2024-09-19T07:02:56.801 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T07:02:56.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T07:02:56.922 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsstress}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911784' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFHrr3pBBTygRqWQI51HXi+CMFDXuVY0GxCgkW5xxO6SbBZu1XERk/5O+O74b1Dtd1vlCicObVeROTHfuHIn0ks= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCF/MZnlmvKx1Mf/Q9l0UMpqpCILvTLnLHKznER0if5f+jANiVRSWUXrKdHhr+S45fYm/eyQB1Qos9YkTgGkILk= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAm/yDiq7Oos5TrSzRdEncXAPjIu6ImvqfG4JaloBN6uCgIZUAexAT/XIzHuE5a03jrd1C5/arAzAhOTDC0Ri9s= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T07:02:56.922 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T07:02:56.922 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T07:02:56.923 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T07:02:56.924 INFO:teuthology.task.internal:Checking packages... 2024-09-19T07:02:56.946 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T07:02:56.946 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T07:02:56.946 INFO:teuthology.packaging:ref: None 2024-09-19T07:02:56.946 INFO:teuthology.packaging:tag: None 2024-09-19T07:02:56.946 INFO:teuthology.packaging:branch: squid 2024-09-19T07:02:56.946 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:02:56.946 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T07:02:57.157 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T07:02:57.158 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T07:02:57.164 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T07:02:57.165 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T07:02:57.207 INFO:teuthology.task.internal:Saving configuration 2024-09-19T07:02:57.229 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T07:02:57.327 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T07:02:57.347 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:57:43.536645', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFHrr3pBBTygRqWQI51HXi+CMFDXuVY0GxCgkW5xxO6SbBZu1XERk/5O+O74b1Dtd1vlCicObVeROTHfuHIn0ks='} 2024-09-19T07:02:57.363 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:57:43.538435', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCF/MZnlmvKx1Mf/Q9l0UMpqpCILvTLnLHKznER0if5f+jANiVRSWUXrKdHhr+S45fYm/eyQB1Qos9YkTgGkILk='} 2024-09-19T07:02:57.381 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:57:43.539858', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAm/yDiq7Oos5TrSzRdEncXAPjIu6ImvqfG4JaloBN6uCgIZUAexAT/XIzHuE5a03jrd1C5/arAzAhOTDC0Ri9s='} 2024-09-19T07:02:57.382 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T07:02:57.434 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T07:02:57.435 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T07:02:57.435 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T07:02:57.435 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T07:02:57.574 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f604cb1f520>, signals=[15]) 2024-09-19T07:02:57.574 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T07:02:57.585 INFO:teuthology.task.internal:Opening connections... 2024-09-19T07:02:57.585 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-19T07:02:57.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:02:57.665 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-09-19T07:02:57.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:02:57.739 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T07:02:57.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:02:57.815 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T07:02:57.821 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-19T07:02:57.840 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-19T07:02:57.841 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-19T07:02:57.898 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-09-19T07:02:57.898 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-09-19T07:02:57.898 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-09-19T07:02:57.898 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-09-19T07:02:57.898 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-09-19T07:02:57.898 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-09-19T07:02:57.898 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T07:02:57.898 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-09-19T07:02:57.899 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-09-19T07:02:57.899 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T07:02:57.899 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-09-19T07:02:57.899 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T07:02:57.899 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T07:02:57.899 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T07:02:57.900 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-19T07:02:57.915 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-09-19T07:02:57.933 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-09-19T07:02:57.933 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-09-19T07:02:57.991 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2024-09-19T07:02:57.991 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2024-09-19T07:02:57.991 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2024-09-19T07:02:57.991 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2024-09-19T07:02:57.991 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2024-09-19T07:02:57.991 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2024-09-19T07:02:57.991 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T07:02:57.991 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2024-09-19T07:02:57.991 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2024-09-19T07:02:57.991 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T07:02:57.992 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2024-09-19T07:02:57.992 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T07:02:57.992 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T07:02:57.992 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T07:02:57.992 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-09-19T07:02:58.015 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-19T07:02:58.034 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-19T07:02:58.034 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-19T07:02:58.093 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-09-19T07:02:58.093 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-09-19T07:02:58.093 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-09-19T07:02:58.093 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-09-19T07:02:58.093 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-09-19T07:02:58.093 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-09-19T07:02:58.093 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T07:02:58.093 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-09-19T07:02:58.093 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-09-19T07:02:58.093 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T07:02:58.093 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-09-19T07:02:58.094 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T07:02:58.094 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T07:02:58.094 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T07:02:58.094 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-19T07:02:58.114 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T07:02:58.126 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T07:02:58.177 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T07:02:58.178 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-19T07:02:58.180 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-09-19T07:02:58.182 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-19T07:02:58.199 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T07:02:58.250 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T07:02:58.250 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-19T07:02:58.253 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-09-19T07:02:58.255 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-19T07:02:58.371 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T07:02:58.440 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T07:02:58.458 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T07:02:58.458 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T07:02:58.458 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T07:02:58.459 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T07:02:58.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:02:58.476 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-19T07:02:58.534 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-503.el9.x86_64 2024-09-19T07:02:58.535 INFO:teuthology.task.kernel:Running kernel on smithi098: 5.14.0-503.el9.x86_64 2024-09-19T07:02:58.535 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum install -y kernel 2024-09-19T07:03:02.202 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.3 MB 00:01 2024-09-19T07:03:03.970 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-19T07:03:08.946 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.5 MB 00:01 2024-09-19T07:03:10.697 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-19T07:03:11.551 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-19T07:03:16.973 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T07:03:18.855 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T07:03:18.855 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T07:03:18.934 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-19T07:03:18.945 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-19T07:03:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-19T07:03:18.946 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-19T07:03:18.946 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-19T07:03:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T07:03:18.946 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-19T07:03:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T07:03:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T07:03:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T07:03:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:03:18.947 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-19T07:03:18.947 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-19T07:03:18.947 INFO:teuthology.orchestra.run.smithi098.stdout:Install 4 Packages 2024-09-19T07:03:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:03:18.948 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 79 M 2024-09-19T07:03:18.948 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 126 M 2024-09-19T07:03:18.948 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-19T07:03:19.167 INFO:teuthology.orchestra.run.smithi098.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 302 kB/s | 36 kB 00:00 2024-09-19T07:03:20.084 INFO:teuthology.orchestra.run.smithi098.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-19T07:03:20.517 INFO:teuthology.orchestra.run.smithi098.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 24 MB/s | 35 MB 00:01 2024-09-19T07:03:20.926 INFO:teuthology.orchestra.run.smithi098.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 16 MB/s | 29 MB 00:01 2024-09-19T07:03:20.926 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:03:20.926 INFO:teuthology.orchestra.run.smithi098.stdout:Total 40 MB/s | 79 MB 00:01 2024-09-19T07:03:21.610 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-19T07:03:21.957 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-19T07:03:21.957 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-19T07:03:22.909 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-19T07:03:22.909 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-19T07:03:25.337 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-19T07:03:26.019 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T07:03:26.111 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T07:03:28.857 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T07:03:28.990 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T07:03:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T07:03:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:03:38.707 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:04:16.412 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:04:16.451 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:04:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:04:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T07:04:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T07:04:16.820 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T07:04:17.627 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T07:04:17.627 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:04:17.627 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-19T07:04:17.627 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T07:04:17.627 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T07:04:17.627 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T07:04:17.627 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T07:04:17.628 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:04:17.628 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-19T07:04:17.966 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T07:04:18.055 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T07:04:18.055 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T07:04:18.055 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T07:04:18.056 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T07:04:18.056 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T07:04:18.056 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T07:04:18.056 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T07:04:18.056 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T07:04:18.114 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T07:04:18.115 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T07:04:18.115 DEBUG:teuthology.orchestra.run.smithi098:> sudo rpm -qi grub2-tools 2024-09-19T07:04:18.156 INFO:teuthology.orchestra.run.smithi098.stdout:Name : grub2-tools 2024-09-19T07:04:18.156 INFO:teuthology.orchestra.run.smithi098.stdout:Epoch : 1 2024-09-19T07:04:18.156 INFO:teuthology.orchestra.run.smithi098.stdout:Version : 2.06 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:Release : 82.el9 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: x86_64 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:Group : Unspecified 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:Size : 8274670 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:License : GPLv3+ 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:Packager : builder@centos.org 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:Vendor : CentOS 2024-09-19T07:04:18.157 INFO:teuthology.orchestra.run.smithi098.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T07:04:18.158 INFO:teuthology.orchestra.run.smithi098.stdout:Summary : Support tools for GRUB. 2024-09-19T07:04:18.158 INFO:teuthology.orchestra.run.smithi098.stdout:Description : 2024-09-19T07:04:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:04:18.158 INFO:teuthology.orchestra.run.smithi098.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T07:04:18.158 INFO:teuthology.orchestra.run.smithi098.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T07:04:18.158 INFO:teuthology.orchestra.run.smithi098.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T07:04:18.158 INFO:teuthology.orchestra.run.smithi098.stdout:hardware devices. 2024-09-19T07:04:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:04:18.158 INFO:teuthology.orchestra.run.smithi098.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T07:04:18.159 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T07:04:18.159 INFO:teuthology.task.kernel:Updating grub on smithi098 to boot 5.14.0-508.el9.x86_64 2024-09-19T07:04:18.159 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T07:04:18.788 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2024-09-19T07:04:20.086 INFO:teuthology.orchestra.run.smithi098.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T07:04:20.114 INFO:teuthology.orchestra.run.smithi098.stderr:done 2024-09-19T07:04:20.117 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-19T07:04:20.133 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.0FyVQcrAVk 2024-09-19T07:04:20.133 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0FyVQcrAVk 2024-09-19T07:04:20.200 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.0FyVQcrAVk 2024-09-19T07:04:20.337 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.0FyVQcrAVk is 6KB 2024-09-19T07:04:20.386 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.0FyVQcrAVk 2024-09-19T07:04:20.401 DEBUG:teuthology.orchestra.run.smithi098:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T07:04:20.463 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T07:04:20.464 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T07:04:20.464 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T07:04:20.464 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T07:04:20.465 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T07:04:20.619 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2024-09-19T07:04:50.622 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T07:04:50.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-19T07:04:50.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:05:09.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-19T07:05:18.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-19T07:05:18.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:05:21.249 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-19T07:05:33.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-19T07:05:33.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:06:05.262 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-19T07:06:05.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-19T07:06:05.620 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T07:06:05.620 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-19T07:06:05.635 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-508.el9.x86_64 2024-09-19T07:06:05.635 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T07:06:05.635 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T07:06:05.635 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T07:06:06.637 DEBUG:teuthology.parallel:result is None 2024-09-19T07:06:06.637 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T07:06:06.645 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T07:06:06.645 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T07:06:06.648 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T07:06:06.651 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T07:06:06.680 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T07:06:06.902 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T07:06:06.976 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T07:06:06.976 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T07:06:06.979 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T07:06:06.982 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T07:06:07.116 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T07:06:07.124 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T07:06:07.125 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T07:06:07.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:06:07.142 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T07:06:07.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:06:07.161 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T07:06:07.164 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T07:06:07.185 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T07:06:07.226 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:06:07.243 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:06:07.245 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:06:07.273 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:06:07.277 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:06:07.340 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T07:06:07.342 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T07:06:07.349 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T07:06:07.349 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T07:06:07.352 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T07:06:07.354 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T07:06:07.406 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T07:06:07.468 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T07:06:07.468 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T07:06:07.471 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T07:06:07.474 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T07:06:07.512 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:06:07.597 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:06:07.647 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:06:07.730 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:06:07.769 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:06:07.769 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T07:06:07.833 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:06:07.879 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:06:07.930 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:06:08.015 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:06:08.059 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-19T07:06:08.059 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T07:06:08.125 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:06:08.172 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T07:06:08.228 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:06:08.311 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T07:06:08.355 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T07:06:08.356 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T07:06:08.423 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-19T07:06:08.425 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-09-19T07:06:08.429 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-19T07:06:08.467 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:06:08.469 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:06:08.510 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:06:08.980 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T07:06:08.987 INFO:teuthology.task.internal:Starting timer... 2024-09-19T07:06:08.987 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T07:06:09.053 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T07:06:09.103 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T07:06:09.103 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-09-19T07:06:09.148 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-09-19T07:06:09.149 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2024-09-19T07:06:09.198 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2024-09-19T07:06:09.200 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-09-19T07:06:09.261 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-09-19T07:06:09.263 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T07:06:09.264 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-09-19T07:06:09.283 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-09-19T07:06:09.284 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2024-09-19T07:06:09.312 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2024-09-19T07:06:09.313 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-09-19T07:06:09.347 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-09-19T07:06:09.347 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi098.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi139.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-09-19T07:06:09.347 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:06:09.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:06:09.376 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:06:09.404 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:06:09.405 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:06:09.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:06:09.433 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T07:06:09.433 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-09-19T07:06:09.460 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2024-09-19T07:06:09.491 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-09-19T07:06:09.527 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T07:06:09.537 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T07:06:09.541 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T07:06:09.666 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T07:06:09.677 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T07:06:09.679 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi098.front.sepia.ceph.com,smithi139.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T07:10:14.240 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-09-19T07:10:14.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-19T07:10:14.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:10:14.319 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-19T07:10:14.403 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-19T07:10:14.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-19T07:10:14.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:10:14.481 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-09-19T07:10:14.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-09-19T07:10:14.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T07:10:14.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T07:10:14.639 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-19T07:10:14.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T07:10:14.717 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T07:10:14.728 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T07:10:14.728 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T07:10:14.729 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:10:14.731 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T07:10:14.731 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:10:14.733 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T07:10:14.734 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:10:14.758 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T07:10:14.765 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T07:10:14.772 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T07:10:14.780 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T07:10:14.785 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T07:10:14.795 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-09-19T07:10:14.800 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T07:10:14.806 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-09-19T07:10:14.807 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2024-09-19T07:10:14.818 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2024-09-19T07:10:14.821 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T07:10:14.825 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-09-19T07:10:14.834 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T07:10:14.834 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T07:10:14.836 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-09-19T07:10:14.848 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T07:10:14.850 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T07:10:14.865 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T07:10:14.888 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:10:14.891 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:10:14.891 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-19T07:10:14.891 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:10:14.891 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:10:14.891 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:10:14.891 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:10:14.909 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:10:14.912 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:10:14.913 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-09-19T07:10:14.913 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:10:14.913 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:10:14.913 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:10:14.913 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:10:14.927 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:10:14.931 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:10:14.931 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-19T07:10:14.931 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:10:14.931 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:10:14.931 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:10:14.931 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:10:14.932 INFO:teuthology.run_tasks:Running task install... 2024-09-19T07:10:14.941 DEBUG:teuthology.task.install:project ceph 2024-09-19T07:10:14.942 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T07:10:14.942 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T07:10:14.942 INFO:teuthology.task.install:Using flavor: default 2024-09-19T07:10:14.948 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T07:10:14.948 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T07:10:14.949 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T07:10:14.949 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:10:14.951 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T07:10:14.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:10:14.953 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T07:10:14.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:10:15.092 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T07:10:15.092 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T07:10:15.102 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T07:10:15.102 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T07:10:15.113 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T07:10:15.113 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T07:10:15.203 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T07:10:15.203 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:10:15.203 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T07:10:15.208 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T07:10:15.208 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T07:10:15.208 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T07:10:15.223 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T07:10:15.223 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-19T07:10:15.223 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T07:10:15.228 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T07:10:15.228 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T07:10:15.233 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T07:10:15.234 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T07:10:15.249 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T07:10:15.250 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T07:10:15.294 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T07:10:15.299 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T07:10:15.316 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T07:10:15.367 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T07:10:15.375 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T07:10:15.392 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T07:10:15.432 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-09-19T07:10:15.433 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-09-19T07:10:15.440 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-09-19T07:10:15.441 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-09-19T07:10:15.455 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2024-09-19T07:10:15.457 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2024-09-19T07:10:15.662 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-09-19T07:10:15.666 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-09-19T07:10:15.680 INFO:teuthology.orchestra.run.smithi139.stdout:45 files removed 2024-09-19T07:10:15.688 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T07:10:15.692 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T07:10:15.707 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T07:10:16.236 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 329 kB/s | 84 kB 00:00 2024-09-19T07:10:16.240 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-19T07:10:16.242 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 307 kB/s | 84 kB 00:00 2024-09-19T07:10:16.503 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-19T07:10:16.518 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-19T07:10:16.541 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-19T07:10:16.762 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-19T07:10:16.777 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-19T07:10:16.816 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T07:10:17.369 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-19T07:10:17.375 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-19T07:10:19.970 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.3 MB 00:03 2024-09-19T07:10:21.927 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 5.8 MB/s | 20 MB 00:03 2024-09-19T07:10:22.096 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-19T07:10:26.061 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 20 MB 00:07 2024-09-19T07:10:26.244 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-19T07:10:27.737 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-19T07:10:28.330 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-19T07:10:28.649 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-19T07:10:29.872 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-19T07:10:30.695 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.5 MB 00:00 2024-09-19T07:10:30.810 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T07:10:32.312 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-19T07:10:33.208 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-19T07:10:34.072 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T07:10:36.320 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:10:36.321 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:10:36.333 INFO:teuthology.orchestra.run.smithi098.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T07:10:36.334 INFO:teuthology.orchestra.run.smithi098.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T07:10:36.335 INFO:teuthology.orchestra.run.smithi098.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T07:10:36.336 INFO:teuthology.orchestra.run.smithi098.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T07:10:36.338 INFO:teuthology.orchestra.run.smithi098.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T07:10:36.340 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T07:10:36.341 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T07:10:36.357 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-19T07:10:36.405 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-19T07:10:36.423 INFO:teuthology.orchestra.run.smithi098.stdout:====================================================================================== 2024-09-19T07:10:36.423 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-19T07:10:36.423 INFO:teuthology.orchestra.run.smithi098.stdout:====================================================================================== 2024-09-19T07:10:36.423 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-19T07:10:36.423 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T07:10:36.424 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T07:10:36.424 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T07:10:36.424 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T07:10:36.424 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T07:10:36.424 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T07:10:36.424 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T07:10:36.424 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T07:10:36.424 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T07:10:36.424 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T07:10:36.424 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T07:10:36.424 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T07:10:36.424 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T07:10:36.425 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T07:10:36.425 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T07:10:36.425 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T07:10:36.425 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T07:10:36.425 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T07:10:36.425 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T07:10:36.425 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T07:10:36.425 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T07:10:36.425 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T07:10:36.425 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T07:10:36.425 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T07:10:36.426 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T07:10:36.426 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T07:10:36.426 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T07:10:36.426 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T07:10:36.426 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T07:10:36.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T07:10:36.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T07:10:36.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T07:10:36.426 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T07:10:36.426 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T07:10:36.427 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T07:10:36.427 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T07:10:36.427 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T07:10:36.427 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-09-19T07:10:36.427 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T07:10:36.427 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T07:10:36.427 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T07:10:36.427 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T07:10:36.427 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T07:10:36.427 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T07:10:36.427 INFO:teuthology.orchestra.run.smithi098.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T07:10:36.427 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T07:10:36.428 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-19T07:10:36.428 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T07:10:36.428 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T07:10:36.428 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T07:10:36.428 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T07:10:36.428 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T07:10:36.428 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T07:10:36.428 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T07:10:36.428 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T07:10:36.428 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T07:10:36.428 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T07:10:36.428 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T07:10:36.429 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T07:10:36.429 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T07:10:36.429 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T07:10:36.430 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T07:10:36.430 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T07:10:36.430 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T07:10:36.430 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T07:10:36.430 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T07:10:36.430 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T07:10:36.430 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T07:10:36.430 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T07:10:36.430 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T07:10:36.430 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T07:10:36.430 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T07:10:36.430 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T07:10:36.431 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T07:10:36.432 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T07:10:36.432 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T07:10:36.432 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T07:10:36.432 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T07:10:36.432 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T07:10:36.432 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T07:10:36.432 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T07:10:36.432 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T07:10:36.432 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T07:10:36.432 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T07:10:36.432 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T07:10:36.432 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T07:10:36.433 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T07:10:36.434 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T07:10:36.435 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T07:10:36.436 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T07:10:36.436 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T07:10:36.436 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T07:10:36.436 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T07:10:36.436 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T07:10:36.436 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T07:10:36.436 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T07:10:36.436 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T07:10:36.436 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T07:10:36.436 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T07:10:36.436 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T07:10:36.436 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T07:10:36.437 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T07:10:36.437 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T07:10:36.437 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T07:10:36.437 INFO:teuthology.orchestra.run.smithi098.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T07:10:36.437 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T07:10:36.437 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T07:10:36.437 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-09-19T07:10:36.437 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T07:10:36.437 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:10:36.437 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-19T07:10:36.437 INFO:teuthology.orchestra.run.smithi098.stdout:====================================================================================== 2024-09-19T07:10:36.437 INFO:teuthology.orchestra.run.smithi098.stdout:Install 148 Packages 2024-09-19T07:10:36.438 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 8 Packages 2024-09-19T07:10:36.438 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:10:36.438 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 226 M 2024-09-19T07:10:36.438 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-19T07:10:37.124 INFO:teuthology.orchestra.run.smithi098.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 48 kB/s | 6.6 kB 00:00 2024-09-19T07:10:37.457 INFO:teuthology.orchestra.run.smithi098.stdout:(2/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T07:10:37.483 INFO:teuthology.orchestra.run.smithi098.stdout:(3/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.4 MB/s | 896 kB 00:00 2024-09-19T07:10:37.508 INFO:teuthology.orchestra.run.smithi098.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 2.8 MB/s | 145 kB 00:00 2024-09-19T07:10:37.583 INFO:teuthology.orchestra.run.smithi098.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 20 MB/s | 1.5 MB 00:00 2024-09-19T07:10:37.858 INFO:teuthology.orchestra.run.smithi098.stdout:(6/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-19T07:10:38.109 INFO:teuthology.orchestra.run.smithi098.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 19 MB/s | 21 MB 00:01 2024-09-19T07:10:38.159 INFO:teuthology.orchestra.run.smithi098.stdout:(8/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 3.5 MB/s | 2.4 MB 00:00 2024-09-19T07:10:38.234 INFO:teuthology.orchestra.run.smithi098.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 335 kB/s | 25 kB 00:00 2024-09-19T07:10:38.502 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:10:38.503 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:10:38.515 INFO:teuthology.orchestra.run.smithi139.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T07:10:38.516 INFO:teuthology.orchestra.run.smithi139.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T07:10:38.517 INFO:teuthology.orchestra.run.smithi139.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T07:10:38.518 INFO:teuthology.orchestra.run.smithi139.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T07:10:38.520 INFO:teuthology.orchestra.run.smithi139.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T07:10:38.523 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T07:10:38.524 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T07:10:38.588 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-09-19T07:10:38.610 INFO:teuthology.orchestra.run.smithi139.stdout:====================================================================================== 2024-09-19T07:10:38.610 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-09-19T07:10:38.610 INFO:teuthology.orchestra.run.smithi139.stdout:====================================================================================== 2024-09-19T07:10:38.610 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-09-19T07:10:38.610 INFO:teuthology.orchestra.run.smithi139.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T07:10:38.611 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T07:10:38.611 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T07:10:38.611 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T07:10:38.611 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T07:10:38.611 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T07:10:38.611 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T07:10:38.611 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T07:10:38.611 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T07:10:38.611 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T07:10:38.611 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T07:10:38.611 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T07:10:38.611 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T07:10:38.612 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T07:10:38.612 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T07:10:38.612 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T07:10:38.612 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T07:10:38.612 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T07:10:38.612 INFO:teuthology.orchestra.run.smithi139.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T07:10:38.612 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T07:10:38.612 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T07:10:38.612 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T07:10:38.612 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T07:10:38.612 INFO:teuthology.orchestra.run.smithi139.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T07:10:38.613 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T07:10:38.613 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T07:10:38.613 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T07:10:38.613 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T07:10:38.613 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T07:10:38.613 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T07:10:38.613 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T07:10:38.613 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T07:10:38.613 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T07:10:38.613 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T07:10:38.613 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T07:10:38.613 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T07:10:38.614 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T07:10:38.614 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2024-09-19T07:10:38.614 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T07:10:38.614 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T07:10:38.614 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T07:10:38.614 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T07:10:38.614 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T07:10:38.614 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T07:10:38.614 INFO:teuthology.orchestra.run.smithi139.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T07:10:38.614 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T07:10:38.614 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-09-19T07:10:38.615 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T07:10:38.615 INFO:teuthology.orchestra.run.smithi139.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T07:10:38.615 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T07:10:38.615 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T07:10:38.615 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T07:10:38.615 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T07:10:38.615 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T07:10:38.615 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T07:10:38.615 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T07:10:38.615 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T07:10:38.615 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T07:10:38.616 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T07:10:38.616 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T07:10:38.616 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T07:10:38.616 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T07:10:38.616 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T07:10:38.616 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T07:10:38.616 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T07:10:38.616 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T07:10:38.616 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T07:10:38.616 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T07:10:38.616 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T07:10:38.616 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T07:10:38.617 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T07:10:38.617 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T07:10:38.617 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T07:10:38.617 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T07:10:38.617 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T07:10:38.617 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T07:10:38.617 INFO:teuthology.orchestra.run.smithi139.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T07:10:38.617 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T07:10:38.617 INFO:teuthology.orchestra.run.smithi139.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T07:10:38.617 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T07:10:38.617 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T07:10:38.618 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T07:10:38.618 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T07:10:38.618 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T07:10:38.618 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T07:10:38.618 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T07:10:38.618 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T07:10:38.618 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T07:10:38.618 INFO:teuthology.orchestra.run.smithi139.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T07:10:38.619 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T07:10:38.619 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T07:10:38.619 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T07:10:38.619 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T07:10:38.619 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T07:10:38.619 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T07:10:38.619 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T07:10:38.619 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T07:10:38.619 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T07:10:38.620 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T07:10:38.620 INFO:teuthology.orchestra.run.smithi139.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T07:10:38.620 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T07:10:38.620 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T07:10:38.620 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T07:10:38.620 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T07:10:38.620 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T07:10:38.620 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T07:10:38.620 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T07:10:38.620 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T07:10:38.620 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T07:10:38.621 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T07:10:38.621 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T07:10:38.621 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T07:10:38.621 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T07:10:38.621 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T07:10:38.621 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T07:10:38.621 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T07:10:38.621 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T07:10:38.621 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T07:10:38.621 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T07:10:38.621 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T07:10:38.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T07:10:38.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T07:10:38.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T07:10:38.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T07:10:38.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T07:10:38.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T07:10:38.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T07:10:38.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T07:10:38.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T07:10:38.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T07:10:38.622 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T07:10:38.623 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T07:10:38.623 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T07:10:38.623 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T07:10:38.623 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T07:10:38.623 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T07:10:38.623 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T07:10:38.623 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T07:10:38.623 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T07:10:38.624 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T07:10:38.624 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T07:10:38.624 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T07:10:38.624 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T07:10:38.624 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T07:10:38.624 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T07:10:38.624 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T07:10:38.625 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T07:10:38.625 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T07:10:38.625 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T07:10:38.625 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T07:10:38.625 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T07:10:38.625 INFO:teuthology.orchestra.run.smithi139.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T07:10:38.625 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T07:10:38.625 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T07:10:38.625 INFO:teuthology.orchestra.run.smithi139.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T07:10:38.625 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T07:10:38.626 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T07:10:38.626 INFO:teuthology.orchestra.run.smithi139.stdout:Installing weak dependencies: 2024-09-19T07:10:38.626 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T07:10:38.626 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:10:38.626 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-09-19T07:10:38.626 INFO:teuthology.orchestra.run.smithi139.stdout:====================================================================================== 2024-09-19T07:10:38.626 INFO:teuthology.orchestra.run.smithi139.stdout:Install 148 Packages 2024-09-19T07:10:38.626 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 8 Packages 2024-09-19T07:10:38.627 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:10:38.627 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 226 M 2024-09-19T07:10:38.627 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-09-19T07:10:38.643 INFO:teuthology.orchestra.run.smithi098.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 20 MB/s | 11 MB 00:00 2024-09-19T07:10:38.730 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T07:10:38.860 INFO:teuthology.orchestra.run.smithi098.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 17 MB/s | 17 MB 00:01 2024-09-19T07:10:38.885 INFO:teuthology.orchestra.run.smithi098.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 944 kB/s | 228 kB 00:00 2024-09-19T07:10:38.902 INFO:teuthology.orchestra.run.smithi098.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 650 kB/s | 27 kB 00:00 2024-09-19T07:10:38.927 INFO:teuthology.orchestra.run.smithi098.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 758 kB/s | 32 kB 00:00 2024-09-19T07:10:38.977 INFO:teuthology.orchestra.run.smithi098.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-19T07:10:39.003 INFO:teuthology.orchestra.run.smithi098.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T07:10:39.028 INFO:teuthology.orchestra.run.smithi098.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T07:10:39.062 INFO:teuthology.orchestra.run.smithi098.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 8.4 MB/s | 506 kB 00:00 2024-09-19T07:10:39.120 INFO:teuthology.orchestra.run.smithi098.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 774 kB/s | 45 kB 00:00 2024-09-19T07:10:39.196 INFO:teuthology.orchestra.run.smithi098.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T07:10:39.242 INFO:teuthology.orchestra.run.smithi139.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 50 kB/s | 6.6 kB 00:00 2024-09-19T07:10:39.279 INFO:teuthology.orchestra.run.smithi098.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 21 MB/s | 5.3 MB 00:00 2024-09-19T07:10:39.296 INFO:teuthology.orchestra.run.smithi098.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.6 MB/s | 161 kB 00:00 2024-09-19T07:10:39.330 INFO:teuthology.orchestra.run.smithi098.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T07:10:39.355 INFO:teuthology.orchestra.run.smithi098.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T07:10:39.380 INFO:teuthology.orchestra.run.smithi098.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T07:10:39.414 INFO:teuthology.orchestra.run.smithi098.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T07:10:39.648 INFO:teuthology.orchestra.run.smithi098.stdout:(27/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-19T07:10:39.684 INFO:teuthology.orchestra.run.smithi139.stdout:(2/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 9.4 MB/s | 5.4 MB 00:00 2024-09-19T07:10:39.698 INFO:teuthology.orchestra.run.smithi098.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 639 kB/s | 32 kB 00:00 2024-09-19T07:10:39.717 INFO:teuthology.orchestra.run.smithi139.stdout:(3/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.8 MB/s | 896 kB 00:00 2024-09-19T07:10:39.748 INFO:teuthology.orchestra.run.smithi098.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T07:10:39.768 INFO:teuthology.orchestra.run.smithi139.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.7 MB/s | 145 kB 00:00 2024-09-19T07:10:39.876 INFO:teuthology.orchestra.run.smithi139.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 1.5 MB 00:00 2024-09-19T07:10:39.899 INFO:teuthology.orchestra.run.smithi098.stdout:(30/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 353 kB/s | 171 kB 00:00 2024-09-19T07:10:39.957 INFO:teuthology.orchestra.run.smithi098.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 17 MB/s | 3.6 MB 00:00 2024-09-19T07:10:40.058 INFO:teuthology.orchestra.run.smithi098.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.4 MB/s | 249 kB 00:00 2024-09-19T07:10:40.141 INFO:teuthology.orchestra.run.smithi098.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 592 kB/s | 49 kB 00:00 2024-09-19T07:10:40.143 INFO:teuthology.orchestra.run.smithi139.stdout:(6/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-19T07:10:40.192 INFO:teuthology.orchestra.run.smithi098.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 329 kB/s | 16 kB 00:00 2024-09-19T07:10:40.202 INFO:teuthology.orchestra.run.smithi139.stdout:(7/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 4.9 MB/s | 2.4 MB 00:00 2024-09-19T07:10:40.267 INFO:teuthology.orchestra.run.smithi098.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.7 MB/s | 285 kB 00:00 2024-09-19T07:10:40.802 INFO:teuthology.orchestra.run.smithi139.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 13 MB/s | 21 MB 00:01 2024-09-19T07:10:40.852 INFO:teuthology.orchestra.run.smithi139.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 507 kB/s | 25 kB 00:00 2024-09-19T07:10:40.873 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:10:40.874 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T07:10:40.876 INFO:teuthology.orchestra.run.smithi098.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 7.6 MB/s | 7.4 MB 00:00 2024-09-19T07:10:40.885 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T07:10:40.886 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T07:10:40.887 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T07:10:40.888 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T07:10:40.889 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T07:10:40.891 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T07:10:40.892 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T07:10:40.917 INFO:teuthology.orchestra.run.smithi098.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 1.1 MB/s | 765 kB 00:00 2024-09-19T07:10:40.943 INFO:teuthology.orchestra.run.smithi098.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 273 kB/s | 18 kB 00:00 2024-09-19T07:10:40.955 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-19T07:10:40.971 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-19T07:10:40.972 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-19T07:10:40.972 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-19T07:10:40.972 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-19T07:10:40.972 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T07:10:40.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T07:10:40.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T07:10:40.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T07:10:40.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T07:10:40.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T07:10:40.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T07:10:40.972 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T07:10:40.973 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T07:10:40.974 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T07:10:40.975 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T07:10:40.976 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T07:10:40.977 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T07:10:40.978 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T07:10:40.978 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T07:10:40.978 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T07:10:40.978 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T07:10:40.978 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T07:10:40.978 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T07:10:40.978 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T07:10:40.978 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T07:10:40.978 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T07:10:40.978 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T07:10:40.979 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T07:10:40.980 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T07:10:40.981 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T07:10:40.982 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T07:10:40.983 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T07:10:40.984 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T07:10:40.984 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T07:10:40.984 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T07:10:40.984 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T07:10:40.984 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-09-19T07:10:40.984 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T07:10:40.984 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:10:40.984 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-19T07:10:40.984 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-19T07:10:40.984 INFO:teuthology.orchestra.run.smithi162.stdout:Install 148 Packages 2024-09-19T07:10:40.984 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 8 Packages 2024-09-19T07:10:40.984 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:10:40.985 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 226 M 2024-09-19T07:10:40.985 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-19T07:10:41.035 INFO:teuthology.orchestra.run.smithi098.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 682 kB/s | 80 kB 00:00 2024-09-19T07:10:41.093 INFO:teuthology.orchestra.run.smithi098.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T07:10:41.127 INFO:teuthology.orchestra.run.smithi139.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 17 MB/s | 17 MB 00:00 2024-09-19T07:10:41.135 INFO:teuthology.orchestra.run.smithi098.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-19T07:10:41.161 INFO:teuthology.orchestra.run.smithi098.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-19T07:10:41.186 INFO:teuthology.orchestra.run.smithi139.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T07:10:41.202 INFO:teuthology.orchestra.run.smithi098.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-09-19T07:10:41.228 INFO:teuthology.orchestra.run.smithi098.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-19T07:10:41.244 INFO:teuthology.orchestra.run.smithi139.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 465 kB/s | 27 kB 00:00 2024-09-19T07:10:41.245 INFO:teuthology.orchestra.run.smithi098.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 3.1 MB/s | 135 kB 00:00 2024-09-19T07:10:41.270 INFO:teuthology.orchestra.run.smithi098.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-19T07:10:41.295 INFO:teuthology.orchestra.run.smithi098.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T07:10:41.303 INFO:teuthology.orchestra.run.smithi139.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 546 kB/s | 32 kB 00:00 2024-09-19T07:10:41.332 INFO:teuthology.orchestra.run.smithi162.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 49 kB/s | 6.6 kB 00:00 2024-09-19T07:10:41.378 INFO:teuthology.orchestra.run.smithi139.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-19T07:10:41.445 INFO:teuthology.orchestra.run.smithi139.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T07:10:41.512 INFO:teuthology.orchestra.run.smithi139.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T07:10:41.562 INFO:teuthology.orchestra.run.smithi098.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-19T07:10:41.587 INFO:teuthology.orchestra.run.smithi139.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T07:10:41.613 INFO:teuthology.orchestra.run.smithi098.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-19T07:10:41.655 INFO:teuthology.orchestra.run.smithi098.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 521 kB/s | 22 kB 00:00 2024-09-19T07:10:41.688 INFO:teuthology.orchestra.run.smithi098.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 943 kB 00:00 2024-09-19T07:10:41.714 INFO:teuthology.orchestra.run.smithi098.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-19T07:10:41.729 INFO:teuthology.orchestra.run.smithi139.stdout:(18/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 6.9 MB/s | 11 MB 00:01 2024-09-19T07:10:41.731 INFO:teuthology.orchestra.run.smithi098.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 777 kB/s | 33 kB 00:00 2024-09-19T07:10:41.773 INFO:teuthology.orchestra.run.smithi098.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-19T07:10:41.782 INFO:teuthology.orchestra.run.smithi162.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.9 MB/s | 896 kB 00:00 2024-09-19T07:10:41.816 INFO:teuthology.orchestra.run.smithi139.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 523 kB/s | 45 kB 00:00 2024-09-19T07:10:41.823 INFO:teuthology.orchestra.run.smithi098.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-19T07:10:41.882 INFO:teuthology.orchestra.run.smithi098.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-19T07:10:41.882 INFO:teuthology.orchestra.run.smithi162.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.4 MB/s | 145 kB 00:00 2024-09-19T07:10:41.888 INFO:teuthology.orchestra.run.smithi139.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.9 MB/s | 136 kB 00:00 2024-09-19T07:10:41.932 INFO:teuthology.orchestra.run.smithi098.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-19T07:10:41.964 INFO:teuthology.orchestra.run.smithi139.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-19T07:10:41.981 INFO:teuthology.orchestra.run.smithi139.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.7 MB/s | 161 kB 00:00 2024-09-19T07:10:41.999 INFO:teuthology.orchestra.run.smithi098.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-19T07:10:42.022 INFO:teuthology.orchestra.run.smithi139.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 5.4 MB/s | 320 kB 00:00 2024-09-19T07:10:42.056 INFO:teuthology.orchestra.run.smithi139.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 300 kB 00:00 2024-09-19T07:10:42.081 INFO:teuthology.orchestra.run.smithi139.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T07:10:42.115 INFO:teuthology.orchestra.run.smithi139.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T07:10:42.198 INFO:teuthology.orchestra.run.smithi139.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-19T07:10:42.265 INFO:teuthology.orchestra.run.smithi139.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 479 kB/s | 32 kB 00:00 2024-09-19T07:10:42.316 INFO:teuthology.orchestra.run.smithi098.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 1.8 MB/s | 581 kB 00:00 2024-09-19T07:10:42.341 INFO:teuthology.orchestra.run.smithi139.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-19T07:10:42.358 INFO:teuthology.orchestra.run.smithi098.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 590 kB/s | 24 kB 00:00 2024-09-19T07:10:42.366 INFO:teuthology.orchestra.run.smithi139.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.4 MB/s | 146 kB 00:00 2024-09-19T07:10:42.408 INFO:teuthology.orchestra.run.smithi098.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2024-09-19T07:10:42.491 INFO:teuthology.orchestra.run.smithi162.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 3.9 MB/s | 2.4 MB 00:00 2024-09-19T07:10:42.592 INFO:teuthology.orchestra.run.smithi098.stdout:(62/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-19T07:10:42.625 INFO:teuthology.orchestra.run.smithi139.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 13 MB/s | 3.6 MB 00:00 2024-09-19T07:10:42.700 INFO:teuthology.orchestra.run.smithi139.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.3 MB/s | 249 kB 00:00 2024-09-19T07:10:42.709 INFO:teuthology.orchestra.run.smithi098.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-19T07:10:42.725 INFO:teuthology.orchestra.run.smithi162.stdout:(5/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.5 MB/s | 5.4 MB 00:01 2024-09-19T07:10:42.750 INFO:teuthology.orchestra.run.smithi139.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 989 kB/s | 49 kB 00:00 2024-09-19T07:10:42.792 INFO:teuthology.orchestra.run.smithi098.stdout:(64/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-19T07:10:42.817 INFO:teuthology.orchestra.run.smithi162.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.7 MB/s | 1.5 MB 00:00 2024-09-19T07:10:42.818 INFO:teuthology.orchestra.run.smithi098.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 354 kB/s | 38 kB 00:00 2024-09-19T07:10:43.167 INFO:teuthology.orchestra.run.smithi162.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-19T07:10:43.167 INFO:teuthology.orchestra.run.smithi139.stdout:(34/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 21 MB/s | 49 MB 00:02 2024-09-19T07:10:43.184 INFO:teuthology.orchestra.run.smithi139.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 38 kB/s | 16 kB 00:00 2024-09-19T07:10:43.234 INFO:teuthology.orchestra.run.smithi139.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.2 MB/s | 285 kB 00:00 2024-09-19T07:10:43.318 INFO:teuthology.orchestra.run.smithi139.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.6 MB/s | 765 kB 00:00 2024-09-19T07:10:43.335 INFO:teuthology.orchestra.run.smithi139.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 182 kB/s | 18 kB 00:00 2024-09-19T07:10:43.427 INFO:teuthology.orchestra.run.smithi139.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 736 kB/s | 80 kB 00:00 2024-09-19T07:10:43.477 INFO:teuthology.orchestra.run.smithi139.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.8 MB/s | 191 kB 00:00 2024-09-19T07:10:43.511 INFO:teuthology.orchestra.run.smithi139.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-19T07:10:43.552 INFO:teuthology.orchestra.run.smithi139.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-19T07:10:43.645 INFO:teuthology.orchestra.run.smithi139.stdout:(43/156): ceph-mgr-diskprediction-local-19.1.1- 5.8 MB/s | 7.4 MB 00:01 2024-09-19T07:10:43.670 INFO:teuthology.orchestra.run.smithi139.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 912 kB/s | 106 kB 00:00 2024-09-19T07:10:43.704 INFO:teuthology.orchestra.run.smithi139.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-19T07:10:43.728 INFO:teuthology.orchestra.run.smithi139.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T07:10:43.745 INFO:teuthology.orchestra.run.smithi139.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 5.1 MB/s | 215 kB 00:00 2024-09-19T07:10:43.770 INFO:teuthology.orchestra.run.smithi139.stdout:(48/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-19T07:10:43.887 INFO:teuthology.orchestra.run.smithi139.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 917 kB/s | 107 kB 00:00 2024-09-19T07:10:43.892 INFO:teuthology.orchestra.run.smithi162.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 7.9 MB/s | 21 MB 00:02 2024-09-19T07:10:43.912 INFO:teuthology.orchestra.run.smithi139.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-19T07:10:43.937 INFO:teuthology.orchestra.run.smithi139.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-19T07:10:43.963 INFO:teuthology.orchestra.run.smithi139.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-19T07:10:43.988 INFO:teuthology.orchestra.run.smithi139.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-19T07:10:44.022 INFO:teuthology.orchestra.run.smithi139.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-19T07:10:44.025 INFO:teuthology.orchestra.run.smithi162.stdout:(9/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 12 MB/s | 11 MB 00:00 2024-09-19T07:10:44.043 INFO:teuthology.orchestra.run.smithi162.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 167 kB/s | 25 kB 00:00 2024-09-19T07:10:44.047 INFO:teuthology.orchestra.run.smithi139.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-19T07:10:44.072 INFO:teuthology.orchestra.run.smithi139.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T07:10:44.106 INFO:teuthology.orchestra.run.smithi139.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-19T07:10:44.131 INFO:teuthology.orchestra.run.smithi139.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-09-19T07:10:44.165 INFO:teuthology.orchestra.run.smithi139.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T07:10:44.198 INFO:teuthology.orchestra.run.smithi139.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 739 kB/s | 24 kB 00:00 2024-09-19T07:10:44.210 INFO:teuthology.orchestra.run.smithi162.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 17 MB 00:01 2024-09-19T07:10:44.234 INFO:teuthology.orchestra.run.smithi162.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.2 MB/s | 228 kB 00:00 2024-09-19T07:10:44.249 INFO:teuthology.orchestra.run.smithi139.stdout:(61/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-09-19T07:10:44.251 INFO:teuthology.orchestra.run.smithi162.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 650 kB/s | 27 kB 00:00 2024-09-19T07:10:44.265 INFO:teuthology.orchestra.run.smithi139.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-09-19T07:10:44.268 INFO:teuthology.orchestra.run.smithi162.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 942 kB/s | 32 kB 00:00 2024-09-19T07:10:44.291 INFO:teuthology.orchestra.run.smithi139.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-19T07:10:44.317 INFO:teuthology.orchestra.run.smithi139.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-19T07:10:44.319 INFO:teuthology.orchestra.run.smithi162.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T07:10:44.333 INFO:teuthology.orchestra.run.smithi139.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 919 kB/s | 38 kB 00:00 2024-09-19T07:10:44.344 INFO:teuthology.orchestra.run.smithi162.stdout:(16/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-19T07:10:44.358 INFO:teuthology.orchestra.run.smithi139.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-19T07:10:44.378 INFO:teuthology.orchestra.run.smithi162.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T07:10:44.420 INFO:teuthology.orchestra.run.smithi162.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T07:10:44.459 INFO:teuthology.orchestra.run.smithi139.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-19T07:10:44.492 INFO:teuthology.orchestra.run.smithi139.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-19T07:10:44.495 INFO:teuthology.orchestra.run.smithi162.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 603 kB/s | 45 kB 00:00 2024-09-19T07:10:44.534 INFO:teuthology.orchestra.run.smithi139.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-19T07:10:44.559 INFO:teuthology.orchestra.run.smithi139.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T07:10:44.570 INFO:teuthology.orchestra.run.smithi162.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T07:10:44.618 INFO:teuthology.orchestra.run.smithi139.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-19T07:10:44.652 INFO:teuthology.orchestra.run.smithi139.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-19T07:10:44.654 INFO:teuthology.orchestra.run.smithi162.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.9 MB/s | 161 kB 00:00 2024-09-19T07:10:44.677 INFO:teuthology.orchestra.run.smithi139.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T07:10:44.710 INFO:teuthology.orchestra.run.smithi139.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-19T07:10:44.746 INFO:teuthology.orchestra.run.smithi162.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.4 MB/s | 320 kB 00:00 2024-09-19T07:10:44.786 INFO:teuthology.orchestra.run.smithi139.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-19T07:10:44.811 INFO:teuthology.orchestra.run.smithi139.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T07:10:44.821 INFO:teuthology.orchestra.run.smithi162.stdout:(23/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-19T07:10:44.836 INFO:teuthology.orchestra.run.smithi139.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T07:10:44.847 INFO:teuthology.orchestra.run.smithi162.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.9 MB/s | 300 kB 00:00 2024-09-19T07:10:44.853 INFO:teuthology.orchestra.run.smithi139.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 612 kB/s | 26 kB 00:00 2024-09-19T07:10:44.872 INFO:teuthology.orchestra.run.smithi162.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T07:10:44.897 INFO:teuthology.orchestra.run.smithi162.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T07:10:44.941 INFO:teuthology.orchestra.run.smithi162.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 4.0 MB/s | 171 kB 00:00 2024-09-19T07:10:44.978 INFO:teuthology.orchestra.run.smithi139.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 135 kB/s | 19 kB 00:00 2024-09-19T07:10:45.004 INFO:teuthology.orchestra.run.smithi139.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-19T07:10:45.029 INFO:teuthology.orchestra.run.smithi139.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-19T07:10:45.039 INFO:teuthology.orchestra.run.smithi162.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-19T07:10:45.065 INFO:teuthology.orchestra.run.smithi162.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 254 kB/s | 32 kB 00:00 2024-09-19T07:10:45.090 INFO:teuthology.orchestra.run.smithi162.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T07:10:45.104 INFO:teuthology.orchestra.run.smithi139.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-19T07:10:45.129 INFO:teuthology.orchestra.run.smithi139.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-19T07:10:45.155 INFO:teuthology.orchestra.run.smithi139.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T07:10:45.180 INFO:teuthology.orchestra.run.smithi139.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T07:10:45.205 INFO:teuthology.orchestra.run.smithi139.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-19T07:10:45.230 INFO:teuthology.orchestra.run.smithi139.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-19T07:10:45.256 INFO:teuthology.orchestra.run.smithi139.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T07:10:45.281 INFO:teuthology.orchestra.run.smithi139.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T07:10:45.284 INFO:teuthology.orchestra.run.smithi098.stdout:(66/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 6.9 MB/s | 49 MB 00:07 2024-09-19T07:10:45.298 INFO:teuthology.orchestra.run.smithi139.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T07:10:45.315 INFO:teuthology.orchestra.run.smithi139.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-19T07:10:45.343 INFO:teuthology.orchestra.run.smithi098.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.8 MB/s | 4.4 MB 00:02 2024-09-19T07:10:45.390 INFO:teuthology.orchestra.run.smithi139.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-19T07:10:45.404 INFO:teuthology.orchestra.run.smithi162.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 11 MB/s | 3.6 MB 00:00 2024-09-19T07:10:45.410 INFO:teuthology.orchestra.run.smithi098.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 1.9 MB/s | 4.9 MB 00:02 2024-09-19T07:10:45.415 INFO:teuthology.orchestra.run.smithi139.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-19T07:10:45.441 INFO:teuthology.orchestra.run.smithi139.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 887 kB/s | 44 kB 00:00 2024-09-19T07:10:45.469 INFO:teuthology.orchestra.run.smithi098.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T07:10:45.471 INFO:teuthology.orchestra.run.smithi162.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.7 MB/s | 249 kB 00:00 2024-09-19T07:10:45.474 INFO:teuthology.orchestra.run.smithi139.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T07:10:45.499 INFO:teuthology.orchestra.run.smithi139.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-09-19T07:10:45.525 INFO:teuthology.orchestra.run.smithi139.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-19T07:10:45.535 INFO:teuthology.orchestra.run.smithi098.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-19T07:10:45.553 INFO:teuthology.orchestra.run.smithi139.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T07:10:45.555 INFO:teuthology.orchestra.run.smithi162.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-19T07:10:45.575 INFO:teuthology.orchestra.run.smithi139.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T07:10:45.580 INFO:teuthology.orchestra.run.smithi162.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 454 kB/s | 49 kB 00:00 2024-09-19T07:10:45.600 INFO:teuthology.orchestra.run.smithi139.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T07:10:45.605 INFO:teuthology.orchestra.run.smithi162.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 328 kB/s | 16 kB 00:00 2024-09-19T07:10:45.626 INFO:teuthology.orchestra.run.smithi139.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T07:10:45.630 INFO:teuthology.orchestra.run.smithi162.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T07:10:45.651 INFO:teuthology.orchestra.run.smithi139.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-19T07:10:45.664 INFO:teuthology.orchestra.run.smithi162.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 13 MB/s | 765 kB 00:00 2024-09-19T07:10:45.681 INFO:teuthology.orchestra.run.smithi162.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 364 kB/s | 18 kB 00:00 2024-09-19T07:10:45.786 INFO:teuthology.orchestra.run.smithi098.stdout:(71/156): postgresql-13.16-1.el9.x86_64.rpm 3.2 MB/s | 1.6 MB 00:00 2024-09-19T07:10:45.869 INFO:teuthology.orchestra.run.smithi098.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-19T07:10:45.893 INFO:teuthology.orchestra.run.smithi139.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-19T07:10:45.918 INFO:teuthology.orchestra.run.smithi139.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-09-19T07:10:45.993 INFO:teuthology.orchestra.run.smithi139.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 4.0 MB/s | 308 kB 00:00 2024-09-19T07:10:46.019 INFO:teuthology.orchestra.run.smithi139.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-09-19T07:10:46.036 INFO:teuthology.orchestra.run.smithi139.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 467 kB/s | 19 kB 00:00 2024-09-19T07:10:46.053 INFO:teuthology.orchestra.run.smithi139.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-19T07:10:46.078 INFO:teuthology.orchestra.run.smithi139.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T07:10:46.078 INFO:teuthology.orchestra.run.smithi098.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.9 MB/s | 1.0 MB 00:00 2024-09-19T07:10:46.111 INFO:teuthology.orchestra.run.smithi139.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-19T07:10:46.120 INFO:teuthology.orchestra.run.smithi098.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T07:10:46.137 INFO:teuthology.orchestra.run.smithi139.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-19T07:10:46.157 INFO:teuthology.orchestra.run.smithi162.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 23 MB/s | 49 MB 00:02 2024-09-19T07:10:46.190 INFO:teuthology.orchestra.run.smithi162.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 152 kB/s | 80 kB 00:00 2024-09-19T07:10:46.203 INFO:teuthology.orchestra.run.smithi139.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-09-19T07:10:46.245 INFO:teuthology.orchestra.run.smithi139.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.1 MB/s | 839 kB 00:00 2024-09-19T07:10:46.262 INFO:teuthology.orchestra.run.smithi139.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-19T07:10:46.279 INFO:teuthology.orchestra.run.smithi139.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T07:10:46.283 INFO:teuthology.orchestra.run.smithi098.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-09-19T07:10:46.305 INFO:teuthology.orchestra.run.smithi139.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-19T07:10:46.307 INFO:teuthology.orchestra.run.smithi162.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-19T07:10:46.334 INFO:teuthology.orchestra.run.smithi162.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-19T07:10:46.358 INFO:teuthology.orchestra.run.smithi162.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-19T07:10:46.372 INFO:teuthology.orchestra.run.smithi139.stdout:(117/156): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-19T07:10:46.397 INFO:teuthology.orchestra.run.smithi139.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-09-19T07:10:46.408 INFO:teuthology.orchestra.run.smithi162.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-19T07:10:46.429 INFO:teuthology.orchestra.run.smithi098.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-19T07:10:46.430 INFO:teuthology.orchestra.run.smithi139.stdout:(119/156): python3-asyncssh-2.13.2-5.el9.noarch 2.4 MB/s | 548 kB 00:00 2024-09-19T07:10:46.456 INFO:teuthology.orchestra.run.smithi139.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T07:10:46.458 INFO:teuthology.orchestra.run.smithi162.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-09-19T07:10:46.479 INFO:teuthology.orchestra.run.smithi098.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-19T07:10:46.481 INFO:teuthology.orchestra.run.smithi139.stdout:(121/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-19T07:10:46.500 INFO:teuthology.orchestra.run.smithi162.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-19T07:10:46.506 INFO:teuthology.orchestra.run.smithi139.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-19T07:10:46.526 INFO:teuthology.orchestra.run.smithi162.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-19T07:10:46.529 INFO:teuthology.orchestra.run.smithi098.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-19T07:10:46.531 INFO:teuthology.orchestra.run.smithi139.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T07:10:46.557 INFO:teuthology.orchestra.run.smithi139.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-19T07:10:46.576 INFO:teuthology.orchestra.run.smithi162.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-19T07:10:46.582 INFO:teuthology.orchestra.run.smithi139.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-19T07:10:46.607 INFO:teuthology.orchestra.run.smithi139.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-19T07:10:46.632 INFO:teuthology.orchestra.run.smithi139.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T07:10:46.638 INFO:teuthology.orchestra.run.smithi098.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-19T07:10:46.658 INFO:teuthology.orchestra.run.smithi139.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T07:10:46.688 INFO:teuthology.orchestra.run.smithi098.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-19T07:10:46.691 INFO:teuthology.orchestra.run.smithi139.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-19T07:10:46.717 INFO:teuthology.orchestra.run.smithi139.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T07:10:46.726 INFO:teuthology.orchestra.run.smithi162.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 713 kB/s | 107 kB 00:00 2024-09-19T07:10:46.742 INFO:teuthology.orchestra.run.smithi139.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T07:10:46.768 INFO:teuthology.orchestra.run.smithi162.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-19T07:10:46.776 INFO:teuthology.orchestra.run.smithi139.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-19T07:10:46.793 INFO:teuthology.orchestra.run.smithi162.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-19T07:10:46.801 INFO:teuthology.orchestra.run.smithi139.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-19T07:10:46.826 INFO:teuthology.orchestra.run.smithi139.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-19T07:10:46.827 INFO:teuthology.orchestra.run.smithi162.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-19T07:10:46.851 INFO:teuthology.orchestra.run.smithi139.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-19T07:10:46.852 INFO:teuthology.orchestra.run.smithi162.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-09-19T07:10:46.868 INFO:teuthology.orchestra.run.smithi139.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 674 kB/s | 28 kB 00:00 2024-09-19T07:10:46.878 INFO:teuthology.orchestra.run.smithi162.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-19T07:10:46.885 INFO:teuthology.orchestra.run.smithi139.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 916 kB/s | 31 kB 00:00 2024-09-19T07:10:46.903 INFO:teuthology.orchestra.run.smithi162.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-19T07:10:46.910 INFO:teuthology.orchestra.run.smithi139.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T07:10:46.927 INFO:teuthology.orchestra.run.smithi139.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-19T07:10:46.928 INFO:teuthology.orchestra.run.smithi162.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T07:10:46.944 INFO:teuthology.orchestra.run.smithi139.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-19T07:10:46.954 INFO:teuthology.orchestra.run.smithi162.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T07:10:46.961 INFO:teuthology.orchestra.run.smithi139.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 2.2 MB/s | 74 kB 00:00 2024-09-19T07:10:46.979 INFO:teuthology.orchestra.run.smithi162.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-19T07:10:47.003 INFO:teuthology.orchestra.run.smithi139.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-09-19T07:10:47.028 INFO:teuthology.orchestra.run.smithi139.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-19T07:10:47.054 INFO:teuthology.orchestra.run.smithi139.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-19T07:10:47.071 INFO:teuthology.orchestra.run.smithi139.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-09-19T07:10:47.096 INFO:teuthology.orchestra.run.smithi139.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T07:10:47.104 INFO:teuthology.orchestra.run.smithi162.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-09-19T07:10:47.130 INFO:teuthology.orchestra.run.smithi139.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T07:10:47.155 INFO:teuthology.orchestra.run.smithi162.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-19T07:10:47.197 INFO:teuthology.orchestra.run.smithi139.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-19T07:10:47.197 INFO:teuthology.orchestra.run.smithi162.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2024-09-19T07:10:47.222 INFO:teuthology.orchestra.run.smithi162.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-19T07:10:47.272 INFO:teuthology.orchestra.run.smithi162.stdout:(63/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.7 MB/s | 3.0 MB 00:00 2024-09-19T07:10:47.297 INFO:teuthology.orchestra.run.smithi162.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-19T07:10:47.323 INFO:teuthology.orchestra.run.smithi162.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 764 kB/s | 38 kB 00:00 2024-09-19T07:10:47.364 INFO:teuthology.orchestra.run.smithi139.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 14 MB/s | 2.3 MB 00:00 2024-09-19T07:10:47.423 INFO:teuthology.orchestra.run.smithi162.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.3 MB/s | 292 kB 00:00 2024-09-19T07:10:47.439 INFO:teuthology.orchestra.run.smithi139.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-09-19T07:10:47.497 INFO:teuthology.orchestra.run.smithi139.stdout:(151/156): librados2-19.1.1-361.g2f599a46.el9.x 8.5 MB/s | 3.4 MB 00:00 2024-09-19T07:10:47.514 INFO:teuthology.orchestra.run.smithi139.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 544 kB/s | 41 kB 00:00 2024-09-19T07:10:47.573 INFO:teuthology.orchestra.run.smithi139.stdout:(153/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.1 MB/s | 3.2 MB 00:00 2024-09-19T07:10:47.615 INFO:teuthology.orchestra.run.smithi139.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 13 MB/s | 1.4 MB 00:00 2024-09-19T07:10:47.640 INFO:teuthology.orchestra.run.smithi139.stdout:(155/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.7 MB/s | 249 kB 00:00 2024-09-19T07:10:47.690 INFO:teuthology.orchestra.run.smithi162.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 6.0 MB/s | 1.6 MB 00:00 2024-09-19T07:10:47.815 INFO:teuthology.orchestra.run.smithi139.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.9 MB/s | 2.4 MB 00:00 2024-09-19T07:10:47.820 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:10:47.821 INFO:teuthology.orchestra.run.smithi139.stdout:Total 25 MB/s | 226 MB 00:09 2024-09-19T07:10:47.840 INFO:teuthology.orchestra.run.smithi162.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 8.6 MB/s | 4.4 MB 00:00 2024-09-19T07:10:47.890 INFO:teuthology.orchestra.run.smithi162.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-09-19T07:10:47.916 INFO:teuthology.orchestra.run.smithi162.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 3.9 MB/s | 910 kB 00:00 2024-09-19T07:10:48.091 INFO:teuthology.orchestra.run.smithi162.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-09-19T07:10:48.122 INFO:teuthology.orchestra.run.smithi098.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 2.2 MB/s | 5.8 MB 00:02 2024-09-19T07:10:48.149 INFO:teuthology.orchestra.run.smithi162.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T07:10:48.272 INFO:teuthology.orchestra.run.smithi098.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-09-19T07:10:48.414 INFO:teuthology.orchestra.run.smithi098.stdout:(83/156): python3-babel-2.9.1-2.el9.noarch.rpm 2.3 MB/s | 6.0 MB 00:02 2024-09-19T07:10:48.465 INFO:teuthology.orchestra.run.smithi098.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 222 kB 00:00 2024-09-19T07:10:48.490 INFO:teuthology.orchestra.run.smithi098.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-19T07:10:48.508 INFO:teuthology.orchestra.run.smithi162.stdout:(73/156): postgresql-server-13.16-1.el9.x86_64. 9.4 MB/s | 5.8 MB 00:00 2024-09-19T07:10:48.515 INFO:teuthology.orchestra.run.smithi098.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-19T07:10:48.549 INFO:teuthology.orchestra.run.smithi098.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-19T07:10:48.575 INFO:teuthology.orchestra.run.smithi162.stdout:(74/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.9 MB/s | 4.9 MB 00:01 2024-09-19T07:10:48.592 INFO:teuthology.orchestra.run.smithi162.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 732 kB/s | 61 kB 00:00 2024-09-19T07:10:48.607 INFO:teuthology.orchestra.run.smithi098.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-19T07:10:48.632 INFO:teuthology.orchestra.run.smithi098.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-19T07:10:48.651 INFO:teuthology.orchestra.run.smithi162.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-19T07:10:48.658 INFO:teuthology.orchestra.run.smithi098.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T07:10:48.676 INFO:teuthology.orchestra.run.smithi162.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T07:10:48.683 INFO:teuthology.orchestra.run.smithi098.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T07:10:48.693 INFO:teuthology.orchestra.run.smithi162.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 611 kB/s | 26 kB 00:00 2024-09-19T07:10:48.727 INFO:teuthology.orchestra.run.smithi162.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-19T07:10:48.733 INFO:teuthology.orchestra.run.smithi098.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-19T07:10:48.752 INFO:teuthology.orchestra.run.smithi162.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-19T07:10:48.777 INFO:teuthology.orchestra.run.smithi162.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-19T07:10:48.792 INFO:teuthology.orchestra.run.smithi098.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 759 kB/s | 44 kB 00:00 2024-09-19T07:10:48.886 INFO:teuthology.orchestra.run.smithi162.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-19T07:10:48.969 INFO:teuthology.orchestra.run.smithi162.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-19T07:10:49.028 INFO:teuthology.orchestra.run.smithi162.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T07:10:49.066 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-09-19T07:10:49.067 INFO:teuthology.orchestra.run.smithi098.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-09-19T07:10:49.078 INFO:teuthology.orchestra.run.smithi162.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 849 kB/s | 42 kB 00:00 2024-09-19T07:10:49.093 INFO:teuthology.orchestra.run.smithi098.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 735 kB/s | 221 kB 00:00 2024-09-19T07:10:49.154 INFO:teuthology.orchestra.run.smithi162.stdout:(86/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.9 MB/s | 6.0 MB 00:01 2024-09-19T07:10:49.168 INFO:teuthology.orchestra.run.smithi098.stdout:(96/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.1 MB/s | 5.1 MB 00:02 2024-09-19T07:10:49.193 INFO:teuthology.orchestra.run.smithi098.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 287 kB/s | 36 kB 00:00 2024-09-19T07:10:49.204 INFO:teuthology.orchestra.run.smithi162.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-19T07:10:49.218 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-09-19T07:10:49.218 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-09-19T07:10:49.218 INFO:teuthology.orchestra.run.smithi098.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-09-19T07:10:49.229 INFO:teuthology.orchestra.run.smithi162.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-19T07:10:49.269 INFO:teuthology.orchestra.run.smithi098.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T07:10:49.280 INFO:teuthology.orchestra.run.smithi162.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T07:10:49.294 INFO:teuthology.orchestra.run.smithi098.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-19T07:10:49.305 INFO:teuthology.orchestra.run.smithi162.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-19T07:10:49.330 INFO:teuthology.orchestra.run.smithi162.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T07:10:49.344 INFO:teuthology.orchestra.run.smithi098.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-09-19T07:10:49.369 INFO:teuthology.orchestra.run.smithi098.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 633 kB/s | 64 kB 00:00 2024-09-19T07:10:49.395 INFO:teuthology.orchestra.run.smithi098.stdout:(103/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-19T07:10:49.414 INFO:teuthology.orchestra.run.smithi162.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.7 MB/s | 5.1 MB 00:00 2024-09-19T07:10:49.450 INFO:teuthology.orchestra.run.smithi162.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-19T07:10:49.473 INFO:teuthology.orchestra.run.smithi162.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-09-19T07:10:49.487 INFO:teuthology.orchestra.run.smithi098.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-19T07:10:49.506 INFO:teuthology.orchestra.run.smithi162.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T07:10:49.512 INFO:teuthology.orchestra.run.smithi098.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 133 kB/s | 22 kB 00:00 2024-09-19T07:10:49.531 INFO:teuthology.orchestra.run.smithi162.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-19T07:10:49.546 INFO:teuthology.orchestra.run.smithi098.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 5.1 MB/s | 308 kB 00:00 2024-09-19T07:10:49.557 INFO:teuthology.orchestra.run.smithi162.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-19T07:10:49.571 INFO:teuthology.orchestra.run.smithi098.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-19T07:10:49.591 INFO:teuthology.orchestra.run.smithi162.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-19T07:10:49.596 INFO:teuthology.orchestra.run.smithi098.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T07:10:49.616 INFO:teuthology.orchestra.run.smithi162.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 986 kB/s | 58 kB 00:00 2024-09-19T07:10:49.622 INFO:teuthology.orchestra.run.smithi098.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T07:10:49.655 INFO:teuthology.orchestra.run.smithi098.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T07:10:49.657 INFO:teuthology.orchestra.run.smithi162.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-19T07:10:49.683 INFO:teuthology.orchestra.run.smithi162.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-09-19T07:10:49.697 INFO:teuthology.orchestra.run.smithi098.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-19T07:10:49.708 INFO:teuthology.orchestra.run.smithi162.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-19T07:10:49.731 INFO:teuthology.orchestra.run.smithi098.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-19T07:10:49.792 INFO:teuthology.orchestra.run.smithi162.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-19T07:10:49.831 INFO:teuthology.orchestra.run.smithi098.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-19T07:10:49.848 INFO:teuthology.orchestra.run.smithi098.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-19T07:10:49.851 INFO:teuthology.orchestra.run.smithi162.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-19T07:10:49.865 INFO:teuthology.orchestra.run.smithi098.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T07:10:49.882 INFO:teuthology.orchestra.run.smithi098.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 853 kB/s | 14 kB 00:00 2024-09-19T07:10:49.884 INFO:teuthology.orchestra.run.smithi162.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T07:10:49.907 INFO:teuthology.orchestra.run.smithi098.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-09-19T07:10:49.910 INFO:teuthology.orchestra.run.smithi162.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-19T07:10:49.932 INFO:teuthology.orchestra.run.smithi098.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T07:10:49.958 INFO:teuthology.orchestra.run.smithi098.stdout:(119/156): python3-asyncssh-2.13.2-5.el9.noarch 2.4 MB/s | 548 kB 00:00 2024-09-19T07:10:50.002 INFO:teuthology.orchestra.run.smithi162.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-09-19T07:10:50.011 INFO:teuthology.orchestra.run.smithi098.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.8 MB/s | 303 kB 00:00 2024-09-19T07:10:50.042 INFO:teuthology.orchestra.run.smithi098.stdout:(121/156): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-09-19T07:10:50.067 INFO:teuthology.orchestra.run.smithi098.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.0 MB/s | 220 kB 00:00 2024-09-19T07:10:50.077 INFO:teuthology.orchestra.run.smithi162.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 26 MB/s | 4.4 MB 00:00 2024-09-19T07:10:50.084 INFO:teuthology.orchestra.run.smithi098.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 646 kB/s | 11 kB 00:00 2024-09-19T07:10:50.109 INFO:teuthology.orchestra.run.smithi098.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-09-19T07:10:50.126 INFO:teuthology.orchestra.run.smithi098.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 420 kB/s | 18 kB 00:00 2024-09-19T07:10:50.127 INFO:teuthology.orchestra.run.smithi162.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2024-09-19T07:10:50.151 INFO:teuthology.orchestra.run.smithi098.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 552 kB/s | 23 kB 00:00 2024-09-19T07:10:50.153 INFO:teuthology.orchestra.run.smithi162.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 172 kB/s | 26 kB 00:00 2024-09-19T07:10:50.177 INFO:teuthology.orchestra.run.smithi098.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T07:10:50.178 INFO:teuthology.orchestra.run.smithi162.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T07:10:50.202 INFO:teuthology.orchestra.run.smithi098.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-19T07:10:50.212 INFO:teuthology.orchestra.run.smithi162.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-19T07:10:50.227 INFO:teuthology.orchestra.run.smithi098.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T07:10:50.253 INFO:teuthology.orchestra.run.smithi098.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T07:10:50.253 INFO:teuthology.orchestra.run.smithi162.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-19T07:10:50.278 INFO:teuthology.orchestra.run.smithi098.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T07:10:50.279 INFO:teuthology.orchestra.run.smithi162.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T07:10:50.296 INFO:teuthology.orchestra.run.smithi162.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T07:10:50.313 INFO:teuthology.orchestra.run.smithi162.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 858 kB/s | 14 kB 00:00 2024-09-19T07:10:50.328 INFO:teuthology.orchestra.run.smithi098.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.4 MB/s | 2.0 MB 00:00 2024-09-19T07:10:50.346 INFO:teuthology.orchestra.run.smithi162.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-19T07:10:50.353 INFO:teuthology.orchestra.run.smithi098.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-19T07:10:50.372 INFO:teuthology.orchestra.run.smithi162.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-19T07:10:50.379 INFO:teuthology.orchestra.run.smithi098.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-19T07:10:50.405 INFO:teuthology.orchestra.run.smithi162.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T07:10:50.412 INFO:teuthology.orchestra.run.smithi098.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 4.3 MB/s | 1.0 MB 00:00 2024-09-19T07:10:50.431 INFO:teuthology.orchestra.run.smithi162.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T07:10:50.437 INFO:teuthology.orchestra.run.smithi098.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 481 kB/s | 28 kB 00:00 2024-09-19T07:10:50.456 INFO:teuthology.orchestra.run.smithi162.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T07:10:50.463 INFO:teuthology.orchestra.run.smithi098.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 824 kB/s | 90 kB 00:00 2024-09-19T07:10:50.488 INFO:teuthology.orchestra.run.smithi098.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-19T07:10:50.489 INFO:teuthology.orchestra.run.smithi162.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T07:10:50.514 INFO:teuthology.orchestra.run.smithi098.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T07:10:50.515 INFO:teuthology.orchestra.run.smithi162.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-19T07:10:50.532 INFO:teuthology.orchestra.run.smithi162.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-19T07:10:50.539 INFO:teuthology.orchestra.run.smithi098.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 706 kB/s | 36 kB 00:00 2024-09-19T07:10:50.549 INFO:teuthology.orchestra.run.smithi162.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-19T07:10:50.564 INFO:teuthology.orchestra.run.smithi098.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-19T07:10:50.574 INFO:teuthology.orchestra.run.smithi162.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-19T07:10:50.589 INFO:teuthology.orchestra.run.smithi098.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-19T07:10:50.600 INFO:teuthology.orchestra.run.smithi162.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-19T07:10:50.615 INFO:teuthology.orchestra.run.smithi098.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T07:10:50.640 INFO:teuthology.orchestra.run.smithi098.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T07:10:50.650 INFO:teuthology.orchestra.run.smithi162.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.3 MB/s | 2.0 MB 00:00 2024-09-19T07:10:50.657 INFO:teuthology.orchestra.run.smithi098.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2024-09-19T07:10:50.676 INFO:teuthology.orchestra.run.smithi162.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T07:10:50.682 INFO:teuthology.orchestra.run.smithi098.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T07:10:50.701 INFO:teuthology.orchestra.run.smithi162.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T07:10:50.707 INFO:teuthology.orchestra.run.smithi098.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-19T07:10:50.750 INFO:teuthology.orchestra.run.smithi098.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-19T07:10:50.763 INFO:teuthology.orchestra.run.smithi162.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 933 kB/s | 58 kB 00:00 2024-09-19T07:10:50.826 INFO:teuthology.orchestra.run.smithi162.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.2 MB/s | 272 kB 00:00 2024-09-19T07:10:50.860 INFO:teuthology.orchestra.run.smithi162.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-09-19T07:10:50.886 INFO:teuthology.orchestra.run.smithi162.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-19T07:10:50.911 INFO:teuthology.orchestra.run.smithi162.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-19T07:10:50.936 INFO:teuthology.orchestra.run.smithi162.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-19T07:10:50.941 INFO:teuthology.orchestra.run.smithi098.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-19T07:10:50.961 INFO:teuthology.orchestra.run.smithi162.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T07:10:50.987 INFO:teuthology.orchestra.run.smithi162.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-19T07:10:51.012 INFO:teuthology.orchestra.run.smithi162.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T07:10:51.025 INFO:teuthology.orchestra.run.smithi098.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 22 MB/s | 1.8 MB 00:00 2024-09-19T07:10:51.027 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-09-19T07:10:51.028 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-09-19T07:10:51.037 INFO:teuthology.orchestra.run.smithi162.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-09-19T07:10:51.063 INFO:teuthology.orchestra.run.smithi162.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T07:10:51.088 INFO:teuthology.orchestra.run.smithi162.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T07:10:51.092 INFO:teuthology.orchestra.run.smithi098.stdout:(151/156): librbd1-19.1.1-361.g2f599a46.el9.x86 8.2 MB/s | 3.2 MB 00:00 2024-09-19T07:10:51.109 INFO:teuthology.orchestra.run.smithi098.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 490 kB/s | 41 kB 00:00 2024-09-19T07:10:51.113 INFO:teuthology.orchestra.run.smithi162.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T07:10:51.138 INFO:teuthology.orchestra.run.smithi162.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 808 kB/s | 20 kB 00:00 2024-09-19T07:10:51.159 INFO:teuthology.orchestra.run.smithi098.stdout:(153/156): librados2-19.1.1-361.g2f599a46.el9.x 7.2 MB/s | 3.4 MB 00:00 2024-09-19T07:10:51.172 INFO:teuthology.orchestra.run.smithi162.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-19T07:10:51.184 INFO:teuthology.orchestra.run.smithi098.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-19T07:10:51.197 INFO:teuthology.orchestra.run.smithi162.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T07:10:51.259 INFO:teuthology.orchestra.run.smithi098.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-19T07:10:51.306 INFO:teuthology.orchestra.run.smithi162.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-19T07:10:51.368 INFO:teuthology.orchestra.run.smithi098.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-19T07:10:51.374 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:10:51.374 INFO:teuthology.orchestra.run.smithi098.stdout:Total 15 MB/s | 226 MB 00:14 2024-09-19T07:10:51.492 INFO:teuthology.orchestra.run.smithi162.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T07:10:51.674 INFO:teuthology.orchestra.run.smithi162.stdout:(149/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.9 MB/s | 16 MB 00:02 2024-09-19T07:10:51.724 INFO:teuthology.orchestra.run.smithi162.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.6 MB/s | 3.2 MB 00:00 2024-09-19T07:10:51.782 INFO:teuthology.orchestra.run.smithi162.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 703 kB/s | 41 kB 00:00 2024-09-19T07:10:51.883 INFO:teuthology.orchestra.run.smithi162.stdout:(152/156): NetworkManager-libnm-1.51.0-1.el9.x8 8.7 MB/s | 1.8 MB 00:00 2024-09-19T07:10:51.908 INFO:teuthology.orchestra.run.smithi162.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.9 MB/s | 249 kB 00:00 2024-09-19T07:10:51.958 INFO:teuthology.orchestra.run.smithi162.stdout:(154/156): NetworkManager-1.51.0-1.el9.x86_64.r 5.0 MB/s | 2.3 MB 00:00 2024-09-19T07:10:52.033 INFO:teuthology.orchestra.run.smithi162.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-19T07:10:52.075 INFO:teuthology.orchestra.run.smithi162.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-19T07:10:52.080 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:10:52.081 INFO:teuthology.orchestra.run.smithi162.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-19T07:10:52.608 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-19T07:10:52.761 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-19T07:10:52.762 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-19T07:10:53.320 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-19T07:10:53.471 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-19T07:10:53.471 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-19T07:10:55.007 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-19T07:10:55.008 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-19T07:10:55.277 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-19T07:10:55.277 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-19T07:10:57.272 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-09-19T07:10:57.377 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T07:10:57.507 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T07:10:57.671 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T07:10:57.711 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T07:10:57.745 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T07:10:57.797 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T07:10:58.133 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T07:10:58.245 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:10:58.351 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:10:58.380 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:10:58.454 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:10:58.484 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:10:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T07:10:58.681 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T07:10:58.709 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:10:58.813 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:10:58.835 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:10:58.897 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:10:58.936 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:10:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:10:59.154 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:10:59.301 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:10:59.434 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T07:10:59.540 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:10:59.602 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:10:59.819 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:10:59.938 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T07:11:00.029 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T07:11:00.065 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T07:11:00.100 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T07:11:00.182 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T07:11:00.226 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T07:11:00.257 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T07:11:00.310 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T07:11:00.342 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T07:11:00.370 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T07:11:00.439 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T07:11:00.492 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T07:11:00.526 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T07:11:00.561 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T07:11:00.638 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T07:11:00.673 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T07:11:00.715 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T07:11:00.744 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T07:11:00.813 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T07:11:00.867 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T07:11:00.942 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T07:11:01.071 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T07:11:01.127 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T07:11:01.265 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-19T07:11:01.364 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T07:11:01.491 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T07:11:01.576 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-19T07:11:01.637 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T07:11:01.686 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T07:11:01.712 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T07:11:01.722 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T07:11:01.727 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T07:11:01.750 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T07:11:01.751 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T07:11:01.752 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T07:11:01.801 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T07:11:01.803 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T07:11:01.803 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T07:11:01.837 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T07:11:01.841 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T07:11:01.863 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T07:11:01.883 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T07:11:01.906 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T07:11:02.031 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T07:11:02.086 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T07:11:02.134 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T07:11:02.140 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T07:11:02.213 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T07:11:02.244 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:11:02.245 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T07:11:02.245 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T07:11:02.281 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T07:11:02.344 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T07:11:02.356 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:11:02.366 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:11:02.388 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T07:11:02.395 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:11:02.431 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T07:11:02.479 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:11:02.481 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T07:11:02.487 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:11:02.516 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:11:02.517 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:11:02.607 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:11:02.617 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T07:11:02.637 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:11:02.666 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T07:11:02.684 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T07:11:02.707 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T07:11:02.739 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T07:11:02.767 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:11:02.786 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T07:11:02.809 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T07:11:02.842 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T07:11:02.870 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:11:02.871 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:11:02.901 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:11:02.917 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T07:11:02.964 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:11:02.965 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T07:11:02.974 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:11:02.990 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T07:11:02.994 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:11:02.996 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:11:03.014 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T07:11:03.015 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:11:03.059 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T07:11:03.081 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:11:03.088 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T07:11:03.102 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T07:11:03.213 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:11:03.214 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T07:11:03.247 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T07:11:03.275 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T07:11:03.307 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:11:03.309 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T07:11:03.348 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T07:11:03.388 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T07:11:03.417 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T07:11:03.424 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:11:03.452 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T07:11:03.455 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T07:11:03.485 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T07:11:03.526 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T07:11:03.526 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T07:11:03.561 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T07:11:03.581 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T07:11:03.634 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:11:03.647 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T07:11:03.676 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:11:03.692 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T07:11:03.694 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:11:03.731 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T07:11:03.748 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:11:03.842 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T07:11:03.899 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T07:11:03.907 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:11:03.981 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T07:11:04.015 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T07:11:04.091 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T07:11:04.103 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T07:11:04.133 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T07:11:04.167 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T07:11:04.184 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T07:11:04.220 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T07:11:04.231 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T07:11:04.263 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T07:11:04.285 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T07:11:04.326 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T07:11:04.328 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T07:11:04.370 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T07:11:04.376 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T07:11:04.402 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T07:11:04.416 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T07:11:04.438 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T07:11:04.469 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T07:11:04.501 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T07:11:04.508 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T07:11:04.530 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T07:11:04.561 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T07:11:04.591 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T07:11:04.599 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T07:11:04.620 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T07:11:04.635 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T07:11:04.652 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T07:11:04.691 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T07:11:04.713 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T07:11:04.729 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T07:11:04.734 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T07:11:04.746 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T07:11:04.763 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T07:11:04.790 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T07:11:04.810 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T07:11:04.817 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T07:11:04.845 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T07:11:04.860 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T07:11:04.888 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T07:11:04.889 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T07:11:04.917 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T07:11:04.918 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T07:11:04.950 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T07:11:04.962 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T07:11:04.986 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T07:11:05.025 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T07:11:05.031 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T07:11:05.049 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T07:11:05.082 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T07:11:05.106 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T07:11:05.163 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T07:11:05.219 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T07:11:05.264 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T07:11:05.265 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T07:11:05.305 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T07:11:05.327 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T07:11:05.382 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T07:11:05.759 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T07:11:05.839 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T07:11:05.846 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T07:11:05.868 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T07:11:05.911 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T07:11:05.931 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T07:11:05.949 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T07:11:05.967 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T07:11:05.992 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T07:11:06.002 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T07:11:06.025 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T07:11:06.040 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T07:11:06.081 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T07:11:06.144 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T07:11:06.153 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T07:11:06.219 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T07:11:06.250 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T07:11:06.274 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T07:11:06.307 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T07:11:06.347 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T07:11:06.361 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T07:11:06.378 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T07:11:06.406 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T07:11:06.435 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T07:11:06.452 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T07:11:06.467 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T07:11:06.488 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T07:11:06.503 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T07:11:06.532 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T07:11:06.550 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T07:11:06.574 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T07:11:06.586 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T07:11:06.620 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T07:11:06.662 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T07:11:06.712 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T07:11:06.751 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T07:11:06.793 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T07:11:06.798 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T07:11:06.839 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T07:11:06.881 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T07:11:06.984 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T07:11:06.988 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T07:11:07.015 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T07:11:07.055 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T07:11:07.080 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T07:11:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T07:11:07.105 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T07:11:07.126 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T07:11:07.158 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T07:11:07.183 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T07:11:07.258 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T07:11:07.275 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T07:11:07.370 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T07:11:07.405 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T07:11:07.432 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T07:11:07.459 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T07:11:07.469 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T07:11:07.487 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T07:11:07.506 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T07:11:07.520 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T07:11:07.542 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T07:11:07.585 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T07:11:07.609 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T07:11:07.615 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T07:11:07.650 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T07:11:07.683 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T07:11:07.716 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T07:11:07.751 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T07:11:07.773 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T07:11:07.838 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T07:11:07.840 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T07:11:07.881 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T07:11:07.891 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:11:07.912 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T07:11:08.018 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T07:11:08.059 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T07:11:08.064 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T07:11:08.093 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T07:11:08.133 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T07:11:08.172 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T07:11:08.201 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T07:11:08.222 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:11:08.236 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T07:11:08.255 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T07:11:08.270 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T07:11:08.292 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T07:11:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T07:11:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T07:11:08.437 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T07:11:08.484 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T07:11:08.515 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T07:11:08.620 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T07:11:08.692 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T07:11:08.771 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T07:11:08.802 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T07:11:08.811 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:11:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T07:11:08.874 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:11:08.878 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T07:11:08.904 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T07:11:08.978 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T07:11:09.025 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T07:11:09.070 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T07:11:09.158 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T07:11:09.198 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T07:11:09.382 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T07:11:09.412 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T07:11:09.413 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T07:11:09.472 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T07:11:09.491 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T07:11:09.506 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T07:11:09.605 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T07:11:09.661 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T07:11:09.706 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T07:11:09.793 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T07:11:09.842 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T07:11:10.027 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T07:11:10.056 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T07:11:10.134 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T07:11:10.156 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T07:11:10.274 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T07:11:10.778 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T07:11:10.896 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T07:11:11.245 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:11:11.277 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:11:11.532 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T07:11:11.818 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:11:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T07:11:11.855 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:11:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T07:11:11.916 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T07:11:11.938 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:11:11.938 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T07:11:11.938 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T07:11:11.938 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:11.973 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:11:12.123 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T07:11:12.220 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T07:11:12.232 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T07:11:12.248 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T07:11:12.279 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:11:12.283 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T07:11:12.403 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:11:12.434 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T07:11:12.470 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T07:11:12.592 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T07:11:12.629 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:11:12.720 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T07:11:12.751 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T07:11:12.787 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T07:11:12.953 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T07:11:12.982 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:11:13.053 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:11:13.083 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T07:11:13.261 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T07:11:13.374 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:11:13.429 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T07:11:13.459 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T07:11:15.371 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:11:15.422 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:11:15.770 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:11:15.806 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:11:15.971 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:11:16.009 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:11:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:11:16.093 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T07:11:16.093 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T07:11:16.093 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:16.144 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:11:16.349 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T07:11:16.384 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:11:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T07:11:16.476 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T07:11:16.476 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T07:11:16.476 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:16.503 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:11:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:11:23.546 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2024-09-19T07:11:23.546 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2024-09-19T07:11:23.546 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2024-09-19T07:11:23.546 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2024-09-19T07:11:23.546 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2024-09-19T07:11:23.546 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /root 2024-09-19T07:11:23.546 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2024-09-19T07:11:23.546 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:23.716 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:11:23.733 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:11:23.733 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:23.733 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T07:11:23.733 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:25.210 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:11:25.237 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:11:25.237 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:25.238 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T07:11:25.238 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:11:25.238 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:11:25.238 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:25.470 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:11:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:11:25.495 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:25.495 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T07:11:25.495 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:11:25.495 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:11:25.495 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:25.928 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:11:25.952 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:11:25.952 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:25.952 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T07:11:25.952 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:11:25.952 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:11:25.952 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:26.058 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T07:11:26.115 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T07:11:26.178 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T07:11:26.362 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T07:11:26.412 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T07:11:26.489 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T07:11:26.578 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T07:11:26.733 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T07:11:26.779 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T07:11:26.811 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T07:11:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T07:11:27.285 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:11:27.312 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:11:27.343 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T07:11:27.405 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T07:11:27.435 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:11:28.331 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:11:28.331 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-09-19T07:11:28.331 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-09-19T07:11:28.331 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-09-19T07:11:28.331 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-09-19T07:11:28.331 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-09-19T07:11:28.332 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-09-19T07:11:28.332 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-09-19T07:11:28.332 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:28.438 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T07:11:28.438 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-09-19T07:11:28.438 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-09-19T07:11:28.438 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-09-19T07:11:28.438 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-09-19T07:11:28.439 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-09-19T07:11:28.439 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-09-19T07:11:28.439 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-09-19T07:11:28.439 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:28.483 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:11:28.507 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:11:28.512 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:11:28.524 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:11:28.524 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:28.524 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T07:11:28.524 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:28.609 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:11:28.625 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T07:11:28.625 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:28.625 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T07:11:28.626 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:29.475 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:11:29.503 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:11:29.606 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:11:29.773 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T07:11:29.805 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:11:29.829 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:11:29.829 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:29.829 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T07:11:29.829 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:11:29.830 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:11:29.830 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:29.873 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:11:29.885 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:11:29.982 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T07:11:30.019 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:11:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T07:11:30.046 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:11:30.047 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:30.047 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T07:11:30.047 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:11:30.047 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:11:30.047 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:30.112 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:11:30.140 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T07:11:30.140 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:30.140 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T07:11:30.140 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:11:30.140 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T07:11:30.140 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:30.278 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:11:30.302 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:11:30.302 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:30.302 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T07:11:30.302 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:11:30.302 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:11:30.302 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:30.371 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:11:30.395 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T07:11:30.395 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:30.395 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T07:11:30.395 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:11:30.395 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T07:11:30.395 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:30.737 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:11:30.761 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:11:30.761 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:30.761 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T07:11:30.761 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:11:30.761 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:11:30.762 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:30.830 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:11:30.854 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T07:11:30.854 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:30.854 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T07:11:30.854 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:11:30.854 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T07:11:30.854 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:30.875 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T07:11:30.925 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T07:11:30.951 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T07:11:30.952 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T07:11:30.975 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:11:30.980 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T07:11:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:11:30.999 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:30.999 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T07:11:30.999 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:11:30.999 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:11:30.999 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:31.009 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T07:11:31.043 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:11:31.066 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:11:31.066 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:31.066 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T07:11:31.066 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:31.072 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T07:11:31.118 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:11:31.142 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:11:31.142 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:31.142 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T07:11:31.142 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:11:31.142 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:11:31.142 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:31.167 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T07:11:31.222 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T07:11:31.261 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T07:11:31.300 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T07:11:31.306 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T07:11:31.376 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T07:11:31.409 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T07:11:31.444 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:11:31.465 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T07:11:31.467 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:11:31.468 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:31.468 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T07:11:31.468 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:11:31.468 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:11:31.468 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:31.546 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T07:11:31.600 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T07:11:31.604 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T07:11:31.638 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T07:11:31.648 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T07:11:31.665 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T07:11:31.681 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T07:11:31.708 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T07:11:32.003 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:11:32.031 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:11:32.062 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T07:11:32.125 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T07:11:32.162 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:11:32.180 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:11:32.207 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T07:11:32.239 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T07:11:32.301 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T07:11:32.330 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:11:33.211 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:11:33.247 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:11:33.377 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T07:11:33.415 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:11:34.209 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:11:34.239 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:11:34.343 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:11:34.377 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T07:11:34.399 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:11:34.504 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T07:11:34.507 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T07:11:34.541 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:11:34.565 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:11:34.565 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:34.565 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T07:11:34.565 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:11:34.565 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:11:34.565 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:34.609 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:11:34.621 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:11:34.670 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T07:11:34.710 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:11:34.718 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T07:11:34.735 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T07:11:34.735 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:34.735 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T07:11:34.735 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:11:34.735 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T07:11:34.735 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:34.776 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T07:11:34.785 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:11:34.797 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T07:11:34.903 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T07:11:34.950 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T07:11:35.696 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T07:11:35.728 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:11:35.752 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:11:35.752 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:35.752 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T07:11:35.752 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:11:35.752 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:11:35.752 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:35.796 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:11:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:11:35.819 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:35.819 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T07:11:35.819 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:35.863 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:11:35.874 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T07:11:35.886 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:11:35.886 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:35.886 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T07:11:35.886 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:11:35.886 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:11:35.886 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:35.905 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:11:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T07:11:35.929 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:35.930 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T07:11:35.930 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:11:35.930 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T07:11:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:35.973 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:11:35.995 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T07:11:35.995 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:35.996 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T07:11:35.996 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:36.014 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T07:11:36.048 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:11:36.055 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T07:11:36.072 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T07:11:36.072 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:36.072 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T07:11:36.072 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:11:36.072 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T07:11:36.072 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:36.096 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T07:11:36.128 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T07:11:36.155 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T07:11:36.197 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:11:36.220 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:11:36.220 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:36.220 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T07:11:36.220 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:11:36.221 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:11:36.221 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:36.334 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T07:11:36.376 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T07:11:36.381 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:11:36.405 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T07:11:36.405 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T07:11:36.405 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T07:11:36.405 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:11:36.405 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T07:11:36.405 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:36.406 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T07:11:36.436 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T07:11:36.482 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T07:11:37.111 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:11:37.147 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:11:37.168 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:11:37.987 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T07:11:38.068 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T07:11:38.109 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T07:11:38.189 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T07:11:38.229 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T07:11:38.254 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T07:11:38.280 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T07:11:38.280 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:11:38.364 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:11:38.364 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:11:38.440 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:11:38.464 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T07:11:38.470 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:11:38.470 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:11:38.667 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:11:38.667 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:11:38.751 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:11:38.815 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:11:40.792 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T07:11:40.842 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T07:11:40.883 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T07:11:40.915 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T07:11:40.943 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T07:11:40.952 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T07:11:40.994 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T07:11:41.034 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T07:11:41.067 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T07:11:41.094 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T07:11:41.146 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T07:11:41.189 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T07:11:41.220 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T07:11:41.258 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T07:11:41.277 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T07:11:41.304 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T07:11:41.316 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T07:11:41.346 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T07:11:41.376 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T07:11:41.422 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T07:11:41.929 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:11:41.969 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:11:41.989 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:11:42.023 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:11:42.062 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:11:42.083 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T07:11:42.829 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T07:11:42.908 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T07:11:42.937 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T07:11:42.956 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T07:11:43.027 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T07:11:43.044 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T07:11:43.059 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T07:11:43.078 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T07:11:43.103 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T07:11:43.145 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T07:11:43.145 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:11:43.149 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T07:11:43.189 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T07:11:43.214 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T07:11:43.246 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:11:43.247 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:11:43.248 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T07:11:43.248 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:11:43.330 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:11:43.332 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T07:11:43.332 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:11:43.355 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T07:11:43.361 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:11:43.361 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:11:43.408 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T07:11:43.433 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T07:11:43.439 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:11:43.439 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:11:43.541 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:11:43.541 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:11:43.608 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:11:43.621 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T07:11:43.621 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:11:43.673 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:11:43.703 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T07:11:43.766 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:11:44.447 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:11:44.447 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T07:11:44.447 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T07:11:44.447 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T07:11:44.447 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T07:11:44.448 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T07:11:44.449 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T07:11:44.449 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T07:11:44.449 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T07:11:44.449 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T07:11:44.449 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T07:11:44.449 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T07:11:44.449 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T07:11:44.449 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T07:11:44.449 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T07:11:44.449 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T07:11:44.449 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T07:11:44.461 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T07:11:44.461 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T07:11:44.461 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T07:11:44.461 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T07:11:44.461 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T07:11:44.461 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T07:11:44.461 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T07:11:44.461 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T07:11:44.462 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T07:11:44.463 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T07:11:44.464 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T07:11:44.465 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T07:11:44.466 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T07:11:44.467 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T07:11:44.468 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T07:11:44.468 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T07:11:44.468 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T07:11:44.468 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T07:11:44.468 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T07:11:44.468 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T07:11:44.468 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T07:11:44.469 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T07:11:44.470 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T07:11:44.471 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T07:11:44.471 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T07:11:44.471 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T07:11:44.471 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T07:11:44.471 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T07:11:44.471 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T07:11:44.471 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T07:11:44.471 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T07:11:44.471 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T07:11:44.471 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T07:11:46.964 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:11:46.964 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:46.964 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2024-09-19T07:11:46.965 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T07:11:46.965 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T07:11:46.965 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T07:11:46.965 INFO:teuthology.orchestra.run.smithi139.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T07:11:46.965 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.965 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.965 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T07:11:46.965 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T07:11:46.965 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-09-19T07:11:46.965 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T07:11:46.965 INFO:teuthology.orchestra.run.smithi139.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T07:11:46.965 INFO:teuthology.orchestra.run.smithi139.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:46.966 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:46.967 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.968 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T07:11:46.969 INFO:teuthology.orchestra.run.smithi139.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T07:11:46.970 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T07:11:46.971 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T07:11:46.972 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T07:11:46.973 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.974 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T07:11:46.975 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T07:11:46.976 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T07:11:46.976 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.976 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.976 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:46.976 INFO:teuthology.orchestra.run.smithi139.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T07:11:46.976 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T07:11:46.976 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T07:11:46.976 INFO:teuthology.orchestra.run.smithi139.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T07:11:46.976 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T07:11:46.976 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T07:11:46.977 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T07:11:46.977 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:11:46.977 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-09-19T07:11:47.406 DEBUG:teuthology.parallel:result is None 2024-09-19T07:11:49.386 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:11:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T07:11:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T07:11:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T07:11:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T07:11:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T07:11:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T07:11:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T07:11:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:11:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:11:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:11:49.387 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T07:11:49.388 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T07:11:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T07:11:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T07:11:49.389 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T07:11:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T07:11:49.400 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T07:11:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T07:11:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T07:11:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T07:11:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T07:11:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T07:11:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T07:11:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T07:11:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T07:11:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T07:11:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T07:11:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T07:11:49.401 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T07:11:49.402 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T07:11:49.403 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T07:11:49.404 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T07:11:49.405 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T07:11:49.406 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T07:11:49.407 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T07:11:49.408 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T07:11:49.409 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T07:11:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T07:11:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T07:11:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T07:11:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T07:11:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T07:11:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T07:11:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T07:11:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T07:11:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T07:11:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T07:11:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T07:11:49.410 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T07:11:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T07:11:49.411 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T07:11:49.871 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:11:49.871 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T07:11:49.871 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T07:11:49.872 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T07:11:49.872 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T07:11:49.872 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T07:11:49.872 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T07:11:49.872 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T07:11:49.872 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T07:11:49.872 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T07:11:49.872 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T07:11:49.872 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T07:11:49.873 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T07:11:49.873 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T07:11:49.873 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T07:11:49.873 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T07:11:49.873 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T07:11:49.873 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T07:11:49.873 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T07:11:49.873 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T07:11:49.873 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T07:11:49.873 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T07:11:49.874 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T07:11:49.874 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T07:11:49.874 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T07:11:49.874 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T07:11:49.874 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T07:11:49.874 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T07:11:49.874 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T07:11:49.874 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T07:11:49.874 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T07:11:49.874 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T07:11:49.874 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T07:11:49.875 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T07:11:49.876 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T07:11:49.877 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T07:11:49.877 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T07:11:49.877 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T07:11:49.877 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T07:11:49.877 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T07:11:49.877 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T07:11:49.877 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T07:11:49.877 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T07:11:49.877 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T07:11:49.877 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T07:11:49.878 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T07:11:49.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T07:11:49.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T07:11:49.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T07:11:49.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T07:11:49.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T07:11:49.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T07:11:49.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T07:11:49.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T07:11:49.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T07:11:49.879 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T07:11:49.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T07:11:49.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T07:11:49.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T07:11:49.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T07:11:49.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T07:11:49.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T07:11:49.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T07:11:49.880 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T07:11:49.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T07:11:49.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T07:11:49.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T07:11:49.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T07:11:49.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T07:11:49.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T07:11:49.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T07:11:49.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T07:11:49.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T07:11:49.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T07:11:49.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T07:11:49.881 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T07:11:49.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T07:11:49.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T07:11:49.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T07:11:49.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T07:11:49.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T07:11:49.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T07:11:49.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T07:11:49.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T07:11:49.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T07:11:49.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T07:11:49.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T07:11:49.882 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T07:11:49.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T07:11:49.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T07:11:49.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T07:11:49.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T07:11:49.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T07:11:49.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T07:11:49.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T07:11:49.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T07:11:49.883 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T07:11:49.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T07:11:49.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T07:11:49.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T07:11:49.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T07:11:49.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T07:11:49.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T07:11:49.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T07:11:49.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T07:11:49.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T07:11:49.884 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T07:11:49.885 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T07:11:49.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T07:11:49.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T07:11:49.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T07:11:49.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T07:11:49.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T07:11:49.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T07:11:49.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T07:11:49.886 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T07:11:52.184 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:11:52.184 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:52.184 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-09-19T07:11:52.184 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T07:11:52.184 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T07:11:52.185 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T07:11:52.185 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T07:11:52.185 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.185 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.185 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T07:11:52.185 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T07:11:52.185 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-19T07:11:52.185 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T07:11:52.185 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T07:11:52.185 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T07:11:52.185 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T07:11:52.185 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.186 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.186 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.186 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.186 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.186 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.186 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.186 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.186 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.186 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.186 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.186 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.187 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.188 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T07:11:52.188 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T07:11:52.188 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T07:11:52.188 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T07:11:52.188 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T07:11:52.188 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T07:11:52.188 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T07:11:52.188 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T07:11:52.188 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T07:11:52.188 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T07:11:52.188 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.189 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T07:11:52.190 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T07:11:52.190 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T07:11:52.190 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T07:11:52.190 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T07:11:52.190 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T07:11:52.190 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T07:11:52.190 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T07:11:52.190 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T07:11:52.190 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T07:11:52.190 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T07:11:52.190 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T07:11:52.191 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T07:11:52.191 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T07:11:52.191 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T07:11:52.191 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T07:11:52.191 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T07:11:52.191 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T07:11:52.191 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T07:11:52.191 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T07:11:52.191 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T07:11:52.192 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T07:11:52.192 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T07:11:52.192 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.192 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.192 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.192 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T07:11:52.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T07:11:52.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T07:11:52.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T07:11:52.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T07:11:52.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T07:11:52.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T07:11:52.193 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T07:11:52.194 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T07:11:52.194 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T07:11:52.194 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T07:11:52.194 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T07:11:52.194 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T07:11:52.194 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T07:11:52.194 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T07:11:52.195 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T07:11:52.195 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T07:11:52.195 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T07:11:52.195 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T07:11:52.196 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T07:11:52.196 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T07:11:52.196 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T07:11:52.196 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T07:11:52.196 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T07:11:52.196 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T07:11:52.197 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T07:11:52.198 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T07:11:52.199 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T07:11:52.200 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T07:11:52.200 INFO:teuthology.orchestra.run.smithi098.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T07:11:52.200 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T07:11:52.200 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T07:11:52.200 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T07:11:52.200 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:11:52.201 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-19T07:11:52.468 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T07:11:52.468 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:52.468 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-09-19T07:11:52.468 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T07:11:52.469 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T07:11:52.469 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T07:11:52.469 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T07:11:52.469 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.469 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.470 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T07:11:52.470 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T07:11:52.470 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-19T07:11:52.470 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T07:11:52.470 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T07:11:52.470 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T07:11:52.471 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T07:11:52.471 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.471 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.471 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.471 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.472 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.473 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.474 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.474 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.475 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.475 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.475 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T07:11:52.475 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T07:11:52.475 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T07:11:52.475 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T07:11:52.475 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T07:11:52.475 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T07:11:52.475 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T07:11:52.476 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T07:11:52.477 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T07:11:52.478 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T07:11:52.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T07:11:52.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T07:11:52.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T07:11:52.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T07:11:52.479 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T07:11:52.480 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T07:11:52.481 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T07:11:52.482 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T07:11:52.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T07:11:52.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T07:11:52.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T07:11:52.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T07:11:52.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T07:11:52.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T07:11:52.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T07:11:52.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T07:11:52.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T07:11:52.483 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T07:11:52.484 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T07:11:52.484 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T07:11:52.484 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T07:11:52.484 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.484 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.484 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T07:11:52.484 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T07:11:52.484 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T07:11:52.484 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T07:11:52.484 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T07:11:52.484 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T07:11:52.484 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T07:11:52.485 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T07:11:52.485 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:11:52.485 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-19T07:11:52.615 DEBUG:teuthology.parallel:result is None 2024-09-19T07:11:52.912 DEBUG:teuthology.parallel:result is None 2024-09-19T07:11:52.913 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:11:53.063 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T07:11:53.086 INFO:teuthology.orchestra.run.smithi098.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T07:11:53.087 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T07:11:53.087 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T07:11:53.089 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:11:53.249 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T07:11:53.275 INFO:teuthology.orchestra.run.smithi139.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T07:11:53.275 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T07:11:53.275 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T07:11:53.277 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:11:53.413 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T07:11:53.436 INFO:teuthology.orchestra.run.smithi162.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T07:11:53.436 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T07:11:53.436 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T07:11:53.438 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T07:11:53.438 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:11:53.438 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T07:11:53.468 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-19T07:11:53.469 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T07:11:53.501 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T07:11:53.501 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T07:11:53.529 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T07:11:53.529 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:11:53.529 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T07:11:53.557 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T07:11:53.623 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-19T07:11:53.623 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T07:11:53.654 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T07:11:53.723 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T07:11:53.723 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T07:11:53.749 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T07:11:53.815 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T07:11:53.815 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:11:53.815 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T07:11:53.842 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T07:11:53.908 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-19T07:11:53.908 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T07:11:53.937 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T07:11:54.005 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T07:11:54.005 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T07:11:54.031 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T07:11:54.097 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T07:11:54.097 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:11:54.097 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T07:11:54.124 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T07:11:54.189 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-19T07:11:54.190 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T07:11:54.218 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T07:11:54.286 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T07:11:54.287 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T07:11:54.313 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T07:11:54.379 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T07:11:54.483 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T07:11:54.484 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:11:54.484 INFO:tasks.cephadm:Cluster fsid is 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:11:54.484 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T07:11:54.485 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.98', 'mon.b': '172.21.15.139', 'mon.c': '172.21.15.162'} 2024-09-19T07:11:54.485 INFO:tasks.cephadm:First mon is mon.a on smithi098 2024-09-19T07:11:54.485 INFO:tasks.cephadm:First mgr is x 2024-09-19T07:11:54.485 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T07:11:54.485 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname $(hostname -s) 2024-09-19T07:11:54.512 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname $(hostname -s) 2024-09-19T07:11:54.541 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname $(hostname -s) 2024-09-19T07:11:54.567 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T07:11:54.567 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:11:54.709 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T07:11:54.845 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:11:54.847 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T07:11:54.847 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T07:11:54.847 DEBUG:teuthology.orchestra.run.smithi098:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T07:11:55.231 INFO:teuthology.orchestra.run.smithi098.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 07:11 /home/ubuntu/cephtest/cephadm 2024-09-19T07:11:55.231 DEBUG:teuthology.orchestra.run.smithi139:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T07:11:55.606 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 07:11 /home/ubuntu/cephtest/cephadm 2024-09-19T07:11:55.607 DEBUG:teuthology.orchestra.run.smithi162:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T07:11:55.983 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 07:11 /home/ubuntu/cephtest/cephadm 2024-09-19T07:11:55.984 DEBUG:teuthology.orchestra.run.smithi098:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T07:11:56.003 DEBUG:teuthology.orchestra.run.smithi139:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T07:11:56.023 DEBUG:teuthology.orchestra.run.smithi162:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T07:11:56.058 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T07:11:56.059 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T07:11:56.061 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T07:11:56.066 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T07:11:57.614 INFO:teuthology.orchestra.run.smithi098.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:11:57.680 INFO:teuthology.orchestra.run.smithi139.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:11:57.802 INFO:teuthology.orchestra.run.smithi162.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:12:25.143 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T07:12:25.144 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T07:12:25.144 INFO:teuthology.orchestra.run.smithi162.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T07:12:25.144 INFO:teuthology.orchestra.run.smithi162.stdout: "repo_digests": [ 2024-09-19T07:12:25.144 INFO:teuthology.orchestra.run.smithi162.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T07:12:25.144 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-09-19T07:12:25.144 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T07:12:25.445 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-19T07:12:25.445 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T07:12:25.445 INFO:teuthology.orchestra.run.smithi139.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T07:12:25.445 INFO:teuthology.orchestra.run.smithi139.stdout: "repo_digests": [ 2024-09-19T07:12:25.445 INFO:teuthology.orchestra.run.smithi139.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T07:12:25.445 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-09-19T07:12:25.445 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-19T07:12:29.492 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:12:29.492 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T07:12:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T07:12:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "repo_digests": [ 2024-09-19T07:12:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T07:12:29.493 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-19T07:12:29.493 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:12:29.518 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph 2024-09-19T07:12:29.564 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph 2024-09-19T07:12:29.598 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph 2024-09-19T07:12:29.633 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /etc/ceph 2024-09-19T07:12:29.659 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /etc/ceph 2024-09-19T07:12:29.687 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /etc/ceph 2024-09-19T07:12:29.716 INFO:tasks.cephadm:Writing seed config... 2024-09-19T07:12:29.718 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T07:12:29.718 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T07:12:29.718 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T07:12:29.718 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T07:12:29.718 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T07:12:29.718 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T07:12:29.718 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T07:12:29.718 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T07:12:29.718 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T07:12:29.718 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T07:12:29.718 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T07:12:29.719 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T07:12:29.720 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T07:12:29.721 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T07:12:29.721 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T07:12:29.721 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T07:12:29.721 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T07:12:29.721 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T07:12:29.721 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T07:12:29.721 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T07:12:29.721 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T07:12:29.721 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T07:12:29.721 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T07:12:29.721 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T07:12:29.721 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T07:12:29.722 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:12:29.722 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T07:12:29.738 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 73438718-7656-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T07:12:29.738 DEBUG:teuthology.orchestra.run.smithi098:mon.a> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T07:12:29.781 DEBUG:teuthology.orchestra.run.smithi098:mgr.x> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T07:12:29.823 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T07:12:29.823 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 73438718-7656-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.98 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:12:30.025 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-19T07:12:30.025 INFO:teuthology.orchestra.run.smithi098.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '73438718-7656-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.98', '--skip-admin-label'] 2024-09-19T07:12:30.025 INFO:teuthology.orchestra.run.smithi098.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T07:12:30.025 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying podman|docker is present... 2024-09-19T07:12:30.054 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stdout 5.2.2 2024-09-19T07:12:30.055 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying lvm2 is present... 2024-09-19T07:12:30.055 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying time synchronization is in place... 2024-09-19T07:12:30.062 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T07:12:30.062 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T07:12:30.068 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T07:12:30.068 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout inactive 2024-09-19T07:12:30.075 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout enabled 2024-09-19T07:12:30.081 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout active 2024-09-19T07:12:30.082 INFO:teuthology.orchestra.run.smithi098.stdout:Unit chronyd.service is enabled and running 2024-09-19T07:12:30.082 INFO:teuthology.orchestra.run.smithi098.stdout:Repeating the final host check... 2024-09-19T07:12:30.104 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stdout 5.2.2 2024-09-19T07:12:30.104 INFO:teuthology.orchestra.run.smithi098.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T07:12:30.104 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl is present 2024-09-19T07:12:30.104 INFO:teuthology.orchestra.run.smithi098.stdout:lvcreate is present 2024-09-19T07:12:30.111 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T07:12:30.111 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T07:12:30.117 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T07:12:30.117 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout inactive 2024-09-19T07:12:30.124 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout enabled 2024-09-19T07:12:30.131 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout active 2024-09-19T07:12:30.131 INFO:teuthology.orchestra.run.smithi098.stdout:Unit chronyd.service is enabled and running 2024-09-19T07:12:30.131 INFO:teuthology.orchestra.run.smithi098.stdout:Host looks OK 2024-09-19T07:12:30.131 INFO:teuthology.orchestra.run.smithi098.stdout:Cluster fsid: 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:12:30.131 INFO:teuthology.orchestra.run.smithi098.stdout:Acquiring lock 140641582605312 on /run/cephadm/73438718-7656-11ef-bceb-c7b262605968.lock 2024-09-19T07:12:30.131 INFO:teuthology.orchestra.run.smithi098.stdout:Lock 140641582605312 acquired on /run/cephadm/73438718-7656-11ef-bceb-c7b262605968.lock 2024-09-19T07:12:30.131 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying IP 172.21.15.98 port 3300 ... 2024-09-19T07:12:30.132 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying IP 172.21.15.98 port 6789 ... 2024-09-19T07:12:30.132 INFO:teuthology.orchestra.run.smithi098.stdout:Base mon IP(s) is [172.21.15.98:3300, 172.21.15.98:6789], mon addrv is [v2:172.21.15.98:3300,v1:172.21.15.98:6789] 2024-09-19T07:12:30.135 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.98 metric 100 2024-09-19T07:12:30.135 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.98 metric 100 2024-09-19T07:12:30.137 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T07:12:30.137 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-19T07:12:30.137 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-19T07:12:30.140 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T07:12:30.140 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T07:12:30.140 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T07:12:30.140 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-19T07:12:30.140 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link noprefixroute 2024-09-19T07:12:30.140 INFO:teuthology.orchestra.run.smithi098.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T07:12:30.141 INFO:teuthology.orchestra.run.smithi098.stdout:Mon IP `172.21.15.98` is in CIDR network `172.21.0.0/20` 2024-09-19T07:12:30.141 INFO:teuthology.orchestra.run.smithi098.stdout:Mon IP `172.21.15.98` is in CIDR network `172.21.0.0/20` 2024-09-19T07:12:30.141 INFO:teuthology.orchestra.run.smithi098.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T07:12:30.141 INFO:teuthology.orchestra.run.smithi098.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T07:12:30.142 INFO:teuthology.orchestra.run.smithi098.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:12:30.646 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T07:12:30.646 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T07:12:30.646 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T07:12:30.646 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T07:12:30.646 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T07:12:30.646 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T07:12:30.646 INFO:teuthology.orchestra.run.smithi098.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T07:12:31.533 INFO:teuthology.orchestra.run.smithi098.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T07:12:31.536 INFO:teuthology.orchestra.run.smithi098.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T07:12:31.537 INFO:teuthology.orchestra.run.smithi098.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T07:12:32.439 INFO:teuthology.orchestra.run.smithi098.stdout:stat: stdout 167 167 2024-09-19T07:12:32.439 INFO:teuthology.orchestra.run.smithi098.stdout:Creating initial keys... 2024-09-19T07:12:33.437 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph-authtool: stdout AQDgzutmnqiCLBAAQauVe9jRjEn08CIYhsG+ow== 2024-09-19T07:12:34.309 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph-authtool: stdout AQDhzutms9ZgKRAAd7VplspRcnmnbxusd8tpqg== 2024-09-19T07:12:39.071 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph-authtool: stdout AQDizutm5l5GJRAAsVEuDCimDDcfd6xpL+nQHg== 2024-09-19T07:12:39.071 INFO:teuthology.orchestra.run.smithi098.stdout:Creating initial monmap... 2024-09-19T07:12:48.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T07:12:48.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T07:12:48.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:12:48.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T07:12:48.363 INFO:teuthology.orchestra.run.smithi098.stdout:monmaptool for a [v2:172.21.15.98:3300,v1:172.21.15.98:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T07:12:48.363 INFO:teuthology.orchestra.run.smithi098.stdout:setting min_mon_release = quincy 2024-09-19T07:12:48.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/monmaptool: set fsid to 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:12:48.363 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T07:12:48.364 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:12:48.364 INFO:teuthology.orchestra.run.smithi098.stdout:Creating mon... 2024-09-19T07:12:49.618 INFO:teuthology.orchestra.run.smithi098.stdout:create mon.a on 2024-09-19T07:12:49.812 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T07:12:49.960 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T07:12:50.139 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-73438718-7656-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-73438718-7656-11ef-bceb-c7b262605968.target. 2024-09-19T07:12:50.139 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-73438718-7656-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-73438718-7656-11ef-bceb-c7b262605968.target. 2024-09-19T07:12:50.372 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-73438718-7656-11ef-bceb-c7b262605968@mon.a 2024-09-19T07:12:50.372 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Failed to reset failed state of unit ceph-73438718-7656-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-73438718-7656-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T07:12:50.529 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-73438718-7656-11ef-bceb-c7b262605968.target.wants/ceph-73438718-7656-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-73438718-7656-11ef-bceb-c7b262605968@.service. 2024-09-19T07:12:51.004 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:50 smithi098 ceph-mon[30569]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T07:12:51.023 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T07:12:51.023 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout disabled 2024-09-19T07:12:51.031 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T07:12:51.032 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout inactive 2024-09-19T07:12:51.032 INFO:teuthology.orchestra.run.smithi098.stdout:firewalld.service is not enabled 2024-09-19T07:12:51.032 INFO:teuthology.orchestra.run.smithi098.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T07:12:51.032 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for mon to start... 2024-09-19T07:12:51.032 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for mon... 2024-09-19T07:12:51.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 bash[30550]: 3259c69f7d5bc35ee3095f58984fe9d94f48932a970dcf1f4d2e5c672f2cc63c 2024-09-19T07:12:51.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 systemd[1]: Started Ceph mon.a for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:12:52.177 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 ceph-mon[30569]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T07:12:52.178 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 ceph-mon[30569]: monmap epoch 1 2024-09-19T07:12:52.178 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 ceph-mon[30569]: fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:12:52.178 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 ceph-mon[30569]: last_changed 2024-09-19T07:12:41.724467+0000 2024-09-19T07:12:52.178 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 ceph-mon[30569]: created 2024-09-19T07:12:41.724467+0000 2024-09-19T07:12:52.178 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 ceph-mon[30569]: min_mon_release 19 (squid) 2024-09-19T07:12:52.178 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 ceph-mon[30569]: election_strategy: 1 2024-09-19T07:12:52.178 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 ceph-mon[30569]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-19T07:12:52.178 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 ceph-mon[30569]: fsmap 2024-09-19T07:12:52.178 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 ceph-mon[30569]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T07:12:52.178 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 ceph-mon[30569]: mgrmap e1: no daemons active 2024-09-19T07:12:52.178 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:51 smithi098 ceph-mon[30569]: from='client.? 172.21.15.98:0/3812999162' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T07:12:52.186 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T07:12:52.186 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout id: 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:12:52.186 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T07:12:52.186 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-19T07:12:52.187 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout services: 2024-09-19T07:12:52.187 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.599749s) 2024-09-19T07:12:52.187 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T07:12:52.187 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T07:12:52.187 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-19T07:12:52.187 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout data: 2024-09-19T07:12:52.187 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T07:12:52.187 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T07:12:52.187 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T07:12:52.187 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T07:12:52.187 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-19T07:12:52.187 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.494+0000 7f5ec91ba640 1 Processor -- start 2024-09-19T07:12:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.494+0000 7f5ec91ba640 1 -- start start 2024-09-19T07:12:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.494+0000 7f5ec91ba640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 0x7f5ec4109390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.494+0000 7f5ec91ba640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec4107520 con 0x7f5ec4108f90 2024-09-19T07:12:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.495+0000 7f5ec2d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 0x7f5ec4109390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.495+0000 7f5ec2d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 0x7f5ec4109390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48118/0 (socket says 172.21.15.98:48118) 2024-09-19T07:12:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.495+0000 7f5ec2d9d640 1 -- 172.21.15.98:0/4135889705 learned_addr learned my addr 172.21.15.98:0/4135889705 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:12:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.495+0000 7f5ec2d9d640 1 -- 172.21.15.98:0/4135889705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec41076a0 con 0x7f5ec4108f90 2024-09-19T07:12:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.497+0000 7f5ec2d9d640 1 --2- 172.21.15.98:0/4135889705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 0x7f5ec4109390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009820 tx=0x7f5ebc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f36cdab11508c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.497+0000 7f5ec1d9b640 1 -- 172.21.15.98:0/4135889705 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ebc037070 con 0x7f5ec4108f90 2024-09-19T07:12:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.497+0000 7f5ec1d9b640 1 -- 172.21.15.98:0/4135889705 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ebc032440 con 0x7f5ec4108f90 2024-09-19T07:12:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.497+0000 7f5ec1d9b640 1 -- 172.21.15.98:0/4135889705 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ebc032740 con 0x7f5ec4108f90 2024-09-19T07:12:52.188 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.498+0000 7f5ec91ba640 1 -- 172.21.15.98:0/4135889705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 msgr2=0x7f5ec4109390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.498+0000 7f5ec91ba640 1 --2- 172.21.15.98:0/4135889705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 0x7f5ec4109390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009820 tx=0x7f5ebc02a270 comp rx=0 tx=0).stop 2024-09-19T07:12:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.498+0000 7f5ec91ba640 1 -- 172.21.15.98:0/4135889705 shutdown_connections 2024-09-19T07:12:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.498+0000 7f5ec91ba640 1 --2- 172.21.15.98:0/4135889705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 0x7f5ec4109390 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.498+0000 7f5ec91ba640 1 -- 172.21.15.98:0/4135889705 >> 172.21.15.98:0/4135889705 conn(0x7f5ec4103090 msgr2=0x7f5ec41054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.498+0000 7f5ec91ba640 1 -- 172.21.15.98:0/4135889705 shutdown_connections 2024-09-19T07:12:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.498+0000 7f5ec91ba640 1 -- 172.21.15.98:0/4135889705 wait complete. 2024-09-19T07:12:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.499+0000 7f5ec91ba640 1 Processor -- start 2024-09-19T07:12:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.499+0000 7f5ec91ba640 1 -- start start 2024-09-19T07:12:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.500+0000 7f5ec91ba640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 0x7f5ec419b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.500+0000 7f5ec91ba640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec4107bd0 con 0x7f5ec4108f90 2024-09-19T07:12:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.500+0000 7f5ec2d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 0x7f5ec419b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:52.189 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.500+0000 7f5ec2d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 0x7f5ec419b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48132/0 (socket says 172.21.15.98:48132) 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.500+0000 7f5ec2d9d640 1 -- 172.21.15.98:0/3812999162 learned_addr learned my addr 172.21.15.98:0/3812999162 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.500+0000 7f5ec2d9d640 1 -- 172.21.15.98:0/3812999162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec419b680 con 0x7f5ec4108f90 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.500+0000 7f5ec2d9d640 1 --2- 172.21.15.98:0/3812999162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 0x7f5ec419b140 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0090b0 tx=0x7f5ebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.500+0000 7f5ebbfff640 1 -- 172.21.15.98:0/3812999162 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ebc041070 con 0x7f5ec4108f90 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.500+0000 7f5ebbfff640 1 -- 172.21.15.98:0/3812999162 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ebc03c7a0 con 0x7f5ec4108f90 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.500+0000 7f5ec91ba640 1 -- 172.21.15.98:0/3812999162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec419b910 con 0x7f5ec4108f90 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.501+0000 7f5ebbfff640 1 -- 172.21.15.98:0/3812999162 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ebc037040 con 0x7f5ec4108f90 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.501+0000 7f5ec91ba640 1 -- 172.21.15.98:0/3812999162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec419e600 con 0x7f5ec4108f90 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.501+0000 7f5ebbfff640 1 -- 172.21.15.98:0/3812999162 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ebc044070 con 0x7f5ec4108f90 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.501+0000 7f5ebbfff640 1 -- 172.21.15.98:0/3812999162 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5ebc03d730 con 0x7f5ec4108f90 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.502+0000 7f5ec91ba640 1 -- 172.21.15.98:0/3812999162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec4108220 con 0x7f5ec4108f90 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.504+0000 7f5ebbfff640 1 -- 172.21.15.98:0/3812999162 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5ebc03cbe0 con 0x7f5ec4108f90 2024-09-19T07:12:52.190 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.565+0000 7f5ec91ba640 1 -- 172.21.15.98:0/3812999162 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f5ec402d7c0 con 0x7f5ec4108f90 2024-09-19T07:12:52.191 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.566+0000 7f5ebbfff640 1 -- 172.21.15.98:0/3812999162 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f5ebc03cdc0 con 0x7f5ec4108f90 2024-09-19T07:12:52.191 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.566+0000 7f5ec91ba640 1 -- 172.21.15.98:0/3812999162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 msgr2=0x7f5ec419b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:52.191 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.566+0000 7f5ec91ba640 1 --2- 172.21.15.98:0/3812999162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 0x7f5ec419b140 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0090b0 tx=0x7f5ebc0046c0 comp rx=0 tx=0).stop 2024-09-19T07:12:52.191 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.566+0000 7f5ec91ba640 1 -- 172.21.15.98:0/3812999162 shutdown_connections 2024-09-19T07:12:52.191 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.566+0000 7f5ec91ba640 1 --2- 172.21.15.98:0/3812999162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ec4108f90 0x7f5ec419b140 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:52.191 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.566+0000 7f5ec91ba640 1 -- 172.21.15.98:0/3812999162 >> 172.21.15.98:0/3812999162 conn(0x7f5ec4103090 msgr2=0x7f5ec4191e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:52.191 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.567+0000 7f5ec91ba640 1 -- 172.21.15.98:0/3812999162 shutdown_connections 2024-09-19T07:12:52.191 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:51.567+0000 7f5ec91ba640 1 -- 172.21.15.98:0/3812999162 wait complete. 2024-09-19T07:12:52.191 INFO:teuthology.orchestra.run.smithi098.stdout:mon is available 2024-09-19T07:12:52.191 INFO:teuthology.orchestra.run.smithi098.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T07:12:53.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:52 smithi098 ceph-mon[30569]: from='client.? 172.21.15.98:0/4272671210' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T07:12:53.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:52 smithi098 ceph-mon[30569]: from='client.? 172.21.15.98:0/4272671210' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T07:12:53.284 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout fsid = 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.98:3300,v1:172.21.15.98:6789] 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T07:12:53.285 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.615+0000 7f186a3ab640 1 Processor -- start 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.615+0000 7f186a3ab640 1 -- start start 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.615+0000 7f186a3ab640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 0x7f186410a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.615+0000 7f186a3ab640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f186407be30 con 0x7f1864108400 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.616+0000 7f1863fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 0x7f186410a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.616+0000 7f1863fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 0x7f186410a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45968/0 (socket says 172.21.15.98:45968) 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.616+0000 7f1863fff640 1 -- 172.21.15.98:0/4056483368 learned_addr learned my addr 172.21.15.98:0/4056483368 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.616+0000 7f1863fff640 1 -- 172.21.15.98:0/4056483368 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186410ad30 con 0x7f1864108400 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.617+0000 7f1863fff640 1 --2- 172.21.15.98:0/4056483368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 0x7f186410a7f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1854009820 tx=0x7f185402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb09493c7131e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:53.286 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.617+0000 7f18637fe640 1 -- 172.21.15.98:0/4056483368 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1854037070 con 0x7f1864108400 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.617+0000 7f18637fe640 1 -- 172.21.15.98:0/4056483368 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1854032440 con 0x7f1864108400 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.617+0000 7f18637fe640 1 -- 172.21.15.98:0/4056483368 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1854032740 con 0x7f1864108400 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.617+0000 7f186a3ab640 1 -- 172.21.15.98:0/4056483368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 msgr2=0x7f186410a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.617+0000 7f186a3ab640 1 --2- 172.21.15.98:0/4056483368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 0x7f186410a7f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1854009820 tx=0x7f185402a270 comp rx=0 tx=0).stop 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.617+0000 7f186a3ab640 1 -- 172.21.15.98:0/4056483368 shutdown_connections 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.617+0000 7f186a3ab640 1 --2- 172.21.15.98:0/4056483368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 0x7f186410a7f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.617+0000 7f186a3ab640 1 -- 172.21.15.98:0/4056483368 >> 172.21.15.98:0/4056483368 conn(0x7f1864102020 msgr2=0x7f1864104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.617+0000 7f186a3ab640 1 -- 172.21.15.98:0/4056483368 shutdown_connections 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.617+0000 7f186a3ab640 1 -- 172.21.15.98:0/4056483368 wait complete. 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.618+0000 7f186a3ab640 1 Processor -- start 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.618+0000 7f186a3ab640 1 -- start start 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.618+0000 7f186a3ab640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 0x7f1864107c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.618+0000 7f186a3ab640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f186410b1a0 con 0x7f1864108400 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.618+0000 7f1863fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 0x7f1864107c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.618+0000 7f1863fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 0x7f1864107c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45982/0 (socket says 172.21.15.98:45982) 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.618+0000 7f1863fff640 1 -- 172.21.15.98:0/4272671210 learned_addr learned my addr 172.21.15.98:0/4272671210 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.619+0000 7f1863fff640 1 -- 172.21.15.98:0/4272671210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18641081c0 con 0x7f1864108400 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.619+0000 7f1863fff640 1 --2- 172.21.15.98:0/4272671210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 0x7f1864107c80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f18540090b0 tx=0x7f18540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.619+0000 7f1861ffb640 1 -- 172.21.15.98:0/4272671210 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1854041070 con 0x7f1864108400 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.619+0000 7f1861ffb640 1 -- 172.21.15.98:0/4272671210 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185403c7a0 con 0x7f1864108400 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.619+0000 7f186a3ab640 1 -- 172.21.15.98:0/4272671210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18641063b0 con 0x7f1864108400 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.619+0000 7f1861ffb640 1 -- 172.21.15.98:0/4272671210 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1854037040 con 0x7f1864108400 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.619+0000 7f186a3ab640 1 -- 172.21.15.98:0/4272671210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18641068f0 con 0x7f1864108400 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.619+0000 7f1861ffb640 1 -- 172.21.15.98:0/4272671210 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1854044070 con 0x7f1864108400 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.619+0000 7f1861ffb640 1 -- 172.21.15.98:0/4272671210 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f185403d3f0 con 0x7f1864108400 2024-09-19T07:12:53.288 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.620+0000 7f186a3ab640 1 -- 172.21.15.98:0/4272671210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1864108860 con 0x7f1864108400 2024-09-19T07:12:53.289 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.622+0000 7f1861ffb640 1 -- 172.21.15.98:0/4272671210 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1854046e20 con 0x7f1864108400 2024-09-19T07:12:53.289 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.678+0000 7f186a3ab640 1 -- 172.21.15.98:0/4272671210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f1864194a30 con 0x7f1864108400 2024-09-19T07:12:53.289 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.681+0000 7f1861ffb640 1 -- 172.21.15.98:0/4272671210 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f1854046450 con 0x7f1864108400 2024-09-19T07:12:53.289 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.682+0000 7f1861ffb640 1 -- 172.21.15.98:0/4272671210 <== mon.0 v2:172.21.15.98:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1854046630 con 0x7f1864108400 2024-09-19T07:12:53.289 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.683+0000 7f186a3ab640 1 -- 172.21.15.98:0/4272671210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 msgr2=0x7f1864107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:53.289 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.683+0000 7f186a3ab640 1 --2- 172.21.15.98:0/4272671210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 0x7f1864107c80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f18540090b0 tx=0x7f18540046c0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.289 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.683+0000 7f186a3ab640 1 -- 172.21.15.98:0/4272671210 shutdown_connections 2024-09-19T07:12:53.289 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.683+0000 7f186a3ab640 1 --2- 172.21.15.98:0/4272671210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1864108400 0x7f1864107c80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:53.289 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.683+0000 7f186a3ab640 1 -- 172.21.15.98:0/4272671210 >> 172.21.15.98:0/4272671210 conn(0x7f1864102020 msgr2=0x7f1864103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:53.289 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.683+0000 7f186a3ab640 1 -- 172.21.15.98:0/4272671210 shutdown_connections 2024-09-19T07:12:53.289 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:52.683+0000 7f186a3ab640 1 -- 172.21.15.98:0/4272671210 wait complete. 2024-09-19T07:12:53.289 INFO:teuthology.orchestra.run.smithi098.stdout:Generating new minimal ceph.conf... 2024-09-19T07:12:54.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:53 smithi098 ceph-mon[30569]: from='client.? 172.21.15.98:0/3038370012' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:12:54.701 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.740+0000 7f346a9fb640 1 Processor -- start 2024-09-19T07:12:54.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.740+0000 7f346a9fb640 1 -- start start 2024-09-19T07:12:54.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.740+0000 7f346a9fb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 0x7f346407c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:54.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.740+0000 7f346a9fb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f346407c8b0 con 0x7f346407de80 2024-09-19T07:12:54.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.740+0000 7f3463fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 0x7f346407c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:54.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.740+0000 7f3463fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 0x7f346407c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45988/0 (socket says 172.21.15.98:45988) 2024-09-19T07:12:54.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.740+0000 7f3463fff640 1 -- 172.21.15.98:0/1879520393 learned_addr learned my addr 172.21.15.98:0/1879520393 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:12:54.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.741+0000 7f3463fff640 1 -- 172.21.15.98:0/1879520393 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346407ca30 con 0x7f346407de80 2024-09-19T07:12:54.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.742+0000 7f3463fff640 1 --2- 172.21.15.98:0/1879520393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 0x7f346407c2e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3454009820 tx=0x7f345402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98c875d8be7cba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:54.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.742+0000 7f3462ffd640 1 -- 172.21.15.98:0/1879520393 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3454037070 con 0x7f346407de80 2024-09-19T07:12:54.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.742+0000 7f3462ffd640 1 -- 172.21.15.98:0/1879520393 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3454032900 con 0x7f346407de80 2024-09-19T07:12:54.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.742+0000 7f3462ffd640 1 -- 172.21.15.98:0/1879520393 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3454030850 con 0x7f346407de80 2024-09-19T07:12:54.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.742+0000 7f346a9fb640 1 -- 172.21.15.98:0/1879520393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 msgr2=0x7f346407c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:54.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.742+0000 7f346a9fb640 1 --2- 172.21.15.98:0/1879520393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 0x7f346407c2e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3454009820 tx=0x7f345402a270 comp rx=0 tx=0).stop 2024-09-19T07:12:54.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.742+0000 7f346a9fb640 1 -- 172.21.15.98:0/1879520393 shutdown_connections 2024-09-19T07:12:54.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.742+0000 7f346a9fb640 1 --2- 172.21.15.98:0/1879520393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 0x7f346407c2e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:54.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.742+0000 7f346a9fb640 1 -- 172.21.15.98:0/1879520393 >> 172.21.15.98:0/1879520393 conn(0x7f34641030b0 msgr2=0x7f34641054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:54.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.742+0000 7f346a9fb640 1 -- 172.21.15.98:0/1879520393 shutdown_connections 2024-09-19T07:12:54.708 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.742+0000 7f346a9fb640 1 -- 172.21.15.98:0/1879520393 wait complete. 2024-09-19T07:12:54.708 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.743+0000 7f346a9fb640 1 Processor -- start 2024-09-19T07:12:54.708 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.743+0000 7f346a9fb640 1 -- start start 2024-09-19T07:12:54.708 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.743+0000 7f346a9fb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 0x7f346419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:54.708 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.743+0000 7f346a9fb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f346410df10 con 0x7f346407de80 2024-09-19T07:12:54.708 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.744+0000 7f3463fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 0x7f346419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:54.708 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.744+0000 7f3463fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 0x7f346419da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45996/0 (socket says 172.21.15.98:45996) 2024-09-19T07:12:54.708 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.744+0000 7f3463fff640 1 -- 172.21.15.98:0/3038370012 learned_addr learned my addr 172.21.15.98:0/3038370012 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:12:54.708 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.744+0000 7f3463fff640 1 -- 172.21.15.98:0/3038370012 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346419dfc0 con 0x7f346407de80 2024-09-19T07:12:54.708 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.744+0000 7f3463fff640 1 --2- 172.21.15.98:0/3038370012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 0x7f346419da80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f34540097f0 tx=0x7f3454030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:54.708 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.744+0000 7f34617fa640 1 -- 172.21.15.98:0/3038370012 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3454042070 con 0x7f346407de80 2024-09-19T07:12:54.708 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.744+0000 7f34617fa640 1 -- 172.21.15.98:0/3038370012 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3454032ca0 con 0x7f346407de80 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.744+0000 7f346a9fb640 1 -- 172.21.15.98:0/3038370012 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346419e250 con 0x7f346407de80 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.744+0000 7f34617fa640 1 -- 172.21.15.98:0/3038370012 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3454037040 con 0x7f346407de80 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.744+0000 7f346a9fb640 1 -- 172.21.15.98:0/3038370012 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34641a0f40 con 0x7f346407de80 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.744+0000 7f34617fa640 1 -- 172.21.15.98:0/3038370012 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3454045070 con 0x7f346407de80 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.744+0000 7f34617fa640 1 -- 172.21.15.98:0/3038370012 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3454047a90 con 0x7f346407de80 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.745+0000 7f346a9fb640 1 -- 172.21.15.98:0/3038370012 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346407c360 con 0x7f346407de80 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.747+0000 7f34617fa640 1 -- 172.21.15.98:0/3038370012 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f345403db10 con 0x7f346407de80 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.804+0000 7f346a9fb640 1 -- 172.21.15.98:0/3038370012 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f34641a14b0 con 0x7f346407de80 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.804+0000 7f34617fa640 1 -- 172.21.15.98:0/3038370012 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f345403d430 con 0x7f346407de80 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.805+0000 7f346a9fb640 1 -- 172.21.15.98:0/3038370012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 msgr2=0x7f346419da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.805+0000 7f346a9fb640 1 --2- 172.21.15.98:0/3038370012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 0x7f346419da80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f34540097f0 tx=0x7f3454030ec0 comp rx=0 tx=0).stop 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.805+0000 7f346a9fb640 1 -- 172.21.15.98:0/3038370012 shutdown_connections 2024-09-19T07:12:54.709 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.805+0000 7f346a9fb640 1 --2- 172.21.15.98:0/3038370012 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f346407de80 0x7f346419da80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:54.710 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.805+0000 7f346a9fb640 1 -- 172.21.15.98:0/3038370012 >> 172.21.15.98:0/3038370012 conn(0x7f34641030b0 msgr2=0x7f3464103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:54.710 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.805+0000 7f346a9fb640 1 -- 172.21.15.98:0/3038370012 shutdown_connections 2024-09-19T07:12:54.710 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:53.805+0000 7f346a9fb640 1 -- 172.21.15.98:0/3038370012 wait complete. 2024-09-19T07:12:54.710 INFO:teuthology.orchestra.run.smithi098.stdout:Restarting the monitor... 2024-09-19T07:12:55.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:54 smithi098 systemd[1]: Stopping Ceph mon.a for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:12:55.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:54 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a[30565]: 2024-09-19T07:12:54.984+0000 7ff99a378640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:12:55.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:54 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a[30565]: 2024-09-19T07:12:54.984+0000 7ff99a378640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T07:12:55.359 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:55 smithi098 podman[30823]: 2024-09-19 07:12:55.107458052 +0000 UTC m=+0.222553096 container died 3259c69f7d5bc35ee3095f58984fe9d94f48932a970dcf1f4d2e5c672f2cc63c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:12:55.618 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:55 smithi098 podman[30823]: 2024-09-19 07:12:55.450950154 +0000 UTC m=+0.566045199 container cleanup 3259c69f7d5bc35ee3095f58984fe9d94f48932a970dcf1f4d2e5c672f2cc63c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:12:55.618 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:55 smithi098 bash[30823]: ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a 2024-09-19T07:12:56.011 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:55 smithi098 podman[30835]: 2024-09-19 07:12:55.618628977 +0000 UTC m=+0.508073033 container remove 3259c69f7d5bc35ee3095f58984fe9d94f48932a970dcf1f4d2e5c672f2cc63c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T07:12:56.011 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:55 smithi098 systemd[1]: ceph-73438718-7656-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T07:12:56.011 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:55 smithi098 systemd[1]: Stopped Ceph mon.a for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:12:56.011 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:55 smithi098 systemd[1]: Starting Ceph mon.a for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:12:56.271 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 podman[30931]: 2024-09-19 07:12:56.01126911 +0000 UTC m=+0.099084867 container create 11bd946099decb0e7943f1bc34b5e5d93af1ccc9076f894c16af9df50ccebbda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T07:12:56.271 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 podman[30931]: 2024-09-19 07:12:55.927769349 +0000 UTC m=+0.015585112 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:12:56.271 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 podman[30931]: 2024-09-19 07:12:56.24711266 +0000 UTC m=+0.334928415 container init 11bd946099decb0e7943f1bc34b5e5d93af1ccc9076f894c16af9df50ccebbda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T07:12:56.271 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 podman[30931]: 2024-09-19 07:12:56.250371084 +0000 UTC m=+0.338186838 container start 11bd946099decb0e7943f1bc34b5e5d93af1ccc9076f894c16af9df50ccebbda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:12:56.271 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T07:12:56.368 INFO:teuthology.orchestra.run.smithi098.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T07:12:56.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T07:12:56.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: pidfile_write: ignore empty --pid-file 2024-09-19T07:12:56.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: load: jerasure load: lrc 2024-09-19T07:12:56.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: RocksDB version: 7.9.2 2024-09-19T07:12:56.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Git sha 0 2024-09-19T07:12:56.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T07:12:56.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: DB SUMMARY 2024-09-19T07:12:56.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: DB Session ID: 8KQNZ0A54ECIFJ6A5BZ9 2024-09-19T07:12:56.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: CURRENT file: CURRENT 2024-09-19T07:12:56.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T07:12:56.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T07:12:56.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T07:12:56.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 107224 ; 2024-09-19T07:12:56.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.error_if_exists: 0 2024-09-19T07:12:56.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.create_if_missing: 0 2024-09-19T07:12:56.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.paranoid_checks: 1 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.env: 0x55cd99106940 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.info_log: 0x55cd9b72f6e0 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.statistics: (nil) 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.use_fsync: 0 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_log_file_size: 0 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T07:12:56.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.allow_fallocate: 1 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.use_direct_reads: 0 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.db_log_dir: 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.wal_dir: 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T07:12:56.527 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T07:12:56.528 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T07:12:56.528 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T07:12:56.528 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.write_buffer_manager: 0x55cd9b73edc0 2024-09-19T07:12:56.528 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T07:12:56.528 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T07:12:56.528 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T07:12:56.528 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T07:12:56.528 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T07:12:56.528 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T07:12:56.528 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.unordered_write: 0 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.row_cache: None 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.wal_filter: None 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.two_write_queues: 0 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T07:12:56.529 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.wal_compression: 0 2024-09-19T07:12:56.530 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.atomic_flush: 0 2024-09-19T07:12:56.530 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T07:12:56.530 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T07:12:56.530 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T07:12:56.530 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.log_readahead_size: 0 2024-09-19T07:12:56.530 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T07:12:56.530 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T07:12:56.530 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T07:12:56.530 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T07:12:56.531 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T07:12:56.531 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T07:12:56.531 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T07:12:56.532 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_background_jobs: 2 2024-09-19T07:12:56.532 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_background_compactions: -1 2024-09-19T07:12:56.532 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_subcompactions: 1 2024-09-19T07:12:56.532 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T07:12:56.532 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T07:12:56.533 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T07:12:56.533 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T07:12:56.533 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T07:12:56.533 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T07:12:56.533 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T07:12:56.533 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T07:12:56.533 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_open_files: -1 2024-09-19T07:12:56.533 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T07:12:56.533 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T07:12:56.534 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T07:12:56.534 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T07:12:56.534 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_background_flushes: -1 2024-09-19T07:12:56.534 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Compression algorithms supported: 2024-09-19T07:12:56.534 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: kZSTD supported: 0 2024-09-19T07:12:56.534 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: kXpressCompression supported: 0 2024-09-19T07:12:56.534 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: kBZip2Compression supported: 0 2024-09-19T07:12:56.534 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T07:12:56.534 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: kLZ4Compression supported: 1 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: kZlibCompression supported: 1 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: kSnappyCompression supported: 1 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.merge_operator: 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_filter: None 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T07:12:56.535 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T07:12:56.536 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cd9b72f320) 2024-09-19T07:12:56.536 INFO:journalctl@ceph.mon.a.smithi098.stdout: cache_index_and_filter_blocks: 1 2024-09-19T07:12:56.536 INFO:journalctl@ceph.mon.a.smithi098.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T07:12:56.536 INFO:journalctl@ceph.mon.a.smithi098.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T07:12:56.536 INFO:journalctl@ceph.mon.a.smithi098.stdout: pin_top_level_index_and_filter: 1 2024-09-19T07:12:56.536 INFO:journalctl@ceph.mon.a.smithi098.stdout: index_type: 0 2024-09-19T07:12:56.536 INFO:journalctl@ceph.mon.a.smithi098.stdout: data_block_index_type: 0 2024-09-19T07:12:56.536 INFO:journalctl@ceph.mon.a.smithi098.stdout: index_shortening: 1 2024-09-19T07:12:56.536 INFO:journalctl@ceph.mon.a.smithi098.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T07:12:56.536 INFO:journalctl@ceph.mon.a.smithi098.stdout: checksum: 4 2024-09-19T07:12:56.536 INFO:journalctl@ceph.mon.a.smithi098.stdout: no_block_cache: 0 2024-09-19T07:12:56.537 INFO:journalctl@ceph.mon.a.smithi098.stdout: block_cache: 0x55cd9b7231f0 2024-09-19T07:12:56.537 INFO:journalctl@ceph.mon.a.smithi098.stdout: block_cache_name: BinnedLRUCache 2024-09-19T07:12:56.537 INFO:journalctl@ceph.mon.a.smithi098.stdout: block_cache_options: 2024-09-19T07:12:56.537 INFO:journalctl@ceph.mon.a.smithi098.stdout: capacity : 536870912 2024-09-19T07:12:56.537 INFO:journalctl@ceph.mon.a.smithi098.stdout: num_shard_bits : 4 2024-09-19T07:12:56.537 INFO:journalctl@ceph.mon.a.smithi098.stdout: strict_capacity_limit : 0 2024-09-19T07:12:56.537 INFO:journalctl@ceph.mon.a.smithi098.stdout: high_pri_pool_ratio: 0.000 2024-09-19T07:12:56.537 INFO:journalctl@ceph.mon.a.smithi098.stdout: block_cache_compressed: (nil) 2024-09-19T07:12:56.537 INFO:journalctl@ceph.mon.a.smithi098.stdout: persistent_cache: (nil) 2024-09-19T07:12:56.538 INFO:journalctl@ceph.mon.a.smithi098.stdout: block_size: 4096 2024-09-19T07:12:56.538 INFO:journalctl@ceph.mon.a.smithi098.stdout: block_size_deviation: 10 2024-09-19T07:12:56.538 INFO:journalctl@ceph.mon.a.smithi098.stdout: block_restart_interval: 16 2024-09-19T07:12:56.538 INFO:journalctl@ceph.mon.a.smithi098.stdout: index_block_restart_interval: 1 2024-09-19T07:12:56.538 INFO:journalctl@ceph.mon.a.smithi098.stdout: metadata_block_size: 4096 2024-09-19T07:12:56.538 INFO:journalctl@ceph.mon.a.smithi098.stdout: partition_filters: 0 2024-09-19T07:12:56.538 INFO:journalctl@ceph.mon.a.smithi098.stdout: use_delta_encoding: 1 2024-09-19T07:12:56.538 INFO:journalctl@ceph.mon.a.smithi098.stdout: filter_policy: bloomfilter 2024-09-19T07:12:56.538 INFO:journalctl@ceph.mon.a.smithi098.stdout: whole_key_filtering: 1 2024-09-19T07:12:56.538 INFO:journalctl@ceph.mon.a.smithi098.stdout: verify_compression: 0 2024-09-19T07:12:56.538 INFO:journalctl@ceph.mon.a.smithi098.stdout: read_amp_bytes_per_bit: 0 2024-09-19T07:12:56.539 INFO:journalctl@ceph.mon.a.smithi098.stdout: format_version: 5 2024-09-19T07:12:56.539 INFO:journalctl@ceph.mon.a.smithi098.stdout: enable_index_compression: 1 2024-09-19T07:12:56.539 INFO:journalctl@ceph.mon.a.smithi098.stdout: block_align: 0 2024-09-19T07:12:56.539 INFO:journalctl@ceph.mon.a.smithi098.stdout: max_auto_readahead_size: 262144 2024-09-19T07:12:56.539 INFO:journalctl@ceph.mon.a.smithi098.stdout: prepopulate_block_cache: 0 2024-09-19T07:12:56.539 INFO:journalctl@ceph.mon.a.smithi098.stdout: initial_auto_readahead_size: 8192 2024-09-19T07:12:56.539 INFO:journalctl@ceph.mon.a.smithi098.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T07:12:56.539 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T07:12:56.539 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T07:12:56.539 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compression: NoCompression 2024-09-19T07:12:56.540 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T07:12:56.540 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T07:12:56.540 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T07:12:56.540 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.num_levels: 7 2024-09-19T07:12:56.540 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T07:12:56.540 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T07:12:56.540 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T07:12:56.540 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T07:12:56.540 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T07:12:56.541 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T07:12:56.541 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T07:12:56.541 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:12:56.541 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T07:12:56.541 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T07:12:56.541 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:12:56.541 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T07:12:56.542 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T07:12:56.543 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T07:12:56.544 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T07:12:56.544 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T07:12:56.544 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T07:12:56.544 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T07:12:56.544 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T07:12:56.544 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T07:12:56.544 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T07:12:56.544 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T07:12:56.544 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T07:12:56.544 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T07:12:56.544 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T07:12:56.545 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T07:12:56.545 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T07:12:56.545 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T07:12:56.545 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T07:12:56.545 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T07:12:56.545 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.inplace_update_support: 0 2024-09-19T07:12:56.545 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T07:12:56.545 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T07:12:56.546 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T07:12:56.546 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T07:12:56.546 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.bloom_locality: 0 2024-09-19T07:12:56.546 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.max_successive_merges: 0 2024-09-19T07:12:56.546 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T07:12:56.546 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T07:12:56.546 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T07:12:56.546 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T07:12:56.546 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.ttl: 2592000 2024-09-19T07:12:56.546 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T07:12:56.546 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.enable_blob_files: false 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.min_blob_size: 0 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T07:12:56.547 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9b23d43f-7c36-46f0-b35c-34421a9a1ce4 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729976276570, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729976277622, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 102107, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 336, "table_properties": {"data_size": 99995, "index_size": 304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14782, "raw_average_key_size": 50, "raw_value_size": 91997, "raw_average_value_size": 311, "num_data_blocks": 12, "num_entries": 295, "num_filter_entries": 295, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726729976, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9b23d43f-7c36-46f0-b35c-34421a9a1ce4", "db_session_id": "8KQNZ0A54ECIFJ6A5BZ9", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726729976277717, "job": 1, "event": "recovery_finished"} 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55cd9b750e00 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: DB pointer 0x55cd9b84c000 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout: ** DB Stats ** 2024-09-19T07:12:56.548 INFO:journalctl@ceph.mon.a.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:12:56.549 INFO:journalctl@ceph.mon.a.smithi098.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T07:12:56.549 INFO:journalctl@ceph.mon.a.smithi098.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:12:56.549 INFO:journalctl@ceph.mon.a.smithi098.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:12:56.549 INFO:journalctl@ceph.mon.a.smithi098.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T07:12:56.549 INFO:journalctl@ceph.mon.a.smithi098.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:12:56.549 INFO:journalctl@ceph.mon.a.smithi098.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:12:56.549 INFO:journalctl@ceph.mon.a.smithi098.stdout: 2024-09-19T07:12:56.549 INFO:journalctl@ceph.mon.a.smithi098.stdout: ** Compaction Stats [default] ** 2024-09-19T07:12:56.550 INFO:journalctl@ceph.mon.a.smithi098.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:12:56.550 INFO:journalctl@ceph.mon.a.smithi098.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T07:12:56.550 INFO:journalctl@ceph.mon.a.smithi098.stdout: L0 2/0 101.57 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:12:56.550 INFO:journalctl@ceph.mon.a.smithi098.stdout: Sum 2/0 101.57 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:12:56.550 INFO:journalctl@ceph.mon.a.smithi098.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 144.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:12:56.550 INFO:journalctl@ceph.mon.a.smithi098.stdout: 2024-09-19T07:12:56.550 INFO:journalctl@ceph.mon.a.smithi098.stdout: ** Compaction Stats [default] ** 2024-09-19T07:12:56.551 INFO:journalctl@ceph.mon.a.smithi098.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:12:56.551 INFO:journalctl@ceph.mon.a.smithi098.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T07:12:56.551 INFO:journalctl@ceph.mon.a.smithi098.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 144.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:12:56.551 INFO:journalctl@ceph.mon.a.smithi098.stdout: 2024-09-19T07:12:56.551 INFO:journalctl@ceph.mon.a.smithi098.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T07:12:56.551 INFO:journalctl@ceph.mon.a.smithi098.stdout: 2024-09-19T07:12:56.551 INFO:journalctl@ceph.mon.a.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:12:56.551 INFO:journalctl@ceph.mon.a.smithi098.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T07:12:56.551 INFO:journalctl@ceph.mon.a.smithi098.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T07:12:56.551 INFO:journalctl@ceph.mon.a.smithi098.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T07:12:56.551 INFO:journalctl@ceph.mon.a.smithi098.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout: Cumulative compaction: 0.00 GB write, 31.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout: Interval compaction: 0.00 GB write, 31.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout: Block cache BinnedLRUCache@0x55cd9b7231f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout: 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: starting mon.a rank 0 at public addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] at bind addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: mon.a@-1(???) e1 preinit fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: mon.a@-1(???).mds e1 new map 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: mon.a@-1(???).mds e1 print_map 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout: e1 2024-09-19T07:12:56.552 INFO:journalctl@ceph.mon.a.smithi098.stdout: btime 2024-09-19T07:12:50:967629+0000 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout: legacy client fscid: -1 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout: 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout: No filesystems configured 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: monmap epoch 1 2024-09-19T07:12:56.553 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:12:56.554 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: last_changed 2024-09-19T07:12:41.724467+0000 2024-09-19T07:12:56.554 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: created 2024-09-19T07:12:41.724467+0000 2024-09-19T07:12:56.554 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: min_mon_release 19 (squid) 2024-09-19T07:12:56.554 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: election_strategy: 1 2024-09-19T07:12:56.554 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-19T07:12:56.554 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: fsmap 2024-09-19T07:12:56.554 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T07:12:56.554 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 ceph-mon[30950]: mgrmap e1: no daemons active 2024-09-19T07:12:56.554 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 bash[30931]: 11bd946099decb0e7943f1bc34b5e5d93af1ccc9076f894c16af9df50ccebbda 2024-09-19T07:12:56.554 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:56 smithi098 systemd[1]: Started Ceph mon.a for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:12:57.453 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.772+0000 7f9dceb52640 1 Processor -- start 2024-09-19T07:12:57.453 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.773+0000 7f9dceb52640 1 -- start start 2024-09-19T07:12:57.453 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.773+0000 7f9dceb52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 0x7f9dc810a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:57.453 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.773+0000 7f9dceb52640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc807be50 con 0x7f9dc81083e0 2024-09-19T07:12:57.453 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.773+0000 7f9dcc8ee640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 0x7f9dc810a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:57.453 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.773+0000 7f9dcc8ee640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 0x7f9dc810a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46000/0 (socket says 172.21.15.98:46000) 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.773+0000 7f9dcc8ee640 1 -- 172.21.15.98:0/3638112153 learned_addr learned my addr 172.21.15.98:0/3638112153 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.773+0000 7f9dcc8ee640 1 -- 172.21.15.98:0/3638112153 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc810ad10 con 0x7f9dc81083e0 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.775+0000 7f9dcc8ee640 1 --2- 172.21.15.98:0/3638112153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 0x7f9dc810a7d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009820 tx=0x7f9dbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17216ed5cb61e53d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.775+0000 7f9dc77fe640 1 -- 172.21.15.98:0/3638112153 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dbc037070 con 0x7f9dc81083e0 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.775+0000 7f9dc77fe640 1 -- 172.21.15.98:0/3638112153 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9dbc032900 con 0x7f9dc81083e0 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.775+0000 7f9dc77fe640 1 -- 172.21.15.98:0/3638112153 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dbc030850 con 0x7f9dc81083e0 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.776+0000 7f9dceb52640 1 -- 172.21.15.98:0/3638112153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 msgr2=0x7f9dc810a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.776+0000 7f9dceb52640 1 --2- 172.21.15.98:0/3638112153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 0x7f9dc810a7d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc009820 tx=0x7f9dbc02a270 comp rx=0 tx=0).stop 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.776+0000 7f9dceb52640 1 -- 172.21.15.98:0/3638112153 shutdown_connections 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.776+0000 7f9dceb52640 1 --2- 172.21.15.98:0/3638112153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 0x7f9dc810a7d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.776+0000 7f9dceb52640 1 -- 172.21.15.98:0/3638112153 >> 172.21.15.98:0/3638112153 conn(0x7f9dc8102020 msgr2=0x7f9dc8104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.776+0000 7f9dceb52640 1 -- 172.21.15.98:0/3638112153 shutdown_connections 2024-09-19T07:12:57.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.776+0000 7f9dceb52640 1 -- 172.21.15.98:0/3638112153 wait complete. 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dceb52640 1 Processor -- start 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dceb52640 1 -- start start 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dceb52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 0x7f9dc819b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dceb52640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc810bce0 con 0x7f9dc81083e0 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dcc8ee640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 0x7f9dc819b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dcc8ee640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 0x7f9dc819b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46004/0 (socket says 172.21.15.98:46004) 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dcc8ee640 1 -- 172.21.15.98:0/2705816019 learned_addr learned my addr 172.21.15.98:0/2705816019 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dcc8ee640 1 -- 172.21.15.98:0/2705816019 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc819be00 con 0x7f9dc81083e0 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dcc8ee640 1 --2- 172.21.15.98:0/2705816019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 0x7f9dc819b8c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc031000 tx=0x7f9dbc0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dc5ffb640 1 -- 172.21.15.98:0/2705816019 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dbc042070 con 0x7f9dc81083e0 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dc5ffb640 1 -- 172.21.15.98:0/2705816019 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9dbc032be0 con 0x7f9dc81083e0 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dceb52640 1 -- 172.21.15.98:0/2705816019 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc819c090 con 0x7f9dc81083e0 2024-09-19T07:12:57.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.777+0000 7f9dc5ffb640 1 -- 172.21.15.98:0/2705816019 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dbc037040 con 0x7f9dc81083e0 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.778+0000 7f9dceb52640 1 -- 172.21.15.98:0/2705816019 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc819ed80 con 0x7f9dc81083e0 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.778+0000 7f9dc5ffb640 1 -- 172.21.15.98:0/2705816019 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9dbc045070 con 0x7f9dc81083e0 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.778+0000 7f9dc5ffb640 1 -- 172.21.15.98:0/2705816019 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9dbc047ad0 con 0x7f9dc81083e0 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.779+0000 7f9dceb52640 1 -- 172.21.15.98:0/2705816019 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc8108840 con 0x7f9dc81083e0 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.781+0000 7f9dc5ffb640 1 -- 172.21.15.98:0/2705816019 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9dbc04c030 con 0x7f9dc81083e0 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.838+0000 7f9dceb52640 1 -- 172.21.15.98:0/2705816019 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f9dc819f0a0 con 0x7f9dc81083e0 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.840+0000 7f9dc5ffb640 1 -- 172.21.15.98:0/2705816019 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f9dbc032d90 con 0x7f9dc81083e0 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.841+0000 7f9dceb52640 1 -- 172.21.15.98:0/2705816019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 msgr2=0x7f9dc819b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.841+0000 7f9dceb52640 1 --2- 172.21.15.98:0/2705816019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 0x7f9dc819b8c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc031000 tx=0x7f9dbc0326e0 comp rx=0 tx=0).stop 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.841+0000 7f9dceb52640 1 -- 172.21.15.98:0/2705816019 shutdown_connections 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.841+0000 7f9dceb52640 1 --2- 172.21.15.98:0/2705816019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dc81083e0 0x7f9dc819b8c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.841+0000 7f9dceb52640 1 -- 172.21.15.98:0/2705816019 >> 172.21.15.98:0/2705816019 conn(0x7f9dc8102020 msgr2=0x7f9dc8102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.841+0000 7f9dceb52640 1 -- 172.21.15.98:0/2705816019 shutdown_connections 2024-09-19T07:12:57.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:56.842+0000 7f9dceb52640 1 -- 172.21.15.98:0/2705816019 wait complete. 2024-09-19T07:12:57.457 INFO:teuthology.orchestra.run.smithi098.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T07:12:57.471 INFO:teuthology.orchestra.run.smithi098.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:12:57.471 INFO:teuthology.orchestra.run.smithi098.stdout:Creating mgr... 2024-09-19T07:12:57.471 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T07:12:57.472 INFO:teuthology.orchestra.run.smithi098.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T07:12:57.762 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.x 2024-09-19T07:12:57.763 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Failed to reset failed state of unit ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T07:12:57.916 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-73438718-7656-11ef-bceb-c7b262605968.target.wants/ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-73438718-7656-11ef-bceb-c7b262605968@.service. 2024-09-19T07:12:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:57 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2705816019' entity='client.admin' 2024-09-19T07:12:58.023 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:57 smithi098 systemd[1]: Starting Ceph mgr.x for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:12:58.418 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:58 smithi098 podman[31162]: 2024-09-19 07:12:58.1154431 +0000 UTC m=+0.081861417 container create 623c6bf1043fcd53c7e3b1032f28ae81a822443eddcee2e304cc6f6f283b271f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T07:12:58.418 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:58 smithi098 podman[31162]: 2024-09-19 07:12:58.049434927 +0000 UTC m=+0.015853272 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T07:12:58.418 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:58 smithi098 podman[31162]: 2024-09-19 07:12:58.317834119 +0000 UTC m=+0.284252441 container init 623c6bf1043fcd53c7e3b1032f28ae81a822443eddcee2e304cc6f6f283b271f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T07:12:58.418 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:58 smithi098 podman[31162]: 2024-09-19 07:12:58.320463318 +0000 UTC m=+0.286881639 container start 623c6bf1043fcd53c7e3b1032f28ae81a822443eddcee2e304cc6f6f283b271f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T07:12:58.418 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:58 smithi098 bash[31162]: 623c6bf1043fcd53c7e3b1032f28ae81a822443eddcee2e304cc6f6f283b271f 2024-09-19T07:12:58.431 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T07:12:58.431 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout disabled 2024-09-19T07:12:58.439 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T07:12:58.439 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout inactive 2024-09-19T07:12:58.439 INFO:teuthology.orchestra.run.smithi098.stdout:firewalld.service is not enabled 2024-09-19T07:12:58.439 INFO:teuthology.orchestra.run.smithi098.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T07:12:58.447 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T07:12:58.447 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout disabled 2024-09-19T07:12:58.455 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T07:12:58.455 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout inactive 2024-09-19T07:12:58.455 INFO:teuthology.orchestra.run.smithi098.stdout:firewalld.service is not enabled 2024-09-19T07:12:58.455 INFO:teuthology.orchestra.run.smithi098.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T07:12:58.455 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for mgr to start... 2024-09-19T07:12:58.456 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for mgr... 2024-09-19T07:12:58.710 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:58 smithi098 systemd[1]: Started Ceph mgr.x for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:12:58.711 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:12:58.439+0000 7f52ac40b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:12:58.711 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:12:58.500+0000 7f52ac40b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:12:58.711 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:12:58.652+0000 7f52ac40b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:12:58.977 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:12:58.721+0000 7f52ac40b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:12:58.977 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:12:58.870+0000 7f52ac40b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:12:59.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:12:59 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/540998615' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T07:12:59.273 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:12:59.019+0000 7f52ac40b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:12:59.589 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:12:59.336+0000 7f52ac40b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:12:59.589 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:12:59.397+0000 7f52ac40b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:12:59.842 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:12:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:12:59.588+0000 7f52ac40b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:12:59.845 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-19T07:12:59.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:12:59.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsid": "73438718-7656-11ef-bceb-c7b262605968", 2024-09-19T07:12:59.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T07:12:59.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T07:12:59.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T07:12:59.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T07:12:59.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:12:59.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T07:12:59.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T07:12:59.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 0 2024-09-19T07:12:59.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:12:59.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T07:12:59.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T07:12:59.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:12:59.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T07:12:59.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T07:12:59.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:12:59.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T07:12:59.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T07:12:59.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:12:59.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T07:12:59.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:12:59.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T07:12:59.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T07:12:59.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T07:12:59.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T07:12:59.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T07:12:59.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T07:12:59.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:12:59.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T07:12:59.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T07:12:59.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T07:12:59.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T07:12:59.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T07:12:59.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T07:12:59.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T07:12:59.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T07:12:59.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T07:12:59.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:12:59.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T07:12:59.868 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:12:59.868 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T07:12:50:967629+0000", 2024-09-19T07:12:59.868 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T07:12:59.868 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T07:12:59.868 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:12:59.868 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T07:12:59.868 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T07:12:59.869 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T07:12:59.869 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T07:12:59.869 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T07:12:59.869 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T07:12:59.869 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T07:12:59.869 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:12:59.870 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:12:59.870 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:12:59.870 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T07:12:59.870 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:12:59.870 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T07:12:50.968274+0000", 2024-09-19T07:12:59.870 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:12:59.871 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:12:59.871 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T07:12:59.871 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:12:59.871 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.907+0000 7f8a62a84640 1 Processor -- start 2024-09-19T07:12:59.871 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.907+0000 7f8a62a84640 1 -- start start 2024-09-19T07:12:59.871 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.907+0000 7f8a62a84640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 0x7f8a5c106bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.907+0000 7f8a62a84640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c107180 con 0x7f8a5c1067b0 2024-09-19T07:12:59.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.908+0000 7f8a60820640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 0x7f8a5c106bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.908+0000 7f8a60820640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 0x7f8a5c106bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46030/0 (socket says 172.21.15.98:46030) 2024-09-19T07:12:59.872 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.908+0000 7f8a60820640 1 -- 172.21.15.98:0/2340124226 learned_addr learned my addr 172.21.15.98:0/2340124226 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:12:59.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.908+0000 7f8a60820640 1 -- 172.21.15.98:0/2340124226 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c1079b0 con 0x7f8a5c1067b0 2024-09-19T07:12:59.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.909+0000 7f8a60820640 1 --2- 172.21.15.98:0/2340124226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 0x7f8a5c106bb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009820 tx=0x7f8a5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306c36a95f413e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:59.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.909+0000 7f8a5b7fe640 1 -- 172.21.15.98:0/2340124226 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a50037070 con 0x7f8a5c1067b0 2024-09-19T07:12:59.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.909+0000 7f8a5b7fe640 1 -- 172.21.15.98:0/2340124226 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a50032900 con 0x7f8a5c1067b0 2024-09-19T07:12:59.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.909+0000 7f8a5b7fe640 1 -- 172.21.15.98:0/2340124226 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a50030850 con 0x7f8a5c1067b0 2024-09-19T07:12:59.873 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.910+0000 7f8a62a84640 1 -- 172.21.15.98:0/2340124226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 msgr2=0x7f8a5c106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:59.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.910+0000 7f8a62a84640 1 --2- 172.21.15.98:0/2340124226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 0x7f8a5c106bb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009820 tx=0x7f8a5002a270 comp rx=0 tx=0).stop 2024-09-19T07:12:59.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.910+0000 7f8a62a84640 1 -- 172.21.15.98:0/2340124226 shutdown_connections 2024-09-19T07:12:59.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.910+0000 7f8a62a84640 1 --2- 172.21.15.98:0/2340124226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 0x7f8a5c106bb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.910+0000 7f8a62a84640 1 -- 172.21.15.98:0/2340124226 >> 172.21.15.98:0/2340124226 conn(0x7f8a5c101f40 msgr2=0x7f8a5c104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:59.874 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.910+0000 7f8a62a84640 1 -- 172.21.15.98:0/2340124226 shutdown_connections 2024-09-19T07:12:59.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.910+0000 7f8a62a84640 1 -- 172.21.15.98:0/2340124226 wait complete. 2024-09-19T07:12:59.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.910+0000 7f8a62a84640 1 Processor -- start 2024-09-19T07:12:59.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.911+0000 7f8a62a84640 1 -- start start 2024-09-19T07:12:59.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.911+0000 7f8a62a84640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 0x7f8a5c191970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:12:59.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.911+0000 7f8a62a84640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c10ad60 con 0x7f8a5c1067b0 2024-09-19T07:12:59.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.911+0000 7f8a60820640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 0x7f8a5c191970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:12:59.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.911+0000 7f8a60820640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 0x7f8a5c191970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46042/0 (socket says 172.21.15.98:46042) 2024-09-19T07:12:59.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.911+0000 7f8a60820640 1 -- 172.21.15.98:0/540998615 learned_addr learned my addr 172.21.15.98:0/540998615 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:12:59.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.911+0000 7f8a60820640 1 -- 172.21.15.98:0/540998615 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c191eb0 con 0x7f8a5c1067b0 2024-09-19T07:12:59.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.911+0000 7f8a60820640 1 --2- 172.21.15.98:0/540998615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 0x7f8a5c191970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8a500097f0 tx=0x7f8a50030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:12:59.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.911+0000 7f8a59ffb640 1 -- 172.21.15.98:0/540998615 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a50037040 con 0x7f8a5c1067b0 2024-09-19T07:12:59.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.911+0000 7f8a59ffb640 1 -- 172.21.15.98:0/540998615 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a50040070 con 0x7f8a5c1067b0 2024-09-19T07:12:59.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.911+0000 7f8a62a84640 1 -- 172.21.15.98:0/540998615 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5c1900a0 con 0x7f8a5c1067b0 2024-09-19T07:12:59.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.911+0000 7f8a59ffb640 1 -- 172.21.15.98:0/540998615 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a5003a390 con 0x7f8a5c1067b0 2024-09-19T07:12:59.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.912+0000 7f8a62a84640 1 -- 172.21.15.98:0/540998615 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5c190580 con 0x7f8a5c1067b0 2024-09-19T07:12:59.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.912+0000 7f8a59ffb640 1 -- 172.21.15.98:0/540998615 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a5003a5e0 con 0x7f8a5c1067b0 2024-09-19T07:12:59.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.912+0000 7f8a59ffb640 1 -- 172.21.15.98:0/540998615 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8a50045950 con 0x7f8a5c1067b0 2024-09-19T07:12:59.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.913+0000 7f8a62a84640 1 -- 172.21.15.98:0/540998615 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5c106c30 con 0x7f8a5c1067b0 2024-09-19T07:12:59.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.915+0000 7f8a59ffb640 1 -- 172.21.15.98:0/540998615 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8a50045460 con 0x7f8a5c1067b0 2024-09-19T07:12:59.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.976+0000 7f8a62a84640 1 -- 172.21.15.98:0/540998615 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8a5c195280 con 0x7f8a5c1067b0 2024-09-19T07:12:59.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.977+0000 7f8a59ffb640 1 -- 172.21.15.98:0/540998615 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f8a5003b430 con 0x7f8a5c1067b0 2024-09-19T07:12:59.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.978+0000 7f8a62a84640 1 -- 172.21.15.98:0/540998615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 msgr2=0x7f8a5c191970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:12:59.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.978+0000 7f8a62a84640 1 --2- 172.21.15.98:0/540998615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 0x7f8a5c191970 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8a500097f0 tx=0x7f8a50030d80 comp rx=0 tx=0).stop 2024-09-19T07:12:59.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.978+0000 7f8a62a84640 1 -- 172.21.15.98:0/540998615 shutdown_connections 2024-09-19T07:12:59.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.978+0000 7f8a62a84640 1 --2- 172.21.15.98:0/540998615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a5c1067b0 0x7f8a5c191970 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:12:59.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.978+0000 7f8a62a84640 1 -- 172.21.15.98:0/540998615 >> 172.21.15.98:0/540998615 conn(0x7f8a5c101f40 msgr2=0x7f8a5c102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:12:59.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.978+0000 7f8a62a84640 1 -- 172.21.15.98:0/540998615 shutdown_connections 2024-09-19T07:12:59.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:12:58.978+0000 7f8a62a84640 1 -- 172.21.15.98:0/540998615 wait complete. 2024-09-19T07:12:59.880 INFO:teuthology.orchestra.run.smithi098.stdout:mgr not available, waiting (1/15)... 2024-09-19T07:13:00.773 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:00.472+0000 7f52ac40b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:13:00.773 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:00.540+0000 7f52ac40b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:13:01.503 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:01.247+0000 7f52ac40b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:13:01.503 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:01.363+0000 7f52ac40b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:13:01.503 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:01.502+0000 7f52ac40b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:13:01.773 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:01.562+0000 7f52ac40b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:13:01.773 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:01.708+0000 7f52ac40b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:13:02.069 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:01.779+0000 7f52ac40b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:13:02.070 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:01.838+0000 7f52ac40b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:13:02.070 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:02.002+0000 7f52ac40b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:13:02.070 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:02.069+0000 7f52ac40b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:13:02.320 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:02.138+0000 7f52ac40b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:13:02.320 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:02.223+0000 7f52ac40b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:13:02.320 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:02.289+0000 7f52ac40b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:13:02.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:02 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/96625492' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T07:13:02.773 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:02.374+0000 7f52ac40b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:13:02.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-19T07:13:02.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:13:02.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsid": "73438718-7656-11ef-bceb-c7b262605968", 2024-09-19T07:13:02.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T07:13:02.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T07:13:02.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T07:13:02.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T07:13:02.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 0 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:02.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T07:13:02.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:13:02.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T07:13:02.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T07:13:02.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T07:13:02.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T07:13:02.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T07:13:02.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T07:13:02.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:02.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T07:13:02.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T07:13:02.875 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T07:13:02.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T07:13:02.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T07:13:02.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T07:13:02.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T07:13:02.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T07:13:02.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T07:13:02.876 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:02.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T07:13:02.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:13:02.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T07:12:50:967629+0000", 2024-09-19T07:13:02.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T07:13:02.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T07:13:02.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:02.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T07:13:02.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T07:13:02.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T07:13:02.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T07:13:02.877 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T07:13:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T07:13:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T07:13:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:13:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:13:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T07:13:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:13:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T07:12:50.968274+0000", 2024-09-19T07:13:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:13:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:02.878 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T07:13:02.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:13:02.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.246+0000 7f475499e640 1 Processor -- start 2024-09-19T07:13:02.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.247+0000 7f475499e640 1 -- start start 2024-09-19T07:13:02.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.247+0000 7f475499e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 0x7f4750106b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.247+0000 7f475499e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4750107160 con 0x7f4750106790 2024-09-19T07:13:02.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.247+0000 7f474e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 0x7f4750106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.247+0000 7f474e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 0x7f4750106b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46046/0 (socket says 172.21.15.98:46046) 2024-09-19T07:13:02.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.247+0000 7f474e59c640 1 -- 172.21.15.98:0/1198924539 learned_addr learned my addr 172.21.15.98:0/1198924539 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:02.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.247+0000 7f474e59c640 1 -- 172.21.15.98:0/1198924539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4750107990 con 0x7f4750106790 2024-09-19T07:13:02.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.248+0000 7f474e59c640 1 --2- 172.21.15.98:0/1198924539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 0x7f4750106b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4740009820 tx=0x7f474002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f1f6299eea24b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:02.879 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.248+0000 7f474dd9b640 1 -- 172.21.15.98:0/1198924539 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4740037070 con 0x7f4750106790 2024-09-19T07:13:02.880 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.248+0000 7f474dd9b640 1 -- 172.21.15.98:0/1198924539 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4740032900 con 0x7f4750106790 2024-09-19T07:13:02.880 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.248+0000 7f474dd9b640 1 -- 172.21.15.98:0/1198924539 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4740030850 con 0x7f4750106790 2024-09-19T07:13:02.880 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.249+0000 7f475499e640 1 -- 172.21.15.98:0/1198924539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 msgr2=0x7f4750106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:02.880 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.249+0000 7f475499e640 1 --2- 172.21.15.98:0/1198924539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 0x7f4750106b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4740009820 tx=0x7f474002a270 comp rx=0 tx=0).stop 2024-09-19T07:13:02.880 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.249+0000 7f475499e640 1 -- 172.21.15.98:0/1198924539 shutdown_connections 2024-09-19T07:13:02.880 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.249+0000 7f475499e640 1 --2- 172.21.15.98:0/1198924539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 0x7f4750106b90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.880 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.249+0000 7f475499e640 1 -- 172.21.15.98:0/1198924539 >> 172.21.15.98:0/1198924539 conn(0x7f4750101ee0 msgr2=0x7f4750104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:02.880 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.249+0000 7f475499e640 1 -- 172.21.15.98:0/1198924539 shutdown_connections 2024-09-19T07:13:02.880 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.249+0000 7f475499e640 1 -- 172.21.15.98:0/1198924539 wait complete. 2024-09-19T07:13:02.880 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.250+0000 7f475499e640 1 Processor -- start 2024-09-19T07:13:02.880 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.250+0000 7f475499e640 1 -- start start 2024-09-19T07:13:02.881 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.250+0000 7f475499e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 0x7f475019a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:02.881 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.250+0000 7f475499e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f475010ad40 con 0x7f4750106790 2024-09-19T07:13:02.881 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.250+0000 7f474e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 0x7f475019a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:02.881 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.250+0000 7f474e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 0x7f475019a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46050/0 (socket says 172.21.15.98:46050) 2024-09-19T07:13:02.881 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.250+0000 7f474e59c640 1 -- 172.21.15.98:0/96625492 learned_addr learned my addr 172.21.15.98:0/96625492 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:02.881 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.250+0000 7f474e59c640 1 -- 172.21.15.98:0/96625492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475019ad00 con 0x7f4750106790 2024-09-19T07:13:02.881 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.250+0000 7f474e59c640 1 --2- 172.21.15.98:0/96625492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 0x7f475019a7c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4740009940 tx=0x7f4740032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:02.881 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.251+0000 7f47477fe640 1 -- 172.21.15.98:0/96625492 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4740042070 con 0x7f4750106790 2024-09-19T07:13:02.881 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.251+0000 7f47477fe640 1 -- 172.21.15.98:0/96625492 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47400308c0 con 0x7f4750106790 2024-09-19T07:13:02.881 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.251+0000 7f475499e640 1 -- 172.21.15.98:0/96625492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475019af90 con 0x7f4750106790 2024-09-19T07:13:02.881 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.251+0000 7f47477fe640 1 -- 172.21.15.98:0/96625492 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4740037040 con 0x7f4750106790 2024-09-19T07:13:02.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.251+0000 7f475499e640 1 -- 172.21.15.98:0/96625492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f475019dc80 con 0x7f4750106790 2024-09-19T07:13:02.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.251+0000 7f47477fe640 1 -- 172.21.15.98:0/96625492 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4740045070 con 0x7f4750106790 2024-09-19T07:13:02.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.251+0000 7f47477fe640 1 -- 172.21.15.98:0/96625492 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4740047bb0 con 0x7f4750106790 2024-09-19T07:13:02.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.252+0000 7f475499e640 1 -- 172.21.15.98:0/96625492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4750106c10 con 0x7f4750106790 2024-09-19T07:13:02.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.256+0000 7f47477fe640 1 -- 172.21.15.98:0/96625492 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f47400327b0 con 0x7f4750106790 2024-09-19T07:13:02.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.318+0000 7f475499e640 1 -- 172.21.15.98:0/96625492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f475019de50 con 0x7f4750106790 2024-09-19T07:13:02.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.319+0000 7f47477fe640 1 -- 172.21.15.98:0/96625492 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f474003c760 con 0x7f4750106790 2024-09-19T07:13:02.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.320+0000 7f475499e640 1 -- 172.21.15.98:0/96625492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 msgr2=0x7f475019a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:02.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.320+0000 7f475499e640 1 --2- 172.21.15.98:0/96625492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 0x7f475019a7c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4740009940 tx=0x7f4740032ce0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.320+0000 7f475499e640 1 -- 172.21.15.98:0/96625492 shutdown_connections 2024-09-19T07:13:02.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.320+0000 7f475499e640 1 --2- 172.21.15.98:0/96625492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4750106790 0x7f475019a7c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:02.882 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.320+0000 7f475499e640 1 -- 172.21.15.98:0/96625492 >> 172.21.15.98:0/96625492 conn(0x7f4750101ee0 msgr2=0x7f4750102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:02.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.320+0000 7f475499e640 1 -- 172.21.15.98:0/96625492 shutdown_connections 2024-09-19T07:13:02.883 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:02.320+0000 7f475499e640 1 -- 172.21.15.98:0/96625492 wait complete. 2024-09-19T07:13:02.883 INFO:teuthology.orchestra.run.smithi098.stdout:mgr not available, waiting (2/15)... 2024-09-19T07:13:03.523 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:03.170+0000 7f52ac40b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:13:03.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: Activating manager daemon x 2024-09-19T07:13:03.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: mgrmap e2: x(active, starting, since 0.00315304s) 2024-09-19T07:13:03.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: from='mgr.14100 172.21.15.98:0/583565392' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:13:03.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: from='mgr.14100 172.21.15.98:0/583565392' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:13:03.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: from='mgr.14100 172.21.15.98:0/583565392' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:13:03.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: from='mgr.14100 172.21.15.98:0/583565392' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:13:03.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: from='mgr.14100 172.21.15.98:0/583565392' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:13:03.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: Manager daemon x is now available 2024-09-19T07:13:03.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: from='mgr.14100 172.21.15.98:0/583565392' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:13:03.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: from='mgr.14100 172.21.15.98:0/583565392' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:13:03.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: from='mgr.14100 172.21.15.98:0/583565392' entity='mgr.x' 2024-09-19T07:13:03.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: from='mgr.14100 172.21.15.98:0/583565392' entity='mgr.x' 2024-09-19T07:13:03.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:03 smithi098 ceph-mon[30950]: from='mgr.14100 172.21.15.98:0/583565392' entity='mgr.x' 2024-09-19T07:13:05.250 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:05 smithi098 ceph-mon[30950]: mgrmap e3: x(active, since 1.0069s) 2024-09-19T07:13:05.995 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-19T07:13:05.995 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:13:05.995 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsid": "73438718-7656-11ef-bceb-c7b262605968", 2024-09-19T07:13:05.995 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 0 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T07:13:05.996 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T07:13:05.997 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:13:05.997 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T07:13:05.997 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T07:13:05.997 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:05.997 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T07:13:05.997 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:13:05.997 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T07:13:05.997 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T07:13:05.997 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T07:13:06.005 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T07:13:06.006 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T07:13:06.006 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T07:13:06.006 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:06.006 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T07:13:06.006 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T07:13:06.006 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T07:13:06.006 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T07:13:06.006 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T07:13:06.006 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T07:13:06.006 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T07:13:06.006 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T07:12:50:967629+0000", 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T07:13:06.007 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ], 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T07:12:50.968274+0000", 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout }, 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.249+0000 7f923b27c640 1 Processor -- start 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.249+0000 7f923b27c640 1 -- start start 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.250+0000 7f923b27c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 0x7f9234106550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:06.008 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.250+0000 7f923b27c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f923407be50 con 0x7f9234106150 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.250+0000 7f9239018640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 0x7f9234106550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.250+0000 7f9239018640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 0x7f9234106550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42756/0 (socket says 172.21.15.98:42756) 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.250+0000 7f9239018640 1 -- 172.21.15.98:0/1476435136 learned_addr learned my addr 172.21.15.98:0/1476435136 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.250+0000 7f9239018640 1 -- 172.21.15.98:0/1476435136 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9234106a90 con 0x7f9234106150 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.251+0000 7f9239018640 1 --2- 172.21.15.98:0/1476435136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 0x7f9234106550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f922c009820 tx=0x7f922c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a8156b1d8e52e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.251+0000 7f9233fff640 1 -- 172.21.15.98:0/1476435136 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f922c037070 con 0x7f9234106150 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.251+0000 7f9233fff640 1 -- 172.21.15.98:0/1476435136 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f922c032900 con 0x7f9234106150 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.251+0000 7f9233fff640 1 -- 172.21.15.98:0/1476435136 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f922c030850 con 0x7f9234106150 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.252+0000 7f923b27c640 1 -- 172.21.15.98:0/1476435136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 msgr2=0x7f9234106550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.252+0000 7f923b27c640 1 --2- 172.21.15.98:0/1476435136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 0x7f9234106550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f922c009820 tx=0x7f922c02a270 comp rx=0 tx=0).stop 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.252+0000 7f923b27c640 1 -- 172.21.15.98:0/1476435136 shutdown_connections 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.252+0000 7f923b27c640 1 --2- 172.21.15.98:0/1476435136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 0x7f9234106550 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.252+0000 7f923b27c640 1 -- 172.21.15.98:0/1476435136 >> 172.21.15.98:0/1476435136 conn(0x7f9234101f40 msgr2=0x7f9234104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:06.009 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.252+0000 7f923b27c640 1 -- 172.21.15.98:0/1476435136 shutdown_connections 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.252+0000 7f923b27c640 1 -- 172.21.15.98:0/1476435136 wait complete. 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.252+0000 7f923b27c640 1 Processor -- start 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.252+0000 7f923b27c640 1 -- start start 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.253+0000 7f923b27c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 0x7f923419da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.253+0000 7f923b27c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9234107b20 con 0x7f9234106150 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.253+0000 7f9239018640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 0x7f923419da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.253+0000 7f9239018640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 0x7f923419da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42766/0 (socket says 172.21.15.98:42766) 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.253+0000 7f9239018640 1 -- 172.21.15.98:0/2846895792 learned_addr learned my addr 172.21.15.98:0/2846895792 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.253+0000 7f9239018640 1 -- 172.21.15.98:0/2846895792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923419dfb0 con 0x7f9234106150 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.253+0000 7f9239018640 1 --2- 172.21.15.98:0/2846895792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 0x7f923419da70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f922c032ce0 tx=0x7f922c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.253+0000 7f92327fc640 1 -- 172.21.15.98:0/2846895792 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f922c042070 con 0x7f9234106150 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.253+0000 7f92327fc640 1 -- 172.21.15.98:0/2846895792 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f922c0308c0 con 0x7f9234106150 2024-09-19T07:13:06.010 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.253+0000 7f923b27c640 1 -- 172.21.15.98:0/2846895792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f923419e240 con 0x7f9234106150 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.253+0000 7f92327fc640 1 -- 172.21.15.98:0/2846895792 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f922c037040 con 0x7f9234106150 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.253+0000 7f923b27c640 1 -- 172.21.15.98:0/2846895792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92341a0f30 con 0x7f9234106150 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.254+0000 7f92327fc640 1 -- 172.21.15.98:0/2846895792 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f922c045070 con 0x7f9234106150 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.254+0000 7f92327fc640 1 --2- 172.21.15.98:0/2846895792 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f921c0391b0 0x7f921c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.254+0000 7f92327fc640 1 -- 172.21.15.98:0/2846895792 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f922c06c1f0 con 0x7f9234106150 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.254+0000 7f9238817640 1 --2- 172.21.15.98:0/2846895792 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f921c0391b0 0x7f921c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.254+0000 7f923b27c640 1 -- 172.21.15.98:0/2846895792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9234106550 con 0x7f9234106150 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.255+0000 7f9238817640 1 --2- 172.21.15.98:0/2846895792 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f921c0391b0 0x7f921c03b670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f922800ad30 tx=0x7f92280093f0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.260+0000 7f92327fc640 1 -- 172.21.15.98:0/2846895792 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f922c045360 con 0x7f9234106150 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.488+0000 7f923b27c640 1 -- 172.21.15.98:0/2846895792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f92341a1100 con 0x7f9234106150 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.488+0000 7f92327fc640 1 -- 172.21.15.98:0/2846895792 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f92341a1100 con 0x7f9234106150 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.490+0000 7f923b27c640 1 -- 172.21.15.98:0/2846895792 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f921c0391b0 msgr2=0x7f921c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.490+0000 7f923b27c640 1 --2- 172.21.15.98:0/2846895792 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f921c0391b0 0x7f921c03b670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f922800ad30 tx=0x7f92280093f0 comp rx=0 tx=0).stop 2024-09-19T07:13:06.011 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.490+0000 7f923b27c640 1 -- 172.21.15.98:0/2846895792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 msgr2=0x7f923419da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:06.012 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.490+0000 7f923b27c640 1 --2- 172.21.15.98:0/2846895792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 0x7f923419da70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f922c032ce0 tx=0x7f922c032d10 comp rx=0 tx=0).stop 2024-09-19T07:13:06.012 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.490+0000 7f923b27c640 1 -- 172.21.15.98:0/2846895792 shutdown_connections 2024-09-19T07:13:06.012 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.490+0000 7f923b27c640 1 --2- 172.21.15.98:0/2846895792 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f921c0391b0 0x7f921c03b670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:06.012 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.490+0000 7f923b27c640 1 --2- 172.21.15.98:0/2846895792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9234106150 0x7f923419da70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:06.012 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.490+0000 7f923b27c640 1 -- 172.21.15.98:0/2846895792 >> 172.21.15.98:0/2846895792 conn(0x7f9234101f40 msgr2=0x7f9234191d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:06.012 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.490+0000 7f923b27c640 1 -- 172.21.15.98:0/2846895792 shutdown_connections 2024-09-19T07:13:06.012 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:05.490+0000 7f923b27c640 1 -- 172.21.15.98:0/2846895792 wait complete. 2024-09-19T07:13:06.012 INFO:teuthology.orchestra.run.smithi098.stdout:mgr is available 2024-09-19T07:13:06.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:06 smithi098 ceph-mon[30950]: mgrmap e4: x(active, since 2s) 2024-09-19T07:13:06.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:06 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2846895792' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T07:13:07.157 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-19T07:13:07.164 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T07:13:07.164 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout fsid = 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:13:07.164 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.98:3300,v1:172.21.15.98:6789] 2024-09-19T07:13:07.165 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T07:13:07.165 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T07:13:07.165 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T07:13:07.165 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T07:13:07.165 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-19T07:13:07.165 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T07:13:07.165 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T07:13:07.165 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 2024-09-19T07:13:07.165 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T07:13:07.165 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T07:13:07.165 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T07:13:07.165 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.396+0000 7f07cf700640 1 Processor -- start 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.396+0000 7f07cf700640 1 -- start start 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.396+0000 7f07cf700640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 0x7f07c8107d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.396+0000 7f07cf700640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f07c81082d0 con 0x7f07c8107900 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.396+0000 7f07cd49c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 0x7f07c8107d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.396+0000 7f07cd49c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 0x7f07c8107d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42770/0 (socket says 172.21.15.98:42770) 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.396+0000 7f07cd49c640 1 -- 172.21.15.98:0/1941398952 learned_addr learned my addr 172.21.15.98:0/1941398952 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.397+0000 7f07cd49c640 1 -- 172.21.15.98:0/1941398952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c8108ab0 con 0x7f07c8107900 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.397+0000 7f07cd49c640 1 --2- 172.21.15.98:0/1941398952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 0x7f07c8107d00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009820 tx=0x7f07c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec7f9a7fa90ecda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.397+0000 7f07bffff640 1 -- 172.21.15.98:0/1941398952 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07c4037070 con 0x7f07c8107900 2024-09-19T07:13:07.166 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.398+0000 7f07bffff640 1 -- 172.21.15.98:0/1941398952 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07c4032900 con 0x7f07c8107900 2024-09-19T07:13:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.398+0000 7f07bffff640 1 -- 172.21.15.98:0/1941398952 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07c4030850 con 0x7f07c8107900 2024-09-19T07:13:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.398+0000 7f07cf700640 1 -- 172.21.15.98:0/1941398952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 msgr2=0x7f07c8107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.398+0000 7f07cf700640 1 --2- 172.21.15.98:0/1941398952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 0x7f07c8107d00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009820 tx=0x7f07c402a270 comp rx=0 tx=0).stop 2024-09-19T07:13:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.398+0000 7f07cf700640 1 -- 172.21.15.98:0/1941398952 shutdown_connections 2024-09-19T07:13:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.398+0000 7f07cf700640 1 --2- 172.21.15.98:0/1941398952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 0x7f07c8107d00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.398+0000 7f07cf700640 1 -- 172.21.15.98:0/1941398952 >> 172.21.15.98:0/1941398952 conn(0x7f07c8103090 msgr2=0x7f07c81054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.398+0000 7f07cf700640 1 -- 172.21.15.98:0/1941398952 shutdown_connections 2024-09-19T07:13:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.398+0000 7f07cf700640 1 -- 172.21.15.98:0/1941398952 wait complete. 2024-09-19T07:13:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.399+0000 7f07cf700640 1 Processor -- start 2024-09-19T07:13:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.399+0000 7f07cf700640 1 -- start start 2024-09-19T07:13:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.399+0000 7f07cf700640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 0x7f07c819b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:07.167 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.399+0000 7f07cf700640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f07c810be60 con 0x7f07c8107900 2024-09-19T07:13:07.168 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.399+0000 7f07cd49c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 0x7f07c819b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:07.168 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.399+0000 7f07cd49c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 0x7f07c819b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42786/0 (socket says 172.21.15.98:42786) 2024-09-19T07:13:07.168 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.399+0000 7f07cd49c640 1 -- 172.21.15.98:0/2938281372 learned_addr learned my addr 172.21.15.98:0/2938281372 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:07.168 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.399+0000 7f07cd49c640 1 -- 172.21.15.98:0/2938281372 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c819bdb0 con 0x7f07c8107900 2024-09-19T07:13:07.168 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.400+0000 7f07cd49c640 1 --2- 172.21.15.98:0/2938281372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 0x7f07c819b870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009940 tx=0x7f07c4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:07.168 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.400+0000 7f07be7fc640 1 -- 172.21.15.98:0/2938281372 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07c4042070 con 0x7f07c8107900 2024-09-19T07:13:07.168 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.400+0000 7f07be7fc640 1 -- 172.21.15.98:0/2938281372 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07c40308c0 con 0x7f07c8107900 2024-09-19T07:13:07.168 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.400+0000 7f07be7fc640 1 -- 172.21.15.98:0/2938281372 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07c4037040 con 0x7f07c8107900 2024-09-19T07:13:07.168 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.400+0000 7f07cf700640 1 -- 172.21.15.98:0/2938281372 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c819c040 con 0x7f07c8107900 2024-09-19T07:13:07.168 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.400+0000 7f07cf700640 1 -- 172.21.15.98:0/2938281372 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c819ed30 con 0x7f07c8107900 2024-09-19T07:13:07.168 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.401+0000 7f07be7fc640 1 -- 172.21.15.98:0/2938281372 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f07c4045070 con 0x7f07c8107900 2024-09-19T07:13:07.168 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.401+0000 7f07be7fc640 1 --2- 172.21.15.98:0/2938281372 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f07b4039160 0x7f07b403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.401+0000 7f07cf700640 1 -- 172.21.15.98:0/2938281372 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c8107d80 con 0x7f07c8107900 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.401+0000 7f07be7fc640 1 -- 172.21.15.98:0/2938281372 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f07c406c200 con 0x7f07c8107900 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.401+0000 7f07ccc9b640 1 --2- 172.21.15.98:0/2938281372 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f07b4039160 0x7f07b403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.401+0000 7f07ccc9b640 1 --2- 172.21.15.98:0/2938281372 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f07b4039160 0x7f07b403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f07b80098c0 tx=0x7f07b8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.406+0000 7f07be7fc640 1 -- 172.21.15.98:0/2938281372 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f07c404b170 con 0x7f07c8107900 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.576+0000 7f07cf700640 1 -- 172.21.15.98:0/2938281372 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f07c819ef00 con 0x7f07c8107900 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.577+0000 7f07be7fc640 1 -- 172.21.15.98:0/2938281372 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f07c819ef00 con 0x7f07c8107900 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.580+0000 7f07cf700640 1 -- 172.21.15.98:0/2938281372 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f07b4039160 msgr2=0x7f07b403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.580+0000 7f07cf700640 1 --2- 172.21.15.98:0/2938281372 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f07b4039160 0x7f07b403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f07b80098c0 tx=0x7f07b8006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.580+0000 7f07cf700640 1 -- 172.21.15.98:0/2938281372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 msgr2=0x7f07c819b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.580+0000 7f07cf700640 1 --2- 172.21.15.98:0/2938281372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 0x7f07c819b870 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009940 tx=0x7f07c4032ce0 comp rx=0 tx=0).stop 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.580+0000 7f07cf700640 1 -- 172.21.15.98:0/2938281372 shutdown_connections 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.580+0000 7f07cf700640 1 --2- 172.21.15.98:0/2938281372 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f07b4039160 0x7f07b403b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:07.169 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.580+0000 7f07cf700640 1 --2- 172.21.15.98:0/2938281372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f07c8107900 0x7f07c819b870 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:07.170 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.580+0000 7f07cf700640 1 -- 172.21.15.98:0/2938281372 >> 172.21.15.98:0/2938281372 conn(0x7f07c8103090 msgr2=0x7f07c8103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:07.170 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.580+0000 7f07cf700640 1 -- 172.21.15.98:0/2938281372 shutdown_connections 2024-09-19T07:13:07.170 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:06.580+0000 7f07cf700640 1 -- 172.21.15.98:0/2938281372 wait complete. 2024-09-19T07:13:07.170 INFO:teuthology.orchestra.run.smithi098.stdout:Enabling cephadm module... 2024-09-19T07:13:07.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:07 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2938281372' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T07:13:08.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:08 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2834255198' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T07:13:08.523 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: ignoring --setuser ceph since I am not root 2024-09-19T07:13:08.524 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: ignoring --setgroup ceph since I am not root 2024-09-19T07:13:08.524 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:08.321+0000 7f5beea6f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:13:08.524 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:08.378+0000 7f5beea6f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:13:08.882 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:08.526+0000 7f5beea6f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:13:08.882 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:08.594+0000 7f5beea6f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:13:08.882 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:08.740+0000 7f5beea6f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:13:08.882 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:08.881+0000 7f5beea6f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:13:08.921 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.554+0000 7f4568a74640 1 Processor -- start 2024-09-19T07:13:08.921 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.554+0000 7f4568a74640 1 -- start start 2024-09-19T07:13:08.921 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.555+0000 7f4568a74640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 0x7f456410a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.555+0000 7f4568a74640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f456407be10 con 0x7f4564108370 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.555+0000 7f456259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 0x7f456410a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.555+0000 7f456259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 0x7f456410a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42790/0 (socket says 172.21.15.98:42790) 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.555+0000 7f456259c640 1 -- 172.21.15.98:0/1089363580 learned_addr learned my addr 172.21.15.98:0/1089363580 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.555+0000 7f456259c640 1 -- 172.21.15.98:0/1089363580 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456410aca0 con 0x7f4564108370 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.556+0000 7f456259c640 1 --2- 172.21.15.98:0/1089363580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 0x7f456410a760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4554009820 tx=0x7f455402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46090c47dfe7719a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.556+0000 7f456159a640 1 -- 172.21.15.98:0/1089363580 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4554037070 con 0x7f4564108370 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.556+0000 7f456159a640 1 -- 172.21.15.98:0/1089363580 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4554032900 con 0x7f4564108370 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.556+0000 7f456159a640 1 -- 172.21.15.98:0/1089363580 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4554030850 con 0x7f4564108370 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.556+0000 7f4568a74640 1 -- 172.21.15.98:0/1089363580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 msgr2=0x7f456410a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.556+0000 7f4568a74640 1 --2- 172.21.15.98:0/1089363580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 0x7f456410a760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4554009820 tx=0x7f455402a270 comp rx=0 tx=0).stop 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.556+0000 7f4568a74640 1 -- 172.21.15.98:0/1089363580 shutdown_connections 2024-09-19T07:13:08.922 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.556+0000 7f4568a74640 1 --2- 172.21.15.98:0/1089363580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 0x7f456410a760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.556+0000 7f4568a74640 1 -- 172.21.15.98:0/1089363580 >> 172.21.15.98:0/1089363580 conn(0x7f4564101f10 msgr2=0x7f4564104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.557+0000 7f4568a74640 1 -- 172.21.15.98:0/1089363580 shutdown_connections 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.557+0000 7f4568a74640 1 -- 172.21.15.98:0/1089363580 wait complete. 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.557+0000 7f4568a74640 1 Processor -- start 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.557+0000 7f4568a74640 1 -- start start 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.557+0000 7f4568a74640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 0x7f456419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.558+0000 7f4568a74640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f456410bc10 con 0x7f4564108370 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.558+0000 7f456259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 0x7f456419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.558+0000 7f456259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 0x7f456419b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42794/0 (socket says 172.21.15.98:42794) 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.558+0000 7f456259c640 1 -- 172.21.15.98:0/2834255198 learned_addr learned my addr 172.21.15.98:0/2834255198 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.558+0000 7f456259c640 1 -- 172.21.15.98:0/2834255198 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456419bd80 con 0x7f4564108370 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.558+0000 7f456259c640 1 --2- 172.21.15.98:0/2834255198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 0x7f456419b840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f45540097f0 tx=0x7f4554030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:08.923 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.558+0000 7f45537fe640 1 -- 172.21.15.98:0/2834255198 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4554037040 con 0x7f4564108370 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.558+0000 7f45537fe640 1 -- 172.21.15.98:0/2834255198 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4554040070 con 0x7f4564108370 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.558+0000 7f4568a74640 1 -- 172.21.15.98:0/2834255198 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456419c010 con 0x7f4564108370 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.558+0000 7f45537fe640 1 -- 172.21.15.98:0/2834255198 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f455403a390 con 0x7f4564108370 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.558+0000 7f4568a74640 1 -- 172.21.15.98:0/2834255198 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456419ed00 con 0x7f4564108370 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.559+0000 7f45537fe640 1 -- 172.21.15.98:0/2834255198 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f455403a5e0 con 0x7f4564108370 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.559+0000 7f45537fe640 1 --2- 172.21.15.98:0/2834255198 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f454c0391b0 0x7f454c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.559+0000 7f45537fe640 1 -- 172.21.15.98:0/2834255198 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f455406c3c0 con 0x7f4564108370 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.559+0000 7f4561d9b640 1 --2- 172.21.15.98:0/2834255198 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f454c0391b0 0x7f454c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.559+0000 7f4568a74640 1 -- 172.21.15.98:0/2834255198 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45641087d0 con 0x7f4564108370 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.560+0000 7f4561d9b640 1 --2- 172.21.15.98:0/2834255198 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f454c0391b0 0x7f454c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45580098c0 tx=0x7f4558006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.564+0000 7f45537fe640 1 -- 172.21.15.98:0/2834255198 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f455406c1c0 con 0x7f4564108370 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:07.775+0000 7f4568a74640 1 -- 172.21.15.98:0/2834255198 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f456419eed0 con 0x7f4564108370 2024-09-19T07:13:08.924 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:08.182+0000 7f45537fe640 1 -- 172.21.15.98:0/2834255198 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f455403a8d0 con 0x7f4564108370 2024-09-19T07:13:08.925 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:08.183+0000 7f45537fe640 1 -- 172.21.15.98:0/2834255198 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f455402fd60 con 0x7f4564108370 2024-09-19T07:13:08.925 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:08.185+0000 7f4568a74640 1 -- 172.21.15.98:0/2834255198 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f454c0391b0 msgr2=0x7f454c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:08.925 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:08.185+0000 7f4568a74640 1 --2- 172.21.15.98:0/2834255198 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f454c0391b0 0x7f454c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45580098c0 tx=0x7f4558006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:08.925 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:08.185+0000 7f4568a74640 1 -- 172.21.15.98:0/2834255198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 msgr2=0x7f456419b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:08.925 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:08.185+0000 7f4568a74640 1 --2- 172.21.15.98:0/2834255198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 0x7f456419b840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f45540097f0 tx=0x7f4554030d80 comp rx=0 tx=0).stop 2024-09-19T07:13:08.925 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:08.185+0000 7f4568a74640 1 -- 172.21.15.98:0/2834255198 shutdown_connections 2024-09-19T07:13:08.925 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:08.185+0000 7f4568a74640 1 --2- 172.21.15.98:0/2834255198 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f454c0391b0 0x7f454c03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:08.925 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:08.185+0000 7f4568a74640 1 --2- 172.21.15.98:0/2834255198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4564108370 0x7f456419b840 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:08.925 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:08.185+0000 7f4568a74640 1 -- 172.21.15.98:0/2834255198 >> 172.21.15.98:0/2834255198 conn(0x7f4564101f10 msgr2=0x7f4564102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:08.925 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:08.185+0000 7f4568a74640 1 -- 172.21.15.98:0/2834255198 shutdown_connections 2024-09-19T07:13:08.925 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:08.185+0000 7f4568a74640 1 -- 172.21.15.98:0/2834255198 wait complete. 2024-09-19T07:13:09.461 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:09 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2834255198' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T07:13:09.461 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:09 smithi098 ceph-mon[30950]: mgrmap e5: x(active, since 5s) 2024-09-19T07:13:09.461 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:09 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:09.202+0000 7f5beea6f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:13:09.462 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:09 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:09.263+0000 7f5beea6f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:13:09.462 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:09 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:09.460+0000 7f5beea6f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:13:10.170 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:13:10.170 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T07:13:10.170 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T07:13:10.170 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T07:13:10.170 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T07:13:10.171 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:13:10.171 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.336+0000 7f0a2b47f640 1 Processor -- start 2024-09-19T07:13:10.171 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.336+0000 7f0a2b47f640 1 -- start start 2024-09-19T07:13:10.171 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.337+0000 7f0a2b47f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 0x7f0a241065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:10.171 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.337+0000 7f0a2b47f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2407be30 con 0x7f0a241061d0 2024-09-19T07:13:10.171 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.337+0000 7f0a2921b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 0x7f0a241065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:10.172 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.337+0000 7f0a2921b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 0x7f0a241065d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42836/0 (socket says 172.21.15.98:42836) 2024-09-19T07:13:10.172 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.337+0000 7f0a2921b640 1 -- 172.21.15.98:0/3766364819 learned_addr learned my addr 172.21.15.98:0/3766364819 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:10.172 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.337+0000 7f0a2921b640 1 -- 172.21.15.98:0/3766364819 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a24106b10 con 0x7f0a241061d0 2024-09-19T07:13:10.172 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.338+0000 7f0a2921b640 1 --2- 172.21.15.98:0/3766364819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 0x7f0a241065d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009820 tx=0x7f0a2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c281b2e49821c7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:10.172 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.338+0000 7f0a1bfff640 1 -- 172.21.15.98:0/3766364819 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20037070 con 0x7f0a241061d0 2024-09-19T07:13:10.173 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.338+0000 7f0a1bfff640 1 -- 172.21.15.98:0/3766364819 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a20032900 con 0x7f0a241061d0 2024-09-19T07:13:10.173 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.338+0000 7f0a1bfff640 1 -- 172.21.15.98:0/3766364819 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20030850 con 0x7f0a241061d0 2024-09-19T07:13:10.173 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.339+0000 7f0a2b47f640 1 -- 172.21.15.98:0/3766364819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 msgr2=0x7f0a241065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:10.173 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.339+0000 7f0a2b47f640 1 --2- 172.21.15.98:0/3766364819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 0x7f0a241065d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009820 tx=0x7f0a2002a270 comp rx=0 tx=0).stop 2024-09-19T07:13:10.173 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.339+0000 7f0a2b47f640 1 -- 172.21.15.98:0/3766364819 shutdown_connections 2024-09-19T07:13:10.173 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.339+0000 7f0a2b47f640 1 --2- 172.21.15.98:0/3766364819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 0x7f0a241065d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.174 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.339+0000 7f0a2b47f640 1 -- 172.21.15.98:0/3766364819 >> 172.21.15.98:0/3766364819 conn(0x7f0a24101fc0 msgr2=0x7f0a241043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:10.174 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.339+0000 7f0a2b47f640 1 -- 172.21.15.98:0/3766364819 shutdown_connections 2024-09-19T07:13:10.174 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.339+0000 7f0a2b47f640 1 -- 172.21.15.98:0/3766364819 wait complete. 2024-09-19T07:13:10.174 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.339+0000 7f0a2b47f640 1 Processor -- start 2024-09-19T07:13:10.174 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.339+0000 7f0a2b47f640 1 -- start start 2024-09-19T07:13:10.175 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.340+0000 7f0a2b47f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 0x7f0a2419de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:10.175 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.340+0000 7f0a2b47f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24107ba0 con 0x7f0a241061d0 2024-09-19T07:13:10.175 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.340+0000 7f0a2921b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 0x7f0a2419de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:10.175 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.340+0000 7f0a2921b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 0x7f0a2419de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42850/0 (socket says 172.21.15.98:42850) 2024-09-19T07:13:10.175 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.340+0000 7f0a2921b640 1 -- 172.21.15.98:0/2535617606 learned_addr learned my addr 172.21.15.98:0/2535617606 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:10.175 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.340+0000 7f0a2921b640 1 -- 172.21.15.98:0/2535617606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2419e340 con 0x7f0a241061d0 2024-09-19T07:13:10.176 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.340+0000 7f0a2921b640 1 --2- 172.21.15.98:0/2535617606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 0x7f0a2419de00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0a20031000 tx=0x7f0a200326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:10.176 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.340+0000 7f0a1a7fc640 1 -- 172.21.15.98:0/2535617606 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20042070 con 0x7f0a241061d0 2024-09-19T07:13:10.176 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.340+0000 7f0a1a7fc640 1 -- 172.21.15.98:0/2535617606 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a20032be0 con 0x7f0a241061d0 2024-09-19T07:13:10.176 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.340+0000 7f0a2b47f640 1 -- 172.21.15.98:0/2535617606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2419e5d0 con 0x7f0a241061d0 2024-09-19T07:13:10.176 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.340+0000 7f0a1a7fc640 1 -- 172.21.15.98:0/2535617606 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20037040 con 0x7f0a241061d0 2024-09-19T07:13:10.177 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.340+0000 7f0a2b47f640 1 -- 172.21.15.98:0/2535617606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a241a12c0 con 0x7f0a241061d0 2024-09-19T07:13:10.177 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.341+0000 7f0a1a7fc640 1 -- 172.21.15.98:0/2535617606 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f0a20045070 con 0x7f0a241061d0 2024-09-19T07:13:10.177 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.341+0000 7f0a2b47f640 1 -- 172.21.15.98:0/2535617606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a241065d0 con 0x7f0a241061d0 2024-09-19T07:13:10.177 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.341+0000 7f0a1a7fc640 1 --2- 172.21.15.98:0/2535617606 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f0a100391b0 0x7f0a1003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:10.177 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.342+0000 7f0a1a7fc640 1 -- 172.21.15.98:0/2535617606 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0a2006c5c0 con 0x7f0a241061d0 2024-09-19T07:13:10.177 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.342+0000 7f0a28a1a640 1 -- 172.21.15.98:0/2535617606 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f0a100391b0 msgr2=0x7f0a1003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2881913098 2024-09-19T07:13:10.178 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.342+0000 7f0a28a1a640 1 --2- 172.21.15.98:0/2535617606 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f0a100391b0 0x7f0a1003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:13:10.178 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.350+0000 7f0a1a7fc640 1 -- 172.21.15.98:0/2535617606 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a20042210 con 0x7f0a241061d0 2024-09-19T07:13:10.178 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.543+0000 7f0a28a1a640 1 -- 172.21.15.98:0/2535617606 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f0a100391b0 msgr2=0x7f0a1003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2881913098 2024-09-19T07:13:10.178 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.543+0000 7f0a28a1a640 1 --2- 172.21.15.98:0/2535617606 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f0a100391b0 0x7f0a1003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:13:10.178 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.570+0000 7f0a2b47f640 1 -- 172.21.15.98:0/2535617606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f0a2402d7c0 con 0x7f0a241061d0 2024-09-19T07:13:10.178 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.571+0000 7f0a1a7fc640 1 -- 172.21.15.98:0/2535617606 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f0a2004c070 con 0x7f0a241061d0 2024-09-19T07:13:10.179 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.574+0000 7f0a2b47f640 1 -- 172.21.15.98:0/2535617606 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f0a100391b0 msgr2=0x7f0a1003b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:13:10.179 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.574+0000 7f0a2b47f640 1 --2- 172.21.15.98:0/2535617606 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f0a100391b0 0x7f0a1003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.179 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.574+0000 7f0a2b47f640 1 -- 172.21.15.98:0/2535617606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 msgr2=0x7f0a2419de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:10.179 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.574+0000 7f0a2b47f640 1 --2- 172.21.15.98:0/2535617606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 0x7f0a2419de00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0a20031000 tx=0x7f0a200326e0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.179 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.574+0000 7f0a2b47f640 1 -- 172.21.15.98:0/2535617606 shutdown_connections 2024-09-19T07:13:10.180 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.574+0000 7f0a2b47f640 1 --2- 172.21.15.98:0/2535617606 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f0a100391b0 0x7f0a1003b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.180 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.574+0000 7f0a2b47f640 1 --2- 172.21.15.98:0/2535617606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a241061d0 0x7f0a2419de00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:10.180 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.574+0000 7f0a2b47f640 1 -- 172.21.15.98:0/2535617606 >> 172.21.15.98:0/2535617606 conn(0x7f0a24101fc0 msgr2=0x7f0a241947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:10.180 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.574+0000 7f0a2b47f640 1 -- 172.21.15.98:0/2535617606 shutdown_connections 2024-09-19T07:13:10.180 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:09.574+0000 7f0a2b47f640 1 -- 172.21.15.98:0/2535617606 wait complete. 2024-09-19T07:13:10.180 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for the mgr to restart... 2024-09-19T07:13:10.181 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for mgr epoch 5... 2024-09-19T07:13:10.360 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:10 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2535617606' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T07:13:10.760 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:10 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:10.369+0000 7f5beea6f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:13:10.760 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:10 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:10.437+0000 7f5beea6f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:13:11.404 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:11.149+0000 7f5beea6f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:13:11.404 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:11.263+0000 7f5beea6f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:13:11.683 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:11.403+0000 7f5beea6f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:13:11.683 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:11.464+0000 7f5beea6f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:13:11.683 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:11.613+0000 7f5beea6f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:13:11.683 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:11.681+0000 7f5beea6f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:13:11.961 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:11.741+0000 7f5beea6f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:13:11.962 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:11.898+0000 7f5beea6f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:13:12.229 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:11.961+0000 7f5beea6f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:13:12.229 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:12.029+0000 7f5beea6f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:13:12.229 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:12.110+0000 7f5beea6f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:13:12.230 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:12.171+0000 7f5beea6f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:13:12.230 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:12.228+0000 7f5beea6f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:13:13.273 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:13.005+0000 7f5beea6f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:13:13.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: Active manager daemon x restarted 2024-09-19T07:13:13.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: Activating manager daemon x 2024-09-19T07:13:13.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T07:13:13.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: mgrmap e6: x(active, starting, since 0.00356672s) 2024-09-19T07:13:13.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:13:13.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:13:13.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:13:13.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:13:13.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:13:13.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: Manager daemon x is now available 2024-09-19T07:13:13.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:13.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:13.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:13.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:13.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:13:13.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:13 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:13:14.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:14 smithi098 ceph-mon[30950]: Found migration_current of "None". Setting to last migration. 2024-09-19T07:13:14.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:14 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:14.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:14 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:14.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:14 smithi098 ceph-mon[30950]: mgrmap e7: x(active, since 1.0053s) 2024-09-19T07:13:14.630 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:13:14.630 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T07:13:14.630 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T07:13:14.630 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:13:14.630 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.552+0000 7f3421d90640 1 Processor -- start 2024-09-19T07:13:14.630 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.552+0000 7f3421d90640 1 -- start start 2024-09-19T07:13:14.630 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.553+0000 7f3421d90640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 0x7f341c105f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:14.630 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.553+0000 7f3421d90640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f341c106510 con 0x7f341c105b40 2024-09-19T07:13:14.631 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.553+0000 7f341b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 0x7f341c105f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:14.631 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.553+0000 7f341b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 0x7f341c105f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42852/0 (socket says 172.21.15.98:42852) 2024-09-19T07:13:14.631 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.553+0000 7f341b7fe640 1 -- 172.21.15.98:0/4120074978 learned_addr learned my addr 172.21.15.98:0/4120074978 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:14.631 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.553+0000 7f341b7fe640 1 -- 172.21.15.98:0/4120074978 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c108b20 con 0x7f341c105b40 2024-09-19T07:13:14.632 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.554+0000 7f341b7fe640 1 --2- 172.21.15.98:0/4120074978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 0x7f341c105f40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f340c009820 tx=0x7f340c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c25a7f6c7dca9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:14.632 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.554+0000 7f341a7fc640 1 -- 172.21.15.98:0/4120074978 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f340c037070 con 0x7f341c105b40 2024-09-19T07:13:14.632 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.554+0000 7f341a7fc640 1 -- 172.21.15.98:0/4120074978 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f340c032900 con 0x7f341c105b40 2024-09-19T07:13:14.632 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.554+0000 7f341a7fc640 1 -- 172.21.15.98:0/4120074978 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f340c030850 con 0x7f341c105b40 2024-09-19T07:13:14.632 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.555+0000 7f3421d90640 1 -- 172.21.15.98:0/4120074978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 msgr2=0x7f341c105f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:14.632 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.555+0000 7f3421d90640 1 --2- 172.21.15.98:0/4120074978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 0x7f341c105f40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f340c009820 tx=0x7f340c02a270 comp rx=0 tx=0).stop 2024-09-19T07:13:14.632 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.555+0000 7f3421d90640 1 -- 172.21.15.98:0/4120074978 shutdown_connections 2024-09-19T07:13:14.632 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.555+0000 7f3421d90640 1 --2- 172.21.15.98:0/4120074978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 0x7f341c105f40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:14.632 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.555+0000 7f3421d90640 1 -- 172.21.15.98:0/4120074978 >> 172.21.15.98:0/4120074978 conn(0x7f341c1016b0 msgr2=0x7f341c103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:14.632 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.555+0000 7f3421d90640 1 -- 172.21.15.98:0/4120074978 shutdown_connections 2024-09-19T07:13:14.632 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.555+0000 7f3421d90640 1 -- 172.21.15.98:0/4120074978 wait complete. 2024-09-19T07:13:14.632 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.556+0000 7f3421d90640 1 Processor -- start 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.556+0000 7f3421d90640 1 -- start start 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.556+0000 7f3421d90640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 0x7f341c19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.556+0000 7f3421d90640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f341c10bd50 con 0x7f341c105b40 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.556+0000 7f341b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 0x7f341c19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.556+0000 7f341b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 0x7f341c19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42856/0 (socket says 172.21.15.98:42856) 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.556+0000 7f341b7fe640 1 -- 172.21.15.98:0/374825790 learned_addr learned my addr 172.21.15.98:0/374825790 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.556+0000 7f341b7fe640 1 -- 172.21.15.98:0/374825790 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341c19bdf0 con 0x7f341c105b40 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.557+0000 7f341b7fe640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 0x7f341c19b8b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f340c009940 tx=0x7f340c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.557+0000 7f3418ff9640 1 -- 172.21.15.98:0/374825790 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f340c042070 con 0x7f341c105b40 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.557+0000 7f3418ff9640 1 -- 172.21.15.98:0/374825790 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f340c0308c0 con 0x7f341c105b40 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.557+0000 7f3421d90640 1 -- 172.21.15.98:0/374825790 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341c19c080 con 0x7f341c105b40 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.557+0000 7f3418ff9640 1 -- 172.21.15.98:0/374825790 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f340c037040 con 0x7f341c105b40 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.557+0000 7f3421d90640 1 -- 172.21.15.98:0/374825790 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f341c19ed70 con 0x7f341c105b40 2024-09-19T07:13:14.633 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.558+0000 7f3418ff9640 1 -- 172.21.15.98:0/374825790 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f340c045070 con 0x7f341c105b40 2024-09-19T07:13:14.634 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.558+0000 7f3418ff9640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f34040391b0 0x7f340403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:14.634 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.558+0000 7f3418ff9640 1 -- 172.21.15.98:0/374825790 --> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f340403bd80 con 0x7f34040391b0 2024-09-19T07:13:14.634 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.558+0000 7f3418ff9640 1 -- 172.21.15.98:0/374825790 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f340c06c2b0 con 0x7f341c105b40 2024-09-19T07:13:14.634 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.558+0000 7f341affd640 1 -- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f34040391b0 msgr2=0x7f340403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2881913098 2024-09-19T07:13:14.634 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.558+0000 7f341affd640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f34040391b0 0x7f340403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:13:14.634 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.759+0000 7f341affd640 1 -- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f34040391b0 msgr2=0x7f340403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2881913098 2024-09-19T07:13:14.634 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:10.759+0000 7f341affd640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f34040391b0 0x7f340403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:13:14.634 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:11.160+0000 7f341affd640 1 -- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f34040391b0 msgr2=0x7f340403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2881913098 2024-09-19T07:13:14.634 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:11.160+0000 7f341affd640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f34040391b0 0x7f340403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T07:13:14.634 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:11.961+0000 7f341affd640 1 -- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f34040391b0 msgr2=0x7f340403b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2881913098 2024-09-19T07:13:14.634 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:11.961+0000 7f341affd640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f34040391b0 0x7f340403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T07:13:14.634 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:13.008+0000 7f3418ff9640 1 -- 172.21.15.98:0/374825790 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f340c06ae30 con 0x7f341c105b40 2024-09-19T07:13:14.635 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:13.008+0000 7f3418ff9640 1 -- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f34040391b0 msgr2=0x7f340403b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:13:14.635 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:13.008+0000 7f3418ff9640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f34040391b0 0x7f340403b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:14.635 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.009+0000 7f3418ff9640 1 -- 172.21.15.98:0/374825790 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f340c042ae0 con 0x7f341c105b40 2024-09-19T07:13:14.635 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.009+0000 7f3418ff9640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f340403cae0 0x7f340403eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:14.635 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.009+0000 7f3418ff9640 1 -- 172.21.15.98:0/374825790 --> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f340c045e70 con 0x7f340403cae0 2024-09-19T07:13:14.635 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.010+0000 7f341affd640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f340403cae0 0x7f340403eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:14.635 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.010+0000 7f341affd640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f340403cae0 0x7f340403eed0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3410003980 tx=0x7f3410006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:14.635 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.011+0000 7f3418ff9640 1 -- 172.21.15.98:0/374825790 <== mgr.14118 v2:172.21.15.98:6800/4041153215 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f340c045e70 con 0x7f340403cae0 2024-09-19T07:13:14.635 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3421d90640 1 -- 172.21.15.98:0/374825790 --> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f341c105fc0 con 0x7f340403cae0 2024-09-19T07:13:14.635 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3418ff9640 1 -- 172.21.15.98:0/374825790 <== mgr.14118 v2:172.21.15.98:6800/4041153215 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f341c105fc0 con 0x7f340403cae0 2024-09-19T07:13:14.636 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3421d90640 1 -- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f340403cae0 msgr2=0x7f340403eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:14.636 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3421d90640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f340403cae0 0x7f340403eed0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3410003980 tx=0x7f3410006e10 comp rx=0 tx=0).stop 2024-09-19T07:13:14.636 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3421d90640 1 -- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 msgr2=0x7f341c19b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:14.636 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3421d90640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 0x7f341c19b8b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f340c009940 tx=0x7f340c032ce0 comp rx=0 tx=0).stop 2024-09-19T07:13:14.636 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3421d90640 1 -- 172.21.15.98:0/374825790 shutdown_connections 2024-09-19T07:13:14.636 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3421d90640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f340403cae0 0x7f340403eed0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:14.636 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3421d90640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:6800/2881913098,v1:172.21.15.98:6801/2881913098] conn(0x7f34040391b0 0x7f340403b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:14.636 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3421d90640 1 --2- 172.21.15.98:0/374825790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f341c105b40 0x7f341c19b8b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:14.636 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3421d90640 1 -- 172.21.15.98:0/374825790 >> 172.21.15.98:0/374825790 conn(0x7f341c1016b0 msgr2=0x7f341c102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:14.636 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3421d90640 1 -- 172.21.15.98:0/374825790 shutdown_connections 2024-09-19T07:13:14.636 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:14.018+0000 7f3421d90640 1 -- 172.21.15.98:0/374825790 wait complete. 2024-09-19T07:13:14.636 INFO:teuthology.orchestra.run.smithi098.stdout:mgr epoch 5 is available 2024-09-19T07:13:14.637 INFO:teuthology.orchestra.run.smithi098.stdout:Setting orchestrator backend to cephadm... 2024-09-19T07:13:15.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-mon[30950]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T07:13:15.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-mon[30950]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T07:13:15.274 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:15.143+0000 7f5b55dc9640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:07:13:15] ENGINE Error in HTTPServer.serve 2024-09-19T07:13:15.274 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: Traceback (most recent call last): 2024-09-19T07:13:15.274 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:13:15.274 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: self._connections.run(self.expiration_interval) 2024-09-19T07:13:15.274 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:13:15.274 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: self._run(expiration_interval) 2024-09-19T07:13:15.274 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:13:15.274 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:13:15.274 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:13:15.274 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:13:15.274 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:13:15.274 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: s = self.context.wrap_socket( 2024-09-19T07:13:15.275 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:13:15.275 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: return self.sslsocket_class._create( 2024-09-19T07:13:15.275 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:13:15.275 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: self.do_handshake() 2024-09-19T07:13:15.275 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:13:15.275 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: self._sslobj.do_handshake() 2024-09-19T07:13:15.275 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:13:15.275 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:15.826 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.092+0000 7fb108cd3640 1 Processor -- start 2024-09-19T07:13:15.826 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.092+0000 7fb108cd3640 1 -- start start 2024-09-19T07:13:15.826 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.092+0000 7fb108cd3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 0x7fb10407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:15.826 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.092+0000 7fb108cd3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb10407c890 con 0x7fb10407de60 2024-09-19T07:13:15.826 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.092+0000 7fb10259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 0x7fb10407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:15.826 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.092+0000 7fb10259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 0x7fb10407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35148/0 (socket says 172.21.15.98:35148) 2024-09-19T07:13:15.826 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.092+0000 7fb10259c640 1 -- 172.21.15.98:0/1354994131 learned_addr learned my addr 172.21.15.98:0/1354994131 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:15.826 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.092+0000 7fb10259c640 1 -- 172.21.15.98:0/1354994131 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10407ca10 con 0x7fb10407de60 2024-09-19T07:13:15.826 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.093+0000 7fb10259c640 1 --2- 172.21.15.98:0/1354994131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 0x7fb10407c2c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009820 tx=0x7fb0f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb001e88fdd4715 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:15.827 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.093+0000 7fb10159a640 1 -- 172.21.15.98:0/1354994131 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f4037070 con 0x7fb10407de60 2024-09-19T07:13:15.827 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.093+0000 7fb10159a640 1 -- 172.21.15.98:0/1354994131 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb0f4032900 con 0x7fb10407de60 2024-09-19T07:13:15.827 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.093+0000 7fb10159a640 1 -- 172.21.15.98:0/1354994131 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f4030850 con 0x7fb10407de60 2024-09-19T07:13:15.827 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.094+0000 7fb108cd3640 1 -- 172.21.15.98:0/1354994131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 msgr2=0x7fb10407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:15.827 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.094+0000 7fb108cd3640 1 --2- 172.21.15.98:0/1354994131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 0x7fb10407c2c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009820 tx=0x7fb0f402a270 comp rx=0 tx=0).stop 2024-09-19T07:13:15.827 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.094+0000 7fb108cd3640 1 -- 172.21.15.98:0/1354994131 shutdown_connections 2024-09-19T07:13:15.827 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.094+0000 7fb108cd3640 1 --2- 172.21.15.98:0/1354994131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 0x7fb10407c2c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:15.827 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.094+0000 7fb108cd3640 1 -- 172.21.15.98:0/1354994131 >> 172.21.15.98:0/1354994131 conn(0x7fb1041030b0 msgr2=0x7fb1041054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:15.827 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.094+0000 7fb108cd3640 1 -- 172.21.15.98:0/1354994131 shutdown_connections 2024-09-19T07:13:15.827 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.094+0000 7fb108cd3640 1 -- 172.21.15.98:0/1354994131 wait complete. 2024-09-19T07:13:15.827 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.095+0000 7fb108cd3640 1 Processor -- start 2024-09-19T07:13:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.095+0000 7fb108cd3640 1 -- start start 2024-09-19T07:13:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.095+0000 7fb108cd3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 0x7fb10419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.095+0000 7fb108cd3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb10410ded0 con 0x7fb10407de60 2024-09-19T07:13:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.095+0000 7fb10259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 0x7fb10419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.095+0000 7fb10259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 0x7fb10419da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35154/0 (socket says 172.21.15.98:35154) 2024-09-19T07:13:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.095+0000 7fb10259c640 1 -- 172.21.15.98:0/270982719 learned_addr learned my addr 172.21.15.98:0/270982719 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.095+0000 7fb10259c640 1 -- 172.21.15.98:0/270982719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10419dfc0 con 0x7fb10407de60 2024-09-19T07:13:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.095+0000 7fb10259c640 1 --2- 172.21.15.98:0/270982719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 0x7fb10419da80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4031000 tx=0x7fb0f40326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.096+0000 7fb0f37fe640 1 -- 172.21.15.98:0/270982719 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f4042070 con 0x7fb10407de60 2024-09-19T07:13:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.096+0000 7fb0f37fe640 1 -- 172.21.15.98:0/270982719 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb0f4032be0 con 0x7fb10407de60 2024-09-19T07:13:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.096+0000 7fb108cd3640 1 -- 172.21.15.98:0/270982719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb10419e250 con 0x7fb10407de60 2024-09-19T07:13:15.828 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.096+0000 7fb0f37fe640 1 -- 172.21.15.98:0/270982719 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f4037040 con 0x7fb10407de60 2024-09-19T07:13:15.829 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.096+0000 7fb108cd3640 1 -- 172.21.15.98:0/270982719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1041a0f40 con 0x7fb10407de60 2024-09-19T07:13:15.829 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.097+0000 7fb0f37fe640 1 -- 172.21.15.98:0/270982719 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fb0f4045070 con 0x7fb10407de60 2024-09-19T07:13:15.829 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.097+0000 7fb108cd3640 1 -- 172.21.15.98:0/270982719 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb10407c340 con 0x7fb10407de60 2024-09-19T07:13:15.829 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.097+0000 7fb0f37fe640 1 --2- 172.21.15.98:0/270982719 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fb0ec0391b0 0x7fb0ec03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:15.829 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.097+0000 7fb0f37fe640 1 -- 172.21.15.98:0/270982719 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb0f406c290 con 0x7fb10407de60 2024-09-19T07:13:15.829 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.097+0000 7fb101d9b640 1 --2- 172.21.15.98:0/270982719 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fb0ec0391b0 0x7fb0ec03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:15.829 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.097+0000 7fb101d9b640 1 --2- 172.21.15.98:0/270982719 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fb0ec0391b0 0x7fb0ec03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80098c0 tx=0x7fb0f8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:15.829 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.102+0000 7fb0f37fe640 1 -- 172.21.15.98:0/270982719 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0f402f2a0 con 0x7fb10407de60 2024-09-19T07:13:15.829 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.285+0000 7fb108cd3640 1 -- 172.21.15.98:0/270982719 --> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fb104104350 con 0x7fb0ec0391b0 2024-09-19T07:13:15.829 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.289+0000 7fb0f37fe640 1 -- 172.21.15.98:0/270982719 <== mgr.14118 v2:172.21.15.98:6800/4041153215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb104104350 con 0x7fb0ec0391b0 2024-09-19T07:13:15.829 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.291+0000 7fb108cd3640 1 -- 172.21.15.98:0/270982719 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fb0ec0391b0 msgr2=0x7fb0ec03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:15.829 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.291+0000 7fb108cd3640 1 --2- 172.21.15.98:0/270982719 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fb0ec0391b0 0x7fb0ec03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80098c0 tx=0x7fb0f8006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:15.830 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.291+0000 7fb108cd3640 1 -- 172.21.15.98:0/270982719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 msgr2=0x7fb10419da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:15.830 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.291+0000 7fb108cd3640 1 --2- 172.21.15.98:0/270982719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 0x7fb10419da80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4031000 tx=0x7fb0f40326e0 comp rx=0 tx=0).stop 2024-09-19T07:13:15.830 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.292+0000 7fb108cd3640 1 -- 172.21.15.98:0/270982719 shutdown_connections 2024-09-19T07:13:15.830 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.292+0000 7fb108cd3640 1 --2- 172.21.15.98:0/270982719 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fb0ec0391b0 0x7fb0ec03b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:15.830 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.292+0000 7fb108cd3640 1 --2- 172.21.15.98:0/270982719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb10407de60 0x7fb10419da80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:15.830 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.292+0000 7fb108cd3640 1 -- 172.21.15.98:0/270982719 >> 172.21.15.98:0/270982719 conn(0x7fb1041030b0 msgr2=0x7fb104103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:15.830 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.292+0000 7fb108cd3640 1 -- 172.21.15.98:0/270982719 shutdown_connections 2024-09-19T07:13:15.830 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:15.292+0000 7fb108cd3640 1 -- 172.21.15.98:0/270982719 wait complete. 2024-09-19T07:13:16.243 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:16 smithi098 ceph-mon[30950]: [19/Sep/2024:07:13:14] ENGINE Bus STARTING 2024-09-19T07:13:16.244 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:16 smithi098 ceph-mon[30950]: [19/Sep/2024:07:13:15] ENGINE Serving on http://172.21.15.98:8765 2024-09-19T07:13:16.244 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:16 smithi098 ceph-mon[30950]: mgrmap e8: x(active, since 2s) 2024-09-19T07:13:16.244 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:16 smithi098 ceph-mon[30950]: [19/Sep/2024:07:13:15] ENGINE Serving on https://172.21.15.98:7150 2024-09-19T07:13:16.244 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:16 smithi098 ceph-mon[30950]: [19/Sep/2024:07:13:15] ENGINE Bus STARTED 2024-09-19T07:13:16.244 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:16 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:16.244 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:16 smithi098 ceph-mon[30950]: [19/Sep/2024:07:13:15] ENGINE Error in HTTPServer.serve 2024-09-19T07:13:16.244 INFO:journalctl@ceph.mon.a.smithi098.stdout: Traceback (most recent call last): 2024-09-19T07:13:16.244 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:13:16.244 INFO:journalctl@ceph.mon.a.smithi098.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:13:16.244 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:13:16.245 INFO:journalctl@ceph.mon.a.smithi098.stdout: self._run(expiration_interval) 2024-09-19T07:13:16.245 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:13:16.245 INFO:journalctl@ceph.mon.a.smithi098.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:13:16.245 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:13:16.245 INFO:journalctl@ceph.mon.a.smithi098.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:13:16.245 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:13:16.245 INFO:journalctl@ceph.mon.a.smithi098.stdout: s = self.context.wrap_socket( 2024-09-19T07:13:16.245 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:13:16.245 INFO:journalctl@ceph.mon.a.smithi098.stdout: return self.sslsocket_class._create( 2024-09-19T07:13:16.245 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:13:16.245 INFO:journalctl@ceph.mon.a.smithi098.stdout: self.do_handshake() 2024-09-19T07:13:16.246 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:13:16.246 INFO:journalctl@ceph.mon.a.smithi098.stdout: self._sslobj.do_handshake() 2024-09-19T07:13:16.246 INFO:journalctl@ceph.mon.a.smithi098.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:13:16.246 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:16 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:16.246 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:16 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:17.066 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T07:13:17.066 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.247+0000 7fc598b6c640 1 Processor -- start 2024-09-19T07:13:17.066 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.247+0000 7fc598b6c640 1 -- start start 2024-09-19T07:13:17.066 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.247+0000 7fc598b6c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 0x7fc59410a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:17.066 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.247+0000 7fc598b6c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc59407be90 con 0x7fc5941083a0 2024-09-19T07:13:17.066 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.247+0000 7fc59259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 0x7fc59410a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:17.066 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.247+0000 7fc59259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 0x7fc59410a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35170/0 (socket says 172.21.15.98:35170) 2024-09-19T07:13:17.066 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.247+0000 7fc59259c640 1 -- 172.21.15.98:0/2562671507 learned_addr learned my addr 172.21.15.98:0/2562671507 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:17.066 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.248+0000 7fc59259c640 1 -- 172.21.15.98:0/2562671507 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59410acd0 con 0x7fc5941083a0 2024-09-19T07:13:17.066 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.248+0000 7fc59259c640 1 --2- 172.21.15.98:0/2562671507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 0x7fc59410a790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc584009820 tx=0x7fc58402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b641b998510dacd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.249+0000 7fc591d9b640 1 -- 172.21.15.98:0/2562671507 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc584037070 con 0x7fc5941083a0 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.249+0000 7fc591d9b640 1 -- 172.21.15.98:0/2562671507 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc584032900 con 0x7fc5941083a0 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.249+0000 7fc591d9b640 1 -- 172.21.15.98:0/2562671507 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc584030850 con 0x7fc5941083a0 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.249+0000 7fc598b6c640 1 -- 172.21.15.98:0/2562671507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 msgr2=0x7fc59410a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.249+0000 7fc598b6c640 1 --2- 172.21.15.98:0/2562671507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 0x7fc59410a790 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc584009820 tx=0x7fc58402a270 comp rx=0 tx=0).stop 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.249+0000 7fc598b6c640 1 -- 172.21.15.98:0/2562671507 shutdown_connections 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.249+0000 7fc598b6c640 1 --2- 172.21.15.98:0/2562671507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 0x7fc59410a790 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.249+0000 7fc598b6c640 1 -- 172.21.15.98:0/2562671507 >> 172.21.15.98:0/2562671507 conn(0x7fc594102020 msgr2=0x7fc594104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.249+0000 7fc598b6c640 1 -- 172.21.15.98:0/2562671507 shutdown_connections 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.249+0000 7fc598b6c640 1 -- 172.21.15.98:0/2562671507 wait complete. 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.250+0000 7fc598b6c640 1 Processor -- start 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.250+0000 7fc598b6c640 1 -- start start 2024-09-19T07:13:17.067 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.250+0000 7fc598b6c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 0x7fc59419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.250+0000 7fc598b6c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc59410bd00 con 0x7fc5941083a0 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.251+0000 7fc59259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 0x7fc59419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.251+0000 7fc59259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 0x7fc59419b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35182/0 (socket says 172.21.15.98:35182) 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.251+0000 7fc59259c640 1 -- 172.21.15.98:0/2550699305 learned_addr learned my addr 172.21.15.98:0/2550699305 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.251+0000 7fc59259c640 1 -- 172.21.15.98:0/2550699305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59419bdd0 con 0x7fc5941083a0 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.251+0000 7fc59259c640 1 --2- 172.21.15.98:0/2550699305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 0x7fc59419b890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc5840097f0 tx=0x7fc584030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.251+0000 7fc58bfff640 1 -- 172.21.15.98:0/2550699305 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc584042070 con 0x7fc5941083a0 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.251+0000 7fc58bfff640 1 -- 172.21.15.98:0/2550699305 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc584032ca0 con 0x7fc5941083a0 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.251+0000 7fc598b6c640 1 -- 172.21.15.98:0/2550699305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc59419c060 con 0x7fc5941083a0 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.251+0000 7fc58bfff640 1 -- 172.21.15.98:0/2550699305 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc584037040 con 0x7fc5941083a0 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.251+0000 7fc598b6c640 1 -- 172.21.15.98:0/2550699305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc59419ed50 con 0x7fc5941083a0 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.252+0000 7fc58bfff640 1 -- 172.21.15.98:0/2550699305 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc584045070 con 0x7fc5941083a0 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.252+0000 7fc58bfff640 1 --2- 172.21.15.98:0/2550699305 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fc580039200 0x7fc58003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:17.068 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.252+0000 7fc58bfff640 1 -- 172.21.15.98:0/2550699305 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc58406d220 con 0x7fc5941083a0 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.252+0000 7fc589d9b640 1 --2- 172.21.15.98:0/2550699305 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fc580039200 0x7fc58003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.252+0000 7fc598b6c640 1 -- 172.21.15.98:0/2550699305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc594108800 con 0x7fc5941083a0 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.253+0000 7fc589d9b640 1 --2- 172.21.15.98:0/2550699305 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fc580039200 0x7fc58003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0098c0 tx=0x7fc57c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.257+0000 7fc58bfff640 1 -- 172.21.15.98:0/2550699305 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc584045760 con 0x7fc5941083a0 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.427+0000 7fc598b6c640 1 -- 172.21.15.98:0/2550699305 --> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fc594103310 con 0x7fc580039200 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.428+0000 7fc58bfff640 1 -- 172.21.15.98:0/2550699305 <== mgr.14118 v2:172.21.15.98:6800/4041153215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fc594103310 con 0x7fc580039200 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.429+0000 7fc598b6c640 1 -- 172.21.15.98:0/2550699305 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fc580039200 msgr2=0x7fc58003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.429+0000 7fc598b6c640 1 --2- 172.21.15.98:0/2550699305 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fc580039200 0x7fc58003b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0098c0 tx=0x7fc57c006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.430+0000 7fc598b6c640 1 -- 172.21.15.98:0/2550699305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 msgr2=0x7fc59419b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.430+0000 7fc598b6c640 1 --2- 172.21.15.98:0/2550699305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 0x7fc59419b890 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc5840097f0 tx=0x7fc584030ec0 comp rx=0 tx=0).stop 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.430+0000 7fc598b6c640 1 -- 172.21.15.98:0/2550699305 shutdown_connections 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.430+0000 7fc598b6c640 1 --2- 172.21.15.98:0/2550699305 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fc580039200 0x7fc58003b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.430+0000 7fc598b6c640 1 --2- 172.21.15.98:0/2550699305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc5941083a0 0x7fc59419b890 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:17.069 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.430+0000 7fc598b6c640 1 -- 172.21.15.98:0/2550699305 >> 172.21.15.98:0/2550699305 conn(0x7fc594102020 msgr2=0x7fc594102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:17.070 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.430+0000 7fc598b6c640 1 -- 172.21.15.98:0/2550699305 shutdown_connections 2024-09-19T07:13:17.070 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:16.430+0000 7fc598b6c640 1 -- 172.21.15.98:0/2550699305 wait complete. 2024-09-19T07:13:17.070 INFO:teuthology.orchestra.run.smithi098.stdout:Generating ssh key... 2024-09-19T07:13:17.386 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-mon[30950]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:13:18.240 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:18 smithi098 ceph-mon[30950]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:13:18.240 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:18 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:18.240 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:18 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:18.240 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: Generating public/private rsa key pair. 2024-09-19T07:13:18.240 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: Your identification has been saved in /tmp/tmpdtdgh2z9/key 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: Your public key has been saved in /tmp/tmpdtdgh2z9/key.pub 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: The key fingerprint is: 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: SHA256:TevD196eVA+aplUNGttetIF1XGQbDdmpbZNNfBbo844 ceph-73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: The key's randomart image is: 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: +---[RSA 3072]----+ 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: | o@X| 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: | .+o%| 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: | . o.+==| 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: | o . O O+| 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: | S o o B.=| 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: | o * +o| 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: | + * =..| 2024-09-19T07:13:18.241 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: | * E.o.| 2024-09-19T07:13:18.242 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: | . .oo| 2024-09-19T07:13:18.242 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: +----[SHA256]-----+ 2024-09-19T07:13:18.547 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.461+0000 7f4ce80e6640 1 Processor -- start 2024-09-19T07:13:18.548 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.462+0000 7f4ce80e6640 1 -- start start 2024-09-19T07:13:18.548 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.462+0000 7f4ce80e6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 0x7f4ce0107d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:18.548 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.462+0000 7f4ce80e6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce01082d0 con 0x7f4ce0107900 2024-09-19T07:13:18.548 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.462+0000 7f4ce5e82640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 0x7f4ce0107d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:18.548 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.462+0000 7f4ce5e82640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 0x7f4ce0107d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35184/0 (socket says 172.21.15.98:35184) 2024-09-19T07:13:18.548 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.462+0000 7f4ce5e82640 1 -- 172.21.15.98:0/218567552 learned_addr learned my addr 172.21.15.98:0/218567552 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:18.548 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.462+0000 7f4ce5e82640 1 -- 172.21.15.98:0/218567552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce0108b00 con 0x7f4ce0107900 2024-09-19T07:13:18.548 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.463+0000 7f4ce5e82640 1 --2- 172.21.15.98:0/218567552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 0x7f4ce0107d00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009820 tx=0x7f4cdc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef820cf2c867b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:18.548 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.463+0000 7f4ce4e80640 1 -- 172.21.15.98:0/218567552 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cdc037070 con 0x7f4ce0107900 2024-09-19T07:13:18.548 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.463+0000 7f4ce4e80640 1 -- 172.21.15.98:0/218567552 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4cdc032900 con 0x7f4ce0107900 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.463+0000 7f4ce4e80640 1 -- 172.21.15.98:0/218567552 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cdc030850 con 0x7f4ce0107900 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.464+0000 7f4ce80e6640 1 -- 172.21.15.98:0/218567552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 msgr2=0x7f4ce0107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.464+0000 7f4ce80e6640 1 --2- 172.21.15.98:0/218567552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 0x7f4ce0107d00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009820 tx=0x7f4cdc02a270 comp rx=0 tx=0).stop 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.464+0000 7f4ce80e6640 1 -- 172.21.15.98:0/218567552 shutdown_connections 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.464+0000 7f4ce80e6640 1 --2- 172.21.15.98:0/218567552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 0x7f4ce0107d00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.464+0000 7f4ce80e6640 1 -- 172.21.15.98:0/218567552 >> 172.21.15.98:0/218567552 conn(0x7f4ce01030b0 msgr2=0x7f4ce01054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.464+0000 7f4ce80e6640 1 -- 172.21.15.98:0/218567552 shutdown_connections 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.464+0000 7f4ce80e6640 1 -- 172.21.15.98:0/218567552 wait complete. 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.464+0000 7f4ce80e6640 1 Processor -- start 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.464+0000 7f4ce80e6640 1 -- start start 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.464+0000 7f4ce80e6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 0x7f4ce019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.464+0000 7f4ce80e6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce010beb0 con 0x7f4ce0107900 2024-09-19T07:13:18.549 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.465+0000 7f4ce5e82640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 0x7f4ce019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.465+0000 7f4ce5e82640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 0x7f4ce019b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35192/0 (socket says 172.21.15.98:35192) 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.465+0000 7f4ce5e82640 1 -- 172.21.15.98:0/84028968 learned_addr learned my addr 172.21.15.98:0/84028968 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.465+0000 7f4ce5e82640 1 -- 172.21.15.98:0/84028968 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce019be70 con 0x7f4ce0107900 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.465+0000 7f4ce5e82640 1 --2- 172.21.15.98:0/84028968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 0x7f4ce019b930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009940 tx=0x7f4cdc0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.465+0000 7f4cd6ffd640 1 -- 172.21.15.98:0/84028968 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cdc042070 con 0x7f4ce0107900 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.465+0000 7f4cd6ffd640 1 -- 172.21.15.98:0/84028968 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4cdc032be0 con 0x7f4ce0107900 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.465+0000 7f4ce80e6640 1 -- 172.21.15.98:0/84028968 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce019c100 con 0x7f4ce0107900 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.465+0000 7f4cd6ffd640 1 -- 172.21.15.98:0/84028968 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cdc037040 con 0x7f4ce0107900 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.465+0000 7f4ce80e6640 1 -- 172.21.15.98:0/84028968 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce019edf0 con 0x7f4ce0107900 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.466+0000 7f4cd6ffd640 1 -- 172.21.15.98:0/84028968 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4cdc045070 con 0x7f4ce0107900 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.466+0000 7f4ce80e6640 1 -- 172.21.15.98:0/84028968 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce0107d80 con 0x7f4ce0107900 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.466+0000 7f4cd6ffd640 1 --2- 172.21.15.98:0/84028968 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ccc0391b0 0x7f4ccc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.466+0000 7f4cd6ffd640 1 -- 172.21.15.98:0/84028968 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4cdc06c420 con 0x7f4ce0107900 2024-09-19T07:13:18.550 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.466+0000 7f4ce5681640 1 --2- 172.21.15.98:0/84028968 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ccc0391b0 0x7f4ccc03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:18.551 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.467+0000 7f4ce5681640 1 --2- 172.21.15.98:0/84028968 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ccc0391b0 0x7f4ccc03b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00098c0 tx=0x7f4cd0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:18.551 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.471+0000 7f4cd6ffd640 1 -- 172.21.15.98:0/84028968 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4cdc045e10 con 0x7f4ce0107900 2024-09-19T07:13:18.551 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.638+0000 7f4ce80e6640 1 -- 172.21.15.98:0/84028968 --> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f4ce0104360 con 0x7f4ccc0391b0 2024-09-19T07:13:18.551 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.937+0000 7f4cd6ffd640 1 -- 172.21.15.98:0/84028968 <== mgr.14118 v2:172.21.15.98:6800/4041153215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4ce0104360 con 0x7f4ccc0391b0 2024-09-19T07:13:18.551 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.939+0000 7f4ce80e6640 1 -- 172.21.15.98:0/84028968 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ccc0391b0 msgr2=0x7f4ccc03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:18.551 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.939+0000 7f4ce80e6640 1 --2- 172.21.15.98:0/84028968 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ccc0391b0 0x7f4ccc03b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00098c0 tx=0x7f4cd0006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:18.551 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.939+0000 7f4ce80e6640 1 -- 172.21.15.98:0/84028968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 msgr2=0x7f4ce019b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:18.551 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.939+0000 7f4ce80e6640 1 --2- 172.21.15.98:0/84028968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 0x7f4ce019b930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009940 tx=0x7f4cdc0326e0 comp rx=0 tx=0).stop 2024-09-19T07:13:18.551 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.939+0000 7f4ce80e6640 1 -- 172.21.15.98:0/84028968 shutdown_connections 2024-09-19T07:13:18.551 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.939+0000 7f4ce80e6640 1 --2- 172.21.15.98:0/84028968 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ccc0391b0 0x7f4ccc03b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:18.551 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.939+0000 7f4ce80e6640 1 --2- 172.21.15.98:0/84028968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ce0107900 0x7f4ce019b930 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:18.551 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.939+0000 7f4ce80e6640 1 -- 172.21.15.98:0/84028968 >> 172.21.15.98:0/84028968 conn(0x7f4ce01030b0 msgr2=0x7f4ce0103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:18.552 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.939+0000 7f4ce80e6640 1 -- 172.21.15.98:0/84028968 shutdown_connections 2024-09-19T07:13:18.552 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:17.939+0000 7f4ce80e6640 1 -- 172.21.15.98:0/84028968 wait complete. 2024-09-19T07:13:19.180 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:19 smithi098 ceph-mon[30950]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:13:19.180 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:19 smithi098 ceph-mon[30950]: Generating ssh key... 2024-09-19T07:13:19.763 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIRoCZnEzALRcM4f65r1oKt75XhVXAeiyyLO90ILUWGXe+f3mF+wc+qhzCCiI8zOJbvL7Acpi1kvgz2VMyHW3MTsMSat4Vo61OHMoNrU7h4fkLRV7qxYEwpRKMpDdVAa3WA6HGioQ4lYMjaEEM0eelUwGLocuaKMHSB1YHMxqBY4YQs1aBWQdL+GU5eH5fYQYbsma+ENKzVtxYhrNeziwCwejPMdX2hYkRT5y1qVB+ZeaOdOiXqcpO2l5NyBHEFEXDfWkQmMjJ5O4FuSxGl2tvi4sFGEFsDF7vWimCC/xDzD+bfndJTNP0s5Og9Ofl+hEZLqwSPuU6prUjgp7zJkqO6TiJzZR2apPByOMwRAF/vZ237hvgqI0IFuLExmrjZeal77KrhF+LBsws4NAOw8kofG18Ot7b6jnH6N8zG02gFy0nC0LUFJHGzgSSqWklu88JQOJ5wpJfZuEjeaetG3xMUJ7GFnH4x9ZW4UXamFn+zO3w1ChR2HepieEozovWO3M= ceph-73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:13:19.763 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.002+0000 7f5011494640 1 Processor -- start 2024-09-19T07:13:19.763 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.002+0000 7f5011494640 1 -- start start 2024-09-19T07:13:19.763 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.002+0000 7f5011494640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 0x7f500c107ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:19.763 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.002+0000 7f5011494640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f500c1082b0 con 0x7f500c1078e0 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.002+0000 7f500affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 0x7f500c107ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.002+0000 7f500affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 0x7f500c107ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35200/0 (socket says 172.21.15.98:35200) 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.002+0000 7f500affd640 1 -- 172.21.15.98:0/4023005338 learned_addr learned my addr 172.21.15.98:0/4023005338 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.002+0000 7f500affd640 1 -- 172.21.15.98:0/4023005338 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c108a90 con 0x7f500c1078e0 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.003+0000 7f500affd640 1 --2- 172.21.15.98:0/4023005338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 0x7f500c107ce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009820 tx=0x7f4ffc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161347543f133439 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.003+0000 7f5009ffb640 1 -- 172.21.15.98:0/4023005338 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc037070 con 0x7f500c1078e0 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.003+0000 7f5009ffb640 1 -- 172.21.15.98:0/4023005338 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ffc032900 con 0x7f500c1078e0 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.003+0000 7f5009ffb640 1 -- 172.21.15.98:0/4023005338 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc030850 con 0x7f500c1078e0 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.004+0000 7f5011494640 1 -- 172.21.15.98:0/4023005338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 msgr2=0x7f500c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.004+0000 7f5011494640 1 --2- 172.21.15.98:0/4023005338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 0x7f500c107ce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009820 tx=0x7f4ffc02a270 comp rx=0 tx=0).stop 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.004+0000 7f5011494640 1 -- 172.21.15.98:0/4023005338 shutdown_connections 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.004+0000 7f5011494640 1 --2- 172.21.15.98:0/4023005338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 0x7f500c107ce0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:19.764 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.004+0000 7f5011494640 1 -- 172.21.15.98:0/4023005338 >> 172.21.15.98:0/4023005338 conn(0x7f500c103070 msgr2=0x7f500c1054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.004+0000 7f5011494640 1 -- 172.21.15.98:0/4023005338 shutdown_connections 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.004+0000 7f5011494640 1 -- 172.21.15.98:0/4023005338 wait complete. 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.004+0000 7f5011494640 1 Processor -- start 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f5011494640 1 -- start start 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f5011494640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 0x7f500c19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f5011494640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f500c10be40 con 0x7f500c1078e0 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f500affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 0x7f500c19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f500affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 0x7f500c19b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35206/0 (socket says 172.21.15.98:35206) 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f500affd640 1 -- 172.21.15.98:0/596460829 learned_addr learned my addr 172.21.15.98:0/596460829 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f500affd640 1 -- 172.21.15.98:0/596460829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c19bd90 con 0x7f500c1078e0 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f500affd640 1 --2- 172.21.15.98:0/596460829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 0x7f500c19b850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009940 tx=0x7f4ffc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f4ff3fff640 1 -- 172.21.15.98:0/596460829 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc042070 con 0x7f500c1078e0 2024-09-19T07:13:19.765 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f5011494640 1 -- 172.21.15.98:0/596460829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500c19c020 con 0x7f500c1078e0 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f4ff3fff640 1 -- 172.21.15.98:0/596460829 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4ffc0308c0 con 0x7f500c1078e0 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f4ff3fff640 1 -- 172.21.15.98:0/596460829 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ffc037040 con 0x7f500c1078e0 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.005+0000 7f5011494640 1 -- 172.21.15.98:0/596460829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f500c19ed10 con 0x7f500c1078e0 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.006+0000 7f4ff3fff640 1 -- 172.21.15.98:0/596460829 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4ffc045070 con 0x7f500c1078e0 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.006+0000 7f4ff3fff640 1 --2- 172.21.15.98:0/596460829 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ff40391b0 0x7f4ff403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.006+0000 7f5011494640 1 -- 172.21.15.98:0/596460829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500c107d60 con 0x7f500c1078e0 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.006+0000 7f4ff3fff640 1 -- 172.21.15.98:0/596460829 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4ffc06c380 con 0x7f500c1078e0 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.007+0000 7f500a7fc640 1 --2- 172.21.15.98:0/596460829 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ff40391b0 0x7f4ff403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.007+0000 7f500a7fc640 1 --2- 172.21.15.98:0/596460829 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ff40391b0 0x7f4ff403b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f50000098c0 tx=0x7f5000006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.011+0000 7f4ff3fff640 1 -- 172.21.15.98:0/596460829 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ffc03cd90 con 0x7f500c1078e0 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.179+0000 7f5011494640 1 -- 172.21.15.98:0/596460829 --> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f500c104340 con 0x7f4ff40391b0 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.180+0000 7f4ff3fff640 1 -- 172.21.15.98:0/596460829 <== mgr.14118 v2:172.21.15.98:6800/4041153215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f500c104340 con 0x7f4ff40391b0 2024-09-19T07:13:19.766 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.183+0000 7f5011494640 1 -- 172.21.15.98:0/596460829 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ff40391b0 msgr2=0x7f4ff403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:19.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.183+0000 7f5011494640 1 --2- 172.21.15.98:0/596460829 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ff40391b0 0x7f4ff403b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f50000098c0 tx=0x7f5000006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:19.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.183+0000 7f5011494640 1 -- 172.21.15.98:0/596460829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 msgr2=0x7f500c19b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:19.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.183+0000 7f5011494640 1 --2- 172.21.15.98:0/596460829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 0x7f500c19b850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009940 tx=0x7f4ffc032ce0 comp rx=0 tx=0).stop 2024-09-19T07:13:19.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.183+0000 7f5011494640 1 -- 172.21.15.98:0/596460829 shutdown_connections 2024-09-19T07:13:19.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.183+0000 7f5011494640 1 --2- 172.21.15.98:0/596460829 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ff40391b0 0x7f4ff403b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:19.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.183+0000 7f5011494640 1 --2- 172.21.15.98:0/596460829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f500c1078e0 0x7f500c19b850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:19.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.183+0000 7f5011494640 1 -- 172.21.15.98:0/596460829 >> 172.21.15.98:0/596460829 conn(0x7f500c103070 msgr2=0x7f500c103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:19.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.183+0000 7f5011494640 1 -- 172.21.15.98:0/596460829 shutdown_connections 2024-09-19T07:13:19.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:19.183+0000 7f5011494640 1 -- 172.21.15.98:0/596460829 wait complete. 2024-09-19T07:13:19.767 INFO:teuthology.orchestra.run.smithi098.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:13:19.767 INFO:teuthology.orchestra.run.smithi098.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T07:13:19.768 INFO:teuthology.orchestra.run.smithi098.stdout:Adding host smithi098... 2024-09-19T07:13:20.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:20 smithi098 ceph-mon[30950]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:13:21.364 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:21 smithi098 ceph-mon[30950]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "addr": "172.21.15.98", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:13:21.364 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:21 smithi098 ceph-mon[30950]: Deploying cephadm binary to smithi098 2024-09-19T07:13:24.054 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Added host 'smithi098' with addr '172.21.15.98' 2024-09-19T07:13:24.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.162+0000 7f5490848640 1 Processor -- start 2024-09-19T07:13:24.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.162+0000 7f5490848640 1 -- start start 2024-09-19T07:13:24.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.162+0000 7f5490848640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 0x7f548c106c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:24.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.162+0000 7f5490848640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f548c1071e0 con 0x7f548c106810 2024-09-19T07:13:24.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.163+0000 7f548a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 0x7f548c106c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:24.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.163+0000 7f548a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 0x7f548c106c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35212/0 (socket says 172.21.15.98:35212) 2024-09-19T07:13:24.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.163+0000 7f548a59c640 1 -- 172.21.15.98:0/157185731 learned_addr learned my addr 172.21.15.98:0/157185731 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:24.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.163+0000 7f548a59c640 1 -- 172.21.15.98:0/157185731 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c107a10 con 0x7f548c106810 2024-09-19T07:13:24.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.164+0000 7f548a59c640 1 --2- 172.21.15.98:0/157185731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 0x7f548c106c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f547c009e80 tx=0x7f547c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b675660751281d04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:24.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.164+0000 7f548959a640 1 -- 172.21.15.98:0/157185731 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547c036070 con 0x7f548c106810 2024-09-19T07:13:24.055 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.164+0000 7f548959a640 1 -- 172.21.15.98:0/157185731 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f547c0318c0 con 0x7f548c106810 2024-09-19T07:13:24.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.164+0000 7f548959a640 1 -- 172.21.15.98:0/157185731 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547c007ab0 con 0x7f548c106810 2024-09-19T07:13:24.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.164+0000 7f5490848640 1 -- 172.21.15.98:0/157185731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 msgr2=0x7f548c106c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:24.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.164+0000 7f5490848640 1 --2- 172.21.15.98:0/157185731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 0x7f548c106c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f547c009e80 tx=0x7f547c02a7a0 comp rx=0 tx=0).stop 2024-09-19T07:13:24.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.164+0000 7f5490848640 1 -- 172.21.15.98:0/157185731 shutdown_connections 2024-09-19T07:13:24.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.164+0000 7f5490848640 1 --2- 172.21.15.98:0/157185731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 0x7f548c106c10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:24.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.164+0000 7f5490848640 1 -- 172.21.15.98:0/157185731 >> 172.21.15.98:0/157185731 conn(0x7f548c101fc0 msgr2=0x7f548c1043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:24.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.164+0000 7f5490848640 1 -- 172.21.15.98:0/157185731 shutdown_connections 2024-09-19T07:13:24.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.164+0000 7f5490848640 1 -- 172.21.15.98:0/157185731 wait complete. 2024-09-19T07:13:24.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.165+0000 7f5490848640 1 Processor -- start 2024-09-19T07:13:24.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.165+0000 7f5490848640 1 -- start start 2024-09-19T07:13:24.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.165+0000 7f5490848640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 0x7f548c19bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:24.056 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.165+0000 7f5490848640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f548c10adc0 con 0x7f548c106810 2024-09-19T07:13:24.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.165+0000 7f548a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 0x7f548c19bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:24.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.165+0000 7f548a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 0x7f548c19bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35226/0 (socket says 172.21.15.98:35226) 2024-09-19T07:13:24.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.165+0000 7f548a59c640 1 -- 172.21.15.98:0/2397169259 learned_addr learned my addr 172.21.15.98:0/2397169259 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:24.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.166+0000 7f548a59c640 1 -- 172.21.15.98:0/2397169259 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548c19c150 con 0x7f548c106810 2024-09-19T07:13:24.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.166+0000 7f548a59c640 1 --2- 172.21.15.98:0/2397169259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 0x7f548c19bc10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f547c02acc0 tx=0x7f547c031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:24.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.166+0000 7f547b7fe640 1 -- 172.21.15.98:0/2397169259 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547c036050 con 0x7f548c106810 2024-09-19T07:13:24.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.166+0000 7f5490848640 1 -- 172.21.15.98:0/2397169259 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548c19c3e0 con 0x7f548c106810 2024-09-19T07:13:24.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.166+0000 7f547b7fe640 1 -- 172.21.15.98:0/2397169259 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f547c037040 con 0x7f548c106810 2024-09-19T07:13:24.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.166+0000 7f547b7fe640 1 -- 172.21.15.98:0/2397169259 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f547c03d890 con 0x7f548c106810 2024-09-19T07:13:24.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.166+0000 7f5490848640 1 -- 172.21.15.98:0/2397169259 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548c19f0d0 con 0x7f548c106810 2024-09-19T07:13:24.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.167+0000 7f547b7fe640 1 -- 172.21.15.98:0/2397169259 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f547c044020 con 0x7f548c106810 2024-09-19T07:13:24.057 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.167+0000 7f5490848640 1 -- 172.21.15.98:0/2397169259 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f548c106c90 con 0x7f548c106810 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.167+0000 7f547b7fe640 1 --2- 172.21.15.98:0/2397169259 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f54740391b0 0x7f547403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.167+0000 7f547b7fe640 1 -- 172.21.15.98:0/2397169259 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f547c042020 con 0x7f548c106810 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.167+0000 7f5489d9b640 1 --2- 172.21.15.98:0/2397169259 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f54740391b0 0x7f547403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.168+0000 7f5489d9b640 1 --2- 172.21.15.98:0/2397169259 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f54740391b0 0x7f547403b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f54800098c0 tx=0x7f5480006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.172+0000 7f547b7fe640 1 -- 172.21.15.98:0/2397169259 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f547c04b020 con 0x7f548c106810 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:20.345+0000 7f5490848640 1 -- 172.21.15.98:0/2397169259 --> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi098", "addr": "172.21.15.98", "target": ["mon-mgr", ""]}) -- 0x7f548c074ca0 con 0x7f54740391b0 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:23.482+0000 7f547b7fe640 1 -- 172.21.15.98:0/2397169259 <== mgr.14118 v2:172.21.15.98:6800/4041153215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f548c074ca0 con 0x7f54740391b0 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:23.485+0000 7f5490848640 1 -- 172.21.15.98:0/2397169259 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f54740391b0 msgr2=0x7f547403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:23.485+0000 7f5490848640 1 --2- 172.21.15.98:0/2397169259 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f54740391b0 0x7f547403b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f54800098c0 tx=0x7f5480006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:23.485+0000 7f5490848640 1 -- 172.21.15.98:0/2397169259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 msgr2=0x7f548c19bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:23.485+0000 7f5490848640 1 --2- 172.21.15.98:0/2397169259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 0x7f548c19bc10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f547c02acc0 tx=0x7f547c031ca0 comp rx=0 tx=0).stop 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:23.485+0000 7f5490848640 1 -- 172.21.15.98:0/2397169259 shutdown_connections 2024-09-19T07:13:24.058 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:23.485+0000 7f5490848640 1 --2- 172.21.15.98:0/2397169259 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f54740391b0 0x7f547403b670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:24.059 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:23.485+0000 7f5490848640 1 --2- 172.21.15.98:0/2397169259 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f548c106810 0x7f548c19bc10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:24.059 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:23.485+0000 7f5490848640 1 -- 172.21.15.98:0/2397169259 >> 172.21.15.98:0/2397169259 conn(0x7f548c101fc0 msgr2=0x7f548c102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:24.059 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:23.485+0000 7f5490848640 1 -- 172.21.15.98:0/2397169259 shutdown_connections 2024-09-19T07:13:24.059 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:23.485+0000 7f5490848640 1 -- 172.21.15.98:0/2397169259 wait complete. 2024-09-19T07:13:24.059 INFO:teuthology.orchestra.run.smithi098.stdout:Deploying unmanaged mon service... 2024-09-19T07:13:24.760 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:24 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:24.760 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:24 smithi098 ceph-mon[30950]: Added host smithi098 2024-09-19T07:13:24.760 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:24 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:25.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T07:13:25.341 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.564+0000 7f2308141640 1 Processor -- start 2024-09-19T07:13:25.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.564+0000 7f2308141640 1 -- start start 2024-09-19T07:13:25.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.565+0000 7f2308141640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 0x7f2300106b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:25.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.565+0000 7f2308141640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2300107150 con 0x7f2300106780 2024-09-19T07:13:25.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.565+0000 7f2305edd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 0x7f2300106b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:25.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.565+0000 7f2305edd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 0x7f2300106b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48862/0 (socket says 172.21.15.98:48862) 2024-09-19T07:13:25.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.565+0000 7f2305edd640 1 -- 172.21.15.98:0/2892387085 learned_addr learned my addr 172.21.15.98:0/2892387085 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:25.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.565+0000 7f2305edd640 1 -- 172.21.15.98:0/2892387085 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2300107980 con 0x7f2300106780 2024-09-19T07:13:25.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.566+0000 7f2305edd640 1 --2- 172.21.15.98:0/2892387085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 0x7f2300106b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009820 tx=0x7f22fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3163cb425b7d10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:25.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.566+0000 7f2304edb640 1 -- 172.21.15.98:0/2892387085 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22fc037070 con 0x7f2300106780 2024-09-19T07:13:25.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.566+0000 7f2304edb640 1 -- 172.21.15.98:0/2892387085 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f22fc032900 con 0x7f2300106780 2024-09-19T07:13:25.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.566+0000 7f2304edb640 1 -- 172.21.15.98:0/2892387085 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22fc030850 con 0x7f2300106780 2024-09-19T07:13:25.342 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.566+0000 7f2308141640 1 -- 172.21.15.98:0/2892387085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 msgr2=0x7f2300106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.566+0000 7f2308141640 1 --2- 172.21.15.98:0/2892387085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 0x7f2300106b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009820 tx=0x7f22fc02a270 comp rx=0 tx=0).stop 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.566+0000 7f2308141640 1 -- 172.21.15.98:0/2892387085 shutdown_connections 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.567+0000 7f2308141640 1 --2- 172.21.15.98:0/2892387085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 0x7f2300106b80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.567+0000 7f2308141640 1 -- 172.21.15.98:0/2892387085 >> 172.21.15.98:0/2892387085 conn(0x7f2300101f10 msgr2=0x7f2300104350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.567+0000 7f2308141640 1 -- 172.21.15.98:0/2892387085 shutdown_connections 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.567+0000 7f2308141640 1 -- 172.21.15.98:0/2892387085 wait complete. 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.567+0000 7f2308141640 1 Processor -- start 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.567+0000 7f2308141640 1 -- start start 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.567+0000 7f2308141640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 0x7f230019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.567+0000 7f2308141640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f230010ad30 con 0x7f2300106780 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.567+0000 7f2305edd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 0x7f230019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.568+0000 7f2305edd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 0x7f230019b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48866/0 (socket says 172.21.15.98:48866) 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.568+0000 7f2305edd640 1 -- 172.21.15.98:0/1638459833 learned_addr learned my addr 172.21.15.98:0/1638459833 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:25.343 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.568+0000 7f2305edd640 1 -- 172.21.15.98:0/1638459833 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f230019be10 con 0x7f2300106780 2024-09-19T07:13:25.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.568+0000 7f2305edd640 1 --2- 172.21.15.98:0/1638459833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 0x7f230019b8d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009940 tx=0x7f22fc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:25.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.568+0000 7f22f6ffd640 1 -- 172.21.15.98:0/1638459833 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22fc042070 con 0x7f2300106780 2024-09-19T07:13:25.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.568+0000 7f22f6ffd640 1 -- 172.21.15.98:0/1638459833 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f22fc0308c0 con 0x7f2300106780 2024-09-19T07:13:25.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.568+0000 7f2308141640 1 -- 172.21.15.98:0/1638459833 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f230019c0a0 con 0x7f2300106780 2024-09-19T07:13:25.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.568+0000 7f22f6ffd640 1 -- 172.21.15.98:0/1638459833 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22fc037040 con 0x7f2300106780 2024-09-19T07:13:25.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.568+0000 7f2308141640 1 -- 172.21.15.98:0/1638459833 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f230019ed90 con 0x7f2300106780 2024-09-19T07:13:25.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.569+0000 7f22f6ffd640 1 -- 172.21.15.98:0/1638459833 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f22fc045070 con 0x7f2300106780 2024-09-19T07:13:25.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.569+0000 7f22f6ffd640 1 --2- 172.21.15.98:0/1638459833 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f22ec039200 0x7f22ec03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:25.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.569+0000 7f22f6ffd640 1 -- 172.21.15.98:0/1638459833 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f22fc06c310 con 0x7f2300106780 2024-09-19T07:13:25.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.569+0000 7f23056dc640 1 --2- 172.21.15.98:0/1638459833 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f22ec039200 0x7f22ec03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:25.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.569+0000 7f2308141640 1 -- 172.21.15.98:0/1638459833 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2300106c00 con 0x7f2300106780 2024-09-19T07:13:25.344 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.570+0000 7f23056dc640 1 --2- 172.21.15.98:0/1638459833 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f22ec039200 0x7f22ec03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f22f00098c0 tx=0x7f22f0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.574+0000 7f22f6ffd640 1 -- 172.21.15.98:0/1638459833 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f22fc045360 con 0x7f2300106780 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.759+0000 7f2308141640 1 -- 172.21.15.98:0/1638459833 --> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f230002daa0 con 0x7f22ec039200 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.764+0000 7f22f6ffd640 1 -- 172.21.15.98:0/1638459833 <== mgr.14118 v2:172.21.15.98:6800/4041153215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f230002daa0 con 0x7f22ec039200 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.767+0000 7f2308141640 1 -- 172.21.15.98:0/1638459833 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f22ec039200 msgr2=0x7f22ec03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.767+0000 7f2308141640 1 --2- 172.21.15.98:0/1638459833 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f22ec039200 0x7f22ec03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f22f00098c0 tx=0x7f22f0006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.767+0000 7f2308141640 1 -- 172.21.15.98:0/1638459833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 msgr2=0x7f230019b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.767+0000 7f2308141640 1 --2- 172.21.15.98:0/1638459833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 0x7f230019b8d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009940 tx=0x7f22fc032ce0 comp rx=0 tx=0).stop 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.767+0000 7f2308141640 1 -- 172.21.15.98:0/1638459833 shutdown_connections 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.767+0000 7f2308141640 1 --2- 172.21.15.98:0/1638459833 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f22ec039200 0x7f22ec03b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.767+0000 7f2308141640 1 --2- 172.21.15.98:0/1638459833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2300106780 0x7f230019b8d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.767+0000 7f2308141640 1 -- 172.21.15.98:0/1638459833 >> 172.21.15.98:0/1638459833 conn(0x7f2300101f10 msgr2=0x7f2300102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.767+0000 7f2308141640 1 -- 172.21.15.98:0/1638459833 shutdown_connections 2024-09-19T07:13:25.345 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:24.767+0000 7f2308141640 1 -- 172.21.15.98:0/1638459833 wait complete. 2024-09-19T07:13:25.346 INFO:teuthology.orchestra.run.smithi098.stdout:Deploying unmanaged mgr service... 2024-09-19T07:13:25.919 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:25 smithi098 ceph-mon[30950]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:13:25.920 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:25 smithi098 ceph-mon[30950]: Saving service mon spec with placement count:5 2024-09-19T07:13:25.920 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:25 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:26.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T07:13:26.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.734+0000 7f6bb4f0d640 1 Processor -- start 2024-09-19T07:13:26.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.734+0000 7f6bb4f0d640 1 -- start start 2024-09-19T07:13:26.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.734+0000 7f6bb4f0d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 0x7f6bb007c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.734+0000 7f6bb4f0d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb007c890 con 0x7f6bb007de60 2024-09-19T07:13:26.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.734+0000 7f6bae59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 0x7f6bb007c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.767 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.734+0000 7f6bae59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 0x7f6bb007c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48882/0 (socket says 172.21.15.98:48882) 2024-09-19T07:13:26.768 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.734+0000 7f6bae59c640 1 -- 172.21.15.98:0/3341558025 learned_addr learned my addr 172.21.15.98:0/3341558025 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:26.768 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.734+0000 7f6bae59c640 1 -- 172.21.15.98:0/3341558025 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb007ca10 con 0x7f6bb007de60 2024-09-19T07:13:26.768 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.735+0000 7f6bae59c640 1 --2- 172.21.15.98:0/3341558025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 0x7f6bb007c2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009820 tx=0x7f6ba002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f7cdd11ff4178e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:26.768 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.735+0000 7f6badd9b640 1 -- 172.21.15.98:0/3341558025 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0037070 con 0x7f6bb007de60 2024-09-19T07:13:26.768 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.735+0000 7f6badd9b640 1 -- 172.21.15.98:0/3341558025 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ba0032900 con 0x7f6bb007de60 2024-09-19T07:13:26.768 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.735+0000 7f6badd9b640 1 -- 172.21.15.98:0/3341558025 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0030850 con 0x7f6bb007de60 2024-09-19T07:13:26.768 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.736+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3341558025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 msgr2=0x7f6bb007c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:26.768 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.736+0000 7f6bb4f0d640 1 --2- 172.21.15.98:0/3341558025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 0x7f6bb007c2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009820 tx=0x7f6ba002a270 comp rx=0 tx=0).stop 2024-09-19T07:13:26.768 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.736+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3341558025 shutdown_connections 2024-09-19T07:13:26.768 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.736+0000 7f6bb4f0d640 1 --2- 172.21.15.98:0/3341558025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 0x7f6bb007c2c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.768 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.736+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3341558025 >> 172.21.15.98:0/3341558025 conn(0x7f6bb01030b0 msgr2=0x7f6bb01054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:26.768 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.736+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3341558025 shutdown_connections 2024-09-19T07:13:26.769 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.736+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3341558025 wait complete. 2024-09-19T07:13:26.769 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.737+0000 7f6bb4f0d640 1 Processor -- start 2024-09-19T07:13:26.769 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.737+0000 7f6bb4f0d640 1 -- start start 2024-09-19T07:13:26.769 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.737+0000 7f6bb4f0d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 0x7f6bb019da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.769 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.737+0000 7f6bb4f0d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb010ded0 con 0x7f6bb007de60 2024-09-19T07:13:26.769 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.737+0000 7f6bae59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 0x7f6bb019da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.769 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.737+0000 7f6bae59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 0x7f6bb019da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48886/0 (socket says 172.21.15.98:48886) 2024-09-19T07:13:26.769 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.737+0000 7f6bae59c640 1 -- 172.21.15.98:0/3821327037 learned_addr learned my addr 172.21.15.98:0/3821327037 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:26.769 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.737+0000 7f6bae59c640 1 -- 172.21.15.98:0/3821327037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb019dfc0 con 0x7f6bb007de60 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.737+0000 7f6bae59c640 1 --2- 172.21.15.98:0/3821327037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 0x7f6bb019da80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0031000 tx=0x7f6ba00326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.738+0000 7f6ba77fe640 1 -- 172.21.15.98:0/3821327037 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0042070 con 0x7f6bb007de60 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.738+0000 7f6ba77fe640 1 -- 172.21.15.98:0/3821327037 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ba0032be0 con 0x7f6bb007de60 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.738+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3821327037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb019e250 con 0x7f6bb007de60 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.738+0000 7f6ba77fe640 1 -- 172.21.15.98:0/3821327037 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0037040 con 0x7f6bb007de60 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.738+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3821327037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb01a0f40 con 0x7f6bb007de60 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.739+0000 7f6ba77fe640 1 -- 172.21.15.98:0/3821327037 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f6ba0045070 con 0x7f6bb007de60 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.739+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3821327037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb007c340 con 0x7f6bb007de60 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.739+0000 7f6ba77fe640 1 --2- 172.21.15.98:0/3821327037 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f6b9c0391b0 0x7f6b9c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.739+0000 7f6ba77fe640 1 -- 172.21.15.98:0/3821327037 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6ba006c290 con 0x7f6bb007de60 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.739+0000 7f6ba7fff640 1 --2- 172.21.15.98:0/3821327037 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f6b9c0391b0 0x7f6b9c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.739+0000 7f6ba7fff640 1 --2- 172.21.15.98:0/3821327037 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f6b9c0391b0 0x7f6b9c03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6b980098c0 tx=0x7f6b98006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:26.770 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.744+0000 7f6ba77fe640 1 -- 172.21.15.98:0/3821327037 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ba002f2a0 con 0x7f6bb007de60 2024-09-19T07:13:26.771 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.925+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3821327037 --> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f6bb0104350 con 0x7f6b9c0391b0 2024-09-19T07:13:26.771 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.929+0000 7f6ba77fe640 1 -- 172.21.15.98:0/3821327037 <== mgr.14118 v2:172.21.15.98:6800/4041153215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6bb0104350 con 0x7f6b9c0391b0 2024-09-19T07:13:26.771 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.931+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3821327037 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f6b9c0391b0 msgr2=0x7f6b9c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:26.771 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.931+0000 7f6bb4f0d640 1 --2- 172.21.15.98:0/3821327037 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f6b9c0391b0 0x7f6b9c03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6b980098c0 tx=0x7f6b98006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.771 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.931+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3821327037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 msgr2=0x7f6bb019da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:26.771 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.931+0000 7f6bb4f0d640 1 --2- 172.21.15.98:0/3821327037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 0x7f6bb019da80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0031000 tx=0x7f6ba00326e0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.772 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.931+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3821327037 shutdown_connections 2024-09-19T07:13:26.772 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.931+0000 7f6bb4f0d640 1 --2- 172.21.15.98:0/3821327037 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f6b9c0391b0 0x7f6b9c03b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.772 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.931+0000 7f6bb4f0d640 1 --2- 172.21.15.98:0/3821327037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6bb007de60 0x7f6bb019da80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:26.772 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.931+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3821327037 >> 172.21.15.98:0/3821327037 conn(0x7f6bb01030b0 msgr2=0x7f6bb0103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:26.772 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.931+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3821327037 shutdown_connections 2024-09-19T07:13:26.772 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:25.932+0000 7f6bb4f0d640 1 -- 172.21.15.98:0/3821327037 wait complete. 2024-09-19T07:13:26.985 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:26 smithi098 ceph-mon[30950]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:13:26.985 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:26 smithi098 ceph-mon[30950]: Saving service mgr spec with placement count:2 2024-09-19T07:13:26.985 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:26 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:28.398 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.192+0000 7fb9ab719640 1 Processor -- start 2024-09-19T07:13:28.398 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.192+0000 7fb9ab719640 1 -- start start 2024-09-19T07:13:28.398 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.192+0000 7fb9ab719640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 0x7fb9a407c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:28.398 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.192+0000 7fb9ab719640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a407c890 con 0x7fb9a407de60 2024-09-19T07:13:28.398 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.192+0000 7fb9a94b5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 0x7fb9a407c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:28.398 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.192+0000 7fb9a94b5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 0x7fb9a407c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48890/0 (socket says 172.21.15.98:48890) 2024-09-19T07:13:28.399 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.192+0000 7fb9a94b5640 1 -- 172.21.15.98:0/3754591970 learned_addr learned my addr 172.21.15.98:0/3754591970 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:28.399 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.192+0000 7fb9a94b5640 1 -- 172.21.15.98:0/3754591970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a407ca10 con 0x7fb9a407de60 2024-09-19T07:13:28.399 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.193+0000 7fb9a94b5640 1 --2- 172.21.15.98:0/3754591970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 0x7fb9a407c2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009820 tx=0x7fb9a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7251c162e2fc79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:28.399 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.193+0000 7fb99bfff640 1 -- 172.21.15.98:0/3754591970 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a0037070 con 0x7fb9a407de60 2024-09-19T07:13:28.399 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.193+0000 7fb99bfff640 1 -- 172.21.15.98:0/3754591970 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9a0032900 con 0x7fb9a407de60 2024-09-19T07:13:28.399 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.193+0000 7fb99bfff640 1 -- 172.21.15.98:0/3754591970 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a0030850 con 0x7fb9a407de60 2024-09-19T07:13:28.399 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.194+0000 7fb9ab719640 1 -- 172.21.15.98:0/3754591970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 msgr2=0x7fb9a407c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:28.399 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.194+0000 7fb9ab719640 1 --2- 172.21.15.98:0/3754591970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 0x7fb9a407c2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009820 tx=0x7fb9a002a270 comp rx=0 tx=0).stop 2024-09-19T07:13:28.399 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.194+0000 7fb9ab719640 1 -- 172.21.15.98:0/3754591970 shutdown_connections 2024-09-19T07:13:28.399 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.194+0000 7fb9ab719640 1 --2- 172.21.15.98:0/3754591970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 0x7fb9a407c2c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.399 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.194+0000 7fb9ab719640 1 -- 172.21.15.98:0/3754591970 >> 172.21.15.98:0/3754591970 conn(0x7fb9a41030b0 msgr2=0x7fb9a41054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.194+0000 7fb9ab719640 1 -- 172.21.15.98:0/3754591970 shutdown_connections 2024-09-19T07:13:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.194+0000 7fb9ab719640 1 -- 172.21.15.98:0/3754591970 wait complete. 2024-09-19T07:13:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.194+0000 7fb9ab719640 1 Processor -- start 2024-09-19T07:13:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.194+0000 7fb9ab719640 1 -- start start 2024-09-19T07:13:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.195+0000 7fb9ab719640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 0x7fb9a419da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.195+0000 7fb9ab719640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a410ded0 con 0x7fb9a407de60 2024-09-19T07:13:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.195+0000 7fb9a94b5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 0x7fb9a419da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.195+0000 7fb9a94b5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 0x7fb9a419da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48898/0 (socket says 172.21.15.98:48898) 2024-09-19T07:13:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.195+0000 7fb9a94b5640 1 -- 172.21.15.98:0/4061054759 learned_addr learned my addr 172.21.15.98:0/4061054759 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.195+0000 7fb9a94b5640 1 -- 172.21.15.98:0/4061054759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a419dfc0 con 0x7fb9a407de60 2024-09-19T07:13:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.195+0000 7fb9a94b5640 1 --2- 172.21.15.98:0/4061054759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 0x7fb9a419da80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0031000 tx=0x7fb9a00326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:28.400 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.195+0000 7fb99a7fc640 1 -- 172.21.15.98:0/4061054759 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a0042070 con 0x7fb9a407de60 2024-09-19T07:13:28.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.195+0000 7fb9ab719640 1 -- 172.21.15.98:0/4061054759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a419e250 con 0x7fb9a407de60 2024-09-19T07:13:28.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.195+0000 7fb99a7fc640 1 -- 172.21.15.98:0/4061054759 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9a0032be0 con 0x7fb9a407de60 2024-09-19T07:13:28.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.195+0000 7fb99a7fc640 1 -- 172.21.15.98:0/4061054759 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9a0037040 con 0x7fb9a407de60 2024-09-19T07:13:28.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.195+0000 7fb9ab719640 1 -- 172.21.15.98:0/4061054759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a41a0f40 con 0x7fb9a407de60 2024-09-19T07:13:28.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.196+0000 7fb99a7fc640 1 -- 172.21.15.98:0/4061054759 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fb9a0045070 con 0x7fb9a407de60 2024-09-19T07:13:28.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.196+0000 7fb9ab719640 1 -- 172.21.15.98:0/4061054759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a407c340 con 0x7fb9a407de60 2024-09-19T07:13:28.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.196+0000 7fb99a7fc640 1 --2- 172.21.15.98:0/4061054759 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fb9900391b0 0x7fb99003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:28.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.197+0000 7fb99a7fc640 1 -- 172.21.15.98:0/4061054759 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb9a006c280 con 0x7fb9a407de60 2024-09-19T07:13:28.401 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.197+0000 7fb9a8cb4640 1 --2- 172.21.15.98:0/4061054759 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fb9900391b0 0x7fb99003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.197+0000 7fb9a8cb4640 1 --2- 172.21.15.98:0/4061054759 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fb9900391b0 0x7fb99003b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb9940098c0 tx=0x7fb994006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.201+0000 7fb99a7fc640 1 -- 172.21.15.98:0/4061054759 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb9a002f2a0 con 0x7fb9a407de60 2024-09-19T07:13:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.368+0000 7fb9ab719640 1 -- 172.21.15.98:0/4061054759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fb9a41a1580 con 0x7fb9a407de60 2024-09-19T07:13:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.373+0000 7fb99a7fc640 1 -- 172.21.15.98:0/4061054759 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7fb9a0032d90 con 0x7fb9a407de60 2024-09-19T07:13:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.376+0000 7fb9ab719640 1 -- 172.21.15.98:0/4061054759 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fb9900391b0 msgr2=0x7fb99003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.376+0000 7fb9ab719640 1 --2- 172.21.15.98:0/4061054759 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fb9900391b0 0x7fb99003b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb9940098c0 tx=0x7fb994006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.376+0000 7fb9ab719640 1 -- 172.21.15.98:0/4061054759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 msgr2=0x7fb9a419da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.376+0000 7fb9ab719640 1 --2- 172.21.15.98:0/4061054759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 0x7fb9a419da80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0031000 tx=0x7fb9a00326e0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.402 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.376+0000 7fb9ab719640 1 -- 172.21.15.98:0/4061054759 shutdown_connections 2024-09-19T07:13:28.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.376+0000 7fb9ab719640 1 --2- 172.21.15.98:0/4061054759 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7fb9900391b0 0x7fb99003b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.376+0000 7fb9ab719640 1 --2- 172.21.15.98:0/4061054759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9a407de60 0x7fb9a419da80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:28.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.376+0000 7fb9ab719640 1 -- 172.21.15.98:0/4061054759 >> 172.21.15.98:0/4061054759 conn(0x7fb9a41030b0 msgr2=0x7fb9a4103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:28.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.376+0000 7fb9ab719640 1 -- 172.21.15.98:0/4061054759 shutdown_connections 2024-09-19T07:13:28.403 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:27.376+0000 7fb9ab719640 1 -- 172.21.15.98:0/4061054759 wait complete. 2024-09-19T07:13:28.516 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:28 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4061054759' entity='client.admin' 2024-09-19T07:13:28.516 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:28 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:29.637 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:29 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:29.637 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:29 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/637633037' entity='client.admin' 2024-09-19T07:13:30.156 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.893+0000 7f96ce90e640 1 Processor -- start 2024-09-19T07:13:30.156 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.893+0000 7f96ce90e640 1 -- start start 2024-09-19T07:13:30.156 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.893+0000 7f96ce90e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 0x7f96c807c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:30.156 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.893+0000 7f96ce90e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f96c807c8b0 con 0x7f96c807de80 2024-09-19T07:13:30.156 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.893+0000 7f96c7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 0x7f96c807c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:30.156 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.893+0000 7f96c7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 0x7f96c807c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48912/0 (socket says 172.21.15.98:48912) 2024-09-19T07:13:30.156 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.893+0000 7f96c7fff640 1 -- 172.21.15.98:0/3010661003 learned_addr learned my addr 172.21.15.98:0/3010661003 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:30.156 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.893+0000 7f96c7fff640 1 -- 172.21.15.98:0/3010661003 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c807ca30 con 0x7f96c807de80 2024-09-19T07:13:30.157 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.894+0000 7f96c7fff640 1 --2- 172.21.15.98:0/3010661003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 0x7f96c807c2e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009820 tx=0x7f96b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8b8575f1a3565c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:30.157 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.894+0000 7f96c6ffd640 1 -- 172.21.15.98:0/3010661003 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b8037070 con 0x7f96c807de80 2024-09-19T07:13:30.157 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.894+0000 7f96c6ffd640 1 -- 172.21.15.98:0/3010661003 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96b8032920 con 0x7f96c807de80 2024-09-19T07:13:30.157 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.894+0000 7f96c6ffd640 1 -- 172.21.15.98:0/3010661003 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b8030810 con 0x7f96c807de80 2024-09-19T07:13:30.157 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.895+0000 7f96ce90e640 1 -- 172.21.15.98:0/3010661003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 msgr2=0x7f96c807c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:30.157 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.895+0000 7f96ce90e640 1 --2- 172.21.15.98:0/3010661003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 0x7f96c807c2e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009820 tx=0x7f96b802a270 comp rx=0 tx=0).stop 2024-09-19T07:13:30.157 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.895+0000 7f96ce90e640 1 -- 172.21.15.98:0/3010661003 shutdown_connections 2024-09-19T07:13:30.157 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.895+0000 7f96ce90e640 1 --2- 172.21.15.98:0/3010661003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 0x7f96c807c2e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.895+0000 7f96ce90e640 1 -- 172.21.15.98:0/3010661003 >> 172.21.15.98:0/3010661003 conn(0x7f96c81030b0 msgr2=0x7f96c81054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.895+0000 7f96ce90e640 1 -- 172.21.15.98:0/3010661003 shutdown_connections 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.895+0000 7f96ce90e640 1 -- 172.21.15.98:0/3010661003 wait complete. 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.895+0000 7f96ce90e640 1 Processor -- start 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.895+0000 7f96ce90e640 1 -- start start 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.896+0000 7f96ce90e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 0x7f96c819daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.896+0000 7f96ce90e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f96c810df60 con 0x7f96c807de80 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.896+0000 7f96c7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 0x7f96c819daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.896+0000 7f96c7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 0x7f96c819daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48916/0 (socket says 172.21.15.98:48916) 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.896+0000 7f96c7fff640 1 -- 172.21.15.98:0/637633037 learned_addr learned my addr 172.21.15.98:0/637633037 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.896+0000 7f96c7fff640 1 -- 172.21.15.98:0/637633037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c819dfe0 con 0x7f96c807de80 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.896+0000 7f96c7fff640 1 --2- 172.21.15.98:0/637633037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 0x7f96c819daa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f96b80097f0 tx=0x7f96b80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:30.158 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.896+0000 7f96c57fa640 1 -- 172.21.15.98:0/637633037 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b8037040 con 0x7f96c807de80 2024-09-19T07:13:30.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.896+0000 7f96c57fa640 1 -- 172.21.15.98:0/637633037 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96b8030c40 con 0x7f96c807de80 2024-09-19T07:13:30.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.896+0000 7f96c57fa640 1 -- 172.21.15.98:0/637633037 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96b803a5d0 con 0x7f96c807de80 2024-09-19T07:13:30.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.896+0000 7f96ce90e640 1 -- 172.21.15.98:0/637633037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c819e270 con 0x7f96c807de80 2024-09-19T07:13:30.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.897+0000 7f96ce90e640 1 -- 172.21.15.98:0/637633037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c81a0f60 con 0x7f96c807de80 2024-09-19T07:13:30.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.897+0000 7f96c57fa640 1 -- 172.21.15.98:0/637633037 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f96b803a810 con 0x7f96c807de80 2024-09-19T07:13:30.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.897+0000 7f96c57fa640 1 --2- 172.21.15.98:0/637633037 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f96b00391b0 0x7f96b003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:30.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.897+0000 7f96c57fa640 1 -- 172.21.15.98:0/637633037 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f96b806c7a0 con 0x7f96c807de80 2024-09-19T07:13:30.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.898+0000 7f96c77fe640 1 --2- 172.21.15.98:0/637633037 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f96b00391b0 0x7f96b003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:30.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.898+0000 7f96ce90e640 1 -- 172.21.15.98:0/637633037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c807c360 con 0x7f96c807de80 2024-09-19T07:13:30.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.898+0000 7f96c77fe640 1 --2- 172.21.15.98:0/637633037 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f96b00391b0 0x7f96b003b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0098c0 tx=0x7f96bc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:30.159 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:28.902+0000 7f96c57fa640 1 -- 172.21.15.98:0/637633037 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f96b8043d50 con 0x7f96c807de80 2024-09-19T07:13:30.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:29.092+0000 7f96ce90e640 1 -- 172.21.15.98:0/637633037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f96c81a13e0 con 0x7f96c807de80 2024-09-19T07:13:30.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:29.094+0000 7f96c57fa640 1 -- 172.21.15.98:0/637633037 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f96b802c030 con 0x7f96c807de80 2024-09-19T07:13:30.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:29.097+0000 7f96ce90e640 1 -- 172.21.15.98:0/637633037 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f96b00391b0 msgr2=0x7f96b003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:30.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:29.097+0000 7f96ce90e640 1 --2- 172.21.15.98:0/637633037 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f96b00391b0 0x7f96b003b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96bc0098c0 tx=0x7f96bc006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:30.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:29.097+0000 7f96ce90e640 1 -- 172.21.15.98:0/637633037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 msgr2=0x7f96c819daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:30.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:29.097+0000 7f96ce90e640 1 --2- 172.21.15.98:0/637633037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 0x7f96c819daa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f96b80097f0 tx=0x7f96b80327b0 comp rx=0 tx=0).stop 2024-09-19T07:13:30.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:29.097+0000 7f96ce90e640 1 -- 172.21.15.98:0/637633037 shutdown_connections 2024-09-19T07:13:30.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:29.097+0000 7f96ce90e640 1 --2- 172.21.15.98:0/637633037 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f96b00391b0 0x7f96b003b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:30.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:29.097+0000 7f96ce90e640 1 --2- 172.21.15.98:0/637633037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96c807de80 0x7f96c819daa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:30.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:29.097+0000 7f96ce90e640 1 -- 172.21.15.98:0/637633037 >> 172.21.15.98:0/637633037 conn(0x7f96c81030b0 msgr2=0x7f96c8103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:30.160 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:29.097+0000 7f96ce90e640 1 -- 172.21.15.98:0/637633037 shutdown_connections 2024-09-19T07:13:30.161 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:29.097+0000 7f96ce90e640 1 -- 172.21.15.98:0/637633037 wait complete. 2024-09-19T07:13:30.161 INFO:teuthology.orchestra.run.smithi098.stdout:Enabling the dashboard module... 2024-09-19T07:13:32.000 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:31 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:32.001 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:31 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1933467089' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T07:13:32.001 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:31 smithi098 ceph-mon[30950]: from='mgr.14118 172.21.15.98:0/3277730088' entity='mgr.x' 2024-09-19T07:13:32.001 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:31 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: ignoring --setuser ceph since I am not root 2024-09-19T07:13:32.001 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:31 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: ignoring --setgroup ceph since I am not root 2024-09-19T07:13:32.001 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:31 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:31.792+0000 7ffacfe7b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:13:32.001 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:31 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:31.851+0000 7ffacfe7b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:13:32.001 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:32 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:31.999+0000 7ffacfe7b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:13:32.273 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:32 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:32.067+0000 7ffacfe7b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:13:32.273 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:32 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:32.217+0000 7ffacfe7b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:13:32.643 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:32 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:32.356+0000 7ffacfe7b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:13:32.783 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.521+0000 7f5b92507640 1 Processor -- start 2024-09-19T07:13:32.783 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.521+0000 7f5b92507640 1 -- start start 2024-09-19T07:13:32.783 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.521+0000 7f5b92507640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 0x7f5b8c109300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:32.783 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.521+0000 7f5b92507640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c1098d0 con 0x7f5b8c108f00 2024-09-19T07:13:32.784 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.521+0000 7f5b8bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 0x7f5b8c109300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:32.784 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.521+0000 7f5b8bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 0x7f5b8c109300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48926/0 (socket says 172.21.15.98:48926) 2024-09-19T07:13:32.784 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.521+0000 7f5b8bfff640 1 -- 172.21.15.98:0/4234758519 learned_addr learned my addr 172.21.15.98:0/4234758519 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:32.784 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.522+0000 7f5b8bfff640 1 -- 172.21.15.98:0/4234758519 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c109a50 con 0x7f5b8c108f00 2024-09-19T07:13:32.784 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.522+0000 7f5b8bfff640 1 --2- 172.21.15.98:0/4234758519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 0x7f5b8c109300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009820 tx=0x7f5b7c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfd08462661dee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:32.784 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.522+0000 7f5b8affd640 1 -- 172.21.15.98:0/4234758519 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b7c037070 con 0x7f5b8c108f00 2024-09-19T07:13:32.784 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.522+0000 7f5b8affd640 1 -- 172.21.15.98:0/4234758519 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b7c032920 con 0x7f5b8c108f00 2024-09-19T07:13:32.784 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.522+0000 7f5b8affd640 1 -- 172.21.15.98:0/4234758519 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b7c030810 con 0x7f5b8c108f00 2024-09-19T07:13:32.784 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.523+0000 7f5b92507640 1 -- 172.21.15.98:0/4234758519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 msgr2=0x7f5b8c109300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:32.784 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.523+0000 7f5b92507640 1 --2- 172.21.15.98:0/4234758519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 0x7f5b8c109300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009820 tx=0x7f5b7c02a270 comp rx=0 tx=0).stop 2024-09-19T07:13:32.784 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.523+0000 7f5b92507640 1 -- 172.21.15.98:0/4234758519 shutdown_connections 2024-09-19T07:13:32.784 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.523+0000 7f5b92507640 1 --2- 172.21.15.98:0/4234758519 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 0x7f5b8c109300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.523+0000 7f5b92507640 1 -- 172.21.15.98:0/4234758519 >> 172.21.15.98:0/4234758519 conn(0x7f5b8c101790 msgr2=0x7f5b8c103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.523+0000 7f5b92507640 1 -- 172.21.15.98:0/4234758519 shutdown_connections 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.523+0000 7f5b92507640 1 -- 172.21.15.98:0/4234758519 wait complete. 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.524+0000 7f5b92507640 1 Processor -- start 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.524+0000 7f5b92507640 1 -- start start 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.524+0000 7f5b92507640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 0x7f5b8c19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.524+0000 7f5b92507640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c10bed0 con 0x7f5b8c108f00 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.524+0000 7f5b8bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 0x7f5b8c19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.524+0000 7f5b8bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 0x7f5b8c19b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48938/0 (socket says 172.21.15.98:48938) 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.524+0000 7f5b8bfff640 1 -- 172.21.15.98:0/1933467089 learned_addr learned my addr 172.21.15.98:0/1933467089 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.524+0000 7f5b8bfff640 1 -- 172.21.15.98:0/1933467089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c19be20 con 0x7f5b8c108f00 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.525+0000 7f5b8bfff640 1 --2- 172.21.15.98:0/1933467089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 0x7f5b8c19b8e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c030560 tx=0x7f5b7c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:32.785 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.525+0000 7f5b897fa640 1 -- 172.21.15.98:0/1933467089 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b7c037040 con 0x7f5b8c108f00 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.525+0000 7f5b92507640 1 -- 172.21.15.98:0/1933467089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8c19c0b0 con 0x7f5b8c108f00 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.525+0000 7f5b897fa640 1 -- 172.21.15.98:0/1933467089 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b7c040070 con 0x7f5b8c108f00 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.525+0000 7f5b897fa640 1 -- 172.21.15.98:0/1933467089 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b7c03a740 con 0x7f5b8c108f00 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.525+0000 7f5b92507640 1 -- 172.21.15.98:0/1933467089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b8c19eda0 con 0x7f5b8c108f00 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.526+0000 7f5b897fa640 1 -- 172.21.15.98:0/1933467089 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5b7c03a9b0 con 0x7f5b8c108f00 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.526+0000 7f5b92507640 1 -- 172.21.15.98:0/1933467089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8c109380 con 0x7f5b8c108f00 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.526+0000 7f5b897fa640 1 --2- 172.21.15.98:0/1933467089 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f5b740391b0 0x7f5b7403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.526+0000 7f5b897fa640 1 -- 172.21.15.98:0/1933467089 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5b7c06c880 con 0x7f5b8c108f00 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.526+0000 7f5b8b7fe640 1 --2- 172.21.15.98:0/1933467089 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f5b740391b0 0x7f5b7403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.527+0000 7f5b8b7fe640 1 --2- 172.21.15.98:0/1933467089 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f5b740391b0 0x7f5b7403b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b800098c0 tx=0x7f5b80006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.531+0000 7f5b897fa640 1 -- 172.21.15.98:0/1933467089 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b7c031e80 con 0x7f5b8c108f00 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:30.750+0000 7f5b92507640 1 -- 172.21.15.98:0/1933467089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f5b8c19f390 con 0x7f5b8c108f00 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:31.642+0000 7f5b897fa640 1 -- 172.21.15.98:0/1933467089 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f5b7c04a200 con 0x7f5b8c108f00 2024-09-19T07:13:32.786 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:31.644+0000 7f5b897fa640 1 -- 172.21.15.98:0/1933467089 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f5b7c03b420 con 0x7f5b8c108f00 2024-09-19T07:13:32.787 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:31.645+0000 7f5b92507640 1 -- 172.21.15.98:0/1933467089 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f5b740391b0 msgr2=0x7f5b7403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:32.787 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:31.645+0000 7f5b92507640 1 --2- 172.21.15.98:0/1933467089 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f5b740391b0 0x7f5b7403b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b800098c0 tx=0x7f5b80006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:32.787 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:31.645+0000 7f5b92507640 1 -- 172.21.15.98:0/1933467089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 msgr2=0x7f5b8c19b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:32.787 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:31.645+0000 7f5b92507640 1 --2- 172.21.15.98:0/1933467089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 0x7f5b8c19b8e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c030560 tx=0x7f5b7c032670 comp rx=0 tx=0).stop 2024-09-19T07:13:32.787 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:31.645+0000 7f5b92507640 1 -- 172.21.15.98:0/1933467089 shutdown_connections 2024-09-19T07:13:32.787 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:31.645+0000 7f5b92507640 1 --2- 172.21.15.98:0/1933467089 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f5b740391b0 0x7f5b7403b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:32.787 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:31.645+0000 7f5b92507640 1 --2- 172.21.15.98:0/1933467089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b8c108f00 0x7f5b8c19b8e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:32.787 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:31.645+0000 7f5b92507640 1 -- 172.21.15.98:0/1933467089 >> 172.21.15.98:0/1933467089 conn(0x7f5b8c101790 msgr2=0x7f5b8c102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:32.787 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:31.645+0000 7f5b92507640 1 -- 172.21.15.98:0/1933467089 shutdown_connections 2024-09-19T07:13:32.787 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:31.645+0000 7f5b92507640 1 -- 172.21.15.98:0/1933467089 wait complete. 2024-09-19T07:13:32.901 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:32 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1933467089' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T07:13:32.901 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:32 smithi098 ceph-mon[30950]: mgrmap e9: x(active, since 18s) 2024-09-19T07:13:32.902 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:32 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:32.673+0000 7ffacfe7b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:13:32.902 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:32 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:32.734+0000 7ffacfe7b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:13:33.179 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:32 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:32.927+0000 7ffacfe7b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:13:33.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:33 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3855935379' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T07:13:34.135 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:33 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:33.850+0000 7ffacfe7b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:13:34.135 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:33 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:33.918+0000 7ffacfe7b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:13:34.143 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:13:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T07:13:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T07:13:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T07:13:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T07:13:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:13:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.190+0000 7f4af5c7b640 1 Processor -- start 2024-09-19T07:13:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.190+0000 7f4af5c7b640 1 -- start start 2024-09-19T07:13:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.191+0000 7f4af5c7b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 0x7f4af010a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.191+0000 7f4af5c7b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4af007be50 con 0x7f4af0108360 2024-09-19T07:13:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.191+0000 7f4aef7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 0x7f4af010a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.191+0000 7f4aef7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 0x7f4af010a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38992/0 (socket says 172.21.15.98:38992) 2024-09-19T07:13:34.144 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.191+0000 7f4aef7fe640 1 -- 172.21.15.98:0/3486906489 learned_addr learned my addr 172.21.15.98:0/3486906489 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.191+0000 7f4aef7fe640 1 -- 172.21.15.98:0/3486906489 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af010ac90 con 0x7f4af0108360 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.192+0000 7f4aef7fe640 1 --2- 172.21.15.98:0/3486906489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 0x7f4af010a750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009820 tx=0x7f4ae002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b980edcc9bd24a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.192+0000 7f4aee7fc640 1 -- 172.21.15.98:0/3486906489 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae0037070 con 0x7f4af0108360 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.192+0000 7f4aee7fc640 1 -- 172.21.15.98:0/3486906489 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae0032920 con 0x7f4af0108360 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.192+0000 7f4aee7fc640 1 -- 172.21.15.98:0/3486906489 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae0030810 con 0x7f4af0108360 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.193+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3486906489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 msgr2=0x7f4af010a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.193+0000 7f4af5c7b640 1 --2- 172.21.15.98:0/3486906489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 0x7f4af010a750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009820 tx=0x7f4ae002a270 comp rx=0 tx=0).stop 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.193+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3486906489 shutdown_connections 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.193+0000 7f4af5c7b640 1 --2- 172.21.15.98:0/3486906489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 0x7f4af010a750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.193+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3486906489 >> 172.21.15.98:0/3486906489 conn(0x7f4af0101f40 msgr2=0x7f4af0104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.193+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3486906489 shutdown_connections 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.193+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3486906489 wait complete. 2024-09-19T07:13:34.145 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.193+0000 7f4af5c7b640 1 Processor -- start 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.194+0000 7f4af5c7b640 1 -- start start 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.194+0000 7f4af5c7b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 0x7f4af0107be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.194+0000 7f4af5c7b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4af010bca0 con 0x7f4af0108360 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.194+0000 7f4aef7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 0x7f4af0107be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.194+0000 7f4aef7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 0x7f4af0107be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:38996/0 (socket says 172.21.15.98:38996) 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.194+0000 7f4aef7fe640 1 -- 172.21.15.98:0/3855935379 learned_addr learned my addr 172.21.15.98:0/3855935379 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.194+0000 7f4aef7fe640 1 -- 172.21.15.98:0/3855935379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af0108120 con 0x7f4af0108360 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.194+0000 7f4aef7fe640 1 --2- 172.21.15.98:0/3855935379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 0x7f4af0107be0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0030380 tx=0x7f4ae0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.195+0000 7f4aecff9640 1 -- 172.21.15.98:0/3855935379 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae0037040 con 0x7f4af0108360 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.195+0000 7f4aecff9640 1 -- 172.21.15.98:0/3855935379 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae0040070 con 0x7f4af0108360 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.195+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3855935379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af0106310 con 0x7f4af0108360 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.195+0000 7f4aecff9640 1 -- 172.21.15.98:0/3855935379 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae003a7b0 con 0x7f4af0108360 2024-09-19T07:13:34.146 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.195+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3855935379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af0106850 con 0x7f4af0108360 2024-09-19T07:13:34.147 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.196+0000 7f4aecff9640 1 -- 172.21.15.98:0/3855935379 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f4ae003a9e0 con 0x7f4af0108360 2024-09-19T07:13:34.147 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.196+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3855935379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af01087c0 con 0x7f4af0108360 2024-09-19T07:13:34.147 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.196+0000 7f4aecff9640 1 --2- 172.21.15.98:0/3855935379 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ad8039260 0x7f4ad803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:34.147 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.196+0000 7f4aecff9640 1 -- 172.21.15.98:0/3855935379 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4ae006c8e0 con 0x7f4af0108360 2024-09-19T07:13:34.147 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.196+0000 7f4aeeffd640 1 -- 172.21.15.98:0/3855935379 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ad8039260 msgr2=0x7f4ad803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/4041153215 2024-09-19T07:13:34.147 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.196+0000 7f4aeeffd640 1 --2- 172.21.15.98:0/3855935379 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ad8039260 0x7f4ad803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:13:34.147 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.203+0000 7f4aecff9640 1 -- 172.21.15.98:0/3855935379 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ae0042e30 con 0x7f4af0108360 2024-09-19T07:13:34.147 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.397+0000 7f4aeeffd640 1 -- 172.21.15.98:0/3855935379 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ad8039260 msgr2=0x7f4ad803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/4041153215 2024-09-19T07:13:34.147 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.397+0000 7f4aeeffd640 1 --2- 172.21.15.98:0/3855935379 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ad8039260 0x7f4ad803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:13:34.147 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.423+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3855935379 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f4af0106ad0 con 0x7f4af0108360 2024-09-19T07:13:34.147 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.423+0000 7f4aecff9640 1 -- 172.21.15.98:0/3855935379 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f4ae0043ba0 con 0x7f4af0108360 2024-09-19T07:13:34.147 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.425+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3855935379 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ad8039260 msgr2=0x7f4ad803b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:13:34.148 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.425+0000 7f4af5c7b640 1 --2- 172.21.15.98:0/3855935379 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ad8039260 0x7f4ad803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.148 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.425+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3855935379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 msgr2=0x7f4af0107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:34.148 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.425+0000 7f4af5c7b640 1 --2- 172.21.15.98:0/3855935379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 0x7f4af0107be0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0030380 tx=0x7f4ae0032670 comp rx=0 tx=0).stop 2024-09-19T07:13:34.148 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.426+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3855935379 shutdown_connections 2024-09-19T07:13:34.148 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.426+0000 7f4af5c7b640 1 --2- 172.21.15.98:0/3855935379 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7f4ad8039260 0x7f4ad803b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.148 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.426+0000 7f4af5c7b640 1 --2- 172.21.15.98:0/3855935379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af0108360 0x7f4af0107be0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:34.148 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.426+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3855935379 >> 172.21.15.98:0/3855935379 conn(0x7f4af0101f40 msgr2=0x7f4af0102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:34.148 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.426+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3855935379 shutdown_connections 2024-09-19T07:13:34.148 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:33.426+0000 7f4af5c7b640 1 -- 172.21.15.98:0/3855935379 wait complete. 2024-09-19T07:13:34.149 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for the mgr to restart... 2024-09-19T07:13:34.149 INFO:teuthology.orchestra.run.smithi098.stdout:Waiting for mgr epoch 9... 2024-09-19T07:13:34.765 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:34 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:34.650+0000 7ffacfe7b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:13:34.765 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:34 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:34.765+0000 7ffacfe7b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:13:35.023 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:34 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:34.908+0000 7ffacfe7b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:13:35.023 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:34 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:34.968+0000 7ffacfe7b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:13:35.291 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:35.121+0000 7ffacfe7b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:13:35.291 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:35.191+0000 7ffacfe7b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:13:35.291 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:35.253+0000 7ffacfe7b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:13:35.558 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:35.420+0000 7ffacfe7b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:13:35.558 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:35.488+0000 7ffacfe7b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:13:35.558 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:35.557+0000 7ffacfe7b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:13:35.992 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:35.641+0000 7ffacfe7b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:13:35.992 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:35.703+0000 7ffacfe7b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:13:35.993 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:35.763+0000 7ffacfe7b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:13:37.023 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:36.568+0000 7ffacfe7b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:13:37.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: Active manager daemon x restarted 2024-09-19T07:13:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: Activating manager daemon x 2024-09-19T07:13:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T07:13:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: mgrmap e10: x(active, starting, since 0.00325142s) 2024-09-19T07:13:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:13:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:13:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:13:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:13:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:13:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: Manager daemon x is now available 2024-09-19T07:13:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:13:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:13:38.024 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:37.789+0000 7ffa3b18f640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:07:13:37] ENGINE Error in HTTPServer.serve 2024-09-19T07:13:38.024 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: Traceback (most recent call last): 2024-09-19T07:13:38.024 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:13:38.024 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: self._connections.run(self.expiration_interval) 2024-09-19T07:13:38.024 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:13:38.024 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: self._run(expiration_interval) 2024-09-19T07:13:38.025 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:13:38.025 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:13:38.025 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:13:38.025 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:13:38.025 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:13:38.025 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: s = self.context.wrap_socket( 2024-09-19T07:13:38.025 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:13:38.025 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: return self.sslsocket_class._create( 2024-09-19T07:13:38.025 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:13:38.025 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: self.do_handshake() 2024-09-19T07:13:38.026 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:13:38.026 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: self._sslobj.do_handshake() 2024-09-19T07:13:38.026 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:13:38.026 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:13:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:13:38.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout { 2024-09-19T07:13:38.445 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T07:13:38.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T07:13:38.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout } 2024-09-19T07:13:38.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.582+0000 7ffadbd74640 1 Processor -- start 2024-09-19T07:13:38.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.583+0000 7ffadbd74640 1 -- start start 2024-09-19T07:13:38.446 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.583+0000 7ffadbd74640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 0x7ffad41065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.583+0000 7ffadbd74640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffad407bdf0 con 0x7ffad41061b0 2024-09-19T07:13:38.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.583+0000 7ffad9b10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 0x7ffad41065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.583+0000 7ffad9b10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 0x7ffad41065b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39002/0 (socket says 172.21.15.98:39002) 2024-09-19T07:13:38.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.583+0000 7ffad9b10640 1 -- 172.21.15.98:0/3395165724 learned_addr learned my addr 172.21.15.98:0/3395165724 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:38.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.583+0000 7ffad9b10640 1 -- 172.21.15.98:0/3395165724 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad4106af0 con 0x7ffad41061b0 2024-09-19T07:13:38.447 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.584+0000 7ffad9b10640 1 --2- 172.21.15.98:0/3395165724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 0x7ffad41065b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009820 tx=0x7ffad002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10149b4bb16cd878 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:38.448 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.584+0000 7ffad8b0e640 1 -- 172.21.15.98:0/3395165724 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffad0037070 con 0x7ffad41061b0 2024-09-19T07:13:38.448 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.584+0000 7ffad8b0e640 1 -- 172.21.15.98:0/3395165724 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffad0032920 con 0x7ffad41061b0 2024-09-19T07:13:38.448 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.584+0000 7ffad8b0e640 1 -- 172.21.15.98:0/3395165724 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffad0030810 con 0x7ffad41061b0 2024-09-19T07:13:38.448 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.585+0000 7ffadbd74640 1 -- 172.21.15.98:0/3395165724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 msgr2=0x7ffad41065b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:38.448 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.585+0000 7ffadbd74640 1 --2- 172.21.15.98:0/3395165724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 0x7ffad41065b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009820 tx=0x7ffad002a270 comp rx=0 tx=0).stop 2024-09-19T07:13:38.449 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.585+0000 7ffadbd74640 1 -- 172.21.15.98:0/3395165724 shutdown_connections 2024-09-19T07:13:38.449 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.585+0000 7ffadbd74640 1 --2- 172.21.15.98:0/3395165724 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 0x7ffad41065b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.449 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.585+0000 7ffadbd74640 1 -- 172.21.15.98:0/3395165724 >> 172.21.15.98:0/3395165724 conn(0x7ffad4101f40 msgr2=0x7ffad4104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:38.449 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.585+0000 7ffadbd74640 1 -- 172.21.15.98:0/3395165724 shutdown_connections 2024-09-19T07:13:38.449 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.585+0000 7ffadbd74640 1 -- 172.21.15.98:0/3395165724 wait complete. 2024-09-19T07:13:38.449 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.585+0000 7ffadbd74640 1 Processor -- start 2024-09-19T07:13:38.450 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.586+0000 7ffadbd74640 1 -- start start 2024-09-19T07:13:38.450 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.586+0000 7ffadbd74640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 0x7ffad419da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.450 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.586+0000 7ffadbd74640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffad4107bc0 con 0x7ffad41061b0 2024-09-19T07:13:38.450 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.586+0000 7ffad9b10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 0x7ffad419da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.450 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.586+0000 7ffad9b10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 0x7ffad419da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39006/0 (socket says 172.21.15.98:39006) 2024-09-19T07:13:38.451 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.586+0000 7ffad9b10640 1 -- 172.21.15.98:0/1645255885 learned_addr learned my addr 172.21.15.98:0/1645255885 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:38.451 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.586+0000 7ffad9b10640 1 -- 172.21.15.98:0/1645255885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad419dfb0 con 0x7ffad41061b0 2024-09-19T07:13:38.451 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.586+0000 7ffad9b10640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 0x7ffad419da70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffad0030380 tx=0x7ffad0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:38.451 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.586+0000 7ffacaffd640 1 -- 172.21.15.98:0/1645255885 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffad0037040 con 0x7ffad41061b0 2024-09-19T07:13:38.451 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.586+0000 7ffacaffd640 1 -- 172.21.15.98:0/1645255885 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffad0040070 con 0x7ffad41061b0 2024-09-19T07:13:38.451 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.586+0000 7ffadbd74640 1 -- 172.21.15.98:0/1645255885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad419e240 con 0x7ffad41061b0 2024-09-19T07:13:38.452 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.587+0000 7ffadbd74640 1 -- 172.21.15.98:0/1645255885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad41a0f30 con 0x7ffad41061b0 2024-09-19T07:13:38.452 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.587+0000 7ffacaffd640 1 -- 172.21.15.98:0/1645255885 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffad003a7b0 con 0x7ffad41061b0 2024-09-19T07:13:38.452 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.588+0000 7ffacaffd640 1 -- 172.21.15.98:0/1645255885 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7ffad003a9e0 con 0x7ffad41061b0 2024-09-19T07:13:38.452 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.588+0000 7ffacaffd640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7ffac0039260 0x7ffac003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.452 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.588+0000 7ffacaffd640 1 -- 172.21.15.98:0/1645255885 --> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffac003be30 con 0x7ffac0039260 2024-09-19T07:13:38.452 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.588+0000 7ffacaffd640 1 -- 172.21.15.98:0/1645255885 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffad006c8c0 con 0x7ffad41061b0 2024-09-19T07:13:38.453 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.588+0000 7ffad930f640 1 -- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7ffac0039260 msgr2=0x7ffac003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/4041153215 2024-09-19T07:13:38.453 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.588+0000 7ffad930f640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7ffac0039260 0x7ffac003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:13:38.453 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.789+0000 7ffad930f640 1 -- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7ffac0039260 msgr2=0x7ffac003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/4041153215 2024-09-19T07:13:38.453 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:34.789+0000 7ffad930f640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7ffac0039260 0x7ffac003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:13:38.453 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:35.190+0000 7ffad930f640 1 -- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7ffac0039260 msgr2=0x7ffac003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/4041153215 2024-09-19T07:13:38.453 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:35.190+0000 7ffad930f640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7ffac0039260 0x7ffac003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T07:13:38.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:35.991+0000 7ffad930f640 1 -- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7ffac0039260 msgr2=0x7ffac003b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/4041153215 2024-09-19T07:13:38.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:35.991+0000 7ffad930f640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7ffac0039260 0x7ffac003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T07:13:38.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:36.571+0000 7ffacaffd640 1 -- 172.21.15.98:0/1645255885 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7ffad006b370 con 0x7ffad41061b0 2024-09-19T07:13:38.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:36.571+0000 7ffacaffd640 1 -- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7ffac0039260 msgr2=0x7ffac003b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:13:38.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:36.571+0000 7ffacaffd640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7ffac0039260 0x7ffac003b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.572+0000 7ffacaffd640 1 -- 172.21.15.98:0/1645255885 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7ffad006e9f0 con 0x7ffad41061b0 2024-09-19T07:13:38.454 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.572+0000 7ffacaffd640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ffac003cd20 0x7ffac003f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:38.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.572+0000 7ffacaffd640 1 -- 172.21.15.98:0/1645255885 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffad003aec0 con 0x7ffac003cd20 2024-09-19T07:13:38.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.573+0000 7ffad930f640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ffac003cd20 0x7ffac003f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:38.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.574+0000 7ffad930f640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ffac003cd20 0x7ffac003f110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ffac4003980 tx=0x7ffac40092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:38.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.574+0000 7ffacaffd640 1 -- 172.21.15.98:0/1645255885 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ffad003aec0 con 0x7ffac003cd20 2024-09-19T07:13:38.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.581+0000 7ffadbd74640 1 -- 172.21.15.98:0/1645255885 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ffad41065b0 con 0x7ffac003cd20 2024-09-19T07:13:38.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.581+0000 7ffacaffd640 1 -- 172.21.15.98:0/1645255885 <== mgr.14150 v2:172.21.15.98:6800/2172632890 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ffad41065b0 con 0x7ffac003cd20 2024-09-19T07:13:38.455 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.582+0000 7ffadbd74640 1 -- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ffac003cd20 msgr2=0x7ffac003f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:38.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.582+0000 7ffadbd74640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ffac003cd20 0x7ffac003f110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ffac4003980 tx=0x7ffac40092b0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.582+0000 7ffadbd74640 1 -- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 msgr2=0x7ffad419da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:38.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.582+0000 7ffadbd74640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 0x7ffad419da70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffad0030380 tx=0x7ffad0032670 comp rx=0 tx=0).stop 2024-09-19T07:13:38.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.582+0000 7ffadbd74640 1 -- 172.21.15.98:0/1645255885 shutdown_connections 2024-09-19T07:13:38.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.582+0000 7ffadbd74640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ffac003cd20 0x7ffac003f110 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.456 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.582+0000 7ffadbd74640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:6800/4041153215,v1:172.21.15.98:6801/4041153215] conn(0x7ffac0039260 0x7ffac003b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.457 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.582+0000 7ffadbd74640 1 --2- 172.21.15.98:0/1645255885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffad41061b0 0x7ffad419da70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:38.457 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.582+0000 7ffadbd74640 1 -- 172.21.15.98:0/1645255885 >> 172.21.15.98:0/1645255885 conn(0x7ffad4101f40 msgr2=0x7ffad4194750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:38.457 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.582+0000 7ffadbd74640 1 -- 172.21.15.98:0/1645255885 shutdown_connections 2024-09-19T07:13:38.457 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:37.582+0000 7ffadbd74640 1 -- 172.21.15.98:0/1645255885 wait complete. 2024-09-19T07:13:38.457 INFO:teuthology.orchestra.run.smithi098.stdout:mgr epoch 9 is available 2024-09-19T07:13:38.457 INFO:teuthology.orchestra.run.smithi098.stdout:Generating a dashboard self-signed certificate... 2024-09-19T07:13:38.691 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:38 smithi098 ceph-mon[30950]: mgrmap e11: x(active, since 1.0059s) 2024-09-19T07:13:38.692 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:38 smithi098 ceph-mon[30950]: [19/Sep/2024:07:13:37] ENGINE Bus STARTING 2024-09-19T07:13:38.692 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:38 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:39.703 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T07:13:39.703 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.884+0000 7f81eeca0640 1 Processor -- start 2024-09-19T07:13:39.703 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.884+0000 7f81eeca0640 1 -- start start 2024-09-19T07:13:39.703 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.884+0000 7f81eeca0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 0x7f81e8107d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:39.703 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.884+0000 7f81eeca0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f81e81082d0 con 0x7f81e8107900 2024-09-19T07:13:39.703 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.884+0000 7f81eca3c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 0x7f81e8107d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:39.703 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.884+0000 7f81eca3c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 0x7f81e8107d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39052/0 (socket says 172.21.15.98:39052) 2024-09-19T07:13:39.703 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.884+0000 7f81eca3c640 1 -- 172.21.15.98:0/772722776 learned_addr learned my addr 172.21.15.98:0/772722776 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:39.703 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.885+0000 7f81eca3c640 1 -- 172.21.15.98:0/772722776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e8108b00 con 0x7f81e8107900 2024-09-19T07:13:39.703 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.885+0000 7f81eca3c640 1 --2- 172.21.15.98:0/772722776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 0x7f81e8107d00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009820 tx=0x7f81dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e93149fda1da0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:39.703 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.886+0000 7f81e77fe640 1 -- 172.21.15.98:0/772722776 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81dc037070 con 0x7f81e8107900 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.886+0000 7f81e77fe640 1 -- 172.21.15.98:0/772722776 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81dc032920 con 0x7f81e8107900 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.886+0000 7f81e77fe640 1 -- 172.21.15.98:0/772722776 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81dc030810 con 0x7f81e8107900 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.886+0000 7f81eeca0640 1 -- 172.21.15.98:0/772722776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 msgr2=0x7f81e8107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.886+0000 7f81eeca0640 1 --2- 172.21.15.98:0/772722776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 0x7f81e8107d00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009820 tx=0x7f81dc02a270 comp rx=0 tx=0).stop 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.886+0000 7f81eeca0640 1 -- 172.21.15.98:0/772722776 shutdown_connections 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.886+0000 7f81eeca0640 1 --2- 172.21.15.98:0/772722776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 0x7f81e8107d00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.886+0000 7f81eeca0640 1 -- 172.21.15.98:0/772722776 >> 172.21.15.98:0/772722776 conn(0x7f81e81030b0 msgr2=0x7f81e81054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.886+0000 7f81eeca0640 1 -- 172.21.15.98:0/772722776 shutdown_connections 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.886+0000 7f81eeca0640 1 -- 172.21.15.98:0/772722776 wait complete. 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.887+0000 7f81eeca0640 1 Processor -- start 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.887+0000 7f81eeca0640 1 -- start start 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.887+0000 7f81eeca0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 0x7f81e807db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:39.704 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.887+0000 7f81eeca0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f81e810beb0 con 0x7f81e8107900 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.887+0000 7f81eca3c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 0x7f81e807db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.887+0000 7f81eca3c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 0x7f81e807db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39060/0 (socket says 172.21.15.98:39060) 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.887+0000 7f81eca3c640 1 -- 172.21.15.98:0/1177778780 learned_addr learned my addr 172.21.15.98:0/1177778780 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.887+0000 7f81eca3c640 1 -- 172.21.15.98:0/1177778780 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e807e090 con 0x7f81e8107900 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.888+0000 7f81eca3c640 1 --2- 172.21.15.98:0/1177778780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 0x7f81e807db50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0097f0 tx=0x7f81dc0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.888+0000 7f81e5ffb640 1 -- 172.21.15.98:0/1177778780 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81dc037040 con 0x7f81e8107900 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.888+0000 7f81e5ffb640 1 -- 172.21.15.98:0/1177778780 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81dc030c40 con 0x7f81e8107900 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.888+0000 7f81eeca0640 1 -- 172.21.15.98:0/1177778780 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e807c280 con 0x7f81e8107900 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.888+0000 7f81e5ffb640 1 -- 172.21.15.98:0/1177778780 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81dc03a5b0 con 0x7f81e8107900 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.888+0000 7f81eeca0640 1 -- 172.21.15.98:0/1177778780 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e807c7c0 con 0x7f81e8107900 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.889+0000 7f81e5ffb640 1 -- 172.21.15.98:0/1177778780 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f81dc03a7a0 con 0x7f81e8107900 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.889+0000 7f81e5ffb640 1 --2- 172.21.15.98:0/1177778780 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81d8039140 0x7f81d803b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:39.705 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.889+0000 7f81e5ffb640 1 -- 172.21.15.98:0/1177778780 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f81dc06c700 con 0x7f81e8107900 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.889+0000 7f81eeca0640 1 -- 172.21.15.98:0/1177778780 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e8107d80 con 0x7f81e8107900 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.889+0000 7f81e7fff640 1 --2- 172.21.15.98:0/1177778780 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81d8039140 0x7f81d803b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.889+0000 7f81e7fff640 1 --2- 172.21.15.98:0/1177778780 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81d8039140 0x7f81d803b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f81d40098c0 tx=0x7f81d4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:38.894+0000 7f81e5ffb640 1 -- 172.21.15.98:0/1177778780 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f81dc030df0 con 0x7f81e8107900 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.045+0000 7f81e5ffb640 1 -- 172.21.15.98:0/1177778780 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f81dc02fd60 con 0x7f81e8107900 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.075+0000 7f81eeca0640 1 -- 172.21.15.98:0/1177778780 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f81e8104380 con 0x7f81d8039140 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.130+0000 7f81e5ffb640 1 -- 172.21.15.98:0/1177778780 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f81e8104380 con 0x7f81d8039140 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.132+0000 7f81eeca0640 1 -- 172.21.15.98:0/1177778780 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81d8039140 msgr2=0x7f81d803b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.132+0000 7f81eeca0640 1 --2- 172.21.15.98:0/1177778780 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81d8039140 0x7f81d803b600 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f81d40098c0 tx=0x7f81d4006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.132+0000 7f81eeca0640 1 -- 172.21.15.98:0/1177778780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 msgr2=0x7f81e807db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.132+0000 7f81eeca0640 1 --2- 172.21.15.98:0/1177778780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 0x7f81e807db50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0097f0 tx=0x7f81dc0327b0 comp rx=0 tx=0).stop 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.132+0000 7f81eeca0640 1 -- 172.21.15.98:0/1177778780 shutdown_connections 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.132+0000 7f81eeca0640 1 --2- 172.21.15.98:0/1177778780 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81d8039140 0x7f81d803b600 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:39.706 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.132+0000 7f81eeca0640 1 --2- 172.21.15.98:0/1177778780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81e8107900 0x7f81e807db50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:39.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.132+0000 7f81eeca0640 1 -- 172.21.15.98:0/1177778780 >> 172.21.15.98:0/1177778780 conn(0x7f81e81030b0 msgr2=0x7f81e8103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:39.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.132+0000 7f81eeca0640 1 -- 172.21.15.98:0/1177778780 shutdown_connections 2024-09-19T07:13:39.707 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:39.133+0000 7f81eeca0640 1 -- 172.21.15.98:0/1177778780 wait complete. 2024-09-19T07:13:39.707 INFO:teuthology.orchestra.run.smithi098.stdout:Creating initial admin user... 2024-09-19T07:13:39.823 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:39 smithi098 ceph-mon[30950]: [19/Sep/2024:07:13:37] ENGINE Serving on https://172.21.15.98:7150 2024-09-19T07:13:39.823 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:39 smithi098 ceph-mon[30950]: [19/Sep/2024:07:13:37] ENGINE Error in HTTPServer.serve 2024-09-19T07:13:39.823 INFO:journalctl@ceph.mon.a.smithi098.stdout: Traceback (most recent call last): 2024-09-19T07:13:39.823 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:13:39.823 INFO:journalctl@ceph.mon.a.smithi098.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:13:39.823 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:13:39.823 INFO:journalctl@ceph.mon.a.smithi098.stdout: self._run(expiration_interval) 2024-09-19T07:13:39.823 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:13:39.824 INFO:journalctl@ceph.mon.a.smithi098.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:13:39.824 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:13:39.824 INFO:journalctl@ceph.mon.a.smithi098.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:13:39.824 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:13:39.824 INFO:journalctl@ceph.mon.a.smithi098.stdout: s = self.context.wrap_socket( 2024-09-19T07:13:39.824 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:13:39.824 INFO:journalctl@ceph.mon.a.smithi098.stdout: return self.sslsocket_class._create( 2024-09-19T07:13:39.824 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:13:39.824 INFO:journalctl@ceph.mon.a.smithi098.stdout: self.do_handshake() 2024-09-19T07:13:39.825 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:13:39.825 INFO:journalctl@ceph.mon.a.smithi098.stdout: self._sslobj.do_handshake() 2024-09-19T07:13:39.825 INFO:journalctl@ceph.mon.a.smithi098.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:13:39.825 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:39 smithi098 ceph-mon[30950]: [19/Sep/2024:07:13:37] ENGINE Serving on http://172.21.15.98:8765 2024-09-19T07:13:39.825 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:39 smithi098 ceph-mon[30950]: [19/Sep/2024:07:13:37] ENGINE Bus STARTED 2024-09-19T07:13:39.825 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:39.825 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:39 smithi098 ceph-mon[30950]: mgrmap e12: x(active, since 2s) 2024-09-19T07:13:39.825 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:39.825 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:40.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:40 smithi098 ceph-mon[30950]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:13:40.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:40 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:41.856 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:41 smithi098 ceph-mon[30950]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:13:41.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$LDloSbx5wEr9Xo0AfJnbI.HIkwuxIa9duYomyMxkvpW/kKDWyitfC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726730020, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T07:13:41.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.119+0000 7fd51c9a6640 1 Processor -- start 2024-09-19T07:13:41.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.119+0000 7fd51c9a6640 1 -- start start 2024-09-19T07:13:41.863 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.119+0000 7fd51c9a6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 0x7fd518107d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.119+0000 7fd51c9a6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd5181082d0 con 0x7fd518107900 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.119+0000 7fd51659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 0x7fd518107d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.119+0000 7fd51659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 0x7fd518107d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39074/0 (socket says 172.21.15.98:39074) 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.119+0000 7fd51659c640 1 -- 172.21.15.98:0/2774619047 learned_addr learned my addr 172.21.15.98:0/2774619047 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.120+0000 7fd51659c640 1 -- 172.21.15.98:0/2774619047 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd518108b00 con 0x7fd518107900 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.120+0000 7fd51659c640 1 --2- 172.21.15.98:0/2774619047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 0x7fd518107d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd508009820 tx=0x7fd50802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda49f6b0f2ce74b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.121+0000 7fd515d9b640 1 -- 172.21.15.98:0/2774619047 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd508037070 con 0x7fd518107900 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.121+0000 7fd515d9b640 1 -- 172.21.15.98:0/2774619047 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd508032920 con 0x7fd518107900 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.121+0000 7fd515d9b640 1 -- 172.21.15.98:0/2774619047 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd508030810 con 0x7fd518107900 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.121+0000 7fd51c9a6640 1 -- 172.21.15.98:0/2774619047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 msgr2=0x7fd518107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.121+0000 7fd51c9a6640 1 --2- 172.21.15.98:0/2774619047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 0x7fd518107d00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd508009820 tx=0x7fd50802a270 comp rx=0 tx=0).stop 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.121+0000 7fd51c9a6640 1 -- 172.21.15.98:0/2774619047 shutdown_connections 2024-09-19T07:13:41.864 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.121+0000 7fd51c9a6640 1 --2- 172.21.15.98:0/2774619047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 0x7fd518107d00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.121+0000 7fd51c9a6640 1 -- 172.21.15.98:0/2774619047 >> 172.21.15.98:0/2774619047 conn(0x7fd5181030b0 msgr2=0x7fd5181054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.121+0000 7fd51c9a6640 1 -- 172.21.15.98:0/2774619047 shutdown_connections 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.121+0000 7fd51c9a6640 1 -- 172.21.15.98:0/2774619047 wait complete. 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.122+0000 7fd51c9a6640 1 Processor -- start 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.122+0000 7fd51c9a6640 1 -- start start 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.122+0000 7fd51c9a6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 0x7fd51819b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.122+0000 7fd51c9a6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd51810beb0 con 0x7fd518107900 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.122+0000 7fd51659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 0x7fd51819b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.122+0000 7fd51659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 0x7fd51819b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39088/0 (socket says 172.21.15.98:39088) 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.122+0000 7fd51659c640 1 -- 172.21.15.98:0/1476768212 learned_addr learned my addr 172.21.15.98:0/1476768212 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.122+0000 7fd51659c640 1 -- 172.21.15.98:0/1476768212 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51819be00 con 0x7fd518107900 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.123+0000 7fd51659c640 1 --2- 172.21.15.98:0/1476768212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 0x7fd51819b8c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd5080097f0 tx=0x7fd5080327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.123+0000 7fd50f7fe640 1 -- 172.21.15.98:0/1476768212 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd508037040 con 0x7fd518107900 2024-09-19T07:13:41.865 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.123+0000 7fd51c9a6640 1 -- 172.21.15.98:0/1476768212 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd51819c090 con 0x7fd518107900 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.123+0000 7fd50f7fe640 1 -- 172.21.15.98:0/1476768212 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd508030c40 con 0x7fd518107900 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.123+0000 7fd50f7fe640 1 -- 172.21.15.98:0/1476768212 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd50803a5b0 con 0x7fd518107900 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.123+0000 7fd51c9a6640 1 -- 172.21.15.98:0/1476768212 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd51819ed80 con 0x7fd518107900 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.124+0000 7fd50f7fe640 1 -- 172.21.15.98:0/1476768212 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fd50803a7f0 con 0x7fd518107900 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.124+0000 7fd50f7fe640 1 --2- 172.21.15.98:0/1476768212 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd504039200 0x7fd50403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.124+0000 7fd50f7fe640 1 -- 172.21.15.98:0/1476768212 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd50806d800 con 0x7fd518107900 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.124+0000 7fd50ffff640 1 --2- 172.21.15.98:0/1476768212 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd504039200 0x7fd50403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.124+0000 7fd51c9a6640 1 -- 172.21.15.98:0/1476768212 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd518107d80 con 0x7fd518107900 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.124+0000 7fd50ffff640 1 --2- 172.21.15.98:0/1476768212 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd504039200 0x7fd50403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd5000098c0 tx=0x7fd500006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.129+0000 7fd50f7fe640 1 -- 172.21.15.98:0/1476768212 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd508030df0 con 0x7fd518107900 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.323+0000 7fd51c9a6640 1 -- 172.21.15.98:0/1476768212 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fd518104370 con 0x7fd504039200 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.548+0000 7fd50f7fe640 1 -- 172.21.15.98:0/1476768212 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fd518104370 con 0x7fd504039200 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.550+0000 7fd51c9a6640 1 -- 172.21.15.98:0/1476768212 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd504039200 msgr2=0x7fd50403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.866 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.550+0000 7fd51c9a6640 1 --2- 172.21.15.98:0/1476768212 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd504039200 0x7fd50403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd5000098c0 tx=0x7fd500006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.550+0000 7fd51c9a6640 1 -- 172.21.15.98:0/1476768212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 msgr2=0x7fd51819b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:41.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.550+0000 7fd51c9a6640 1 --2- 172.21.15.98:0/1476768212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 0x7fd51819b8c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd5080097f0 tx=0x7fd5080327b0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.550+0000 7fd51c9a6640 1 -- 172.21.15.98:0/1476768212 shutdown_connections 2024-09-19T07:13:41.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.550+0000 7fd51c9a6640 1 --2- 172.21.15.98:0/1476768212 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd504039200 0x7fd50403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.550+0000 7fd51c9a6640 1 --2- 172.21.15.98:0/1476768212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd518107900 0x7fd51819b8c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:41.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.550+0000 7fd51c9a6640 1 -- 172.21.15.98:0/1476768212 >> 172.21.15.98:0/1476768212 conn(0x7fd5181030b0 msgr2=0x7fd518103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:41.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.550+0000 7fd51c9a6640 1 -- 172.21.15.98:0/1476768212 shutdown_connections 2024-09-19T07:13:41.867 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:40.550+0000 7fd51c9a6640 1 -- 172.21.15.98:0/1476768212 wait complete. 2024-09-19T07:13:41.867 INFO:teuthology.orchestra.run.smithi098.stdout:Fetching dashboard port number... 2024-09-19T07:13:42.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:42 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/340431313' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T07:13:43.074 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T07:13:43.074 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.291+0000 7f056deb6640 1 Processor -- start 2024-09-19T07:13:43.074 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.291+0000 7f056deb6640 1 -- start start 2024-09-19T07:13:43.074 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.291+0000 7f056deb6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 0x7f0568107d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:43.074 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.291+0000 7f056deb6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f05681082d0 con 0x7f0568107900 2024-09-19T07:13:43.074 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.292+0000 7f05677fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 0x7f0568107d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:43.074 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.292+0000 7f05677fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 0x7f0568107d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39102/0 (socket says 172.21.15.98:39102) 2024-09-19T07:13:43.074 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.292+0000 7f05677fe640 1 -- 172.21.15.98:0/733252977 learned_addr learned my addr 172.21.15.98:0/733252977 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.292+0000 7f05677fe640 1 -- 172.21.15.98:0/733252977 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0568108b00 con 0x7f0568107900 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.293+0000 7f05677fe640 1 --2- 172.21.15.98:0/733252977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 0x7f0568107d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0558009820 tx=0x7f055802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5956faad5593dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.293+0000 7f05667fc640 1 -- 172.21.15.98:0/733252977 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558037070 con 0x7f0568107900 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.293+0000 7f05667fc640 1 -- 172.21.15.98:0/733252977 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0558032920 con 0x7f0568107900 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.293+0000 7f05667fc640 1 -- 172.21.15.98:0/733252977 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558030810 con 0x7f0568107900 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.293+0000 7f056deb6640 1 -- 172.21.15.98:0/733252977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 msgr2=0x7f0568107d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.293+0000 7f056deb6640 1 --2- 172.21.15.98:0/733252977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 0x7f0568107d00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0558009820 tx=0x7f055802a270 comp rx=0 tx=0).stop 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.293+0000 7f056deb6640 1 -- 172.21.15.98:0/733252977 shutdown_connections 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.293+0000 7f056deb6640 1 --2- 172.21.15.98:0/733252977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 0x7f0568107d00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.293+0000 7f056deb6640 1 -- 172.21.15.98:0/733252977 >> 172.21.15.98:0/733252977 conn(0x7f05681030b0 msgr2=0x7f05681054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.293+0000 7f056deb6640 1 -- 172.21.15.98:0/733252977 shutdown_connections 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.293+0000 7f056deb6640 1 -- 172.21.15.98:0/733252977 wait complete. 2024-09-19T07:13:43.075 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.294+0000 7f056deb6640 1 Processor -- start 2024-09-19T07:13:43.076 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.294+0000 7f056deb6640 1 -- start start 2024-09-19T07:13:43.076 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.294+0000 7f056deb6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 0x7f056819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:43.076 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.294+0000 7f056deb6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f056810beb0 con 0x7f0568107900 2024-09-19T07:13:43.076 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.294+0000 7f05677fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 0x7f056819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:43.076 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.294+0000 7f05677fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 0x7f056819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39114/0 (socket says 172.21.15.98:39114) 2024-09-19T07:13:43.076 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.294+0000 7f05677fe640 1 -- 172.21.15.98:0/340431313 learned_addr learned my addr 172.21.15.98:0/340431313 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:43.076 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.295+0000 7f05677fe640 1 -- 172.21.15.98:0/340431313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056819be20 con 0x7f0568107900 2024-09-19T07:13:43.076 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.295+0000 7f05677fe640 1 --2- 172.21.15.98:0/340431313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 0x7f056819b8e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0558030560 tx=0x7f0558032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:43.076 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.295+0000 7f0564ff9640 1 -- 172.21.15.98:0/340431313 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0558037040 con 0x7f0568107900 2024-09-19T07:13:43.076 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.295+0000 7f0564ff9640 1 -- 172.21.15.98:0/340431313 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0558040070 con 0x7f0568107900 2024-09-19T07:13:43.076 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.295+0000 7f056deb6640 1 -- 172.21.15.98:0/340431313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056819c0b0 con 0x7f0568107900 2024-09-19T07:13:43.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.295+0000 7f0564ff9640 1 -- 172.21.15.98:0/340431313 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f055803a6d0 con 0x7f0568107900 2024-09-19T07:13:43.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.295+0000 7f056deb6640 1 -- 172.21.15.98:0/340431313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f056819eda0 con 0x7f0568107900 2024-09-19T07:13:43.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.296+0000 7f0564ff9640 1 -- 172.21.15.98:0/340431313 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f055803bb20 con 0x7f0568107900 2024-09-19T07:13:43.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.296+0000 7f056deb6640 1 -- 172.21.15.98:0/340431313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0568107d80 con 0x7f0568107900 2024-09-19T07:13:43.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.296+0000 7f0564ff9640 1 --2- 172.21.15.98:0/340431313 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0550039260 0x7f055003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:43.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.296+0000 7f0564ff9640 1 -- 172.21.15.98:0/340431313 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f055806c9e0 con 0x7f0568107900 2024-09-19T07:13:43.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.296+0000 7f0566ffd640 1 --2- 172.21.15.98:0/340431313 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0550039260 0x7f055003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:43.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.297+0000 7f0566ffd640 1 --2- 172.21.15.98:0/340431313 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0550039260 0x7f055003b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f055c0098c0 tx=0x7f055c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:43.077 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.301+0000 7f0564ff9640 1 -- 172.21.15.98:0/340431313 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f05580328f0 con 0x7f0568107900 2024-09-19T07:13:43.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.467+0000 7f056deb6640 1 -- 172.21.15.98:0/340431313 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f056819ef70 con 0x7f0568107900 2024-09-19T07:13:43.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.467+0000 7f0564ff9640 1 -- 172.21.15.98:0/340431313 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f055804a200 con 0x7f0568107900 2024-09-19T07:13:43.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.469+0000 7f056deb6640 1 -- 172.21.15.98:0/340431313 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0550039260 msgr2=0x7f055003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:43.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.469+0000 7f056deb6640 1 --2- 172.21.15.98:0/340431313 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0550039260 0x7f055003b720 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f055c0098c0 tx=0x7f055c006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:43.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.469+0000 7f056deb6640 1 -- 172.21.15.98:0/340431313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 msgr2=0x7f056819b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:43.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.469+0000 7f056deb6640 1 --2- 172.21.15.98:0/340431313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 0x7f056819b8e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0558030560 tx=0x7f0558032670 comp rx=0 tx=0).stop 2024-09-19T07:13:43.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.469+0000 7f056deb6640 1 -- 172.21.15.98:0/340431313 shutdown_connections 2024-09-19T07:13:43.078 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.469+0000 7f056deb6640 1 --2- 172.21.15.98:0/340431313 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0550039260 0x7f055003b720 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:43.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.469+0000 7f056deb6640 1 --2- 172.21.15.98:0/340431313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0568107900 0x7f056819b8e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:43.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.469+0000 7f056deb6640 1 -- 172.21.15.98:0/340431313 >> 172.21.15.98:0/340431313 conn(0x7f05681030b0 msgr2=0x7f0568103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:43.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.469+0000 7f056deb6640 1 -- 172.21.15.98:0/340431313 shutdown_connections 2024-09-19T07:13:43.079 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:42.469+0000 7f056deb6640 1 -- 172.21.15.98:0/340431313 wait complete. 2024-09-19T07:13:43.081 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T07:13:43.081 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout disabled 2024-09-19T07:13:43.088 INFO:teuthology.orchestra.run.smithi098.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T07:13:43.088 INFO:teuthology.orchestra.run.smithi098.stdout:systemctl: stdout inactive 2024-09-19T07:13:43.088 INFO:teuthology.orchestra.run.smithi098.stdout:firewalld.service is not enabled 2024-09-19T07:13:43.088 INFO:teuthology.orchestra.run.smithi098.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T07:13:43.089 INFO:teuthology.orchestra.run.smithi098.stdout:Ceph Dashboard is now available at: 2024-09-19T07:13:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:13:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: URL: https://smithi098.front.sepia.ceph.com:8443/ 2024-09-19T07:13:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: User: admin 2024-09-19T07:13:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: Password: ow6nhsscy6 2024-09-19T07:13:43.090 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:13:43.090 INFO:teuthology.orchestra.run.smithi098.stdout:Saving cluster configuration to /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config directory 2024-09-19T07:13:43.749 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:43 smithi098 ceph-mon[30950]: mgrmap e13: x(active, since 6s) 2024-09-19T07:13:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.480+0000 7f6544e3b640 1 Processor -- start 2024-09-19T07:13:44.315 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.480+0000 7f6544e3b640 1 -- start start 2024-09-19T07:13:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.480+0000 7f6544e3b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 0x7f654010a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.480+0000 7f6544e3b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f654007be30 con 0x7f6540108400 2024-09-19T07:13:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.480+0000 7f653e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 0x7f654010a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.480+0000 7f653e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 0x7f654010a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33382/0 (socket says 172.21.15.98:33382) 2024-09-19T07:13:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.480+0000 7f653e59c640 1 -- 172.21.15.98:0/2182467717 learned_addr learned my addr 172.21.15.98:0/2182467717 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.481+0000 7f653e59c640 1 -- 172.21.15.98:0/2182467717 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654010ad30 con 0x7f6540108400 2024-09-19T07:13:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.481+0000 7f653e59c640 1 --2- 172.21.15.98:0/2182467717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 0x7f654010a7f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6530009820 tx=0x7f653002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b43f9dc8a8469a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.481+0000 7f653dd9b640 1 -- 172.21.15.98:0/2182467717 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6530037070 con 0x7f6540108400 2024-09-19T07:13:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.481+0000 7f653dd9b640 1 -- 172.21.15.98:0/2182467717 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6530032920 con 0x7f6540108400 2024-09-19T07:13:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.481+0000 7f653dd9b640 1 -- 172.21.15.98:0/2182467717 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6530030810 con 0x7f6540108400 2024-09-19T07:13:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.482+0000 7f6544e3b640 1 -- 172.21.15.98:0/2182467717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 msgr2=0x7f654010a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:44.316 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.482+0000 7f6544e3b640 1 --2- 172.21.15.98:0/2182467717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 0x7f654010a7f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6530009820 tx=0x7f653002a270 comp rx=0 tx=0).stop 2024-09-19T07:13:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.482+0000 7f6544e3b640 1 -- 172.21.15.98:0/2182467717 shutdown_connections 2024-09-19T07:13:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.482+0000 7f6544e3b640 1 --2- 172.21.15.98:0/2182467717 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 0x7f654010a7f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.482+0000 7f6544e3b640 1 -- 172.21.15.98:0/2182467717 >> 172.21.15.98:0/2182467717 conn(0x7f6540102020 msgr2=0x7f6540104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.482+0000 7f6544e3b640 1 -- 172.21.15.98:0/2182467717 shutdown_connections 2024-09-19T07:13:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.482+0000 7f6544e3b640 1 -- 172.21.15.98:0/2182467717 wait complete. 2024-09-19T07:13:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.483+0000 7f6544e3b640 1 Processor -- start 2024-09-19T07:13:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.483+0000 7f6544e3b640 1 -- start start 2024-09-19T07:13:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.483+0000 7f6544e3b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 0x7f6540107c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.483+0000 7f6544e3b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f654010bd40 con 0x7f6540108400 2024-09-19T07:13:44.317 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.483+0000 7f653e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 0x7f6540107c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.483+0000 7f653e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 0x7f6540107c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33384/0 (socket says 172.21.15.98:33384) 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.483+0000 7f653e59c640 1 -- 172.21.15.98:0/4140327811 learned_addr learned my addr 172.21.15.98:0/4140327811 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.483+0000 7f653e59c640 1 -- 172.21.15.98:0/4140327811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65401081c0 con 0x7f6540108400 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.483+0000 7f653e59c640 1 --2- 172.21.15.98:0/4140327811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 0x7f6540107c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f65300097f0 tx=0x7f65300327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.484+0000 7f65377fe640 1 -- 172.21.15.98:0/4140327811 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6530037040 con 0x7f6540108400 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.484+0000 7f65377fe640 1 -- 172.21.15.98:0/4140327811 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6530030c40 con 0x7f6540108400 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.484+0000 7f6544e3b640 1 -- 172.21.15.98:0/4140327811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65401063b0 con 0x7f6540108400 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.484+0000 7f65377fe640 1 -- 172.21.15.98:0/4140327811 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f653003a5d0 con 0x7f6540108400 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.484+0000 7f6544e3b640 1 -- 172.21.15.98:0/4140327811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65401068f0 con 0x7f6540108400 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.484+0000 7f65377fe640 1 -- 172.21.15.98:0/4140327811 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f653003a810 con 0x7f6540108400 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.485+0000 7f65377fe640 1 --2- 172.21.15.98:0/4140327811 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f652c0392a0 0x7f652c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.485+0000 7f65377fe640 1 -- 172.21.15.98:0/4140327811 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f653006c9d0 con 0x7f6540108400 2024-09-19T07:13:44.318 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.485+0000 7f6537fff640 1 --2- 172.21.15.98:0/4140327811 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f652c0392a0 0x7f652c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.485+0000 7f6544e3b640 1 -- 172.21.15.98:0/4140327811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6540108860 con 0x7f6540108400 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.485+0000 7f6537fff640 1 --2- 172.21.15.98:0/4140327811 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f652c0392a0 0x7f652c03b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f65280098c0 tx=0x7f6528006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.490+0000 7f65377fe640 1 -- 172.21.15.98:0/4140327811 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6530039950 con 0x7f6540108400 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.748+0000 7f6544e3b640 1 -- 172.21.15.98:0/4140327811 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f6540106f70 con 0x7f6540108400 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.750+0000 7f65377fe640 1 -- 172.21.15.98:0/4140327811 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f65300371e0 con 0x7f6540108400 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.752+0000 7f6544e3b640 1 -- 172.21.15.98:0/4140327811 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f652c0392a0 msgr2=0x7f652c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.752+0000 7f6544e3b640 1 --2- 172.21.15.98:0/4140327811 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f652c0392a0 0x7f652c03b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f65280098c0 tx=0x7f6528006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.752+0000 7f6544e3b640 1 -- 172.21.15.98:0/4140327811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 msgr2=0x7f6540107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.752+0000 7f6544e3b640 1 --2- 172.21.15.98:0/4140327811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 0x7f6540107c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f65300097f0 tx=0x7f65300327b0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.752+0000 7f6544e3b640 1 -- 172.21.15.98:0/4140327811 shutdown_connections 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.752+0000 7f6544e3b640 1 --2- 172.21.15.98:0/4140327811 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f652c0392a0 0x7f652c03b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.752+0000 7f6544e3b640 1 --2- 172.21.15.98:0/4140327811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6540108400 0x7f6540107c80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:44.319 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.752+0000 7f6544e3b640 1 -- 172.21.15.98:0/4140327811 >> 172.21.15.98:0/4140327811 conn(0x7f6540102020 msgr2=0x7f6540102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.753+0000 7f6544e3b640 1 -- 172.21.15.98:0/4140327811 shutdown_connections 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout:/usr/bin/ceph: stderr 2024-09-19T07:13:43.753+0000 7f6544e3b640 1 -- 172.21.15.98:0/4140327811 wait complete. 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout: ceph telemetry on 2024-09-19T07:13:44.320 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:13:44.321 INFO:teuthology.orchestra.run.smithi098.stdout:For more information see: 2024-09-19T07:13:44.321 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:13:44.321 INFO:teuthology.orchestra.run.smithi098.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T07:13:44.321 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:13:44.321 INFO:teuthology.orchestra.run.smithi098.stdout:Bootstrap complete. 2024-09-19T07:13:44.351 INFO:tasks.cephadm:Fetching config... 2024-09-19T07:13:44.351 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:13:44.351 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T07:13:44.367 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T07:13:44.367 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:13:44.368 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T07:13:44.423 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T07:13:44.423 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:13:44.423 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T07:13:44.488 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T07:13:44.489 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:13:44.489 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T07:13:44.544 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T07:13:44.545 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIRoCZnEzALRcM4f65r1oKt75XhVXAeiyyLO90ILUWGXe+f3mF+wc+qhzCCiI8zOJbvL7Acpi1kvgz2VMyHW3MTsMSat4Vo61OHMoNrU7h4fkLRV7qxYEwpRKMpDdVAa3WA6HGioQ4lYMjaEEM0eelUwGLocuaKMHSB1YHMxqBY4YQs1aBWQdL+GU5eH5fYQYbsma+ENKzVtxYhrNeziwCwejPMdX2hYkRT5y1qVB+ZeaOdOiXqcpO2l5NyBHEFEXDfWkQmMjJ5O4FuSxGl2tvi4sFGEFsDF7vWimCC/xDzD+bfndJTNP0s5Og9Ofl+hEZLqwSPuU6prUjgp7zJkqO6TiJzZR2apPByOMwRAF/vZ237hvgqI0IFuLExmrjZeal77KrhF+LBsws4NAOw8kofG18Ot7b6jnH6N8zG02gFy0nC0LUFJHGzgSSqWklu88JQOJ5wpJfZuEjeaetG3xMUJ7GFnH4x9ZW4UXamFn+zO3w1ChR2HepieEozovWO3M= ceph-73438718-7656-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T07:13:44.624 INFO:teuthology.orchestra.run.smithi098.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIRoCZnEzALRcM4f65r1oKt75XhVXAeiyyLO90ILUWGXe+f3mF+wc+qhzCCiI8zOJbvL7Acpi1kvgz2VMyHW3MTsMSat4Vo61OHMoNrU7h4fkLRV7qxYEwpRKMpDdVAa3WA6HGioQ4lYMjaEEM0eelUwGLocuaKMHSB1YHMxqBY4YQs1aBWQdL+GU5eH5fYQYbsma+ENKzVtxYhrNeziwCwejPMdX2hYkRT5y1qVB+ZeaOdOiXqcpO2l5NyBHEFEXDfWkQmMjJ5O4FuSxGl2tvi4sFGEFsDF7vWimCC/xDzD+bfndJTNP0s5Og9Ofl+hEZLqwSPuU6prUjgp7zJkqO6TiJzZR2apPByOMwRAF/vZ237hvgqI0IFuLExmrjZeal77KrhF+LBsws4NAOw8kofG18Ot7b6jnH6N8zG02gFy0nC0LUFJHGzgSSqWklu88JQOJ5wpJfZuEjeaetG3xMUJ7GFnH4x9ZW4UXamFn+zO3w1ChR2HepieEozovWO3M= ceph-73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:13:44.637 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIRoCZnEzALRcM4f65r1oKt75XhVXAeiyyLO90ILUWGXe+f3mF+wc+qhzCCiI8zOJbvL7Acpi1kvgz2VMyHW3MTsMSat4Vo61OHMoNrU7h4fkLRV7qxYEwpRKMpDdVAa3WA6HGioQ4lYMjaEEM0eelUwGLocuaKMHSB1YHMxqBY4YQs1aBWQdL+GU5eH5fYQYbsma+ENKzVtxYhrNeziwCwejPMdX2hYkRT5y1qVB+ZeaOdOiXqcpO2l5NyBHEFEXDfWkQmMjJ5O4FuSxGl2tvi4sFGEFsDF7vWimCC/xDzD+bfndJTNP0s5Og9Ofl+hEZLqwSPuU6prUjgp7zJkqO6TiJzZR2apPByOMwRAF/vZ237hvgqI0IFuLExmrjZeal77KrhF+LBsws4NAOw8kofG18Ot7b6jnH6N8zG02gFy0nC0LUFJHGzgSSqWklu88JQOJ5wpJfZuEjeaetG3xMUJ7GFnH4x9ZW4UXamFn+zO3w1ChR2HepieEozovWO3M= ceph-73438718-7656-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T07:13:44.678 INFO:teuthology.orchestra.run.smithi139.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIRoCZnEzALRcM4f65r1oKt75XhVXAeiyyLO90ILUWGXe+f3mF+wc+qhzCCiI8zOJbvL7Acpi1kvgz2VMyHW3MTsMSat4Vo61OHMoNrU7h4fkLRV7qxYEwpRKMpDdVAa3WA6HGioQ4lYMjaEEM0eelUwGLocuaKMHSB1YHMxqBY4YQs1aBWQdL+GU5eH5fYQYbsma+ENKzVtxYhrNeziwCwejPMdX2hYkRT5y1qVB+ZeaOdOiXqcpO2l5NyBHEFEXDfWkQmMjJ5O4FuSxGl2tvi4sFGEFsDF7vWimCC/xDzD+bfndJTNP0s5Og9Ofl+hEZLqwSPuU6prUjgp7zJkqO6TiJzZR2apPByOMwRAF/vZ237hvgqI0IFuLExmrjZeal77KrhF+LBsws4NAOw8kofG18Ot7b6jnH6N8zG02gFy0nC0LUFJHGzgSSqWklu88JQOJ5wpJfZuEjeaetG3xMUJ7GFnH4x9ZW4UXamFn+zO3w1ChR2HepieEozovWO3M= ceph-73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:13:44.691 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIRoCZnEzALRcM4f65r1oKt75XhVXAeiyyLO90ILUWGXe+f3mF+wc+qhzCCiI8zOJbvL7Acpi1kvgz2VMyHW3MTsMSat4Vo61OHMoNrU7h4fkLRV7qxYEwpRKMpDdVAa3WA6HGioQ4lYMjaEEM0eelUwGLocuaKMHSB1YHMxqBY4YQs1aBWQdL+GU5eH5fYQYbsma+ENKzVtxYhrNeziwCwejPMdX2hYkRT5y1qVB+ZeaOdOiXqcpO2l5NyBHEFEXDfWkQmMjJ5O4FuSxGl2tvi4sFGEFsDF7vWimCC/xDzD+bfndJTNP0s5Og9Ofl+hEZLqwSPuU6prUjgp7zJkqO6TiJzZR2apPByOMwRAF/vZ237hvgqI0IFuLExmrjZeal77KrhF+LBsws4NAOw8kofG18Ot7b6jnH6N8zG02gFy0nC0LUFJHGzgSSqWklu88JQOJ5wpJfZuEjeaetG3xMUJ7GFnH4x9ZW4UXamFn+zO3w1ChR2HepieEozovWO3M= ceph-73438718-7656-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T07:13:44.732 INFO:teuthology.orchestra.run.smithi162.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIRoCZnEzALRcM4f65r1oKt75XhVXAeiyyLO90ILUWGXe+f3mF+wc+qhzCCiI8zOJbvL7Acpi1kvgz2VMyHW3MTsMSat4Vo61OHMoNrU7h4fkLRV7qxYEwpRKMpDdVAa3WA6HGioQ4lYMjaEEM0eelUwGLocuaKMHSB1YHMxqBY4YQs1aBWQdL+GU5eH5fYQYbsma+ENKzVtxYhrNeziwCwejPMdX2hYkRT5y1qVB+ZeaOdOiXqcpO2l5NyBHEFEXDfWkQmMjJ5O4FuSxGl2tvi4sFGEFsDF7vWimCC/xDzD+bfndJTNP0s5Og9Ofl+hEZLqwSPuU6prUjgp7zJkqO6TiJzZR2apPByOMwRAF/vZ237hvgqI0IFuLExmrjZeal77KrhF+LBsws4NAOw8kofG18Ot7b6jnH6N8zG02gFy0nC0LUFJHGzgSSqWklu88JQOJ5wpJfZuEjeaetG3xMUJ7GFnH4x9ZW4UXamFn+zO3w1ChR2HepieEozovWO3M= ceph-73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:13:44.745 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T07:13:44.996 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:45.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:44 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4140327811' entity='client.admin' 2024-09-19T07:13:45.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.463+0000 7ff90d5f7640 1 -- 172.21.15.98:0/3683593778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff908100510 msgr2=0x7ff908100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.463+0000 7ff90d5f7640 1 --2- 172.21.15.98:0/3683593778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff908100510 0x7ff908100910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8009880 tx=0x7ff8f802a5d0 comp rx=0 tx=0).stop 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.463+0000 7ff90d5f7640 1 -- 172.21.15.98:0/3683593778 shutdown_connections 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.463+0000 7ff90d5f7640 1 --2- 172.21.15.98:0/3683593778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff908100510 0x7ff908100910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.463+0000 7ff90d5f7640 1 -- 172.21.15.98:0/3683593778 >> 172.21.15.98:0/3683593778 conn(0x7ff9080fbc80 msgr2=0x7ff9080fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.463+0000 7ff90d5f7640 1 -- 172.21.15.98:0/3683593778 shutdown_connections 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.463+0000 7ff90d5f7640 1 -- 172.21.15.98:0/3683593778 wait complete. 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.464+0000 7ff90d5f7640 1 Processor -- start 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.464+0000 7ff90d5f7640 1 -- start start 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.464+0000 7ff90d5f7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff908100510 0x7ff9080fdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.464+0000 7ff90d5f7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff908106620 con 0x7ff908100510 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.464+0000 7ff906ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff908100510 0x7ff9080fdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.464+0000 7ff906ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff908100510 0x7ff9080fdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33394/0 (socket says 172.21.15.98:33394) 2024-09-19T07:13:45.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.464+0000 7ff906ffd640 1 -- 172.21.15.98:0/2945541288 learned_addr learned my addr 172.21.15.98:0/2945541288 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:45.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.464+0000 7ff906ffd640 1 -- 172.21.15.98:0/2945541288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9080fe0a0 con 0x7ff908100510 2024-09-19T07:13:45.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.464+0000 7ff906ffd640 1 --2- 172.21.15.98:0/2945541288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff908100510 0x7ff9080fdb60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8004f60 tx=0x7ff8f80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:45.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.465+0000 7ff8effff640 1 -- 172.21.15.98:0/2945541288 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8f803f070 con 0x7ff908100510 2024-09-19T07:13:45.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.465+0000 7ff8effff640 1 -- 172.21.15.98:0/2945541288 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8f8004d40 con 0x7ff908100510 2024-09-19T07:13:45.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.465+0000 7ff90d5f7640 1 -- 172.21.15.98:0/2945541288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9080fc290 con 0x7ff908100510 2024-09-19T07:13:45.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.465+0000 7ff8effff640 1 -- 172.21.15.98:0/2945541288 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8f8035030 con 0x7ff908100510 2024-09-19T07:13:45.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.465+0000 7ff90d5f7640 1 -- 172.21.15.98:0/2945541288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9080fc7d0 con 0x7ff908100510 2024-09-19T07:13:45.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.466+0000 7ff8effff640 1 -- 172.21.15.98:0/2945541288 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7ff8f8042070 con 0x7ff908100510 2024-09-19T07:13:45.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.466+0000 7ff90d5f7640 1 -- 172.21.15.98:0/2945541288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff908106da0 con 0x7ff908100510 2024-09-19T07:13:45.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.466+0000 7ff8effff640 1 --2- 172.21.15.98:0/2945541288 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff8f00392a0 0x7ff8f003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:45.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.466+0000 7ff8effff640 1 -- 172.21.15.98:0/2945541288 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff8f806d000 con 0x7ff908100510 2024-09-19T07:13:45.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.466+0000 7ff9067fc640 1 --2- 172.21.15.98:0/2945541288 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff8f00392a0 0x7ff8f003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:45.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.466+0000 7ff9067fc640 1 --2- 172.21.15.98:0/2945541288 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff8f00392a0 0x7ff8f003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0098c0 tx=0x7ff8fc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:45.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.471+0000 7ff8effff640 1 -- 172.21.15.98:0/2945541288 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff8f8039350 con 0x7ff908100510 2024-09-19T07:13:45.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.640+0000 7ff90d5f7640 1 -- 172.21.15.98:0/2945541288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7ff908190270 con 0x7ff908100510 2024-09-19T07:13:45.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.643+0000 7ff8effff640 1 -- 172.21.15.98:0/2945541288 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7ff8f802f300 con 0x7ff908100510 2024-09-19T07:13:45.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.646+0000 7ff90d5f7640 1 -- 172.21.15.98:0/2945541288 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff8f00392a0 msgr2=0x7ff8f003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:45.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.646+0000 7ff90d5f7640 1 --2- 172.21.15.98:0/2945541288 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff8f00392a0 0x7ff8f003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0098c0 tx=0x7ff8fc006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:45.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.646+0000 7ff90d5f7640 1 -- 172.21.15.98:0/2945541288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff908100510 msgr2=0x7ff9080fdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:45.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.646+0000 7ff90d5f7640 1 --2- 172.21.15.98:0/2945541288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff908100510 0x7ff9080fdb60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8004f60 tx=0x7ff8f80048f0 comp rx=0 tx=0).stop 2024-09-19T07:13:45.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.646+0000 7ff90d5f7640 1 -- 172.21.15.98:0/2945541288 shutdown_connections 2024-09-19T07:13:45.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.646+0000 7ff90d5f7640 1 --2- 172.21.15.98:0/2945541288 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff8f00392a0 0x7ff8f003b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:45.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.646+0000 7ff90d5f7640 1 --2- 172.21.15.98:0/2945541288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff908100510 0x7ff9080fdb60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:45.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.646+0000 7ff90d5f7640 1 -- 172.21.15.98:0/2945541288 >> 172.21.15.98:0/2945541288 conn(0x7ff9080fbc80 msgr2=0x7ff90806a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:45.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.646+0000 7ff90d5f7640 1 -- 172.21.15.98:0/2945541288 shutdown_connections 2024-09-19T07:13:45.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:45.646+0000 7ff90d5f7640 1 -- 172.21.15.98:0/2945541288 wait complete. 2024-09-19T07:13:46.777 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T07:13:46.778 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T07:13:46.942 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:46 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2945541288' entity='client.admin' 2024-09-19T07:13:47.026 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.504+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2984639313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01015e0 msgr2=0x7f22e01019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.504+0000 7f22e5e2b640 1 --2- 172.21.15.98:0/2984639313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01015e0 0x7f22e01019e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009c20 tx=0x7f22d002aa90 comp rx=0 tx=0).stop 2024-09-19T07:13:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.504+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2984639313 shutdown_connections 2024-09-19T07:13:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.504+0000 7f22e5e2b640 1 --2- 172.21.15.98:0/2984639313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01015e0 0x7f22e01019e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.504+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2984639313 >> 172.21.15.98:0/2984639313 conn(0x7f22e00fcd70 msgr2=0x7f22e00ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.504+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2984639313 shutdown_connections 2024-09-19T07:13:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.504+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2984639313 wait complete. 2024-09-19T07:13:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.504+0000 7f22e5e2b640 1 Processor -- start 2024-09-19T07:13:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.505+0000 7f22e5e2b640 1 -- start start 2024-09-19T07:13:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.505+0000 7f22e5e2b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01015e0 0x7f22e0075eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.505+0000 7f22e5e2b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f22e01076f0 con 0x7f22e01015e0 2024-09-19T07:13:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.505+0000 7f22df7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01015e0 0x7f22e0075eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.505+0000 7f22df7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01015e0 0x7f22e0075eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33406/0 (socket says 172.21.15.98:33406) 2024-09-19T07:13:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.505+0000 7f22df7fe640 1 -- 172.21.15.98:0/2484323148 learned_addr learned my addr 172.21.15.98:0/2484323148 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.505+0000 7f22df7fe640 1 -- 172.21.15.98:0/2484323148 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e00763f0 con 0x7f22e01015e0 2024-09-19T07:13:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.505+0000 7f22df7fe640 1 --2- 172.21.15.98:0/2484323148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01015e0 0x7f22e0075eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22d0005cc0 tx=0x7f22d002fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.505+0000 7f22dcff9640 1 -- 172.21.15.98:0/2484323148 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d0047070 con 0x7f22e01015e0 2024-09-19T07:13:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.505+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2484323148 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e00745e0 con 0x7f22e01015e0 2024-09-19T07:13:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.505+0000 7f22dcff9640 1 -- 172.21.15.98:0/2484323148 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22d0003e50 con 0x7f22e01015e0 2024-09-19T07:13:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.505+0000 7f22dcff9640 1 -- 172.21.15.98:0/2484323148 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d0033050 con 0x7f22e01015e0 2024-09-19T07:13:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.506+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2484323148 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e0074b20 con 0x7f22e01015e0 2024-09-19T07:13:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.506+0000 7f22dcff9640 1 -- 172.21.15.98:0/2484323148 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f22d004a070 con 0x7f22e01015e0 2024-09-19T07:13:47.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.506+0000 7f22dcff9640 1 --2- 172.21.15.98:0/2484323148 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f22c80392a0 0x7f22c803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:47.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.506+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2484323148 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e0107e70 con 0x7f22e01015e0 2024-09-19T07:13:47.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.506+0000 7f22dcff9640 1 -- 172.21.15.98:0/2484323148 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f22d003e030 con 0x7f22e01015e0 2024-09-19T07:13:47.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.507+0000 7f22deffd640 1 --2- 172.21.15.98:0/2484323148 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f22c80392a0 0x7f22c803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:47.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.507+0000 7f22deffd640 1 --2- 172.21.15.98:0/2484323148 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f22c80392a0 0x7f22c803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f22d40098c0 tx=0x7f22d4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:47.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.511+0000 7f22dcff9640 1 -- 172.21.15.98:0/2484323148 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f22d0051020 con 0x7f22e01015e0 2024-09-19T07:13:47.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.685+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2484323148 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f22e0190200 con 0x7f22c80392a0 2024-09-19T07:13:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.689+0000 7f22dcff9640 1 -- 172.21.15.98:0/2484323148 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f22e0190200 con 0x7f22c80392a0 2024-09-19T07:13:47.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.691+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2484323148 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f22c80392a0 msgr2=0x7f22c803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:47.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.691+0000 7f22e5e2b640 1 --2- 172.21.15.98:0/2484323148 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f22c80392a0 0x7f22c803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f22d40098c0 tx=0x7f22d4006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:47.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.691+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2484323148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01015e0 msgr2=0x7f22e0075eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:47.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.691+0000 7f22e5e2b640 1 --2- 172.21.15.98:0/2484323148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01015e0 0x7f22e0075eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22d0005cc0 tx=0x7f22d002fc10 comp rx=0 tx=0).stop 2024-09-19T07:13:47.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.691+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2484323148 shutdown_connections 2024-09-19T07:13:47.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.691+0000 7f22e5e2b640 1 --2- 172.21.15.98:0/2484323148 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f22c80392a0 0x7f22c803b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:47.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.691+0000 7f22e5e2b640 1 --2- 172.21.15.98:0/2484323148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f22e01015e0 0x7f22e0075eb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:47.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.691+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2484323148 >> 172.21.15.98:0/2484323148 conn(0x7f22e00fcd70 msgr2=0x7f22e00fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:47.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.691+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2484323148 shutdown_connections 2024-09-19T07:13:47.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:47.691+0000 7f22e5e2b640 1 -- 172.21.15.98:0/2484323148 wait complete. 2024-09-19T07:13:48.271 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi139 2024-09-19T07:13:48.272 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-19T07:13:48.272 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/etc/ceph/ceph.conf 2024-09-19T07:13:48.291 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-19T07:13:48.291 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:13:48.350 INFO:tasks.cephadm:Adding host smithi139 to orchestrator... 2024-09-19T07:13:48.350 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch host add smithi139 2024-09-19T07:13:48.776 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:48.938 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:48 smithi098 ceph-mon[30950]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:13:48.938 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:48 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:49.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.288+0000 7febc8af9640 1 -- 172.21.15.98:0/3828116000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc4100540 msgr2=0x7febc4100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:49.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.288+0000 7febc8af9640 1 --2- 172.21.15.98:0/3828116000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc4100540 0x7febc4100940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7febb4009880 tx=0x7febb402a5d0 comp rx=0 tx=0).stop 2024-09-19T07:13:49.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.288+0000 7febc8af9640 1 -- 172.21.15.98:0/3828116000 shutdown_connections 2024-09-19T07:13:49.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.288+0000 7febc8af9640 1 --2- 172.21.15.98:0/3828116000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc4100540 0x7febc4100940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:49.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.288+0000 7febc8af9640 1 -- 172.21.15.98:0/3828116000 >> 172.21.15.98:0/3828116000 conn(0x7febc40fbcd0 msgr2=0x7febc40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:49.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.288+0000 7febc8af9640 1 -- 172.21.15.98:0/3828116000 shutdown_connections 2024-09-19T07:13:49.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.288+0000 7febc8af9640 1 -- 172.21.15.98:0/3828116000 wait complete. 2024-09-19T07:13:49.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.289+0000 7febc8af9640 1 Processor -- start 2024-09-19T07:13:49.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.289+0000 7febc8af9640 1 -- start start 2024-09-19T07:13:49.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.289+0000 7febc8af9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc4100540 0x7febc4196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:49.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.289+0000 7febc8af9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7febc41065f0 con 0x7febc4100540 2024-09-19T07:13:49.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.289+0000 7febc259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc4100540 0x7febc4196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:49.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.289+0000 7febc259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc4100540 0x7febc4196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33424/0 (socket says 172.21.15.98:33424) 2024-09-19T07:13:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.289+0000 7febc259c640 1 -- 172.21.15.98:0/2819959243 learned_addr learned my addr 172.21.15.98:0/2819959243 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.289+0000 7febc259c640 1 -- 172.21.15.98:0/2819959243 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc41972a0 con 0x7febc4100540 2024-09-19T07:13:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.289+0000 7febc259c640 1 --2- 172.21.15.98:0/2819959243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc4100540 0x7febc4196d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7febb4004f60 tx=0x7febb40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.290+0000 7febb37fe640 1 -- 172.21.15.98:0/2819959243 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febb403f070 con 0x7febc4100540 2024-09-19T07:13:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.290+0000 7febc8af9640 1 -- 172.21.15.98:0/2819959243 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc4197530 con 0x7febc4100540 2024-09-19T07:13:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.290+0000 7febb37fe640 1 -- 172.21.15.98:0/2819959243 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febb4004d40 con 0x7febc4100540 2024-09-19T07:13:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.290+0000 7febb37fe640 1 -- 172.21.15.98:0/2819959243 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7febb4035030 con 0x7febc4100540 2024-09-19T07:13:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.290+0000 7febc8af9640 1 -- 172.21.15.98:0/2819959243 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc419a220 con 0x7febc4100540 2024-09-19T07:13:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.291+0000 7febb37fe640 1 -- 172.21.15.98:0/2819959243 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7febb4042070 con 0x7febc4100540 2024-09-19T07:13:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.291+0000 7febc8af9640 1 -- 172.21.15.98:0/2819959243 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc4106d70 con 0x7febc4100540 2024-09-19T07:13:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.291+0000 7febb37fe640 1 --2- 172.21.15.98:0/2819959243 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7febac0392a0 0x7febac03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.291+0000 7febb37fe640 1 -- 172.21.15.98:0/2819959243 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7febb406d0a0 con 0x7febc4100540 2024-09-19T07:13:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.291+0000 7febc1d9b640 1 --2- 172.21.15.98:0/2819959243 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7febac0392a0 0x7febac03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.291+0000 7febc1d9b640 1 --2- 172.21.15.98:0/2819959243 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7febac0392a0 0x7febac03b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7febb80098c0 tx=0x7febb8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:49.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.296+0000 7febb37fe640 1 -- 172.21.15.98:0/2819959243 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7febb4040260 con 0x7febc4100540 2024-09-19T07:13:49.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:49.520+0000 7febc8af9640 1 -- 172.21.15.98:0/2819959243 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}) -- 0x7febc402d830 con 0x7febac0392a0 2024-09-19T07:13:49.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:49.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:49.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:13:49.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:13:49.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:13:49.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-19T07:13:49.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: Updating smithi098:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:13:49.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:13:49.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: Updating smithi098:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:13:49.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:13:49.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:49.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:49.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:49.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:49.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:13:49.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:13:49.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:51.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:50 smithi098 ceph-mon[30950]: Deploying cephadm binary to smithi139 2024-09-19T07:13:52.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:52.628+0000 7febb37fe640 1 -- 172.21.15.98:0/2819959243 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7febc402d830 con 0x7febac0392a0 2024-09-19T07:13:52.629 INFO:teuthology.orchestra.run.smithi098.stdout:Added host 'smithi139' with addr '172.21.15.139' 2024-09-19T07:13:52.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:52.630+0000 7febc8af9640 1 -- 172.21.15.98:0/2819959243 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7febac0392a0 msgr2=0x7febac03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:52.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:52.630+0000 7febc8af9640 1 --2- 172.21.15.98:0/2819959243 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7febac0392a0 0x7febac03b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7febb80098c0 tx=0x7febb8006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:52.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:52.630+0000 7febc8af9640 1 -- 172.21.15.98:0/2819959243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc4100540 msgr2=0x7febc4196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:52.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:52.630+0000 7febc8af9640 1 --2- 172.21.15.98:0/2819959243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc4100540 0x7febc4196d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7febb4004f60 tx=0x7febb40048f0 comp rx=0 tx=0).stop 2024-09-19T07:13:52.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:52.630+0000 7febc8af9640 1 -- 172.21.15.98:0/2819959243 shutdown_connections 2024-09-19T07:13:52.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:52.630+0000 7febc8af9640 1 --2- 172.21.15.98:0/2819959243 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7febac0392a0 0x7febac03b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:52.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:52.630+0000 7febc8af9640 1 --2- 172.21.15.98:0/2819959243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc4100540 0x7febc4196d60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:52.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:52.630+0000 7febc8af9640 1 -- 172.21.15.98:0/2819959243 >> 172.21.15.98:0/2819959243 conn(0x7febc40fbcd0 msgr2=0x7febc4069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:52.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:52.630+0000 7febc8af9640 1 -- 172.21.15.98:0/2819959243 shutdown_connections 2024-09-19T07:13:52.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:52.630+0000 7febc8af9640 1 -- 172.21.15.98:0/2819959243 wait complete. 2024-09-19T07:13:53.241 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T07:13:53.479 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:53.921 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:53.921 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:53 smithi098 ceph-mon[30950]: Added host smithi139 2024-09-19T07:13:53.922 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:53.922 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:53.922 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:53.925 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.920+0000 7fb2cfce7640 1 -- 172.21.15.98:0/237879993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8106560 msgr2=0x7fb2c8106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:53.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.920+0000 7fb2cfce7640 1 --2- 172.21.15.98:0/237879993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8106560 0x7fb2c8106940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009880 tx=0x7fb2b802a5d0 comp rx=0 tx=0).stop 2024-09-19T07:13:53.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.920+0000 7fb2cfce7640 1 -- 172.21.15.98:0/237879993 shutdown_connections 2024-09-19T07:13:53.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.920+0000 7fb2cfce7640 1 --2- 172.21.15.98:0/237879993 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8106560 0x7fb2c8106940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:53.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.920+0000 7fb2cfce7640 1 -- 172.21.15.98:0/237879993 >> 172.21.15.98:0/237879993 conn(0x7fb2c80fc1b0 msgr2=0x7fb2c80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:53.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.920+0000 7fb2cfce7640 1 -- 172.21.15.98:0/237879993 shutdown_connections 2024-09-19T07:13:53.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.920+0000 7fb2cfce7640 1 -- 172.21.15.98:0/237879993 wait complete. 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.921+0000 7fb2cfce7640 1 Processor -- start 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.921+0000 7fb2cfce7640 1 -- start start 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.921+0000 7fb2cfce7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8106560 0x7fb2c8196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.921+0000 7fb2cfce7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c810ab90 con 0x7fb2c8106560 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.921+0000 7fb2cda83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8106560 0x7fb2c8196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.921+0000 7fb2cda83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8106560 0x7fb2c8196030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52904/0 (socket says 172.21.15.98:52904) 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.921+0000 7fb2cda83640 1 -- 172.21.15.98:0/2096997679 learned_addr learned my addr 172.21.15.98:0/2096997679 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.922+0000 7fb2cda83640 1 -- 172.21.15.98:0/2096997679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c8196570 con 0x7fb2c8106560 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.922+0000 7fb2cda83640 1 --2- 172.21.15.98:0/2096997679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8106560 0x7fb2c8196030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009230 tx=0x7fb2b8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.922+0000 7fb2beffd640 1 -- 172.21.15.98:0/2096997679 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b803f070 con 0x7fb2c8106560 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.922+0000 7fb2cfce7640 1 -- 172.21.15.98:0/2096997679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c8196800 con 0x7fb2c8106560 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.922+0000 7fb2beffd640 1 -- 172.21.15.98:0/2096997679 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b803bc80 con 0x7fb2c8106560 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.922+0000 7fb2beffd640 1 -- 172.21.15.98:0/2096997679 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b8035030 con 0x7fb2c8106560 2024-09-19T07:13:53.927 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.922+0000 7fb2cfce7640 1 -- 172.21.15.98:0/2096997679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c819a900 con 0x7fb2c8106560 2024-09-19T07:13:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.923+0000 7fb2beffd640 1 -- 172.21.15.98:0/2096997679 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fb2b8042070 con 0x7fb2c8106560 2024-09-19T07:13:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.923+0000 7fb2beffd640 1 --2- 172.21.15.98:0/2096997679 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb2b40392a0 0x7fb2b403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.923+0000 7fb2cfce7640 1 -- 172.21.15.98:0/2096997679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c8101bd0 con 0x7fb2c8106560 2024-09-19T07:13:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.923+0000 7fb2cd282640 1 --2- 172.21.15.98:0/2096997679 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb2b40392a0 0x7fb2b403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.923+0000 7fb2beffd640 1 -- 172.21.15.98:0/2096997679 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb2b806cff0 con 0x7fb2c8106560 2024-09-19T07:13:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.924+0000 7fb2cd282640 1 --2- 172.21.15.98:0/2096997679 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb2b40392a0 0x7fb2b403b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40098c0 tx=0x7fb2c4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:53.928 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:53.928+0000 7fb2beffd640 1 -- 172.21.15.98:0/2096997679 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb2b80372d0 con 0x7fb2c8106560 2024-09-19T07:13:54.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:54.103+0000 7fb2cfce7640 1 -- 172.21.15.98:0/2096997679 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2c8197390 con 0x7fb2b40392a0 2024-09-19T07:13:54.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:54.104+0000 7fb2beffd640 1 -- 172.21.15.98:0/2096997679 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fb2c8197390 con 0x7fb2b40392a0 2024-09-19T07:13:54.105 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:13:54.105 INFO:teuthology.orchestra.run.smithi098.stdout:[{"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}, {"addr": "172.21.15.139", "hostname": "smithi139", "labels": [], "status": ""}] 2024-09-19T07:13:54.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:54.106+0000 7fb2cfce7640 1 -- 172.21.15.98:0/2096997679 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb2b40392a0 msgr2=0x7fb2b403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:54.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:54.106+0000 7fb2cfce7640 1 --2- 172.21.15.98:0/2096997679 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb2b40392a0 0x7fb2b403b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2c40098c0 tx=0x7fb2c4006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:54.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:54.106+0000 7fb2cfce7640 1 -- 172.21.15.98:0/2096997679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8106560 msgr2=0x7fb2c8196030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:54.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:54.106+0000 7fb2cfce7640 1 --2- 172.21.15.98:0/2096997679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8106560 0x7fb2c8196030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009230 tx=0x7fb2b8003d40 comp rx=0 tx=0).stop 2024-09-19T07:13:54.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:54.106+0000 7fb2cfce7640 1 -- 172.21.15.98:0/2096997679 shutdown_connections 2024-09-19T07:13:54.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:54.106+0000 7fb2cfce7640 1 --2- 172.21.15.98:0/2096997679 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb2b40392a0 0x7fb2b403b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:54.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:54.106+0000 7fb2cfce7640 1 --2- 172.21.15.98:0/2096997679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2c8106560 0x7fb2c8196030 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:54.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:54.106+0000 7fb2cfce7640 1 -- 172.21.15.98:0/2096997679 >> 172.21.15.98:0/2096997679 conn(0x7fb2c80fc1b0 msgr2=0x7fb2c80fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:54.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:54.106+0000 7fb2cfce7640 1 -- 172.21.15.98:0/2096997679 shutdown_connections 2024-09-19T07:13:54.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:54.106+0000 7fb2cfce7640 1 -- 172.21.15.98:0/2096997679 wait complete. 2024-09-19T07:13:54.708 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi162 2024-09-19T07:13:54.709 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T07:13:54.709 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.conf 2024-09-19T07:13:54.729 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T07:13:54.729 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:13:54.788 INFO:tasks.cephadm:Adding host smithi162 to orchestrator... 2024-09-19T07:13:54.788 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch host add smithi162 2024-09-19T07:13:55.029 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:55.248 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:54 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:55.248 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:54 smithi098 ceph-mon[30950]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:13:55.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.463+0000 7fd1f9716640 1 -- 172.21.15.98:0/293256271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f4107650 msgr2=0x7fd1f4107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:55.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.463+0000 7fd1f9716640 1 --2- 172.21.15.98:0/293256271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f4107650 0x7fd1f4107a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec009c20 tx=0x7fd1ec02aa90 comp rx=0 tx=0).stop 2024-09-19T07:13:55.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.463+0000 7fd1f9716640 1 -- 172.21.15.98:0/293256271 shutdown_connections 2024-09-19T07:13:55.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.463+0000 7fd1f9716640 1 --2- 172.21.15.98:0/293256271 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f4107650 0x7fd1f4107a30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:55.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.463+0000 7fd1f9716640 1 -- 172.21.15.98:0/293256271 >> 172.21.15.98:0/293256271 conn(0x7fd1f40fd2a0 msgr2=0x7fd1f40ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:55.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.463+0000 7fd1f9716640 1 -- 172.21.15.98:0/293256271 shutdown_connections 2024-09-19T07:13:55.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.463+0000 7fd1f9716640 1 -- 172.21.15.98:0/293256271 wait complete. 2024-09-19T07:13:55.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.463+0000 7fd1f9716640 1 Processor -- start 2024-09-19T07:13:55.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.464+0000 7fd1f9716640 1 -- start start 2024-09-19T07:13:55.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.464+0000 7fd1f9716640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f4107650 0x7fd1f41992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:55.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.464+0000 7fd1f9716640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f410bc60 con 0x7fd1f4107650 2024-09-19T07:13:55.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.464+0000 7fd1f2ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f4107650 0x7fd1f41992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:55.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.464+0000 7fd1f2ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f4107650 0x7fd1f41992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52910/0 (socket says 172.21.15.98:52910) 2024-09-19T07:13:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.464+0000 7fd1f2ffd640 1 -- 172.21.15.98:0/2817068601 learned_addr learned my addr 172.21.15.98:0/2817068601 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:13:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.464+0000 7fd1f2ffd640 1 -- 172.21.15.98:0/2817068601 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f41997f0 con 0x7fd1f4107650 2024-09-19T07:13:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.464+0000 7fd1f2ffd640 1 --2- 172.21.15.98:0/2817068601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f4107650 0x7fd1f41992b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec005e30 tx=0x7fd1ec02fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.464+0000 7fd1ebfff640 1 -- 172.21.15.98:0/2817068601 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1ec047070 con 0x7fd1f4107650 2024-09-19T07:13:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.464+0000 7fd1ebfff640 1 -- 172.21.15.98:0/2817068601 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1ec003df0 con 0x7fd1f4107650 2024-09-19T07:13:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.464+0000 7fd1f9716640 1 -- 172.21.15.98:0/2817068601 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f4199ae0 con 0x7fd1f4107650 2024-09-19T07:13:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.465+0000 7fd1ebfff640 1 -- 172.21.15.98:0/2817068601 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1ec033050 con 0x7fd1f4107650 2024-09-19T07:13:55.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.465+0000 7fd1f9716640 1 -- 172.21.15.98:0/2817068601 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f419db80 con 0x7fd1f4107650 2024-09-19T07:13:55.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.466+0000 7fd1ebfff640 1 -- 172.21.15.98:0/2817068601 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fd1ec04a070 con 0x7fd1f4107650 2024-09-19T07:13:55.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.466+0000 7fd1f9716640 1 -- 172.21.15.98:0/2817068601 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f4102d00 con 0x7fd1f4107650 2024-09-19T07:13:55.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.466+0000 7fd1ebfff640 1 --2- 172.21.15.98:0/2817068601 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd1e00392a0 0x7fd1e003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:13:55.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.466+0000 7fd1ebfff640 1 -- 172.21.15.98:0/2817068601 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd1ec03e030 con 0x7fd1f4107650 2024-09-19T07:13:55.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.466+0000 7fd1f27fc640 1 --2- 172.21.15.98:0/2817068601 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd1e00392a0 0x7fd1e003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:13:55.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.466+0000 7fd1f27fc640 1 --2- 172.21.15.98:0/2817068601 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd1e00392a0 0x7fd1e003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0098c0 tx=0x7fd1dc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:13:55.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.470+0000 7fd1ebfff640 1 -- 172.21.15.98:0/2817068601 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd1ec001250 con 0x7fd1f4107650 2024-09-19T07:13:55.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:55.642+0000 7fd1f9716640 1 -- 172.21.15.98:0/2817068601 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}) -- 0x7fd1f419a610 con 0x7fd1e00392a0 2024-09-19T07:13:56.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:55 smithi098 ceph-mon[30950]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:13:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:57 smithi098 ceph-mon[30950]: Deploying cephadm binary to smithi162 2024-09-19T07:13:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:57 smithi098 ceph-mon[30950]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:13:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:58.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:58.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:58.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:58.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:13:58.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:13:58.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:13:58.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:58.844+0000 7fd1ebfff640 1 -- 172.21.15.98:0/2817068601 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd1f419a610 con 0x7fd1e00392a0 2024-09-19T07:13:58.846 INFO:teuthology.orchestra.run.smithi098.stdout:Added host 'smithi162' with addr '172.21.15.162' 2024-09-19T07:13:58.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:58 smithi098 ceph-mon[30950]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-19T07:13:58.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:58 smithi098 ceph-mon[30950]: Updating smithi139:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:13:58.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:58 smithi098 ceph-mon[30950]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:13:58.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:58 smithi098 ceph-mon[30950]: Updating smithi139:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:13:58.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:58 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:58.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:58 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:58.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:58 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:58.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:58.846+0000 7fd1f9716640 1 -- 172.21.15.98:0/2817068601 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd1e00392a0 msgr2=0x7fd1e003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:58.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:58.846+0000 7fd1f9716640 1 --2- 172.21.15.98:0/2817068601 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd1e00392a0 0x7fd1e003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0098c0 tx=0x7fd1dc006db0 comp rx=0 tx=0).stop 2024-09-19T07:13:58.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:58.846+0000 7fd1f9716640 1 -- 172.21.15.98:0/2817068601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f4107650 msgr2=0x7fd1f41992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:13:58.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:58.846+0000 7fd1f9716640 1 --2- 172.21.15.98:0/2817068601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f4107650 0x7fd1f41992b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec005e30 tx=0x7fd1ec02fc10 comp rx=0 tx=0).stop 2024-09-19T07:13:58.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:58.846+0000 7fd1f9716640 1 -- 172.21.15.98:0/2817068601 shutdown_connections 2024-09-19T07:13:58.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:58.846+0000 7fd1f9716640 1 --2- 172.21.15.98:0/2817068601 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd1e00392a0 0x7fd1e003b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:58.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:58.846+0000 7fd1f9716640 1 --2- 172.21.15.98:0/2817068601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1f4107650 0x7fd1f41992b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:13:58.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:58.846+0000 7fd1f9716640 1 -- 172.21.15.98:0/2817068601 >> 172.21.15.98:0/2817068601 conn(0x7fd1f40fd2a0 msgr2=0x7fd1f4075de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:13:58.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:58.846+0000 7fd1f9716640 1 -- 172.21.15.98:0/2817068601 shutdown_connections 2024-09-19T07:13:58.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:13:58.846+0000 7fd1f9716640 1 -- 172.21.15.98:0/2817068601 wait complete. 2024-09-19T07:13:59.482 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T07:13:59.721 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:13:59.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:59 smithi098 ceph-mon[30950]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:13:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:13:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:13:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:13:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:00.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.166+0000 7ff4df94f640 1 -- 172.21.15.98:0/3261155040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4d8100550 msgr2=0x7ff4d8100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:00.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.166+0000 7ff4df94f640 1 --2- 172.21.15.98:0/3261155040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4d8100550 0x7ff4d8100930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009880 tx=0x7ff4d402a670 comp rx=0 tx=0).stop 2024-09-19T07:14:00.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.166+0000 7ff4df94f640 1 -- 172.21.15.98:0/3261155040 shutdown_connections 2024-09-19T07:14:00.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.166+0000 7ff4df94f640 1 --2- 172.21.15.98:0/3261155040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4d8100550 0x7ff4d8100930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.166+0000 7ff4df94f640 1 -- 172.21.15.98:0/3261155040 >> 172.21.15.98:0/3261155040 conn(0x7ff4d80fc180 msgr2=0x7ff4d80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.166+0000 7ff4df94f640 1 -- 172.21.15.98:0/3261155040 shutdown_connections 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.166+0000 7ff4df94f640 1 -- 172.21.15.98:0/3261155040 wait complete. 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.166+0000 7ff4df94f640 1 Processor -- start 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.166+0000 7ff4df94f640 1 -- start start 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.167+0000 7ff4df94f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4d8100550 0x7ff4d81a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.167+0000 7ff4df94f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d81122e0 con 0x7ff4d8100550 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.167+0000 7ff4dd6eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4d8100550 0x7ff4d81a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.167+0000 7ff4dd6eb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4d8100550 0x7ff4d81a33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52932/0 (socket says 172.21.15.98:52932) 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.167+0000 7ff4dd6eb640 1 -- 172.21.15.98:0/844125660 learned_addr learned my addr 172.21.15.98:0/844125660 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.167+0000 7ff4dd6eb640 1 -- 172.21.15.98:0/844125660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d81a3930 con 0x7ff4d8100550 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.167+0000 7ff4dd6eb640 1 --2- 172.21.15.98:0/844125660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4d8100550 0x7ff4d81a33f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009230 tx=0x7ff4d4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:00.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.167+0000 7ff4ce7fc640 1 -- 172.21.15.98:0/844125660 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4d403f070 con 0x7ff4d8100550 2024-09-19T07:14:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.167+0000 7ff4df94f640 1 -- 172.21.15.98:0/844125660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d81a3bc0 con 0x7ff4d8100550 2024-09-19T07:14:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.167+0000 7ff4ce7fc640 1 -- 172.21.15.98:0/844125660 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4d403bc80 con 0x7ff4d8100550 2024-09-19T07:14:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.167+0000 7ff4ce7fc640 1 -- 172.21.15.98:0/844125660 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4d4035030 con 0x7ff4d8100550 2024-09-19T07:14:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.167+0000 7ff4df94f640 1 -- 172.21.15.98:0/844125660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d819d5b0 con 0x7ff4d8100550 2024-09-19T07:14:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.168+0000 7ff4ce7fc640 1 -- 172.21.15.98:0/844125660 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7ff4d4042070 con 0x7ff4d8100550 2024-09-19T07:14:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.168+0000 7ff4df94f640 1 -- 172.21.15.98:0/844125660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d806a7b0 con 0x7ff4d8100550 2024-09-19T07:14:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.168+0000 7ff4ce7fc640 1 --2- 172.21.15.98:0/844125660 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff4c4039300 0x7ff4c403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.168+0000 7ff4ce7fc640 1 -- 172.21.15.98:0/844125660 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff4d406cfb0 con 0x7ff4d8100550 2024-09-19T07:14:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.168+0000 7ff4dceea640 1 --2- 172.21.15.98:0/844125660 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff4c4039300 0x7ff4c403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.169+0000 7ff4dceea640 1 --2- 172.21.15.98:0/844125660 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff4c4039300 0x7ff4c403b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80098c0 tx=0x7ff4c8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:00.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.173+0000 7ff4ce7fc640 1 -- 172.21.15.98:0/844125660 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff4d40433b0 con 0x7ff4d8100550 2024-09-19T07:14:00.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.345+0000 7ff4df94f640 1 -- 172.21.15.98:0/844125660 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4d81009b0 con 0x7ff4c4039300 2024-09-19T07:14:00.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.346+0000 7ff4ce7fc640 1 -- 172.21.15.98:0/844125660 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7ff4d81009b0 con 0x7ff4c4039300 2024-09-19T07:14:00.348 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:14:00.348 INFO:teuthology.orchestra.run.smithi098.stdout:[{"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}, {"addr": "172.21.15.139", "hostname": "smithi139", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}] 2024-09-19T07:14:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.348+0000 7ff4df94f640 1 -- 172.21.15.98:0/844125660 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff4c4039300 msgr2=0x7ff4c403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.348+0000 7ff4df94f640 1 --2- 172.21.15.98:0/844125660 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff4c4039300 0x7ff4c403b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80098c0 tx=0x7ff4c8006db0 comp rx=0 tx=0).stop 2024-09-19T07:14:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.348+0000 7ff4df94f640 1 -- 172.21.15.98:0/844125660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4d8100550 msgr2=0x7ff4d81a33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.348+0000 7ff4df94f640 1 --2- 172.21.15.98:0/844125660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4d8100550 0x7ff4d81a33f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009230 tx=0x7ff4d4003d40 comp rx=0 tx=0).stop 2024-09-19T07:14:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.348+0000 7ff4df94f640 1 -- 172.21.15.98:0/844125660 shutdown_connections 2024-09-19T07:14:00.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.348+0000 7ff4df94f640 1 --2- 172.21.15.98:0/844125660 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff4c4039300 0x7ff4c403b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:00.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.349+0000 7ff4df94f640 1 --2- 172.21.15.98:0/844125660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4d8100550 0x7ff4d81a33f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:00.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.349+0000 7ff4df94f640 1 -- 172.21.15.98:0/844125660 >> 172.21.15.98:0/844125660 conn(0x7ff4d80fc180 msgr2=0x7ff4d80fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:00.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.349+0000 7ff4df94f640 1 -- 172.21.15.98:0/844125660 shutdown_connections 2024-09-19T07:14:00.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:00.349+0000 7ff4df94f640 1 -- 172.21.15.98:0/844125660 wait complete. 2024-09-19T07:14:00.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:00 smithi098 ceph-mon[30950]: Added host smithi162 2024-09-19T07:14:00.669 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:00.982 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T07:14:00.982 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T07:14:01.221 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:01.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:01 smithi098 ceph-mon[30950]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:14:01.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:01 smithi098 ceph-mon[30950]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:01.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.666+0000 7fc89fede640 1 -- 172.21.15.98:0/1174059885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc898100540 msgr2=0x7fc898100920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:01.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.666+0000 7fc89fede640 1 --2- 172.21.15.98:0/1174059885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc898100540 0x7fc898100920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc894009880 tx=0x7fc89402a670 comp rx=0 tx=0).stop 2024-09-19T07:14:01.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.666+0000 7fc89fede640 1 -- 172.21.15.98:0/1174059885 shutdown_connections 2024-09-19T07:14:01.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.666+0000 7fc89fede640 1 --2- 172.21.15.98:0/1174059885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc898100540 0x7fc898100920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:01.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.666+0000 7fc89fede640 1 -- 172.21.15.98:0/1174059885 >> 172.21.15.98:0/1174059885 conn(0x7fc8980fc1b0 msgr2=0x7fc8980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:01.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.666+0000 7fc89fede640 1 -- 172.21.15.98:0/1174059885 shutdown_connections 2024-09-19T07:14:01.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.666+0000 7fc89fede640 1 -- 172.21.15.98:0/1174059885 wait complete. 2024-09-19T07:14:01.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.667+0000 7fc89fede640 1 Processor -- start 2024-09-19T07:14:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.667+0000 7fc89fede640 1 -- start start 2024-09-19T07:14:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.667+0000 7fc89fede640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc898100540 0x7fc8981a3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.667+0000 7fc89fede640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc8981122d0 con 0x7fc898100540 2024-09-19T07:14:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.667+0000 7fc89dc7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc898100540 0x7fc8981a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.667+0000 7fc89dc7a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc898100540 0x7fc8981a3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:52950/0 (socket says 172.21.15.98:52950) 2024-09-19T07:14:01.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.667+0000 7fc89dc7a640 1 -- 172.21.15.98:0/625552689 learned_addr learned my addr 172.21.15.98:0/625552689 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:14:01.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.667+0000 7fc89dc7a640 1 -- 172.21.15.98:0/625552689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8981a3960 con 0x7fc898100540 2024-09-19T07:14:01.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.668+0000 7fc89dc7a640 1 --2- 172.21.15.98:0/625552689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc898100540 0x7fc8981a3420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc894009230 tx=0x7fc894003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:01.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.668+0000 7fc88effd640 1 -- 172.21.15.98:0/625552689 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc89403f070 con 0x7fc898100540 2024-09-19T07:14:01.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.668+0000 7fc88effd640 1 -- 172.21.15.98:0/625552689 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc89403bc80 con 0x7fc898100540 2024-09-19T07:14:01.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.668+0000 7fc88effd640 1 -- 172.21.15.98:0/625552689 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc894035030 con 0x7fc898100540 2024-09-19T07:14:01.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.668+0000 7fc89fede640 1 -- 172.21.15.98:0/625552689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8981a3bf0 con 0x7fc898100540 2024-09-19T07:14:01.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.668+0000 7fc89fede640 1 -- 172.21.15.98:0/625552689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89819d5e0 con 0x7fc898100540 2024-09-19T07:14:01.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.669+0000 7fc88effd640 1 -- 172.21.15.98:0/625552689 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc894042070 con 0x7fc898100540 2024-09-19T07:14:01.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.669+0000 7fc89fede640 1 -- 172.21.15.98:0/625552689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc89806a7b0 con 0x7fc898100540 2024-09-19T07:14:01.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.669+0000 7fc88effd640 1 --2- 172.21.15.98:0/625552689 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc884039300 0x7fc88403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:01.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.669+0000 7fc88effd640 1 -- 172.21.15.98:0/625552689 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc89406d260 con 0x7fc898100540 2024-09-19T07:14:01.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.669+0000 7fc89d479640 1 --2- 172.21.15.98:0/625552689 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc884039300 0x7fc88403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:01.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.669+0000 7fc89d479640 1 --2- 172.21.15.98:0/625552689 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc884039300 0x7fc88403b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc8880098c0 tx=0x7fc888006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:01.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.673+0000 7fc88effd640 1 -- 172.21.15.98:0/625552689 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc8940314c0 con 0x7fc898100540 2024-09-19T07:14:01.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:01.846+0000 7fc89fede640 1 -- 172.21.15.98:0/625552689 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fc8981009a0 con 0x7fc898100540 2024-09-19T07:14:02.583 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:02.581+0000 7fc88effd640 1 -- 172.21.15.98:0/625552689 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fc89403a890 con 0x7fc898100540 2024-09-19T07:14:02.583 INFO:teuthology.orchestra.run.smithi098.stderr:adjusted tunables profile to default 2024-09-19T07:14:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:02.584+0000 7fc89fede640 1 -- 172.21.15.98:0/625552689 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc884039300 msgr2=0x7fc88403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:02.584+0000 7fc89fede640 1 --2- 172.21.15.98:0/625552689 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc884039300 0x7fc88403b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc8880098c0 tx=0x7fc888006db0 comp rx=0 tx=0).stop 2024-09-19T07:14:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:02.584+0000 7fc89fede640 1 -- 172.21.15.98:0/625552689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc898100540 msgr2=0x7fc8981a3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:02.584+0000 7fc89fede640 1 --2- 172.21.15.98:0/625552689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc898100540 0x7fc8981a3420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc894009230 tx=0x7fc894003d40 comp rx=0 tx=0).stop 2024-09-19T07:14:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:02.584+0000 7fc89fede640 1 -- 172.21.15.98:0/625552689 shutdown_connections 2024-09-19T07:14:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:02.584+0000 7fc89fede640 1 --2- 172.21.15.98:0/625552689 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc884039300 0x7fc88403b7c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:02.584+0000 7fc89fede640 1 --2- 172.21.15.98:0/625552689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc898100540 0x7fc8981a3420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:02.584+0000 7fc89fede640 1 -- 172.21.15.98:0/625552689 >> 172.21.15.98:0/625552689 conn(0x7fc8980fc1b0 msgr2=0x7fc8980fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:02.584+0000 7fc89fede640 1 -- 172.21.15.98:0/625552689 shutdown_connections 2024-09-19T07:14:02.586 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:02.584+0000 7fc89fede640 1 -- 172.21.15.98:0/625552689 wait complete. 2024-09-19T07:14:02.866 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:02 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/625552689' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T07:14:03.227 INFO:tasks.cephadm:Adding mon.a on smithi098 2024-09-19T07:14:03.227 INFO:tasks.cephadm:Adding mon.b on smithi139 2024-09-19T07:14:03.228 INFO:tasks.cephadm:Adding mon.c on smithi162 2024-09-19T07:14:03.228 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi098:172.21.15.98=a;smithi139:172.21.15.139=b;smithi162:172.21.15.162=c' 2024-09-19T07:14:03.477 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:03 smithi098 ceph-mon[30950]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:03 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/625552689' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:03 smithi098 ceph-mon[30950]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:04.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:04.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:04.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:04.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:04.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.014+0000 7f7e2934e640 1 -- 172.21.15.162:0/3955952193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e24102790 msgr2=0x7f7e24102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:04.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.014+0000 7f7e2934e640 1 --2- 172.21.15.162:0/3955952193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e24102790 0x7f7e24102b70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7e14009c10 tx=0x7f7e1402aa10 comp rx=0 tx=0).stop 2024-09-19T07:14:04.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.014+0000 7f7e2934e640 1 -- 172.21.15.162:0/3955952193 shutdown_connections 2024-09-19T07:14:04.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.014+0000 7f7e2934e640 1 --2- 172.21.15.162:0/3955952193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e24102790 0x7f7e24102b70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:04.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.014+0000 7f7e2934e640 1 -- 172.21.15.162:0/3955952193 >> 172.21.15.162:0/3955952193 conn(0x7f7e24077310 msgr2=0x7f7e240fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:04.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.014+0000 7f7e2934e640 1 -- 172.21.15.162:0/3955952193 shutdown_connections 2024-09-19T07:14:04.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.014+0000 7f7e2934e640 1 -- 172.21.15.162:0/3955952193 wait complete. 2024-09-19T07:14:04.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.015+0000 7f7e2934e640 1 Processor -- start 2024-09-19T07:14:04.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.015+0000 7f7e2934e640 1 -- start start 2024-09-19T07:14:04.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.015+0000 7f7e2934e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e24102790 0x7f7e241003f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:04.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.015+0000 7f7e2934e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2410bc80 con 0x7f7e24102790 2024-09-19T07:14:04.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.016+0000 7f7e22ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e24102790 0x7f7e241003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.016+0000 7f7e22ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e24102790 0x7f7e241003f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.162:36122/0 (socket says 172.21.15.162:36122) 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.016+0000 7f7e22ffd640 1 -- 172.21.15.162:0/2875014317 learned_addr learned my addr 172.21.15.162:0/2875014317 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.016+0000 7f7e22ffd640 1 -- 172.21.15.162:0/2875014317 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e241022e0 con 0x7f7e24102790 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.016+0000 7f7e22ffd640 1 --2- 172.21.15.162:0/2875014317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e24102790 0x7f7e241003f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7e14005dd0 tx=0x7f7e14030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.016+0000 7f7e1bfff640 1 -- 172.21.15.162:0/2875014317 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e14034070 con 0x7f7e24102790 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.016+0000 7f7e2934e640 1 -- 172.21.15.162:0/2875014317 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e24100930 con 0x7f7e24102790 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.016+0000 7f7e1bfff640 1 -- 172.21.15.162:0/2875014317 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e1402f8c0 con 0x7f7e24102790 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.016+0000 7f7e1bfff640 1 -- 172.21.15.162:0/2875014317 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e14004520 con 0x7f7e24102790 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.016+0000 7f7e2934e640 1 -- 172.21.15.162:0/2875014317 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e24100d30 con 0x7f7e24102790 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.017+0000 7f7e1bfff640 1 -- 172.21.15.162:0/2875014317 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7e14037020 con 0x7f7e24102790 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.017+0000 7f7e2934e640 1 -- 172.21.15.162:0/2875014317 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e24069f30 con 0x7f7e24102790 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.017+0000 7f7e1bfff640 1 --2- 172.21.15.162:0/2875014317 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7e10039300 0x7f7e1003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:04.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.017+0000 7f7e1bfff640 1 -- 172.21.15.162:0/2875014317 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7e1406d2d0 con 0x7f7e24102790 2024-09-19T07:14:04.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.018+0000 7f7e227fc640 1 --2- 172.21.15.162:0/2875014317 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7e10039300 0x7f7e1003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:04.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.018+0000 7f7e227fc640 1 --2- 172.21.15.162:0/2875014317 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7e10039300 0x7f7e1003b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0098c0 tx=0x7f7e0c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:04.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.022+0000 7f7e1bfff640 1 -- 172.21.15.162:0/2875014317 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7e1403f070 con 0x7f7e24102790 2024-09-19T07:14:04.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.200+0000 7f7e2934e640 1 -- 172.21.15.162:0/2875014317 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi098:172.21.15.98=a;smithi139:172.21.15.139=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}) -- 0x7f7e24100fc0 con 0x7f7e10039300 2024-09-19T07:14:04.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.206+0000 7f7e1bfff640 1 -- 172.21.15.162:0/2875014317 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7e24100fc0 con 0x7f7e10039300 2024-09-19T07:14:04.206 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mon update... 2024-09-19T07:14:04.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.207+0000 7f7e2934e640 1 -- 172.21.15.162:0/2875014317 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7e10039300 msgr2=0x7f7e1003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:04.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.207+0000 7f7e2934e640 1 --2- 172.21.15.162:0/2875014317 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7e10039300 0x7f7e1003b7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0098c0 tx=0x7f7e0c006db0 comp rx=0 tx=0).stop 2024-09-19T07:14:04.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.207+0000 7f7e2934e640 1 -- 172.21.15.162:0/2875014317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e24102790 msgr2=0x7f7e241003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:04.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.207+0000 7f7e2934e640 1 --2- 172.21.15.162:0/2875014317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e24102790 0x7f7e241003f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7e14005dd0 tx=0x7f7e14030c30 comp rx=0 tx=0).stop 2024-09-19T07:14:04.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.208+0000 7f7e2934e640 1 -- 172.21.15.162:0/2875014317 shutdown_connections 2024-09-19T07:14:04.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.208+0000 7f7e2934e640 1 --2- 172.21.15.162:0/2875014317 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7e10039300 0x7f7e1003b7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:04.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.208+0000 7f7e2934e640 1 --2- 172.21.15.162:0/2875014317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e24102790 0x7f7e241003f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:04.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.208+0000 7f7e2934e640 1 -- 172.21.15.162:0/2875014317 >> 172.21.15.162:0/2875014317 conn(0x7f7e24077310 msgr2=0x7f7e24103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:04.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.208+0000 7f7e2934e640 1 -- 172.21.15.162:0/2875014317 shutdown_connections 2024-09-19T07:14:04.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:04.208+0000 7f7e2934e640 1 -- 172.21.15.162:0/2875014317 wait complete. 2024-09-19T07:14:04.832 DEBUG:teuthology.orchestra.run.smithi139:mon.b> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T07:14:04.835 DEBUG:teuthology.orchestra.run.smithi162:mon.c> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T07:14:04.838 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T07:14:04.838 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T07:14:05.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T07:14:05.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:05.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:14:05.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:14:05.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:05.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:05.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:05.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:05.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:05.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:05.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:05.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:05.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:05.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:05.776 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:05.924 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:05 smithi098 ceph-mon[30950]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi098:172.21.15.98=a;smithi139:172.21.15.139=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:14:05.925 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:05 smithi098 ceph-mon[30950]: Saving service mon spec with placement smithi098:172.21.15.98=a;smithi139:172.21.15.139=b;smithi162:172.21.15.162=c;count:3 2024-09-19T07:14:05.925 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:05 smithi098 ceph-mon[30950]: Deploying daemon mon.c on smithi162 2024-09-19T07:14:05.925 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:05 smithi098 ceph-mon[30950]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:07.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.293+0000 7efd0de72640 1 -- 172.21.15.162:0/1018925951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd08102730 msgr2=0x7efd08102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:07.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.293+0000 7efd0de72640 1 --2- 172.21.15.162:0/1018925951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd08102730 0x7efd08102b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009810 tx=0x7efcf802a540 comp rx=0 tx=0).stop 2024-09-19T07:14:07.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.294+0000 7efd0de72640 1 -- 172.21.15.162:0/1018925951 shutdown_connections 2024-09-19T07:14:07.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.294+0000 7efd0de72640 1 --2- 172.21.15.162:0/1018925951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd08102730 0x7efd08102b10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:07.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.294+0000 7efd0de72640 1 -- 172.21.15.162:0/1018925951 >> 172.21.15.162:0/1018925951 conn(0x7efd08077310 msgr2=0x7efd080fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:07.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.294+0000 7efd0de72640 1 -- 172.21.15.162:0/1018925951 shutdown_connections 2024-09-19T07:14:07.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.294+0000 7efd0de72640 1 -- 172.21.15.162:0/1018925951 wait complete. 2024-09-19T07:14:07.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.294+0000 7efd0de72640 1 Processor -- start 2024-09-19T07:14:07.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.294+0000 7efd0de72640 1 -- start start 2024-09-19T07:14:07.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.295+0000 7efd0de72640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd08102730 0x7efd081971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:07.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.295+0000 7efd0de72640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd0810bc80 con 0x7efd08102730 2024-09-19T07:14:07.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.295+0000 7efd077fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd08102730 0x7efd081971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.295+0000 7efd077fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd08102730 0x7efd081971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.162:50740/0 (socket says 172.21.15.162:50740) 2024-09-19T07:14:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.295+0000 7efd077fe640 1 -- 172.21.15.162:0/2548154921 learned_addr learned my addr 172.21.15.162:0/2548154921 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T07:14:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.295+0000 7efd077fe640 1 -- 172.21.15.162:0/2548154921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd081976f0 con 0x7efd08102730 2024-09-19T07:14:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.295+0000 7efd077fe640 1 --2- 172.21.15.162:0/2548154921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd08102730 0x7efd081971b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009930 tx=0x7efcf8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.295+0000 7efd04ff9640 1 -- 172.21.15.162:0/2548154921 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8031400 con 0x7efd08102730 2024-09-19T07:14:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.296+0000 7efd04ff9640 1 -- 172.21.15.162:0/2548154921 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcf80035f0 con 0x7efd08102730 2024-09-19T07:14:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.296+0000 7efd0de72640 1 -- 172.21.15.162:0/2548154921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd08197980 con 0x7efd08102730 2024-09-19T07:14:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.296+0000 7efd04ff9640 1 -- 172.21.15.162:0/2548154921 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf803c440 con 0x7efd08102730 2024-09-19T07:14:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.296+0000 7efd0de72640 1 -- 172.21.15.162:0/2548154921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd08197de0 con 0x7efd08102730 2024-09-19T07:14:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.296+0000 7efd04ff9640 1 -- 172.21.15.162:0/2548154921 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7efcf8039040 con 0x7efd08102730 2024-09-19T07:14:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.296+0000 7efd0de72640 1 -- 172.21.15.162:0/2548154921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd08069f90 con 0x7efd08102730 2024-09-19T07:14:07.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.297+0000 7efd04ff9640 1 --2- 172.21.15.162:0/2548154921 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7efcf00392a0 0x7efcf003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:07.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.297+0000 7efd04ff9640 1 -- 172.21.15.162:0/2548154921 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efcf806d730 con 0x7efd08102730 2024-09-19T07:14:07.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.297+0000 7efd06ffd640 1 --2- 172.21.15.162:0/2548154921 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7efcf00392a0 0x7efcf003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:07.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.298+0000 7efd06ffd640 1 --2- 172.21.15.162:0/2548154921 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7efcf00392a0 0x7efcf003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0098c0 tx=0x7efcfc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:07.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.301+0000 7efd04ff9640 1 -- 172.21.15.162:0/2548154921 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efcf8040030 con 0x7efd08102730 2024-09-19T07:14:07.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.547+0000 7efd0de72640 1 -- 172.21.15.162:0/2548154921 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7efd08198570 con 0x7efd08102730 2024-09-19T07:14:07.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.547+0000 7efd04ff9640 1 -- 172.21.15.162:0/2548154921 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7efcf804bde0 con 0x7efd08102730 2024-09-19T07:14:07.548 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:14:07.548 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":1,"fsid":"73438718-7656-11ef-bceb-c7b262605968","modified":"2024-09-19T07:12:41.724467Z","created":"2024-09-19T07:12:41.724467Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T07:14:07.548 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 1 2024-09-19T07:14:07.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.550+0000 7efd0de72640 1 -- 172.21.15.162:0/2548154921 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7efcf00392a0 msgr2=0x7efcf003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:07.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.550+0000 7efd0de72640 1 --2- 172.21.15.162:0/2548154921 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7efcf00392a0 0x7efcf003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0098c0 tx=0x7efcfc006db0 comp rx=0 tx=0).stop 2024-09-19T07:14:07.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.550+0000 7efd0de72640 1 -- 172.21.15.162:0/2548154921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd08102730 msgr2=0x7efd081971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:07.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.550+0000 7efd0de72640 1 --2- 172.21.15.162:0/2548154921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd08102730 0x7efd081971b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009930 tx=0x7efcf8004570 comp rx=0 tx=0).stop 2024-09-19T07:14:07.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.550+0000 7efd0de72640 1 -- 172.21.15.162:0/2548154921 shutdown_connections 2024-09-19T07:14:07.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.550+0000 7efd0de72640 1 --2- 172.21.15.162:0/2548154921 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7efcf00392a0 0x7efcf003b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:07.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.550+0000 7efd0de72640 1 --2- 172.21.15.162:0/2548154921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd08102730 0x7efd081971b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:07.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.550+0000 7efd0de72640 1 -- 172.21.15.162:0/2548154921 >> 172.21.15.162:0/2548154921 conn(0x7efd08077310 msgr2=0x7efd081054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:07.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.550+0000 7efd0de72640 1 -- 172.21.15.162:0/2548154921 shutdown_connections 2024-09-19T07:14:07.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:07.550+0000 7efd0de72640 1 -- 172.21.15.162:0/2548154921 wait complete. 2024-09-19T07:14:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:07 smithi098 ceph-mon[30950]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:07 smithi098 ceph-mon[30950]: from='client.? 172.21.15.162:0/2548154921' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:14:08.648 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T07:14:08.649 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T07:14:08.649 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T07:14:08.649 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_open_files: -1 2024-09-19T07:14:08.649 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T07:14:08.649 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T07:14:08.649 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T07:14:08.649 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T07:14:08.649 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_background_flushes: -1 2024-09-19T07:14:08.649 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Compression algorithms supported: 2024-09-19T07:14:08.649 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: kZSTD supported: 0 2024-09-19T07:14:08.649 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: kXpressCompression supported: 0 2024-09-19T07:14:08.649 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: kBZip2Compression supported: 0 2024-09-19T07:14:08.650 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T07:14:08.650 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: kLZ4Compression supported: 1 2024-09-19T07:14:08.650 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: kZlibCompression supported: 1 2024-09-19T07:14:08.650 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T07:14:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: kSnappyCompression supported: 1 2024-09-19T07:14:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T07:14:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T07:14:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T07:14:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T07:14:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.merge_operator: 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_filter: None 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fbc28cd320) 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: cache_index_and_filter_blocks: 1 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: pin_top_level_index_and_filter: 1 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: index_type: 0 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: data_block_index_type: 0 2024-09-19T07:14:09.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: index_shortening: 1 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: checksum: 4 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: no_block_cache: 0 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_cache: 0x55fbc28c11f0 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_cache_name: BinnedLRUCache 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_cache_options: 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: capacity : 536870912 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: num_shard_bits : 4 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: strict_capacity_limit : 0 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: high_pri_pool_ratio: 0.000 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_cache_compressed: (nil) 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: persistent_cache: (nil) 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_size: 4096 2024-09-19T07:14:09.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_size_deviation: 10 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_restart_interval: 16 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: index_block_restart_interval: 1 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: metadata_block_size: 4096 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: partition_filters: 0 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: use_delta_encoding: 1 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: filter_policy: bloomfilter 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: whole_key_filtering: 1 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: verify_compression: 0 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: read_amp_bytes_per_bit: 0 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: format_version: 5 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: enable_index_compression: 1 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: block_align: 0 2024-09-19T07:14:09.135 INFO:journalctl@ceph.mon.c.smithi162.stdout: max_auto_readahead_size: 262144 2024-09-19T07:14:09.136 INFO:journalctl@ceph.mon.c.smithi162.stdout: prepopulate_block_cache: 0 2024-09-19T07:14:09.136 INFO:journalctl@ceph.mon.c.smithi162.stdout: initial_auto_readahead_size: 8192 2024-09-19T07:14:09.136 INFO:journalctl@ceph.mon.c.smithi162.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T07:14:09.137 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T07:14:09.137 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T07:14:09.137 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compression: NoCompression 2024-09-19T07:14:09.137 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T07:14:09.137 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T07:14:09.137 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T07:14:09.137 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.num_levels: 7 2024-09-19T07:14:09.137 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T07:14:09.137 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T07:14:09.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T07:14:09.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T07:14:09.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:14:09.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:14:09.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T07:14:09.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T07:14:09.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:14:09.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T07:14:09.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T07:14:09.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T07:14:09.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T07:14:09.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T07:14:09.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T07:14:09.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T07:14:09.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T07:14:09.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T07:14:09.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T07:14:09.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T07:14:09.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.inplace_update_support: 0 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.bloom_locality: 0 2024-09-19T07:14:09.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.max_successive_merges: 0 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.ttl: 2592000 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.enable_blob_files: false 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.min_blob_size: 0 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T07:14:09.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 14edbc07-b79c-4c1b-be86-09962eb32545 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726730048647976, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726730048648381, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726730048, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "14edbc07-b79c-4c1b-be86-09962eb32545", "db_session_id": "1S5PX7F7PH1746MIBJBN", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726730048648476, "job": 1, "event": "recovery_finished"} 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T07:14:09.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fbc28eee00 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: DB pointer 0x55fbc29ea000 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout: ** DB Stats ** 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T07:14:09.145 INFO:journalctl@ceph.mon.c.smithi162.stdout: ** Compaction Stats [default] ** 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: ** Compaction Stats [default] ** 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:14:09.146 INFO:journalctl@ceph.mon.c.smithi162.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout: Cumulative compaction: 0.00 GB write, 0.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout: Interval compaction: 0.00 GB write, 0.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout: Block cache BinnedLRUCache@0x55fbc28c11f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T07:14:09.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: using public_addr v2:172.21.15.162:0/0 -> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: starting mon.c rank -1 at public addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] at bind addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(???) e0 preinit fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout: e1 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout: btime 2024-09-19T07:12:50:967629+0000 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout: legacy client fscid: -1 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout: 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout: No filesystems configured 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T07:14:09.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: Added host smithi162 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/625552689' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T07:14:09.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:09.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/625552689' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T07:14:09.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:14:09.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:09.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:09.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:09.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:09.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:09.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:09.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:09.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T07:14:09.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi098:172.21.15.98=a;smithi139:172.21.15.139=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: Saving service mon spec with placement smithi098:172.21.15.98=a;smithi139:172.21.15.139=b;smithi162:172.21.15.162=c;count:3 2024-09-19T07:14:09.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: Deploying daemon mon.c on smithi162 2024-09-19T07:14:09.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:09.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:09.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: from='client.? 172.21.15.162:0/2548154921' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:14:09.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 ceph-mon[35726]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T07:14:09.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 bash[35707]: 84c03fd703129bad6c867fd65e84839a3fa546335b0f1c1e0ce67f1586843984 2024-09-19T07:14:09.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:08 smithi162 systemd[1]: Started Ceph mon.c for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:14:09.159 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T07:14:09.160 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T07:14:09.417 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:14:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:14:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: mon.a calling monitor election 2024-09-19T07:14:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: mon.c calling monitor election 2024-09-19T07:14:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:14:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: monmap epoch 2 2024-09-19T07:14:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: last_changed 2024-09-19T07:14:08.674643+0000 2024-09-19T07:14:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: created 2024-09-19T07:12:41.724467+0000 2024-09-19T07:14:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: min_mon_release 19 (squid) 2024-09-19T07:14:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: election_strategy: 1 2024-09-19T07:14:14.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-19T07:14:14.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T07:14:14.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: fsmap 2024-09-19T07:14:14.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:14:14.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: mgrmap e13: x(active, since 37s) 2024-09-19T07:14:14.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: overall HEALTH_OK 2024-09-19T07:14:14.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:14.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:14.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:14.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:14.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: mon.a calling monitor election 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: mon.c calling monitor election 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:14:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: monmap epoch 2 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: last_changed 2024-09-19T07:14:08.674643+0000 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: created 2024-09-19T07:12:41.724467+0000 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: min_mon_release 19 (squid) 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: election_strategy: 1 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: fsmap 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: mgrmap e13: x(active, since 37s) 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: overall HEALTH_OK 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:14.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:14.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:14.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:14.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:14.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.229+0000 7f63d17ed640 1 -- 172.21.15.162:0/1082970760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8003530 msgr2=0x7f63b80059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:14.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.229+0000 7f63d17ed640 1 --2- 172.21.15.162:0/1082970760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8003530 0x7f63b80059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f63cc1016a0 tx=0x7f63bc02c490 comp rx=0 tx=0).stop 2024-09-19T07:14:14.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.229+0000 7f63d17ed640 1 -- 172.21.15.162:0/1082970760 shutdown_connections 2024-09-19T07:14:14.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.229+0000 7f63d17ed640 1 --2- 172.21.15.162:0/1082970760 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8003530 0x7f63b80059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.229+0000 7f63d17ed640 1 -- 172.21.15.162:0/1082970760 >> 172.21.15.162:0/1082970760 conn(0x7f63cc0fc220 msgr2=0x7f63cc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.229+0000 7f63d17ed640 1 -- 172.21.15.162:0/1082970760 shutdown_connections 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.229+0000 7f63d17ed640 1 -- 172.21.15.162:0/1082970760 wait complete. 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.230+0000 7f63d17ed640 1 Processor -- start 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.230+0000 7f63d17ed640 1 -- start start 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.230+0000 7f63d17ed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8003530 0x7f63cc198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.230+0000 7f63d17ed640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc198640 0x7f63cc198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.230+0000 7f63d17ed640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc108670 con 0x7f63b8003530 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.230+0000 7f63d17ed640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc1084f0 con 0x7f63cc198640 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.231+0000 7f63ca7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc198640 0x7f63cc198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.231+0000 7f63ca7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc198640 0x7f63cc198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:39706/0 (socket says 172.21.15.162:39706) 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.231+0000 7f63ca7fc640 1 -- 172.21.15.162:0/1558947419 learned_addr learned my addr 172.21.15.162:0/1558947419 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T07:14:14.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.231+0000 7f63ca7fc640 1 -- 172.21.15.162:0/1558947419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc198640 msgr2=0x7f63cc198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T07:14:14.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.231+0000 7f63ca7fc640 1 -- 172.21.15.162:0/1558947419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc198640 msgr2=0x7f63cc198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:14:14.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.231+0000 7f63caffd640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8003530 0x7f63cc198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:14.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.231+0000 7f63ca7fc640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc198640 0x7f63cc198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:14:14.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.231+0000 7f63ca7fc640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc198640 0x7f63cc198aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:14:14.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.231+0000 7f63caffd640 1 -- 172.21.15.162:0/1558947419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc198640 msgr2=0x7f63cc198aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:14:14.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.231+0000 7f63caffd640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc198640 0x7f63cc198aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:14.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.231+0000 7f63caffd640 1 -- 172.21.15.162:0/1558947419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63cc1a1170 con 0x7f63b8003530 2024-09-19T07:14:14.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.231+0000 7f63caffd640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8003530 0x7f63cc198100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f63bc036040 tx=0x7f63bc033680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:14.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.232+0000 7f63c3fff640 1 -- 172.21.15.162:0/1558947419 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f63bc032920 con 0x7f63b8003530 2024-09-19T07:14:14.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.232+0000 7f63c3fff640 1 -- 172.21.15.162:0/1558947419 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63bc041070 con 0x7f63b8003530 2024-09-19T07:14:14.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.232+0000 7f63d17ed640 1 -- 172.21.15.162:0/1558947419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63cc1a1340 con 0x7f63b8003530 2024-09-19T07:14:14.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.232+0000 7f63c3fff640 1 -- 172.21.15.162:0/1558947419 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f63bc004970 con 0x7f63b8003530 2024-09-19T07:14:14.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.232+0000 7f63d17ed640 1 -- 172.21.15.162:0/1558947419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63cc1a1840 con 0x7f63b8003530 2024-09-19T07:14:14.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.233+0000 7f63c3fff640 1 -- 172.21.15.162:0/1558947419 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f63bc004c20 con 0x7f63b8003530 2024-09-19T07:14:14.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.233+0000 7f63c3fff640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63ac039090 0x7f63ac03b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:14.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.233+0000 7f63d17ed640 1 -- 172.21.15.162:0/1558947419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63cc101ca0 con 0x7f63b8003530 2024-09-19T07:14:14.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.233+0000 7f63c3fff640 1 -- 172.21.15.162:0/1558947419 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f63bc06e680 con 0x7f63b8003530 2024-09-19T07:14:14.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.233+0000 7f63ca7fc640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63ac039090 0x7f63ac03b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:14.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.234+0000 7f63ca7fc640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63ac039090 0x7f63ac03b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009100 tx=0x7f63b4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:14.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.238+0000 7f63c3fff640 1 -- 172.21.15.162:0/1558947419 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f63bc03a550 con 0x7f63b8003530 2024-09-19T07:14:14.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.473+0000 7f63d17ed640 1 -- 172.21.15.162:0/1558947419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f63cc18fe50 con 0x7f63b8003530 2024-09-19T07:14:14.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.474+0000 7f63c3fff640 1 -- 172.21.15.162:0/1558947419 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f63bc03a2f0 con 0x7f63b8003530 2024-09-19T07:14:14.475 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:14:14.475 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"73438718-7656-11ef-bceb-c7b262605968","modified":"2024-09-19T07:14:08.674643Z","created":"2024-09-19T07:12:41.724467Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T07:14:14.475 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-09-19T07:14:14.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.476+0000 7f63d17ed640 1 -- 172.21.15.162:0/1558947419 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63ac039090 msgr2=0x7f63ac03b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:14.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.476+0000 7f63d17ed640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63ac039090 0x7f63ac03b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f63b4009100 tx=0x7f63b4008040 comp rx=0 tx=0).stop 2024-09-19T07:14:14.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.476+0000 7f63d17ed640 1 -- 172.21.15.162:0/1558947419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8003530 msgr2=0x7f63cc198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:14.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.476+0000 7f63d17ed640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8003530 0x7f63cc198100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f63bc036040 tx=0x7f63bc033680 comp rx=0 tx=0).stop 2024-09-19T07:14:14.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.476+0000 7f63d17ed640 1 -- 172.21.15.162:0/1558947419 shutdown_connections 2024-09-19T07:14:14.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.476+0000 7f63d17ed640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63ac039090 0x7f63ac03b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:14.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.476+0000 7f63d17ed640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63cc198640 0x7f63cc198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:14.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.476+0000 7f63d17ed640 1 --2- 172.21.15.162:0/1558947419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8003530 0x7f63cc198100 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:14.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.476+0000 7f63d17ed640 1 -- 172.21.15.162:0/1558947419 >> 172.21.15.162:0/1558947419 conn(0x7f63cc0fc220 msgr2=0x7f63cc0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:14.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.476+0000 7f63d17ed640 1 -- 172.21.15.162:0/1558947419 shutdown_connections 2024-09-19T07:14:14.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:14.476+0000 7f63d17ed640 1 -- 172.21.15.162:0/1558947419 wait complete. 2024-09-19T07:14:15.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:14 smithi098 ceph-mon[30950]: Deploying daemon mon.b on smithi139 2024-09-19T07:14:15.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:14 smithi098 ceph-mon[30950]: from='client.? 172.21.15.162:0/1558947419' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:14:15.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:14 smithi098 ceph-mon[30950]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:15.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:15.081 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:14 smithi162 ceph-mon[35726]: Deploying daemon mon.b on smithi139 2024-09-19T07:14:15.081 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:14 smithi162 ceph-mon[35726]: from='client.? 172.21.15.162:0/1558947419' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:14:15.081 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:14 smithi162 ceph-mon[35726]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:15.081 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:16.109 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T07:14:16.110 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T07:14:16.374 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:14:16.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.834+0000 7fbce4bc9640 1 -- 172.21.15.162:0/1445481753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce0107670 msgr2=0x7fbce0107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:16.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.834+0000 7fbce4bc9640 1 --2- 172.21.15.162:0/1445481753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce0107670 0x7fbce0107a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009880 tx=0x7fbcd002a5d0 comp rx=0 tx=0).stop 2024-09-19T07:14:16.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.834+0000 7fbce4bc9640 1 -- 172.21.15.162:0/1445481753 shutdown_connections 2024-09-19T07:14:16.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.834+0000 7fbce4bc9640 1 --2- 172.21.15.162:0/1445481753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce0107670 0x7fbce0107a50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:16.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.834+0000 7fbce4bc9640 1 -- 172.21.15.162:0/1445481753 >> 172.21.15.162:0/1445481753 conn(0x7fbce00fd330 msgr2=0x7fbce00ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:16.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.834+0000 7fbce4bc9640 1 -- 172.21.15.162:0/1445481753 shutdown_connections 2024-09-19T07:14:16.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.834+0000 7fbce4bc9640 1 -- 172.21.15.162:0/1445481753 wait complete. 2024-09-19T07:14:16.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbce4bc9640 1 Processor -- start 2024-09-19T07:14:16.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbce4bc9640 1 -- start start 2024-09-19T07:14:16.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbce4bc9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce0107670 0x7fbce0197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:16.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbce4bc9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce01979a0 0x7fbce019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:16.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbce4bc9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbce010bd30 con 0x7fbce01979a0 2024-09-19T07:14:16.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbce4bc9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbce010bbb0 con 0x7fbce0107670 2024-09-19T07:14:16.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbcde59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce0107670 0x7fbce0197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:16.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbcde59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce0107670 0x7fbce0197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:49010/0 (socket says 172.21.15.162:49010) 2024-09-19T07:14:16.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbcde59c640 1 -- 172.21.15.162:0/2414054935 learned_addr learned my addr 172.21.15.162:0/2414054935 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T07:14:16.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbcddd9b640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce01979a0 0x7fbce019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:16.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbcde59c640 1 -- 172.21.15.162:0/2414054935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce0107670 msgr2=0x7fbce0197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T07:14:16.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbcde59c640 1 -- 172.21.15.162:0/2414054935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce0107670 msgr2=0x7fbce0197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:14:16.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbcde59c640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce0107670 0x7fbce0197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:14:16.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.835+0000 7fbcde59c640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce0107670 0x7fbce0197460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:14:16.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.836+0000 7fbcddd9b640 1 -- 172.21.15.162:0/2414054935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce0107670 msgr2=0x7fbce0197460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:14:16.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.836+0000 7fbcddd9b640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce0107670 0x7fbce0197460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:16.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.836+0000 7fbcddd9b640 1 -- 172.21.15.162:0/2414054935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce0197fc0 con 0x7fbce01979a0 2024-09-19T07:14:16.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.836+0000 7fbcddd9b640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce01979a0 0x7fbce019bd30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400b3d0 tx=0x7fbcd400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:16.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.836+0000 7fbccf7fe640 1 -- 172.21.15.162:0/2414054935 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fbcd4011630 con 0x7fbce01979a0 2024-09-19T07:14:16.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.836+0000 7fbccf7fe640 1 -- 172.21.15.162:0/2414054935 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcd4011cb0 con 0x7fbce01979a0 2024-09-19T07:14:16.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.836+0000 7fbce4bc9640 1 -- 172.21.15.162:0/2414054935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce019c270 con 0x7fbce01979a0 2024-09-19T07:14:16.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.836+0000 7fbccf7fe640 1 -- 172.21.15.162:0/2414054935 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fbcd4010df0 con 0x7fbce01979a0 2024-09-19T07:14:16.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.836+0000 7fbce4bc9640 1 -- 172.21.15.162:0/2414054935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce019c7b0 con 0x7fbce01979a0 2024-09-19T07:14:16.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.837+0000 7fbccf7fe640 1 -- 172.21.15.162:0/2414054935 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fbcd4018020 con 0x7fbce01979a0 2024-09-19T07:14:16.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.837+0000 7fbce4bc9640 1 -- 172.21.15.162:0/2414054935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce0102db0 con 0x7fbce01979a0 2024-09-19T07:14:16.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.837+0000 7fbccf7fe640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbcc8039040 0x7fbcc803b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:16.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.837+0000 7fbccf7fe640 1 -- 172.21.15.162:0/2414054935 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbcd404cfe0 con 0x7fbce01979a0 2024-09-19T07:14:16.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.838+0000 7fbcde59c640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbcc8039040 0x7fbcc803b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:16.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.838+0000 7fbcde59c640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbcc8039040 0x7fbcc803b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00096c0 tx=0x7fbcd0005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:16.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:16.842+0000 7fbccf7fe640 1 -- 172.21.15.162:0/2414054935 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbcd401f020 con 0x7fbce01979a0 2024-09-19T07:14:17.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.080+0000 7fbce4bc9640 1 -- 172.21.15.162:0/2414054935 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fbce019cac0 con 0x7fbce01979a0 2024-09-19T07:14:17.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.081+0000 7fbccf7fe640 1 -- 172.21.15.162:0/2414054935 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fbcd4018310 con 0x7fbce01979a0 2024-09-19T07:14:17.082 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:14:17.082 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"73438718-7656-11ef-bceb-c7b262605968","modified":"2024-09-19T07:14:08.674643Z","created":"2024-09-19T07:12:41.724467Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T07:14:17.082 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-09-19T07:14:17.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.083+0000 7fbce4bc9640 1 -- 172.21.15.162:0/2414054935 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbcc8039040 msgr2=0x7fbcc803b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:17.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.083+0000 7fbce4bc9640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbcc8039040 0x7fbcc803b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00096c0 tx=0x7fbcd0005a40 comp rx=0 tx=0).stop 2024-09-19T07:14:17.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.083+0000 7fbce4bc9640 1 -- 172.21.15.162:0/2414054935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce01979a0 msgr2=0x7fbce019bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:17.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.083+0000 7fbce4bc9640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce01979a0 0x7fbce019bd30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400b3d0 tx=0x7fbcd400b890 comp rx=0 tx=0).stop 2024-09-19T07:14:17.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.084+0000 7fbce4bc9640 1 -- 172.21.15.162:0/2414054935 shutdown_connections 2024-09-19T07:14:17.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.084+0000 7fbce4bc9640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbcc8039040 0x7fbcc803b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:17.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.084+0000 7fbce4bc9640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbce01979a0 0x7fbce019bd30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:17.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.084+0000 7fbce4bc9640 1 --2- 172.21.15.162:0/2414054935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce0107670 0x7fbce0197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:17.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.084+0000 7fbce4bc9640 1 -- 172.21.15.162:0/2414054935 >> 172.21.15.162:0/2414054935 conn(0x7fbce00fd330 msgr2=0x7fbce00fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:17.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.084+0000 7fbce4bc9640 1 -- 172.21.15.162:0/2414054935 shutdown_connections 2024-09-19T07:14:17.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:17.084+0000 7fbce4bc9640 1 -- 172.21.15.162:0/2414054935 wait complete. 2024-09-19T07:14:17.311 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 podman[35021]: 2024-09-19 07:14:17.185336735 +0000 UTC m=+0.015475074 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:14:17.311 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 podman[35021]: 2024-09-19 07:14:17.310725878 +0000 UTC m=+0.140864260 container create a8c956391da0bf59958e245fd37c0301a03e4f3acfd5979fd5300f4125f80a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:14:17.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 podman[35021]: 2024-09-19 07:14:17.554602278 +0000 UTC m=+0.384740620 container init a8c956391da0bf59958e245fd37c0301a03e4f3acfd5979fd5300f4125f80a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:14:17.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 podman[35021]: 2024-09-19 07:14:17.55798723 +0000 UTC m=+0.388125572 container start a8c956391da0bf59958e245fd37c0301a03e4f3acfd5979fd5300f4125f80a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-b, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T07:14:18.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T07:14:18.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T07:14:18.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: pidfile_write: ignore empty --pid-file 2024-09-19T07:14:18.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: load: jerasure load: lrc 2024-09-19T07:14:18.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: RocksDB version: 7.9.2 2024-09-19T07:14:18.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Git sha 0 2024-09-19T07:14:18.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T07:14:18.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: DB SUMMARY 2024-09-19T07:14:18.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: DB Session ID: 8CPJ6GL0GHZNQ2OV2AI4 2024-09-19T07:14:18.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: CURRENT file: CURRENT 2024-09-19T07:14:18.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T07:14:18.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T07:14:18.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-19T07:14:18.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-19T07:14:18.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.error_if_exists: 0 2024-09-19T07:14:18.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.create_if_missing: 0 2024-09-19T07:14:18.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.paranoid_checks: 1 2024-09-19T07:14:18.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T07:14:18.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T07:14:18.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T07:14:18.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.env: 0x558ce3fce940 2024-09-19T07:14:18.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T07:14:18.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.info_log: 0x558ce65736e0 2024-09-19T07:14:18.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T07:14:18.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.statistics: (nil) 2024-09-19T07:14:18.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.use_fsync: 0 2024-09-19T07:14:18.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_log_file_size: 0 2024-09-19T07:14:18.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T07:14:18.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T07:14:18.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T07:14:18.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T07:14:18.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.allow_fallocate: 1 2024-09-19T07:14:18.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T07:14:18.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.use_direct_reads: 0 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.db_log_dir: 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.wal_dir: 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T07:14:18.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.write_buffer_manager: 0x558ce6582dc0 2024-09-19T07:14:18.072 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T07:14:18.072 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T07:14:18.072 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T07:14:18.072 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T07:14:18.072 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T07:14:18.072 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T07:14:18.072 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T07:14:18.072 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T07:14:18.072 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.unordered_write: 0 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.row_cache: None 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.wal_filter: None 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.two_write_queues: 0 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.wal_compression: 0 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.atomic_flush: 0 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T07:14:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T07:14:18.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T07:14:18.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.log_readahead_size: 0 2024-09-19T07:14:18.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T07:14:18.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T07:14:18.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T07:14:18.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T07:14:18.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T07:14:18.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T07:14:18.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T07:14:18.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_background_jobs: 2 2024-09-19T07:14:18.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_background_compactions: -1 2024-09-19T07:14:18.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_subcompactions: 1 2024-09-19T07:14:18.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T07:14:18.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T07:14:18.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T07:14:18.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T07:14:18.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T07:14:18.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T07:14:18.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T07:14:18.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T07:14:18.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_open_files: -1 2024-09-19T07:14:18.078 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T07:14:18.078 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T07:14:18.078 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T07:14:18.078 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T07:14:18.078 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_background_flushes: -1 2024-09-19T07:14:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Compression algorithms supported: 2024-09-19T07:14:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: kZSTD supported: 0 2024-09-19T07:14:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: kXpressCompression supported: 0 2024-09-19T07:14:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: kBZip2Compression supported: 0 2024-09-19T07:14:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T07:14:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: kLZ4Compression supported: 1 2024-09-19T07:14:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: kZlibCompression supported: 1 2024-09-19T07:14:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T07:14:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: kSnappyCompression supported: 1 2024-09-19T07:14:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T07:14:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T07:14:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-19T07:14:18.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T07:14:18.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T07:14:18.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.merge_operator: 2024-09-19T07:14:18.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_filter: None 2024-09-19T07:14:18.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T07:14:18.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T07:14:18.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T07:14:18.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T07:14:18.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558ce6573320) 2024-09-19T07:14:18.082 INFO:journalctl@ceph.mon.b.smithi139.stdout: cache_index_and_filter_blocks: 1 2024-09-19T07:14:18.082 INFO:journalctl@ceph.mon.b.smithi139.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T07:14:18.082 INFO:journalctl@ceph.mon.b.smithi139.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T07:14:18.082 INFO:journalctl@ceph.mon.b.smithi139.stdout: pin_top_level_index_and_filter: 1 2024-09-19T07:14:18.083 INFO:journalctl@ceph.mon.b.smithi139.stdout: index_type: 0 2024-09-19T07:14:18.083 INFO:journalctl@ceph.mon.b.smithi139.stdout: data_block_index_type: 0 2024-09-19T07:14:18.083 INFO:journalctl@ceph.mon.b.smithi139.stdout: index_shortening: 1 2024-09-19T07:14:18.083 INFO:journalctl@ceph.mon.b.smithi139.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T07:14:18.083 INFO:journalctl@ceph.mon.b.smithi139.stdout: checksum: 4 2024-09-19T07:14:18.083 INFO:journalctl@ceph.mon.b.smithi139.stdout: no_block_cache: 0 2024-09-19T07:14:18.083 INFO:journalctl@ceph.mon.b.smithi139.stdout: block_cache: 0x558ce65671f0 2024-09-19T07:14:18.083 INFO:journalctl@ceph.mon.b.smithi139.stdout: block_cache_name: BinnedLRUCache 2024-09-19T07:14:18.083 INFO:journalctl@ceph.mon.b.smithi139.stdout: block_cache_options: 2024-09-19T07:14:18.083 INFO:journalctl@ceph.mon.b.smithi139.stdout: capacity : 536870912 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: num_shard_bits : 4 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: strict_capacity_limit : 0 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: high_pri_pool_ratio: 0.000 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: block_cache_compressed: (nil) 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: persistent_cache: (nil) 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: block_size: 4096 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: block_size_deviation: 10 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: block_restart_interval: 16 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: index_block_restart_interval: 1 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: metadata_block_size: 4096 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: partition_filters: 0 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: use_delta_encoding: 1 2024-09-19T07:14:18.084 INFO:journalctl@ceph.mon.b.smithi139.stdout: filter_policy: bloomfilter 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout: whole_key_filtering: 1 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout: verify_compression: 0 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout: read_amp_bytes_per_bit: 0 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout: format_version: 5 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout: enable_index_compression: 1 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout: block_align: 0 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout: max_auto_readahead_size: 262144 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout: prepopulate_block_cache: 0 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout: initial_auto_readahead_size: 8192 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T07:14:18.085 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compression: NoCompression 2024-09-19T07:14:18.086 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T07:14:18.086 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T07:14:18.086 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T07:14:18.086 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.num_levels: 7 2024-09-19T07:14:18.086 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T07:14:18.086 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T07:14:18.087 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T07:14:18.087 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T07:14:18.087 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T07:14:18.087 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T07:14:18.087 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T07:14:18.087 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:14:18.088 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T07:14:18.088 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T07:14:18.088 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:14:18.088 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:14:18.088 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T07:14:18.088 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T07:14:18.088 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T07:14:18.088 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T07:14:18.088 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T07:14:18.088 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T07:14:18.089 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T07:14:18.089 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T07:14:18.089 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T07:14:18.089 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T07:14:18.089 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T07:14:18.089 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T07:14:18.089 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T07:14:18.089 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T07:14:18.089 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T07:14:18.089 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T07:14:18.089 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T07:14:18.090 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.inplace_update_support: 0 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T07:14:18.091 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.bloom_locality: 0 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.max_successive_merges: 0 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.ttl: 2592000 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T07:14:18.092 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.enable_blob_files: false 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.min_blob_size: 0 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 43d7256b-72ef-432d-b368-4d0a301b5c2f 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726730057585854, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T07:14:18.093 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T07:14:18.094 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726730057586420, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726730057, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "43d7256b-72ef-432d-b368-4d0a301b5c2f", "db_session_id": "8CPJ6GL0GHZNQ2OV2AI4", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T07:14:18.094 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726730057586549, "job": 1, "event": "recovery_finished"} 2024-09-19T07:14:18.094 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T07:14:18.094 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T07:14:18.094 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558ce6594e00 2024-09-19T07:14:18.094 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: DB pointer 0x558ce6690000 2024-09-19T07:14:18.094 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T07:14:18.094 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T07:14:18.094 INFO:journalctl@ceph.mon.b.smithi139.stdout: ** DB Stats ** 2024-09-19T07:14:18.094 INFO:journalctl@ceph.mon.b.smithi139.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:14:18.094 INFO:journalctl@ceph.mon.b.smithi139.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: ** Compaction Stats [default] ** 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:14:18.095 INFO:journalctl@ceph.mon.b.smithi139.stdout: 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: ** Compaction Stats [default] ** 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T07:14:18.096 INFO:journalctl@ceph.mon.b.smithi139.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout: Block cache BinnedLRUCache@0x558ce65671f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout: 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: using public_addr v2:172.21.15.139:0/0 -> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: starting mon.b rank -1 at public addrs [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] at bind addrs [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(???) e0 preinit fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T07:14:18.097 INFO:journalctl@ceph.mon.b.smithi139.stdout: e1 2024-09-19T07:14:18.098 INFO:journalctl@ceph.mon.b.smithi139.stdout: btime 2024-09-19T07:12:50:967629+0000 2024-09-19T07:14:18.098 INFO:journalctl@ceph.mon.b.smithi139.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:14:18.098 INFO:journalctl@ceph.mon.b.smithi139.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:14:18.098 INFO:journalctl@ceph.mon.b.smithi139.stdout: legacy client fscid: -1 2024-09-19T07:14:18.098 INFO:journalctl@ceph.mon.b.smithi139.stdout: 2024-09-19T07:14:18.098 INFO:journalctl@ceph.mon.b.smithi139.stdout: No filesystems configured 2024-09-19T07:14:18.098 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T07:14:18.098 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T07:14:18.098 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T07:14:18.098 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T07:14:18.098 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T07:14:18.098 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: Added host smithi162 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/625552689' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/625552689' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.099 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.100 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi098:172.21.15.98=a;smithi139:172.21.15.139=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: Saving service mon spec with placement smithi098:172.21.15.98=a;smithi139:172.21.15.139=b;smithi162:172.21.15.162=c;count:3 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: Deploying daemon mon.c on smithi162 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='client.? 172.21.15.162:0/2548154921' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:18.101 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.a calling monitor election 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.c calling monitor election 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: monmap epoch 2 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:18.102 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: last_changed 2024-09-19T07:14:08.674643+0000 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: created 2024-09-19T07:12:41.724467+0000 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: min_mon_release 19 (squid) 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: election_strategy: 1 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: fsmap 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mgrmap e13: x(active, since 37s) 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: overall HEALTH_OK 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:18.103 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:18.104 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: Deploying daemon mon.b on smithi139 2024-09-19T07:14:18.104 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='client.? 172.21.15.162:0/1558947419' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:14:18.104 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:18.104 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:18.104 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 ceph-mon[35039]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T07:14:18.104 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 bash[35021]: a8c956391da0bf59958e245fd37c0301a03e4f3acfd5979fd5300f4125f80a40 2024-09-19T07:14:18.104 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:17 smithi139 systemd[1]: Started Ceph mon.b for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:14:18.625 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T07:14:18.625 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T07:14:18.878 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:14:22.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.914+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1213071384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4cc003530 msgr2=0x7ff4cc0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:22.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.914+0000 7ff4e80c1640 1 --2- 172.21.15.162:0/1213071384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4cc003530 0x7ff4cc0059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0102b00 tx=0x7ff4dc02c3f0 comp rx=0 tx=0).stop 2024-09-19T07:14:22.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.914+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1213071384 shutdown_connections 2024-09-19T07:14:22.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.914+0000 7ff4e80c1640 1 --2- 172.21.15.162:0/1213071384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4cc003530 0x7ff4cc0059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:22.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.914+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1213071384 >> 172.21.15.162:0/1213071384 conn(0x7ff4e00fd330 msgr2=0x7ff4e00ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:22.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.915+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1213071384 shutdown_connections 2024-09-19T07:14:22.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.915+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1213071384 wait complete. 2024-09-19T07:14:22.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.915+0000 7ff4e80c1640 1 Processor -- start 2024-09-19T07:14:22.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e80c1640 1 -- start start 2024-09-19T07:14:22.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e80c1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4cc003530 0x7ff4e0197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:22.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e80c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4e0197880 0x7ff4e019bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:22.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e80c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4e019c150 0x7ff4e019c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:22.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e80c1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e0109730 con 0x7ff4cc003530 2024-09-19T07:14:22.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e80c1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e01095b0 con 0x7ff4e0197880 2024-09-19T07:14:22.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e80c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e01098b0 con 0x7ff4e019c150 2024-09-19T07:14:22.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e665e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4e019c150 0x7ff4e019c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:22.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e665e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4e019c150 0x7ff4e019c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:49022/0 (socket says 172.21.15.162:49022) 2024-09-19T07:14:22.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e5e5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4cc003530 0x7ff4e0197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:22.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e665e640 1 -- 172.21.15.162:0/1328895186 learned_addr learned my addr 172.21.15.162:0/1328895186 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T07:14:22.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e565c640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4e0197880 0x7ff4e019bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:22.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e665e640 1 -- 172.21.15.162:0/1328895186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4e019c150 msgr2=0x7ff4e019c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T07:14:22.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e665e640 1 -- 172.21.15.162:0/1328895186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4e019c150 msgr2=0x7ff4e019c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:14:22.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e665e640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4e019c150 0x7ff4e019c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:14:22.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e665e640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4e019c150 0x7ff4e019c600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:14:22.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e565c640 1 -- 172.21.15.162:0/1328895186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4e0197880 msgr2=0x7ff4e019bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T07:14:22.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e565c640 1 -- 172.21.15.162:0/1328895186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4e0197880 msgr2=0x7ff4e019bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:14:22.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e565c640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4e0197880 0x7ff4e019bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:14:22.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e5e5d640 1 -- 172.21.15.162:0/1328895186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4e019c150 msgr2=0x7ff4e019c600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e5e5d640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4e019c150 0x7ff4e019c600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e565c640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4e0197880 0x7ff4e019bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e5e5d640 1 -- 172.21.15.162:0/1328895186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4e0197880 msgr2=0x7ff4e019bc10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e5e5d640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4e0197880 0x7ff4e019bc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.916+0000 7ff4e5e5d640 1 -- 172.21.15.162:0/1328895186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e0074420 con 0x7ff4cc003530 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.917+0000 7ff4e5e5d640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4cc003530 0x7ff4e0197340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc036040 tx=0x7ff4dc034c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.917+0000 7ff4d6ffd640 1 -- 172.21.15.162:0/1328895186 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0054e0 con 0x7ff4cc003530 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.917+0000 7ff4d6ffd640 1 -- 172.21.15.162:0/1328895186 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4dc003ad0 con 0x7ff4cc003530 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.917+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1328895186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e00746b0 con 0x7ff4cc003530 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.917+0000 7ff4d6ffd640 1 -- 172.21.15.162:0/1328895186 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc012a30 con 0x7ff4cc003530 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.917+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1328895186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e0074c40 con 0x7ff4cc003530 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.918+0000 7ff4d6ffd640 1 -- 172.21.15.162:0/1328895186 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7ff4dc012bd0 con 0x7ff4cc003530 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.918+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1328895186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e010a860 con 0x7ff4cc003530 2024-09-19T07:14:22.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.918+0000 7ff4d6ffd640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff4c4039730 0x7ff4c403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:22.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.918+0000 7ff4d6ffd640 1 -- 172.21.15.162:0/1328895186 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff4dc06e690 con 0x7ff4cc003530 2024-09-19T07:14:22.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.918+0000 7ff4e565c640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff4c4039730 0x7ff4c403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:22.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.919+0000 7ff4e565c640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff4c4039730 0x7ff4c403bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0006fd0 tx=0x7ff4d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:22.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:22.923+0000 7ff4d6ffd640 1 -- 172.21.15.162:0/1328895186 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff4dc044300 con 0x7ff4cc003530 2024-09-19T07:14:23.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:14:23.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: mon.a calling monitor election 2024-09-19T07:14:23.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: mon.c calling monitor election 2024-09-19T07:14:23.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:23.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:23.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:23.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: monmap epoch 3 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: last_changed 2024-09-19T07:14:17.614878+0000 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: created 2024-09-19T07:12:41.724467+0000 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: min_mon_release 19 (squid) 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: election_strategy: 1 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: 2: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: fsmap 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:14:23.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: mgrmap e13: x(active, since 46s) 2024-09-19T07:14:23.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: overall HEALTH_OK 2024-09-19T07:14:23.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:23.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:23.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:23.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:22 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:23.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:14:23.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: mon.a calling monitor election 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: mon.c calling monitor election 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: monmap epoch 3 2024-09-19T07:14:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: last_changed 2024-09-19T07:14:17.614878+0000 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: created 2024-09-19T07:12:41.724467+0000 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: min_mon_release 19 (squid) 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: election_strategy: 1 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: 2: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: fsmap 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: mgrmap e13: x(active, since 46s) 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: overall HEALTH_OK 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:23.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:22 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:23.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.176+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1328895186 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff4e0074ea0 con 0x7ff4cc003530 2024-09-19T07:14:23.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.177+0000 7ff4d6ffd640 1 -- 172.21.15.162:0/1328895186 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7ff4dc031d40 con 0x7ff4cc003530 2024-09-19T07:14:23.178 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:14:23.178 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":3,"fsid":"73438718-7656-11ef-bceb-c7b262605968","modified":"2024-09-19T07:14:17.614878Z","created":"2024-09-19T07:12:41.724467Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T07:14:23.178 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 3 2024-09-19T07:14:23.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.179+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1328895186 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff4c4039730 msgr2=0x7ff4c403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:23.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.179+0000 7ff4e80c1640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff4c4039730 0x7ff4c403bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0006fd0 tx=0x7ff4d0008040 comp rx=0 tx=0).stop 2024-09-19T07:14:23.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.179+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1328895186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4cc003530 msgr2=0x7ff4e0197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:23.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.179+0000 7ff4e80c1640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4cc003530 0x7ff4e0197340 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc036040 tx=0x7ff4dc034c50 comp rx=0 tx=0).stop 2024-09-19T07:14:23.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.179+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1328895186 shutdown_connections 2024-09-19T07:14:23.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.179+0000 7ff4e80c1640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff4c4039730 0x7ff4c403bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.179+0000 7ff4e80c1640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4e019c150 0x7ff4e019c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.179+0000 7ff4e80c1640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff4e0197880 0x7ff4e019bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.179+0000 7ff4e80c1640 1 --2- 172.21.15.162:0/1328895186 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff4cc003530 0x7ff4e0197340 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:23.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.179+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1328895186 >> 172.21.15.162:0/1328895186 conn(0x7ff4e00fd330 msgr2=0x7ff4e00ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:23.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.179+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1328895186 shutdown_connections 2024-09-19T07:14:23.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:23.179+0000 7ff4e80c1640 1 -- 172.21.15.162:0/1328895186 wait complete. 2024-09-19T07:14:23.870 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:23 smithi162 ceph-mon[35726]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:23.870 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:23.870 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:23 smithi162 ceph-mon[35726]: from='client.? 172.21.15.162:0/1328895186' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:14:23.870 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:23.898 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T07:14:23.899 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T07:14:24.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:23 smithi098 ceph-mon[30950]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:24.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:24.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:23 smithi098 ceph-mon[30950]: from='client.? 172.21.15.162:0/1328895186' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:14:24.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:24.154 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:24.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.597+0000 7fa8aec3e640 1 -- 172.21.15.98:0/2226030659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a8102730 msgr2=0x7fa8a8102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:24.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.597+0000 7fa8aec3e640 1 --2- 172.21.15.98:0/2226030659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a8102730 0x7fa8a8102b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009810 tx=0x7fa8a402a540 comp rx=0 tx=0).stop 2024-09-19T07:14:24.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.597+0000 7fa8aec3e640 1 -- 172.21.15.98:0/2226030659 shutdown_connections 2024-09-19T07:14:24.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.597+0000 7fa8aec3e640 1 --2- 172.21.15.98:0/2226030659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a8102730 0x7fa8a8102b10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.597+0000 7fa8aec3e640 1 -- 172.21.15.98:0/2226030659 >> 172.21.15.98:0/2226030659 conn(0x7fa8a8077310 msgr2=0x7fa8a80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.598+0000 7fa8aec3e640 1 -- 172.21.15.98:0/2226030659 shutdown_connections 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.598+0000 7fa8aec3e640 1 -- 172.21.15.98:0/2226030659 wait complete. 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.598+0000 7fa8aec3e640 1 Processor -- start 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.598+0000 7fa8aec3e640 1 -- start start 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8aec3e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a8102730 0x7fa8a8100390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8aec3e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a81008d0 0x7fa8a8100d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8aec3e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8a81a3520 0x7fa8a81a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8aec3e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a810bc80 con 0x7fa8a81008d0 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8aec3e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a810bb00 con 0x7fa8a8102730 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8aec3e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a810be00 con 0x7fa8a81a3520 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ac9da640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a8102730 0x7fa8a8100390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:24.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa89ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a81008d0 0x7fa8a8100d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:24.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ac9da640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a8102730 0x7fa8a8100390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:37866/0 (socket says 172.21.15.98:37866) 2024-09-19T07:14:24.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ac9da640 1 -- 172.21.15.98:0/3714676189 learned_addr learned my addr 172.21.15.98:0/3714676189 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:14:24.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ad1db640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8a81a3520 0x7fa8a81a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:24.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ac9da640 1 -- 172.21.15.98:0/3714676189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a8102730 msgr2=0x7fa8a8100390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T07:14:24.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ac9da640 1 -- 172.21.15.98:0/3714676189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a8102730 msgr2=0x7fa8a8100390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T07:14:24.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ac9da640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a8102730 0x7fa8a8100390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T07:14:24.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ac9da640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a8102730 0x7fa8a8100390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:14:24.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ad1db640 1 -- 172.21.15.98:0/3714676189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a8102730 msgr2=0x7fa8a8100390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:14:24.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ad1db640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a8102730 0x7fa8a8100390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:24.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ad1db640 1 -- 172.21.15.98:0/3714676189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a81008d0 msgr2=0x7fa8a8100d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ad1db640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a81008d0 0x7fa8a8100d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa8ad1db640 1 -- 172.21.15.98:0/3714676189 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a81a5fe0 con 0x7fa8a81a3520 2024-09-19T07:14:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.599+0000 7fa89ffff640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a81008d0 0x7fa8a8100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.600+0000 7fa8ad1db640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8a81a3520 0x7fa8a81a5910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000bd50 tx=0x7fa8a000be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.600+0000 7fa89dffb640 1 -- 172.21.15.98:0/3714676189 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0019070 con 0x7fa8a81a3520 2024-09-19T07:14:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.600+0000 7fa89dffb640 1 -- 172.21.15.98:0/3714676189 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8a0014920 con 0x7fa8a81a3520 2024-09-19T07:14:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.600+0000 7fa89dffb640 1 -- 172.21.15.98:0/3714676189 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0012990 con 0x7fa8a81a3520 2024-09-19T07:14:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.600+0000 7fa8aec3e640 1 -- 172.21.15.98:0/3714676189 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a81a62d0 con 0x7fa8a81a3520 2024-09-19T07:14:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.600+0000 7fa8aec3e640 1 -- 172.21.15.98:0/3714676189 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a81a67c0 con 0x7fa8a81a3520 2024-09-19T07:14:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.601+0000 7fa89dffb640 1 -- 172.21.15.98:0/3714676189 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa8a001c070 con 0x7fa8a81a3520 2024-09-19T07:14:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.602+0000 7fa89dffb640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa890039730 0x7fa89003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:24.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.602+0000 7fa89dffb640 1 -- 172.21.15.98:0/3714676189 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa8a004c100 con 0x7fa8a81a3520 2024-09-19T07:14:24.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.602+0000 7fa8aec3e640 1 -- 172.21.15.98:0/3714676189 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a8069f90 con 0x7fa8a81a3520 2024-09-19T07:14:24.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.602+0000 7fa8ac9da640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa890039730 0x7fa89003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:24.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.602+0000 7fa8ac9da640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa890039730 0x7fa89003bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa8a402ab30 tx=0x7fa8a4005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:24.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.608+0000 7fa89dffb640 1 -- 172.21.15.98:0/3714676189 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa8a0011df0 con 0x7fa8a81a3520 2024-09-19T07:14:24.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.787+0000 7fa8aec3e640 1 -- 172.21.15.98:0/3714676189 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fa8a81a6a80 con 0x7fa8a81a3520 2024-09-19T07:14:24.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.788+0000 7fa89dffb640 1 -- 172.21.15.98:0/3714676189 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7fa8a0014b40 con 0x7fa8a81a3520 2024-09-19T07:14:24.789 INFO:teuthology.orchestra.run.smithi098.stdout:# minimal ceph.conf for 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:24.790 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2024-09-19T07:14:24.790 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:24.790 INFO:teuthology.orchestra.run.smithi098.stdout: mon_host = [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-09-19T07:14:24.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.790+0000 7fa8aec3e640 1 -- 172.21.15.98:0/3714676189 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa890039730 msgr2=0x7fa89003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.790+0000 7fa8aec3e640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa890039730 0x7fa89003bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa8a402ab30 tx=0x7fa8a4005dc0 comp rx=0 tx=0).stop 2024-09-19T07:14:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.790+0000 7fa8aec3e640 1 -- 172.21.15.98:0/3714676189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8a81a3520 msgr2=0x7fa8a81a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.790+0000 7fa8aec3e640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8a81a3520 0x7fa8a81a5910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000bd50 tx=0x7fa8a000be40 comp rx=0 tx=0).stop 2024-09-19T07:14:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.791+0000 7fa8aec3e640 1 -- 172.21.15.98:0/3714676189 shutdown_connections 2024-09-19T07:14:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.791+0000 7fa8aec3e640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa890039730 0x7fa89003bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.791+0000 7fa8aec3e640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8a81a3520 0x7fa8a81a5910 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.791+0000 7fa8aec3e640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa8a81008d0 0x7fa8a8100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.791+0000 7fa8aec3e640 1 --2- 172.21.15.98:0/3714676189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa8a8102730 0x7fa8a8100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.791+0000 7fa8aec3e640 1 -- 172.21.15.98:0/3714676189 >> 172.21.15.98:0/3714676189 conn(0x7fa8a8077310 msgr2=0x7fa8a81035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.791+0000 7fa8aec3e640 1 -- 172.21.15.98:0/3714676189 shutdown_connections 2024-09-19T07:14:24.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:24.791+0000 7fa8aec3e640 1 -- 172.21.15.98:0/3714676189 wait complete. 2024-09-19T07:14:25.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:14:25.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: mon.a calling monitor election 2024-09-19T07:14:25.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: mon.c calling monitor election 2024-09-19T07:14:25.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:25.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: monmap epoch 3 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: last_changed 2024-09-19T07:14:17.614878+0000 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: created 2024-09-19T07:12:41.724467+0000 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: min_mon_release 19 (squid) 2024-09-19T07:14:25.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: election_strategy: 1 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: 2: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: fsmap 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: mgrmap e13: x(active, since 46s) 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: overall HEALTH_OK 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:25.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:25.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='client.? 172.21.15.162:0/1328895186' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T07:14:25.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:25.444 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: mon.b calling monitor election 2024-09-19T07:14:25.444 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-19T07:14:25.444 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-19T07:14:25.444 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T07:14:25.444 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:25.444 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: Updating smithi098:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:25.444 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:25.444 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: Updating smithi139:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:25.445 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: mon.b calling monitor election 2024-09-19T07:14:25.445 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: mon.c calling monitor election 2024-09-19T07:14:25.445 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: mon.a calling monitor election 2024-09-19T07:14:25.445 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T07:14:25.445 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: monmap epoch 3 2024-09-19T07:14:25.445 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:25.445 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: last_changed 2024-09-19T07:14:17.614878+0000 2024-09-19T07:14:25.445 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: created 2024-09-19T07:12:41.724467+0000 2024-09-19T07:14:25.445 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: min_mon_release 19 (squid) 2024-09-19T07:14:25.445 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: election_strategy: 1 2024-09-19T07:14:25.445 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-19T07:14:25.445 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: 2: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: fsmap 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: mgrmap e13: x(active, since 48s) 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: overall HEALTH_OK 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3714676189' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.446 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.447 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.447 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.447 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.447 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.447 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:25.447 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:14:25.448 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:25.476 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T07:14:25.477 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:14:25.477 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T07:14:25.505 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:14:25.505 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:14:25.571 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-19T07:14:25.572 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T07:14:25.596 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: mon.b calling monitor election 2024-09-19T07:14:25.596 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-19T07:14:25.597 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-19T07:14:25.597 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T07:14:25.597 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:25.597 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: Updating smithi098:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:25.597 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:25.597 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: Updating smithi139:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:25.597 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: mon.b calling monitor election 2024-09-19T07:14:25.597 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: mon.c calling monitor election 2024-09-19T07:14:25.597 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: mon.a calling monitor election 2024-09-19T07:14:25.597 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: monmap epoch 3 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: last_changed 2024-09-19T07:14:17.614878+0000 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: created 2024-09-19T07:12:41.724467+0000 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: min_mon_release 19 (squid) 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: election_strategy: 1 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: 2: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: fsmap 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: mgrmap e13: x(active, since 48s) 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: overall HEALTH_OK 2024-09-19T07:14:25.598 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3714676189' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:25.599 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:14:25.600 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:25.601 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-19T07:14:25.601 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:14:25.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: mon.b calling monitor election 2024-09-19T07:14:25.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-19T07:14:25.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-19T07:14:25.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T07:14:25.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:25.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: Updating smithi098:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:25.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:25.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: Updating smithi139:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:14:25.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: mon.b calling monitor election 2024-09-19T07:14:25.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: mon.c calling monitor election 2024-09-19T07:14:25.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: mon.a calling monitor election 2024-09-19T07:14:25.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T07:14:25.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: monmap epoch 3 2024-09-19T07:14:25.634 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:14:25.634 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: last_changed 2024-09-19T07:14:17.614878+0000 2024-09-19T07:14:25.634 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: created 2024-09-19T07:12:41.724467+0000 2024-09-19T07:14:25.634 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: min_mon_release 19 (squid) 2024-09-19T07:14:25.634 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: election_strategy: 1 2024-09-19T07:14:25.634 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: 0: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.a 2024-09-19T07:14:25.634 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.c 2024-09-19T07:14:25.634 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: 2: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-09-19T07:14:25.635 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: fsmap 2024-09-19T07:14:25.635 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T07:14:25.635 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: mgrmap e13: x(active, since 48s) 2024-09-19T07:14:25.635 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: overall HEALTH_OK 2024-09-19T07:14:25.635 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3714676189' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:25.636 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.636 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.636 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.636 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.636 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.636 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.636 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.636 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.636 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.637 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.637 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:25.637 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:25.637 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:14:25.637 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:25.667 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T07:14:25.667 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T07:14:25.697 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T07:14:25.697 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:14:25.766 INFO:tasks.cephadm:Adding mgr.x on smithi098 2024-09-19T07:14:25.766 INFO:tasks.cephadm:Adding mgr.y on smithi139 2024-09-19T07:14:25.767 INFO:tasks.cephadm:Adding mgr.z on smithi162 2024-09-19T07:14:25.767 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi098=x;smithi139=y;smithi162=z' 2024-09-19T07:14:26.048 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:14:26.408 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:26 smithi162 ceph-mon[35726]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T07:14:26.408 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:26 smithi162 ceph-mon[35726]: Reconfiguring daemon mon.a on smithi098 2024-09-19T07:14:26.409 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:26 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:26.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.430+0000 7fc36ae00640 1 -- 172.21.15.162:0/1917806013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3641016e0 msgr2=0x7fc364101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:26.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.430+0000 7fc36ae00640 1 --2- 172.21.15.162:0/1917806013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3641016e0 0x7fc364101ae0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009880 tx=0x7fc35c02a5d0 comp rx=0 tx=0).stop 2024-09-19T07:14:26.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.430+0000 7fc36ae00640 1 -- 172.21.15.162:0/1917806013 shutdown_connections 2024-09-19T07:14:26.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.430+0000 7fc36ae00640 1 --2- 172.21.15.162:0/1917806013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3641016e0 0x7fc364101ae0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:26.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.430+0000 7fc36ae00640 1 -- 172.21.15.162:0/1917806013 >> 172.21.15.162:0/1917806013 conn(0x7fc3640fce90 msgr2=0x7fc3640ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:26.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.430+0000 7fc36ae00640 1 -- 172.21.15.162:0/1917806013 shutdown_connections 2024-09-19T07:14:26.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.430+0000 7fc36ae00640 1 -- 172.21.15.162:0/1917806013 wait complete. 2024-09-19T07:14:26.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36ae00640 1 Processor -- start 2024-09-19T07:14:26.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36ae00640 1 -- start start 2024-09-19T07:14:26.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36ae00640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3641016e0 0x7fc364075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:26.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36ae00640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640745e0 0x7fc364074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:26.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36ae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc364074fa0 0x7fc3641a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:26.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36ae00640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc3641077f0 con 0x7fc3640745e0 2024-09-19T07:14:26.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36ae00640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc364107670 con 0x7fc3641016e0 2024-09-19T07:14:26.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36ae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc364107970 con 0x7fc364074fa0 2024-09-19T07:14:26.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36939d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc364074fa0 0x7fc3641a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:26.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36939d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc364074fa0 0x7fc3641a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60650/0 (socket says 172.21.15.162:60650) 2024-09-19T07:14:26.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36939d640 1 -- 172.21.15.162:0/1727401199 learned_addr learned my addr 172.21.15.162:0/1727401199 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T07:14:26.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc363fff640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640745e0 0x7fc364074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:26.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc368b9c640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3641016e0 0x7fc364075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:26.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36939d640 1 -- 172.21.15.162:0/1727401199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3641016e0 msgr2=0x7fc364075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:26.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36939d640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3641016e0 0x7fc364075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:26.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36939d640 1 -- 172.21.15.162:0/1727401199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640745e0 msgr2=0x7fc364074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:26.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36939d640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640745e0 0x7fc364074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:26.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.431+0000 7fc36939d640 1 -- 172.21.15.162:0/1727401199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3641a15b0 con 0x7fc364074fa0 2024-09-19T07:14:26.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.432+0000 7fc36939d640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc364074fa0 0x7fc3641a1020 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc35400ba50 tx=0x7fc35400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:26.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.432+0000 7fc361ffb640 1 -- 172.21.15.162:0/1727401199 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc354019070 con 0x7fc364074fa0 2024-09-19T07:14:26.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.432+0000 7fc361ffb640 1 -- 172.21.15.162:0/1727401199 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc35400cbe0 con 0x7fc364074fa0 2024-09-19T07:14:26.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.432+0000 7fc361ffb640 1 -- 172.21.15.162:0/1727401199 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3540076a0 con 0x7fc364074fa0 2024-09-19T07:14:26.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.432+0000 7fc36ae00640 1 -- 172.21.15.162:0/1727401199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3641a18a0 con 0x7fc364074fa0 2024-09-19T07:14:26.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.432+0000 7fc36ae00640 1 -- 172.21.15.162:0/1727401199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3641a1e10 con 0x7fc364074fa0 2024-09-19T07:14:26.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.433+0000 7fc361ffb640 1 -- 172.21.15.162:0/1727401199 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc35401c070 con 0x7fc364074fa0 2024-09-19T07:14:26.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.433+0000 7fc361ffb640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc350039730 0x7fc35003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:26.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.433+0000 7fc361ffb640 1 -- 172.21.15.162:0/1727401199 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc35404bdd0 con 0x7fc364074fa0 2024-09-19T07:14:26.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.433+0000 7fc36ae00640 1 -- 172.21.15.162:0/1727401199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3641905b0 con 0x7fc364074fa0 2024-09-19T07:14:26.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.433+0000 7fc368b9c640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc350039730 0x7fc35003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:26.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.434+0000 7fc368b9c640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc350039730 0x7fc35003bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc35c005ab0 tx=0x7fc35c0315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:26.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.438+0000 7fc361ffb640 1 -- 172.21.15.162:0/1727401199 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc35400e0a0 con 0x7fc364074fa0 2024-09-19T07:14:26.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:26 smithi098 ceph-mon[30950]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T07:14:26.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:26 smithi098 ceph-mon[30950]: Reconfiguring daemon mon.a on smithi098 2024-09-19T07:14:26.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:26 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:26.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.615+0000 7fc36ae00640 1 -- 172.21.15.162:0/1727401199 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi098=x;smithi139=y;smithi162=z", "target": ["mon-mgr", ""]}) -- 0x7fc3640626c0 con 0x7fc350039730 2024-09-19T07:14:26.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.620+0000 7fc361ffb640 1 -- 172.21.15.162:0/1727401199 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc3640626c0 con 0x7fc350039730 2024-09-19T07:14:26.621 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mgr update... 2024-09-19T07:14:26.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.622+0000 7fc36ae00640 1 -- 172.21.15.162:0/1727401199 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc350039730 msgr2=0x7fc35003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:26.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.622+0000 7fc36ae00640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc350039730 0x7fc35003bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc35c005ab0 tx=0x7fc35c0315d0 comp rx=0 tx=0).stop 2024-09-19T07:14:26.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.622+0000 7fc36ae00640 1 -- 172.21.15.162:0/1727401199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc364074fa0 msgr2=0x7fc3641a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:26.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.622+0000 7fc36ae00640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc364074fa0 0x7fc3641a1020 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc35400ba50 tx=0x7fc35400bf10 comp rx=0 tx=0).stop 2024-09-19T07:14:26.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.622+0000 7fc36ae00640 1 -- 172.21.15.162:0/1727401199 shutdown_connections 2024-09-19T07:14:26.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.622+0000 7fc36ae00640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc350039730 0x7fc35003bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:26.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.622+0000 7fc36ae00640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc364074fa0 0x7fc3641a1020 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:26.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.622+0000 7fc36ae00640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc3640745e0 0x7fc364074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:26.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.622+0000 7fc36ae00640 1 --2- 172.21.15.162:0/1727401199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc3641016e0 0x7fc364075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:26.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.622+0000 7fc36ae00640 1 -- 172.21.15.162:0/1727401199 >> 172.21.15.162:0/1727401199 conn(0x7fc3640fce90 msgr2=0x7fc3640fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:26.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.623+0000 7fc36ae00640 1 -- 172.21.15.162:0/1727401199 shutdown_connections 2024-09-19T07:14:26.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:14:26.623+0000 7fc36ae00640 1 -- 172.21.15.162:0/1727401199 wait complete. 2024-09-19T07:14:26.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:26 smithi139 ceph-mon[35039]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T07:14:26.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:26 smithi139 ceph-mon[35039]: Reconfiguring daemon mon.a on smithi098 2024-09-19T07:14:26.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:26 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:14:27.330 DEBUG:teuthology.orchestra.run.smithi139:mgr.y> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T07:14:27.333 DEBUG:teuthology.orchestra.run.smithi162:mgr.z> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T07:14:27.335 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T07:14:27.335 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:14:27.336 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T07:14:27.354 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T07:14:27.354 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-19T07:14:27.412 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T07:14:27.412 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:14:27.412 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T07:14:27.412 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:14:27.412 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:14:27.412 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-19 07:13:47.280130095 +0000 2024-09-19T07:14:27.413 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-19 07:09:33.543905046 +0000 2024-09-19T07:14:27.413 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-19 07:09:33.543905046 +0000 2024-09-19T07:14:27.413 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-19 07:09:33.543905046 +0000 2024-09-19T07:14:27.413 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T07:14:27.479 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-19T07:14:27.479 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-19T07:14:27.480 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000199211 s, 2.6 MB/s 2024-09-19T07:14:27.481 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T07:14:27.540 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-19T07:14:27.597 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T07:14:27.597 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:14:27.597 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T07:14:27.597 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:14:27.597 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:14:27.597 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-19 07:13:47.305129780 +0000 2024-09-19T07:14:27.597 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-19 07:09:33.878901269 +0000 2024-09-19T07:14:27.598 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-19 07:09:33.878901269 +0000 2024-09-19T07:14:27.598 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-19 07:09:33.878901269 +0000 2024-09-19T07:14:27.598 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T07:14:27.662 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-19T07:14:27.663 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-19T07:14:27.663 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000218188 s, 2.3 MB/s 2024-09-19T07:14:27.664 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T07:14:27.722 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-19T07:14:27.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:27 smithi098 ceph-mon[30950]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:27.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:27.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:27.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:27 smithi098 ceph-mon[30950]: Reconfiguring mon.b (monmap changed)... 2024-09-19T07:14:27.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:27.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:14:27.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:27.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:27 smithi098 ceph-mon[30950]: Reconfiguring daemon mon.b on smithi139 2024-09-19T07:14:27.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:27.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:27 smithi098 ceph-mon[30950]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi098=x;smithi139=y;smithi162=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:14:27.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:27 smithi098 ceph-mon[30950]: Saving service mgr spec with placement smithi098=x;smithi139=y;smithi162=z;count:3 2024-09-19T07:14:27.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:27.779 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T07:14:27.779 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:14:27.779 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T07:14:27.779 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:14:27.779 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:14:27.779 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-19 07:13:47.330129464 +0000 2024-09-19T07:14:27.779 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-19 07:09:34.185897807 +0000 2024-09-19T07:14:27.779 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-19 07:09:34.185897807 +0000 2024-09-19T07:14:27.779 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-19 07:09:34.185897807 +0000 2024-09-19T07:14:27.779 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T07:14:27.845 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-19T07:14:27.845 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-19T07:14:27.845 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000206903 s, 2.5 MB/s 2024-09-19T07:14:27.846 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T07:14:27.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:27 smithi139 ceph-mon[35039]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:27.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:27.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:27.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:27 smithi139 ceph-mon[35039]: Reconfiguring mon.b (monmap changed)... 2024-09-19T07:14:27.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:27.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:14:27.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:27.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:27 smithi139 ceph-mon[35039]: Reconfiguring daemon mon.b on smithi139 2024-09-19T07:14:27.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:27.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:27 smithi139 ceph-mon[35039]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi098=x;smithi139=y;smithi162=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:14:27.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:27 smithi139 ceph-mon[35039]: Saving service mgr spec with placement smithi098=x;smithi139=y;smithi162=z;count:3 2024-09-19T07:14:27.873 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:27 smithi162 ceph-mon[35726]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:27 smithi162 ceph-mon[35726]: Reconfiguring mon.b (monmap changed)... 2024-09-19T07:14:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:14:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:27 smithi162 ceph-mon[35726]: Reconfiguring daemon mon.b on smithi139 2024-09-19T07:14:27.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:27.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:27 smithi162 ceph-mon[35726]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi098=x;smithi139=y;smithi162=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:14:27.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:27 smithi162 ceph-mon[35726]: Saving service mgr spec with placement smithi098=x;smithi139=y;smithi162=z;count:3 2024-09-19T07:14:27.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:27.903 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-19T07:14:27.959 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T07:14:27.960 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:14:27.960 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T07:14:27.960 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:14:27.960 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:14:27.960 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-19 07:13:47.354129162 +0000 2024-09-19T07:14:27.960 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-19 07:09:34.499894267 +0000 2024-09-19T07:14:27.960 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-19 07:09:34.499894267 +0000 2024-09-19T07:14:27.960 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-19 07:09:34.499894267 +0000 2024-09-19T07:14:27.960 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T07:14:28.023 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-19T07:14:28.023 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-19T07:14:28.023 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000209597 s, 2.4 MB/s 2024-09-19T07:14:28.024 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T07:14:28.080 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-09-19T07:14:28.081 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T07:14:28.097 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T07:14:28.097 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-09-19T07:14:28.153 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T07:14:28.154 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:14:28.154 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-19T07:14:28.154 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:14:28.154 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:14:28.154 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-19 07:14:16.994670382 +0000 2024-09-19T07:14:28.154 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-19 07:09:51.398174061 +0000 2024-09-19T07:14:28.154 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-19 07:09:51.398174061 +0000 2024-09-19T07:14:28.154 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-19 07:09:51.398174061 +0000 2024-09-19T07:14:28.154 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T07:14:28.218 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-19T07:14:28.218 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-19T07:14:28.218 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000252754 s, 2.0 MB/s 2024-09-19T07:14:28.219 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T07:14:28.276 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-09-19T07:14:28.333 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T07:14:28.333 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:14:28.333 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T07:14:28.333 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:14:28.333 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:14:28.333 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-19 07:14:16.994670382 +0000 2024-09-19T07:14:28.333 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-19 07:09:51.718167504 +0000 2024-09-19T07:14:28.333 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-19 07:09:51.718167504 +0000 2024-09-19T07:14:28.334 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-19 07:09:51.718167504 +0000 2024-09-19T07:14:28.334 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T07:14:28.396 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-19T07:14:28.396 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-19T07:14:28.397 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000225715 s, 2.3 MB/s 2024-09-19T07:14:28.398 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T07:14:28.455 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-09-19T07:14:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T07:14:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:14:28.511 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T07:14:28.511 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:14:28.511 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:14:28.511 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-19 07:14:16.995670362 +0000 2024-09-19T07:14:28.511 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-19 07:09:52.034161027 +0000 2024-09-19T07:14:28.511 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-19 07:09:52.034161027 +0000 2024-09-19T07:14:28.511 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-19 07:09:52.034161027 +0000 2024-09-19T07:14:28.512 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T07:14:28.575 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-19T07:14:28.576 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-19T07:14:28.576 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000178326 s, 2.9 MB/s 2024-09-19T07:14:28.577 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T07:14:28.633 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-09-19T07:14:28.688 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T07:14:28.688 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:14:28.688 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T07:14:28.688 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:14:28.688 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:14:28.688 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-09-19 07:14:16.995670362 +0000 2024-09-19T07:14:28.688 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-09-19 07:09:52.365154244 +0000 2024-09-19T07:14:28.688 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-09-19 07:09:52.365154244 +0000 2024-09-19T07:14:28.688 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-09-19 07:09:52.365154244 +0000 2024-09-19T07:14:28.689 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T07:14:28.752 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-09-19T07:14:28.752 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-09-19T07:14:28.752 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000253931 s, 2.0 MB/s 2024-09-19T07:14:28.753 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T07:14:28.810 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T07:14:28.810 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T07:14:28.827 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T07:14:28.827 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-19T07:14:28.883 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T07:14:28.883 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:14:28.883 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T07:14:28.883 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:14:28.883 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:14:28.883 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 07:14:07.672327284 +0000 2024-09-19T07:14:28.883 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 07:09:54.599821118 +0000 2024-09-19T07:14:28.884 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 07:09:54.599821118 +0000 2024-09-19T07:14:28.884 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 07:09:54.599821118 +0000 2024-09-19T07:14:28.884 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T07:14:28.948 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T07:14:28.948 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T07:14:28.948 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000245145 s, 2.1 MB/s 2024-09-19T07:14:28.949 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T07:14:29.005 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-19T07:14:29.061 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T07:14:29.061 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:14:29.062 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-19T07:14:29.062 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:14:29.062 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:14:29.062 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 07:14:07.672327284 +0000 2024-09-19T07:14:29.062 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 07:09:54.939813876 +0000 2024-09-19T07:14:29.062 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 07:09:54.939813876 +0000 2024-09-19T07:14:29.062 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 07:09:54.939813876 +0000 2024-09-19T07:14:29.062 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T07:14:29.124 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T07:14:29.125 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T07:14:29.125 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000205542 s, 2.5 MB/s 2024-09-19T07:14:29.126 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T07:14:29.183 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-19T07:14:29.237 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T07:14:29.237 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:14:29.237 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T07:14:29.238 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:14:29.238 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:14:29.238 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 07:14:07.672327284 +0000 2024-09-19T07:14:29.238 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 07:09:55.266806910 +0000 2024-09-19T07:14:29.238 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 07:09:55.266806910 +0000 2024-09-19T07:14:29.238 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 07:09:55.266806910 +0000 2024-09-19T07:14:29.238 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T07:14:29.252 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:28 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:29.252 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:28 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:29.252 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:28 smithi162 ceph-mon[35726]: Reconfiguring mon.c (monmap changed)... 2024-09-19T07:14:29.252 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:28 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:29.252 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:28 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:14:29.252 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:28 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:29.252 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:28 smithi162 ceph-mon[35726]: Reconfiguring daemon mon.c on smithi162 2024-09-19T07:14:29.252 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:28 smithi162 ceph-mon[35726]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:29.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:28 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:29.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:28 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:29.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:28 smithi098 ceph-mon[30950]: Reconfiguring mon.c (monmap changed)... 2024-09-19T07:14:29.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:28 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:29.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:28 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:14:29.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:28 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:29.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:28 smithi098 ceph-mon[30950]: Reconfiguring daemon mon.c on smithi162 2024-09-19T07:14:29.277 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:28 smithi098 ceph-mon[30950]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:29.277 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T07:14:29.277 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T07:14:29.278 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000179073 s, 2.9 MB/s 2024-09-19T07:14:29.278 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T07:14:29.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:28 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:29.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:28 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:29.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:28 smithi139 ceph-mon[35039]: Reconfiguring mon.c (monmap changed)... 2024-09-19T07:14:29.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:28 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T07:14:29.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:28 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T07:14:29.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:28 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:29.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:28 smithi139 ceph-mon[35039]: Reconfiguring daemon mon.c on smithi162 2024-09-19T07:14:29.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:28 smithi139 ceph-mon[35039]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:29.336 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-19T07:14:29.391 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T07:14:29.391 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T07:14:29.392 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T07:14:29.392 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:14:29.392 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T07:14:29.392 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 07:14:07.673327264 +0000 2024-09-19T07:14:29.392 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 07:09:55.606799667 +0000 2024-09-19T07:14:29.392 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 07:09:55.606799667 +0000 2024-09-19T07:14:29.392 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 07:09:55.606799667 +0000 2024-09-19T07:14:29.392 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T07:14:29.455 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T07:14:29.456 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T07:14:29.456 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000219003 s, 2.3 MB/s 2024-09-19T07:14:29.457 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T07:14:29.514 INFO:tasks.cephadm:Deploying osd.0 on smithi098 with /dev/vg_nvme/lv_4... 2024-09-19T07:14:29.514 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T07:14:29.765 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:30.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:30.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:30.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:30.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:30.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:30.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:30.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:14:30.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:14:30.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:14:30.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:30.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:30 smithi098 ceph-mon[30950]: Deploying daemon mgr.z on smithi162 2024-09-19T07:14:30.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:30.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:30.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:30.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:30.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:30.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:30.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:14:30.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:14:30.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:14:30.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:30.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:30 smithi139 ceph-mon[35039]: Deploying daemon mgr.z on smithi162 2024-09-19T07:14:30.600 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:30.600 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:30.600 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:30.600 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:30.600 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:30.600 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:30.600 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:14:30.600 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:14:30.601 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:14:30.601 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:30.601 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:30 smithi162 ceph-mon[35726]: Deploying daemon mgr.z on smithi162 2024-09-19T07:14:31.132 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 systemd[1]: Starting Ceph mgr.z for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:14:31.529 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:31 smithi162 ceph-mon[35726]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:31.529 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 podman[37526]: 2024-09-19 07:14:31.150150398 +0000 UTC m=+0.016358080 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:14:31.529 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 podman[37526]: 2024-09-19 07:14:31.252250818 +0000 UTC m=+0.118458499 container create ec452004dd306a1c2d8069f04b6a563f4e96ede1c1d0666916b3c506be22f3cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T07:14:31.530 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 podman[37526]: 2024-09-19 07:14:31.446286575 +0000 UTC m=+0.312494256 container init ec452004dd306a1c2d8069f04b6a563f4e96ede1c1d0666916b3c506be22f3cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T07:14:31.530 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 podman[37526]: 2024-09-19 07:14:31.449089749 +0000 UTC m=+0.315297443 container start ec452004dd306a1c2d8069f04b6a563f4e96ede1c1d0666916b3c506be22f3cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T07:14:31.530 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 ceph-mgr[37545]: -- 172.21.15.162:0/2658168590 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b4f5e6f0e0 con 0x55b4f5e4d400 2024-09-19T07:14:31.530 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 bash[37526]: ec452004dd306a1c2d8069f04b6a563f4e96ede1c1d0666916b3c506be22f3cb 2024-09-19T07:14:31.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:31 smithi139 ceph-mon[35039]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:31.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:31 smithi098 ceph-mon[30950]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:31.841 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 systemd[1]: Started Ceph mgr.z for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:14:31.841 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:31.569+0000 7f752cace040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:14:31.841 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:31.628+0000 7f752cace040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:14:31.841 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:31.774+0000 7f752cace040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:14:31.841 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:31.839+0000 7f752cace040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:14:32.044 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:14:32.069 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_4 2024-09-19T07:14:32.124 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:31.985+0000 7f752cace040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:14:32.124 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:32.122+0000 7f752cace040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:14:32.310 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:14:32.753 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:32 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:32.753 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:32 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:32.753 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:32 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:32.753 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:32 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:14:32.754 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:32 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:14:32.754 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:32 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:14:32.754 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:32 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:32.754 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:32 smithi098 ceph-mon[30950]: Deploying daemon mgr.y on smithi139 2024-09-19T07:14:32.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.751+0000 7fe958ce2640 1 -- 172.21.15.98:0/208097754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe954101c00 msgr2=0x7fe954102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:32.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.751+0000 7fe958ce2640 1 --2- 172.21.15.98:0/208097754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe954101c00 0x7fe954102000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe944009900 tx=0x7fe94402a410 comp rx=0 tx=0).stop 2024-09-19T07:14:32.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.751+0000 7fe958ce2640 1 -- 172.21.15.98:0/208097754 shutdown_connections 2024-09-19T07:14:32.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.751+0000 7fe958ce2640 1 --2- 172.21.15.98:0/208097754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9541037c0 0x7fe95410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.751+0000 7fe958ce2640 1 --2- 172.21.15.98:0/208097754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe954102e00 0x7fe954103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.751+0000 7fe958ce2640 1 --2- 172.21.15.98:0/208097754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe954101c00 0x7fe954102000 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.751+0000 7fe958ce2640 1 -- 172.21.15.98:0/208097754 >> 172.21.15.98:0/208097754 conn(0x7fe9540fd390 msgr2=0x7fe9540ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:32.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.751+0000 7fe958ce2640 1 -- 172.21.15.98:0/208097754 shutdown_connections 2024-09-19T07:14:32.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.751+0000 7fe958ce2640 1 -- 172.21.15.98:0/208097754 wait complete. 2024-09-19T07:14:32.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.752+0000 7fe958ce2640 1 Processor -- start 2024-09-19T07:14:32.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.752+0000 7fe958ce2640 1 -- start start 2024-09-19T07:14:32.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.752+0000 7fe958ce2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe954101c00 0x7fe954197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.752+0000 7fe958ce2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe954102e00 0x7fe954198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.752+0000 7fe958ce2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9541037c0 0x7fe95419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.752+0000 7fe958ce2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe95410d890 con 0x7fe954102e00 2024-09-19T07:14:32.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.752+0000 7fe958ce2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe95410d710 con 0x7fe954101c00 2024-09-19T07:14:32.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.752+0000 7fe958ce2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe95410da10 con 0x7fe9541037c0 2024-09-19T07:14:32.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe951d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe954102e00 0x7fe954198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe951d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe954102e00 0x7fe954198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37696/0 (socket says 172.21.15.98:37696) 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe951d9b640 1 -- 172.21.15.98:0/1987712655 learned_addr learned my addr 172.21.15.98:0/1987712655 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe95259c640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe954101c00 0x7fe954197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe952d9d640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9541037c0 0x7fe95419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe95259c640 1 -- 172.21.15.98:0/1987712655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9541037c0 msgr2=0x7fe95419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe95259c640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9541037c0 0x7fe95419f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe95259c640 1 -- 172.21.15.98:0/1987712655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe954102e00 msgr2=0x7fe954198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe95259c640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe954102e00 0x7fe954198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe95259c640 1 -- 172.21.15.98:0/1987712655 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95419fa80 con 0x7fe954101c00 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe952d9d640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9541037c0 0x7fe95419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe951d9b640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe954102e00 0x7fe954198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe95259c640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe954101c00 0x7fe954197e50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe944009230 tx=0x7fe944031b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.753+0000 7fe9437fe640 1 -- 172.21.15.98:0/1987712655 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94403f070 con 0x7fe954101c00 2024-09-19T07:14:32.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.754+0000 7fe958ce2640 1 -- 172.21.15.98:0/1987712655 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95419fd10 con 0x7fe954101c00 2024-09-19T07:14:32.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.754+0000 7fe9437fe640 1 -- 172.21.15.98:0/1987712655 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe944003cd0 con 0x7fe954101c00 2024-09-19T07:14:32.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.754+0000 7fe958ce2640 1 -- 172.21.15.98:0/1987712655 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9541a01c0 con 0x7fe954101c00 2024-09-19T07:14:32.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.754+0000 7fe9437fe640 1 -- 172.21.15.98:0/1987712655 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944048060 con 0x7fe954101c00 2024-09-19T07:14:32.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.754+0000 7fe9437fe640 1 -- 172.21.15.98:0/1987712655 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe944043400 con 0x7fe954101c00 2024-09-19T07:14:32.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.755+0000 7fe9437fe640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe93c039500 0x7fe93c03b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:32.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.755+0000 7fe9437fe640 1 -- 172.21.15.98:0/1987712655 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe94406d180 con 0x7fe954101c00 2024-09-19T07:14:32.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.755+0000 7fe951d9b640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe93c039500 0x7fe93c03b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:32.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.755+0000 7fe958ce2640 1 -- 172.21.15.98:0/1987712655 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe954102000 con 0x7fe954101c00 2024-09-19T07:14:32.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.755+0000 7fe951d9b640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe93c039500 0x7fe93c03b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe954199370 tx=0x7fe94800a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:32.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.760+0000 7fe9437fe640 1 -- 172.21.15.98:0/1987712655 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe944041310 con 0x7fe954101c00 2024-09-19T07:14:32.882 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:32.434+0000 7f752cace040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:14:32.882 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:32.494+0000 7f752cace040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:14:32.882 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:32.677+0000 7f752cace040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:14:32.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:32 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:32.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:32 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:32.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:32 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:32.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:32 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:14:32.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:32 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:14:32.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:32 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:14:32.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:32 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:32.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:32 smithi162 ceph-mon[35726]: Deploying daemon mgr.y on smithi139 2024-09-19T07:14:32.918 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:32 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:32.918 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:32 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:32.918 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:32 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:32.918 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:32 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:14:32.918 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:32 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T07:14:32.919 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:32 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:14:32.919 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:32 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:32.919 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:32 smithi139 ceph-mon[35039]: Deploying daemon mgr.y on smithi139 2024-09-19T07:14:32.933 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:32.932+0000 7fe958ce2640 1 -- 172.21.15.98:0/1987712655 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe9540626f0 con 0x7fe93c039500 2024-09-19T07:14:33.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:33 smithi162 ceph-mon[35726]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:33.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:33 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:14:33.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:33 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:14:33.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:33 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:33.882 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:33 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:33.547+0000 7f752cace040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:14:33.882 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:33 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:33.613+0000 7f752cace040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:14:34.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:33 smithi139 ceph-mon[35039]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:34.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:33 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:14:34.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:33 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:14:34.004 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:33 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:34.005 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:33 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:33.848+0000 7f77985c6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:14:34.005 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:34.003+0000 7f77985c6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:14:34.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:33 smithi098 ceph-mon[30950]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:34.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:33 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:14:34.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:33 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:14:34.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:33 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:34.317 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:34.072+0000 7f77985c6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:14:34.317 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:34.233+0000 7f77985c6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:14:34.620 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:34.367+0000 7f752cace040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:14:34.620 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:34.482+0000 7f752cace040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:14:34.649 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:34.393+0000 7f77985c6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:14:34.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-mon[35039]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:14:34.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:34.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:34.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:34.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:34.650 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:34.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:34 smithi098 ceph-mon[30950]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:14:34.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:34 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:34.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:34 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:34.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:34 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:34.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:34 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:34.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:34 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:34.882 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:34.636+0000 7f752cace040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:14:34.882 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:34.698+0000 7f752cace040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:14:34.882 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:34.850+0000 7f752cace040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:14:34.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-mon[35726]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:14:34.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:34.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:34.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:34.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:34.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:34.963 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:34.715+0000 7f77985c6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:14:34.963 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:34.778+0000 7f77985c6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:14:35.214 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:34.918+0000 7f752cace040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:14:35.214 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:34 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:34.981+0000 7f752cace040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:14:35.214 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:35.147+0000 7f752cace040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:14:35.214 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:35.213+0000 7f752cace040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:14:35.316 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:34 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:34.962+0000 7f77985c6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:14:35.479 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:35.279+0000 7f752cace040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:14:35.479 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:35.361+0000 7f752cace040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:14:35.480 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:35.420+0000 7f752cace040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:14:35.480 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:35.479+0000 7f752cace040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:14:35.795 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:35.795 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.795 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.795 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.795 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.795 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:35.795 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:35.795 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.795 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:14:35.796 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:14:35.796 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:35.796 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/750804849' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "716d8456-e227-4bd3-a17d-40eddbb7ccac"}]: dispatch 2024-09-19T07:14:35.796 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/750804849' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "716d8456-e227-4bd3-a17d-40eddbb7ccac"}]': finished 2024-09-19T07:14:35.796 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T07:14:35.796 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:14:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:14:35.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:14:35.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:35.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/750804849' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "716d8456-e227-4bd3-a17d-40eddbb7ccac"}]: dispatch 2024-09-19T07:14:35.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/750804849' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "716d8456-e227-4bd3-a17d-40eddbb7ccac"}]': finished 2024-09-19T07:14:35.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T07:14:35.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:14:35.928 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:35.861+0000 7f77985c6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:14:35.929 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:35.927+0000 7f77985c6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:14:35.929 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:35.929 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.929 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.929 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.929 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.929 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:35.929 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:35.929 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:35.929 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T07:14:35.930 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T07:14:35.930 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:35.930 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/750804849' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "716d8456-e227-4bd3-a17d-40eddbb7ccac"}]: dispatch 2024-09-19T07:14:35.930 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/750804849' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "716d8456-e227-4bd3-a17d-40eddbb7ccac"}]': finished 2024-09-19T07:14:35.930 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T07:14:35.930 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:14:36.629 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:14:36 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:14:36.266+0000 7f752cace040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:14:36.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:36.632+0000 7fe9437fe640 1 -- 172.21.15.98:0/1987712655 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7fe94403a3c0 con 0x7fe954101c00 2024-09-19T07:14:36.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:36 smithi162 ceph-mon[35726]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T07:14:36.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:36 smithi162 ceph-mon[35726]: Reconfiguring daemon mgr.x on smithi098 2024-09-19T07:14:36.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:36 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1485434180' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:14:36.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:36 smithi162 ceph-mon[35726]: Standby manager daemon z started 2024-09-19T07:14:36.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:36 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.162:0/1459227087' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:14:36.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:36 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.162:0/1459227087' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:14:36.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:36 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.162:0/1459227087' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:14:36.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:36 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.162:0/1459227087' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:14:36.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:36.896 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:36.640+0000 7f77985c6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:14:36.897 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:36.756+0000 7f77985c6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:14:36.897 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:36.895+0000 7f77985c6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:14:36.897 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-mon[35039]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T07:14:36.897 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-mon[35039]: Reconfiguring daemon mgr.x on smithi098 2024-09-19T07:14:36.897 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1485434180' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:14:36.897 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-mon[35039]: Standby manager daemon z started 2024-09-19T07:14:36.897 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.162:0/1459227087' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:14:36.898 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.162:0/1459227087' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:14:36.898 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.162:0/1459227087' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:14:36.898 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.162:0/1459227087' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:14:36.898 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:37.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:36 smithi098 ceph-mon[30950]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T07:14:37.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:36 smithi098 ceph-mon[30950]: Reconfiguring daemon mgr.x on smithi098 2024-09-19T07:14:37.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:36 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1485434180' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:14:37.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:36 smithi098 ceph-mon[30950]: Standby manager daemon z started 2024-09-19T07:14:37.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:36 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.162:0/1459227087' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:14:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:36 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.162:0/1459227087' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:14:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:36 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.162:0/1459227087' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:14:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:36 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.162:0/1459227087' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:14:37.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:37.169 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:36 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:36.956+0000 7f77985c6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:14:37.170 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:37.102+0000 7f77985c6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:14:37.170 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:37.169+0000 7f77985c6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:14:37.447 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:37.228+0000 7f77985c6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:14:37.447 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:37.382+0000 7f77985c6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:14:37.447 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:37.446+0000 7f77985c6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:14:37.712 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:37 smithi139 ceph-mon[35039]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:37.713 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:37 smithi139 ceph-mon[35039]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-19T07:14:37.713 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:37 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:14:37.713 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:37.511+0000 7f77985c6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:14:37.713 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:37.592+0000 7f77985c6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:14:37.713 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:37.654+0000 7f77985c6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:14:37.713 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:37.711+0000 7f77985c6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:14:37.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:37 smithi162 ceph-mon[35726]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:37.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:37 smithi162 ceph-mon[35726]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-19T07:14:37.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:37 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:14:38.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:37 smithi098 ceph-mon[30950]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:38.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:37 smithi098 ceph-mon[30950]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-19T07:14:38.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:37 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:14:38.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:38.639+0000 7fe9437fe640 1 -- 172.21.15.98:0/1987712655 <== mon.2 v2:172.21.15.139:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fe94404b350 con 0x7fe954101c00 2024-09-19T07:14:38.817 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:14:38 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:14:38.489+0000 7f77985c6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:14:38.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:38 smithi139 ceph-mon[35039]: Standby manager daemon y started 2024-09-19T07:14:38.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:38 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.139:0/703157295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:14:38.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:38 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.139:0/703157295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:14:38.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:38 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.139:0/703157295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:14:38.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:38 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.139:0/703157295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:14:38.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:38 smithi162 ceph-mon[35726]: Standby manager daemon y started 2024-09-19T07:14:38.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:38 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.139:0/703157295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:14:38.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:38 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.139:0/703157295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:14:38.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:38 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.139:0/703157295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:14:38.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:38 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.139:0/703157295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:14:39.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:38 smithi098 ceph-mon[30950]: Standby manager daemon y started 2024-09-19T07:14:39.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:38 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.139:0/703157295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:14:39.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:38 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.139:0/703157295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:14:39.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:38 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.139:0/703157295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:14:39.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:38 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.139:0/703157295' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:14:40.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:39 smithi098 ceph-mon[30950]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:40.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:39 smithi098 ceph-mon[30950]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-19T07:14:40.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:14:40.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:39 smithi139 ceph-mon[35039]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:40.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:39 smithi139 ceph-mon[35039]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-19T07:14:40.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:14:40.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:39 smithi162 ceph-mon[35726]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:40.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:39 smithi162 ceph-mon[35726]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-19T07:14:40.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:14:41.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:41 smithi098 ceph-mon[30950]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:42.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:41 smithi139 ceph-mon[35039]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:42.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:41 smithi162 ceph-mon[35726]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:43.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:43.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:43.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:43.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:43 smithi098 ceph-mon[30950]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:43.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:43.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:43.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:43.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:43 smithi139 ceph-mon[35039]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:43.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:43.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:43.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:43.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:43 smithi162 ceph-mon[35726]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:44.406 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:44 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:44.407 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:44 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:44.407 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:44 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:44.483 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:44 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:44.483 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:44 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:44.483 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:44 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:44.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:44 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:44.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:44 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:44.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:44 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:45.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:45 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T07:14:45.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:45 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:45.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:45 smithi098 ceph-mon[30950]: Deploying daemon osd.0 on smithi098 2024-09-19T07:14:45.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:45 smithi098 ceph-mon[30950]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:45.533 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:45 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T07:14:45.533 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:45 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:45.533 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:45 smithi162 ceph-mon[35726]: Deploying daemon osd.0 on smithi098 2024-09-19T07:14:45.533 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:45 smithi162 ceph-mon[35726]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:45.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:45 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T07:14:45.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:45 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:45.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:45 smithi139 ceph-mon[35039]: Deploying daemon osd.0 on smithi098 2024-09-19T07:14:45.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:45 smithi139 ceph-mon[35039]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:47.850 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:47 smithi098 ceph-mon[30950]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:47 smithi139 ceph-mon[35039]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:47 smithi162 ceph-mon[35726]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:50.011 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:49 smithi098 ceph-mon[30950]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:49 smithi139 ceph-mon[35039]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:49 smithi162 ceph-mon[35726]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:51.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:51 smithi098 ceph-mon[30950]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:51.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:51 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:51.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:51 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:51.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:51 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:52.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:51 smithi139 ceph-mon[35039]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:52.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:51 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:52.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:51 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:52.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:51 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:51 smithi162 ceph-mon[35726]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:51 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:51 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:51 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:53 smithi098 ceph-mon[30950]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:53 smithi139 ceph-mon[35039]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:54.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:53 smithi162 ceph-mon[35726]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:54.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:54.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:54.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:54.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:54.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:54.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.804+0000 7fe9437fe640 1 -- 172.21.15.98:0/1987712655 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe9540626f0 con 0x7fe93c039500 2024-09-19T07:14:54.806 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 0 on host 'smithi098' 2024-09-19T07:14:54.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.806+0000 7fe958ce2640 1 -- 172.21.15.98:0/1987712655 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe93c039500 msgr2=0x7fe93c03b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:54.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.807+0000 7fe958ce2640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe93c039500 0x7fe93c03b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe954199370 tx=0x7fe94800a380 comp rx=0 tx=0).stop 2024-09-19T07:14:54.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.807+0000 7fe958ce2640 1 -- 172.21.15.98:0/1987712655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe954101c00 msgr2=0x7fe954197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:54.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.807+0000 7fe958ce2640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe954101c00 0x7fe954197e50 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe944009230 tx=0x7fe944031b60 comp rx=0 tx=0).stop 2024-09-19T07:14:54.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.807+0000 7fe958ce2640 1 -- 172.21.15.98:0/1987712655 shutdown_connections 2024-09-19T07:14:54.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.807+0000 7fe958ce2640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe93c039500 0x7fe93c03b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:54.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.807+0000 7fe958ce2640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9541037c0 0x7fe95419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:54.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.807+0000 7fe958ce2640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe954102e00 0x7fe954198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:54.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.807+0000 7fe958ce2640 1 --2- 172.21.15.98:0/1987712655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe954101c00 0x7fe954197e50 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:54.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.807+0000 7fe958ce2640 1 -- 172.21.15.98:0/1987712655 >> 172.21.15.98:0/1987712655 conn(0x7fe9540fd390 msgr2=0x7fe954106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:54.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.807+0000 7fe958ce2640 1 -- 172.21.15.98:0/1987712655 shutdown_connections 2024-09-19T07:14:54.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:14:54.807+0000 7fe958ce2640 1 -- 172.21.15.98:0/1987712655 wait complete. 2024-09-19T07:14:55.456 DEBUG:teuthology.orchestra.run.smithi098:osd.0> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T07:14:55.459 INFO:tasks.cephadm:Deploying osd.1 on smithi139 with /dev/vg_nvme/lv_4... 2024-09-19T07:14:55.459 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T07:14:55.679 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:55 smithi098 ceph-mon[30950]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:55.680 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:55.680 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:55.680 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:55.697 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:14:55.755 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:55 smithi139 ceph-mon[35039]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:55.755 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:55.755 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:55.756 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:56.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:55 smithi162 ceph-mon[35726]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:56.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:14:56.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:56.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:57.274 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:14:57 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0[44450]: 2024-09-19T07:14:57.068+0000 7fca205d5640 -1 osd.0 0 log_to_monitors true 2024-09-19T07:14:57.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:57 smithi139 ceph-mon[35039]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:57.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:57 smithi139 ceph-mon[35039]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T07:14:57.835 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:57 smithi098 ceph-mon[30950]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:57.836 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:57 smithi098 ceph-mon[30950]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T07:14:58.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:57 smithi162 ceph-mon[35726]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:58.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:57 smithi162 ceph-mon[35726]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T07:14:58.158 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:14:58.185 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_4 2024-09-19T07:14:58.436 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:14:58.800 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:58 smithi139 ceph-mon[35039]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T07:14:58.800 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:58 smithi139 ceph-mon[35039]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T07:14:58.800 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:58 smithi139 ceph-mon[35039]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-19T07:14:58.800 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:58 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:14:58.800 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:58 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:58.800 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:58 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:58.800 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:58 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:58.800 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:58 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:58.800 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:58 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:58.800 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:58 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:58.801 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:58 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:58.801 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:58 smithi139 ceph-mon[35039]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-19T07:14:59.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:58 smithi098 ceph-mon[30950]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T07:14:59.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:58 smithi098 ceph-mon[30950]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T07:14:59.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:58 smithi098 ceph-mon[30950]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-19T07:14:59.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:58 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:14:59.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:58 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:59.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:58 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:59.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:58 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:59.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:58 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:59.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:58 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:59.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:58 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:59.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:58 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:59.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:58 smithi098 ceph-mon[30950]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-19T07:14:59.025 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.887+0000 7fcd0f253640 1 -- 172.21.15.139:0/2981931498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd08101c00 msgr2=0x7fcd08102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:59.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.887+0000 7fcd0f253640 1 --2- 172.21.15.139:0/2981931498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd08101c00 0x7fcd08102000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009900 tx=0x7fccfc02a410 comp rx=0 tx=0).stop 2024-09-19T07:14:59.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.887+0000 7fcd0f253640 1 -- 172.21.15.139:0/2981931498 shutdown_connections 2024-09-19T07:14:59.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.887+0000 7fcd0f253640 1 --2- 172.21.15.139:0/2981931498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd081037c0 0x7fcd0810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:59.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.887+0000 7fcd0f253640 1 --2- 172.21.15.139:0/2981931498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd08102e00 0x7fcd08103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:59.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.887+0000 7fcd0f253640 1 --2- 172.21.15.139:0/2981931498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd08101c00 0x7fcd08102000 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:59.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.887+0000 7fcd0f253640 1 -- 172.21.15.139:0/2981931498 >> 172.21.15.139:0/2981931498 conn(0x7fcd080fd390 msgr2=0x7fcd080ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:14:59.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.887+0000 7fcd0f253640 1 -- 172.21.15.139:0/2981931498 shutdown_connections 2024-09-19T07:14:59.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.887+0000 7fcd0f253640 1 -- 172.21.15.139:0/2981931498 wait complete. 2024-09-19T07:14:59.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0f253640 1 Processor -- start 2024-09-19T07:14:59.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0f253640 1 -- start start 2024-09-19T07:14:59.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0f253640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd08101c00 0x7fcd08075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:59.028 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0f253640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd08102e00 0x7fcd080745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:59.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0f253640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd081037c0 0x7fcd08074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:59.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0f253640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0810d8d0 con 0x7fcd08102e00 2024-09-19T07:14:59.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0f253640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0810d750 con 0x7fcd081037c0 2024-09-19T07:14:59.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0f253640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcd0810da50 con 0x7fcd08101c00 2024-09-19T07:14:59.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0d7f0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd081037c0 0x7fcd08074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:59.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0d7f0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd081037c0 0x7fcd08074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:46448/0 (socket says 172.21.15.139:46448) 2024-09-19T07:14:59.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0d7f0640 1 -- 172.21.15.139:0/1714974935 learned_addr learned my addr 172.21.15.139:0/1714974935 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-19T07:14:59.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd07fff640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd08102e00 0x7fcd080745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:59.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0cfef640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd08101c00 0x7fcd08075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:59.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0d7f0640 1 -- 172.21.15.139:0/1714974935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd08101c00 msgr2=0x7fcd08075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:59.029 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0d7f0640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd08101c00 0x7fcd08075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0d7f0640 1 -- 172.21.15.139:0/1714974935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd08102e00 msgr2=0x7fcd080745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0d7f0640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd08102e00 0x7fcd080745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0d7f0640 1 -- 172.21.15.139:0/1714974935 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd080753e0 con 0x7fcd081037c0 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.888+0000 7fcd0d7f0640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd081037c0 0x7fcd08074b20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000eb10 tx=0x7fcd0000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.889+0000 7fcd05ffb640 1 -- 172.21.15.139:0/1714974935 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00004b20 con 0x7fcd081037c0 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.889+0000 7fcd05ffb640 1 -- 172.21.15.139:0/1714974935 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd00004cc0 con 0x7fcd081037c0 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.889+0000 7fcd0f253640 1 -- 172.21.15.139:0/1714974935 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd081a20b0 con 0x7fcd081037c0 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.889+0000 7fcd05ffb640 1 -- 172.21.15.139:0/1714974935 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd00010760 con 0x7fcd081037c0 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.889+0000 7fcd0f253640 1 -- 172.21.15.139:0/1714974935 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd081a25c0 con 0x7fcd081037c0 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.890+0000 7fcd0f253640 1 -- 172.21.15.139:0/1714974935 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd08108ff0 con 0x7fcd081037c0 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.891+0000 7fcd05ffb640 1 -- 172.21.15.139:0/1714974935 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fcd00005020 con 0x7fcd081037c0 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.892+0000 7fcd05ffb640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fccf80a3230 0x7fccf80a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.892+0000 7fcd05ffb640 1 -- 172.21.15.139:0/1714974935 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fcd000ce270 con 0x7fcd081037c0 2024-09-19T07:14:59.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.892+0000 7fcd0cfef640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fccf80a3230 0x7fccf80a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:14:59.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.893+0000 7fcd0cfef640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fccf80a3230 0x7fccf80a56f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fccfc02aa00 tx=0x7fccfc0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:14:59.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:58.896+0000 7fcd05ffb640 1 -- 172.21.15.139:0/1714974935 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd0009cb00 con 0x7fcd081037c0 2024-09-19T07:14:59.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:14:59.100+0000 7fcd0f253640 1 -- 172.21.15.139:0/1714974935 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fcd08062630 con 0x7fccf80a3230 2024-09-19T07:14:59.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:58 smithi162 ceph-mon[35726]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T07:14:59.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:58 smithi162 ceph-mon[35726]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T07:14:59.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:58 smithi162 ceph-mon[35726]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-19T07:14:59.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:58 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:14:59.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:58 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:59.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:58 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:59.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:58 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:14:59.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:58 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:59.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:58 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:59.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:58 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:14:59.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:58 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:14:59.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:58 smithi162 ceph-mon[35726]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-19T07:14:59.744 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:59 smithi139 ceph-mon[35039]: Detected new or changed devices on smithi098 2024-09-19T07:14:59.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:59 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-19T07:14:59.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:59 smithi139 ceph-mon[35039]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:59.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:59 smithi139 ceph-mon[35039]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T07:14:59.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:14:59.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:14:59.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:14:59.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:14:59.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:59.745 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:14:59 smithi139 ceph-mon[35039]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' 2024-09-19T07:14:59.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:59 smithi098 ceph-mon[30950]: Detected new or changed devices on smithi098 2024-09-19T07:14:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:59 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-19T07:14:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:59 smithi098 ceph-mon[30950]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:14:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:59 smithi098 ceph-mon[30950]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T07:14:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:14:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:14:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:14:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:14:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:14:59.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:14:59 smithi098 ceph-mon[30950]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' 2024-09-19T07:14:59.775 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:14:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0[44450]: 2024-09-19T07:14:59.428+0000 7fca1bd35640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T07:14:59.775 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:14:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0[44450]: 2024-09-19T07:14:59.432+0000 7fca14367640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:15:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:59 smithi162 ceph-mon[35726]: Detected new or changed devices on smithi098 2024-09-19T07:15:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:59 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-19T07:15:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:59 smithi162 ceph-mon[35726]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:15:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:59 smithi162 ceph-mon[35726]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T07:15:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:15:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:15:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:15:00.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:15:00.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:00.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:14:59 smithi162 ceph-mon[35726]: from='osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015]' entity='osd.0' 2024-09-19T07:15:00.751 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:00 smithi139 ceph-mon[35039]: purged_snaps scrub starts 2024-09-19T07:15:00.751 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:00 smithi139 ceph-mon[35039]: purged_snaps scrub ok 2024-09-19T07:15:00.751 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:00 smithi139 ceph-mon[35039]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:15:00.751 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:15:00.751 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:00 smithi139 ceph-mon[35039]: osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015] boot 2024-09-19T07:15:00.751 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:00 smithi139 ceph-mon[35039]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T07:15:00.751 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:15:01.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:00 smithi098 ceph-mon[30950]: purged_snaps scrub starts 2024-09-19T07:15:01.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:00 smithi098 ceph-mon[30950]: purged_snaps scrub ok 2024-09-19T07:15:01.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:00 smithi098 ceph-mon[30950]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:15:01.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:15:01.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:00 smithi098 ceph-mon[30950]: osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015] boot 2024-09-19T07:15:01.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:00 smithi098 ceph-mon[30950]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T07:15:01.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:15:01.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:00 smithi162 ceph-mon[35726]: purged_snaps scrub starts 2024-09-19T07:15:01.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:00 smithi162 ceph-mon[35726]: purged_snaps scrub ok 2024-09-19T07:15:01.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:00 smithi162 ceph-mon[35726]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:15:01.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:15:01.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:00 smithi162 ceph-mon[35726]: osd.0 [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015] boot 2024-09-19T07:15:01.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:00 smithi162 ceph-mon[35726]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T07:15:01.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:15:01.932 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:01 smithi139 ceph-mon[35039]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:15:01.932 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:01 smithi139 ceph-mon[35039]: from='client.? 172.21.15.139:0/3080618837' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27725803-429d-4458-9881-4a4fdf82dc5d"}]: dispatch 2024-09-19T07:15:01.932 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:01 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27725803-429d-4458-9881-4a4fdf82dc5d"}]: dispatch 2024-09-19T07:15:01.932 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:01 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27725803-429d-4458-9881-4a4fdf82dc5d"}]': finished 2024-09-19T07:15:01.932 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:01 smithi139 ceph-mon[35039]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T07:15:01.932 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:01 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:02.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:01 smithi098 ceph-mon[30950]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:15:02.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:01 smithi098 ceph-mon[30950]: from='client.? 172.21.15.139:0/3080618837' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27725803-429d-4458-9881-4a4fdf82dc5d"}]: dispatch 2024-09-19T07:15:02.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:01 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27725803-429d-4458-9881-4a4fdf82dc5d"}]: dispatch 2024-09-19T07:15:02.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:01 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27725803-429d-4458-9881-4a4fdf82dc5d"}]': finished 2024-09-19T07:15:02.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:01 smithi098 ceph-mon[30950]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T07:15:02.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:01 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:02.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:01 smithi162 ceph-mon[35726]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T07:15:02.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:01 smithi162 ceph-mon[35726]: from='client.? 172.21.15.139:0/3080618837' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27725803-429d-4458-9881-4a4fdf82dc5d"}]: dispatch 2024-09-19T07:15:02.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:01 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27725803-429d-4458-9881-4a4fdf82dc5d"}]: dispatch 2024-09-19T07:15:02.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:01 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27725803-429d-4458-9881-4a4fdf82dc5d"}]': finished 2024-09-19T07:15:02.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:01 smithi162 ceph-mon[35726]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T07:15:02.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:01 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:03.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:02 smithi098 ceph-mon[30950]: from='client.? 172.21.15.139:0/868655840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:15:03.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:02 smithi139 ceph-mon[35039]: from='client.? 172.21.15.139:0/868655840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:15:03.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:02 smithi162 ceph-mon[35726]: from='client.? 172.21.15.139:0/868655840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:15:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:03 smithi098 ceph-mon[30950]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:04.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:03 smithi139 ceph-mon[35039]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:04.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:03 smithi162 ceph-mon[35726]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:06.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:05 smithi098 ceph-mon[30950]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:06.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:05 smithi139 ceph-mon[35039]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:05 smithi162 ceph-mon[35726]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:07.941 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:07 smithi139 ceph-mon[35039]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:07 smithi098 ceph-mon[30950]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:07 smithi162 ceph-mon[35726]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:09.942 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:09 smithi139 ceph-mon[35039]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:09 smithi098 ceph-mon[30950]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:09 smithi162 ceph-mon[35726]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:11.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:10 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T07:15:11.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:10 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:11.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:10 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T07:15:11.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:10 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:11.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:10 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T07:15:11.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:10 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:11.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:11 smithi139 ceph-mon[35039]: Deploying daemon osd.1 on smithi139 2024-09-19T07:15:11.871 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:11 smithi139 ceph-mon[35039]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:12.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:11 smithi098 ceph-mon[30950]: Deploying daemon osd.1 on smithi139 2024-09-19T07:15:12.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:11 smithi098 ceph-mon[30950]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:12.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:11 smithi162 ceph-mon[35726]: Deploying daemon osd.1 on smithi139 2024-09-19T07:15:12.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:11 smithi162 ceph-mon[35726]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:13.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:13 smithi139 ceph-mon[35039]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:14.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:13 smithi098 ceph-mon[30950]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:14.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:13 smithi162 ceph-mon[35726]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:15.953 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:15 smithi162 ceph-mon[35726]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:16.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:15 smithi098 ceph-mon[30950]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:16.025 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:15 smithi139 ceph-mon[35039]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:17.017 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:17.017 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:17.017 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:17.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:17.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:17.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:17.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:17.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:17.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:17.928 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:17 smithi139 ceph-mon[35039]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:18.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:17 smithi098 ceph-mon[30950]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:18.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:17 smithi162 ceph-mon[35726]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:19 smithi098 ceph-mon[30950]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:19 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:19 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:19 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:20.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:19 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:20.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:19 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:20.055 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:19 smithi139 ceph-mon[35039]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:20.055 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:19 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:20.055 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:19 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:20.055 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:19 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:20.055 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:19 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:20.055 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:19 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:20.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:19 smithi162 ceph-mon[35726]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:20.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:19 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:20.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:19 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:20.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:19 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:20.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:19 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:20.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:19 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:20.382 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 1 on host 'smithi139' 2024-09-19T07:15:20.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.380+0000 7fcd05ffb640 1 -- 172.21.15.139:0/1714974935 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcd08062630 con 0x7fccf80a3230 2024-09-19T07:15:20.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.383+0000 7fcd0f253640 1 -- 172.21.15.139:0/1714974935 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fccf80a3230 msgr2=0x7fccf80a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:20.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.383+0000 7fcd0f253640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fccf80a3230 0x7fccf80a56f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fccfc02aa00 tx=0x7fccfc0315b0 comp rx=0 tx=0).stop 2024-09-19T07:15:20.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.383+0000 7fcd0f253640 1 -- 172.21.15.139:0/1714974935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd081037c0 msgr2=0x7fcd08074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:20.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.383+0000 7fcd0f253640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd081037c0 0x7fcd08074b20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000eb10 tx=0x7fcd0000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:15:20.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.383+0000 7fcd0f253640 1 -- 172.21.15.139:0/1714974935 shutdown_connections 2024-09-19T07:15:20.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.383+0000 7fcd0f253640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fccf80a3230 0x7fccf80a56f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:20.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.383+0000 7fcd0f253640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd081037c0 0x7fcd08074b20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:20.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.383+0000 7fcd0f253640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcd08102e00 0x7fcd080745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:20.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.383+0000 7fcd0f253640 1 --2- 172.21.15.139:0/1714974935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd08101c00 0x7fcd08075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:20.384 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.383+0000 7fcd0f253640 1 -- 172.21.15.139:0/1714974935 >> 172.21.15.139:0/1714974935 conn(0x7fcd080fd390 msgr2=0x7fcd081061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:20.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.383+0000 7fcd0f253640 1 -- 172.21.15.139:0/1714974935 shutdown_connections 2024-09-19T07:15:20.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:15:20.383+0000 7fcd0f253640 1 -- 172.21.15.139:0/1714974935 wait complete. 2024-09-19T07:15:21.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:20 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:21.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:20 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:21.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:20 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:21.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:20 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:21.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:20 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:21.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:20 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:21.025 DEBUG:teuthology.orchestra.run.smithi139:osd.1> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T07:15:21.027 INFO:tasks.cephadm:Deploying osd.2 on smithi162 with /dev/vg_nvme/lv_4... 2024-09-19T07:15:21.027 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T07:15:21.055 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:20 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:21.055 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:20 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:21.055 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:20 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:21.279 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:15:22.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:21 smithi098 ceph-mon[30950]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:22.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:21 smithi139 ceph-mon[35039]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:22.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:21 smithi162 ceph-mon[35726]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:22.703 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:15:22 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1[39537]: 2024-09-19T07:15:22.600+0000 7f6e2e029640 -1 osd.1 0 log_to_monitors true 2024-09-19T07:15:22.821 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:22 smithi162 ceph-mon[35726]: from='osd.1 [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:15:22.821 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:22 smithi162 ceph-mon[35726]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:15:23.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:22 smithi098 ceph-mon[30950]: from='osd.1 [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:15:23.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:22 smithi098 ceph-mon[30950]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:15:23.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:22 smithi139 ceph-mon[35039]: from='osd.1 [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:15:23.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:22 smithi139 ceph-mon[35039]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T07:15:23.475 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:15:23.500 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_4 2024-09-19T07:15:23.783 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:15:23.979 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:23 smithi162 ceph-mon[35726]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:23.979 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:23 smithi162 ceph-mon[35726]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T07:15:23.979 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:23 smithi162 ceph-mon[35726]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T07:15:23.980 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:23 smithi162 ceph-mon[35726]: from='osd.1 [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:15:23.980 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:23.980 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:23 smithi162 ceph-mon[35726]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:15:24.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:23 smithi098 ceph-mon[30950]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:24.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:23 smithi098 ceph-mon[30950]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T07:15:24.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:23 smithi098 ceph-mon[30950]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T07:15:24.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:23 smithi098 ceph-mon[30950]: from='osd.1 [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:15:24.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:24.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:23 smithi098 ceph-mon[30950]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:15:24.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:23 smithi139 ceph-mon[35039]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:23 smithi139 ceph-mon[35039]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T07:15:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:23 smithi139 ceph-mon[35039]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T07:15:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:23 smithi139 ceph-mon[35039]: from='osd.1 [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:15:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:23 smithi139 ceph-mon[35039]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:15:24.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.191+0000 7fd34d0a4640 1 -- 172.21.15.162:0/256591269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3481037c0 msgr2=0x7fd34810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:24.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.191+0000 7fd34d0a4640 1 --2- 172.21.15.162:0/256591269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3481037c0 0x7fd34810a050 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd340009ca0 tx=0x7fd34002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:15:24.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.191+0000 7fd34d0a4640 1 -- 172.21.15.162:0/256591269 shutdown_connections 2024-09-19T07:15:24.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.191+0000 7fd34d0a4640 1 --2- 172.21.15.162:0/256591269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3481037c0 0x7fd34810a050 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:24.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.191+0000 7fd34d0a4640 1 --2- 172.21.15.162:0/256591269 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd348102e00 0x7fd348103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:24.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.191+0000 7fd34d0a4640 1 --2- 172.21.15.162:0/256591269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd348101c00 0x7fd348102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:24.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.191+0000 7fd34d0a4640 1 -- 172.21.15.162:0/256591269 >> 172.21.15.162:0/256591269 conn(0x7fd3480fd390 msgr2=0x7fd3480ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:24.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.191+0000 7fd34d0a4640 1 -- 172.21.15.162:0/256591269 shutdown_connections 2024-09-19T07:15:24.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.191+0000 7fd34d0a4640 1 -- 172.21.15.162:0/256591269 wait complete. 2024-09-19T07:15:24.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.192+0000 7fd34d0a4640 1 Processor -- start 2024-09-19T07:15:24.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.192+0000 7fd34d0a4640 1 -- start start 2024-09-19T07:15:24.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34d0a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd348101c00 0x7fd348197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:24.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34d0a4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd348102e00 0x7fd348198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:24.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34d0a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3481037c0 0x7fd34819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:24.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34d0a4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd34810d980 con 0x7fd348102e00 2024-09-19T07:15:24.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34d0a4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd34810d800 con 0x7fd348101c00 2024-09-19T07:15:24.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34d0a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd34810db00 con 0x7fd3481037c0 2024-09-19T07:15:24.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34759e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3481037c0 0x7fd34819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:24.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd346d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd348101c00 0x7fd348197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34759e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3481037c0 0x7fd34819f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44048/0 (socket says 172.21.15.162:44048) 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34759e640 1 -- 172.21.15.162:0/1995279073 learned_addr learned my addr 172.21.15.162:0/1995279073 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34659c640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd348102e00 0x7fd348198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34759e640 1 -- 172.21.15.162:0/1995279073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd348101c00 msgr2=0x7fd348197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34759e640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd348101c00 0x7fd348197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34759e640 1 -- 172.21.15.162:0/1995279073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd348102e00 msgr2=0x7fd348198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34759e640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd348102e00 0x7fd348198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34759e640 1 -- 172.21.15.162:0/1995279073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd34819fb50 con 0x7fd3481037c0 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34759e640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3481037c0 0x7fd34819f4e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd340009430 tx=0x7fd3400319f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd32ffff640 1 -- 172.21.15.162:0/1995279073 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd340003b70 con 0x7fd3481037c0 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd34d0a4640 1 -- 172.21.15.162:0/1995279073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd34819fde0 con 0x7fd3481037c0 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd32ffff640 1 -- 172.21.15.162:0/1995279073 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd340003d10 con 0x7fd3481037c0 2024-09-19T07:15:24.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.193+0000 7fd32ffff640 1 -- 172.21.15.162:0/1995279073 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd34002fbd0 con 0x7fd3481037c0 2024-09-19T07:15:24.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.194+0000 7fd34d0a4640 1 -- 172.21.15.162:0/1995279073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3481a0310 con 0x7fd3481037c0 2024-09-19T07:15:24.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.194+0000 7fd34d0a4640 1 -- 172.21.15.162:0/1995279073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd348108f30 con 0x7fd3481037c0 2024-09-19T07:15:24.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.196+0000 7fd32ffff640 1 -- 172.21.15.162:0/1995279073 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fd34002fd70 con 0x7fd3481037c0 2024-09-19T07:15:24.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.197+0000 7fd32ffff640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd3300a31e0 0x7fd3300a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:24.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.197+0000 7fd32ffff640 1 -- 172.21.15.162:0/1995279073 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7fd3400ef500 con 0x7fd3481037c0 2024-09-19T07:15:24.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.197+0000 7fd346d9d640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd3300a31e0 0x7fd3300a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:24.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.198+0000 7fd346d9d640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd3300a31e0 0x7fd3300a56a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd348102c60 tx=0x7fd338009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:24.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.200+0000 7fd32ffff640 1 -- 172.21.15.162:0/1995279073 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd3400bdb90 con 0x7fd3481037c0 2024-09-19T07:15:24.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:24.374+0000 7fd34d0a4640 1 -- 172.21.15.162:0/1995279073 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd348062630 con 0x7fd3300a31e0 2024-09-19T07:15:24.817 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1[39537]: 2024-09-19T07:15:24.508+0000 7f6e29789640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T07:15:24.817 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1[39537]: 2024-09-19T07:15:24.521+0000 7f6e21dbb640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:15:24.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:15:24.819 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:24.819 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:24 smithi139 ceph-mon[35039]: from='osd.1 ' entity='osd.1' 2024-09-19T07:15:24.969 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-19T07:15:24.969 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T07:15:24.969 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:24.969 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:24.969 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:24.969 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:24.969 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:24.970 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:24.970 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:24.970 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:24.970 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:24.970 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:15:24.970 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:15:24.970 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:24.970 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:24 smithi162 ceph-mon[35726]: from='osd.1 ' entity='osd.1' 2024-09-19T07:15:25.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-19T07:15:25.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T07:15:25.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:25.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:25.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:25.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:25.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:25.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:25.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:25.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:25.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:25.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:15:25.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:15:25.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:25.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:24 smithi098 ceph-mon[30950]: from='osd.1 ' entity='osd.1' 2024-09-19T07:15:26.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:25 smithi098 ceph-mon[30950]: purged_snaps scrub starts 2024-09-19T07:15:26.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:25 smithi098 ceph-mon[30950]: purged_snaps scrub ok 2024-09-19T07:15:26.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:25 smithi098 ceph-mon[30950]: Detected new or changed devices on smithi139 2024-09-19T07:15:26.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:25 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi139 to 17088M 2024-09-19T07:15:26.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:25 smithi098 ceph-mon[30950]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:15:26.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:25 smithi098 ceph-mon[30950]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:26.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:26.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:25 smithi098 ceph-mon[30950]: osd.1 [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302] boot 2024-09-19T07:15:26.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:25 smithi098 ceph-mon[30950]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T07:15:26.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:26.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:25 smithi162 ceph-mon[35726]: purged_snaps scrub starts 2024-09-19T07:15:26.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:25 smithi162 ceph-mon[35726]: purged_snaps scrub ok 2024-09-19T07:15:26.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:25 smithi162 ceph-mon[35726]: Detected new or changed devices on smithi139 2024-09-19T07:15:26.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:25 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi139 to 17088M 2024-09-19T07:15:26.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:25 smithi162 ceph-mon[35726]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:15:26.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:25 smithi162 ceph-mon[35726]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:26.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:26.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:25 smithi162 ceph-mon[35726]: osd.1 [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302] boot 2024-09-19T07:15:26.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:25 smithi162 ceph-mon[35726]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T07:15:26.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:26.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:25 smithi139 ceph-mon[35039]: purged_snaps scrub starts 2024-09-19T07:15:26.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:25 smithi139 ceph-mon[35039]: purged_snaps scrub ok 2024-09-19T07:15:26.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:25 smithi139 ceph-mon[35039]: Detected new or changed devices on smithi139 2024-09-19T07:15:26.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:25 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi139 to 17088M 2024-09-19T07:15:26.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:25 smithi139 ceph-mon[35039]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:15:26.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:25 smithi139 ceph-mon[35039]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T07:15:26.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:26.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:25 smithi139 ceph-mon[35039]: osd.1 [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302] boot 2024-09-19T07:15:26.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:25 smithi139 ceph-mon[35039]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T07:15:26.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:15:27.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:27 smithi139 ceph-mon[35039]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T07:15:27.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:27 smithi139 ceph-mon[35039]: from='client.? 172.21.15.162:0/1986932809' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40247362-cb89-41d9-9fab-b0dcb276bd71"}]: dispatch 2024-09-19T07:15:27.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:27 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40247362-cb89-41d9-9fab-b0dcb276bd71"}]: dispatch 2024-09-19T07:15:27.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:27 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40247362-cb89-41d9-9fab-b0dcb276bd71"}]': finished 2024-09-19T07:15:27.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:27 smithi139 ceph-mon[35039]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T07:15:27.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:27.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:27 smithi139 ceph-mon[35039]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:27.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:27 smithi139 ceph-mon[35039]: from='client.? 172.21.15.162:0/1442379147' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:15:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:27 smithi162 ceph-mon[35726]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T07:15:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:27 smithi162 ceph-mon[35726]: from='client.? 172.21.15.162:0/1986932809' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40247362-cb89-41d9-9fab-b0dcb276bd71"}]: dispatch 2024-09-19T07:15:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:27 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40247362-cb89-41d9-9fab-b0dcb276bd71"}]: dispatch 2024-09-19T07:15:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:27 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40247362-cb89-41d9-9fab-b0dcb276bd71"}]': finished 2024-09-19T07:15:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:27 smithi162 ceph-mon[35726]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T07:15:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:27.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:27 smithi162 ceph-mon[35726]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:27.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:27 smithi162 ceph-mon[35726]: from='client.? 172.21.15.162:0/1442379147' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:15:28.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:27 smithi098 ceph-mon[30950]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T07:15:28.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:27 smithi098 ceph-mon[30950]: from='client.? 172.21.15.162:0/1986932809' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40247362-cb89-41d9-9fab-b0dcb276bd71"}]: dispatch 2024-09-19T07:15:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:27 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40247362-cb89-41d9-9fab-b0dcb276bd71"}]: dispatch 2024-09-19T07:15:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:27 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40247362-cb89-41d9-9fab-b0dcb276bd71"}]': finished 2024-09-19T07:15:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:27 smithi098 ceph-mon[30950]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T07:15:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:27 smithi098 ceph-mon[30950]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:27 smithi098 ceph-mon[30950]: from='client.? 172.21.15.162:0/1442379147' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:15:29.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:29 smithi162 ceph-mon[35726]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:29 smithi098 ceph-mon[30950]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:30.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:29 smithi139 ceph-mon[35039]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:31 smithi162 ceph-mon[35726]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:32.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:31 smithi098 ceph-mon[30950]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:32.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:31 smithi139 ceph-mon[35039]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:33.878 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:33 smithi162 ceph-mon[35726]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:34.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:33 smithi098 ceph-mon[30950]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:34.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:33 smithi139 ceph-mon[35039]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:35 smithi162 ceph-mon[35726]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T07:15:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:36.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:35 smithi098 ceph-mon[30950]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:36.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T07:15:36.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:36.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:35 smithi139 ceph-mon[35039]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:36.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T07:15:36.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:36.743 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:36 smithi162 ceph-mon[35726]: Deploying daemon osd.2 on smithi162 2024-09-19T07:15:37.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:36 smithi098 ceph-mon[30950]: Deploying daemon osd.2 on smithi162 2024-09-19T07:15:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:36 smithi139 ceph-mon[35039]: Deploying daemon osd.2 on smithi162 2024-09-19T07:15:38.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:37 smithi098 ceph-mon[30950]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:38.065 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:37 smithi162 ceph-mon[35726]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:38.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:37 smithi139 ceph-mon[35039]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:39.964 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:39 smithi162 ceph-mon[35726]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:40.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:39 smithi098 ceph-mon[30950]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:40.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:39 smithi139 ceph-mon[35039]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:41.768 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:41 smithi162 ceph-mon[35726]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:41.768 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:41 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:41.768 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:41 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:41.768 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:41 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:42.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:41 smithi098 ceph-mon[30950]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:42.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:41 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:42.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:41 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:42.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:41 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:42.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:41 smithi139 ceph-mon[35039]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:42.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:41 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:42.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:41 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:42.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:41 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:43 smithi098 ceph-mon[30950]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:44.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:44.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:44.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:43 smithi139 ceph-mon[35039]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:44.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:44.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:44.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:44.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:44.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:43 smithi162 ceph-mon[35726]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:45.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.199+0000 7fd32ffff640 1 -- 172.21.15.162:0/1995279073 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd348062630 con 0x7fd3300a31e0 2024-09-19T07:15:45.200 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 2 on host 'smithi162' 2024-09-19T07:15:45.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.201+0000 7fd34d0a4640 1 -- 172.21.15.162:0/1995279073 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd3300a31e0 msgr2=0x7fd3300a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:45.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.201+0000 7fd34d0a4640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd3300a31e0 0x7fd3300a56a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd348102c60 tx=0x7fd338009110 comp rx=0 tx=0).stop 2024-09-19T07:15:45.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.201+0000 7fd34d0a4640 1 -- 172.21.15.162:0/1995279073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3481037c0 msgr2=0x7fd34819f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:45.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.201+0000 7fd34d0a4640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3481037c0 0x7fd34819f4e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd340009430 tx=0x7fd3400319f0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.201+0000 7fd34d0a4640 1 -- 172.21.15.162:0/1995279073 shutdown_connections 2024-09-19T07:15:45.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.201+0000 7fd34d0a4640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd3300a31e0 0x7fd3300a56a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.201+0000 7fd34d0a4640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3481037c0 0x7fd34819f4e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.201+0000 7fd34d0a4640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd348102e00 0x7fd348198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.201+0000 7fd34d0a4640 1 --2- 172.21.15.162:0/1995279073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd348101c00 0x7fd348197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:45.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.201+0000 7fd34d0a4640 1 -- 172.21.15.162:0/1995279073 >> 172.21.15.162:0/1995279073 conn(0x7fd3480fd390 msgr2=0x7fd348106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:45.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.201+0000 7fd34d0a4640 1 -- 172.21.15.162:0/1995279073 shutdown_connections 2024-09-19T07:15:45.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:15:45.201+0000 7fd34d0a4640 1 -- 172.21.15.162:0/1995279073 wait complete. 2024-09-19T07:15:45.745 DEBUG:teuthology.orchestra.run.smithi162:osd.2> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T07:15:45.748 INFO:tasks.cephadm:Deploying osd.3 on smithi098 with /dev/vg_nvme/lv_3... 2024-09-19T07:15:45.748 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T07:15:45.768 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:45 smithi162 ceph-mon[35726]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:45.768 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:45 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:45.768 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:45 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:45.769 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:45 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:45.988 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:15:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:45 smithi098 ceph-mon[30950]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:45 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:45 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:45 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:45 smithi139 ceph-mon[35039]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:45 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:15:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:45 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:45 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:47.338 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:15:47 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2[40721]: 2024-09-19T07:15:47.159+0000 7f68820d3640 -1 osd.2 0 log_to_monitors true 2024-09-19T07:15:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:47 smithi098 ceph-mon[30950]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:48.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:47 smithi098 ceph-mon[30950]: from='osd.2 [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:15:48.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:47 smithi098 ceph-mon[30950]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:15:48.031 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:47 smithi162 ceph-mon[35726]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:48.031 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:47 smithi162 ceph-mon[35726]: from='osd.2 [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:15:48.031 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:47 smithi162 ceph-mon[35726]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:15:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:47 smithi139 ceph-mon[35039]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:47 smithi139 ceph-mon[35039]: from='osd.2 [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:15:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:47 smithi139 ceph-mon[35039]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T07:15:48.267 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:15:48.295 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_3 2024-09-19T07:15:48.557 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:15:48.842 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:48 smithi098 ceph-mon[30950]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T07:15:48.842 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:48 smithi098 ceph-mon[30950]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T07:15:48.842 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:48 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:48.842 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:48 smithi098 ceph-mon[30950]: from='osd.2 [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:15:48.842 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:48 smithi098 ceph-mon[30950]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:15:48.842 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:48 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:48.842 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:48 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:48.842 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:48 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:48.842 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:48 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:48.843 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:48 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:48.843 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:48 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:48.843 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:48 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:49.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.001+0000 7f55446f4640 1 -- 172.21.15.98:0/231768439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f553c100ad0 msgr2=0x7f553c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:49.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.001+0000 7f55446f4640 1 --2- 172.21.15.98:0/231768439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f553c100ad0 0x7f553c100ed0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5538009900 tx=0x7f553802a410 comp rx=0 tx=0).stop 2024-09-19T07:15:49.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.001+0000 7f55446f4640 1 -- 172.21.15.98:0/231768439 shutdown_connections 2024-09-19T07:15:49.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.001+0000 7f55446f4640 1 --2- 172.21.15.98:0/231768439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f553c102690 0x7f553c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:49.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.001+0000 7f55446f4640 1 --2- 172.21.15.98:0/231768439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c101cd0 0x7f553c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:49.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.001+0000 7f55446f4640 1 --2- 172.21.15.98:0/231768439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f553c100ad0 0x7f553c100ed0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:49.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.001+0000 7f55446f4640 1 -- 172.21.15.98:0/231768439 >> 172.21.15.98:0/231768439 conn(0x7f553c0fc280 msgr2=0x7f553c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:15:49.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.001+0000 7f55446f4640 1 -- 172.21.15.98:0/231768439 shutdown_connections 2024-09-19T07:15:49.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.001+0000 7f55446f4640 1 -- 172.21.15.98:0/231768439 wait complete. 2024-09-19T07:15:49.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.002+0000 7f55446f4640 1 Processor -- start 2024-09-19T07:15:49.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.002+0000 7f55446f4640 1 -- start start 2024-09-19T07:15:49.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.002+0000 7f55446f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f553c100ad0 0x7f553c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:49.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.002+0000 7f55446f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c101cd0 0x7f553c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:49.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.002+0000 7f55446f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f553c102690 0x7f553c19f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:49.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.002+0000 7f55446f4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f553c10c750 con 0x7f553c100ad0 2024-09-19T07:15:49.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.002+0000 7f55446f4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f553c10c5d0 con 0x7f553c102690 2024-09-19T07:15:49.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.002+0000 7f55446f4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f553c10c8d0 con 0x7f553c101cd0 2024-09-19T07:15:49.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f5542490640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f553c100ad0 0x7f553c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:49.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f5542490640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f553c100ad0 0x7f553c06aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40214/0 (socket says 172.21.15.98:40214) 2024-09-19T07:15:49.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f5542490640 1 -- 172.21.15.98:0/482726422 learned_addr learned my addr 172.21.15.98:0/482726422 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:15:49.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f5541c8f640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c101cd0 0x7f553c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:49.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f5542c91640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f553c102690 0x7f553c19f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:49.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f5541c8f640 1 -- 172.21.15.98:0/482726422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f553c102690 msgr2=0x7f553c19f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:49.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f5541c8f640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f553c102690 0x7f553c19f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:49.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f5541c8f640 1 -- 172.21.15.98:0/482726422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f553c100ad0 msgr2=0x7f553c06aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:15:49.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f5541c8f640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f553c100ad0 0x7f553c06aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:15:49.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f5541c8f640 1 -- 172.21.15.98:0/482726422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c19fba0 con 0x7f553c101cd0 2024-09-19T07:15:49.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f5542490640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f553c100ad0 0x7f553c06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:15:49.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f5541c8f640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c101cd0 0x7f553c19cc70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f552c00e9f0 tx=0x7f552c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:49.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f55337fe640 1 -- 172.21.15.98:0/482726422 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c00ccc0 con 0x7f553c101cd0 2024-09-19T07:15:49.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f55337fe640 1 -- 172.21.15.98:0/482726422 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f552c005020 con 0x7f553c101cd0 2024-09-19T07:15:49.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f55446f4640 1 -- 172.21.15.98:0/482726422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553c19fe30 con 0x7f553c101cd0 2024-09-19T07:15:49.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f55337fe640 1 -- 172.21.15.98:0/482726422 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c0049e0 con 0x7f553c101cd0 2024-09-19T07:15:49.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.003+0000 7f55446f4640 1 -- 172.21.15.98:0/482726422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553c1a0290 con 0x7f553c101cd0 2024-09-19T07:15:49.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.004+0000 7f55446f4640 1 -- 172.21.15.98:0/482726422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f553c107f70 con 0x7f553c101cd0 2024-09-19T07:15:49.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.006+0000 7f55337fe640 1 -- 172.21.15.98:0/482726422 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f552c005560 con 0x7f553c101cd0 2024-09-19T07:15:49.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.007+0000 7f55337fe640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f55280a31b0 0x7f55280a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:15:49.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.007+0000 7f5542490640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f55280a31b0 0x7f55280a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:15:49.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.007+0000 7f55337fe640 1 -- 172.21.15.98:0/482726422 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f552c0ce3c0 con 0x7f553c101cd0 2024-09-19T07:15:49.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.007+0000 7f5542490640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f55280a31b0 0x7f55280a5670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5538000c00 tx=0x7f55380046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:15:49.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.010+0000 7f55337fe640 1 -- 172.21.15.98:0/482726422 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f552c0051d0 con 0x7f553c101cd0 2024-09-19T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:48 smithi139 ceph-mon[35039]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:48 smithi139 ceph-mon[35039]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:48 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:48 smithi139 ceph-mon[35039]: from='osd.2 [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:48 smithi139 ceph-mon[35039]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:48 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:48 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:48 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:48 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:48 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:48 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:48 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:49.132 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2[40721]: 2024-09-19T07:15:48.672+0000 7f687d833640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T07:15:49.132 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2[40721]: 2024-09-19T07:15:48.676+0000 7f6879e6d640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:15:49.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-mon[35726]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T07:15:49.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-mon[35726]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T07:15:49.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:49.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-mon[35726]: from='osd.2 [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:15:49.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-mon[35726]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:15:49.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:49.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:49.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:15:49.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:49.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:49.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:15:49.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:48 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:49.192 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:49.191+0000 7f55446f4640 1 -- 172.21.15.98:0/482726422 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f553c062630 con 0x7f55280a31b0 2024-09-19T07:15:49.920 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:49 smithi098 ceph-mon[30950]: Detected new or changed devices on smithi162 2024-09-19T07:15:49.920 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:49 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-19T07:15:49.921 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:49 smithi098 ceph-mon[30950]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:49.921 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:49 smithi098 ceph-mon[30950]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T07:15:49.921 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:49 smithi098 ceph-mon[30950]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T07:15:49.921 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:49.921 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:49.921 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:15:49.921 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:15:49.921 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:49 smithi139 ceph-mon[35039]: Detected new or changed devices on smithi162 2024-09-19T07:15:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:49 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-19T07:15:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:49 smithi139 ceph-mon[35039]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:49 smithi139 ceph-mon[35039]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T07:15:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:49 smithi139 ceph-mon[35039]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T07:15:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:15:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:15:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:49 smithi162 ceph-mon[35726]: Detected new or changed devices on smithi162 2024-09-19T07:15:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:49 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi162 to 17088M 2024-09-19T07:15:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:49 smithi162 ceph-mon[35726]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:49 smithi162 ceph-mon[35726]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T07:15:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:49 smithi162 ceph-mon[35726]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T07:15:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:15:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:15:50.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:15:51.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:50 smithi162 ceph-mon[35726]: purged_snaps scrub starts 2024-09-19T07:15:51.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:50 smithi162 ceph-mon[35726]: purged_snaps scrub ok 2024-09-19T07:15:51.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:50 smithi162 ceph-mon[35726]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:15:51.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:50 smithi162 ceph-mon[35726]: osd.2 [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399] boot 2024-09-19T07:15:51.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:50 smithi162 ceph-mon[35726]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T07:15:51.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:50 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:51.213 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:50 smithi098 ceph-mon[30950]: purged_snaps scrub starts 2024-09-19T07:15:51.214 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:50 smithi098 ceph-mon[30950]: purged_snaps scrub ok 2024-09-19T07:15:51.214 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:50 smithi098 ceph-mon[30950]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:15:51.214 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:50 smithi098 ceph-mon[30950]: osd.2 [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399] boot 2024-09-19T07:15:51.214 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:50 smithi098 ceph-mon[30950]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T07:15:51.214 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:50 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:50 smithi139 ceph-mon[35039]: purged_snaps scrub starts 2024-09-19T07:15:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:50 smithi139 ceph-mon[35039]: purged_snaps scrub ok 2024-09-19T07:15:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:50 smithi139 ceph-mon[35039]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:15:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:50 smithi139 ceph-mon[35039]: osd.2 [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399] boot 2024-09-19T07:15:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:50 smithi139 ceph-mon[35039]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T07:15:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:50 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:15:52.110 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:15:51 smithi098 sudo[48903]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:15:52.110 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:15:51 smithi098 sudo[48903]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:15:52.110 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:15:51 smithi098 sudo[48903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:15:52.111 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:15:51 smithi098 sudo[48903]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:15:52.111 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:51 smithi098 ceph-mon[30950]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:52.111 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:51 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:15:52.111 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:51 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T07:15:52.111 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:51 smithi098 ceph-mon[30950]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T07:15:52.111 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:51 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:15:52.111 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:51 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2878657641' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b314c43-b6f0-492c-bc66-10af912f4d59"}]: dispatch 2024-09-19T07:15:52.111 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:51 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:15:52.111 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:51 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2878657641' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b314c43-b6f0-492c-bc66-10af912f4d59"}]': finished 2024-09-19T07:15:52.112 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:51 smithi098 ceph-mon[30950]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T07:15:52.112 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:51 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:15:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:51 smithi162 ceph-mon[35726]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:51 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:15:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:51 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T07:15:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:51 smithi162 ceph-mon[35726]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T07:15:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:51 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:15:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:51 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2878657641' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b314c43-b6f0-492c-bc66-10af912f4d59"}]: dispatch 2024-09-19T07:15:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:51 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:15:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:51 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2878657641' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b314c43-b6f0-492c-bc66-10af912f4d59"}]': finished 2024-09-19T07:15:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:51 smithi162 ceph-mon[35726]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T07:15:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:51 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:15:52.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:51 smithi139 ceph-mon[35039]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T07:15:52.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:51 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:15:52.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:51 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T07:15:52.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:51 smithi139 ceph-mon[35039]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T07:15:52.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:51 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:15:52.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:51 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2878657641' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b314c43-b6f0-492c-bc66-10af912f4d59"}]: dispatch 2024-09-19T07:15:52.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:51 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:15:52.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:51 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2878657641' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b314c43-b6f0-492c-bc66-10af912f4d59"}]': finished 2024-09-19T07:15:52.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:51 smithi139 ceph-mon[35039]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T07:15:52.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:51 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:15:52.523 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:15:52 smithi098 sudo[48914]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:15:52.523 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:15:52 smithi098 sudo[48914]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:15:52.523 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:15:52 smithi098 sudo[48914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:15:52.523 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:15:52 smithi098 sudo[48914]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:15:52.683 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:15:52 smithi139 sudo[43435]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:15:52.683 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:15:52 smithi139 sudo[43435]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:15:52.684 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:15:52 smithi139 sudo[43435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:15:52.684 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:15:52 smithi139 sudo[43435]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:15:53.067 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:15:52 smithi139 sudo[43438]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:15:53.067 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:15:52 smithi139 sudo[43438]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:15:53.067 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:15:52 smithi139 sudo[43438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:15:53.067 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:15:52 smithi139 sudo[43438]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:15:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:52 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4080454738' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:15:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:52 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:52 smithi139 ceph-mon[35039]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T07:15:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:52 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:15:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:52 smithi139 ceph-mon[35039]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:15:53.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:52 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:53.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:52 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4080454738' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:15:53.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:52 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:53.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:52 smithi162 ceph-mon[35726]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T07:15:53.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:52 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:15:53.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:52 smithi162 ceph-mon[35726]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:15:53.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:52 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:53.132 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:15:53 smithi162 sudo[44375]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:15:53.132 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:15:53 smithi162 sudo[44375]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:15:53.133 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:15:53 smithi162 sudo[44375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:15:53.133 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:15:53 smithi162 sudo[44375]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:15:53.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:52 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4080454738' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:15:53.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:52 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:53.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:52 smithi098 ceph-mon[30950]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T07:15:53.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:52 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:15:53.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:52 smithi098 ceph-mon[30950]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:15:53.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:52 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:53.632 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:15:53 smithi162 sudo[44378]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:15:53.632 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:15:53 smithi162 sudo[44378]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:15:53.632 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:15:53 smithi162 sudo[44378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:15:53.632 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:15:53 smithi162 sudo[44378]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:15:53.835 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:53 smithi098 sudo[49147]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:15:53.835 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:53 smithi098 sudo[49147]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:15:53.835 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:53 smithi098 sudo[49147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:15:53.835 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:53 smithi098 sudo[49147]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:15:54.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:53 smithi098 sudo[49334]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:15:54.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:53 smithi098 sudo[49334]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:15:54.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:53 smithi098 sudo[49334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:15:54.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:53 smithi098 sudo[49334]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:15:54.334 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 sudo[44381]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:15:54.334 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 sudo[44381]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:15:54.334 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 sudo[44381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:15:54.335 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 sudo[44381]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:15:54.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:15:54.343+0000 7f55337fe640 1 -- 172.21.15.98:0/482726422 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f552c098780 con 0x7f553c101cd0 2024-09-19T07:15:54.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 sudo[44384]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:15:54.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 sudo[44384]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:15:54.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 sudo[44384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:15:54.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 sudo[44384]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:15:54.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:54.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 ceph-mon[35726]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:15:54.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 ceph-mon[35726]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:15:54.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:15:54.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:15:54.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:15:54.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:15:54.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:15:54.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:15:54.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:54 smithi162 ceph-mon[35726]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T07:15:54.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:54 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:54.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:54 smithi098 ceph-mon[30950]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:15:54.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:54 smithi098 ceph-mon[30950]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:15:54.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:54 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:15:54.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:54 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:15:54.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:54 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:15:54.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:54 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:15:54.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:54 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:15:54.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:54 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:15:54.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:54 smithi098 ceph-mon[30950]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T07:15:54.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 sudo[43441]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T07:15:54.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 sudo[43441]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:15:54.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 sudo[43441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:15:54.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 sudo[43441]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:15:55.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 sudo[43444]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T07:15:55.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 sudo[43444]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T07:15:55.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 sudo[43444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T07:15:55.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 sudo[43444]: pam_unix(sudo:session): session closed for user root 2024-09-19T07:15:55.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:15:55.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 ceph-mon[35039]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:15:55.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 ceph-mon[35039]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:15:55.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:15:55.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:15:55.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:15:55.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:15:55.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:15:55.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:15:55.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:54 smithi139 ceph-mon[35039]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T07:15:55.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:55 smithi162 ceph-mon[35726]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:15:55.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:55 smithi162 ceph-mon[35726]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:15:55.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:55 smithi162 ceph-mon[35726]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:15:55.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:15:55.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:15:55.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:15:55.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:55 smithi162 ceph-mon[35726]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:15:55.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:55 smithi162 ceph-mon[35726]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:15:55.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:55 smithi098 ceph-mon[30950]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:15:55.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:55 smithi098 ceph-mon[30950]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:15:55.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:55 smithi098 ceph-mon[30950]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:15:55.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:15:55.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:15:55.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:15:55.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:55 smithi098 ceph-mon[30950]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:15:55.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:55 smithi098 ceph-mon[30950]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:15:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:55 smithi139 ceph-mon[35039]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:15:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:55 smithi139 ceph-mon[35039]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:15:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:55 smithi139 ceph-mon[35039]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T07:15:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:15:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:15:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:15:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:55 smithi139 ceph-mon[35039]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:15:55.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:55 smithi139 ceph-mon[35039]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T07:15:57.996 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:57 smithi098 ceph-mon[30950]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:15:58.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:57 smithi139 ceph-mon[35039]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:15:58.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:57 smithi162 ceph-mon[35726]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:15:59.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:15:59 smithi098 ceph-mon[30950]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:00.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:15:59 smithi139 ceph-mon[35039]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:15:59 smithi162 ceph-mon[35726]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:00.933 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T07:16:00.934 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T07:16:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:01.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T07:16:01.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:01.850 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:01 smithi098 ceph-mon[30950]: Deploying daemon osd.3 on smithi098 2024-09-19T07:16:01.851 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:01 smithi098 ceph-mon[30950]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:02.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:01 smithi139 ceph-mon[35039]: Deploying daemon osd.3 on smithi098 2024-09-19T07:16:02.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:01 smithi139 ceph-mon[35039]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:02.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:01 smithi162 ceph-mon[35726]: Deploying daemon osd.3 on smithi098 2024-09-19T07:16:02.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:01 smithi162 ceph-mon[35726]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:03 smithi098 ceph-mon[30950]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:04.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:03 smithi139 ceph-mon[35039]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:04.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:03 smithi162 ceph-mon[35726]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:05.889 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:05 smithi098 ceph-mon[30950]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:05 smithi139 ceph-mon[35039]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:05 smithi162 ceph-mon[35726]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:06.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:06.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:06.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:07.827 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:07 smithi098 ceph-mon[30950]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:07 smithi139 ceph-mon[35039]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:07 smithi162 ceph-mon[35726]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:09.949 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:09 smithi098 ceph-mon[30950]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:09.949 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:09 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:09.949 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:09 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:09.949 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:09 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:09.950 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:09 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:09.950 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:09 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:09.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.985+0000 7f55337fe640 1 -- 172.21.15.98:0/482726422 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f553c062630 con 0x7f55280a31b0 2024-09-19T07:16:09.986 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 3 on host 'smithi098' 2024-09-19T07:16:09.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.987+0000 7f55446f4640 1 -- 172.21.15.98:0/482726422 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f55280a31b0 msgr2=0x7f55280a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:09.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.987+0000 7f55446f4640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f55280a31b0 0x7f55280a5670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5538000c00 tx=0x7f55380046c0 comp rx=0 tx=0).stop 2024-09-19T07:16:09.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.987+0000 7f55446f4640 1 -- 172.21.15.98:0/482726422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c101cd0 msgr2=0x7f553c19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.987+0000 7f55446f4640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c101cd0 0x7f553c19cc70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f552c00e9f0 tx=0x7f552c00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:16:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.988+0000 7f55446f4640 1 -- 172.21.15.98:0/482726422 shutdown_connections 2024-09-19T07:16:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.988+0000 7f55446f4640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f55280a31b0 0x7f55280a5670 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.988+0000 7f55446f4640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f553c102690 0x7f553c19f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.988+0000 7f55446f4640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f553c101cd0 0x7f553c19cc70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.988+0000 7f55446f4640 1 --2- 172.21.15.98:0/482726422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f553c100ad0 0x7f553c06aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.988+0000 7f55446f4640 1 -- 172.21.15.98:0/482726422 >> 172.21.15.98:0/482726422 conn(0x7f553c0fc280 msgr2=0x7f553c105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.988+0000 7f55446f4640 1 -- 172.21.15.98:0/482726422 shutdown_connections 2024-09-19T07:16:09.989 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:16:09.988+0000 7f55446f4640 1 -- 172.21.15.98:0/482726422 wait complete. 2024-09-19T07:16:10.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:09 smithi139 ceph-mon[35039]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:10.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:09 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:10.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:09 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:10.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:09 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:10.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:09 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:10.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:09 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:09 smithi162 ceph-mon[35726]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:09 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:09 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:09 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:09 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:09 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:10.649 DEBUG:teuthology.orchestra.run.smithi098:osd.3> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T07:16:10.651 INFO:tasks.cephadm:Deploying osd.4 on smithi139 with /dev/vg_nvme/lv_3... 2024-09-19T07:16:10.651 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T07:16:10.908 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:16:10.954 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:10 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:10.955 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:10 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:10.955 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:10 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:11.029 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:10 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:11.029 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:10 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:11.029 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:10 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:11.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:10 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:11.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:10 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:11.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:10 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:11.946 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:11 smithi098 ceph-mon[30950]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:12.014 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:11 smithi139 ceph-mon[35039]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:12.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:11 smithi162 ceph-mon[35726]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:13.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:12 smithi098 ceph-mon[30950]: from='osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:16:13.024 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:16:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3[50933]: 2024-09-19T07:16:12.628+0000 7f8f53875640 -1 osd.3 0 log_to_monitors true 2024-09-19T07:16:13.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:12 smithi139 ceph-mon[35039]: from='osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:16:13.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:12 smithi162 ceph-mon[35726]: from='osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T07:16:13.332 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:16:13.359 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_3 2024-09-19T07:16:13.610 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:16:13.960 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:13.961 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: from='osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T07:16:13.961 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T07:16:13.961 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: from='osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-19T07:16:13.961 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:16:13.961 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:13.961 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:13.961 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:16:13.961 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:16:13.961 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:13.961 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:13.961 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:13.961 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:13 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:14.023 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3[50933]: 2024-09-19T07:16:13.693+0000 7f8f4efd5640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T07:16:14.023 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3[50933]: 2024-09-19T07:16:13.703+0000 7f8f4b60f640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:16:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: from='osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T07:16:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T07:16:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: from='osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-19T07:16:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:16:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:16:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:16:14.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:14.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:14.059 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.044+0000 7f05c5444640 1 -- 172.21.15.139:0/892970214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05c01026c0 msgr2=0x7f05c0108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:14.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.044+0000 7f05c5444640 1 --2- 172.21.15.139:0/892970214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05c01026c0 0x7f05c0108f50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009ca0 tx=0x7f05b802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:16:14.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.044+0000 7f05c5444640 1 -- 172.21.15.139:0/892970214 shutdown_connections 2024-09-19T07:16:14.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.044+0000 7f05c5444640 1 --2- 172.21.15.139:0/892970214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05c01026c0 0x7f05c0108f50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:14.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.044+0000 7f05c5444640 1 --2- 172.21.15.139:0/892970214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05c0101d00 0x7f05c0102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:14.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.044+0000 7f05c5444640 1 --2- 172.21.15.139:0/892970214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05c0100b00 0x7f05c0100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:14.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.044+0000 7f05c5444640 1 -- 172.21.15.139:0/892970214 >> 172.21.15.139:0/892970214 conn(0x7f05c00fc270 msgr2=0x7f05c00fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:14.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.044+0000 7f05c5444640 1 -- 172.21.15.139:0/892970214 shutdown_connections 2024-09-19T07:16:14.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.044+0000 7f05c5444640 1 -- 172.21.15.139:0/892970214 wait complete. 2024-09-19T07:16:14.060 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.045+0000 7f05c5444640 1 Processor -- start 2024-09-19T07:16:14.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.045+0000 7f05c5444640 1 -- start start 2024-09-19T07:16:14.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.045+0000 7f05c5444640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05c0100b00 0x7f05c006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:14.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.045+0000 7f05c5444640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05c0101d00 0x7f05c019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:14.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.045+0000 7f05c5444640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05c01026c0 0x7f05c019f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:14.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.045+0000 7f05c5444640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f05c010c760 con 0x7f05c0100b00 2024-09-19T07:16:14.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.045+0000 7f05c5444640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f05c010c5e0 con 0x7f05c0101d00 2024-09-19T07:16:14.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.045+0000 7f05c5444640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f05c010c8e0 con 0x7f05c01026c0 2024-09-19T07:16:14.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05be7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05c0101d00 0x7f05c019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:14.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05be7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05c0101d00 0x7f05c019cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:48364/0 (socket says 172.21.15.139:48364) 2024-09-19T07:16:14.061 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05be7fc640 1 -- 172.21.15.139:0/4184112531 learned_addr learned my addr 172.21.15.139:0/4184112531 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-19T07:16:14.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05bf7fe640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05c01026c0 0x7f05c019f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:14.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05beffd640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05c0100b00 0x7f05c006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:14.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05be7fc640 1 -- 172.21.15.139:0/4184112531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05c01026c0 msgr2=0x7f05c019f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:14.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05be7fc640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05c01026c0 0x7f05c019f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:14.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05be7fc640 1 -- 172.21.15.139:0/4184112531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05c0100b00 msgr2=0x7f05c006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:14.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05be7fc640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05c0100b00 0x7f05c006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:14.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05be7fc640 1 -- 172.21.15.139:0/4184112531 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c019fbb0 con 0x7f05c0101d00 2024-09-19T07:16:14.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05beffd640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05c0100b00 0x7f05c006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:16:14.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05be7fc640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05c0101d00 0x7f05c019cc80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f05b000d950 tx=0x7f05b000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:14.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05a7fff640 1 -- 172.21.15.139:0/4184112531 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b0017030 con 0x7f05c0101d00 2024-09-19T07:16:14.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05c5444640 1 -- 172.21.15.139:0/4184112531 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c019fe40 con 0x7f05c0101d00 2024-09-19T07:16:14.062 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05a7fff640 1 -- 172.21.15.139:0/4184112531 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05b0004020 con 0x7f05c0101d00 2024-09-19T07:16:14.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05a7fff640 1 -- 172.21.15.139:0/4184112531 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b00047a0 con 0x7f05c0101d00 2024-09-19T07:16:14.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.046+0000 7f05c5444640 1 -- 172.21.15.139:0/4184112531 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c01a0340 con 0x7f05c0101d00 2024-09-19T07:16:14.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.048+0000 7f05c5444640 1 -- 172.21.15.139:0/4184112531 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c0107fa0 con 0x7f05c0101d00 2024-09-19T07:16:14.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.048+0000 7f05a7fff640 1 -- 172.21.15.139:0/4184112531 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f05b00041d0 con 0x7f05c0101d00 2024-09-19T07:16:14.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.049+0000 7f05a7fff640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f05a80a3240 0x7f05a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:14.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.049+0000 7f05a7fff640 1 -- 172.21.15.139:0/4184112531 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7f05b00cdf40 con 0x7f05c0101d00 2024-09-19T07:16:14.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.049+0000 7f05beffd640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f05a80a3240 0x7f05a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:14.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.050+0000 7f05beffd640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f05a80a3240 0x7f05a80a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05c0101b60 tx=0x7f05b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:14.063 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.053+0000 7f05a7fff640 1 -- 172.21.15.139:0/4184112531 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f05b009bfa0 con 0x7f05c0101d00 2024-09-19T07:16:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: from='osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T07:16:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T07:16:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: from='osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-19T07:16:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:16:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:16:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:16:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:14.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:14.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:14.234+0000 7f05c5444640 1 -- 172.21.15.139:0/4184112531 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f05c0062630 con 0x7f05a80a3240 2024-09-19T07:16:14.954 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:14 smithi139 ceph-mon[35039]: Detected new or changed devices on smithi098 2024-09-19T07:16:14.954 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:14 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-19T07:16:14.954 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:14 smithi139 ceph-mon[35039]: from='osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-19T07:16:14.954 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:14 smithi139 ceph-mon[35039]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T07:16:14.954 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:16:14.954 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:16:14.954 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:16:14.955 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:16:14.955 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:14.955 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:14 smithi139 ceph-mon[35039]: osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395] boot 2024-09-19T07:16:15.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:14 smithi098 ceph-mon[30950]: Detected new or changed devices on smithi098 2024-09-19T07:16:15.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:14 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-19T07:16:15.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:14 smithi098 ceph-mon[30950]: from='osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-19T07:16:15.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:14 smithi098 ceph-mon[30950]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T07:16:15.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:16:15.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:16:15.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:16:15.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:16:15.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:15.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:14 smithi098 ceph-mon[30950]: osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395] boot 2024-09-19T07:16:15.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:14 smithi162 ceph-mon[35726]: Detected new or changed devices on smithi098 2024-09-19T07:16:15.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:14 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-19T07:16:15.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:14 smithi162 ceph-mon[35726]: from='osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-19T07:16:15.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:14 smithi162 ceph-mon[35726]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T07:16:15.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:16:15.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:16:15.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:16:15.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:16:15.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:15.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:14 smithi162 ceph-mon[35726]: osd.3 [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395] boot 2024-09-19T07:16:15.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:15 smithi139 ceph-mon[35039]: purged_snaps scrub starts 2024-09-19T07:16:15.821 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:15 smithi139 ceph-mon[35039]: purged_snaps scrub ok 2024-09-19T07:16:15.821 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:15 smithi139 ceph-mon[35039]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:16:15.821 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:15 smithi139 ceph-mon[35039]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:15.821 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:15 smithi139 ceph-mon[35039]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T07:16:15.821 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:15 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:16:15.821 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:15 smithi139 ceph-mon[35039]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T07:16:16.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:15 smithi098 ceph-mon[30950]: purged_snaps scrub starts 2024-09-19T07:16:16.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:15 smithi098 ceph-mon[30950]: purged_snaps scrub ok 2024-09-19T07:16:16.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:15 smithi098 ceph-mon[30950]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:16:16.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:15 smithi098 ceph-mon[30950]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:16.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:15 smithi098 ceph-mon[30950]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T07:16:16.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:15 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:16:16.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:15 smithi098 ceph-mon[30950]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T07:16:16.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:15 smithi162 ceph-mon[35726]: purged_snaps scrub starts 2024-09-19T07:16:16.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:15 smithi162 ceph-mon[35726]: purged_snaps scrub ok 2024-09-19T07:16:16.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:15 smithi162 ceph-mon[35726]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:16:16.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:15 smithi162 ceph-mon[35726]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T07:16:16.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:15 smithi162 ceph-mon[35726]: osdmap e23: 4 total, 4 up, 4 in 2024-09-19T07:16:16.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:15 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:16:16.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:15 smithi162 ceph-mon[35726]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T07:16:17.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:16 smithi098 ceph-mon[30950]: from='client.? 172.21.15.139:0/2784250609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62d22856-0d55-4a7c-90d2-ff68643ee0e0"}]: dispatch 2024-09-19T07:16:17.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:16 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62d22856-0d55-4a7c-90d2-ff68643ee0e0"}]: dispatch 2024-09-19T07:16:17.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:16 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62d22856-0d55-4a7c-90d2-ff68643ee0e0"}]': finished 2024-09-19T07:16:17.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:16 smithi098 ceph-mon[30950]: osdmap e25: 5 total, 4 up, 5 in 2024-09-19T07:16:17.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:17.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:16 smithi139 ceph-mon[35039]: from='client.? 172.21.15.139:0/2784250609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62d22856-0d55-4a7c-90d2-ff68643ee0e0"}]: dispatch 2024-09-19T07:16:17.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:16 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62d22856-0d55-4a7c-90d2-ff68643ee0e0"}]: dispatch 2024-09-19T07:16:17.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:16 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62d22856-0d55-4a7c-90d2-ff68643ee0e0"}]': finished 2024-09-19T07:16:17.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:16 smithi139 ceph-mon[35039]: osdmap e25: 5 total, 4 up, 5 in 2024-09-19T07:16:17.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:17.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:16 smithi162 ceph-mon[35726]: from='client.? 172.21.15.139:0/2784250609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62d22856-0d55-4a7c-90d2-ff68643ee0e0"}]: dispatch 2024-09-19T07:16:17.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:16 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62d22856-0d55-4a7c-90d2-ff68643ee0e0"}]: dispatch 2024-09-19T07:16:17.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:16 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62d22856-0d55-4a7c-90d2-ff68643ee0e0"}]': finished 2024-09-19T07:16:17.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:16 smithi162 ceph-mon[35726]: osdmap e25: 5 total, 4 up, 5 in 2024-09-19T07:16:17.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:18.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:17 smithi098 ceph-mon[30950]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:18.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:17 smithi098 ceph-mon[30950]: from='client.? 172.21.15.139:0/1372268166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:16:18.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:17 smithi098 ceph-mon[30950]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T07:16:18.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:18.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:17 smithi139 ceph-mon[35039]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:18.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:17 smithi139 ceph-mon[35039]: from='client.? 172.21.15.139:0/1372268166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:16:18.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:17 smithi139 ceph-mon[35039]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T07:16:18.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:18.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:17 smithi162 ceph-mon[35726]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:18.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:17 smithi162 ceph-mon[35726]: from='client.? 172.21.15.139:0/1372268166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:16:18.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:17 smithi162 ceph-mon[35726]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T07:16:18.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:19.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:19 smithi162 ceph-mon[35726]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:19.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:19 smithi162 ceph-mon[35726]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T07:16:19.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:19 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:19 smithi098 ceph-mon[30950]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:19 smithi098 ceph-mon[30950]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T07:16:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:19 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:20.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:19 smithi139 ceph-mon[35039]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:20.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:19 smithi139 ceph-mon[35039]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T07:16:20.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:19 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:21 smithi162 ceph-mon[35726]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:21.953 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:21 smithi139 ceph-mon[35039]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:22.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:21 smithi098 ceph-mon[30950]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:23.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:23 smithi162 ceph-mon[35726]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T07:16:23.928 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:23 smithi139 ceph-mon[35039]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T07:16:24.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:23 smithi098 ceph-mon[30950]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T07:16:25.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:25 smithi162 ceph-mon[35726]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:16:25.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T07:16:25.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:25 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:25.929 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:25 smithi139 ceph-mon[35039]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:16:25.929 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T07:16:25.929 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:25 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:26.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:25 smithi098 ceph-mon[30950]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:16:26.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T07:16:26.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:25 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:26.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:26 smithi139 ceph-mon[35039]: Deploying daemon osd.4 on smithi139 2024-09-19T07:16:26.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:26 smithi162 ceph-mon[35726]: Deploying daemon osd.4 on smithi139 2024-09-19T07:16:27.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:26 smithi098 ceph-mon[30950]: Deploying daemon osd.4 on smithi139 2024-09-19T07:16:27.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:27 smithi162 ceph-mon[35726]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T07:16:28.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:27 smithi098 ceph-mon[30950]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T07:16:28.048 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:27 smithi139 ceph-mon[35039]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T07:16:29.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:29 smithi162 ceph-mon[35726]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:16:29.883 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:29 smithi139 ceph-mon[35039]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:16:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:29 smithi098 ceph-mon[30950]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:16:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:31 smithi162 ceph-mon[35726]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:16:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:31 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:31 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:31 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:31.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:31 smithi139 ceph-mon[35039]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:16:31.991 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:31 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:31.991 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:31 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:31.991 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:31 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:32.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:31 smithi098 ceph-mon[30950]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:16:32.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:31 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:32.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:31 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:32.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:31 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:33.927 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:33 smithi139 ceph-mon[35039]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:16:34.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:33 smithi098 ceph-mon[30950]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:16:34.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:33 smithi162 ceph-mon[35726]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:16:35.431 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:35.431 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:35.431 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:35.431 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:35.431 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:35.431 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:35 smithi139 ceph-mon[35039]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:35.471 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 4 on host 'smithi139' 2024-09-19T07:16:35.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.470+0000 7f05a7fff640 1 -- 172.21.15.139:0/4184112531 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f05c0062630 con 0x7f05a80a3240 2024-09-19T07:16:35.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.472+0000 7f05c5444640 1 -- 172.21.15.139:0/4184112531 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f05a80a3240 msgr2=0x7f05a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:35.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.472+0000 7f05c5444640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f05a80a3240 0x7f05a80a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f05c0101b60 tx=0x7f05b4005f90 comp rx=0 tx=0).stop 2024-09-19T07:16:35.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.472+0000 7f05c5444640 1 -- 172.21.15.139:0/4184112531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05c0101d00 msgr2=0x7f05c019cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:35.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.472+0000 7f05c5444640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05c0101d00 0x7f05c019cc80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f05b000d950 tx=0x7f05b000de10 comp rx=0 tx=0).stop 2024-09-19T07:16:35.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.472+0000 7f05c5444640 1 -- 172.21.15.139:0/4184112531 shutdown_connections 2024-09-19T07:16:35.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.472+0000 7f05c5444640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f05a80a3240 0x7f05a80a5700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:35.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.472+0000 7f05c5444640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f05c01026c0 0x7f05c019f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:35.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.472+0000 7f05c5444640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05c0101d00 0x7f05c019cc80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:35.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.472+0000 7f05c5444640 1 --2- 172.21.15.139:0/4184112531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05c0100b00 0x7f05c006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:35.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.472+0000 7f05c5444640 1 -- 172.21.15.139:0/4184112531 >> 172.21.15.139:0/4184112531 conn(0x7f05c00fc270 msgr2=0x7f05c0105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:35.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.472+0000 7f05c5444640 1 -- 172.21.15.139:0/4184112531 shutdown_connections 2024-09-19T07:16:35.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:16:35.472+0000 7f05c5444640 1 -- 172.21.15.139:0/4184112531 wait complete. 2024-09-19T07:16:35.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:35.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:35.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:35.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:35.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:35.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:35 smithi098 ceph-mon[30950]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:35.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:35.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:35.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:35.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:35.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:35.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:35 smithi162 ceph-mon[35726]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:36.111 DEBUG:teuthology.orchestra.run.smithi139:osd.4> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T07:16:36.114 INFO:tasks.cephadm:Deploying osd.5 on smithi162 with /dev/vg_nvme/lv_3... 2024-09-19T07:16:36.114 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T07:16:36.369 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:16:36.417 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:36.417 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:36.418 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:36.484 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:36.484 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:36.484 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:36.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:36.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:36.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:37.476 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:37 smithi162 ceph-mon[35726]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:37.505 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:37 smithi139 ceph-mon[35039]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:37.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:37 smithi098 ceph-mon[30950]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:37.792 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:16:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4[46210]: 2024-09-19T07:16:37.504+0000 7fabde018640 -1 osd.4 0 log_to_monitors true 2024-09-19T07:16:38.339 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:38 smithi162 ceph-mon[35726]: from='osd.4 [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:16:38.339 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:38 smithi162 ceph-mon[35726]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:16:38.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:38 smithi098 ceph-mon[30950]: from='osd.4 [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:16:38.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:38 smithi098 ceph-mon[30950]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:16:38.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:38 smithi139 ceph-mon[35039]: from='osd.4 [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:16:38.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:38 smithi139 ceph-mon[35039]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T07:16:38.666 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:16:38.692 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_3 2024-09-19T07:16:38.960 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:16:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T07:16:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T07:16:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: from='osd.4 [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:16:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:16:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:16:39.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:16:39.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:39.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:39.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:39.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:39.349 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T07:16:39.349 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T07:16:39.349 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: from='osd.4 [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:16:39.350 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:39.350 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:16:39.350 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:39.350 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:39.350 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:39.350 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:16:39.351 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:16:39.351 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:39.351 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:39.351 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:39.351 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:39.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.433+0000 7fe9da212640 1 -- 172.21.15.162:0/1254522638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d4102e00 msgr2=0x7fe9d4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:39.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.433+0000 7fe9da212640 1 --2- 172.21.15.162:0/1254522638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d4102e00 0x7fe9d4103280 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009900 tx=0x7fe9c802a410 comp rx=0 tx=0).stop 2024-09-19T07:16:39.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.433+0000 7fe9da212640 1 -- 172.21.15.162:0/1254522638 shutdown_connections 2024-09-19T07:16:39.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.433+0000 7fe9da212640 1 --2- 172.21.15.162:0/1254522638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9d41037c0 0x7fe9d410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:39.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.433+0000 7fe9da212640 1 --2- 172.21.15.162:0/1254522638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d4102e00 0x7fe9d4103280 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:39.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.433+0000 7fe9da212640 1 --2- 172.21.15.162:0/1254522638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9d4101c00 0x7fe9d4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:39.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.433+0000 7fe9da212640 1 -- 172.21.15.162:0/1254522638 >> 172.21.15.162:0/1254522638 conn(0x7fe9d40fd390 msgr2=0x7fe9d40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:16:39.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.433+0000 7fe9da212640 1 -- 172.21.15.162:0/1254522638 shutdown_connections 2024-09-19T07:16:39.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.433+0000 7fe9da212640 1 -- 172.21.15.162:0/1254522638 wait complete. 2024-09-19T07:16:39.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.433+0000 7fe9da212640 1 Processor -- start 2024-09-19T07:16:39.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9da212640 1 -- start start 2024-09-19T07:16:39.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9da212640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9d4101c00 0x7fe9d4197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:39.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9da212640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d4102e00 0x7fe9d4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:39.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9da212640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9d41037c0 0x7fe9d419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:39.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9da212640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d410d860 con 0x7fe9d4101c00 2024-09-19T07:16:39.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9da212640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d410d6e0 con 0x7fe9d41037c0 2024-09-19T07:16:39.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9da212640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d410d9e0 con 0x7fe9d4102e00 2024-09-19T07:16:39.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9d2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d4102e00 0x7fe9d4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:39.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9d2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d4102e00 0x7fe9d4198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41168/0 (socket says 172.21.15.162:41168) 2024-09-19T07:16:39.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9d2ffd640 1 -- 172.21.15.162:0/1188248026 learned_addr learned my addr 172.21.15.162:0/1188248026 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T07:16:39.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9d3fff640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9d41037c0 0x7fe9d419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:39.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9d37fe640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9d4101c00 0x7fe9d4197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:39.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9d2ffd640 1 -- 172.21.15.162:0/1188248026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9d41037c0 msgr2=0x7fe9d419f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:39.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9d2ffd640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9d41037c0 0x7fe9d419f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:39.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9d2ffd640 1 -- 172.21.15.162:0/1188248026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9d4101c00 msgr2=0x7fe9d4197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:16:39.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9d2ffd640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9d4101c00 0x7fe9d4197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:16:39.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9d2ffd640 1 -- 172.21.15.162:0/1188248026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d419fb30 con 0x7fe9d4102e00 2024-09-19T07:16:39.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9d37fe640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9d4101c00 0x7fe9d4197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:16:39.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.434+0000 7fe9d2ffd640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d4102e00 0x7fe9d4198440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009230 tx=0x7fe9c8031b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:39.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.435+0000 7fe9d0ff9640 1 -- 172.21.15.162:0/1188248026 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c803f030 con 0x7fe9d4102e00 2024-09-19T07:16:39.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.435+0000 7fe9da212640 1 -- 172.21.15.162:0/1188248026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d419fdc0 con 0x7fe9d4102e00 2024-09-19T07:16:39.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.435+0000 7fe9d0ff9640 1 -- 172.21.15.162:0/1188248026 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9c8003ad0 con 0x7fe9d4102e00 2024-09-19T07:16:39.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.435+0000 7fe9d0ff9640 1 -- 172.21.15.162:0/1188248026 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8035070 con 0x7fe9d4102e00 2024-09-19T07:16:39.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.435+0000 7fe9da212640 1 -- 172.21.15.162:0/1188248026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d41a0210 con 0x7fe9d4102e00 2024-09-19T07:16:39.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.436+0000 7fe9da212640 1 -- 172.21.15.162:0/1188248026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d4109000 con 0x7fe9d4102e00 2024-09-19T07:16:39.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.437+0000 7fe9d0ff9640 1 -- 172.21.15.162:0/1188248026 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe9c8042030 con 0x7fe9d4102e00 2024-09-19T07:16:39.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.437+0000 7fe9d0ff9640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe9bc0a3270 0x7fe9bc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:16:39.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.437+0000 7fe9d0ff9640 1 -- 172.21.15.162:0/1188248026 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3821+0+0 (secure 0 0 0) 0x7fe9c80eecd0 con 0x7fe9d4102e00 2024-09-19T07:16:39.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.437+0000 7fe9d37fe640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe9bc0a3270 0x7fe9bc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:16:39.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.438+0000 7fe9d37fe640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe9bc0a3270 0x7fe9bc0a5730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4102c60 tx=0x7fe9c4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:16:39.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.442+0000 7fe9d0ff9640 1 -- 172.21.15.162:0/1188248026 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe9c80bcb80 con 0x7fe9d4102e00 2024-09-19T07:16:39.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T07:16:39.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T07:16:39.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: from='osd.4 [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:16:39.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:39.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:16:39.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:39.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:39.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:39.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:16:39.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:16:39.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:39.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:39.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:16:39.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:39.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:16:39.618+0000 7fe9da212640 1 -- 172.21.15.162:0/1188248026 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe9d4062630 con 0x7fe9bc0a3270 2024-09-19T07:16:40.303 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:40 smithi162 ceph-mon[35726]: Detected new or changed devices on smithi139 2024-09-19T07:16:40.303 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:40 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi139 to 8544M 2024-09-19T07:16:40.303 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:40 smithi162 ceph-mon[35726]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-19T07:16:40.303 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:40 smithi162 ceph-mon[35726]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T07:16:40.304 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:40 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:40.304 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:40 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:40.304 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:40 smithi162 ceph-mon[35726]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:16:40.304 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:40 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:16:40.304 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:40 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:16:40.304 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:40 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:40.304 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:40 smithi162 ceph-mon[35726]: from='osd.4 ' entity='osd.4' 2024-09-19T07:16:40.319 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4[46210]: 2024-09-19T07:16:39.987+0000 7fabda7af640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T07:16:40.320 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:16:39 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4[46210]: 2024-09-19T07:16:39.995+0000 7fabd1daa640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:16:40.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:40 smithi139 ceph-mon[35039]: Detected new or changed devices on smithi139 2024-09-19T07:16:40.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:40 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi139 to 8544M 2024-09-19T07:16:40.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:40 smithi139 ceph-mon[35039]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-19T07:16:40.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:40 smithi139 ceph-mon[35039]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T07:16:40.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:40 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:40.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:40 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:40.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:40 smithi139 ceph-mon[35039]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:16:40.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:40 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:16:40.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:40 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:16:40.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:40 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:40.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:40 smithi139 ceph-mon[35039]: from='osd.4 ' entity='osd.4' 2024-09-19T07:16:40.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:40 smithi098 ceph-mon[30950]: Detected new or changed devices on smithi139 2024-09-19T07:16:40.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:40 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi139 to 8544M 2024-09-19T07:16:40.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:40 smithi098 ceph-mon[30950]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-19T07:16:40.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:40 smithi098 ceph-mon[30950]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T07:16:40.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:40 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:40.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:40 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:40.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:40 smithi098 ceph-mon[30950]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:16:40.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:40 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:16:40.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:40 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:16:40.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:40 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:40.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:40 smithi098 ceph-mon[30950]: from='osd.4 ' entity='osd.4' 2024-09-19T07:16:41.490 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:41 smithi162 ceph-mon[35726]: purged_snaps scrub starts 2024-09-19T07:16:41.490 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:41 smithi162 ceph-mon[35726]: purged_snaps scrub ok 2024-09-19T07:16:41.490 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:41 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:41.491 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:41 smithi162 ceph-mon[35726]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:41.491 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:41 smithi162 ceph-mon[35726]: osd.4 [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034] boot 2024-09-19T07:16:41.491 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:41 smithi162 ceph-mon[35726]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T07:16:41.491 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:41 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:41.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:41 smithi098 ceph-mon[30950]: purged_snaps scrub starts 2024-09-19T07:16:41.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:41 smithi098 ceph-mon[30950]: purged_snaps scrub ok 2024-09-19T07:16:41.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:41 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:41.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:41 smithi098 ceph-mon[30950]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:41.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:41 smithi098 ceph-mon[30950]: osd.4 [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034] boot 2024-09-19T07:16:41.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:41 smithi098 ceph-mon[30950]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T07:16:41.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:41 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:41.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:41 smithi139 ceph-mon[35039]: purged_snaps scrub starts 2024-09-19T07:16:41.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:41 smithi139 ceph-mon[35039]: purged_snaps scrub ok 2024-09-19T07:16:41.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:41 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:41.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:41 smithi139 ceph-mon[35039]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-19T07:16:41.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:41 smithi139 ceph-mon[35039]: osd.4 [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034] boot 2024-09-19T07:16:41.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:41 smithi139 ceph-mon[35039]: osdmap e30: 5 total, 5 up, 5 in 2024-09-19T07:16:41.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:41 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:16:42.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:42 smithi162 ceph-mon[35726]: from='client.? 172.21.15.162:0/291246554' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbd4560c-4744-4863-aae3-a2c51b7c5e20"}]: dispatch 2024-09-19T07:16:42.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:42 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbd4560c-4744-4863-aae3-a2c51b7c5e20"}]: dispatch 2024-09-19T07:16:42.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:42 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbd4560c-4744-4863-aae3-a2c51b7c5e20"}]': finished 2024-09-19T07:16:42.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:42 smithi162 ceph-mon[35726]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T07:16:42.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:16:42.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:42 smithi098 ceph-mon[30950]: from='client.? 172.21.15.162:0/291246554' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbd4560c-4744-4863-aae3-a2c51b7c5e20"}]: dispatch 2024-09-19T07:16:42.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:42 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbd4560c-4744-4863-aae3-a2c51b7c5e20"}]: dispatch 2024-09-19T07:16:42.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:42 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbd4560c-4744-4863-aae3-a2c51b7c5e20"}]': finished 2024-09-19T07:16:42.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:42 smithi098 ceph-mon[30950]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T07:16:42.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:16:42.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:42 smithi139 ceph-mon[35039]: from='client.? 172.21.15.162:0/291246554' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbd4560c-4744-4863-aae3-a2c51b7c5e20"}]: dispatch 2024-09-19T07:16:42.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:42 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbd4560c-4744-4863-aae3-a2c51b7c5e20"}]: dispatch 2024-09-19T07:16:42.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:42 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbd4560c-4744-4863-aae3-a2c51b7c5e20"}]': finished 2024-09-19T07:16:42.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:42 smithi139 ceph-mon[35039]: osdmap e31: 6 total, 5 up, 6 in 2024-09-19T07:16:42.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:16:43.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:43 smithi098 ceph-mon[30950]: from='client.? 172.21.15.162:0/3112202090' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:16:43.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:43 smithi098 ceph-mon[30950]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:43.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:43 smithi139 ceph-mon[35039]: from='client.? 172.21.15.162:0/3112202090' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:16:43.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:43 smithi139 ceph-mon[35039]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:43.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:43 smithi162 ceph-mon[35726]: from='client.? 172.21.15.162:0/3112202090' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:16:43.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:43 smithi162 ceph-mon[35726]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:45 smithi098 ceph-mon[30950]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:46.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:45 smithi139 ceph-mon[35039]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:45 smithi162 ceph-mon[35726]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:47.862 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:47 smithi162 ceph-mon[35726]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:47 smithi098 ceph-mon[30950]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:47 smithi139 ceph-mon[35039]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:49.838 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:49 smithi162 ceph-mon[35726]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:49 smithi098 ceph-mon[30950]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:50.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:49 smithi139 ceph-mon[35039]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:51.005 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:50 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T07:16:51.005 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:50 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:51.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:50 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T07:16:51.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:50 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:51.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:50 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T07:16:51.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:50 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:16:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:51 smithi098 ceph-mon[30950]: Deploying daemon osd.5 on smithi162 2024-09-19T07:16:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:51 smithi098 ceph-mon[30950]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:52.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:51 smithi162 ceph-mon[35726]: Deploying daemon osd.5 on smithi162 2024-09-19T07:16:52.034 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:51 smithi162 ceph-mon[35726]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:52.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:51 smithi139 ceph-mon[35039]: Deploying daemon osd.5 on smithi162 2024-09-19T07:16:52.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:51 smithi139 ceph-mon[35039]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:53.869 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:53 smithi162 ceph-mon[35726]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:53 smithi098 ceph-mon[30950]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:54.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:53 smithi139 ceph-mon[35039]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:55.977 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:55 smithi162 ceph-mon[35726]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:56.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:55 smithi098 ceph-mon[30950]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:56.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:55 smithi139 ceph-mon[35039]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:57.006 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:56 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:57.006 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:56 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:57.006 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:56 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:57.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:56 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:57.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:56 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:57.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:56 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:57.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:56 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:16:57.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:56 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:57.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:56 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:16:57.986 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:57 smithi162 ceph-mon[35726]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:57 smithi098 ceph-mon[30950]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:16:58.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:57 smithi139 ceph-mon[35039]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:00.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:59 smithi098 ceph-mon[30950]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:00.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:00.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:00.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:00.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:00.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:16:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:00.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:59 smithi139 ceph-mon[35039]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:00.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:00.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:00.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:00.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:00.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:16:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:00.112 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:59 smithi162 ceph-mon[35726]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:00.112 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:00.112 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:00.112 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:00.112 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:00.112 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:16:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:00.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.376+0000 7fe9d0ff9640 1 -- 172.21.15.162:0/1188248026 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe9d4062630 con 0x7fe9bc0a3270 2024-09-19T07:17:00.376 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 5 on host 'smithi162' 2024-09-19T07:17:00.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.378+0000 7fe9da212640 1 -- 172.21.15.162:0/1188248026 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe9bc0a3270 msgr2=0x7fe9bc0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:00.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.378+0000 7fe9da212640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe9bc0a3270 0x7fe9bc0a5730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4102c60 tx=0x7fe9c4009500 comp rx=0 tx=0).stop 2024-09-19T07:17:00.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.378+0000 7fe9da212640 1 -- 172.21.15.162:0/1188248026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d4102e00 msgr2=0x7fe9d4198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:00.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.378+0000 7fe9da212640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d4102e00 0x7fe9d4198440 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009230 tx=0x7fe9c8031b60 comp rx=0 tx=0).stop 2024-09-19T07:17:00.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.378+0000 7fe9da212640 1 -- 172.21.15.162:0/1188248026 shutdown_connections 2024-09-19T07:17:00.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.378+0000 7fe9da212640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe9bc0a3270 0x7fe9bc0a5730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.378+0000 7fe9da212640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe9d41037c0 0x7fe9d419f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.378+0000 7fe9da212640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9d4102e00 0x7fe9d4198440 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.378+0000 7fe9da212640 1 --2- 172.21.15.162:0/1188248026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe9d4101c00 0x7fe9d4197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:00.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.378+0000 7fe9da212640 1 -- 172.21.15.162:0/1188248026 >> 172.21.15.162:0/1188248026 conn(0x7fe9d40fd390 msgr2=0x7fe9d41061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:00.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.378+0000 7fe9da212640 1 -- 172.21.15.162:0/1188248026 shutdown_connections 2024-09-19T07:17:00.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:00.378+0000 7fe9da212640 1 -- 172.21.15.162:0/1188248026 wait complete. 2024-09-19T07:17:00.951 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:00.952 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:00.952 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:00.976 DEBUG:teuthology.orchestra.run.smithi162:osd.5> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T07:17:00.979 INFO:tasks.cephadm:Deploying osd.6 on smithi098 with /dev/vg_nvme/lv_2... 2024-09-19T07:17:00.979 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T07:17:01.008 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:01.008 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:01.008 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:01.234 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:17:01.873 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:01 smithi162 ceph-mon[35726]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:02.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:01 smithi098 ceph-mon[30950]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:02.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:01 smithi139 ceph-mon[35039]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:03.130 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:17:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:17:02.858+0000 7f1f584e1640 -1 osd.5 0 log_to_monitors true 2024-09-19T07:17:03.609 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:17:03.636 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_2 2024-09-19T07:17:03.938 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:17:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:03 smithi098 ceph-mon[30950]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:03 smithi098 ceph-mon[30950]: from='osd.5 [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:17:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:03 smithi098 ceph-mon[30950]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:17:04.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:03 smithi139 ceph-mon[35039]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:04.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:03 smithi139 ceph-mon[35039]: from='osd.5 [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:17:04.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:03 smithi139 ceph-mon[35039]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:17:04.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:03 smithi162 ceph-mon[35726]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:04.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:03 smithi162 ceph-mon[35726]: from='osd.5 [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:17:04.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:03 smithi162 ceph-mon[35726]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T07:17:04.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.369+0000 7fa726b94640 1 -- 172.21.15.98:0/3764875871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7201026d0 msgr2=0x7fa720108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:04.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.369+0000 7fa726b94640 1 --2- 172.21.15.98:0/3764875871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7201026d0 0x7fa720108f60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa718009ca0 tx=0x7fa71802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:17:04.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.369+0000 7fa726b94640 1 -- 172.21.15.98:0/3764875871 shutdown_connections 2024-09-19T07:17:04.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.369+0000 7fa726b94640 1 --2- 172.21.15.98:0/3764875871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7201026d0 0x7fa720108f60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:04.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.369+0000 7fa726b94640 1 --2- 172.21.15.98:0/3764875871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa720101d10 0x7fa720102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:04.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.369+0000 7fa726b94640 1 --2- 172.21.15.98:0/3764875871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa720100b10 0x7fa720100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:04.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.369+0000 7fa726b94640 1 -- 172.21.15.98:0/3764875871 >> 172.21.15.98:0/3764875871 conn(0x7fa7200fc2a0 msgr2=0x7fa7200fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:04.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.369+0000 7fa726b94640 1 -- 172.21.15.98:0/3764875871 shutdown_connections 2024-09-19T07:17:04.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.369+0000 7fa726b94640 1 -- 172.21.15.98:0/3764875871 wait complete. 2024-09-19T07:17:04.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa726b94640 1 Processor -- start 2024-09-19T07:17:04.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa726b94640 1 -- start start 2024-09-19T07:17:04.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa726b94640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa720100b10 0x7fa72006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:04.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa726b94640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa720101d10 0x7fa72019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:04.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa726b94640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7201026d0 0x7fa72019f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:04.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa725131640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7201026d0 0x7fa72019f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:04.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa726b94640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa72010c7f0 con 0x7fa7201026d0 2024-09-19T07:17:04.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa726b94640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa72010c670 con 0x7fa720100b10 2024-09-19T07:17:04.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa725131640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7201026d0 0x7fa72019f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54516/0 (socket says 172.21.15.98:54516) 2024-09-19T07:17:04.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa726b94640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa72010c970 con 0x7fa720101d10 2024-09-19T07:17:04.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa725131640 1 -- 172.21.15.98:0/471593455 learned_addr learned my addr 172.21.15.98:0/471593455 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:17:04.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa724930640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa720100b10 0x7fa72006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:04.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa71ffff640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa720101d10 0x7fa72019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:04.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa725131640 1 -- 172.21.15.98:0/471593455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa720101d10 msgr2=0x7fa72019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:04.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.370+0000 7fa725131640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa720101d10 0x7fa72019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:04.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.371+0000 7fa725131640 1 -- 172.21.15.98:0/471593455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa720100b10 msgr2=0x7fa72006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:04.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.371+0000 7fa725131640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa720100b10 0x7fa72006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:04.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.371+0000 7fa725131640 1 -- 172.21.15.98:0/471593455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72019fba0 con 0x7fa7201026d0 2024-09-19T07:17:04.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.371+0000 7fa725131640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7201026d0 0x7fa72019f290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa718005e30 tx=0x7fa718031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:04.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.371+0000 7fa71dffb640 1 -- 172.21.15.98:0/471593455 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71804b070 con 0x7fa7201026d0 2024-09-19T07:17:04.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.371+0000 7fa71dffb640 1 -- 172.21.15.98:0/471593455 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa718003c40 con 0x7fa7201026d0 2024-09-19T07:17:04.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.371+0000 7fa726b94640 1 -- 172.21.15.98:0/471593455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa720196a40 con 0x7fa7201026d0 2024-09-19T07:17:04.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.371+0000 7fa71dffb640 1 -- 172.21.15.98:0/471593455 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa718004680 con 0x7fa7201026d0 2024-09-19T07:17:04.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.371+0000 7fa726b94640 1 -- 172.21.15.98:0/471593455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa720197050 con 0x7fa7201026d0 2024-09-19T07:17:04.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.372+0000 7fa726b94640 1 -- 172.21.15.98:0/471593455 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa720107f10 con 0x7fa7201026d0 2024-09-19T07:17:04.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.373+0000 7fa71dffb640 1 -- 172.21.15.98:0/471593455 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa71804e070 con 0x7fa7201026d0 2024-09-19T07:17:04.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.374+0000 7fa71dffb640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa7100a32c0 0x7fa7100a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:04.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.374+0000 7fa724930640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa7100a32c0 0x7fa7100a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:04.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.374+0000 7fa71dffb640 1 -- 172.21.15.98:0/471593455 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4237+0+0 (secure 0 0 0) 0x7fa7180f33b0 con 0x7fa7201026d0 2024-09-19T07:17:04.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.374+0000 7fa724930640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa7100a32c0 0x7fa7100a5780 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa720101b70 tx=0x7fa71400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:04.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.378+0000 7fa71dffb640 1 -- 172.21.15.98:0/471593455 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa718083210 con 0x7fa7201026d0 2024-09-19T07:17:04.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:04.553+0000 7fa726b94640 1 -- 172.21.15.98:0/471593455 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa720198500 con 0x7fa7100a32c0 2024-09-19T07:17:04.957 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T07:17:04.957 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T07:17:04.957 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:17:04.957 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='osd.5 [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:17:04.957 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:17:04.957 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: Detected new or changed devices on smithi162 2024-09-19T07:17:04.957 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:04.957 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:04.958 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:04.958 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:04.958 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-19T07:17:04.958 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:04.958 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:04.958 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:04.958 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:04.958 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:17:04.958 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:17:04.958 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:05.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T07:17:05.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T07:17:05.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:17:05.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='osd.5 [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:17:05.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:17:05.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: Detected new or changed devices on smithi162 2024-09-19T07:17:05.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:05.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:05.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:05.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:05.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-19T07:17:05.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:05.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:05.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:05.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:05.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:17:05.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:17:05.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:05.132 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:17:04.702+0000 7f1f53c41640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T07:17:05.132 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:17:04.710+0000 7f1f5027b640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:17:05.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T07:17:05.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='osd.5 [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: Detected new or changed devices on smithi162 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi162 to 8544M 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:05.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:17:05.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:17:05.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:06.007 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:05 smithi098 ceph-mon[30950]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:17:06.007 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:05 smithi098 ceph-mon[30950]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:06.007 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:05 smithi098 ceph-mon[30950]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T07:17:06.007 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:05 smithi098 ceph-mon[30950]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T07:17:06.007 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:05 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:17:06.007 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:05 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:17:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:05 smithi139 ceph-mon[35039]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:17:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:05 smithi139 ceph-mon[35039]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:05 smithi139 ceph-mon[35039]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T07:17:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:05 smithi139 ceph-mon[35039]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T07:17:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:05 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:17:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:05 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:17:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:05 smithi162 ceph-mon[35726]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:17:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:05 smithi162 ceph-mon[35726]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:05 smithi162 ceph-mon[35726]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T07:17:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:05 smithi162 ceph-mon[35726]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T07:17:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:05 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:17:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:05 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:17:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:06 smithi098 ceph-mon[30950]: purged_snaps scrub starts 2024-09-19T07:17:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:06 smithi098 ceph-mon[30950]: purged_snaps scrub ok 2024-09-19T07:17:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:06 smithi098 ceph-mon[30950]: osd.5 [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028] boot 2024-09-19T07:17:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:06 smithi098 ceph-mon[30950]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T07:17:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:17:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:06 smithi098 ceph-mon[30950]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T07:17:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:06 smithi139 ceph-mon[35039]: purged_snaps scrub starts 2024-09-19T07:17:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:06 smithi139 ceph-mon[35039]: purged_snaps scrub ok 2024-09-19T07:17:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:06 smithi139 ceph-mon[35039]: osd.5 [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028] boot 2024-09-19T07:17:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:06 smithi139 ceph-mon[35039]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T07:17:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:17:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:06 smithi139 ceph-mon[35039]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T07:17:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:06 smithi162 ceph-mon[35726]: purged_snaps scrub starts 2024-09-19T07:17:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:06 smithi162 ceph-mon[35726]: purged_snaps scrub ok 2024-09-19T07:17:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:06 smithi162 ceph-mon[35726]: osd.5 [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028] boot 2024-09-19T07:17:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:06 smithi162 ceph-mon[35726]: osdmap e34: 6 total, 6 up, 6 in 2024-09-19T07:17:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:17:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:06 smithi162 ceph-mon[35726]: osdmap e35: 6 total, 6 up, 6 in 2024-09-19T07:17:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:07 smithi098 ceph-mon[30950]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:07 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4084028251' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ccb29a18-5a73-4e5c-86fb-1596e5386ce8"}]: dispatch 2024-09-19T07:17:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:07 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4084028251' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccb29a18-5a73-4e5c-86fb-1596e5386ce8"}]': finished 2024-09-19T07:17:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:07 smithi098 ceph-mon[30950]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T07:17:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:07 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:07 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2165041633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:17:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:07 smithi139 ceph-mon[35039]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:07 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4084028251' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ccb29a18-5a73-4e5c-86fb-1596e5386ce8"}]: dispatch 2024-09-19T07:17:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:07 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4084028251' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccb29a18-5a73-4e5c-86fb-1596e5386ce8"}]': finished 2024-09-19T07:17:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:07 smithi139 ceph-mon[35039]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T07:17:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:07 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:07 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2165041633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:17:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:07 smithi162 ceph-mon[35726]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-19T07:17:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:07 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4084028251' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ccb29a18-5a73-4e5c-86fb-1596e5386ce8"}]: dispatch 2024-09-19T07:17:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:07 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4084028251' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ccb29a18-5a73-4e5c-86fb-1596e5386ce8"}]': finished 2024-09-19T07:17:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:07 smithi162 ceph-mon[35726]: osdmap e36: 7 total, 6 up, 7 in 2024-09-19T07:17:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:07 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:07 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2165041633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:17:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:08 smithi162 ceph-mon[35726]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T07:17:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:08 smithi162 ceph-mon[35726]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:09.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:08 smithi098 ceph-mon[30950]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T07:17:09.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:08 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:09.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:08 smithi098 ceph-mon[30950]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:09.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:08 smithi139 ceph-mon[35039]: osdmap e37: 7 total, 6 up, 7 in 2024-09-19T07:17:09.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:08 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:09.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:08 smithi139 ceph-mon[35039]: pgmap v133: 1 pgs: 1 remapped+peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:10.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:09 smithi162 ceph-mon[35726]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T07:17:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:09 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:10.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:09 smithi098 ceph-mon[30950]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T07:17:10.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:09 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:10.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:09 smithi139 ceph-mon[35039]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T07:17:10.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:09 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:11.125 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:10 smithi098 ceph-mon[30950]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:11.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:10 smithi162 ceph-mon[35726]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:11.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:10 smithi139 ceph-mon[35039]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:13.949 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:13 smithi098 ceph-mon[30950]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T07:17:14.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:13 smithi139 ceph-mon[35039]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T07:17:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:13 smithi162 ceph-mon[35726]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T07:17:15.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:15 smithi098 ceph-mon[30950]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T07:17:15.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:15 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T07:17:15.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:15 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:15.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:15 smithi098 ceph-mon[30950]: Deploying daemon osd.6 on smithi098 2024-09-19T07:17:16.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:15 smithi139 ceph-mon[35039]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T07:17:16.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:15 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T07:17:16.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:15 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:16.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:15 smithi139 ceph-mon[35039]: Deploying daemon osd.6 on smithi098 2024-09-19T07:17:16.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:15 smithi162 ceph-mon[35726]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T07:17:16.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:15 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T07:17:16.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:15 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:16.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:15 smithi162 ceph-mon[35726]: Deploying daemon osd.6 on smithi098 2024-09-19T07:17:17.934 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:17 smithi162 ceph-mon[35726]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T07:17:17.973 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:17 smithi098 ceph-mon[30950]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T07:17:18.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:17 smithi139 ceph-mon[35039]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T07:17:19.992 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:19 smithi098 ceph-mon[30950]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:17:20.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:19 smithi139 ceph-mon[35039]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:17:20.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:19 smithi162 ceph-mon[35726]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:17:21.005 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:20 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:21.005 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:20 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:21.005 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:20 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:21.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:20 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:21.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:20 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:21.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:20 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:21.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:20 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:21.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:20 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:21.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:20 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:21.993 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:21 smithi098 ceph-mon[30950]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T07:17:22.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:21 smithi139 ceph-mon[35039]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T07:17:22.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:21 smithi162 ceph-mon[35726]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T07:17:23.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:23 smithi098 ceph-mon[30950]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:17:23.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:23.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:23.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:23.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:23.846 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:24.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:23 smithi139 ceph-mon[35039]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:17:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:23 smithi162 ceph-mon[35726]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:17:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:24.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.146+0000 7fa71dffb640 1 -- 172.21.15.98:0/471593455 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa720198500 con 0x7fa7100a32c0 2024-09-19T07:17:24.147 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 6 on host 'smithi098' 2024-09-19T07:17:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.148+0000 7fa726b94640 1 -- 172.21.15.98:0/471593455 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa7100a32c0 msgr2=0x7fa7100a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.148+0000 7fa726b94640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa7100a32c0 0x7fa7100a5780 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa720101b70 tx=0x7fa71400b390 comp rx=0 tx=0).stop 2024-09-19T07:17:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.148+0000 7fa726b94640 1 -- 172.21.15.98:0/471593455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7201026d0 msgr2=0x7fa72019f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.148+0000 7fa726b94640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7201026d0 0x7fa72019f290 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa718005e30 tx=0x7fa718031ee0 comp rx=0 tx=0).stop 2024-09-19T07:17:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.149+0000 7fa726b94640 1 -- 172.21.15.98:0/471593455 shutdown_connections 2024-09-19T07:17:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.149+0000 7fa726b94640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa7100a32c0 0x7fa7100a5780 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.149+0000 7fa726b94640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7201026d0 0x7fa72019f290 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.149+0000 7fa726b94640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa720101d10 0x7fa72019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.149+0000 7fa726b94640 1 --2- 172.21.15.98:0/471593455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa720100b10 0x7fa72006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.149+0000 7fa726b94640 1 -- 172.21.15.98:0/471593455 >> 172.21.15.98:0/471593455 conn(0x7fa7200fc2a0 msgr2=0x7fa7201050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.149+0000 7fa726b94640 1 -- 172.21.15.98:0/471593455 shutdown_connections 2024-09-19T07:17:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:17:24.149+0000 7fa726b94640 1 -- 172.21.15.98:0/471593455 wait complete. 2024-09-19T07:17:24.736 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:24.736 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:24.736 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:24 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:24.737 DEBUG:teuthology.orchestra.run.smithi098:osd.6> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T07:17:24.739 INFO:tasks.cephadm:Deploying osd.7 on smithi139 with /dev/vg_nvme/lv_2... 2024-09-19T07:17:24.740 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T07:17:24.994 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:17:25.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:25.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:25.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:24 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:25.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:25.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:25.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:24 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:25.766 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:25 smithi098 ceph-mon[30950]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:26.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:25 smithi139 ceph-mon[35039]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:26.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:25 smithi162 ceph-mon[35726]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:26.523 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:17:26 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:17:26.100+0000 7f68d32d8640 -1 osd.6 0 log_to_monitors true 2024-09-19T07:17:26.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:26 smithi139 ceph-mon[35039]: from='osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T07:17:27.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:26 smithi098 ceph-mon[30950]: from='osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T07:17:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:26 smithi162 ceph-mon[35726]: from='osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T07:17:27.532 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:17:27.559 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_2 2024-09-19T07:17:27.816 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:17:27.948 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:27.948 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: from='osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T07:17:27.948 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T07:17:27.948 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: from='osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-19T07:17:27.948 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:27.948 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:27.948 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:27.948 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:27.948 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:27.949 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:27.949 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:27.949 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:27.949 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:27.949 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:28.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:17:27.693+0000 7f68cfa6f640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T07:17:28.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:17:27.700+0000 7f68cb072640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:17:28.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:28.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: from='osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T07:17:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T07:17:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: from='osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-19T07:17:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:28.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: from='osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T07:17:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T07:17:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: from='osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-19T07:17:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:28.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:28.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:28.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:28.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:28.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.307+0000 7fed19825640 1 -- 172.21.15.139:0/874601110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed14100ad0 msgr2=0x7fed14100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:28.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.307+0000 7fed19825640 1 --2- 172.21.15.139:0/874601110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed14100ad0 0x7fed14100ed0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fed08009900 tx=0x7fed0802a410 comp rx=0 tx=0).stop 2024-09-19T07:17:28.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.307+0000 7fed19825640 1 -- 172.21.15.139:0/874601110 shutdown_connections 2024-09-19T07:17:28.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.307+0000 7fed19825640 1 --2- 172.21.15.139:0/874601110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed14102690 0x7fed14108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:28.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.307+0000 7fed19825640 1 --2- 172.21.15.139:0/874601110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed14101cd0 0x7fed14102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:28.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.307+0000 7fed19825640 1 --2- 172.21.15.139:0/874601110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed14100ad0 0x7fed14100ed0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:28.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.307+0000 7fed19825640 1 -- 172.21.15.139:0/874601110 >> 172.21.15.139:0/874601110 conn(0x7fed140fc280 msgr2=0x7fed140fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:28.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.308+0000 7fed19825640 1 -- 172.21.15.139:0/874601110 shutdown_connections 2024-09-19T07:17:28.325 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.308+0000 7fed19825640 1 -- 172.21.15.139:0/874601110 wait complete. 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.308+0000 7fed19825640 1 Processor -- start 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.308+0000 7fed19825640 1 -- start start 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.308+0000 7fed19825640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed14100ad0 0x7fed14196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed19825640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed14101cd0 0x7fed141972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed19825640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed14102690 0x7fed1419e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed19825640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fed1410c730 con 0x7fed14100ad0 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed19825640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fed1410c5b0 con 0x7fed14102690 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed19825640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fed1410c8b0 con 0x7fed14101cd0 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed12ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed14100ad0 0x7fed14196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed12ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed14100ad0 0x7fed14196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.139:46990/0 (socket says 172.21.15.139:46990) 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed12ffd640 1 -- 172.21.15.139:0/3727295224 learned_addr learned my addr 172.21.15.139:0/3727295224 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed127fc640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed14101cd0 0x7fed141972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:28.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed137fe640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed14102690 0x7fed1419e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:28.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed12ffd640 1 -- 172.21.15.139:0/3727295224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed14101cd0 msgr2=0x7fed141972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:28.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed12ffd640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed14101cd0 0x7fed141972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:28.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed12ffd640 1 -- 172.21.15.139:0/3727295224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed14102690 msgr2=0x7fed1419e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:28.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed12ffd640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed14102690 0x7fed1419e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:28.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed12ffd640 1 -- 172.21.15.139:0/3727295224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1419e9e0 con 0x7fed14100ad0 2024-09-19T07:17:28.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed12ffd640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed14100ad0 0x7fed14196db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed08031610 tx=0x7fed080043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:28.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.309+0000 7fed18823640 1 -- 172.21.15.139:0/3727295224 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0803f030 con 0x7fed14100ad0 2024-09-19T07:17:28.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.310+0000 7fed18823640 1 -- 172.21.15.139:0/3727295224 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed08003ce0 con 0x7fed14100ad0 2024-09-19T07:17:28.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.310+0000 7fed19825640 1 -- 172.21.15.139:0/3727295224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed1419ec70 con 0x7fed14100ad0 2024-09-19T07:17:28.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.310+0000 7fed18823640 1 -- 172.21.15.139:0/3727295224 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed08035070 con 0x7fed14100ad0 2024-09-19T07:17:28.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.310+0000 7fed19825640 1 -- 172.21.15.139:0/3727295224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed1419f150 con 0x7fed14100ad0 2024-09-19T07:17:28.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.310+0000 7fed19825640 1 -- 172.21.15.139:0/3727295224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed14107e70 con 0x7fed14100ad0 2024-09-19T07:17:28.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.312+0000 7fed18823640 1 -- 172.21.15.139:0/3727295224 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fed08042030 con 0x7fed14100ad0 2024-09-19T07:17:28.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.312+0000 7fed18823640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fecfc0a3270 0x7fecfc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:28.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.313+0000 7fed18823640 1 -- 172.21.15.139:0/3727295224 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4685+0+0 (secure 0 0 0) 0x7fed080ef2b0 con 0x7fed14100ad0 2024-09-19T07:17:28.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.313+0000 7fed127fc640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fecfc0a3270 0x7fecfc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:28.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.313+0000 7fed127fc640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fecfc0a3270 0x7fecfc0a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed141982d0 tx=0x7fed0400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:28.328 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.316+0000 7fed18823640 1 -- 172.21.15.139:0/3727295224 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fed080bc710 con 0x7fed14100ad0 2024-09-19T07:17:28.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:28.498+0000 7fed19825640 1 -- 172.21.15.139:0/3727295224 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fed14062630 con 0x7fecfc0a3270 2024-09-19T07:17:28.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:28 smithi139 ceph-mon[35039]: Detected new or changed devices on smithi098 2024-09-19T07:17:28.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:28 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-19T07:17:28.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:28 smithi139 ceph-mon[35039]: from='osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-19T07:17:28.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:28 smithi139 ceph-mon[35039]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T07:17:28.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:28 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:28.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:28 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:28.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:28 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:17:28.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:28 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:17:28.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:28 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:29.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:28 smithi098 ceph-mon[30950]: Detected new or changed devices on smithi098 2024-09-19T07:17:29.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:28 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-19T07:17:29.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:28 smithi098 ceph-mon[30950]: from='osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-19T07:17:29.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:28 smithi098 ceph-mon[30950]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T07:17:29.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:28 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:29.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:28 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:29.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:28 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:17:29.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:28 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:17:29.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:28 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:29.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:28 smithi162 ceph-mon[35726]: Detected new or changed devices on smithi098 2024-09-19T07:17:29.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:28 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-19T07:17:29.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:28 smithi162 ceph-mon[35726]: from='osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-19T07:17:29.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:28 smithi162 ceph-mon[35726]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T07:17:29.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:28 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:29.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:28 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:29.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:28 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:17:29.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:28 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:17:29.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:28 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:29.888 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:29 smithi139 ceph-mon[35039]: purged_snaps scrub starts 2024-09-19T07:17:29.888 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:29 smithi139 ceph-mon[35039]: purged_snaps scrub ok 2024-09-19T07:17:29.889 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:29 smithi139 ceph-mon[35039]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:17:29.889 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:29 smithi139 ceph-mon[35039]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:29.889 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:29 smithi139 ceph-mon[35039]: osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351] boot 2024-09-19T07:17:29.889 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:29 smithi139 ceph-mon[35039]: osdmap e41: 7 total, 7 up, 7 in 2024-09-19T07:17:29.889 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:29 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:29 smithi098 ceph-mon[30950]: purged_snaps scrub starts 2024-09-19T07:17:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:29 smithi098 ceph-mon[30950]: purged_snaps scrub ok 2024-09-19T07:17:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:29 smithi098 ceph-mon[30950]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:17:30.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:29 smithi098 ceph-mon[30950]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:30.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:29 smithi098 ceph-mon[30950]: osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351] boot 2024-09-19T07:17:30.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:29 smithi098 ceph-mon[30950]: osdmap e41: 7 total, 7 up, 7 in 2024-09-19T07:17:30.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:29 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:29 smithi162 ceph-mon[35726]: purged_snaps scrub starts 2024-09-19T07:17:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:29 smithi162 ceph-mon[35726]: purged_snaps scrub ok 2024-09-19T07:17:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:29 smithi162 ceph-mon[35726]: from='client.14388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:17:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:29 smithi162 ceph-mon[35726]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-19T07:17:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:29 smithi162 ceph-mon[35726]: osd.6 [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351] boot 2024-09-19T07:17:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:29 smithi162 ceph-mon[35726]: osdmap e41: 7 total, 7 up, 7 in 2024-09-19T07:17:30.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:29 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:17:30.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:30 smithi139 ceph-mon[35039]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T07:17:31.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:30 smithi098 ceph-mon[30950]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T07:17:31.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:30 smithi162 ceph-mon[35726]: osdmap e42: 7 total, 7 up, 7 in 2024-09-19T07:17:32.030 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:31 smithi098 ceph-mon[30950]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:32.030 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:31 smithi098 ceph-mon[30950]: from='client.? 172.21.15.139:0/1875096246' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "532269e4-0c74-4b64-95c0-1e4ff49d817e"}]: dispatch 2024-09-19T07:17:32.030 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:31 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "532269e4-0c74-4b64-95c0-1e4ff49d817e"}]: dispatch 2024-09-19T07:17:32.031 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:31 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "532269e4-0c74-4b64-95c0-1e4ff49d817e"}]': finished 2024-09-19T07:17:32.031 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:31 smithi098 ceph-mon[30950]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T07:17:32.031 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:31 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:32.031 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:31 smithi098 ceph-mon[30950]: from='client.? 172.21.15.139:0/3802568310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:17:32.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:31 smithi139 ceph-mon[35039]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:32.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:31 smithi139 ceph-mon[35039]: from='client.? 172.21.15.139:0/1875096246' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "532269e4-0c74-4b64-95c0-1e4ff49d817e"}]: dispatch 2024-09-19T07:17:32.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:31 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "532269e4-0c74-4b64-95c0-1e4ff49d817e"}]: dispatch 2024-09-19T07:17:32.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:31 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "532269e4-0c74-4b64-95c0-1e4ff49d817e"}]': finished 2024-09-19T07:17:32.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:31 smithi139 ceph-mon[35039]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T07:17:32.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:31 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:32.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:31 smithi139 ceph-mon[35039]: from='client.? 172.21.15.139:0/3802568310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:17:32.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:31 smithi162 ceph-mon[35726]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:32.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:31 smithi162 ceph-mon[35726]: from='client.? 172.21.15.139:0/1875096246' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "532269e4-0c74-4b64-95c0-1e4ff49d817e"}]: dispatch 2024-09-19T07:17:32.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:31 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "532269e4-0c74-4b64-95c0-1e4ff49d817e"}]: dispatch 2024-09-19T07:17:32.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:31 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "532269e4-0c74-4b64-95c0-1e4ff49d817e"}]': finished 2024-09-19T07:17:32.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:31 smithi162 ceph-mon[35726]: osdmap e43: 8 total, 7 up, 8 in 2024-09-19T07:17:32.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:31 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:32.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:31 smithi162 ceph-mon[35726]: from='client.? 172.21.15.139:0/3802568310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:17:34.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:33 smithi098 ceph-mon[30950]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:34.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:33 smithi139 ceph-mon[35039]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:34.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:33 smithi162 ceph-mon[35726]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:36.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:35 smithi098 ceph-mon[30950]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:36.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:35 smithi139 ceph-mon[35039]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:36.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:35 smithi162 ceph-mon[35726]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:38.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:37 smithi098 ceph-mon[30950]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:38.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:37 smithi139 ceph-mon[35039]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:37 smithi162 ceph-mon[35726]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:39.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:39 smithi139 ceph-mon[35039]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:39.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T07:17:39.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:40.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:39 smithi098 ceph-mon[30950]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:40.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T07:17:40.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:40.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:39 smithi162 ceph-mon[35726]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:40.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T07:17:40.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:40.963 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:40 smithi139 ceph-mon[35039]: Deploying daemon osd.7 on smithi139 2024-09-19T07:17:41.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:40 smithi098 ceph-mon[30950]: Deploying daemon osd.7 on smithi139 2024-09-19T07:17:41.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:40 smithi162 ceph-mon[35726]: Deploying daemon osd.7 on smithi139 2024-09-19T07:17:41.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:41 smithi139 ceph-mon[35039]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:42.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:41 smithi098 ceph-mon[30950]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:42.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:41 smithi162 ceph-mon[35726]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:43 smithi098 ceph-mon[30950]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:44.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:43 smithi139 ceph-mon[35039]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:43 smithi162 ceph-mon[35726]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:45 smithi098 ceph-mon[30950]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:45 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:45 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:45 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:46.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:45 smithi139 ceph-mon[35039]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:46.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:45 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:45 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:45 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:45 smithi162 ceph-mon[35726]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:45 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:45 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:45 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:47.044 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:46 smithi162 ceph-mon[35726]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:47.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:46 smithi139 ceph-mon[35039]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:47.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:46 smithi098 ceph-mon[30950]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:49.193 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.193+0000 7fed18823640 1 -- 172.21.15.139:0/3727295224 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fed14062630 con 0x7fecfc0a3270 2024-09-19T07:17:49.194 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 7 on host 'smithi139' 2024-09-19T07:17:49.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.195+0000 7fed19825640 1 -- 172.21.15.139:0/3727295224 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fecfc0a3270 msgr2=0x7fecfc0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:49.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.195+0000 7fed19825640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fecfc0a3270 0x7fecfc0a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed141982d0 tx=0x7fed0400b410 comp rx=0 tx=0).stop 2024-09-19T07:17:49.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.195+0000 7fed19825640 1 -- 172.21.15.139:0/3727295224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed14100ad0 msgr2=0x7fed14196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:49.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.195+0000 7fed19825640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed14100ad0 0x7fed14196db0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fed08031610 tx=0x7fed080043b0 comp rx=0 tx=0).stop 2024-09-19T07:17:49.196 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.195+0000 7fed19825640 1 -- 172.21.15.139:0/3727295224 shutdown_connections 2024-09-19T07:17:49.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.195+0000 7fed19825640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fecfc0a3270 0x7fecfc0a5730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:49.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.195+0000 7fed19825640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fed14102690 0x7fed1419e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:49.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.195+0000 7fed19825640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed14101cd0 0x7fed141972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:49.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.195+0000 7fed19825640 1 --2- 172.21.15.139:0/3727295224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed14100ad0 0x7fed14196db0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:49.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.195+0000 7fed19825640 1 -- 172.21.15.139:0/3727295224 >> 172.21.15.139:0/3727295224 conn(0x7fed140fc280 msgr2=0x7fed14105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:49.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.196+0000 7fed19825640 1 -- 172.21.15.139:0/3727295224 shutdown_connections 2024-09-19T07:17:49.197 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:17:49.196+0000 7fed19825640 1 -- 172.21.15.139:0/3727295224 wait complete. 2024-09-19T07:17:49.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:49.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:49.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:49 smithi098 ceph-mon[30950]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:49.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:49.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.550 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.550 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.550 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:49.550 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:49.551 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.551 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:49 smithi139 ceph-mon[35039]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:49.551 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:49.551 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.551 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:49.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:49.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:49 smithi162 ceph-mon[35726]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:49.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:17:49.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:49.902 DEBUG:teuthology.orchestra.run.smithi139:osd.7> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T07:17:49.904 INFO:tasks.cephadm:Deploying osd.8 on smithi162 with /dev/vg_nvme/lv_2... 2024-09-19T07:17:49.905 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T07:17:50.161 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:17:51.567 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:17:51 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:17:51.461+0000 7f71cdb9b640 -1 osd.7 0 log_to_monitors true 2024-09-19T07:17:51.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:51 smithi162 ceph-mon[35726]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:51.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:51 smithi162 ceph-mon[35726]: from='osd.7 [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:17:51.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:51 smithi162 ceph-mon[35726]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:17:52.007 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:51 smithi139 ceph-mon[35039]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:52.007 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:51 smithi139 ceph-mon[35039]: from='osd.7 [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:17:52.007 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:51 smithi139 ceph-mon[35039]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:17:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:51 smithi098 ceph-mon[30950]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:51 smithi098 ceph-mon[30950]: from='osd.7 [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:17:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:51 smithi098 ceph-mon[30950]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T07:17:52.663 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:17:52.692 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_2 2024-09-19T07:17:52.945 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:17:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:52 smithi098 ceph-mon[30950]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T07:17:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:52 smithi098 ceph-mon[30950]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T07:17:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:52 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:52 smithi098 ceph-mon[30950]: from='osd.7 [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:17:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:52 smithi098 ceph-mon[30950]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:17:53.065 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:52 smithi162 ceph-mon[35726]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T07:17:53.066 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:52 smithi162 ceph-mon[35726]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T07:17:53.066 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:52 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:53.066 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:52 smithi162 ceph-mon[35726]: from='osd.7 [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:17:53.066 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:52 smithi162 ceph-mon[35726]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:17:53.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:52 smithi139 ceph-mon[35039]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T07:17:53.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:52 smithi139 ceph-mon[35039]: osdmap e44: 8 total, 7 up, 8 in 2024-09-19T07:17:53.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:52 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:52 smithi139 ceph-mon[35039]: from='osd.7 [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:17:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:52 smithi139 ceph-mon[35039]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:17:53.067 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:17:52 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:17:52.694+0000 7f71c92fb640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T07:17:53.067 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:17:52 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:17:52.707+0000 7f71c5935640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:17:53.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.343+0000 7f513a2aa640 1 -- 172.21.15.162:0/121877721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5134102e00 msgr2=0x7f5134103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:53.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.343+0000 7f513a2aa640 1 --2- 172.21.15.162:0/121877721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5134102e00 0x7f5134103280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5128009900 tx=0x7f512802a410 comp rx=0 tx=0).stop 2024-09-19T07:17:53.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.343+0000 7f513a2aa640 1 -- 172.21.15.162:0/121877721 shutdown_connections 2024-09-19T07:17:53.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.343+0000 7f513a2aa640 1 --2- 172.21.15.162:0/121877721 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f51341037c0 0x7f513410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:53.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.343+0000 7f513a2aa640 1 --2- 172.21.15.162:0/121877721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5134102e00 0x7f5134103280 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.343+0000 7f513a2aa640 1 --2- 172.21.15.162:0/121877721 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5134101c00 0x7f5134102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.343+0000 7f513a2aa640 1 -- 172.21.15.162:0/121877721 >> 172.21.15.162:0/121877721 conn(0x7f51340fd390 msgr2=0x7f51340ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:17:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.343+0000 7f513a2aa640 1 -- 172.21.15.162:0/121877721 shutdown_connections 2024-09-19T07:17:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.344+0000 7f513a2aa640 1 -- 172.21.15.162:0/121877721 wait complete. 2024-09-19T07:17:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.344+0000 7f513a2aa640 1 Processor -- start 2024-09-19T07:17:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.344+0000 7f513a2aa640 1 -- start start 2024-09-19T07:17:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f513a2aa640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5134101c00 0x7f5134195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f513a2aa640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5134102e00 0x7f513419b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f513a2aa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51341037c0 0x7f51341962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f513a2aa640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f513410d860 con 0x7f5134101c00 2024-09-19T07:17:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f513a2aa640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f513410d6e0 con 0x7f5134102e00 2024-09-19T07:17:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f513a2aa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f513410d9e0 con 0x7f51341037c0 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f5138847640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51341037c0 0x7f51341962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f5133fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5134101c00 0x7f5134195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f5138847640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51341037c0 0x7f51341962b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:56560/0 (socket says 172.21.15.162:56560) 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f5138847640 1 -- 172.21.15.162:0/4056588131 learned_addr learned my addr 172.21.15.162:0/4056588131 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f51337fe640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5134102e00 0x7f513419b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f5138847640 1 -- 172.21.15.162:0/4056588131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5134102e00 msgr2=0x7f513419b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f5138847640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5134102e00 0x7f513419b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f5138847640 1 -- 172.21.15.162:0/4056588131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5134101c00 msgr2=0x7f5134195c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f5138847640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5134101c00 0x7f5134195c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f5138847640 1 -- 172.21.15.162:0/4056588131 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51341ae8a0 con 0x7f51341037c0 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.345+0000 7f5138847640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51341037c0 0x7f51341962b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f512c00eb10 tx=0x7f512c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.346+0000 7f51317fa640 1 -- 172.21.15.162:0/4056588131 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c004b20 con 0x7f51341037c0 2024-09-19T07:17:53.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.346+0000 7f513a2aa640 1 -- 172.21.15.162:0/4056588131 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51341aeb90 con 0x7f51341037c0 2024-09-19T07:17:53.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.346+0000 7f51317fa640 1 -- 172.21.15.162:0/4056588131 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f512c004cc0 con 0x7f51341037c0 2024-09-19T07:17:53.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.346+0000 7f51317fa640 1 -- 172.21.15.162:0/4056588131 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c010760 con 0x7f51341037c0 2024-09-19T07:17:53.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.346+0000 7f513a2aa640 1 -- 172.21.15.162:0/4056588131 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51341af0a0 con 0x7f51341037c0 2024-09-19T07:17:53.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.347+0000 7f513a2aa640 1 -- 172.21.15.162:0/4056588131 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51341af270 con 0x7f51341037c0 2024-09-19T07:17:53.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.348+0000 7f51317fa640 1 -- 172.21.15.162:0/4056588131 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f512c010900 con 0x7f51341037c0 2024-09-19T07:17:53.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.349+0000 7f51317fa640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f511c0a3270 0x7f511c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:17:53.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.349+0000 7f51317fa640 1 -- 172.21.15.162:0/4056588131 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5117+0+0 (secure 0 0 0) 0x7f512c0cf480 con 0x7f51341037c0 2024-09-19T07:17:53.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.349+0000 7f5133fff640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f511c0a3270 0x7f511c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:17:53.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.350+0000 7f5133fff640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f511c0a3270 0x7f511c0a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5134102c60 tx=0x7f5124005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:17:53.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.352+0000 7f51317fa640 1 -- 172.21.15.162:0/4056588131 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f512c054210 con 0x7f51341037c0 2024-09-19T07:17:53.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:17:53.524+0000 7f513a2aa640 1 -- 172.21.15.162:0/4056588131 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f51341af440 con 0x7f511c0a3270 2024-09-19T07:17:53.954 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:53.954 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-19T07:17:53.954 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T07:17:53.954 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: Detected new or changed devices on smithi139 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi139 to 5696M 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:53.955 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:17:53.956 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:17:53.956 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-19T07:17:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T07:17:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: Detected new or changed devices on smithi139 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi139 to 5696M 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:17:54.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:17:54.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-09-19T07:17:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-19T07:17:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T07:17:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: Detected new or changed devices on smithi139 2024-09-19T07:17:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:17:54.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi139 to 5696M 2024-09-19T07:17:54.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:54.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:54.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:17:54.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:17:54.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:17:54.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:17:54.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:17:54.909 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:54 smithi162 ceph-mon[35726]: purged_snaps scrub starts 2024-09-19T07:17:54.909 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:54 smithi162 ceph-mon[35726]: purged_snaps scrub ok 2024-09-19T07:17:54.909 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:54 smithi162 ceph-mon[35726]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:17:54.910 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:54 smithi162 ceph-mon[35726]: osd.7 [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110] boot 2024-09-19T07:17:54.910 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:54 smithi162 ceph-mon[35726]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T07:17:54.910 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:54 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:55.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:54 smithi098 ceph-mon[30950]: purged_snaps scrub starts 2024-09-19T07:17:55.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:54 smithi098 ceph-mon[30950]: purged_snaps scrub ok 2024-09-19T07:17:55.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:54 smithi098 ceph-mon[30950]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:17:55.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:54 smithi098 ceph-mon[30950]: osd.7 [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110] boot 2024-09-19T07:17:55.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:54 smithi098 ceph-mon[30950]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T07:17:55.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:54 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:55.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:54 smithi139 ceph-mon[35039]: purged_snaps scrub starts 2024-09-19T07:17:55.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:54 smithi139 ceph-mon[35039]: purged_snaps scrub ok 2024-09-19T07:17:55.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:54 smithi139 ceph-mon[35039]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:17:55.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:54 smithi139 ceph-mon[35039]: osd.7 [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110] boot 2024-09-19T07:17:55.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:54 smithi139 ceph-mon[35039]: osdmap e46: 8 total, 8 up, 8 in 2024-09-19T07:17:55.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:54 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:17:55.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:55 smithi162 ceph-mon[35726]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:17:55.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:55 smithi162 ceph-mon[35726]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T07:17:56.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:55 smithi098 ceph-mon[30950]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:17:56.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:55 smithi098 ceph-mon[30950]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T07:17:56.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:55 smithi139 ceph-mon[35039]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:17:56.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:55 smithi139 ceph-mon[35039]: osdmap e47: 8 total, 8 up, 8 in 2024-09-19T07:17:57.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:56 smithi098 ceph-mon[30950]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T07:17:57.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:56 smithi098 ceph-mon[30950]: from='client.? 172.21.15.162:0/3595064439' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca54d58c-9cc0-473c-88da-5e3b15c8cdca"}]: dispatch 2024-09-19T07:17:57.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:56 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca54d58c-9cc0-473c-88da-5e3b15c8cdca"}]: dispatch 2024-09-19T07:17:57.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:56 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca54d58c-9cc0-473c-88da-5e3b15c8cdca"}]': finished 2024-09-19T07:17:57.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:56 smithi098 ceph-mon[30950]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T07:17:57.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:56 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:17:57.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:56 smithi098 ceph-mon[30950]: from='client.? 172.21.15.162:0/951376236' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:17:57.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:56 smithi139 ceph-mon[35039]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T07:17:57.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:56 smithi139 ceph-mon[35039]: from='client.? 172.21.15.162:0/3595064439' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca54d58c-9cc0-473c-88da-5e3b15c8cdca"}]: dispatch 2024-09-19T07:17:57.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:56 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca54d58c-9cc0-473c-88da-5e3b15c8cdca"}]: dispatch 2024-09-19T07:17:57.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:56 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca54d58c-9cc0-473c-88da-5e3b15c8cdca"}]': finished 2024-09-19T07:17:57.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:56 smithi139 ceph-mon[35039]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T07:17:57.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:56 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:17:57.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:56 smithi139 ceph-mon[35039]: from='client.? 172.21.15.162:0/951376236' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:17:57.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:56 smithi162 ceph-mon[35726]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T07:17:57.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:56 smithi162 ceph-mon[35726]: from='client.? 172.21.15.162:0/3595064439' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca54d58c-9cc0-473c-88da-5e3b15c8cdca"}]: dispatch 2024-09-19T07:17:57.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:56 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca54d58c-9cc0-473c-88da-5e3b15c8cdca"}]: dispatch 2024-09-19T07:17:57.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:56 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca54d58c-9cc0-473c-88da-5e3b15c8cdca"}]': finished 2024-09-19T07:17:57.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:56 smithi162 ceph-mon[35726]: osdmap e49: 9 total, 8 up, 9 in 2024-09-19T07:17:57.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:56 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:17:57.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:56 smithi162 ceph-mon[35726]: from='client.? 172.21.15.162:0/951376236' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:17:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:57 smithi098 ceph-mon[30950]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:17:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:57 smithi098 ceph-mon[30950]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T07:17:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:17:58.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:57 smithi139 ceph-mon[35039]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:17:58.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:57 smithi139 ceph-mon[35039]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T07:17:58.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:57 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:17:58.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:57 smithi162 ceph-mon[35726]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:17:58.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:57 smithi162 ceph-mon[35726]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T07:17:58.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:57 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:00.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:17:59 smithi098 ceph-mon[30950]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:00.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:17:59 smithi139 ceph-mon[35039]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:17:59 smithi162 ceph-mon[35726]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:01.849 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:01 smithi162 ceph-mon[35726]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:02.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:01 smithi098 ceph-mon[30950]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:02.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:01 smithi139 ceph-mon[35039]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:03.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:03 smithi162 ceph-mon[35726]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:03 smithi098 ceph-mon[30950]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:04.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:03 smithi139 ceph-mon[35039]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:04.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T07:18:04.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:04 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:05.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T07:18:05.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:04 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:05.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T07:18:05.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:04 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:05.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:05 smithi162 ceph-mon[35726]: Deploying daemon osd.8 on smithi162 2024-09-19T07:18:05.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:05 smithi162 ceph-mon[35726]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:06.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:05 smithi098 ceph-mon[30950]: Deploying daemon osd.8 on smithi162 2024-09-19T07:18:06.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:05 smithi098 ceph-mon[30950]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:06.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:05 smithi139 ceph-mon[35039]: Deploying daemon osd.8 on smithi162 2024-09-19T07:18:06.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:05 smithi139 ceph-mon[35039]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:07.952 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:07 smithi162 ceph-mon[35726]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:07 smithi098 ceph-mon[30950]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:08.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:07 smithi139 ceph-mon[35039]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:09.870 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:09 smithi162 ceph-mon[35726]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:09 smithi098 ceph-mon[30950]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:10.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:09 smithi139 ceph-mon[35039]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:10.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:10 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:10.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:10 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:10.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:10 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:11.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:10 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:11.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:10 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:11.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:10 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:11.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:10 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:11.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:10 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:11.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:10 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:12.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:11 smithi098 ceph-mon[30950]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:12.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:11 smithi139 ceph-mon[35039]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:12.120 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:11 smithi162 ceph-mon[35726]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:13.163 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 8 on host 'smithi162' 2024-09-19T07:18:13.163 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.162+0000 7f51317fa640 1 -- 172.21.15.162:0/4056588131 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f51341af440 con 0x7f511c0a3270 2024-09-19T07:18:13.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.164+0000 7f513a2aa640 1 -- 172.21.15.162:0/4056588131 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f511c0a3270 msgr2=0x7f511c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:13.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.164+0000 7f513a2aa640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f511c0a3270 0x7f511c0a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5134102c60 tx=0x7f5124005f90 comp rx=0 tx=0).stop 2024-09-19T07:18:13.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.164+0000 7f513a2aa640 1 -- 172.21.15.162:0/4056588131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51341037c0 msgr2=0x7f51341962b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:13.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.164+0000 7f513a2aa640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51341037c0 0x7f51341962b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f512c00eb10 tx=0x7f512c00c2d0 comp rx=0 tx=0).stop 2024-09-19T07:18:13.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.164+0000 7f513a2aa640 1 -- 172.21.15.162:0/4056588131 shutdown_connections 2024-09-19T07:18:13.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.164+0000 7f513a2aa640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f511c0a3270 0x7f511c0a5730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:13.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.164+0000 7f513a2aa640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51341037c0 0x7f51341962b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:13.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.164+0000 7f513a2aa640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5134102e00 0x7f513419b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:13.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.164+0000 7f513a2aa640 1 --2- 172.21.15.162:0/4056588131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5134101c00 0x7f5134195c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:13.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.164+0000 7f513a2aa640 1 -- 172.21.15.162:0/4056588131 >> 172.21.15.162:0/4056588131 conn(0x7f51340fd390 msgr2=0x7f5134074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:13.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.165+0000 7f513a2aa640 1 -- 172.21.15.162:0/4056588131 shutdown_connections 2024-09-19T07:18:13.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:18:13.165+0000 7f513a2aa640 1 -- 172.21.15.162:0/4056588131 wait complete. 2024-09-19T07:18:13.703 DEBUG:teuthology.orchestra.run.smithi162:osd.8> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T07:18:13.706 INFO:tasks.cephadm:Deploying osd.9 on smithi098 with /dev/vg_nvme/lv_1... 2024-09-19T07:18:13.706 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T07:18:13.969 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:18:14.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:13 smithi098 ceph-mon[30950]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:14.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:14.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:13 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:14.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:13 smithi139 ceph-mon[35039]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:14.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:13 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:14.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:13 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:13 smithi162 ceph-mon[35726]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:13 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:15.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:15.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:15.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:14 smithi139 ceph-mon[35039]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:15.077 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:15.077 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:15.078 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:14 smithi098 ceph-mon[30950]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:14 smithi162 ceph-mon[35726]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:16.677 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:18:16.708 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi098:vg_nvme/lv_1 2024-09-19T07:18:16.764 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:16 smithi162 ceph-mon[35726]: from='osd.8 [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:18:16.764 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:16 smithi162 ceph-mon[35726]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:18:16.765 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:18:16 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:18:16.451+0000 7fc4db45f640 -1 osd.8 0 log_to_monitors true 2024-09-19T07:18:16.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:16 smithi098 ceph-mon[30950]: from='osd.8 [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:18:16.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:16 smithi098 ceph-mon[30950]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:18:16.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:16 smithi139 ceph-mon[35039]: from='osd.8 [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:18:16.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:16 smithi139 ceph-mon[35039]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T07:18:16.979 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:18:17.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.475+0000 7f60b099e640 1 -- 172.21.15.98:0/2877609392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60ac100b10 msgr2=0x7f60ac100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:17.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.475+0000 7f60b099e640 1 --2- 172.21.15.98:0/2877609392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60ac100b10 0x7f60ac100f10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f609c009900 tx=0x7f609c02a410 comp rx=0 tx=0).stop 2024-09-19T07:18:17.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.476+0000 7f60b099e640 1 -- 172.21.15.98:0/2877609392 shutdown_connections 2024-09-19T07:18:17.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.476+0000 7f60b099e640 1 --2- 172.21.15.98:0/2877609392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60ac1026d0 0x7f60ac108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:17.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.476+0000 7f60b099e640 1 --2- 172.21.15.98:0/2877609392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60ac101d10 0x7f60ac102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:17.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.476+0000 7f60b099e640 1 --2- 172.21.15.98:0/2877609392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60ac100b10 0x7f60ac100f10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:17.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.476+0000 7f60b099e640 1 -- 172.21.15.98:0/2877609392 >> 172.21.15.98:0/2877609392 conn(0x7f60ac0fc2a0 msgr2=0x7f60ac0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:17.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.476+0000 7f60b099e640 1 -- 172.21.15.98:0/2877609392 shutdown_connections 2024-09-19T07:18:17.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.476+0000 7f60b099e640 1 -- 172.21.15.98:0/2877609392 wait complete. 2024-09-19T07:18:17.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.476+0000 7f60b099e640 1 Processor -- start 2024-09-19T07:18:17.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60b099e640 1 -- start start 2024-09-19T07:18:17.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60b099e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60ac100b10 0x7f60ac196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:17.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60b099e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60ac101d10 0x7f60ac197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:17.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60b099e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60ac1026d0 0x7f60ac19e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60b099e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac10c790 con 0x7f60ac100b10 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60b099e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac10c610 con 0x7f60ac101d10 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60b099e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac10c910 con 0x7f60ac1026d0 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60aa59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60ac100b10 0x7f60ac196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60aa59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60ac100b10 0x7f60ac196e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40102/0 (socket says 172.21.15.98:40102) 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60aa59c640 1 -- 172.21.15.98:0/3230623761 learned_addr learned my addr 172.21.15.98:0/3230623761 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60aad9d640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60ac1026d0 0x7f60ac19e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60a1d9b640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60ac101d10 0x7f60ac197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60aa59c640 1 -- 172.21.15.98:0/3230623761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60ac1026d0 msgr2=0x7f60ac19e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60aa59c640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60ac1026d0 0x7f60ac19e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60aa59c640 1 -- 172.21.15.98:0/3230623761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60ac101d10 msgr2=0x7f60ac197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60aa59c640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60ac101d10 0x7f60ac197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:17.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60aa59c640 1 -- 172.21.15.98:0/3230623761 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac19ea80 con 0x7f60ac100b10 2024-09-19T07:18:17.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.477+0000 7f60aa59c640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60ac100b10 0x7f60ac196e50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f609c031610 tx=0x7f609c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:17.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.478+0000 7f60a3fff640 1 -- 172.21.15.98:0/3230623761 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c046070 con 0x7f60ac100b10 2024-09-19T07:18:17.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.478+0000 7f60b099e640 1 -- 172.21.15.98:0/3230623761 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ac06a790 con 0x7f60ac100b10 2024-09-19T07:18:17.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.478+0000 7f60a3fff640 1 -- 172.21.15.98:0/3230623761 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f609c003ce0 con 0x7f60ac100b10 2024-09-19T07:18:17.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.478+0000 7f60a3fff640 1 -- 172.21.15.98:0/3230623761 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c035050 con 0x7f60ac100b10 2024-09-19T07:18:17.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.478+0000 7f60b099e640 1 -- 172.21.15.98:0/3230623761 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ac06ac70 con 0x7f60ac100b10 2024-09-19T07:18:17.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.479+0000 7f60b099e640 1 -- 172.21.15.98:0/3230623761 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60ac06b690 con 0x7f60ac100b10 2024-09-19T07:18:17.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.480+0000 7f60a3fff640 1 -- 172.21.15.98:0/3230623761 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f609c049070 con 0x7f60ac100b10 2024-09-19T07:18:17.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.480+0000 7f60a3fff640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f60980a3270 0x7f60980a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:17.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.481+0000 7f60a1d9b640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f60980a3270 0x7f60980a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:17.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.481+0000 7f60a3fff640 1 -- 172.21.15.98:0/3230623761 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5533+0+0 (secure 0 0 0) 0x7f609c0f0c60 con 0x7f60ac100b10 2024-09-19T07:18:17.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.481+0000 7f60a1d9b640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f60980a3270 0x7f60980a5730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6094005fd0 tx=0x7f6094005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:17.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.484+0000 7f60a3fff640 1 -- 172.21.15.98:0/3230623761 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f609c07e210 con 0x7f60ac100b10 2024-09-19T07:18:17.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:17.663+0000 7f60b099e640 1 -- 172.21.15.98:0/3230623761 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f60ac06aed0 con 0x7f60980a3270 2024-09-19T07:18:17.664 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T07:18:17.664 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T07:18:17.664 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:17.664 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='osd.8 [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:18:17.664 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:18:17.664 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:17.664 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.664 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:17.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:17.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:17.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:17.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:17.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:17.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:17.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:17.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:17 smithi098 ceph-mon[30950]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T07:18:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T07:18:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T07:18:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='osd.8 [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:18:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:18:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:17.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:17.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:17.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:17.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:17.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:17.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:17.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:17 smithi139 ceph-mon[35039]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T07:18:17.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:18:17.515+0000 7fc4d6bbf640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T07:18:17.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:18:17.527+0000 7fc4d31f9640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:18:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T07:18:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T07:18:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='osd.8 [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:18:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:17.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:17.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:17 smithi162 ceph-mon[35726]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T07:18:18.676 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:18 smithi098 ceph-mon[30950]: Detected new or changed devices on smithi162 2024-09-19T07:18:18.676 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:18 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-19T07:18:18.676 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:18 smithi098 ceph-mon[30950]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T07:18:18.676 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:18 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:18.676 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:18 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:18.677 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:18 smithi098 ceph-mon[30950]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:18:18.677 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:18 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:18:18.677 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:18 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:18:18.677 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:18 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:18.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:18 smithi139 ceph-mon[35039]: Detected new or changed devices on smithi162 2024-09-19T07:18:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:18 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-19T07:18:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:18 smithi139 ceph-mon[35039]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T07:18:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:18 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:18 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:18 smithi139 ceph-mon[35039]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:18:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:18 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:18:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:18 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:18:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:18 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:18 smithi162 ceph-mon[35726]: Detected new or changed devices on smithi162 2024-09-19T07:18:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:18 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi162 to 5696M 2024-09-19T07:18:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:18 smithi162 ceph-mon[35726]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T07:18:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:18 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:18 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:18 smithi162 ceph-mon[35726]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:18:18.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:18 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:18:18.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:18 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:18:18.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:18 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:19.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:19 smithi162 ceph-mon[35726]: purged_snaps scrub starts 2024-09-19T07:18:19.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:19 smithi162 ceph-mon[35726]: purged_snaps scrub ok 2024-09-19T07:18:19.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:19 smithi162 ceph-mon[35726]: osd.8 [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188] boot 2024-09-19T07:18:19.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:19 smithi162 ceph-mon[35726]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T07:18:19.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:19 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:19.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:19 smithi162 ceph-mon[35726]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:19.716 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:19 smithi098 ceph-mon[30950]: purged_snaps scrub starts 2024-09-19T07:18:19.716 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:19 smithi098 ceph-mon[30950]: purged_snaps scrub ok 2024-09-19T07:18:19.716 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:19 smithi098 ceph-mon[30950]: osd.8 [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188] boot 2024-09-19T07:18:19.716 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:19 smithi098 ceph-mon[30950]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T07:18:19.716 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:19 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:19.716 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:19 smithi098 ceph-mon[30950]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:19.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:19 smithi139 ceph-mon[35039]: purged_snaps scrub starts 2024-09-19T07:18:19.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:19 smithi139 ceph-mon[35039]: purged_snaps scrub ok 2024-09-19T07:18:19.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:19 smithi139 ceph-mon[35039]: osd.8 [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188] boot 2024-09-19T07:18:19.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:19 smithi139 ceph-mon[35039]: osdmap e53: 9 total, 9 up, 9 in 2024-09-19T07:18:19.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:19 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:18:19.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:19 smithi139 ceph-mon[35039]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-09-19T07:18:20.622 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:20 smithi098 ceph-mon[30950]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T07:18:20.623 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:20 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2571229752' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899"}]: dispatch 2024-09-19T07:18:20.623 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:20 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2571229752' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899"}]': finished 2024-09-19T07:18:20.623 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:20 smithi098 ceph-mon[30950]: osdmap e55: 10 total, 9 up, 10 in 2024-09-19T07:18:20.623 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:20 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:20.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:20 smithi139 ceph-mon[35039]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T07:18:20.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:20 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2571229752' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899"}]: dispatch 2024-09-19T07:18:20.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:20 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2571229752' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899"}]': finished 2024-09-19T07:18:20.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:20 smithi139 ceph-mon[35039]: osdmap e55: 10 total, 9 up, 10 in 2024-09-19T07:18:20.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:20 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:20.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:20 smithi162 ceph-mon[35726]: osdmap e54: 9 total, 9 up, 9 in 2024-09-19T07:18:20.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:20 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2571229752' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899"}]: dispatch 2024-09-19T07:18:20.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:20 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2571229752' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899"}]': finished 2024-09-19T07:18:20.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:20 smithi162 ceph-mon[35726]: osdmap e55: 10 total, 9 up, 10 in 2024-09-19T07:18:20.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:20 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:21 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/272563648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:18:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:21 smithi098 ceph-mon[30950]: pgmap v187: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:21 smithi098 ceph-mon[30950]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T07:18:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:21 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:21.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:21 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/272563648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:18:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:21 smithi139 ceph-mon[35039]: pgmap v187: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:21 smithi139 ceph-mon[35039]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T07:18:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:21 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:21 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/272563648' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:18:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:21 smithi162 ceph-mon[35726]: pgmap v187: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:21 smithi162 ceph-mon[35726]: osdmap e56: 10 total, 9 up, 10 in 2024-09-19T07:18:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:21 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:23.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:23 smithi162 ceph-mon[35726]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T07:18:23.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:23.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:23 smithi162 ceph-mon[35726]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:23.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:23 smithi098 ceph-mon[30950]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T07:18:23.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:23.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:23 smithi098 ceph-mon[30950]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:23.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:23 smithi139 ceph-mon[35039]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T07:18:23.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:23.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:23 smithi139 ceph-mon[35039]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:25.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:25 smithi098 ceph-mon[30950]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-19T07:18:26.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:25 smithi139 ceph-mon[35039]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-19T07:18:26.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:25 smithi162 ceph-mon[35726]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-09-19T07:18:28.007 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:27 smithi098 ceph-mon[30950]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T07:18:28.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:27 smithi139 ceph-mon[35039]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T07:18:28.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:27 smithi162 ceph-mon[35726]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-19T07:18:29.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:29 smithi098 ceph-mon[30950]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:18:29.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:29 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T07:18:29.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:29 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:29.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:29 smithi139 ceph-mon[35039]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:18:29.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:29 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T07:18:29.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:29 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:29.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:29 smithi162 ceph-mon[35726]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:18:29.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:29 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T07:18:29.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:29 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:30.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:30 smithi098 ceph-mon[30950]: Deploying daemon osd.9 on smithi098 2024-09-19T07:18:31.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:30 smithi139 ceph-mon[35039]: Deploying daemon osd.9 on smithi098 2024-09-19T07:18:31.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:30 smithi162 ceph-mon[35726]: Deploying daemon osd.9 on smithi098 2024-09-19T07:18:31.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:31 smithi098 ceph-mon[30950]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T07:18:32.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:31 smithi139 ceph-mon[35039]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T07:18:32.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:31 smithi162 ceph-mon[35726]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T07:18:33.759 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:33 smithi098 ceph-mon[30950]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T07:18:34.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:33 smithi139 ceph-mon[35039]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T07:18:34.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:33 smithi162 ceph-mon[35726]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T07:18:36.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:35 smithi098 ceph-mon[30950]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:18:36.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:36.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:36.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:35 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:36.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:35 smithi139 ceph-mon[35039]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:18:36.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:36.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:36.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:35 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:36.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:35 smithi162 ceph-mon[35726]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:18:36.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:36.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:36.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:35 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:38.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:37 smithi098 ceph-mon[30950]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:38.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:37 smithi139 ceph-mon[35039]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:38.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:37 smithi162 ceph-mon[35726]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:38.233 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 9 on host 'smithi098' 2024-09-19T07:18:38.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.232+0000 7f60a3fff640 1 -- 172.21.15.98:0/3230623761 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f60ac06aed0 con 0x7f60980a3270 2024-09-19T07:18:38.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.235+0000 7f60b099e640 1 -- 172.21.15.98:0/3230623761 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f60980a3270 msgr2=0x7f60980a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:38.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.235+0000 7f60b099e640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f60980a3270 0x7f60980a5730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6094005fd0 tx=0x7f6094005850 comp rx=0 tx=0).stop 2024-09-19T07:18:38.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.235+0000 7f60b099e640 1 -- 172.21.15.98:0/3230623761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60ac100b10 msgr2=0x7f60ac196e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:38.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.235+0000 7f60b099e640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60ac100b10 0x7f60ac196e50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f609c031610 tx=0x7f609c0043b0 comp rx=0 tx=0).stop 2024-09-19T07:18:38.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.235+0000 7f60b099e640 1 -- 172.21.15.98:0/3230623761 shutdown_connections 2024-09-19T07:18:38.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.235+0000 7f60b099e640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f60980a3270 0x7f60980a5730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:38.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.235+0000 7f60b099e640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60ac1026d0 0x7f60ac19e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:38.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.235+0000 7f60b099e640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60ac101d10 0x7f60ac197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:38.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.235+0000 7f60b099e640 1 --2- 172.21.15.98:0/3230623761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60ac100b10 0x7f60ac196e50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:38.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.235+0000 7f60b099e640 1 -- 172.21.15.98:0/3230623761 >> 172.21.15.98:0/3230623761 conn(0x7f60ac0fc2a0 msgr2=0x7f60ac1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:38.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.235+0000 7f60b099e640 1 -- 172.21.15.98:0/3230623761 shutdown_connections 2024-09-19T07:18:38.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:18:38.235+0000 7f60b099e640 1 -- 172.21.15.98:0/3230623761 wait complete. 2024-09-19T07:18:38.858 DEBUG:teuthology.orchestra.run.smithi098:osd.9> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T07:18:38.860 INFO:tasks.cephadm:Deploying osd.10 on smithi139 with /dev/vg_nvme/lv_1... 2024-09-19T07:18:38.861 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T07:18:39.117 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:18:39.482 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:39.482 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:39.482 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:39 smithi139 ceph-mon[35039]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:39.482 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:39.482 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:39.484 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:39.484 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:39.484 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:39 smithi098 ceph-mon[30950]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:39.484 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:39.484 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:39.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:39.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:39.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:39 smithi162 ceph-mon[35726]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:39.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:39.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:41.273 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:18:41 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:18:41.176+0000 7febf6848640 -1 osd.9 0 log_to_monitors true 2024-09-19T07:18:41.532 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-09-19T07:18:41.560 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_1 2024-09-19T07:18:41.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:41 smithi098 ceph-mon[30950]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:41.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:41 smithi098 ceph-mon[30950]: from='osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T07:18:41.812 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:18:41.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:41 smithi139 ceph-mon[35039]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:41.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:41 smithi139 ceph-mon[35039]: from='osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T07:18:42.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:41 smithi162 ceph-mon[35726]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:42.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:41 smithi162 ceph-mon[35726]: from='osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T07:18:42.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.258+0000 7f6a50377640 1 -- 172.21.15.139:0/2448232862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a48102df0 msgr2=0x7f6a48103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:42.261 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.258+0000 7f6a50377640 1 --2- 172.21.15.139:0/2448232862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a48102df0 0x7f6a48103270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009900 tx=0x7f6a3802a410 comp rx=0 tx=0).stop 2024-09-19T07:18:42.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.259+0000 7f6a50377640 1 -- 172.21.15.139:0/2448232862 shutdown_connections 2024-09-19T07:18:42.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.259+0000 7f6a50377640 1 --2- 172.21.15.139:0/2448232862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a481037b0 0x7f6a4810a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.259+0000 7f6a50377640 1 --2- 172.21.15.139:0/2448232862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a48102df0 0x7f6a48103270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.259+0000 7f6a50377640 1 --2- 172.21.15.139:0/2448232862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a48101bf0 0x7f6a48101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.259+0000 7f6a50377640 1 -- 172.21.15.139:0/2448232862 >> 172.21.15.139:0/2448232862 conn(0x7f6a480fd3c0 msgr2=0x7f6a480ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:18:42.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.259+0000 7f6a50377640 1 -- 172.21.15.139:0/2448232862 shutdown_connections 2024-09-19T07:18:42.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.259+0000 7f6a50377640 1 -- 172.21.15.139:0/2448232862 wait complete. 2024-09-19T07:18:42.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.259+0000 7f6a50377640 1 Processor -- start 2024-09-19T07:18:42.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.259+0000 7f6a50377640 1 -- start start 2024-09-19T07:18:42.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a50377640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a48101bf0 0x7f6a48197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a50377640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a48102df0 0x7f6a481983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a50377640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a481037b0 0x7f6a4819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a50377640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4810d850 con 0x7f6a48101bf0 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a50377640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4810d6d0 con 0x7f6a481037b0 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a50377640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4810d9d0 con 0x7f6a48102df0 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a4e914640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a481037b0 0x7f6a4819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a4e113640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a48101bf0 0x7f6a48197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a4e914640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a481037b0 0x7f6a4819f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:45054/0 (socket says 172.21.15.139:45054) 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a4e113640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a48101bf0 0x7f6a48197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.139:35834/0 (socket says 172.21.15.139:35834) 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a4e914640 1 -- 172.21.15.139:0/2503747946 learned_addr learned my addr 172.21.15.139:0/2503747946 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a4d912640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a48102df0 0x7f6a481983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a4e914640 1 -- 172.21.15.139:0/2503747946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a48102df0 msgr2=0x7f6a481983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a4e914640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a48102df0 0x7f6a481983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a4e914640 1 -- 172.21.15.139:0/2503747946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a48101bf0 msgr2=0x7f6a48197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:18:42.263 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a4e914640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a48101bf0 0x7f6a48197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:18:42.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a4e914640 1 -- 172.21.15.139:0/2503747946 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4819fad0 con 0x7f6a481037b0 2024-09-19T07:18:42.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a4e914640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a481037b0 0x7f6a4819f460 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000eb10 tx=0x7f6a4000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:42.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a3f7fe640 1 -- 172.21.15.139:0/2503747946 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40004b20 con 0x7f6a481037b0 2024-09-19T07:18:42.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a3f7fe640 1 -- 172.21.15.139:0/2503747946 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a40004cc0 con 0x7f6a481037b0 2024-09-19T07:18:42.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.260+0000 7f6a50377640 1 -- 172.21.15.139:0/2503747946 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4819fdc0 con 0x7f6a481037b0 2024-09-19T07:18:42.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.261+0000 7f6a3f7fe640 1 -- 172.21.15.139:0/2503747946 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40010760 con 0x7f6a481037b0 2024-09-19T07:18:42.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.261+0000 7f6a50377640 1 -- 172.21.15.139:0/2503747946 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a481a0220 con 0x7f6a481037b0 2024-09-19T07:18:42.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.262+0000 7f6a50377640 1 -- 172.21.15.139:0/2503747946 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a48108fc0 con 0x7f6a481037b0 2024-09-19T07:18:42.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.263+0000 7f6a3f7fe640 1 -- 172.21.15.139:0/2503747946 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6a40004fe0 con 0x7f6a481037b0 2024-09-19T07:18:42.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.264+0000 7f6a3f7fe640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f6a340a3270 0x7f6a340a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:18:42.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.264+0000 7f6a4e113640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f6a340a3270 0x7f6a340a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:18:42.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.264+0000 7f6a3f7fe640 1 -- 172.21.15.139:0/2503747946 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5965+0+0 (secure 0 0 0) 0x7f6a400cf4c0 con 0x7f6a481037b0 2024-09-19T07:18:42.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.264+0000 7f6a4e113640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f6a340a3270 0x7f6a340a5730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6a44005fd0 tx=0x7f6a4400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:18:42.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.268+0000 7f6a3f7fe640 1 -- 172.21.15.139:0/2503747946 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a4009cb10 con 0x7f6a481037b0 2024-09-19T07:18:42.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:18:42.451+0000 7f6a50377640 1 -- 172.21.15.139:0/2503747946 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6a48062630 con 0x7f6a340a3270 2024-09-19T07:18:42.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T07:18:42.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T07:18:42.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-19T07:18:42.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:42.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:42.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:42.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:42.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:42.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:42.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:42.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:42.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:42.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:42.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:42.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:42.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:42.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:42.819 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:42.819 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:18:42.819 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:18:42.819 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:42.819 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-19T07:18:42.819 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T07:18:42.819 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:42 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:43.023 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:18:42.689+0000 7febf1fa8640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T07:18:43.023 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:18:42.700+0000 7febee5e2640 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:18:43.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T07:18:43.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T07:18:43.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-19T07:18:43.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:43.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:43.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:43.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:43.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:43.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:43.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:43.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:43.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:43.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:43.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:43.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:43.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:43.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:43.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:43.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:18:43.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:18:43.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:43.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-19T07:18:43.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T07:18:43.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:42 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:43.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T07:18:43.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T07:18:43.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]: dispatch 2024-09-19T07:18:43.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:43.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:43.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:43.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:43.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:43.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:43.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:18:43.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:43.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:43.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:43.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:43.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:43.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:43.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:18:43.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:43.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:18:43.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:18:43.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:43.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-19T07:18:43.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T07:18:43.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:42 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:44.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:43 smithi139 ceph-mon[35039]: Detected new or changed devices on smithi098 2024-09-19T07:18:44.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:43 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-19T07:18:44.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:43 smithi139 ceph-mon[35039]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:18:44.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:43 smithi139 ceph-mon[35039]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:44.005 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:44.006 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:43 smithi098 ceph-mon[30950]: Detected new or changed devices on smithi098 2024-09-19T07:18:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:43 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-19T07:18:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:43 smithi098 ceph-mon[30950]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:18:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:43 smithi098 ceph-mon[30950]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:44.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:43 smithi162 ceph-mon[35726]: Detected new or changed devices on smithi098 2024-09-19T07:18:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:43 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-19T07:18:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:43 smithi162 ceph-mon[35726]: from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:18:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:43 smithi162 ceph-mon[35726]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:45.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:44 smithi098 ceph-mon[30950]: purged_snaps scrub starts 2024-09-19T07:18:45.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:44 smithi098 ceph-mon[30950]: purged_snaps scrub ok 2024-09-19T07:18:45.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:44 smithi098 ceph-mon[30950]: osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006] boot 2024-09-19T07:18:45.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:44 smithi098 ceph-mon[30950]: osdmap e60: 10 total, 10 up, 10 in 2024-09-19T07:18:45.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:44 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:45.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:44 smithi139 ceph-mon[35039]: purged_snaps scrub starts 2024-09-19T07:18:45.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:44 smithi139 ceph-mon[35039]: purged_snaps scrub ok 2024-09-19T07:18:45.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:44 smithi139 ceph-mon[35039]: osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006] boot 2024-09-19T07:18:45.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:44 smithi139 ceph-mon[35039]: osdmap e60: 10 total, 10 up, 10 in 2024-09-19T07:18:45.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:44 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:45.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:44 smithi162 ceph-mon[35726]: purged_snaps scrub starts 2024-09-19T07:18:45.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:44 smithi162 ceph-mon[35726]: purged_snaps scrub ok 2024-09-19T07:18:45.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:44 smithi162 ceph-mon[35726]: osd.9 [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006] boot 2024-09-19T07:18:45.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:44 smithi162 ceph-mon[35726]: osdmap e60: 10 total, 10 up, 10 in 2024-09-19T07:18:45.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:44 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:18:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:45 smithi098 ceph-mon[30950]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:45 smithi098 ceph-mon[30950]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T07:18:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:45 smithi098 ceph-mon[30950]: from='client.? 172.21.15.139:0/1466390908' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d940771-0407-4f30-95af-079e436759cc"}]: dispatch 2024-09-19T07:18:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:45 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d940771-0407-4f30-95af-079e436759cc"}]: dispatch 2024-09-19T07:18:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:45 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d940771-0407-4f30-95af-079e436759cc"}]': finished 2024-09-19T07:18:46.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:45 smithi098 ceph-mon[30950]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T07:18:46.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:45 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:18:46.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:45 smithi098 ceph-mon[30950]: from='client.? 172.21.15.139:0/1163971291' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:18:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:45 smithi139 ceph-mon[35039]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:45 smithi139 ceph-mon[35039]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T07:18:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:45 smithi139 ceph-mon[35039]: from='client.? 172.21.15.139:0/1466390908' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d940771-0407-4f30-95af-079e436759cc"}]: dispatch 2024-09-19T07:18:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:45 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d940771-0407-4f30-95af-079e436759cc"}]: dispatch 2024-09-19T07:18:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:45 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d940771-0407-4f30-95af-079e436759cc"}]': finished 2024-09-19T07:18:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:45 smithi139 ceph-mon[35039]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T07:18:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:45 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:18:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:45 smithi139 ceph-mon[35039]: from='client.? 172.21.15.139:0/1163971291' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:18:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:45 smithi162 ceph-mon[35726]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 804 GiB / 805 GiB avail 2024-09-19T07:18:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:45 smithi162 ceph-mon[35726]: osdmap e61: 10 total, 10 up, 10 in 2024-09-19T07:18:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:45 smithi162 ceph-mon[35726]: from='client.? 172.21.15.139:0/1466390908' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d940771-0407-4f30-95af-079e436759cc"}]: dispatch 2024-09-19T07:18:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:45 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d940771-0407-4f30-95af-079e436759cc"}]: dispatch 2024-09-19T07:18:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:45 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d940771-0407-4f30-95af-079e436759cc"}]': finished 2024-09-19T07:18:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:45 smithi162 ceph-mon[35726]: osdmap e62: 11 total, 10 up, 11 in 2024-09-19T07:18:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:45 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:18:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:45 smithi162 ceph-mon[35726]: from='client.? 172.21.15.139:0/1163971291' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:18:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:47 smithi098 ceph-mon[30950]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:47 smithi139 ceph-mon[35039]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:47 smithi162 ceph-mon[35726]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:49 smithi098 ceph-mon[30950]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:50.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:49 smithi139 ceph-mon[35039]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:49 smithi162 ceph-mon[35726]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:51.943 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:51 smithi139 ceph-mon[35039]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:51 smithi098 ceph-mon[30950]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:51 smithi162 ceph-mon[35726]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:53.975 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:53 smithi139 ceph-mon[35039]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:53.975 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T07:18:53.975 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:53 smithi098 ceph-mon[30950]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T07:18:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:54.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:53 smithi162 ceph-mon[35726]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:54.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T07:18:54.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:18:55.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:54 smithi098 ceph-mon[30950]: Deploying daemon osd.10 on smithi139 2024-09-19T07:18:55.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:54 smithi139 ceph-mon[35039]: Deploying daemon osd.10 on smithi139 2024-09-19T07:18:55.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:54 smithi162 ceph-mon[35726]: Deploying daemon osd.10 on smithi139 2024-09-19T07:18:56.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:55 smithi098 ceph-mon[30950]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:56.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:55 smithi139 ceph-mon[35039]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:56.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:55 smithi162 ceph-mon[35726]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:57.913 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:57 smithi139 ceph-mon[35039]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:57 smithi098 ceph-mon[30950]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:58.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:57 smithi162 ceph-mon[35726]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:59.987 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:59 smithi139 ceph-mon[35039]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:18:59.987 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:18:59.987 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:18:59.987 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:18:59 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:00.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:59 smithi098 ceph-mon[30950]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:00.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:00.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:00.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:18:59 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:59 smithi162 ceph-mon[35726]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:18:59 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:01.996 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:01 smithi139 ceph-mon[35039]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:02.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:01 smithi098 ceph-mon[30950]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:02.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:01 smithi162 ceph-mon[35726]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:02.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.840+0000 7f6a3f7fe640 1 -- 172.21.15.139:0/2503747946 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6a48062630 con 0x7f6a340a3270 2024-09-19T07:19:02.841 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 10 on host 'smithi139' 2024-09-19T07:19:02.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.841+0000 7f6a50377640 1 -- 172.21.15.139:0/2503747946 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f6a340a3270 msgr2=0x7f6a340a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:02.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.841+0000 7f6a50377640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f6a340a3270 0x7f6a340a5730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6a44005fd0 tx=0x7f6a4400b410 comp rx=0 tx=0).stop 2024-09-19T07:19:02.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.841+0000 7f6a50377640 1 -- 172.21.15.139:0/2503747946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a481037b0 msgr2=0x7f6a4819f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:02.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.841+0000 7f6a50377640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a481037b0 0x7f6a4819f460 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000eb10 tx=0x7f6a4000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.841+0000 7f6a50377640 1 -- 172.21.15.139:0/2503747946 shutdown_connections 2024-09-19T07:19:02.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.841+0000 7f6a50377640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f6a340a3270 0x7f6a340a5730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.841+0000 7f6a50377640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a481037b0 0x7f6a4819f460 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.841+0000 7f6a50377640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a48102df0 0x7f6a481983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.841+0000 7f6a50377640 1 --2- 172.21.15.139:0/2503747946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a48101bf0 0x7f6a48197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:02.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.841+0000 7f6a50377640 1 -- 172.21.15.139:0/2503747946 >> 172.21.15.139:0/2503747946 conn(0x7f6a480fd3c0 msgr2=0x7f6a48106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:02.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.842+0000 7f6a50377640 1 -- 172.21.15.139:0/2503747946 shutdown_connections 2024-09-19T07:19:02.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-09-19T07:19:02.842+0000 7f6a50377640 1 -- 172.21.15.139:0/2503747946 wait complete. 2024-09-19T07:19:03.469 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.469 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.469 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:03.469 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:03.470 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.470 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:03 smithi139 ceph-mon[35039]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:03.470 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:03.470 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.470 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.497 DEBUG:teuthology.orchestra.run.smithi139:osd.10> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T07:19:03.500 INFO:tasks.cephadm:Deploying osd.11 on smithi162 with /dev/vg_nvme/lv_1... 2024-09-19T07:19:03.500 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T07:19:03.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:03.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:03.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:03 smithi098 ceph-mon[30950]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:03.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:03.525 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.526 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.529 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.529 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.529 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:03.529 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:03.529 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.529 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:03 smithi162 ceph-mon[35726]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:03.529 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:03.529 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.529 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:03.757 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:19:06.022 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:05 smithi139 ceph-mon[35039]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:06.023 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:05 smithi139 ceph-mon[35039]: from='osd.10 [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:19:06.023 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:05 smithi139 ceph-mon[35039]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:19:06.023 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:19:05 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:19:05.639+0000 7f2571ae2640 -1 osd.10 0 log_to_monitors true 2024-09-19T07:19:06.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:05 smithi098 ceph-mon[30950]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:06.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:05 smithi098 ceph-mon[30950]: from='osd.10 [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:19:06.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:05 smithi098 ceph-mon[30950]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:19:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:05 smithi162 ceph-mon[35726]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:05 smithi162 ceph-mon[35726]: from='osd.10 [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:19:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:05 smithi162 ceph-mon[35726]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T07:19:06.266 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T07:19:06.295 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_1 2024-09-19T07:19:06.600 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:19:06.831 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T07:19:06.831 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T07:19:06.831 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:19:06.831 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='osd.10 [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:19:06.831 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:19:06.831 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:06.831 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:06.831 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:06.831 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:06.831 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:06.832 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:06.832 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:06.832 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:06.832 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:06.832 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T07:19:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T07:19:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:19:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='osd.10 [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:19:07.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:19:07.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:07.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:07.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:07.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:07.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:07.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:07.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:07.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:07.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:07.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:07.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.051+0000 7f80ab93d640 1 -- 172.21.15.162:0/3611021017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80a4105030 msgr2=0x7f80a4107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:07.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.051+0000 7f80ab93d640 1 --2- 172.21.15.162:0/3611021017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80a4105030 0x7f80a4107420 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8094009900 tx=0x7f809402a410 comp rx=0 tx=0).stop 2024-09-19T07:19:07.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.051+0000 7f80ab93d640 1 -- 172.21.15.162:0/3611021017 shutdown_connections 2024-09-19T07:19:07.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.051+0000 7f80ab93d640 1 --2- 172.21.15.162:0/3611021017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80a4107960 0x7f80a4109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:07.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.051+0000 7f80ab93d640 1 --2- 172.21.15.162:0/3611021017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80a4105030 0x7f80a4107420 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:07.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.051+0000 7f80ab93d640 1 --2- 172.21.15.162:0/3611021017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80a4102700 0x7f80a4104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:07.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.051+0000 7f80ab93d640 1 -- 172.21.15.162:0/3611021017 >> 172.21.15.162:0/3611021017 conn(0x7f80a40fc280 msgr2=0x7f80a40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:07.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.051+0000 7f80ab93d640 1 -- 172.21.15.162:0/3611021017 shutdown_connections 2024-09-19T07:19:07.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.051+0000 7f80ab93d640 1 -- 172.21.15.162:0/3611021017 wait complete. 2024-09-19T07:19:07.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.051+0000 7f80ab93d640 1 Processor -- start 2024-09-19T07:19:07.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.051+0000 7f80ab93d640 1 -- start start 2024-09-19T07:19:07.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80ab93d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80a4102700 0x7f80a4197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:07.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80ab93d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80a4105030 0x7f80a4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:07.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80ab93d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80a4107960 0x7f80a419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:07.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80ab93d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f80a410d850 con 0x7f80a4105030 2024-09-19T07:19:07.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80ab93d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f80a410d6d0 con 0x7f80a4102700 2024-09-19T07:19:07.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80ab93d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80a410d9d0 con 0x7f80a4107960 2024-09-19T07:19:07.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a9eda640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80a4107960 0x7f80a419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:07.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a96d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80a4102700 0x7f80a4197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:07.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a96d9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80a4102700 0x7f80a4197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.162:34016/0 (socket says 172.21.15.162:34016) 2024-09-19T07:19:07.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a9eda640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80a4107960 0x7f80a419f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47456/0 (socket says 172.21.15.162:47456) 2024-09-19T07:19:07.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a96d9640 1 -- 172.21.15.162:0/3680968020 learned_addr learned my addr 172.21.15.162:0/3680968020 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T07:19:07.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a8ed8640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80a4105030 0x7f80a4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:07.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a9eda640 1 -- 172.21.15.162:0/3680968020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80a4102700 msgr2=0x7f80a4197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:07.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a9eda640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80a4102700 0x7f80a4197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:07.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a9eda640 1 -- 172.21.15.162:0/3680968020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80a4105030 msgr2=0x7f80a4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:07.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a9eda640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80a4105030 0x7f80a4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:07.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a9eda640 1 -- 172.21.15.162:0/3680968020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a419fb60 con 0x7f80a4107960 2024-09-19T07:19:07.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a96d9640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80a4102700 0x7f80a4197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:19:07.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f80a9eda640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80a4107960 0x7f80a419f4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f809c009fd0 tx=0x7f809c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:07.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.052+0000 7f809a7fc640 1 -- 172.21.15.162:0/3680968020 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c00ce20 con 0x7f80a4107960 2024-09-19T07:19:07.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.053+0000 7f809a7fc640 1 -- 172.21.15.162:0/3680968020 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f809c005020 con 0x7f80a4107960 2024-09-19T07:19:07.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.053+0000 7f80ab93d640 1 -- 172.21.15.162:0/3680968020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a419fe50 con 0x7f80a4107960 2024-09-19T07:19:07.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.053+0000 7f809a7fc640 1 -- 172.21.15.162:0/3680968020 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c010720 con 0x7f80a4107960 2024-09-19T07:19:07.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.053+0000 7f80ab93d640 1 -- 172.21.15.162:0/3680968020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a41a0300 con 0x7f80a4107960 2024-09-19T07:19:07.057 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.054+0000 7f80ab93d640 1 -- 172.21.15.162:0/3680968020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a40fdd70 con 0x7f80a4107960 2024-09-19T07:19:07.057 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.055+0000 7f809a7fc640 1 -- 172.21.15.162:0/3680968020 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f809c005540 con 0x7f80a4107960 2024-09-19T07:19:07.057 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.056+0000 7f809a7fc640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f80900a32f0 0x7f80900a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:07.057 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.056+0000 7f809a7fc640 1 -- 172.21.15.162:0/3680968020 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6414+0+0 (secure 0 0 0) 0x7f809c0cf760 con 0x7f80a4107960 2024-09-19T07:19:07.057 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.056+0000 7f80a96d9640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f80900a32f0 0x7f80900a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:07.057 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.056+0000 7f80a96d9640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f80900a32f0 0x7f80900a57b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f80a00104e0 tx=0x7f80a000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:07.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.059+0000 7f809a7fc640 1 -- 172.21.15.162:0/3680968020 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f809c09cbf0 con 0x7f80a4107960 2024-09-19T07:19:07.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:19:06.699+0000 7f256d242640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T07:19:07.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:19:06.711+0000 7f256987c640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:19:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T07:19:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: osdmap e63: 11 total, 10 up, 11 in 2024-09-19T07:19:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:19:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='osd.10 [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:19:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-09-19T07:19:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:07.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:07.241+0000 7f80ab93d640 1 -- 172.21.15.162:0/3680968020 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f80a4062630 con 0x7f80900a32f0 2024-09-19T07:19:07.852 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:07 smithi162 ceph-mon[35726]: Detected new or changed devices on smithi139 2024-09-19T07:19:07.852 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:07 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi139 to 4272M 2024-09-19T07:19:07.852 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:07 smithi162 ceph-mon[35726]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:07.852 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:07 smithi162 ceph-mon[35726]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-19T07:19:07.853 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:07 smithi162 ceph-mon[35726]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T07:19:07.853 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:07 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:19:07.853 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:07 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:19:07.853 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:07 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:19:07.853 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:07 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:19:07.853 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:07 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:07.853 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:07 smithi162 ceph-mon[35726]: osd.10 [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368] boot 2024-09-19T07:19:07.853 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:07 smithi162 ceph-mon[35726]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T07:19:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:07 smithi098 ceph-mon[30950]: Detected new or changed devices on smithi139 2024-09-19T07:19:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:07 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi139 to 4272M 2024-09-19T07:19:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:07 smithi098 ceph-mon[30950]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:07 smithi098 ceph-mon[30950]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-19T07:19:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:07 smithi098 ceph-mon[30950]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T07:19:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:07 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:19:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:07 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:19:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:07 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:19:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:07 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:19:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:07 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:07 smithi098 ceph-mon[30950]: osd.10 [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368] boot 2024-09-19T07:19:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:07 smithi098 ceph-mon[30950]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T07:19:08.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:07 smithi139 ceph-mon[35039]: Detected new or changed devices on smithi139 2024-09-19T07:19:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:07 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi139 to 4272M 2024-09-19T07:19:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:07 smithi139 ceph-mon[35039]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 284 MiB used, 894 GiB / 894 GiB avail 2024-09-19T07:19:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:07 smithi139 ceph-mon[35039]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-09-19T07:19:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:07 smithi139 ceph-mon[35039]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T07:19:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:07 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:19:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:07 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:19:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:07 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T07:19:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:07 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T07:19:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:07 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:07 smithi139 ceph-mon[35039]: osd.10 [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368] boot 2024-09-19T07:19:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:07 smithi139 ceph-mon[35039]: osdmap e65: 11 total, 11 up, 11 in 2024-09-19T07:19:08.940 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:08 smithi162 ceph-mon[35726]: purged_snaps scrub starts 2024-09-19T07:19:08.940 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:08 smithi162 ceph-mon[35726]: purged_snaps scrub ok 2024-09-19T07:19:08.940 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:08 smithi162 ceph-mon[35726]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:19:08.940 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:19:08.940 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:08 smithi162 ceph-mon[35726]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T07:19:09.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:08 smithi098 ceph-mon[30950]: purged_snaps scrub starts 2024-09-19T07:19:09.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:08 smithi098 ceph-mon[30950]: purged_snaps scrub ok 2024-09-19T07:19:09.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:08 smithi098 ceph-mon[30950]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:19:09.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:08 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:19:09.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:08 smithi098 ceph-mon[30950]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T07:19:09.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:08 smithi139 ceph-mon[35039]: purged_snaps scrub starts 2024-09-19T07:19:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:08 smithi139 ceph-mon[35039]: purged_snaps scrub ok 2024-09-19T07:19:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:08 smithi139 ceph-mon[35039]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:19:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:08 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:19:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:08 smithi139 ceph-mon[35039]: osdmap e66: 11 total, 11 up, 11 in 2024-09-19T07:19:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:09 smithi098 ceph-mon[30950]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:09 smithi098 ceph-mon[30950]: from='client.? 172.21.15.162:0/1121897297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f91b69da-1ecf-46b5-a94d-401a7416be9c"}]: dispatch 2024-09-19T07:19:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:09 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f91b69da-1ecf-46b5-a94d-401a7416be9c"}]: dispatch 2024-09-19T07:19:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:09 smithi098 ceph-mon[30950]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f91b69da-1ecf-46b5-a94d-401a7416be9c"}]': finished 2024-09-19T07:19:10.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:09 smithi098 ceph-mon[30950]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T07:19:10.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:09 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:10.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:09 smithi139 ceph-mon[35039]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:10.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:09 smithi139 ceph-mon[35039]: from='client.? 172.21.15.162:0/1121897297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f91b69da-1ecf-46b5-a94d-401a7416be9c"}]: dispatch 2024-09-19T07:19:10.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:09 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f91b69da-1ecf-46b5-a94d-401a7416be9c"}]: dispatch 2024-09-19T07:19:10.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:09 smithi139 ceph-mon[35039]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f91b69da-1ecf-46b5-a94d-401a7416be9c"}]': finished 2024-09-19T07:19:10.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:09 smithi139 ceph-mon[35039]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T07:19:10.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:09 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:10.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:09 smithi162 ceph-mon[35726]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:09 smithi162 ceph-mon[35726]: from='client.? 172.21.15.162:0/1121897297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f91b69da-1ecf-46b5-a94d-401a7416be9c"}]: dispatch 2024-09-19T07:19:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:09 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f91b69da-1ecf-46b5-a94d-401a7416be9c"}]: dispatch 2024-09-19T07:19:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:09 smithi162 ceph-mon[35726]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f91b69da-1ecf-46b5-a94d-401a7416be9c"}]': finished 2024-09-19T07:19:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:09 smithi162 ceph-mon[35726]: osdmap e67: 12 total, 11 up, 12 in 2024-09-19T07:19:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:09 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:11.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:10 smithi098 ceph-mon[30950]: from='client.? 172.21.15.162:0/866947888' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:19:11.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:10 smithi098 ceph-mon[30950]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T07:19:11.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:10 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:11.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:10 smithi139 ceph-mon[35039]: from='client.? 172.21.15.162:0/866947888' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:19:11.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:10 smithi139 ceph-mon[35039]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T07:19:11.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:10 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:11.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:10 smithi162 ceph-mon[35726]: from='client.? 172.21.15.162:0/866947888' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T07:19:11.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:10 smithi162 ceph-mon[35726]: osdmap e68: 12 total, 11 up, 12 in 2024-09-19T07:19:11.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:10 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:12.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:11 smithi098 ceph-mon[30950]: pgmap v225: 1 pgs: 1 remapped+peering; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:12.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:11 smithi098 ceph-mon[30950]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T07:19:12.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:11 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:12.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:11 smithi139 ceph-mon[35039]: pgmap v225: 1 pgs: 1 remapped+peering; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:12.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:11 smithi139 ceph-mon[35039]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T07:19:12.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:11 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:12.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:11 smithi162 ceph-mon[35726]: pgmap v225: 1 pgs: 1 remapped+peering; 577 KiB data, 311 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:12.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:11 smithi162 ceph-mon[35726]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T07:19:12.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:11 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:14.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:13 smithi098 ceph-mon[30950]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:14.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:13 smithi139 ceph-mon[35039]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:14.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:13 smithi162 ceph-mon[35726]: pgmap v227: 1 pgs: 1 remapped+peering; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:16.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:15 smithi098 ceph-mon[30950]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T07:19:16.059 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:15 smithi162 ceph-mon[35726]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T07:19:16.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:15 smithi139 ceph-mon[35039]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T07:19:18.009 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:17 smithi162 ceph-mon[35726]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T07:19:18.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:17 smithi098 ceph-mon[30950]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T07:19:18.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:17 smithi139 ceph-mon[35039]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T07:19:19.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:18 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T07:19:19.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:18 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:19.059 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:18 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T07:19:19.059 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:18 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:19.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:18 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T07:19:19.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:18 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:19 smithi098 ceph-mon[30950]: Deploying daemon osd.11 on smithi162 2024-09-19T07:19:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:19 smithi098 ceph-mon[30950]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:19:20.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:19 smithi139 ceph-mon[35039]: Deploying daemon osd.11 on smithi162 2024-09-19T07:19:20.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:19 smithi139 ceph-mon[35039]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:19:20.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:19 smithi162 ceph-mon[35726]: Deploying daemon osd.11 on smithi162 2024-09-19T07:19:20.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:19 smithi162 ceph-mon[35726]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T07:19:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:21 smithi162 ceph-mon[35726]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:19:22.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:21 smithi098 ceph-mon[30950]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:19:22.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:21 smithi139 ceph-mon[35039]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T07:19:22.948 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:22 smithi162 ceph-mon[35726]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T07:19:23.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:22 smithi098 ceph-mon[30950]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T07:19:23.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:22 smithi139 ceph-mon[35039]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T07:19:24.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:24.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:24.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:24.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:24.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:24.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:24.109 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:24.109 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:24.109 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:24.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:24 smithi162 ceph-mon[35726]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:19:25.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:24 smithi098 ceph-mon[30950]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:19:25.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:24 smithi139 ceph-mon[35039]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T07:19:26.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.848+0000 7f809a7fc640 1 -- 172.21.15.162:0/3680968020 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f80a4062630 con 0x7f80900a32f0 2024-09-19T07:19:26.850 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 11 on host 'smithi162' 2024-09-19T07:19:26.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.851+0000 7f80ab93d640 1 -- 172.21.15.162:0/3680968020 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f80900a32f0 msgr2=0x7f80900a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:26.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.851+0000 7f80ab93d640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f80900a32f0 0x7f80900a57b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f80a00104e0 tx=0x7f80a000b410 comp rx=0 tx=0).stop 2024-09-19T07:19:26.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.851+0000 7f80ab93d640 1 -- 172.21.15.162:0/3680968020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80a4107960 msgr2=0x7f80a419f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:26.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.851+0000 7f80ab93d640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80a4107960 0x7f80a419f4f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f809c009fd0 tx=0x7f809c00ef10 comp rx=0 tx=0).stop 2024-09-19T07:19:26.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.851+0000 7f80ab93d640 1 -- 172.21.15.162:0/3680968020 shutdown_connections 2024-09-19T07:19:26.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.851+0000 7f80ab93d640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f80900a32f0 0x7f80900a57b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:26.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.851+0000 7f80ab93d640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80a4107960 0x7f80a419f4f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:26.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.851+0000 7f80ab93d640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80a4105030 0x7f80a4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:26.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.851+0000 7f80ab93d640 1 --2- 172.21.15.162:0/3680968020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80a4102700 0x7f80a4197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:26.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.851+0000 7f80ab93d640 1 -- 172.21.15.162:0/3680968020 >> 172.21.15.162:0/3680968020 conn(0x7f80a40fc280 msgr2=0x7f80a41031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:26.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.851+0000 7f80ab93d640 1 -- 172.21.15.162:0/3680968020 shutdown_connections 2024-09-19T07:19:26.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:26.851+0000 7f80ab93d640 1 -- 172.21.15.162:0/3680968020 wait complete. 2024-09-19T07:19:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:27 smithi162 ceph-mon[35726]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:27 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:27.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:27.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:27 smithi139 ceph-mon[35039]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:27.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:27.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:27 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.425 DEBUG:teuthology.orchestra.run.smithi162:osd.11> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T07:19:27.427 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T07:19:27.428 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T07:19:27.456 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.456 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.456 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:27.456 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:27.456 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.456 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:27 smithi098 ceph-mon[30950]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:27.457 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:27.457 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.457 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:27 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:27.683 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:28.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.170+0000 7fd4c3365640 1 -- 172.21.15.98:0/2145672457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4bc101c00 msgr2=0x7fd4bc102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.170+0000 7fd4c3365640 1 --2- 172.21.15.98:0/2145672457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4bc101c00 0x7fd4bc102000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009900 tx=0x7fd4b802a410 comp rx=0 tx=0).stop 2024-09-19T07:19:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.170+0000 7fd4c3365640 1 -- 172.21.15.98:0/2145672457 shutdown_connections 2024-09-19T07:19:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.170+0000 7fd4c3365640 1 --2- 172.21.15.98:0/2145672457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4bc1037c0 0x7fd4bc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.170+0000 7fd4c3365640 1 --2- 172.21.15.98:0/2145672457 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc102e00 0x7fd4bc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.170+0000 7fd4c3365640 1 --2- 172.21.15.98:0/2145672457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4bc101c00 0x7fd4bc102000 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.170+0000 7fd4c3365640 1 -- 172.21.15.98:0/2145672457 >> 172.21.15.98:0/2145672457 conn(0x7fd4bc0fd390 msgr2=0x7fd4bc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.170+0000 7fd4c3365640 1 -- 172.21.15.98:0/2145672457 shutdown_connections 2024-09-19T07:19:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.170+0000 7fd4c3365640 1 -- 172.21.15.98:0/2145672457 wait complete. 2024-09-19T07:19:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c3365640 1 Processor -- start 2024-09-19T07:19:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c3365640 1 -- start start 2024-09-19T07:19:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c3365640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc101c00 0x7fd4bc19e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:28.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c3365640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4bc102e00 0x7fd4bc19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c3365640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4bc1037c0 0x7fd4bc1a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c3365640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd4bc10d890 con 0x7fd4bc1037c0 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c3365640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd4bc10d710 con 0x7fd4bc101c00 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c3365640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd4bc10da10 con 0x7fd4bc102e00 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c1101640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc101c00 0x7fd4bc19e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c1902640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4bc1037c0 0x7fd4bc1a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c1101640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc101c00 0x7fd4bc19e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:41936/0 (socket says 172.21.15.98:41936) 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c1902640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4bc1037c0 0x7fd4bc1a5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40710/0 (socket says 172.21.15.98:40710) 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c1101640 1 -- 172.21.15.98:0/4095801774 learned_addr learned my addr 172.21.15.98:0/4095801774 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c0900640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4bc102e00 0x7fd4bc19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c1902640 1 -- 172.21.15.98:0/4095801774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4bc102e00 msgr2=0x7fd4bc19e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c1902640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4bc102e00 0x7fd4bc19e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:28.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c1902640 1 -- 172.21.15.98:0/4095801774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc101c00 msgr2=0x7fd4bc19e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c1902640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc101c00 0x7fd4bc19e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.171+0000 7fd4c1902640 1 -- 172.21.15.98:0/4095801774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4bc1a6090 con 0x7fd4bc1037c0 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.172+0000 7fd4c1902640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4bc1037c0 0x7fd4bc1a5a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400e940 tx=0x7fd4b400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.172+0000 7fd4b27fc640 1 -- 172.21.15.98:0/4095801774 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4004d20 con 0x7fd4bc1037c0 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.172+0000 7fd4c3365640 1 -- 172.21.15.98:0/4095801774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4bc1a6380 con 0x7fd4bc1037c0 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.172+0000 7fd4b27fc640 1 -- 172.21.15.98:0/4095801774 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4b4005020 con 0x7fd4bc1037c0 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.172+0000 7fd4b27fc640 1 -- 172.21.15.98:0/4095801774 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40116d0 con 0x7fd4bc1037c0 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.172+0000 7fd4c3365640 1 -- 172.21.15.98:0/4095801774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4bc1a6910 con 0x7fd4bc1037c0 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.173+0000 7fd4c3365640 1 -- 172.21.15.98:0/4095801774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4bc106fa0 con 0x7fd4bc1037c0 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.174+0000 7fd4b27fc640 1 -- 172.21.15.98:0/4095801774 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd4b40054d0 con 0x7fd4bc1037c0 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.174+0000 7fd4b27fc640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd4a80a3270 0x7fd4a80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.175+0000 7fd4c1101640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd4a80a3270 0x7fd4a80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.175+0000 7fd4b27fc640 1 -- 172.21.15.98:0/4095801774 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6809+0+0 (secure 0 0 0) 0x7fd4b40cf710 con 0x7fd4bc1037c0 2024-09-19T07:19:28.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.175+0000 7fd4c1101640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd4a80a3270 0x7fd4a80a5730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8000c00 tx=0x7fd4b80046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:28.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.178+0000 7fd4b27fc640 1 -- 172.21.15.98:0/4095801774 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd4b4016030 con 0x7fd4bc1037c0 2024-09-19T07:19:28.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.344+0000 7fd4c3365640 1 -- 172.21.15.98:0/4095801774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd4bc062df0 con 0x7fd4bc1037c0 2024-09-19T07:19:28.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.344+0000 7fd4b27fc640 1 -- 172.21.15.98:0/4095801774 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7fd4b4096e20 con 0x7fd4bc1037c0 2024-09-19T07:19:28.345 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:19:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.346+0000 7fd4c3365640 1 -- 172.21.15.98:0/4095801774 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd4a80a3270 msgr2=0x7fd4a80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.346+0000 7fd4c3365640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd4a80a3270 0x7fd4a80a5730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8000c00 tx=0x7fd4b80046c0 comp rx=0 tx=0).stop 2024-09-19T07:19:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.346+0000 7fd4c3365640 1 -- 172.21.15.98:0/4095801774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4bc1037c0 msgr2=0x7fd4bc1a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.346+0000 7fd4c3365640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4bc1037c0 0x7fd4bc1a5a20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400e940 tx=0x7fd4b400ed40 comp rx=0 tx=0).stop 2024-09-19T07:19:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.346+0000 7fd4c3365640 1 -- 172.21.15.98:0/4095801774 shutdown_connections 2024-09-19T07:19:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.346+0000 7fd4c3365640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd4a80a3270 0x7fd4a80a5730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.346+0000 7fd4c3365640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd4bc1037c0 0x7fd4bc1a5a20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:28.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.346+0000 7fd4c3365640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4bc102e00 0x7fd4bc19e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:28.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.346+0000 7fd4c3365640 1 --2- 172.21.15.98:0/4095801774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd4bc101c00 0x7fd4bc19e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:28.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.346+0000 7fd4c3365640 1 -- 172.21.15.98:0/4095801774 >> 172.21.15.98:0/4095801774 conn(0x7fd4bc0fd390 msgr2=0x7fd4bc104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:28.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.346+0000 7fd4c3365640 1 -- 172.21.15.98:0/4095801774 shutdown_connections 2024-09-19T07:19:28.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:28.347+0000 7fd4c3365640 1 -- 172.21.15.98:0/4095801774 wait complete. 2024-09-19T07:19:28.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:28 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4095801774' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:19:28.713 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:28 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4095801774' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:19:28.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:28 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4095801774' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:19:29.085 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1726730347,"num_in_osds":12,"osd_in_since":1726730349,"num_remapped_pgs":0} 2024-09-19T07:19:29.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:29 smithi139 ceph-mon[35039]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:29.660 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:29 smithi162 ceph-mon[35726]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:29.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:29 smithi098 ceph-mon[30950]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:30.087 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T07:19:30.092 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:19:29 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:19:29.659+0000 7f790ba34640 -1 osd.11 0 log_to_monitors true 2024-09-19T07:19:30.339 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:30.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:30 smithi098 ceph-mon[30950]: from='osd.11 [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:19:30.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:30 smithi098 ceph-mon[30950]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:19:30.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:30.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:30.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:30.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:30.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:30.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:30.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:30.668 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:30.669 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:30.669 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:30 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.746+0000 7fd0761f6640 1 -- 172.21.15.98:0/159929786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0701037c0 msgr2=0x7fd07010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.746+0000 7fd0761f6640 1 --2- 172.21.15.98:0/159929786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0701037c0 0x7fd07010a050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd068009ca0 tx=0x7fd06802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.746+0000 7fd0761f6640 1 -- 172.21.15.98:0/159929786 shutdown_connections 2024-09-19T07:19:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.746+0000 7fd0761f6640 1 --2- 172.21.15.98:0/159929786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0701037c0 0x7fd07010a050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.746+0000 7fd0761f6640 1 --2- 172.21.15.98:0/159929786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd070102e00 0x7fd070103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.746+0000 7fd0761f6640 1 --2- 172.21.15.98:0/159929786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd070101c00 0x7fd070102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.746+0000 7fd0761f6640 1 -- 172.21.15.98:0/159929786 >> 172.21.15.98:0/159929786 conn(0x7fd0700fd390 msgr2=0x7fd0700ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.746+0000 7fd0761f6640 1 -- 172.21.15.98:0/159929786 shutdown_connections 2024-09-19T07:19:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.746+0000 7fd0761f6640 1 -- 172.21.15.98:0/159929786 wait complete. 2024-09-19T07:19:30.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.747+0000 7fd0761f6640 1 Processor -- start 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.747+0000 7fd0761f6640 1 -- start start 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.747+0000 7fd0761f6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd070101c00 0x7fd070198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.747+0000 7fd0761f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd070102e00 0x7fd070198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.747+0000 7fd0761f6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0701037c0 0x7fd07019f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.747+0000 7fd0761f6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd07010d980 con 0x7fd070102e00 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.747+0000 7fd0761f6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd07010d800 con 0x7fd0701037c0 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.747+0000 7fd0761f6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd07010db00 con 0x7fd070101c00 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.747+0000 7fd06effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd070102e00 0x7fd070198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.747+0000 7fd06effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd070102e00 0x7fd070198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40726/0 (socket says 172.21.15.98:40726) 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.747+0000 7fd06effd640 1 -- 172.21.15.98:0/3604905253 learned_addr learned my addr 172.21.15.98:0/3604905253 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd06f7fe640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd070101c00 0x7fd070198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd06ffff640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0701037c0 0x7fd07019f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:30.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd06effd640 1 -- 172.21.15.98:0/3604905253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd070101c00 msgr2=0x7fd070198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd06effd640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd070101c00 0x7fd070198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd06effd640 1 -- 172.21.15.98:0/3604905253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0701037c0 msgr2=0x7fd07019f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd06effd640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0701037c0 0x7fd07019f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd06effd640 1 -- 172.21.15.98:0/3604905253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07019fc60 con 0x7fd070102e00 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd06effd640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd070102e00 0x7fd070198570 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd06000b4a0 tx=0x7fd06000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd06cff9640 1 -- 172.21.15.98:0/3604905253 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd060015020 con 0x7fd070102e00 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd06cff9640 1 -- 172.21.15.98:0/3604905253 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd060011d10 con 0x7fd070102e00 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd0761f6640 1 -- 172.21.15.98:0/3604905253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07019ff50 con 0x7fd070102e00 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd06cff9640 1 -- 172.21.15.98:0/3604905253 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06000f2e0 con 0x7fd070102e00 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.748+0000 7fd0761f6640 1 -- 172.21.15.98:0/3604905253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0701a0480 con 0x7fd070102e00 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.749+0000 7fd0761f6640 1 -- 172.21.15.98:0/3604905253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd070109050 con 0x7fd070102e00 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.750+0000 7fd06cff9640 1 -- 172.21.15.98:0/3604905253 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd060018020 con 0x7fd070102e00 2024-09-19T07:19:30.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.751+0000 7fd06cff9640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd0580a3270 0x7fd0580a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:30.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.751+0000 7fd06f7fe640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd0580a3270 0x7fd0580a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:30.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.751+0000 7fd06cff9640 1 -- 172.21.15.98:0/3604905253 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6831+0+0 (secure 0 0 0) 0x7fd0600cec10 con 0x7fd070102e00 2024-09-19T07:19:30.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.751+0000 7fd06f7fe640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd0580a3270 0x7fd0580a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd070102c60 tx=0x7fd064009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:30.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.755+0000 7fd06cff9640 1 -- 172.21.15.98:0/3604905253 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd06001f020 con 0x7fd070102e00 2024-09-19T07:19:30.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:30 smithi139 ceph-mon[35039]: from='osd.11 [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:19:30.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:30 smithi139 ceph-mon[35039]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:19:30.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:30.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:30.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:30.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:30.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:30.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:30.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:30.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:30.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:30.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:30 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:30.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:30 smithi162 ceph-mon[35726]: from='osd.11 [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:19:30.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:30 smithi162 ceph-mon[35726]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T07:19:30.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:30.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:30.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:30.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:30.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:30.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:19:30.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:30.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:30.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:30.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:30 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:30.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.923+0000 7fd0761f6640 1 -- 172.21.15.98:0/3604905253 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd07002d9c0 con 0x7fd070102e00 2024-09-19T07:19:30.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.923+0000 7fd06cff9640 1 -- 172.21.15.98:0/3604905253 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7fd06009bf00 con 0x7fd070102e00 2024-09-19T07:19:30.924 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:19:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.925+0000 7fd0761f6640 1 -- 172.21.15.98:0/3604905253 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd0580a3270 msgr2=0x7fd0580a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.925+0000 7fd0761f6640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd0580a3270 0x7fd0580a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd070102c60 tx=0x7fd064009110 comp rx=0 tx=0).stop 2024-09-19T07:19:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.925+0000 7fd0761f6640 1 -- 172.21.15.98:0/3604905253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd070102e00 msgr2=0x7fd070198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.925+0000 7fd0761f6640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd070102e00 0x7fd070198570 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd06000b4a0 tx=0x7fd06000b8a0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.925+0000 7fd0761f6640 1 -- 172.21.15.98:0/3604905253 shutdown_connections 2024-09-19T07:19:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.925+0000 7fd0761f6640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd0580a3270 0x7fd0580a5730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.925+0000 7fd0761f6640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0701037c0 0x7fd07019f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.925+0000 7fd0761f6640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd070102e00 0x7fd070198570 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.925+0000 7fd0761f6640 1 --2- 172.21.15.98:0/3604905253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd070101c00 0x7fd070198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.925+0000 7fd0761f6640 1 -- 172.21.15.98:0/3604905253 >> 172.21.15.98:0/3604905253 conn(0x7fd0700fd390 msgr2=0x7fd070106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.925+0000 7fd0761f6640 1 -- 172.21.15.98:0/3604905253 shutdown_connections 2024-09-19T07:19:30.926 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:30.925+0000 7fd0761f6640 1 -- 172.21.15.98:0/3604905253 wait complete. 2024-09-19T07:19:31.615 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726730347,"num_in_osds":12,"osd_in_since":1726730349,"num_remapped_pgs":0} 2024-09-19T07:19:31.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:31 smithi098 ceph-mon[30950]: Detected new or changed devices on smithi162 2024-09-19T07:19:31.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:31 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-19T07:19:31.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:31 smithi098 ceph-mon[30950]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T07:19:31.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:31 smithi098 ceph-mon[30950]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T07:19:31.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:31 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:31.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:31 smithi098 ceph-mon[30950]: from='osd.11 [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:19:31.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:31 smithi098 ceph-mon[30950]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:19:31.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:31 smithi098 ceph-mon[30950]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:31.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:31 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3604905253' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:19:31.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:31 smithi139 ceph-mon[35039]: Detected new or changed devices on smithi162 2024-09-19T07:19:31.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:31 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-19T07:19:31.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:31 smithi139 ceph-mon[35039]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T07:19:31.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:31 smithi139 ceph-mon[35039]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T07:19:31.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:31 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:31.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:31 smithi139 ceph-mon[35039]: from='osd.11 [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:19:31.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:31 smithi139 ceph-mon[35039]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:19:31.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:31 smithi139 ceph-mon[35039]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:31.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:31 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3604905253' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:19:31.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:31 smithi162 ceph-mon[35726]: Detected new or changed devices on smithi162 2024-09-19T07:19:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:31 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi162 to 4272M 2024-09-19T07:19:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:31 smithi162 ceph-mon[35726]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T07:19:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:31 smithi162 ceph-mon[35726]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T07:19:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:31 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:31 smithi162 ceph-mon[35726]: from='osd.11 [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:19:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:31 smithi162 ceph-mon[35726]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-09-19T07:19:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:31 smithi162 ceph-mon[35726]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:31.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:31 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3604905253' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:19:32.615 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T07:19:32.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:19:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:19:32.194+0000 7f79081cb640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T07:19:32.633 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:19:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:19:32.209+0000 7f78ff7c6640 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T07:19:32.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:32 smithi162 ceph-mon[35726]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T07:19:32.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:32 smithi162 ceph-mon[35726]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T07:19:32.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:32 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:32.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:32 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:32.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:32 smithi162 ceph-mon[35726]: from='osd.11 ' entity='osd.11' 2024-09-19T07:19:32.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:32 smithi098 ceph-mon[30950]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T07:19:32.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:32 smithi098 ceph-mon[30950]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T07:19:32.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:32 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:32.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:32 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:32.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:32 smithi098 ceph-mon[30950]: from='osd.11 ' entity='osd.11' 2024-09-19T07:19:32.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:32 smithi139 ceph-mon[35039]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-09-19T07:19:32.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:32 smithi139 ceph-mon[35039]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T07:19:32.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:32 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:32.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:32 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:32.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:32 smithi139 ceph-mon[35039]: from='osd.11 ' entity='osd.11' 2024-09-19T07:19:32.862 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:33.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.263+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/339508476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f14102720 msgr2=0x7f5f14104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:33.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.263+0000 7f5f1ab5a640 1 --2- 172.21.15.98:0/339508476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f14102720 0x7f5f14104b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009900 tx=0x7f5f0802a410 comp rx=0 tx=0).stop 2024-09-19T07:19:33.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.263+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/339508476 shutdown_connections 2024-09-19T07:19:33.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.263+0000 7f5f1ab5a640 1 --2- 172.21.15.98:0/339508476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f14107980 0x7f5f14109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.263+0000 7f5f1ab5a640 1 --2- 172.21.15.98:0/339508476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f14105050 0x7f5f14107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.263+0000 7f5f1ab5a640 1 --2- 172.21.15.98:0/339508476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f14102720 0x7f5f14104b10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.263+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/339508476 >> 172.21.15.98:0/339508476 conn(0x7f5f140fc2a0 msgr2=0x7f5f140fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:33.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.263+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/339508476 shutdown_connections 2024-09-19T07:19:33.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.263+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/339508476 wait complete. 2024-09-19T07:19:33.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f1ab5a640 1 Processor -- start 2024-09-19T07:19:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f1ab5a640 1 -- start start 2024-09-19T07:19:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f1ab5a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f14102720 0x7f5f14197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f1ab5a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f14105050 0x7f5f14198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f1ab5a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f14107980 0x7f5f1419f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f1ab5a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1410d8a0 con 0x7f5f14102720 2024-09-19T07:19:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f1ab5a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1410d720 con 0x7f5f14107980 2024-09-19T07:19:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f1ab5a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1410da20 con 0x7f5f14105050 2024-09-19T07:19:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f188f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f14102720 0x7f5f14197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f188f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f14102720 0x7f5f14197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56668/0 (socket says 172.21.15.98:56668) 2024-09-19T07:19:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f188f6640 1 -- 172.21.15.98:0/3902944581 learned_addr learned my addr 172.21.15.98:0/3902944581 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:19:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f190f7640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f14107980 0x7f5f1419f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:33.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f188f6640 1 -- 172.21.15.98:0/3902944581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f14105050 msgr2=0x7f5f14198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:33.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f188f6640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f14105050 0x7f5f14198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f188f6640 1 -- 172.21.15.98:0/3902944581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f14107980 msgr2=0x7f5f1419f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:33.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f188f6640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f14107980 0x7f5f1419f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f188f6640 1 -- 172.21.15.98:0/3902944581 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1419fb50 con 0x7f5f14102720 2024-09-19T07:19:33.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f190f7640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f14107980 0x7f5f1419f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:33.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.264+0000 7f5f188f6640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f14102720 0x7f5f14197f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009230 tx=0x7f5f08004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:33.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.265+0000 7f5f11ffb640 1 -- 172.21.15.98:0/3902944581 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0803f030 con 0x7f5f14102720 2024-09-19T07:19:33.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.265+0000 7f5f11ffb640 1 -- 172.21.15.98:0/3902944581 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f08003ce0 con 0x7f5f14102720 2024-09-19T07:19:33.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.265+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/3902944581 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f1419fde0 con 0x7f5f14102720 2024-09-19T07:19:33.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.265+0000 7f5f11ffb640 1 -- 172.21.15.98:0/3902944581 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f08035070 con 0x7f5f14102720 2024-09-19T07:19:33.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.265+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/3902944581 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f141a0240 con 0x7f5f14102720 2024-09-19T07:19:33.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.266+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/3902944581 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f140fdd90 con 0x7f5f14102720 2024-09-19T07:19:33.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.267+0000 7f5f11ffb640 1 -- 172.21.15.98:0/3902944581 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5f08042030 con 0x7f5f14102720 2024-09-19T07:19:33.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.267+0000 7f5f11ffb640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5f040a32f0 0x7f5f040a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:33.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.268+0000 7f5f13fff640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5f040a32f0 0x7f5f040a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:33.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.268+0000 7f5f11ffb640 1 -- 172.21.15.98:0/3902944581 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7f5f080eff70 con 0x7f5f14102720 2024-09-19T07:19:33.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.268+0000 7f5f13fff640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5f040a32f0 0x7f5f040a57b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5f00005fd0 tx=0x7f5f00005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:33.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.271+0000 7f5f11ffb640 1 -- 172.21.15.98:0/3902944581 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f080bd090 con 0x7f5f14102720 2024-09-19T07:19:33.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.440+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/3902944581 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5f1402da30 con 0x7f5f14102720 2024-09-19T07:19:33.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.440+0000 7f5f11ffb640 1 -- 172.21.15.98:0/3902944581 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f5f080bc990 con 0x7f5f14102720 2024-09-19T07:19:33.441 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.442+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/3902944581 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5f040a32f0 msgr2=0x7f5f040a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.442+0000 7f5f1ab5a640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5f040a32f0 0x7f5f040a57b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5f00005fd0 tx=0x7f5f00005850 comp rx=0 tx=0).stop 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.442+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/3902944581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f14102720 msgr2=0x7f5f14197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.442+0000 7f5f1ab5a640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f14102720 0x7f5f14197f20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009230 tx=0x7f5f08004360 comp rx=0 tx=0).stop 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.442+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/3902944581 shutdown_connections 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.442+0000 7f5f1ab5a640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5f040a32f0 0x7f5f040a57b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.442+0000 7f5f1ab5a640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5f14107980 0x7f5f1419f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.442+0000 7f5f1ab5a640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f14105050 0x7f5f14198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.442+0000 7f5f1ab5a640 1 --2- 172.21.15.98:0/3902944581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f14102720 0x7f5f14197f20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:33.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.442+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/3902944581 >> 172.21.15.98:0/3902944581 conn(0x7f5f140fc2a0 msgr2=0x7f5f14103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:33.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.442+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/3902944581 shutdown_connections 2024-09-19T07:19:33.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:33.442+0000 7f5f1ab5a640 1 -- 172.21.15.98:0/3902944581 wait complete. 2024-09-19T07:19:33.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:33 smithi098 ceph-mon[30950]: purged_snaps scrub starts 2024-09-19T07:19:33.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:33 smithi098 ceph-mon[30950]: purged_snaps scrub ok 2024-09-19T07:19:33.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:33 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:33.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:33 smithi098 ceph-mon[30950]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:33.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:33 smithi098 ceph-mon[30950]: osd.11 [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723] boot 2024-09-19T07:19:33.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:33 smithi098 ceph-mon[30950]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T07:19:33.524 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:33 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:33.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:33 smithi139 ceph-mon[35039]: purged_snaps scrub starts 2024-09-19T07:19:33.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:33 smithi139 ceph-mon[35039]: purged_snaps scrub ok 2024-09-19T07:19:33.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:33 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:33.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:33 smithi139 ceph-mon[35039]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:33.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:33 smithi139 ceph-mon[35039]: osd.11 [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723] boot 2024-09-19T07:19:33.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:33 smithi139 ceph-mon[35039]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T07:19:33.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:33 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:33.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:33 smithi162 ceph-mon[35726]: purged_snaps scrub starts 2024-09-19T07:19:33.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:33 smithi162 ceph-mon[35726]: purged_snaps scrub ok 2024-09-19T07:19:33.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:33 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:33.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:33 smithi162 ceph-mon[35726]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 983 GiB / 983 GiB avail 2024-09-19T07:19:33.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:33 smithi162 ceph-mon[35726]: osd.11 [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723] boot 2024-09-19T07:19:33.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:33 smithi162 ceph-mon[35726]: osdmap e72: 12 total, 12 up, 12 in 2024-09-19T07:19:33.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:33 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:19:34.192 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":72,"num_osds":12,"num_up_osds":12,"osd_up_since":1726730373,"num_in_osds":12,"osd_in_since":1726730349,"num_remapped_pgs":0} 2024-09-19T07:19:34.192 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:19:34.436 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:34.677 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:34 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3902944581' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:19:34.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:34 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3902944581' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:19:34.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:34 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3902944581' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T07:19:34.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.939+0000 7f08fcf6a640 1 -- 172.21.15.98:0/1336939467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f8106f00 msgr2=0x7f08f810ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:34.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.939+0000 7f08fcf6a640 1 --2- 172.21.15.98:0/1336939467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f8106f00 0x7f08f810ea80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009ca0 tx=0x7f08f002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:19:34.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.939+0000 7f08fcf6a640 1 -- 172.21.15.98:0/1336939467 shutdown_connections 2024-09-19T07:19:34.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.939+0000 7f08fcf6a640 1 --2- 172.21.15.98:0/1336939467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f8106f00 0x7f08f810ea80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:34.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.939+0000 7f08fcf6a640 1 --2- 172.21.15.98:0/1336939467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08f8102780 0x7f08f81067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:34.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.939+0000 7f08fcf6a640 1 --2- 172.21.15.98:0/1336939467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f8101dd0 0x7f08f81021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:34.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.939+0000 7f08fcf6a640 1 -- 172.21.15.98:0/1336939467 >> 172.21.15.98:0/1336939467 conn(0x7f08f80fd8b0 msgr2=0x7f08f80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:34.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.939+0000 7f08fcf6a640 1 -- 172.21.15.98:0/1336939467 shutdown_connections 2024-09-19T07:19:34.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.939+0000 7f08fcf6a640 1 -- 172.21.15.98:0/1336939467 wait complete. 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08fcf6a640 1 Processor -- start 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08fcf6a640 1 -- start start 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08fcf6a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f8101dd0 0x7f08f8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08fcf6a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08f8102780 0x7f08f8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08fcf6a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f8106f00 0x7f08f819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08fcf6a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f08f8111f80 con 0x7f08f8106f00 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08fcf6a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f08f8111e00 con 0x7f08f8102780 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08fcf6a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f08f8112100 con 0x7f08f8101dd0 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08f6d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f8106f00 0x7f08f819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08f6d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f8106f00 0x7f08f819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56688/0 (socket says 172.21.15.98:56688) 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08f6d9d640 1 -- 172.21.15.98:0/443627931 learned_addr learned my addr 172.21.15.98:0/443627931 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08f659c640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f8101dd0 0x7f08f8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:34.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08f6d9d640 1 -- 172.21.15.98:0/443627931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f8101dd0 msgr2=0x7f08f8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08f6d9d640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f8101dd0 0x7f08f8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08f6d9d640 1 -- 172.21.15.98:0/443627931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08f8102780 msgr2=0x7f08f8198980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08f6d9d640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08f8102780 0x7f08f8198980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08f6d9d640 1 -- 172.21.15.98:0/443627931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f819d3f0 con 0x7f08f8106f00 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.940+0000 7f08f659c640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f8101dd0 0x7f08f8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.941+0000 7f08f6d9d640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f8106f00 0x7f08f819cd10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08f0031a20 tx=0x7f08f0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.941+0000 7f08ef7fe640 1 -- 172.21.15.98:0/443627931 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0003c30 con 0x7f08f8106f00 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.941+0000 7f08ef7fe640 1 -- 172.21.15.98:0/443627931 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08f0003dd0 con 0x7f08f8106f00 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.941+0000 7f08fcf6a640 1 -- 172.21.15.98:0/443627931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f819d680 con 0x7f08f8106f00 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.941+0000 7f08ef7fe640 1 -- 172.21.15.98:0/443627931 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f002fcf0 con 0x7f08f8106f00 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.941+0000 7f08fcf6a640 1 -- 172.21.15.98:0/443627931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f81a4fc0 con 0x7f08f8106f00 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.942+0000 7f08fcf6a640 1 -- 172.21.15.98:0/443627931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f81021b0 con 0x7f08f8106f00 2024-09-19T07:19:34.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.943+0000 7f08ef7fe640 1 -- 172.21.15.98:0/443627931 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f08f0004050 con 0x7f08f8106f00 2024-09-19T07:19:34.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.944+0000 7f08ef7fe640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f08e40a32c0 0x7f08e40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:34.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.944+0000 7f08f659c640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f08e40a32c0 0x7f08e40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:34.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.944+0000 7f08ef7fe640 1 -- 172.21.15.98:0/443627931 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f08f00f09b0 con 0x7f08f8106f00 2024-09-19T07:19:34.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.944+0000 7f08f659c640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f08e40a32c0 0x7f08e40a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009930 tx=0x7f08e8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:34.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:34.947+0000 7f08ef7fe640 1 -- 172.21.15.98:0/443627931 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f08f00bdc00 con 0x7f08f8106f00 2024-09-19T07:19:35.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.114+0000 7f08fcf6a640 1 -- 172.21.15.98:0/443627931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08f810a1a0 con 0x7f08f8106f00 2024-09-19T07:19:35.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.115+0000 7f08ef7fe640 1 -- 172.21.15.98:0/443627931 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18479 (secure 0 0 0) 0x7f08f002fe90 con 0x7f08f8106f00 2024-09-19T07:19:35.116 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:19:35.116 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":73,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:19:34.425521+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:19:35.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.117+0000 7f08fcf6a640 1 -- 172.21.15.98:0/443627931 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f08e40a32c0 msgr2=0x7f08e40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:35.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.117+0000 7f08fcf6a640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f08e40a32c0 0x7f08e40a5780 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f08e8009930 tx=0x7f08e8008040 comp rx=0 tx=0).stop 2024-09-19T07:19:35.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.117+0000 7f08fcf6a640 1 -- 172.21.15.98:0/443627931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f8106f00 msgr2=0x7f08f819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:35.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.117+0000 7f08fcf6a640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f8106f00 0x7f08f819cd10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08f0031a20 tx=0x7f08f0031a50 comp rx=0 tx=0).stop 2024-09-19T07:19:35.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.117+0000 7f08fcf6a640 1 -- 172.21.15.98:0/443627931 shutdown_connections 2024-09-19T07:19:35.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.117+0000 7f08fcf6a640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f08e40a32c0 0x7f08e40a5780 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:35.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.117+0000 7f08fcf6a640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f8106f00 0x7f08f819cd10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:35.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.117+0000 7f08fcf6a640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08f8102780 0x7f08f8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:35.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.117+0000 7f08fcf6a640 1 --2- 172.21.15.98:0/443627931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f8101dd0 0x7f08f8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:35.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.117+0000 7f08fcf6a640 1 -- 172.21.15.98:0/443627931 >> 172.21.15.98:0/443627931 conn(0x7f08f80fd8b0 msgr2=0x7f08f80fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:35.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.117+0000 7f08fcf6a640 1 -- 172.21.15.98:0/443627931 shutdown_connections 2024-09-19T07:19:35.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:35.117+0000 7f08fcf6a640 1 -- 172.21.15.98:0/443627931 wait complete. 2024-09-19T07:19:35.664 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:35 smithi098 ceph-mon[30950]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T07:19:35.664 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:35 smithi098 ceph-mon[30950]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:35.665 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:35 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/443627931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:19:35.692 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T07:15:50.874894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T07:19:35.693 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T07:19:35.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:35 smithi139 ceph-mon[35039]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T07:19:35.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:35 smithi139 ceph-mon[35039]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:35.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:35 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/443627931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:19:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:35 smithi162 ceph-mon[35726]: osdmap e73: 12 total, 12 up, 12 in 2024-09-19T07:19:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:35 smithi162 ceph-mon[35726]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:35.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:35 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/443627931' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:19:35.934 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:36.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.348+0000 7f7724164640 1 -- 172.21.15.98:0/339745123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f771c103760 msgr2=0x7f771c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:36.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.348+0000 7f7724164640 1 --2- 172.21.15.98:0/339745123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f771c103760 0x7f771c107ba0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f770c009930 tx=0x7f770c02a420 comp rx=0 tx=0).stop 2024-09-19T07:19:36.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.348+0000 7f7724164640 1 -- 172.21.15.98:0/339745123 shutdown_connections 2024-09-19T07:19:36.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.348+0000 7f7724164640 1 --2- 172.21.15.98:0/339745123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f771c1082e0 0x7f771c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:36.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.348+0000 7f7724164640 1 --2- 172.21.15.98:0/339745123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f771c103760 0x7f771c107ba0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:36.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.348+0000 7f7724164640 1 --2- 172.21.15.98:0/339745123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771c102db0 0x7f771c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:36.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.348+0000 7f7724164640 1 -- 172.21.15.98:0/339745123 >> 172.21.15.98:0/339745123 conn(0x7f771c0fc7d0 msgr2=0x7f771c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:36.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.348+0000 7f7724164640 1 -- 172.21.15.98:0/339745123 shutdown_connections 2024-09-19T07:19:36.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.348+0000 7f7724164640 1 -- 172.21.15.98:0/339745123 wait complete. 2024-09-19T07:19:36.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.348+0000 7f7724164640 1 Processor -- start 2024-09-19T07:19:36.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.348+0000 7f7724164640 1 -- start start 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f7724164640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771c102db0 0x7f771c1a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f7724164640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f771c103760 0x7f771c1a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f7724164640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f771c1082e0 0x7f771c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f7724164640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f771c112050 con 0x7f771c103760 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f7724164640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f771c111ed0 con 0x7f771c1082e0 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f7724164640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1121d0 con 0x7f771c102db0 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f77216ff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f771c103760 0x7f771c1a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f77216ff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f771c103760 0x7f771c1a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56706/0 (socket says 172.21.15.98:56706) 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f77216ff640 1 -- 172.21.15.98:0/314018623 learned_addr learned my addr 172.21.15.98:0/314018623 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f7722701640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f771c1082e0 0x7f771c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f7721f00640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771c102db0 0x7f771c1a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f77216ff640 1 -- 172.21.15.98:0/314018623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771c102db0 msgr2=0x7f771c1a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:36.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f77216ff640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771c102db0 0x7f771c1a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:36.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f77216ff640 1 -- 172.21.15.98:0/314018623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f771c1082e0 msgr2=0x7f771c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:36.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f77216ff640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f771c1082e0 0x7f771c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:36.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f77216ff640 1 -- 172.21.15.98:0/314018623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c19acf0 con 0x7f771c103760 2024-09-19T07:19:36.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f7721f00640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771c102db0 0x7f771c1a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:19:36.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f77216ff640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f771c103760 0x7f771c1a0940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f770c005940 tx=0x7f770c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:36.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.349+0000 7f7712ffd640 1 -- 172.21.15.98:0/314018623 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c03f070 con 0x7f771c103760 2024-09-19T07:19:36.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.350+0000 7f7712ffd640 1 -- 172.21.15.98:0/314018623 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f770c031c30 con 0x7f771c103760 2024-09-19T07:19:36.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.350+0000 7f7724164640 1 -- 172.21.15.98:0/314018623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c19af80 con 0x7f771c103760 2024-09-19T07:19:36.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.350+0000 7f7712ffd640 1 -- 172.21.15.98:0/314018623 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c035030 con 0x7f771c103760 2024-09-19T07:19:36.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.350+0000 7f7724164640 1 -- 172.21.15.98:0/314018623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c1a72d0 con 0x7f771c103760 2024-09-19T07:19:36.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.351+0000 7f7724164640 1 -- 172.21.15.98:0/314018623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f771c103190 con 0x7f771c103760 2024-09-19T07:19:36.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.352+0000 7f7712ffd640 1 -- 172.21.15.98:0/314018623 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f770c042070 con 0x7f771c103760 2024-09-19T07:19:36.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.353+0000 7f7712ffd640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f77080a3240 0x7f77080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:36.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.353+0000 7f7721f00640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f77080a3240 0x7f77080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:36.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.353+0000 7f7712ffd640 1 -- 172.21.15.98:0/314018623 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f770c0efc60 con 0x7f771c103760 2024-09-19T07:19:36.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.353+0000 7f7721f00640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f77080a3240 0x7f77080a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7718005c40 tx=0x7f77180082f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:36.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.357+0000 7f7712ffd640 1 -- 172.21.15.98:0/314018623 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f770c031de0 con 0x7f771c103760 2024-09-19T07:19:36.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.522+0000 7f7724164640 1 -- 172.21.15.98:0/314018623 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f771c10c2d0 con 0x7f771c103760 2024-09-19T07:19:36.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.523+0000 7f7712ffd640 1 -- 172.21.15.98:0/314018623 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f770c0bce20 con 0x7f771c103760 2024-09-19T07:19:36.523 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2024-09-19T07:19:36.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.525+0000 7f7724164640 1 -- 172.21.15.98:0/314018623 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f77080a3240 msgr2=0x7f77080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:36.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.525+0000 7f7724164640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f77080a3240 0x7f77080a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7718005c40 tx=0x7f77180082f0 comp rx=0 tx=0).stop 2024-09-19T07:19:36.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.525+0000 7f7724164640 1 -- 172.21.15.98:0/314018623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f771c103760 msgr2=0x7f771c1a0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:36.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.525+0000 7f7724164640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f771c103760 0x7f771c1a0940 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f770c005940 tx=0x7f770c003c10 comp rx=0 tx=0).stop 2024-09-19T07:19:36.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.525+0000 7f7724164640 1 -- 172.21.15.98:0/314018623 shutdown_connections 2024-09-19T07:19:36.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.525+0000 7f7724164640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f77080a3240 0x7f77080a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:36.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.525+0000 7f7724164640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f771c1082e0 0x7f771c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:36.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.525+0000 7f7724164640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f771c103760 0x7f771c1a0940 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:36.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.525+0000 7f7724164640 1 --2- 172.21.15.98:0/314018623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f771c102db0 0x7f771c1a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:36.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.525+0000 7f7724164640 1 -- 172.21.15.98:0/314018623 >> 172.21.15.98:0/314018623 conn(0x7f771c0fc7d0 msgr2=0x7f771c101540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:36.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.525+0000 7f7724164640 1 -- 172.21.15.98:0/314018623 shutdown_connections 2024-09-19T07:19:36.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:36.525+0000 7f7724164640 1 -- 172.21.15.98:0/314018623 wait complete. 2024-09-19T07:19:36.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:36 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/314018623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:19:36.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:36 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/314018623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:19:37.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:36 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/314018623' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:19:37.202 INFO:tasks.cephadm:Adding mds.a on smithi098 2024-09-19T07:19:37.202 INFO:tasks.cephadm:Adding mds.d on smithi098 2024-09-19T07:19:37.202 INFO:tasks.cephadm:Adding mds.g on smithi098 2024-09-19T07:19:37.202 INFO:tasks.cephadm:Adding mds.j on smithi098 2024-09-19T07:19:37.202 INFO:tasks.cephadm:Adding mds.b on smithi139 2024-09-19T07:19:37.202 INFO:tasks.cephadm:Adding mds.e on smithi139 2024-09-19T07:19:37.202 INFO:tasks.cephadm:Adding mds.h on smithi139 2024-09-19T07:19:37.202 INFO:tasks.cephadm:Adding mds.k on smithi139 2024-09-19T07:19:37.202 INFO:tasks.cephadm:Adding mds.c on smithi162 2024-09-19T07:19:37.203 INFO:tasks.cephadm:Adding mds.f on smithi162 2024-09-19T07:19:37.203 INFO:tasks.cephadm:Adding mds.i on smithi162 2024-09-19T07:19:37.203 INFO:tasks.cephadm:Adding mds.l on smithi162 2024-09-19T07:19:37.203 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi098=a;smithi098=d;smithi098=g;smithi098=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l' 2024-09-19T07:19:37.464 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:19:37.836 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:37 smithi162 ceph-mon[35726]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:37.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.923+0000 7f105da8f640 1 -- 172.21.15.162:0/1005349550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10581026a0 msgr2=0x7f1058104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:37.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.923+0000 7f105da8f640 1 --2- 172.21.15.162:0/1005349550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10581026a0 0x7f1058104a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1048009900 tx=0x7f104802a410 comp rx=0 tx=0).stop 2024-09-19T07:19:37.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.923+0000 7f105da8f640 1 -- 172.21.15.162:0/1005349550 shutdown_connections 2024-09-19T07:19:37.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.924+0000 7f105da8f640 1 --2- 172.21.15.162:0/1005349550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1058107900 0x7f1058109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:37.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.924+0000 7f105da8f640 1 --2- 172.21.15.162:0/1005349550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1058104fd0 0x7f10581073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:37.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.924+0000 7f105da8f640 1 --2- 172.21.15.162:0/1005349550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10581026a0 0x7f1058104a90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:37.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.924+0000 7f105da8f640 1 -- 172.21.15.162:0/1005349550 >> 172.21.15.162:0/1005349550 conn(0x7f10580fc2a0 msgr2=0x7f10580fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:37.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.924+0000 7f105da8f640 1 -- 172.21.15.162:0/1005349550 shutdown_connections 2024-09-19T07:19:37.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.924+0000 7f105da8f640 1 -- 172.21.15.162:0/1005349550 wait complete. 2024-09-19T07:19:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.924+0000 7f105da8f640 1 Processor -- start 2024-09-19T07:19:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.924+0000 7f105da8f640 1 -- start start 2024-09-19T07:19:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.924+0000 7f105da8f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10581026a0 0x7f1058102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.924+0000 7f105da8f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1058104fd0 0x7f1058100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f105da8f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058107900 0x7f1058100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f105da8f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f105810d8b0 con 0x7f10581026a0 2024-09-19T07:19:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f105da8f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f105810d730 con 0x7f1058104fd0 2024-09-19T07:19:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f105da8f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f105810da30 con 0x7f1058107900 2024-09-19T07:19:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f1057fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058107900 0x7f1058100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f10577fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10581026a0 0x7f1058102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f1057fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058107900 0x7f1058100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44202/0 (socket says 172.21.15.162:44202) 2024-09-19T07:19:37.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f1057fff640 1 -- 172.21.15.162:0/242128224 learned_addr learned my addr 172.21.15.162:0/242128224 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T07:19:37.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f1056ffd640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1058104fd0 0x7f1058100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:37.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f1057fff640 1 -- 172.21.15.162:0/242128224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1058104fd0 msgr2=0x7f1058100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:37.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f1057fff640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1058104fd0 0x7f1058100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:37.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f1057fff640 1 -- 172.21.15.162:0/242128224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10581026a0 msgr2=0x7f1058102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:37.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f1057fff640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10581026a0 0x7f1058102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:37.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f1057fff640 1 -- 172.21.15.162:0/242128224 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1058101450 con 0x7f1058107900 2024-09-19T07:19:37.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f10577fe640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10581026a0 0x7f1058102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:19:37.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f1057fff640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058107900 0x7f1058100b90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f105000eb10 tx=0x7f105000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:37.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f1054ff9640 1 -- 172.21.15.162:0/242128224 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050004b20 con 0x7f1058107900 2024-09-19T07:19:37.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f1054ff9640 1 -- 172.21.15.162:0/242128224 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1050004cc0 con 0x7f1058107900 2024-09-19T07:19:37.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.925+0000 7f105da8f640 1 -- 172.21.15.162:0/242128224 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10581a20c0 con 0x7f1058107900 2024-09-19T07:19:37.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.926+0000 7f1054ff9640 1 -- 172.21.15.162:0/242128224 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050010760 con 0x7f1058107900 2024-09-19T07:19:37.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.926+0000 7f105da8f640 1 -- 172.21.15.162:0/242128224 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10581a25d0 con 0x7f1058107900 2024-09-19T07:19:37.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.927+0000 7f105da8f640 1 -- 172.21.15.162:0/242128224 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10581053b0 con 0x7f1058107900 2024-09-19T07:19:37.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.928+0000 7f1054ff9640 1 -- 172.21.15.162:0/242128224 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1050005020 con 0x7f1058107900 2024-09-19T07:19:37.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.929+0000 7f1054ff9640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a32c0 0x7f10400a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:37.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.929+0000 7f1054ff9640 1 -- 172.21.15.162:0/242128224 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f10500cf960 con 0x7f1058107900 2024-09-19T07:19:37.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.929+0000 7f10577fe640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a32c0 0x7f10400a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:37.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.929+0000 7f10577fe640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a32c0 0x7f10400a5780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f10480314e0 tx=0x7f1048000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:37.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:37.932+0000 7f1054ff9640 1 -- 172.21.15.162:0/242128224 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f105009ca80 con 0x7f1058107900 2024-09-19T07:19:38.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:37 smithi098 ceph-mon[30950]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:38.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:37 smithi139 ceph-mon[35039]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:38.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.113+0000 7f105da8f640 1 -- 172.21.15.162:0/242128224 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi098=a;smithi098=d;smithi098=g;smithi098=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}) -- 0x7f1058062830 con 0x7f10400a32c0 2024-09-19T07:19:38.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.120+0000 7f1054ff9640 1 -- 172.21.15.162:0/242128224 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f1058062830 con 0x7f10400a32c0 2024-09-19T07:19:38.120 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mds.all update... 2024-09-19T07:19:38.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.122+0000 7f105da8f640 1 -- 172.21.15.162:0/242128224 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a32c0 msgr2=0x7f10400a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:38.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.122+0000 7f105da8f640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a32c0 0x7f10400a5780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f10480314e0 tx=0x7f1048000bc0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.122+0000 7f105da8f640 1 -- 172.21.15.162:0/242128224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058107900 msgr2=0x7f1058100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:38.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.122+0000 7f105da8f640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058107900 0x7f1058100b90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f105000eb10 tx=0x7f105000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.122+0000 7f105da8f640 1 -- 172.21.15.162:0/242128224 shutdown_connections 2024-09-19T07:19:38.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.122+0000 7f105da8f640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a32c0 0x7f10400a5780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.122+0000 7f105da8f640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1058107900 0x7f1058100b90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.122+0000 7f105da8f640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1058104fd0 0x7f1058100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.122+0000 7f105da8f640 1 --2- 172.21.15.162:0/242128224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10581026a0 0x7f1058102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:38.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.123+0000 7f105da8f640 1 -- 172.21.15.162:0/242128224 >> 172.21.15.162:0/242128224 conn(0x7f10580fc2a0 msgr2=0x7f1058103080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:38.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.123+0000 7f105da8f640 1 -- 172.21.15.162:0/242128224 shutdown_connections 2024-09-19T07:19:38.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T07:19:38.123+0000 7f105da8f640 1 -- 172.21.15.162:0/242128224 wait complete. 2024-09-19T07:19:38.747 DEBUG:teuthology.orchestra.run.smithi098:mds.a> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T07:19:38.750 DEBUG:teuthology.orchestra.run.smithi098:mds.d> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T07:19:38.793 DEBUG:teuthology.orchestra.run.smithi098:mds.g> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T07:19:38.836 DEBUG:teuthology.orchestra.run.smithi098:mds.j> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T07:19:38.879 DEBUG:teuthology.orchestra.run.smithi139:mds.b> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T07:19:38.882 DEBUG:teuthology.orchestra.run.smithi139:mds.e> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T07:19:38.925 DEBUG:teuthology.orchestra.run.smithi139:mds.h> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T07:19:38.968 DEBUG:teuthology.orchestra.run.smithi139:mds.k> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T07:19:39.011 DEBUG:teuthology.orchestra.run.smithi162:mds.c> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T07:19:39.014 DEBUG:teuthology.orchestra.run.smithi162:mds.f> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T07:19:39.057 DEBUG:teuthology.orchestra.run.smithi162:mds.i> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T07:19:39.100 DEBUG:teuthology.orchestra.run.smithi162:mds.l> sudo journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T07:19:39.143 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T07:19:39.143 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:19:39.284 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:39 smithi162 ceph-mon[35726]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi098=a;smithi098=d;smithi098=g;smithi098=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:19:39.285 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:39 smithi162 ceph-mon[35726]: Saving service mds.all spec with placement smithi098=a;smithi098=d;smithi098=g;smithi098=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-19T07:19:39.285 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:39.285 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:39.285 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:39.285 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:39.285 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:39.285 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:39.285 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:39.285 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:39 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:39.285 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:39 smithi162 ceph-mon[35726]: Deploying daemon mds.l on smithi162 2024-09-19T07:19:39.285 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:39 smithi162 ceph-mon[35726]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:39 smithi139 ceph-mon[35039]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi098=a;smithi098=d;smithi098=g;smithi098=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:19:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:39 smithi139 ceph-mon[35039]: Saving service mds.all spec with placement smithi098=a;smithi098=d;smithi098=g;smithi098=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-19T07:19:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:39.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:39.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:39 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:39.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:39 smithi139 ceph-mon[35039]: Deploying daemon mds.l on smithi162 2024-09-19T07:19:39.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:39 smithi139 ceph-mon[35039]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:39.385 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:39.506 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:39 smithi098 ceph-mon[30950]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi098=a;smithi098=d;smithi098=g;smithi098=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:19:39.506 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:39 smithi098 ceph-mon[30950]: Saving service mds.all spec with placement smithi098=a;smithi098=d;smithi098=g;smithi098=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-19T07:19:39.506 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:39.507 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:19:39.507 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:39.507 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:19:39.507 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:39.507 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:39.507 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:39.507 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:39 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:39.507 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:39 smithi098 ceph-mon[30950]: Deploying daemon mds.l on smithi162 2024-09-19T07:19:39.507 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:39 smithi098 ceph-mon[30950]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:39.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.833+0000 7f3d99bcf640 1 -- 172.21.15.98:0/2797665738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d94101de0 msgr2=0x7f3d941021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.833+0000 7f3d99bcf640 1 --2- 172.21.15.98:0/2797665738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d94101de0 0x7f3d941021c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009900 tx=0x7f3d8402a410 comp rx=0 tx=0).stop 2024-09-19T07:19:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.833+0000 7f3d99bcf640 1 -- 172.21.15.98:0/2797665738 shutdown_connections 2024-09-19T07:19:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.833+0000 7f3d99bcf640 1 --2- 172.21.15.98:0/2797665738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d94106f10 0x7f3d9410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.833+0000 7f3d99bcf640 1 --2- 172.21.15.98:0/2797665738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d94102790 0x7f3d941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.833+0000 7f3d99bcf640 1 --2- 172.21.15.98:0/2797665738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d94101de0 0x7f3d941021c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.833+0000 7f3d99bcf640 1 -- 172.21.15.98:0/2797665738 >> 172.21.15.98:0/2797665738 conn(0x7f3d940fd8c0 msgr2=0x7f3d940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.833+0000 7f3d99bcf640 1 -- 172.21.15.98:0/2797665738 shutdown_connections 2024-09-19T07:19:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.833+0000 7f3d99bcf640 1 -- 172.21.15.98:0/2797665738 wait complete. 2024-09-19T07:19:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d99bcf640 1 Processor -- start 2024-09-19T07:19:39.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d99bcf640 1 -- start start 2024-09-19T07:19:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d99bcf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d94101de0 0x7f3d940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d99bcf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d94102790 0x7f3d94074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d99bcf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d94106f10 0x7f3d94074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d99bcf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d94111fb0 con 0x7f3d94101de0 2024-09-19T07:19:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d99bcf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3d94111e30 con 0x7f3d94106f10 2024-09-19T07:19:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d99bcf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3d94112130 con 0x7f3d94102790 2024-09-19T07:19:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d937fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d94101de0 0x7f3d940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d937fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d94101de0 0x7f3d940744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56732/0 (socket says 172.21.15.98:56732) 2024-09-19T07:19:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d937fe640 1 -- 172.21.15.98:0/1716789046 learned_addr learned my addr 172.21.15.98:0/1716789046 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:19:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d92ffd640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d94102790 0x7f3d94074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d93fff640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d94106f10 0x7f3d94074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:39.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d937fe640 1 -- 172.21.15.98:0/1716789046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d94102790 msgr2=0x7f3d94074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d937fe640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d94102790 0x7f3d94074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d937fe640 1 -- 172.21.15.98:0/1716789046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d94106f10 msgr2=0x7f3d94074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d937fe640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d94106f10 0x7f3d94074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.834+0000 7f3d937fe640 1 -- 172.21.15.98:0/1716789046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d941a69d0 con 0x7f3d94101de0 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.835+0000 7f3d937fe640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d94101de0 0x7f3d940744f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3d84006010 tx=0x7f3d840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.835+0000 7f3d90ff9640 1 -- 172.21.15.98:0/1716789046 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8403f030 con 0x7f3d94101de0 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.835+0000 7f3d90ff9640 1 -- 172.21.15.98:0/1716789046 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d84003ce0 con 0x7f3d94101de0 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.835+0000 7f3d99bcf640 1 -- 172.21.15.98:0/1716789046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d941a6c60 con 0x7f3d94101de0 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.835+0000 7f3d90ff9640 1 -- 172.21.15.98:0/1716789046 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84035070 con 0x7f3d94101de0 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.835+0000 7f3d99bcf640 1 -- 172.21.15.98:0/1716789046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d941a7190 con 0x7f3d94101de0 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.836+0000 7f3d99bcf640 1 -- 172.21.15.98:0/1716789046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d941021c0 con 0x7f3d94101de0 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.837+0000 7f3d90ff9640 1 -- 172.21.15.98:0/1716789046 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3d84042030 con 0x7f3d94101de0 2024-09-19T07:19:39.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.837+0000 7f3d90ff9640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f3d7c0a32c0 0x7f3d7c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:39.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.838+0000 7f3d92ffd640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f3d7c0a32c0 0x7f3d7c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:39.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.838+0000 7f3d90ff9640 1 -- 172.21.15.98:0/1716789046 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f3d840ef820 con 0x7f3d94101de0 2024-09-19T07:19:39.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.838+0000 7f3d92ffd640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f3d7c0a32c0 0x7f3d7c0a5780 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d94075f80 tx=0x7f3d88009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:39.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:39.842+0000 7f3d90ff9640 1 -- 172.21.15.98:0/1716789046 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3d840bc9e0 con 0x7f3d94101de0 2024-09-19T07:19:40.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.046+0000 7f3d99bcf640 1 -- 172.21.15.98:0/1716789046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d9410a0f0 con 0x7f3d94101de0 2024-09-19T07:19:40.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.046+0000 7f3d90ff9640 1 -- 172.21.15.98:0/1716789046 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f3d840bc2e0 con 0x7f3d94101de0 2024-09-19T07:19:40.047 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:19:40.047 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"btime":"2024-09-19T07:12:50:967629+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T07:19:40.047 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 1 2024-09-19T07:19:40.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.049+0000 7f3d99bcf640 1 -- 172.21.15.98:0/1716789046 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f3d7c0a32c0 msgr2=0x7f3d7c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:40.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.049+0000 7f3d99bcf640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f3d7c0a32c0 0x7f3d7c0a5780 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d94075f80 tx=0x7f3d88009110 comp rx=0 tx=0).stop 2024-09-19T07:19:40.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.049+0000 7f3d99bcf640 1 -- 172.21.15.98:0/1716789046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d94101de0 msgr2=0x7f3d940744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:40.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.049+0000 7f3d99bcf640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d94101de0 0x7f3d940744f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3d84006010 tx=0x7f3d840042f0 comp rx=0 tx=0).stop 2024-09-19T07:19:40.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.049+0000 7f3d99bcf640 1 -- 172.21.15.98:0/1716789046 shutdown_connections 2024-09-19T07:19:40.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.049+0000 7f3d99bcf640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f3d7c0a32c0 0x7f3d7c0a5780 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:40.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.049+0000 7f3d99bcf640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d94106f10 0x7f3d94074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:40.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.049+0000 7f3d99bcf640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d94102790 0x7f3d94074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:40.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.049+0000 7f3d99bcf640 1 --2- 172.21.15.98:0/1716789046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d94101de0 0x7f3d940744f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:40.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.049+0000 7f3d99bcf640 1 -- 172.21.15.98:0/1716789046 >> 172.21.15.98:0/1716789046 conn(0x7f3d940fd8c0 msgr2=0x7f3d940febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:40.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.049+0000 7f3d99bcf640 1 -- 172.21.15.98:0/1716789046 shutdown_connections 2024-09-19T07:19:40.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:40.049+0000 7f3d99bcf640 1 -- 172.21.15.98:0/1716789046 wait complete. 2024-09-19T07:19:40.491 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:19:40 smithi162 systemd[1]: Starting Ceph mds.l for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:19:40.760 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:40 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1716789046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:40.817 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:40 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1716789046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:40.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:40 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1716789046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:40.817 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:19:40 smithi162 podman[65169]: 2024-09-19 07:19:40.443749811 +0000 UTC m=+0.015818006 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:19:40.817 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:19:40 smithi162 podman[65169]: 2024-09-19 07:19:40.565238989 +0000 UTC m=+0.137307247 container create 19646953c402c364623f4b64c6f64fb411ba3a55d190bec720cdb7087be73d0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T07:19:40.817 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:19:40 smithi162 podman[65169]: 2024-09-19 07:19:40.817228538 +0000 UTC m=+0.389296723 container init 19646953c402c364623f4b64c6f64fb411ba3a55d190bec720cdb7087be73d0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T07:19:41.132 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:19:40 smithi162 podman[65169]: 2024-09-19 07:19:40.819989489 +0000 UTC m=+0.392057683 container start 19646953c402c364623f4b64c6f64fb411ba3a55d190bec720cdb7087be73d0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T07:19:41.132 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:19:40 smithi162 ceph-mds[65188]: -- 172.21.15.162:0/554910081 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d38d9ad860 con 0x55d38d98b000 2024-09-19T07:19:41.132 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:19:40 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-l[65184]: starting mds.l at 2024-09-19T07:19:41.132 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:19:40 smithi162 bash[65169]: 19646953c402c364623f4b64c6f64fb411ba3a55d190bec720cdb7087be73d0b 2024-09-19T07:19:41.132 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:19:40 smithi162 systemd[1]: Started Ceph mds.l for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:19:41.684 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:41 smithi139 ceph-mon[35039]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:41.685 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:41 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.162:6832/1643362672,v1:172.21.15.162:6833/1643362672] up:boot 2024-09-19T07:19:41.685 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:41 smithi139 ceph-mon[35039]: fsmap 1 up:standby 2024-09-19T07:19:41.685 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:41 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:19:41.685 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:41 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:41.685 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:41 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:41.685 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:41 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:41.685 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:41 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:41.685 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:41 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:41.685 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:41 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:41.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:41 smithi098 ceph-mon[30950]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:41.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:41 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.162:6832/1643362672,v1:172.21.15.162:6833/1643362672] up:boot 2024-09-19T07:19:41.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:41 smithi098 ceph-mon[30950]: fsmap 1 up:standby 2024-09-19T07:19:41.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:41 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:19:41.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:41 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:41.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:41 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:41.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:41 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:41.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:41 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:41.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:41 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:41.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:41 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:41.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:41 smithi162 ceph-mon[35726]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:41.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:41 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.162:6832/1643362672,v1:172.21.15.162:6833/1643362672] up:boot 2024-09-19T07:19:41.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:41 smithi162 ceph-mon[35726]: fsmap 1 up:standby 2024-09-19T07:19:41.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:41 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:19:41.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:41 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:41.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:41 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:41.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:41 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:41.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:41 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:41.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:41 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:41.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:41 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:42.655 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:42 smithi139 ceph-mon[35039]: Deploying daemon mds.k on smithi139 2024-09-19T07:19:42.762 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:19:42.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:42 smithi098 ceph-mon[30950]: Deploying daemon mds.k on smithi139 2024-09-19T07:19:42.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:42 smithi162 ceph-mon[35726]: Deploying daemon mds.k on smithi139 2024-09-19T07:19:43.018 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:43.045 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:19:42 smithi139 systemd[1]: Starting Ceph mds.k for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:19:43.316 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:19:43 smithi139 podman[64498]: 2024-09-19 07:19:43.045588213 +0000 UTC m=+0.107999966 container create 69de78d0610fcaefcd677bae0fc12835f093c12ccd97db18701c6dd73933d616 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T07:19:43.316 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:19:43 smithi139 podman[64498]: 2024-09-19 07:19:42.953103725 +0000 UTC m=+0.015515497 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:19:43.316 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:19:43 smithi139 podman[64498]: 2024-09-19 07:19:43.289476746 +0000 UTC m=+0.351888504 container init 69de78d0610fcaefcd677bae0fc12835f093c12ccd97db18701c6dd73933d616 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T07:19:43.316 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:19:43 smithi139 podman[64498]: 2024-09-19 07:19:43.292343044 +0000 UTC m=+0.354754797 container start 69de78d0610fcaefcd677bae0fc12835f093c12ccd97db18701c6dd73933d616 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-k, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T07:19:43.316 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:19:43 smithi139 ceph-mds[64517]: -- 172.21.15.139:0/531776653 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56504e4dd860 con 0x56504e4bb000 2024-09-19T07:19:43.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.467+0000 7f7e0d47b640 1 -- 172.21.15.98:0/1068843375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e08102ef0 msgr2=0x7f7e0810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:43.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.467+0000 7f7e0d47b640 1 --2- 172.21.15.98:0/1068843375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e08102ef0 0x7f7e0810da40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009ca0 tx=0x7f7e0002a950 comp rx=0 tx=0).stop 2024-09-19T07:19:43.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.467+0000 7f7e0d47b640 1 -- 172.21.15.98:0/1068843375 shutdown_connections 2024-09-19T07:19:43.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.467+0000 7f7e0d47b640 1 --2- 172.21.15.98:0/1068843375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e08102ef0 0x7f7e0810da40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:43.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.467+0000 7f7e0d47b640 1 --2- 172.21.15.98:0/1068843375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08102570 0x7f7e081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:43.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.467+0000 7f7e0d47b640 1 --2- 172.21.15.98:0/1068843375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e08100e20 0x7f7e08101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:43.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.467+0000 7f7e0d47b640 1 -- 172.21.15.98:0/1068843375 >> 172.21.15.98:0/1068843375 conn(0x7f7e080fc7d0 msgr2=0x7f7e080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:43.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.467+0000 7f7e0d47b640 1 -- 172.21.15.98:0/1068843375 shutdown_connections 2024-09-19T07:19:43.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.467+0000 7f7e0d47b640 1 -- 172.21.15.98:0/1068843375 wait complete. 2024-09-19T07:19:43.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.468+0000 7f7e0d47b640 1 Processor -- start 2024-09-19T07:19:43.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.468+0000 7f7e0d47b640 1 -- start start 2024-09-19T07:19:43.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.468+0000 7f7e0d47b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e08100e20 0x7f7e081992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:43.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.468+0000 7f7e0d47b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e08102570 0x7f7e081997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:43.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.468+0000 7f7e0d47b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08102ef0 0x7f7e081a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:43.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.468+0000 7f7e0d47b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e08110f80 con 0x7f7e08102570 2024-09-19T07:19:43.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.468+0000 7f7e0d47b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7e08110e00 con 0x7f7e08100e20 2024-09-19T07:19:43.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.468+0000 7f7e0d47b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e08111100 con 0x7f7e08102ef0 2024-09-19T07:19:43.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e067fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e08102570 0x7f7e081997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:43.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e067fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e08102570 0x7f7e081997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44030/0 (socket says 172.21.15.98:44030) 2024-09-19T07:19:43.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e067fc640 1 -- 172.21.15.98:0/3121720683 learned_addr learned my addr 172.21.15.98:0/3121720683 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:19:43.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e06ffd640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e08100e20 0x7f7e081992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:43.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e077fe640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08102ef0 0x7f7e081a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:43.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e067fc640 1 -- 172.21.15.98:0/3121720683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08102ef0 msgr2=0x7f7e081a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:43.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e067fc640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08102ef0 0x7f7e081a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:43.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e067fc640 1 -- 172.21.15.98:0/3121720683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e08100e20 msgr2=0x7f7e081992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:43.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e067fc640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e08100e20 0x7f7e081992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:43.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e067fc640 1 -- 172.21.15.98:0/3121720683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e081a4870 con 0x7f7e08102570 2024-09-19T07:19:43.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e067fc640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e08102570 0x7f7e081997f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00d950 tx=0x7f7dfc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:43.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7deffff640 1 -- 172.21.15.98:0/3121720683 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc017030 con 0x7f7e08102570 2024-09-19T07:19:43.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7deffff640 1 -- 172.21.15.98:0/3121720683 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dfc004020 con 0x7f7e08102570 2024-09-19T07:19:43.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7deffff640 1 -- 172.21.15.98:0/3121720683 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc0047a0 con 0x7f7e08102570 2024-09-19T07:19:43.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e0d47b640 1 -- 172.21.15.98:0/3121720683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e081a4a40 con 0x7f7e08102570 2024-09-19T07:19:43.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.469+0000 7f7e0d47b640 1 -- 172.21.15.98:0/3121720683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e081a4f00 con 0x7f7e08102570 2024-09-19T07:19:43.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.471+0000 7f7e0d47b640 1 -- 172.21.15.98:0/3121720683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e08101200 con 0x7f7e08102570 2024-09-19T07:19:43.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.472+0000 7f7deffff640 1 -- 172.21.15.98:0/3121720683 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7dfc0041d0 con 0x7f7e08102570 2024-09-19T07:19:43.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.473+0000 7f7deffff640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7df00a3240 0x7f7df00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:43.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.473+0000 7f7e06ffd640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7df00a3240 0x7f7df00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:43.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.473+0000 7f7deffff640 1 -- 172.21.15.98:0/3121720683 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f7dfc0cedf0 con 0x7f7e08102570 2024-09-19T07:19:43.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.473+0000 7f7e06ffd640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7df00a3240 0x7f7df00a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7df8005d00 tx=0x7f7df800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:43.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.477+0000 7f7deffff640 1 -- 172.21.15.98:0/3121720683 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7dfc09bfb0 con 0x7f7e08102570 2024-09-19T07:19:43.567 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:19:43 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-k[64513]: starting mds.k at 2024-09-19T07:19:43.567 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:19:43 smithi139 bash[64498]: 69de78d0610fcaefcd677bae0fc12835f093c12ccd97db18701c6dd73933d616 2024-09-19T07:19:43.567 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:19:43 smithi139 systemd[1]: Started Ceph mds.k for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:19:43.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:43 smithi139 ceph-mon[35039]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:43.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:43.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:43.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:43.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:43.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:43.569 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:43 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:43.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.683+0000 7f7e0d47b640 1 -- 172.21.15.98:0/3121720683 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e081a51f0 con 0x7f7e08102570 2024-09-19T07:19:43.684 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:43 smithi098 ceph-mon[30950]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:43.684 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:43.684 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:43.684 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:43.684 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:43.684 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:43.684 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:43 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:43.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.683+0000 7f7deffff640 1 -- 172.21.15.98:0/3121720683 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f7dfc0ce8f0 con 0x7f7e08102570 2024-09-19T07:19:43.685 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:19:43.685 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":3,"btime":"2024-09-19T07:19:43:499104+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T07:19:43.686 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 3 2024-09-19T07:19:43.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.687+0000 7f7e0d47b640 1 -- 172.21.15.98:0/3121720683 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7df00a3240 msgr2=0x7f7df00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:43.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.687+0000 7f7e0d47b640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7df00a3240 0x7f7df00a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7df8005d00 tx=0x7f7df800b410 comp rx=0 tx=0).stop 2024-09-19T07:19:43.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.687+0000 7f7e0d47b640 1 -- 172.21.15.98:0/3121720683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e08102570 msgr2=0x7f7e081997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:43.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.687+0000 7f7e0d47b640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e08102570 0x7f7e081997f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00d950 tx=0x7f7dfc00de10 comp rx=0 tx=0).stop 2024-09-19T07:19:43.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.687+0000 7f7e0d47b640 1 -- 172.21.15.98:0/3121720683 shutdown_connections 2024-09-19T07:19:43.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.687+0000 7f7e0d47b640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7df00a3240 0x7f7df00a5700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:43.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.687+0000 7f7e0d47b640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e08102ef0 0x7f7e081a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:43.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.687+0000 7f7e0d47b640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e08102570 0x7f7e081997f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:43.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.687+0000 7f7e0d47b640 1 --2- 172.21.15.98:0/3121720683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e08100e20 0x7f7e081992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:43.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.687+0000 7f7e0d47b640 1 -- 172.21.15.98:0/3121720683 >> 172.21.15.98:0/3121720683 conn(0x7f7e080fc7d0 msgr2=0x7f7e08106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:43.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.687+0000 7f7e0d47b640 1 -- 172.21.15.98:0/3121720683 shutdown_connections 2024-09-19T07:19:43.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:43.687+0000 7f7e0d47b640 1 -- 172.21.15.98:0/3121720683 wait complete. 2024-09-19T07:19:43.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:43 smithi162 ceph-mon[35726]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:43.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:43.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:43.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:43.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:43.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:43.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:43 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:44.712 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:44 smithi139 ceph-mon[35039]: Deploying daemon mds.j on smithi098 2024-09-19T07:19:44.712 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:44 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.139:6832/587476912,v1:172.21.15.139:6833/587476912] up:boot 2024-09-19T07:19:44.713 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:44 smithi139 ceph-mon[35039]: fsmap 2 up:standby 2024-09-19T07:19:44.713 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:44 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:19:44.713 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:44 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3121720683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:44.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:44 smithi098 ceph-mon[30950]: Deploying daemon mds.j on smithi098 2024-09-19T07:19:44.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:44 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.139:6832/587476912,v1:172.21.15.139:6833/587476912] up:boot 2024-09-19T07:19:44.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:44 smithi098 ceph-mon[30950]: fsmap 2 up:standby 2024-09-19T07:19:44.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:44 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:19:44.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:44 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3121720683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:44.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:44 smithi162 ceph-mon[35726]: Deploying daemon mds.j on smithi098 2024-09-19T07:19:44.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:44 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.139:6832/587476912,v1:172.21.15.139:6833/587476912] up:boot 2024-09-19T07:19:44.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:44 smithi162 ceph-mon[35726]: fsmap 2 up:standby 2024-09-19T07:19:44.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:44 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:19:44.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:44 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3121720683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:45.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:45 smithi098 ceph-mon[30950]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:45.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:45 smithi139 ceph-mon[35039]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:45.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:45 smithi162 ceph-mon[35726]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:46.176 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:19:45 smithi098 systemd[1]: Starting Ceph mds.j for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:19:46.403 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:19:46.427 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:19:46 smithi098 podman[69724]: 2024-09-19 07:19:46.176770101 +0000 UTC m=+0.110676822 container create 1dbde68a8eb5a48e64d7d8fee2cd7903a232099edddd85688d2948236589227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T07:19:46.427 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:19:46 smithi098 podman[69724]: 2024-09-19 07:19:46.082090249 +0000 UTC m=+0.015996984 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:19:46.428 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:19:46 smithi098 podman[69724]: 2024-09-19 07:19:46.379590679 +0000 UTC m=+0.313497409 container init 1dbde68a8eb5a48e64d7d8fee2cd7903a232099edddd85688d2948236589227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:19:46.428 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:19:46 smithi098 podman[69724]: 2024-09-19 07:19:46.382331894 +0000 UTC m=+0.316238626 container start 1dbde68a8eb5a48e64d7d8fee2cd7903a232099edddd85688d2948236589227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T07:19:46.428 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:19:46 smithi098 ceph-mds[69744]: -- 172.21.15.98:0/2239315276 <== mon.0 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d3825b3860 con 0x55d382591000 2024-09-19T07:19:46.428 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:19:46 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-j[69740]: starting mds.j at 2024-09-19T07:19:46.674 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:46.773 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:19:46 smithi098 bash[69724]: 1dbde68a8eb5a48e64d7d8fee2cd7903a232099edddd85688d2948236589227b 2024-09-19T07:19:46.773 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:19:46 smithi098 systemd[1]: Started Ceph mds.j for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:19:47.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.206+0000 7f12921a4640 1 -- 172.21.15.98:0/1011532946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f128c1036e0 msgr2=0x7f128c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:47.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.206+0000 7f12921a4640 1 --2- 172.21.15.98:0/1011532946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f128c1036e0 0x7f128c107b90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1280009930 tx=0x7f128002a440 comp rx=0 tx=0).stop 2024-09-19T07:19:47.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.206+0000 7f12921a4640 1 -- 172.21.15.98:0/1011532946 shutdown_connections 2024-09-19T07:19:47.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.206+0000 7f12921a4640 1 --2- 172.21.15.98:0/1011532946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f128c1082a0 0x7f128c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:47.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.206+0000 7f12921a4640 1 --2- 172.21.15.98:0/1011532946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f128c1036e0 0x7f128c107b90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.206+0000 7f12921a4640 1 --2- 172.21.15.98:0/1011532946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f128c102d30 0x7f128c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.206+0000 7f12921a4640 1 -- 172.21.15.98:0/1011532946 >> 172.21.15.98:0/1011532946 conn(0x7f128c0fc7d0 msgr2=0x7f128c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.206+0000 7f12921a4640 1 -- 172.21.15.98:0/1011532946 shutdown_connections 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.206+0000 7f12921a4640 1 -- 172.21.15.98:0/1011532946 wait complete. 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.207+0000 7f12921a4640 1 Processor -- start 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.207+0000 7f12921a4640 1 -- start start 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.207+0000 7f12921a4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f128c102d30 0x7f128c198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.207+0000 7f12921a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f128c1036e0 0x7f128c198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.207+0000 7f12921a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f128c1082a0 0x7f128c19cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.207+0000 7f12921a4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f128c112160 con 0x7f128c102d30 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.207+0000 7f12921a4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f128c111fe0 con 0x7f128c1036e0 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.207+0000 7f12921a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f128c1122e0 con 0x7f128c1082a0 2024-09-19T07:19:47.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.207+0000 7f128b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f128c102d30 0x7f128c198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f128b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f128c102d30 0x7f128c198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44052/0 (socket says 172.21.15.98:44052) 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f128b7fe640 1 -- 172.21.15.98:0/2184351492 learned_addr learned my addr 172.21.15.98:0/2184351492 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f128b7fe640 1 -- 172.21.15.98:0/2184351492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f128c1082a0 msgr2=0x7f128c19cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f128b7fe640 1 --2- 172.21.15.98:0/2184351492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f128c1082a0 0x7f128c19cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f128b7fe640 1 -- 172.21.15.98:0/2184351492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f128c1036e0 msgr2=0x7f128c198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f128b7fe640 1 --2- 172.21.15.98:0/2184351492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f128c1036e0 0x7f128c198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f128b7fe640 1 -- 172.21.15.98:0/2184351492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128c19d6d0 con 0x7f128c102d30 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f128b7fe640 1 --2- 172.21.15.98:0/2184351492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f128c102d30 0x7f128c198720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f127c00b450 tx=0x7f127c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f1288ff9640 1 -- 172.21.15.98:0/2184351492 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c015020 con 0x7f128c102d30 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f12921a4640 1 -- 172.21.15.98:0/2184351492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128c19d9c0 con 0x7f128c102d30 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f1288ff9640 1 -- 172.21.15.98:0/2184351492 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f127c011d70 con 0x7f128c102d30 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f1288ff9640 1 -- 172.21.15.98:0/2184351492 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c00f340 con 0x7f128c102d30 2024-09-19T07:19:47.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.208+0000 7f12921a4640 1 -- 172.21.15.98:0/2184351492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f128c1a52a0 con 0x7f128c102d30 2024-09-19T07:19:47.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.209+0000 7f12921a4640 1 -- 172.21.15.98:0/2184351492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f128c06a850 con 0x7f128c102d30 2024-09-19T07:19:47.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.210+0000 7f1288ff9640 1 -- 172.21.15.98:0/2184351492 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f127c018020 con 0x7f128c102d30 2024-09-19T07:19:47.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.211+0000 7f1288ff9640 1 --2- 172.21.15.98:0/2184351492 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f12740a3240 0x7f12740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:47.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.211+0000 7f128affd640 1 --2- 172.21.15.98:0/2184351492 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f12740a3240 0x7f12740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:47.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.212+0000 7f1288ff9640 1 -- 172.21.15.98:0/2184351492 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f127c0ceff0 con 0x7f128c102d30 2024-09-19T07:19:47.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.212+0000 7f128affd640 1 --2- 172.21.15.98:0/2184351492 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f12740a3240 0x7f12740a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f128002a960 tx=0x7f1280000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:47.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.216+0000 7f1288ff9640 1 -- 172.21.15.98:0/2184351492 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f127c01f020 con 0x7f128c102d30 2024-09-19T07:19:47.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.427+0000 7f12921a4640 1 -- 172.21.15.98:0/2184351492 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f128c10a2b0 con 0x7f128c102d30 2024-09-19T07:19:47.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.427+0000 7f1288ff9640 1 -- 172.21.15.98:0/2184351492 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f127c00d040 con 0x7f128c102d30 2024-09-19T07:19:47.429 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:19:47.429 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":4,"btime":"2024-09-19T07:19:46:512531+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T07:19:47.429 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 4 2024-09-19T07:19:47.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.429+0000 7f12921a4640 1 -- 172.21.15.98:0/2184351492 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f12740a3240 msgr2=0x7f12740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:47.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.429+0000 7f12921a4640 1 --2- 172.21.15.98:0/2184351492 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f12740a3240 0x7f12740a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f128002a960 tx=0x7f1280000bc0 comp rx=0 tx=0).stop 2024-09-19T07:19:47.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.429+0000 7f12921a4640 1 -- 172.21.15.98:0/2184351492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f128c102d30 msgr2=0x7f128c198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:47.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.429+0000 7f12921a4640 1 --2- 172.21.15.98:0/2184351492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f128c102d30 0x7f128c198720 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f127c00b450 tx=0x7f127c00b910 comp rx=0 tx=0).stop 2024-09-19T07:19:47.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.430+0000 7f12921a4640 1 -- 172.21.15.98:0/2184351492 shutdown_connections 2024-09-19T07:19:47.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.430+0000 7f12921a4640 1 --2- 172.21.15.98:0/2184351492 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f12740a3240 0x7f12740a5700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:47.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.430+0000 7f12921a4640 1 --2- 172.21.15.98:0/2184351492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f128c1082a0 0x7f128c19cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:47.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.430+0000 7f12921a4640 1 --2- 172.21.15.98:0/2184351492 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f128c1036e0 0x7f128c198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:47.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.430+0000 7f12921a4640 1 --2- 172.21.15.98:0/2184351492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f128c102d30 0x7f128c198720 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:47.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.430+0000 7f12921a4640 1 -- 172.21.15.98:0/2184351492 >> 172.21.15.98:0/2184351492 conn(0x7f128c0fc7d0 msgr2=0x7f128c105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:47.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.430+0000 7f12921a4640 1 -- 172.21.15.98:0/2184351492 shutdown_connections 2024-09-19T07:19:47.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:47.430+0000 7f12921a4640 1 -- 172.21.15.98:0/2184351492 wait complete. 2024-09-19T07:19:47.746 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:47 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.98:6834/181693932,v1:172.21.15.98:6835/181693932] up:boot 2024-09-19T07:19:47.746 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:47 smithi098 ceph-mon[30950]: fsmap 3 up:standby 2024-09-19T07:19:47.747 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:47 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:19:47.747 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:47 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:47.747 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:47 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:47.747 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:47 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:47.747 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:47 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:47.747 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:47 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:47.747 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:47 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:47.747 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:47 smithi098 ceph-mon[30950]: Deploying daemon mds.d on smithi098 2024-09-19T07:19:47.747 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:47 smithi098 ceph-mon[30950]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:47.747 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:47 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2184351492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:47.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:47 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.98:6834/181693932,v1:172.21.15.98:6835/181693932] up:boot 2024-09-19T07:19:47.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:47 smithi139 ceph-mon[35039]: fsmap 3 up:standby 2024-09-19T07:19:47.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:47 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:19:47.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:47 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:47.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:47 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:47.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:47 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:47.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:47 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:47.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:47 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:47.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:47 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:47.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:47 smithi139 ceph-mon[35039]: Deploying daemon mds.d on smithi098 2024-09-19T07:19:47.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:47 smithi139 ceph-mon[35039]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:47.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:47 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2184351492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:47.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:47 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.98:6834/181693932,v1:172.21.15.98:6835/181693932] up:boot 2024-09-19T07:19:47.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:47 smithi162 ceph-mon[35726]: fsmap 3 up:standby 2024-09-19T07:19:47.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:47 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:19:47.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:47 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:47.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:47 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:47.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:47 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:47.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:47 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:47.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:47 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:47.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:47 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:47.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:47 smithi162 ceph-mon[35726]: Deploying daemon mds.d on smithi098 2024-09-19T07:19:47.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:47 smithi162 ceph-mon[35726]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:47.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:47 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2184351492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:49.523 INFO:journalctl@ceph.mds.d.smithi098.stdout:Sep 19 07:19:49 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-d[70157]: starting mds.d at 2024-09-19T07:19:50.023 INFO:journalctl@ceph.mds.d.smithi098.stdout:Sep 19 07:19:49 smithi098 bash[70142]: 2fe97c96888ab396ae4ecda1fa5c15e9f7a4e12e6d3237023cb603df35c630e0 2024-09-19T07:19:50.023 INFO:journalctl@ceph.mds.d.smithi098.stdout:Sep 19 07:19:49 smithi098 systemd[1]: Started Ceph mds.d for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:19:50.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:49 smithi098 ceph-mon[30950]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:50.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:50.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:50.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:50.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:50.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:50.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:49 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:50.038 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:49 smithi139 ceph-mon[35039]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:50.038 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:50.038 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:50.038 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:50.038 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:50.038 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:50.038 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:49 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:49 smithi162 ceph-mon[35726]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:50.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:50.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:50.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:49 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:51.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:50 smithi098 ceph-mon[30950]: Deploying daemon mds.e on smithi139 2024-09-19T07:19:51.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:50 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.98:6836/2912813887,v1:172.21.15.98:6837/2912813887] up:boot 2024-09-19T07:19:51.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:50 smithi098 ceph-mon[30950]: fsmap 4 up:standby 2024-09-19T07:19:51.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:50 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:19:51.054 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:19:51.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:50 smithi139 ceph-mon[35039]: Deploying daemon mds.e on smithi139 2024-09-19T07:19:51.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:50 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.98:6836/2912813887,v1:172.21.15.98:6837/2912813887] up:boot 2024-09-19T07:19:51.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:50 smithi139 ceph-mon[35039]: fsmap 4 up:standby 2024-09-19T07:19:51.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:50 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:19:51.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:50 smithi162 ceph-mon[35726]: Deploying daemon mds.e on smithi139 2024-09-19T07:19:51.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:50 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.98:6836/2912813887,v1:172.21.15.98:6837/2912813887] up:boot 2024-09-19T07:19:51.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:50 smithi162 ceph-mon[35726]: fsmap 4 up:standby 2024-09-19T07:19:51.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:50 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:19:51.317 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:51.713 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:19:51 smithi139 systemd[1]: Starting Ceph mds.e for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:19:51.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.801+0000 7ff1b01c4640 1 -- 172.21.15.98:0/3699637560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a8106f10 msgr2=0x7ff1a810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:51.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.801+0000 7ff1b01c4640 1 --2- 172.21.15.98:0/3699637560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a8106f10 0x7ff1a810ea90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009ca0 tx=0x7ff1a002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.801+0000 7ff1b01c4640 1 -- 172.21.15.98:0/3699637560 shutdown_connections 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.801+0000 7ff1b01c4640 1 --2- 172.21.15.98:0/3699637560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a8106f10 0x7ff1a810ea90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.801+0000 7ff1b01c4640 1 --2- 172.21.15.98:0/3699637560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a8102790 0x7ff1a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.801+0000 7ff1b01c4640 1 --2- 172.21.15.98:0/3699637560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a8101de0 0x7ff1a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.801+0000 7ff1b01c4640 1 -- 172.21.15.98:0/3699637560 >> 172.21.15.98:0/3699637560 conn(0x7ff1a80fd8c0 msgr2=0x7ff1a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.801+0000 7ff1b01c4640 1 -- 172.21.15.98:0/3699637560 shutdown_connections 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.801+0000 7ff1b01c4640 1 -- 172.21.15.98:0/3699637560 wait complete. 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1b01c4640 1 Processor -- start 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1b01c4640 1 -- start start 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1b01c4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a8101de0 0x7ff1a8198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1b01c4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a8102790 0x7ff1a8198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1b01c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a8106f10 0x7ff1a819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:51.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1b01c4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a8111f70 con 0x7ff1a8102790 2024-09-19T07:19:51.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1b01c4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a8111df0 con 0x7ff1a8101de0 2024-09-19T07:19:51.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1b01c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a81120f0 con 0x7ff1a8106f10 2024-09-19T07:19:51.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1ad75f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a8102790 0x7ff1a8198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:51.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1ad75f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a8102790 0x7ff1a8198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44090/0 (socket says 172.21.15.98:44090) 2024-09-19T07:19:51.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1ad75f640 1 -- 172.21.15.98:0/942662476 learned_addr learned my addr 172.21.15.98:0/942662476 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:19:51.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1ad75f640 1 -- 172.21.15.98:0/942662476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a8106f10 msgr2=0x7ff1a819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:51.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1ad75f640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a8106f10 0x7ff1a819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:51.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1ad75f640 1 -- 172.21.15.98:0/942662476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a8101de0 msgr2=0x7ff1a8198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:51.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1adf60640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a8101de0 0x7ff1a8198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:51.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1ad75f640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a8101de0 0x7ff1a8198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:51.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1ad75f640 1 -- 172.21.15.98:0/942662476 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a819d2e0 con 0x7ff1a8102790 2024-09-19T07:19:51.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.802+0000 7ff1ad75f640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a8102790 0x7ff1a8198870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff19800c890 tx=0x7ff19800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:51.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.803+0000 7ff19effd640 1 -- 172.21.15.98:0/942662476 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198004220 con 0x7ff1a8102790 2024-09-19T07:19:51.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.803+0000 7ff19effd640 1 -- 172.21.15.98:0/942662476 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1980043c0 con 0x7ff1a8102790 2024-09-19T07:19:51.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.803+0000 7ff1b01c4640 1 -- 172.21.15.98:0/942662476 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a819d5d0 con 0x7ff1a8102790 2024-09-19T07:19:51.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.803+0000 7ff19effd640 1 -- 172.21.15.98:0/942662476 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1980049e0 con 0x7ff1a8102790 2024-09-19T07:19:51.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.803+0000 7ff1b01c4640 1 -- 172.21.15.98:0/942662476 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a81a4eb0 con 0x7ff1a8102790 2024-09-19T07:19:51.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.804+0000 7ff1b01c4640 1 -- 172.21.15.98:0/942662476 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a81021c0 con 0x7ff1a8102790 2024-09-19T07:19:51.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.805+0000 7ff19effd640 1 -- 172.21.15.98:0/942662476 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff1980079b0 con 0x7ff1a8102790 2024-09-19T07:19:51.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.805+0000 7ff19effd640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff1940a3240 0x7ff1940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:51.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.805+0000 7ff1adf60640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff1940a3240 0x7ff1940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:51.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.806+0000 7ff19effd640 1 -- 172.21.15.98:0/942662476 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff1980cf520 con 0x7ff1a8102790 2024-09-19T07:19:51.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.806+0000 7ff1adf60640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff1940a3240 0x7ff1940a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400ba40 tx=0x7ff1a4005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:51.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:51.810+0000 7ff19effd640 1 -- 172.21.15.98:0/942662476 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff198014030 con 0x7ff1a8102790 2024-09-19T07:19:51.975 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:51 smithi139 ceph-mon[35039]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:51.975 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:19:51 smithi139 podman[64807]: 2024-09-19 07:19:51.64137659 +0000 UTC m=+0.015841924 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:19:51.975 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:19:51 smithi139 podman[64807]: 2024-09-19 07:19:51.756068194 +0000 UTC m=+0.130533529 container create 415d2f182a9206fd9f006559d35f61da4ab29138be47b9aad0f8ee8adfd956df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T07:19:51.975 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:19:51 smithi139 podman[64807]: 2024-09-19 07:19:51.975451243 +0000 UTC m=+0.349916604 container init 415d2f182a9206fd9f006559d35f61da4ab29138be47b9aad0f8ee8adfd956df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:19:52.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.010+0000 7ff1b01c4640 1 -- 172.21.15.98:0/942662476 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1a802d7c0 con 0x7ff1a8102790 2024-09-19T07:19:52.011 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:51 smithi098 ceph-mon[30950]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:52.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.011+0000 7ff19effd640 1 -- 172.21.15.98:0/942662476 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7ff19809c6e0 con 0x7ff1a8102790 2024-09-19T07:19:52.012 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:19:52.012 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":5,"btime":"2024-09-19T07:19:49:695990+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T07:19:52.012 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 5 2024-09-19T07:19:52.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.013+0000 7ff1b01c4640 1 -- 172.21.15.98:0/942662476 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff1940a3240 msgr2=0x7ff1940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.013+0000 7ff1b01c4640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff1940a3240 0x7ff1940a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400ba40 tx=0x7ff1a4005cc0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.013+0000 7ff1b01c4640 1 -- 172.21.15.98:0/942662476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a8102790 msgr2=0x7ff1a8198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.013+0000 7ff1b01c4640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a8102790 0x7ff1a8198870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff19800c890 tx=0x7ff19800cd50 comp rx=0 tx=0).stop 2024-09-19T07:19:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.013+0000 7ff1b01c4640 1 -- 172.21.15.98:0/942662476 shutdown_connections 2024-09-19T07:19:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.013+0000 7ff1b01c4640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff1940a3240 0x7ff1940a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.013+0000 7ff1b01c4640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a8106f10 0x7ff1a819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.013+0000 7ff1b01c4640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1a8102790 0x7ff1a8198870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.013+0000 7ff1b01c4640 1 --2- 172.21.15.98:0/942662476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff1a8101de0 0x7ff1a8198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.013+0000 7ff1b01c4640 1 -- 172.21.15.98:0/942662476 >> 172.21.15.98:0/942662476 conn(0x7ff1a80fd8c0 msgr2=0x7ff1a80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.013+0000 7ff1b01c4640 1 -- 172.21.15.98:0/942662476 shutdown_connections 2024-09-19T07:19:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:52.013+0000 7ff1b01c4640 1 -- 172.21.15.98:0/942662476 wait complete. 2024-09-19T07:19:52.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:51 smithi162 ceph-mon[35726]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:52.316 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:19:51 smithi139 podman[64807]: 2024-09-19 07:19:51.978395694 +0000 UTC m=+0.352861037 container start 415d2f182a9206fd9f006559d35f61da4ab29138be47b9aad0f8ee8adfd956df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True) 2024-09-19T07:19:52.317 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:19:52 smithi139 ceph-mds[64826]: -- 172.21.15.139:0/1904536904 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560f1fd65860 con 0x560f1fd42800 2024-09-19T07:19:52.317 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:19:52 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e[64822]: starting mds.e at 2024-09-19T07:19:52.317 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:19:52 smithi139 bash[64807]: 415d2f182a9206fd9f006559d35f61da4ab29138be47b9aad0f8ee8adfd956df 2024-09-19T07:19:52.317 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:19:52 smithi139 systemd[1]: Started Ceph mds.e for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:19:52.852 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:52 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/942662476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:52.852 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:52 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:52.852 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:52 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:52.852 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:52 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:52.852 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:52 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:52.852 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:52 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:52.852 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:52 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:52 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/942662476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:52 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:52 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:52 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:52 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:52 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:52 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:53.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:52 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/942662476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:52 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:52 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:52 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:52 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:52 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:53.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:52 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:53.791 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:53 smithi162 ceph-mon[35726]: Deploying daemon mds.f on smithi162 2024-09-19T07:19:53.791 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:53 smithi162 ceph-mon[35726]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:53.791 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:53 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.139:6834/4113105598,v1:172.21.15.139:6835/4113105598] up:boot 2024-09-19T07:19:53.791 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:53 smithi162 ceph-mon[35726]: fsmap 5 up:standby 2024-09-19T07:19:53.791 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:53 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:19:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:53 smithi098 ceph-mon[30950]: Deploying daemon mds.f on smithi162 2024-09-19T07:19:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:53 smithi098 ceph-mon[30950]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:53 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.139:6834/4113105598,v1:172.21.15.139:6835/4113105598] up:boot 2024-09-19T07:19:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:53 smithi098 ceph-mon[30950]: fsmap 5 up:standby 2024-09-19T07:19:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:53 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:19:54.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:53 smithi139 ceph-mon[35039]: Deploying daemon mds.f on smithi162 2024-09-19T07:19:54.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:53 smithi139 ceph-mon[35039]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:54.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:53 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.139:6834/4113105598,v1:172.21.15.139:6835/4113105598] up:boot 2024-09-19T07:19:54.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:53 smithi139 ceph-mon[35039]: fsmap 5 up:standby 2024-09-19T07:19:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:53 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:19:54.132 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:19:53 smithi162 systemd[1]: Starting Ceph mds.f for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:19:54.501 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:19:54 smithi162 podman[65468]: 2024-09-19 07:19:54.090452494 +0000 UTC m=+0.016198725 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:19:54.501 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:19:54 smithi162 podman[65468]: 2024-09-19 07:19:54.207376088 +0000 UTC m=+0.133122311 container create 86dc30f8492288d50cc4d74b0a92ae1ac6516e10b4715c078fe660c26743eeac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T07:19:54.501 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:19:54 smithi162 podman[65468]: 2024-09-19 07:19:54.409516561 +0000 UTC m=+0.335262792 container init 86dc30f8492288d50cc4d74b0a92ae1ac6516e10b4715c078fe660c26743eeac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T07:19:54.501 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:19:54 smithi162 podman[65468]: 2024-09-19 07:19:54.412315571 +0000 UTC m=+0.338061797 container start 86dc30f8492288d50cc4d74b0a92ae1ac6516e10b4715c078fe660c26743eeac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-f, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T07:19:54.501 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:19:54 smithi162 ceph-mds[65487]: -- 172.21.15.162:0/2535320240 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56328afcf860 con 0x56328afad000 2024-09-19T07:19:54.501 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:19:54 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-f[65483]: starting mds.f at 2024-09-19T07:19:54.501 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:19:54 smithi162 bash[65468]: 86dc30f8492288d50cc4d74b0a92ae1ac6516e10b4715c078fe660c26743eeac 2024-09-19T07:19:54.771 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:19:54.881 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:19:54 smithi162 systemd[1]: Started Ceph mds.f for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:19:55.029 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:55.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.425+0000 7f7e2f79b640 1 -- 172.21.15.98:0/335443195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e281011e0 msgr2=0x7f7e28105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:55.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.425+0000 7f7e2f79b640 1 --2- 172.21.15.98:0/335443195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e281011e0 0x7f7e28105980 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009ca0 tx=0x7f7e1c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:19:55.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.425+0000 7f7e2f79b640 1 -- 172.21.15.98:0/335443195 shutdown_connections 2024-09-19T07:19:55.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.425+0000 7f7e2f79b640 1 --2- 172.21.15.98:0/335443195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e28105ec0 0x7f7e28106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:55.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.425+0000 7f7e2f79b640 1 --2- 172.21.15.98:0/335443195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e281011e0 0x7f7e28105980 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.425+0000 7f7e2f79b640 1 --2- 172.21.15.98:0/335443195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e281008c0 0x7f7e28100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.425+0000 7f7e2f79b640 1 -- 172.21.15.98:0/335443195 >> 172.21.15.98:0/335443195 conn(0x7f7e280fc7d0 msgr2=0x7f7e280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.425+0000 7f7e2f79b640 1 -- 172.21.15.98:0/335443195 shutdown_connections 2024-09-19T07:19:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.425+0000 7f7e2f79b640 1 -- 172.21.15.98:0/335443195 wait complete. 2024-09-19T07:19:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2f79b640 1 Processor -- start 2024-09-19T07:19:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2f79b640 1 -- start start 2024-09-19T07:19:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2f79b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e281008c0 0x7f7e281a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2f79b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e281011e0 0x7f7e281a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2f79b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e28105ec0 0x7f7e2819e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:55.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2f79b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28118610 con 0x7f7e28105ec0 2024-09-19T07:19:55.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2f79b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28118490 con 0x7f7e281011e0 2024-09-19T07:19:55.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2f79b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28118790 con 0x7f7e281008c0 2024-09-19T07:19:55.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2dd38640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e28105ec0 0x7f7e2819e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:55.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2dd38640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e28105ec0 0x7f7e2819e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58310/0 (socket says 172.21.15.98:58310) 2024-09-19T07:19:55.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2dd38640 1 -- 172.21.15.98:0/4085532726 learned_addr learned my addr 172.21.15.98:0/4085532726 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:19:55.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2cd36640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e281011e0 0x7f7e281a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:55.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2d537640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e281008c0 0x7f7e281a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:55.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2dd38640 1 -- 172.21.15.98:0/4085532726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e281008c0 msgr2=0x7f7e281a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:55.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2dd38640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e281008c0 0x7f7e281a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:55.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2dd38640 1 -- 172.21.15.98:0/4085532726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e281011e0 msgr2=0x7f7e281a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:55.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.426+0000 7f7e2dd38640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e281011e0 0x7f7e281a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.427+0000 7f7e2dd38640 1 -- 172.21.15.98:0/4085532726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2819f010 con 0x7f7e28105ec0 2024-09-19T07:19:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.427+0000 7f7e2dd38640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e28105ec0 0x7f7e2819e8e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800e970 tx=0x7f7e1800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.427+0000 7f7e267fc640 1 -- 172.21.15.98:0/4085532726 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800ccc0 con 0x7f7e28105ec0 2024-09-19T07:19:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.427+0000 7f7e267fc640 1 -- 172.21.15.98:0/4085532726 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e1800ce60 con 0x7f7e28105ec0 2024-09-19T07:19:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.427+0000 7f7e2f79b640 1 -- 172.21.15.98:0/4085532726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2819f300 con 0x7f7e28105ec0 2024-09-19T07:19:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.427+0000 7f7e267fc640 1 -- 172.21.15.98:0/4085532726 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e18010490 con 0x7f7e28105ec0 2024-09-19T07:19:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.427+0000 7f7e2f79b640 1 -- 172.21.15.98:0/4085532726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e281ab5f0 con 0x7f7e28105ec0 2024-09-19T07:19:55.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.428+0000 7f7e2f79b640 1 -- 172.21.15.98:0/4085532726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e28105980 con 0x7f7e28105ec0 2024-09-19T07:19:55.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.430+0000 7f7e267fc640 1 -- 172.21.15.98:0/4085532726 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7e18005000 con 0x7f7e28105ec0 2024-09-19T07:19:55.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.430+0000 7f7e267fc640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7e100a3240 0x7f7e100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:55.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.430+0000 7f7e2d537640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7e100a3240 0x7f7e100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:55.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.430+0000 7f7e267fc640 1 -- 172.21.15.98:0/4085532726 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f7e180cfaf0 con 0x7f7e28105ec0 2024-09-19T07:19:55.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.431+0000 7f7e2d537640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7e100a3240 0x7f7e100a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e20005e10 tx=0x7f7e20005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:55.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.434+0000 7f7e267fc640 1 -- 172.21.15.98:0/4085532726 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7e18054210 con 0x7f7e28105ec0 2024-09-19T07:19:55.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:55.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:55.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:55.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:55.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:55.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:55.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:55 smithi162 ceph-mon[35726]: Deploying daemon mds.c on smithi162 2024-09-19T07:19:55.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:55 smithi162 ceph-mon[35726]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:55.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:55 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.162:6834/2650670127,v1:172.21.15.162:6835/2650670127] up:boot 2024-09-19T07:19:55.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:55 smithi162 ceph-mon[35726]: fsmap 6 up:standby 2024-09-19T07:19:55.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:55 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:19:55.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.639+0000 7f7e2f79b640 1 -- 172.21.15.98:0/4085532726 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e281ab7c0 con 0x7f7e28105ec0 2024-09-19T07:19:55.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.640+0000 7f7e267fc640 1 -- 172.21.15.98:0/4085532726 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5566 (secure 0 0 0) 0x7f7e1809ccb0 con 0x7f7e28105ec0 2024-09-19T07:19:55.640 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:19:55.640 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":7,"btime":"2024-09-19T07:19:54:722113+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T07:19:55.641 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 7 2024-09-19T07:19:55.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.642+0000 7f7e2f79b640 1 -- 172.21.15.98:0/4085532726 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7e100a3240 msgr2=0x7f7e100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.642+0000 7f7e2f79b640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7e100a3240 0x7f7e100a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e20005e10 tx=0x7f7e20005da0 comp rx=0 tx=0).stop 2024-09-19T07:19:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.642+0000 7f7e2f79b640 1 -- 172.21.15.98:0/4085532726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e28105ec0 msgr2=0x7f7e2819e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.642+0000 7f7e2f79b640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e28105ec0 0x7f7e2819e8e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7e1800e970 tx=0x7f7e1800ed70 comp rx=0 tx=0).stop 2024-09-19T07:19:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.642+0000 7f7e2f79b640 1 -- 172.21.15.98:0/4085532726 shutdown_connections 2024-09-19T07:19:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.642+0000 7f7e2f79b640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7e100a3240 0x7f7e100a5700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.642+0000 7f7e2f79b640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7e28105ec0 0x7f7e2819e8e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.642+0000 7f7e2f79b640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e281011e0 0x7f7e281a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.642+0000 7f7e2f79b640 1 --2- 172.21.15.98:0/4085532726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e281008c0 0x7f7e281a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.642+0000 7f7e2f79b640 1 -- 172.21.15.98:0/4085532726 >> 172.21.15.98:0/4085532726 conn(0x7f7e280fc7d0 msgr2=0x7f7e28103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.642+0000 7f7e2f79b640 1 -- 172.21.15.98:0/4085532726 shutdown_connections 2024-09-19T07:19:55.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:55.642+0000 7f7e2f79b640 1 -- 172.21.15.98:0/4085532726 wait complete. 2024-09-19T07:19:55.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:55.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:55.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:55.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:55.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:55.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:55.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:55 smithi098 ceph-mon[30950]: Deploying daemon mds.c on smithi162 2024-09-19T07:19:55.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:55 smithi098 ceph-mon[30950]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:55.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:55 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.162:6834/2650670127,v1:172.21.15.162:6835/2650670127] up:boot 2024-09-19T07:19:55.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:55 smithi098 ceph-mon[30950]: fsmap 6 up:standby 2024-09-19T07:19:55.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:55 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:19:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:55.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:55 smithi139 ceph-mon[35039]: Deploying daemon mds.c on smithi162 2024-09-19T07:19:55.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:55 smithi139 ceph-mon[35039]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:55.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:55 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.162:6834/2650670127,v1:172.21.15.162:6835/2650670127] up:boot 2024-09-19T07:19:55.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:55 smithi139 ceph-mon[35039]: fsmap 6 up:standby 2024-09-19T07:19:55.818 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:55 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:19:56.574 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:19:56 smithi162 systemd[1]: Starting Ceph mds.c for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:19:56.853 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:56 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4085532726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:56.853 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:19:56 smithi162 podman[65766]: 2024-09-19 07:19:56.52661123 +0000 UTC m=+0.015953577 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:19:56.853 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:19:56 smithi162 podman[65766]: 2024-09-19 07:19:56.634378895 +0000 UTC m=+0.123721233 container create 0b8fea2a7a950c04f252ce609997f74a18b08e5d1da6d3358e2b4f683934c115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T07:19:56.853 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:19:56 smithi162 podman[65766]: 2024-09-19 07:19:56.853409481 +0000 UTC m=+0.342751820 container init 0b8fea2a7a950c04f252ce609997f74a18b08e5d1da6d3358e2b4f683934c115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T07:19:57.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:56 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4085532726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:57.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:56 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4085532726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:57.132 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:19:56 smithi162 podman[65766]: 2024-09-19 07:19:56.856444445 +0000 UTC m=+0.345786786 container start 0b8fea2a7a950c04f252ce609997f74a18b08e5d1da6d3358e2b4f683934c115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:19:57.132 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:19:56 smithi162 ceph-mds[65785]: -- 172.21.15.162:0/3595649613 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b6dbcf3860 con 0x55b6dbcd0800 2024-09-19T07:19:57.132 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:19:56 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c[65781]: starting mds.c at 2024-09-19T07:19:57.132 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:19:56 smithi162 bash[65766]: 0b8fea2a7a950c04f252ce609997f74a18b08e5d1da6d3358e2b4f683934c115 2024-09-19T07:19:57.132 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:19:56 smithi162 systemd[1]: Started Ceph mds.c for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:19:57.777 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:57 smithi139 ceph-mon[35039]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:57.777 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:57 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:57.777 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:57 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:57.777 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:57 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:57.777 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:57 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:57.777 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:57 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:57.778 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:57 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:57.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:57 smithi162 ceph-mon[35726]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:57.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:57 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:57.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:57 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:57.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:57 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:57.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:57 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:57.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:57 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:57.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:57 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:57 smithi098 ceph-mon[30950]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:19:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:19:58.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:19:58.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:57 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:19:58.365 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:19:58.624 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:19:58.746 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:58 smithi098 ceph-mon[30950]: Deploying daemon mds.h on smithi139 2024-09-19T07:19:58.746 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:58 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.162:6836/2810820400,v1:172.21.15.162:6837/2810820400] up:boot 2024-09-19T07:19:58.746 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:58 smithi098 ceph-mon[30950]: fsmap 7 up:standby 2024-09-19T07:19:58.746 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:58 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:19:58.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:58 smithi139 ceph-mon[35039]: Deploying daemon mds.h on smithi139 2024-09-19T07:19:58.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:58 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.162:6836/2810820400,v1:172.21.15.162:6837/2810820400] up:boot 2024-09-19T07:19:58.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:58 smithi139 ceph-mon[35039]: fsmap 7 up:standby 2024-09-19T07:19:58.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:58 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:19:58.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:58 smithi162 ceph-mon[35726]: Deploying daemon mds.h on smithi139 2024-09-19T07:19:58.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:58 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.162:6836/2810820400,v1:172.21.15.162:6837/2810820400] up:boot 2024-09-19T07:19:58.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:58 smithi162 ceph-mon[35726]: fsmap 7 up:standby 2024-09-19T07:19:58.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:58 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:19:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.190+0000 7f5ba97b8640 1 -- 172.21.15.98:0/1611805017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ba4102790 msgr2=0x7f5ba41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.190+0000 7f5ba97b8640 1 --2- 172.21.15.98:0/1611805017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ba4102790 0x7f5ba41067e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009900 tx=0x7f5b8c02a410 comp rx=0 tx=0).stop 2024-09-19T07:19:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.190+0000 7f5ba97b8640 1 -- 172.21.15.98:0/1611805017 shutdown_connections 2024-09-19T07:19:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.190+0000 7f5ba97b8640 1 --2- 172.21.15.98:0/1611805017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba4106f10 0x7f5ba410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.190+0000 7f5ba97b8640 1 --2- 172.21.15.98:0/1611805017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ba4102790 0x7f5ba41067e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.190+0000 7f5ba97b8640 1 --2- 172.21.15.98:0/1611805017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ba4101de0 0x7f5ba41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.190+0000 7f5ba97b8640 1 -- 172.21.15.98:0/1611805017 >> 172.21.15.98:0/1611805017 conn(0x7f5ba40fd8c0 msgr2=0x7f5ba40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.190+0000 7f5ba97b8640 1 -- 172.21.15.98:0/1611805017 shutdown_connections 2024-09-19T07:19:59.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.190+0000 7f5ba97b8640 1 -- 172.21.15.98:0/1611805017 wait complete. 2024-09-19T07:19:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba97b8640 1 Processor -- start 2024-09-19T07:19:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba97b8640 1 -- start start 2024-09-19T07:19:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba97b8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ba4101de0 0x7f5ba41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba97b8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba4102790 0x7f5ba41989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba97b8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ba4106f10 0x7f5ba419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba97b8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba4111fb0 con 0x7f5ba4106f10 2024-09-19T07:19:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba97b8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba4111e30 con 0x7f5ba4101de0 2024-09-19T07:19:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba97b8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba4112130 con 0x7f5ba4102790 2024-09-19T07:19:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ba4106f10 0x7f5ba419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ba4106f10 0x7f5ba419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58336/0 (socket says 172.21.15.98:58336) 2024-09-19T07:19:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba37fe640 1 -- 172.21.15.98:0/3059721364 learned_addr learned my addr 172.21.15.98:0/3059721364 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:19:59.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba2ffd640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ba4101de0 0x7f5ba41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.191+0000 7f5ba27fc640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba4102790 0x7f5ba41989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.192+0000 7f5ba37fe640 1 -- 172.21.15.98:0/3059721364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba4102790 msgr2=0x7f5ba41989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.192+0000 7f5ba37fe640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba4102790 0x7f5ba41989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.192+0000 7f5ba37fe640 1 -- 172.21.15.98:0/3059721364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ba4101de0 msgr2=0x7f5ba41984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.192+0000 7f5ba37fe640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ba4101de0 0x7f5ba41984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.192+0000 7f5ba37fe640 1 -- 172.21.15.98:0/3059721364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba419d460 con 0x7f5ba4106f10 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.192+0000 7f5ba27fc640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba4102790 0x7f5ba41989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.192+0000 7f5ba37fe640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ba4106f10 0x7f5ba419cd80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00cad0 tx=0x7f5b9c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.192+0000 7f5b9bfff640 1 -- 172.21.15.98:0/3059721364 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c00ad60 con 0x7f5ba4106f10 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.192+0000 7f5b9bfff640 1 -- 172.21.15.98:0/3059721364 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b9c005020 con 0x7f5ba4106f10 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.192+0000 7f5ba97b8640 1 -- 172.21.15.98:0/3059721364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba419d750 con 0x7f5ba4106f10 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.192+0000 7f5b9bfff640 1 -- 172.21.15.98:0/3059721364 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c00f6b0 con 0x7f5ba4106f10 2024-09-19T07:19:59.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.192+0000 7f5ba97b8640 1 -- 172.21.15.98:0/3059721364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba41a5030 con 0x7f5ba4106f10 2024-09-19T07:19:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.193+0000 7f5ba97b8640 1 -- 172.21.15.98:0/3059721364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba41021c0 con 0x7f5ba4106f10 2024-09-19T07:19:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.194+0000 7f5b9bfff640 1 -- 172.21.15.98:0/3059721364 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5b9c005560 con 0x7f5ba4106f10 2024-09-19T07:19:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.195+0000 7f5b9bfff640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5b900a3240 0x7f5b900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:19:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.195+0000 7f5ba2ffd640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5b900a3240 0x7f5b900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:19:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.195+0000 7f5b9bfff640 1 -- 172.21.15.98:0/3059721364 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f5b9c0cf4b0 con 0x7f5ba4106f10 2024-09-19T07:19:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.195+0000 7f5ba2ffd640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5b900a3240 0x7f5b900a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009990 tx=0x7f5b94009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:19:59.199 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.199+0000 7f5b9bfff640 1 -- 172.21.15.98:0/3059721364 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b9c014030 con 0x7f5ba4106f10 2024-09-19T07:19:59.216 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:19:59 smithi139 systemd[1]: Starting Ceph mds.h for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:19:59.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.400+0000 7f5ba97b8640 1 -- 172.21.15.98:0/3059721364 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ba402d7c0 con 0x7f5ba4106f10 2024-09-19T07:19:59.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.400+0000 7f5b9bfff640 1 -- 172.21.15.98:0/3059721364 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7f5b9c09c670 con 0x7f5ba4106f10 2024-09-19T07:19:59.401 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:19:59.401 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":8,"btime":"2024-09-19T07:19:57:573847+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T07:19:59.401 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 8 2024-09-19T07:19:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.402+0000 7f5ba97b8640 1 -- 172.21.15.98:0/3059721364 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5b900a3240 msgr2=0x7f5b900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.402+0000 7f5ba97b8640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5b900a3240 0x7f5b900a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009990 tx=0x7f5b94009110 comp rx=0 tx=0).stop 2024-09-19T07:19:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.402+0000 7f5ba97b8640 1 -- 172.21.15.98:0/3059721364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ba4106f10 msgr2=0x7f5ba419cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:19:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.402+0000 7f5ba97b8640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ba4106f10 0x7f5ba419cd80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00cad0 tx=0x7f5b9c00ced0 comp rx=0 tx=0).stop 2024-09-19T07:19:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.402+0000 7f5ba97b8640 1 -- 172.21.15.98:0/3059721364 shutdown_connections 2024-09-19T07:19:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.402+0000 7f5ba97b8640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5b900a3240 0x7f5b900a5700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.402+0000 7f5ba97b8640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ba4106f10 0x7f5ba419cd80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.402+0000 7f5ba97b8640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ba4102790 0x7f5ba41989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:59.403 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.402+0000 7f5ba97b8640 1 --2- 172.21.15.98:0/3059721364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ba4101de0 0x7f5ba41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:19:59.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.402+0000 7f5ba97b8640 1 -- 172.21.15.98:0/3059721364 >> 172.21.15.98:0/3059721364 conn(0x7f5ba40fd8c0 msgr2=0x7f5ba40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:19:59.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.402+0000 7f5ba97b8640 1 -- 172.21.15.98:0/3059721364 shutdown_connections 2024-09-19T07:19:59.404 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:19:59.402+0000 7f5ba97b8640 1 -- 172.21.15.98:0/3059721364 wait complete. 2024-09-19T07:19:59.468 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:19:59 smithi139 podman[65106]: 2024-09-19 07:19:59.216659612 +0000 UTC m=+0.101497336 container create d84c8446d0ef2a1c07ee38612f409518b0f1ffd576fe66bbfab29e29f2774876 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T07:19:59.469 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:19:59 smithi139 podman[65106]: 2024-09-19 07:19:59.131394541 +0000 UTC m=+0.016232274 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:19:59.469 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:19:59 smithi139 podman[65106]: 2024-09-19 07:19:59.468935943 +0000 UTC m=+0.353773675 container init d84c8446d0ef2a1c07ee38612f409518b0f1ffd576fe66bbfab29e29f2774876 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:19:59.692 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:59 smithi098 ceph-mon[30950]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:59.692 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:19:59 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3059721364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:59.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:59 smithi139 ceph-mon[35039]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:59.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:19:59 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3059721364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:19:59.817 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:19:59 smithi139 podman[65106]: 2024-09-19 07:19:59.471837594 +0000 UTC m=+0.356675317 container start d84c8446d0ef2a1c07ee38612f409518b0f1ffd576fe66bbfab29e29f2774876 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:19:59.817 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:19:59 smithi139 ceph-mds[65126]: -- 172.21.15.139:0/3719082180 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5563cb44d860 con 0x5563cb42a800 2024-09-19T07:19:59.817 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:19:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: starting mds.h at 2024-09-19T07:19:59.817 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:19:59 smithi139 bash[65106]: d84c8446d0ef2a1c07ee38612f409518b0f1ffd576fe66bbfab29e29f2774876 2024-09-19T07:19:59.817 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:19:59 smithi139 systemd[1]: Started Ceph mds.h for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:19:59.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:59 smithi162 ceph-mon[35726]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:19:59.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:19:59 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3059721364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:00.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:00 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] up:boot 2024-09-19T07:20:00.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:00 smithi162 ceph-mon[35726]: fsmap 8 up:standby 2024-09-19T07:20:00.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:20:00.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:00.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:00.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:00.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:20:00.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:20:00.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:00 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:00.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:00 smithi162 ceph-mon[35726]: Deploying daemon mds.i on smithi162 2024-09-19T07:20:00.633 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:00 smithi162 ceph-mon[35726]: overall HEALTH_OK 2024-09-19T07:20:01.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:00 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] up:boot 2024-09-19T07:20:01.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:00 smithi098 ceph-mon[30950]: fsmap 8 up:standby 2024-09-19T07:20:01.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:20:01.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:01.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:01.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:01.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:20:01.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:20:01.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:00 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:01.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:00 smithi098 ceph-mon[30950]: Deploying daemon mds.i on smithi162 2024-09-19T07:20:01.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:00 smithi098 ceph-mon[30950]: overall HEALTH_OK 2024-09-19T07:20:01.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:00 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] up:boot 2024-09-19T07:20:01.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:00 smithi139 ceph-mon[35039]: fsmap 8 up:standby 2024-09-19T07:20:01.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:20:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:20:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:20:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:00 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:00 smithi139 ceph-mon[35039]: Deploying daemon mds.i on smithi162 2024-09-19T07:20:01.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:00 smithi139 ceph-mon[35039]: overall HEALTH_OK 2024-09-19T07:20:01.591 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:20:01 smithi162 systemd[1]: Starting Ceph mds.i for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:20:01.854 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:01 smithi162 ceph-mon[35726]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:01.855 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:20:01 smithi162 podman[66068]: 2024-09-19 07:20:01.719648436 +0000 UTC m=+0.100005334 container create 18c87e98b427d17e6a9f47a9684d20d4ba130e4edac9bb2f7bf00ed5c9c09680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T07:20:01.855 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:20:01 smithi162 podman[66068]: 2024-09-19 07:20:01.635926818 +0000 UTC m=+0.016283728 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:20:02.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:01 smithi098 ceph-mon[30950]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:02.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:01 smithi139 ceph-mon[35039]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:02.141 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:20:02.384 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:20:01 smithi162 podman[66068]: 2024-09-19 07:20:01.939070354 +0000 UTC m=+0.319427255 container init 18c87e98b427d17e6a9f47a9684d20d4ba130e4edac9bb2f7bf00ed5c9c09680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:20:02.384 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:20:01 smithi162 podman[66068]: 2024-09-19 07:20:01.941886752 +0000 UTC m=+0.322243662 container start 18c87e98b427d17e6a9f47a9684d20d4ba130e4edac9bb2f7bf00ed5c9c09680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T07:20:02.385 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:20:01 smithi162 ceph-mds[66087]: -- 172.21.15.162:0/1188257313 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557ed3e7f860 con 0x557ed3e5c800 2024-09-19T07:20:02.385 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:20:01 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: starting mds.i at 2024-09-19T07:20:02.385 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:20:02 smithi162 bash[66068]: 18c87e98b427d17e6a9f47a9684d20d4ba130e4edac9bb2f7bf00ed5c9c09680 2024-09-19T07:20:02.385 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:20:02 smithi162 systemd[1]: Started Ceph mds.i for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:20:02.407 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.868+0000 7f6a1a21c640 1 -- 172.21.15.98:0/3175464431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a141036e0 msgr2=0x7f6a14107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.868+0000 7f6a1a21c640 1 --2- 172.21.15.98:0/3175464431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a141036e0 0x7f6a14107b90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009930 tx=0x7f6a0802a420 comp rx=0 tx=0).stop 2024-09-19T07:20:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.868+0000 7f6a1a21c640 1 -- 172.21.15.98:0/3175464431 shutdown_connections 2024-09-19T07:20:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.868+0000 7f6a1a21c640 1 --2- 172.21.15.98:0/3175464431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a141082a0 0x7f6a1410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.868+0000 7f6a1a21c640 1 --2- 172.21.15.98:0/3175464431 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a141036e0 0x7f6a14107b90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.868+0000 7f6a1a21c640 1 --2- 172.21.15.98:0/3175464431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a14102d30 0x7f6a14103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.868+0000 7f6a1a21c640 1 -- 172.21.15.98:0/3175464431 >> 172.21.15.98:0/3175464431 conn(0x7f6a140fc7d0 msgr2=0x7f6a140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.868+0000 7f6a1a21c640 1 -- 172.21.15.98:0/3175464431 shutdown_connections 2024-09-19T07:20:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.868+0000 7f6a1a21c640 1 -- 172.21.15.98:0/3175464431 wait complete. 2024-09-19T07:20:02.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.868+0000 7f6a1a21c640 1 Processor -- start 2024-09-19T07:20:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a1a21c640 1 -- start start 2024-09-19T07:20:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a1a21c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a14102d30 0x7f6a14198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a1a21c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a141036e0 0x7f6a14198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a1a21c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a141082a0 0x7f6a1419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a1a21c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6a141120a0 con 0x7f6a14102d30 2024-09-19T07:20:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a1a21c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6a14111f20 con 0x7f6a141036e0 2024-09-19T07:20:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a1a21c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a14112220 con 0x7f6a141082a0 2024-09-19T07:20:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a137fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a14102d30 0x7f6a14198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a137fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a14102d30 0x7f6a14198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43968/0 (socket says 172.21.15.98:43968) 2024-09-19T07:20:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a137fe640 1 -- 172.21.15.98:0/987370643 learned_addr learned my addr 172.21.15.98:0/987370643 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a13fff640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a141082a0 0x7f6a1419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:02.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a12ffd640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a141036e0 0x7f6a14198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a137fe640 1 -- 172.21.15.98:0/987370643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a141082a0 msgr2=0x7f6a1419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a137fe640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a141082a0 0x7f6a1419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a137fe640 1 -- 172.21.15.98:0/987370643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a141036e0 msgr2=0x7f6a14198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a137fe640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a141036e0 0x7f6a14198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a137fe640 1 -- 172.21.15.98:0/987370643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1419d5b0 con 0x7f6a14102d30 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a13fff640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a141082a0 0x7f6a1419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a137fe640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a14102d30 0x7f6a14198600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400cce0 tx=0x7f6a0400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.869+0000 7f6a10ff9640 1 -- 172.21.15.98:0/987370643 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04004b20 con 0x7f6a14102d30 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.870+0000 7f6a10ff9640 1 -- 172.21.15.98:0/987370643 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a04004cc0 con 0x7f6a14102d30 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.870+0000 7f6a1a21c640 1 -- 172.21.15.98:0/987370643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1419d8a0 con 0x7f6a14102d30 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.870+0000 7f6a10ff9640 1 -- 172.21.15.98:0/987370643 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400f8c0 con 0x7f6a14102d30 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.870+0000 7f6a1a21c640 1 -- 172.21.15.98:0/987370643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a141a5180 con 0x7f6a14102d30 2024-09-19T07:20:02.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.871+0000 7f6a1a21c640 1 -- 172.21.15.98:0/987370643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a14103110 con 0x7f6a14102d30 2024-09-19T07:20:02.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.872+0000 7f6a10ff9640 1 -- 172.21.15.98:0/987370643 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6a0400fa60 con 0x7f6a14102d30 2024-09-19T07:20:02.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.873+0000 7f6a10ff9640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f69fc0a3240 0x7f69fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:02.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.873+0000 7f6a12ffd640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f69fc0a3240 0x7f69fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:02.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.873+0000 7f6a10ff9640 1 -- 172.21.15.98:0/987370643 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f6a040cf550 con 0x7f6a14102d30 2024-09-19T07:20:02.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.873+0000 7f6a12ffd640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f69fc0a3240 0x7f69fc0a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009900 tx=0x7f6a08032d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:02.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:02.877+0000 7f6a10ff9640 1 -- 172.21.15.98:0/987370643 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a04014030 con 0x7f6a14102d30 2024-09-19T07:20:03.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.082+0000 7f6a1a21c640 1 -- 172.21.15.98:0/987370643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a14199960 con 0x7f6a14102d30 2024-09-19T07:20:03.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.083+0000 7f6a10ff9640 1 -- 172.21.15.98:0/987370643 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8049 (secure 0 0 0) 0x7f6a0409c710 con 0x7f6a14102d30 2024-09-19T07:20:03.084 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:03.084 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":10,"btime":"2024-09-19T07:20:02:591434+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T07:20:03.085 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 10 2024-09-19T07:20:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.085+0000 7f6a1a21c640 1 -- 172.21.15.98:0/987370643 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f69fc0a3240 msgr2=0x7f69fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.085+0000 7f6a1a21c640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f69fc0a3240 0x7f69fc0a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009900 tx=0x7f6a08032d10 comp rx=0 tx=0).stop 2024-09-19T07:20:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.085+0000 7f6a1a21c640 1 -- 172.21.15.98:0/987370643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a14102d30 msgr2=0x7f6a14198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.085+0000 7f6a1a21c640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a14102d30 0x7f6a14198600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400cce0 tx=0x7f6a0400a620 comp rx=0 tx=0).stop 2024-09-19T07:20:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.085+0000 7f6a1a21c640 1 -- 172.21.15.98:0/987370643 shutdown_connections 2024-09-19T07:20:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.085+0000 7f6a1a21c640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f69fc0a3240 0x7f69fc0a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.085+0000 7f6a1a21c640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a141082a0 0x7f6a1419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.085+0000 7f6a1a21c640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a141036e0 0x7f6a14198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:03.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.085+0000 7f6a1a21c640 1 --2- 172.21.15.98:0/987370643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a14102d30 0x7f6a14198600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:03.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.085+0000 7f6a1a21c640 1 -- 172.21.15.98:0/987370643 >> 172.21.15.98:0/987370643 conn(0x7f6a140fc7d0 msgr2=0x7f6a14105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:03.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.086+0000 7f6a1a21c640 1 -- 172.21.15.98:0/987370643 shutdown_connections 2024-09-19T07:20:03.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:03.086+0000 7f6a1a21c640 1 -- 172.21.15.98:0/987370643 wait complete. 2024-09-19T07:20:03.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:03.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:03.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:03.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:20:03.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:20:03.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:03.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:03 smithi162 ceph-mon[35726]: Deploying daemon mds.g on smithi098 2024-09-19T07:20:03.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:03 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] up:boot 2024-09-19T07:20:03.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:03 smithi162 ceph-mon[35726]: fsmap 9 up:standby 2024-09-19T07:20:03.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:03 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:20:03.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:03 smithi162 ceph-mon[35726]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:03.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:03 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/987370643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:03.400 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:03.400 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:03.400 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:03.400 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:20:03.401 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:20:03.401 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:03.401 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:03 smithi098 ceph-mon[30950]: Deploying daemon mds.g on smithi098 2024-09-19T07:20:03.401 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:03 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] up:boot 2024-09-19T07:20:03.401 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:03 smithi098 ceph-mon[30950]: fsmap 9 up:standby 2024-09-19T07:20:03.401 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:03 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:20:03.401 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:03 smithi098 ceph-mon[30950]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:03.401 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:03 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/987370643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:20:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:20:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:03 smithi139 ceph-mon[35039]: Deploying daemon mds.g on smithi098 2024-09-19T07:20:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:03 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] up:boot 2024-09-19T07:20:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:03 smithi139 ceph-mon[35039]: fsmap 9 up:standby 2024-09-19T07:20:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:03 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:20:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:03 smithi139 ceph-mon[35039]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:03.568 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:03 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/987370643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:05.249 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:20:05 smithi098 systemd[1]: Starting Ceph mds.g for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:20:05.514 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:20:05 smithi098 podman[70914]: 2024-09-19 07:20:05.14990255 +0000 UTC m=+0.016260706 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:20:05.514 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:20:05 smithi098 podman[70914]: 2024-09-19 07:20:05.260135988 +0000 UTC m=+0.126494138 container create 64cfe78985fcc44be3660c047c31b8913911849d6fb5571eeb1ee72667b65f8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T07:20:05.514 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:20:05 smithi098 podman[70914]: 2024-09-19 07:20:05.487764563 +0000 UTC m=+0.354122726 container init 64cfe78985fcc44be3660c047c31b8913911849d6fb5571eeb1ee72667b65f8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T07:20:05.514 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:20:05 smithi098 podman[70914]: 2024-09-19 07:20:05.490572473 +0000 UTC m=+0.356930627 container start 64cfe78985fcc44be3660c047c31b8913911849d6fb5571eeb1ee72667b65f8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T07:20:05.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:05 smithi098 ceph-mon[30950]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:05.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:05 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:05.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:05 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:05.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:05 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:05.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:05 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:20:05.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:05 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:20:05.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:05 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:05.774 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:20:05 smithi098 ceph-mds[70933]: -- 172.21.15.98:0/260836624 <== mon.0 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e660a4b860 con 0x55e660a28800 2024-09-19T07:20:05.774 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:20:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-g[70929]: starting mds.g at 2024-09-19T07:20:05.774 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:20:05 smithi098 bash[70914]: 64cfe78985fcc44be3660c047c31b8913911849d6fb5571eeb1ee72667b65f8d 2024-09-19T07:20:05.774 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:20:05 smithi098 systemd[1]: Started Ceph mds.g for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:20:06.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:05 smithi139 ceph-mon[35039]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:05 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:05 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:05 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:05 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:20:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:05 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:20:06.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:05 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:05 smithi162 ceph-mon[35726]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:05 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:05 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:05 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:05 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:20:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:05 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:20:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:05 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:06.164 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:20:06.658 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:06 smithi098 ceph-mon[30950]: Deploying daemon mds.a on smithi098 2024-09-19T07:20:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:06 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.98:6838/2258357114,v1:172.21.15.98:6839/2258357114] up:boot 2024-09-19T07:20:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:06 smithi098 ceph-mon[30950]: fsmap 10 up:standby 2024-09-19T07:20:07.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:06 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:20:07.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:06 smithi139 ceph-mon[35039]: Deploying daemon mds.a on smithi098 2024-09-19T07:20:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:06 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.98:6838/2258357114,v1:172.21.15.98:6839/2258357114] up:boot 2024-09-19T07:20:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:06 smithi139 ceph-mon[35039]: fsmap 10 up:standby 2024-09-19T07:20:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:06 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:20:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:06 smithi162 ceph-mon[35726]: Deploying daemon mds.a on smithi098 2024-09-19T07:20:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:06 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.98:6838/2258357114,v1:172.21.15.98:6839/2258357114] up:boot 2024-09-19T07:20:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:06 smithi162 ceph-mon[35726]: fsmap 10 up:standby 2024-09-19T07:20:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:06 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:20:07.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.583+0000 7ffb62689640 1 -- 172.21.15.98:0/1702661450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb5c100e20 msgr2=0x7ffb5c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:07.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.583+0000 7ffb62689640 1 --2- 172.21.15.98:0/1702661450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb5c100e20 0x7ffb5c101200 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009900 tx=0x7ffb5002a480 comp rx=0 tx=0).stop 2024-09-19T07:20:07.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.583+0000 7ffb62689640 1 -- 172.21.15.98:0/1702661450 shutdown_connections 2024-09-19T07:20:07.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.583+0000 7ffb62689640 1 --2- 172.21.15.98:0/1702661450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb5c102ef0 0x7ffb5c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:07.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.583+0000 7ffb62689640 1 --2- 172.21.15.98:0/1702661450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5c102570 0x7ffb5c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:07.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.583+0000 7ffb62689640 1 --2- 172.21.15.98:0/1702661450 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb5c100e20 0x7ffb5c101200 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:07.584 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.583+0000 7ffb62689640 1 -- 172.21.15.98:0/1702661450 >> 172.21.15.98:0/1702661450 conn(0x7ffb5c0fc7d0 msgr2=0x7ffb5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:07.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.583+0000 7ffb62689640 1 -- 172.21.15.98:0/1702661450 shutdown_connections 2024-09-19T07:20:07.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.583+0000 7ffb62689640 1 -- 172.21.15.98:0/1702661450 wait complete. 2024-09-19T07:20:07.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.583+0000 7ffb62689640 1 Processor -- start 2024-09-19T07:20:07.585 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb62689640 1 -- start start 2024-09-19T07:20:07.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb62689640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5c100e20 0x7ffb5c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:07.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb62689640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb5c102570 0x7ffb5c199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:07.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb62689640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb5c102ef0 0x7ffb5c1a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:07.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb62689640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c110f50 con 0x7ffb5c102570 2024-09-19T07:20:07.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb62689640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c110dd0 con 0x7ffb5c102ef0 2024-09-19T07:20:07.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb62689640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c1110d0 con 0x7ffb5c100e20 2024-09-19T07:20:07.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb5b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb5c102570 0x7ffb5c199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:07.587 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb5b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb5c102570 0x7ffb5c199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44008/0 (socket says 172.21.15.98:44008) 2024-09-19T07:20:07.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb5b7fe640 1 -- 172.21.15.98:0/3781089792 learned_addr learned my addr 172.21.15.98:0/3781089792 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:07.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb60c26640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb5c102ef0 0x7ffb5c1a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:07.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb5bfff640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5c100e20 0x7ffb5c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:07.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb5b7fe640 1 -- 172.21.15.98:0/3781089792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5c100e20 msgr2=0x7ffb5c1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:07.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb5b7fe640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5c100e20 0x7ffb5c1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:07.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb5b7fe640 1 -- 172.21.15.98:0/3781089792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb5c102ef0 msgr2=0x7ffb5c1a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:07.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb5b7fe640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb5c102ef0 0x7ffb5c1a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:07.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.584+0000 7ffb5b7fe640 1 -- 172.21.15.98:0/3781089792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c1a4980 con 0x7ffb5c102570 2024-09-19T07:20:07.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.585+0000 7ffb5b7fe640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb5c102570 0x7ffb5c199900 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00d950 tx=0x7ffb4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:07.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.585+0000 7ffb597fa640 1 -- 172.21.15.98:0/3781089792 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c017070 con 0x7ffb5c102570 2024-09-19T07:20:07.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.585+0000 7ffb597fa640 1 -- 172.21.15.98:0/3781089792 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb4c009c30 con 0x7ffb5c102570 2024-09-19T07:20:07.588 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.585+0000 7ffb62689640 1 -- 172.21.15.98:0/3781089792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5c1a4b50 con 0x7ffb5c102570 2024-09-19T07:20:07.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.585+0000 7ffb597fa640 1 -- 172.21.15.98:0/3781089792 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c00f6b0 con 0x7ffb5c102570 2024-09-19T07:20:07.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.585+0000 7ffb62689640 1 -- 172.21.15.98:0/3781089792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5c1a5060 con 0x7ffb5c102570 2024-09-19T07:20:07.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.586+0000 7ffb62689640 1 -- 172.21.15.98:0/3781089792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5c1021b0 con 0x7ffb5c102570 2024-09-19T07:20:07.589 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.587+0000 7ffb597fa640 1 -- 172.21.15.98:0/3781089792 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ffb4c0109d0 con 0x7ffb5c102570 2024-09-19T07:20:07.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.588+0000 7ffb597fa640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ffb440a3240 0x7ffb440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:07.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.588+0000 7ffb5bfff640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ffb440a3240 0x7ffb440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:07.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.588+0000 7ffb597fa640 1 -- 172.21.15.98:0/3781089792 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ffb4c0cf080 con 0x7ffb5c102570 2024-09-19T07:20:07.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.588+0000 7ffb5bfff640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ffb440a3240 0x7ffb440a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffb50005ab0 tx=0x7ffb50005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:07.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.591+0000 7ffb597fa640 1 -- 172.21.15.98:0/3781089792 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb4c009de0 con 0x7ffb5c102570 2024-09-19T07:20:07.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.803+0000 7ffb62689640 1 -- 172.21.15.98:0/3781089792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb5c06a560 con 0x7ffb5c102570 2024-09-19T07:20:07.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.804+0000 7ffb597fa640 1 -- 172.21.15.98:0/3781089792 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7ffb4c09c240 con 0x7ffb5c102570 2024-09-19T07:20:07.805 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:07.805 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":11,"btime":"2024-09-19T07:20:05:698106+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T07:20:07.806 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 11 2024-09-19T07:20:07.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.806+0000 7ffb62689640 1 -- 172.21.15.98:0/3781089792 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ffb440a3240 msgr2=0x7ffb440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:07.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.806+0000 7ffb62689640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ffb440a3240 0x7ffb440a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffb50005ab0 tx=0x7ffb50005a20 comp rx=0 tx=0).stop 2024-09-19T07:20:07.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.806+0000 7ffb62689640 1 -- 172.21.15.98:0/3781089792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb5c102570 msgr2=0x7ffb5c199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:07.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.806+0000 7ffb62689640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb5c102570 0x7ffb5c199900 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c00d950 tx=0x7ffb4c00de10 comp rx=0 tx=0).stop 2024-09-19T07:20:07.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.807+0000 7ffb62689640 1 -- 172.21.15.98:0/3781089792 shutdown_connections 2024-09-19T07:20:07.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.807+0000 7ffb62689640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ffb440a3240 0x7ffb440a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:07.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.807+0000 7ffb62689640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffb5c102ef0 0x7ffb5c1a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:07.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.807+0000 7ffb62689640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb5c102570 0x7ffb5c199900 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:07.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.807+0000 7ffb62689640 1 --2- 172.21.15.98:0/3781089792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb5c100e20 0x7ffb5c1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:07.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.807+0000 7ffb62689640 1 -- 172.21.15.98:0/3781089792 >> 172.21.15.98:0/3781089792 conn(0x7ffb5c0fc7d0 msgr2=0x7ffb5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:07.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.807+0000 7ffb62689640 1 -- 172.21.15.98:0/3781089792 shutdown_connections 2024-09-19T07:20:07.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:07.807+0000 7ffb62689640 1 -- 172.21.15.98:0/3781089792 wait complete. 2024-09-19T07:20:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:07 smithi098 ceph-mon[30950]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:08.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:07 smithi139 ceph-mon[35039]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:08.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:07 smithi162 ceph-mon[35726]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:08.297 INFO:journalctl@ceph.mds.a.smithi098.stdout:Sep 19 07:20:08 smithi098 podman[71315]: 2024-09-19 07:20:08.271921789 +0000 UTC m=+0.580385861 container start 91c999fb46b483fba5ae7f59c98718b66ce5709e28a5e5ed2c6b8f0043a06858 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T07:20:08.297 INFO:journalctl@ceph.mds.a.smithi098.stdout:Sep 19 07:20:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-a[71343]: starting mds.a at 2024-09-19T07:20:08.551 INFO:journalctl@ceph.mds.a.smithi098.stdout:Sep 19 07:20:08 smithi098 bash[71315]: 91c999fb46b483fba5ae7f59c98718b66ce5709e28a5e5ed2c6b8f0043a06858 2024-09-19T07:20:08.551 INFO:journalctl@ceph.mds.a.smithi098.stdout:Sep 19 07:20:08 smithi098 systemd[1]: Started Ceph mds.a for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:20:08.852 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:08 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3781089792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:08.852 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:08 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:08.852 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:08 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:08.852 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:08 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:08.852 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:08 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:20:08.852 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:08 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:20:08.852 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:08 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:09.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:08 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3781089792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:09.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:08 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:09.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:08 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:09.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:08 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:09.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:08 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:20:09.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:08 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:20:09.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:08 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:08 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3781089792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T07:20:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T07:20:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:08 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:10.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:09 smithi139 ceph-mon[35039]: Deploying daemon mds.b on smithi139 2024-09-19T07:20:10.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:09 smithi139 ceph-mon[35039]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:10.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:09 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.98:6840/2652528346,v1:172.21.15.98:6841/2652528346] up:boot 2024-09-19T07:20:10.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:09 smithi139 ceph-mon[35039]: fsmap 11 up:standby 2024-09-19T07:20:10.000 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:09 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:20:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:09 smithi098 ceph-mon[30950]: Deploying daemon mds.b on smithi139 2024-09-19T07:20:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:09 smithi098 ceph-mon[30950]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:09 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.98:6840/2652528346,v1:172.21.15.98:6841/2652528346] up:boot 2024-09-19T07:20:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:09 smithi098 ceph-mon[30950]: fsmap 11 up:standby 2024-09-19T07:20:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:09 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:20:10.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:09 smithi162 ceph-mon[35726]: Deploying daemon mds.b on smithi139 2024-09-19T07:20:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:09 smithi162 ceph-mon[35726]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:09 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.98:6840/2652528346,v1:172.21.15.98:6841/2652528346] up:boot 2024-09-19T07:20:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:09 smithi162 ceph-mon[35726]: fsmap 11 up:standby 2024-09-19T07:20:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:09 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:20:10.566 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:20:10 smithi139 systemd[1]: Starting Ceph mds.b for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:20:10.879 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:20:10.988 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:20:10 smithi139 podman[65408]: 2024-09-19 07:20:10.70238794 +0000 UTC m=+0.112124554 container create dbcdc14ae0f97be6339644f83079e20f5b625570500cac84fee4fc2cf23017d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T07:20:10.988 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:20:10 smithi139 podman[65408]: 2024-09-19 07:20:10.606318058 +0000 UTC m=+0.016054680 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:20:10.988 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:20:10 smithi139 podman[65408]: 2024-09-19 07:20:10.854536763 +0000 UTC m=+0.264273373 container init dbcdc14ae0f97be6339644f83079e20f5b625570500cac84fee4fc2cf23017d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T07:20:10.988 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:20:10 smithi139 podman[65408]: 2024-09-19 07:20:10.857483523 +0000 UTC m=+0.267220134 container start dbcdc14ae0f97be6339644f83079e20f5b625570500cac84fee4fc2cf23017d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T07:20:10.988 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:20:10 smithi139 ceph-mds[65428]: -- 172.21.15.139:0/2806897607 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c555e09860 con 0x55c555de7400 2024-09-19T07:20:10.988 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:20:10 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b[65424]: starting mds.b at 2024-09-19T07:20:10.989 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:20:10 smithi139 bash[65408]: dbcdc14ae0f97be6339644f83079e20f5b625570500cac84fee4fc2cf23017d8 2024-09-19T07:20:11.145 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:11.316 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:20:10 smithi139 systemd[1]: Started Ceph mds.b for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:20:11.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.603+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1332568892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8f0102790 msgr2=0x7ff8f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:11.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.603+0000 7ff8f76e1640 1 --2- 172.21.15.98:0/1332568892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8f0102790 0x7ff8f01067e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009ca0 tx=0x7ff8e402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:20:11.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.603+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1332568892 shutdown_connections 2024-09-19T07:20:11.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.603+0000 7ff8f76e1640 1 --2- 172.21.15.98:0/1332568892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f0106f10 0x7ff8f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:11.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.603+0000 7ff8f76e1640 1 --2- 172.21.15.98:0/1332568892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8f0102790 0x7ff8f01067e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.603+0000 7ff8f76e1640 1 --2- 172.21.15.98:0/1332568892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8f0101de0 0x7ff8f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.603+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1332568892 >> 172.21.15.98:0/1332568892 conn(0x7ff8f00fd8c0 msgr2=0x7ff8f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.603+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1332568892 shutdown_connections 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.603+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1332568892 wait complete. 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f76e1640 1 Processor -- start 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f76e1640 1 -- start start 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f76e1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8f0101de0 0x7ff8f0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f76e1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8f0102790 0x7ff8f01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f76e1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f0106f10 0x7ff8f019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f76e1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0111f90 con 0x7ff8f0102790 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f76e1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0111e10 con 0x7ff8f0101de0 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f76e1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0112110 con 0x7ff8f0106f10 2024-09-19T07:20:11.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f4c7c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8f0102790 0x7ff8f01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f4c7c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8f0102790 0x7ff8f01989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44054/0 (socket says 172.21.15.98:44054) 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f547d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8f0101de0 0x7ff8f0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f4c7c640 1 -- 172.21.15.98:0/1401573679 learned_addr learned my addr 172.21.15.98:0/1401573679 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f5c7e640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f0106f10 0x7ff8f019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f547d640 1 -- 172.21.15.98:0/1401573679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f0106f10 msgr2=0x7ff8f019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f547d640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f0106f10 0x7ff8f019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f547d640 1 -- 172.21.15.98:0/1401573679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8f0102790 msgr2=0x7ff8f01989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f547d640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8f0102790 0x7ff8f01989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f547d640 1 -- 172.21.15.98:0/1401573679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f019d440 con 0x7ff8f0101de0 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f5c7e640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f0106f10 0x7ff8f019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.604+0000 7ff8f4c7c640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8f0102790 0x7ff8f01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.605+0000 7ff8f547d640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8f0101de0 0x7ff8f0198490 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000b3f0 tx=0x7ff8e000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:11.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.605+0000 7ff8ee7fc640 1 -- 172.21.15.98:0/1401573679 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0015020 con 0x7ff8f0101de0 2024-09-19T07:20:11.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.605+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1401573679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f019d730 con 0x7ff8f0101de0 2024-09-19T07:20:11.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.605+0000 7ff8ee7fc640 1 -- 172.21.15.98:0/1401573679 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8e0011d10 con 0x7ff8f0101de0 2024-09-19T07:20:11.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.605+0000 7ff8ee7fc640 1 -- 172.21.15.98:0/1401573679 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e000f2e0 con 0x7ff8f0101de0 2024-09-19T07:20:11.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.605+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1401573679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f01a5010 con 0x7ff8f0101de0 2024-09-19T07:20:11.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.606+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1401573679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f01021c0 con 0x7ff8f0101de0 2024-09-19T07:20:11.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.607+0000 7ff8ee7fc640 1 -- 172.21.15.98:0/1401573679 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff8e0018020 con 0x7ff8f0101de0 2024-09-19T07:20:11.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.607+0000 7ff8ee7fc640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff8d80a3240 0x7ff8d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:11.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.608+0000 7ff8f4c7c640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff8d80a3240 0x7ff8d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:11.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.608+0000 7ff8ee7fc640 1 -- 172.21.15.98:0/1401573679 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff8e00cf1f0 con 0x7ff8f0101de0 2024-09-19T07:20:11.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.608+0000 7ff8f4c7c640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff8d80a3240 0x7ff8d80a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4004ad0 tx=0x7ff8e4004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:11.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.611+0000 7ff8ee7fc640 1 -- 172.21.15.98:0/1401573679 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff8e001f020 con 0x7ff8f0101de0 2024-09-19T07:20:11.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:11 smithi098 ceph-mon[30950]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:11.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:11 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:11.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:11 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:11.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:11 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:11.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:11 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:11.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:11 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:11.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:11 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:20:11.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:11 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:11.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.836+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1401573679 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8f010a0f0 con 0x7ff8f0101de0 2024-09-19T07:20:11.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.837+0000 7ff8ee7fc640 1 -- 172.21.15.98:0/1401573679 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10530 (secure 0 0 0) 0x7ff8e009c310 con 0x7ff8f0101de0 2024-09-19T07:20:11.838 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:11.838 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":13,"btime":"2024-09-19T07:20:11:725523+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24437,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24458,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T07:20:11.839 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 13 2024-09-19T07:20:11.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.839+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1401573679 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff8d80a3240 msgr2=0x7ff8d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:11.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.839+0000 7ff8f76e1640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff8d80a3240 0x7ff8d80a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4004ad0 tx=0x7ff8e4004a40 comp rx=0 tx=0).stop 2024-09-19T07:20:11.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.839+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1401573679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8f0101de0 msgr2=0x7ff8f0198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:11.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.839+0000 7ff8f76e1640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8f0101de0 0x7ff8f0198490 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000b3f0 tx=0x7ff8e000b8b0 comp rx=0 tx=0).stop 2024-09-19T07:20:11.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.840+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1401573679 shutdown_connections 2024-09-19T07:20:11.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.840+0000 7ff8f76e1640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff8d80a3240 0x7ff8d80a5700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:11.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.840+0000 7ff8f76e1640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8f0106f10 0x7ff8f019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:11.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.840+0000 7ff8f76e1640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff8f0102790 0x7ff8f01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:11.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.840+0000 7ff8f76e1640 1 --2- 172.21.15.98:0/1401573679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8f0101de0 0x7ff8f0198490 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:11.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.840+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1401573679 >> 172.21.15.98:0/1401573679 conn(0x7ff8f00fd8c0 msgr2=0x7ff8f00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:11.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.840+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1401573679 shutdown_connections 2024-09-19T07:20:11.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:11.840+0000 7ff8f76e1640 1 -- 172.21.15.98:0/1401573679 wait complete. 2024-09-19T07:20:11.982 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:11 smithi162 ceph-mon[35726]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:11.982 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:11 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:11.982 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:11 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:11.982 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:11 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:11.982 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:11 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:11.982 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:11 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:11.982 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:11 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:20:11.982 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:11 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:12.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:11 smithi139 ceph-mon[35039]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:12.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:11 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:12.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:11 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:12.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:11 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:12.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:11 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:12.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:11 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:12.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:11 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:20:12.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:11 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:12 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] up:boot 2024-09-19T07:20:13.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:12 smithi098 ceph-mon[30950]: fsmap 12 up:standby 2024-09-19T07:20:13.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:12 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:20:13.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:12 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1401573679' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:13.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:12 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:12 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:12 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:12 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.061 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T07:20:13.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:12 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] up:boot 2024-09-19T07:20:13.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:12 smithi139 ceph-mon[35039]: fsmap 12 up:standby 2024-09-19T07:20:13.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:12 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:20:13.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:12 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1401573679' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:13.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:12 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:12 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:12 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:12 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:12 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] up:boot 2024-09-19T07:20:13.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:12 smithi162 ceph-mon[35726]: fsmap 12 up:standby 2024-09-19T07:20:13.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:12 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:20:13.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:12 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1401573679' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:13.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:12 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:12 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:12 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:12 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:13.342 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:13.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.806+0000 7ff36cd61640 1 -- 172.21.15.98:0/339919914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff368106a80 msgr2=0x7ff368106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:13.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.806+0000 7ff36cd61640 1 --2- 172.21.15.98:0/339919914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff368106a80 0x7ff368106e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff350009930 tx=0x7ff35002a420 comp rx=0 tx=0).stop 2024-09-19T07:20:13.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.806+0000 7ff36cd61640 1 -- 172.21.15.98:0/339919914 shutdown_connections 2024-09-19T07:20:13.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.806+0000 7ff36cd61640 1 --2- 172.21.15.98:0/339919914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff368101420 0x7ff36810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:13.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.806+0000 7ff36cd61640 1 --2- 172.21.15.98:0/339919914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff368100a80 0x7ff368100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:13.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.806+0000 7ff36cd61640 1 --2- 172.21.15.98:0/339919914 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff368106a80 0x7ff368106e60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:13.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.806+0000 7ff36cd61640 1 -- 172.21.15.98:0/339919914 >> 172.21.15.98:0/339919914 conn(0x7ff3680fc7a0 msgr2=0x7ff3680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:13.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.806+0000 7ff36cd61640 1 -- 172.21.15.98:0/339919914 shutdown_connections 2024-09-19T07:20:13.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.806+0000 7ff36cd61640 1 -- 172.21.15.98:0/339919914 wait complete. 2024-09-19T07:20:13.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.806+0000 7ff36cd61640 1 Processor -- start 2024-09-19T07:20:13.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.806+0000 7ff36cd61640 1 -- start start 2024-09-19T07:20:13.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff36cd61640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff368100a80 0x7ff368197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:13.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff36cd61640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff368101420 0x7ff368197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:13.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff36cd61640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff368106a80 0x7ff36819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff36cd61640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff368110ea0 con 0x7ff368101420 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff36cd61640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff368110d20 con 0x7ff368106a80 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff36cd61640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff368111020 con 0x7ff368100a80 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff365d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff368101420 0x7ff368197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff365d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff368101420 0x7ff368197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43096/0 (socket says 172.21.15.98:43096) 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff365d9b640 1 -- 172.21.15.98:0/1298897008 learned_addr learned my addr 172.21.15.98:0/1298897008 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff36659c640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff368100a80 0x7ff368197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff366d9d640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff368106a80 0x7ff36819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff365d9b640 1 -- 172.21.15.98:0/1298897008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff368100a80 msgr2=0x7ff368197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff365d9b640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff368100a80 0x7ff368197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff365d9b640 1 -- 172.21.15.98:0/1298897008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff368106a80 msgr2=0x7ff36819bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff365d9b640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff368106a80 0x7ff36819bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:13.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff365d9b640 1 -- 172.21.15.98:0/1298897008 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36819c2f0 con 0x7ff368101420 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff366d9d640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff368106a80 0x7ff36819bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff365d9b640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff368101420 0x7ff368197880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c920 tx=0x7ff35800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff35f7fe640 1 -- 172.21.15.98:0/1298897008 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff358007c70 con 0x7ff368101420 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff35f7fe640 1 -- 172.21.15.98:0/1298897008 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff358007e10 con 0x7ff368101420 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.807+0000 7ff36cd61640 1 -- 172.21.15.98:0/1298897008 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36819c5e0 con 0x7ff368101420 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.808+0000 7ff35f7fe640 1 -- 172.21.15.98:0/1298897008 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff358018890 con 0x7ff368101420 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.808+0000 7ff36cd61640 1 -- 172.21.15.98:0/1298897008 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3681a3ec0 con 0x7ff368101420 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.808+0000 7ff36cd61640 1 -- 172.21.15.98:0/1298897008 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff368100ee0 con 0x7ff368101420 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.810+0000 7ff35f7fe640 1 -- 172.21.15.98:0/1298897008 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff358018a50 con 0x7ff368101420 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.811+0000 7ff35f7fe640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff3540a3240 0x7ff3540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.811+0000 7ff36659c640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff3540a3240 0x7ff3540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.811+0000 7ff35f7fe640 1 -- 172.21.15.98:0/1298897008 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff3580cf910 con 0x7ff368101420 2024-09-19T07:20:13.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.811+0000 7ff36659c640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff3540a3240 0x7ff3540a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff350000c00 tx=0x7ff350031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:13.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.814+0000 7ff35f7fe640 1 -- 172.21.15.98:0/1298897008 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff358014030 con 0x7ff368101420 2024-09-19T07:20:13.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.997+0000 7ff36cd61640 1 -- 172.21.15.98:0/1298897008 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff3681986a0 con 0x7ff368101420 2024-09-19T07:20:13.998 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:13 smithi098 ceph-mon[30950]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:13.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:13.997+0000 7ff35f7fe640 1 -- 172.21.15.98:0/1298897008 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7ff3681986a0 con 0x7ff368101420 2024-09-19T07:20:13.998 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:13.998 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2024-09-19T07:20:13.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:20:13.999 INFO:teuthology.orchestra.run.smithi098.stdout: "poolnum": 1, 2024-09-19T07:20:13.999 INFO:teuthology.orchestra.run.smithi098.stdout: "poolname": ".mgr" 2024-09-19T07:20:13.999 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:20:13.999 INFO:teuthology.orchestra.run.smithi098.stdout:] 2024-09-19T07:20:14.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:14.000+0000 7ff36cd61640 1 -- 172.21.15.98:0/1298897008 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff3540a3240 msgr2=0x7ff3540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:14.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:14.000+0000 7ff36cd61640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff3540a3240 0x7ff3540a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff350000c00 tx=0x7ff350031490 comp rx=0 tx=0).stop 2024-09-19T07:20:14.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:14.000+0000 7ff36cd61640 1 -- 172.21.15.98:0/1298897008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff368101420 msgr2=0x7ff368197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:14.000+0000 7ff36cd61640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff368101420 0x7ff368197880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c920 tx=0x7ff35800cde0 comp rx=0 tx=0).stop 2024-09-19T07:20:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:14.000+0000 7ff36cd61640 1 -- 172.21.15.98:0/1298897008 shutdown_connections 2024-09-19T07:20:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:14.000+0000 7ff36cd61640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff3540a3240 0x7ff3540a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:14.000+0000 7ff36cd61640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff368106a80 0x7ff36819bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:14.000+0000 7ff36cd61640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff368101420 0x7ff368197880 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:14.000+0000 7ff36cd61640 1 --2- 172.21.15.98:0/1298897008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff368100a80 0x7ff368197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:14.000+0000 7ff36cd61640 1 -- 172.21.15.98:0/1298897008 >> 172.21.15.98:0/1298897008 conn(0x7ff3680fc7a0 msgr2=0x7ff3680fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:14.000+0000 7ff36cd61640 1 -- 172.21.15.98:0/1298897008 shutdown_connections 2024-09-19T07:20:14.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:14.000+0000 7ff36cd61640 1 -- 172.21.15.98:0/1298897008 wait complete. 2024-09-19T07:20:14.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:13 smithi139 ceph-mon[35039]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:14.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:13 smithi162 ceph-mon[35726]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:14.650 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T07:20:14.650 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T07:20:14.910 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:14.910 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:14.910 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:14.910 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:20:14.910 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:14.911 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:14 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1298897008' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T07:20:14.911 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:14 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:20:14.911 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:14 smithi162 ceph-mon[35726]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:15.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:15.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:15.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:15.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:20:15.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:15.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:14 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1298897008' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T07:20:15.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:14 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:20:15.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:14 smithi139 ceph-mon[35039]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:15.160 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:15.161 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:15.161 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:15.161 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:20:15.161 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:15.161 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:14 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1298897008' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T07:20:15.161 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:14 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:20:15.161 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:14 smithi098 ceph-mon[30950]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:15.463 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:15.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.955+0000 7fb26f2b1640 1 -- 172.21.15.98:0/2351885463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb268102dd0 msgr2=0x7fb2681031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:15.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.955+0000 7fb26f2b1640 1 --2- 172.21.15.98:0/2351885463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb268102dd0 0x7fb2681031b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb264009930 tx=0x7fb26402a420 comp rx=0 tx=0).stop 2024-09-19T07:20:15.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.955+0000 7fb26f2b1640 1 -- 172.21.15.98:0/2351885463 shutdown_connections 2024-09-19T07:20:15.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.955+0000 7fb26f2b1640 1 --2- 172.21.15.98:0/2351885463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb268108300 0x7fb26810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:15.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.955+0000 7fb26f2b1640 1 --2- 172.21.15.98:0/2351885463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb268103780 0x7fb268107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:15.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.955+0000 7fb26f2b1640 1 --2- 172.21.15.98:0/2351885463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb268102dd0 0x7fb2681031b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:15.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.955+0000 7fb26f2b1640 1 -- 172.21.15.98:0/2351885463 >> 172.21.15.98:0/2351885463 conn(0x7fb2680fc7d0 msgr2=0x7fb2680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:15.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.955+0000 7fb26f2b1640 1 -- 172.21.15.98:0/2351885463 shutdown_connections 2024-09-19T07:20:15.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.955+0000 7fb26f2b1640 1 -- 172.21.15.98:0/2351885463 wait complete. 2024-09-19T07:20:15.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.955+0000 7fb26f2b1640 1 Processor -- start 2024-09-19T07:20:15.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.955+0000 7fb26f2b1640 1 -- start start 2024-09-19T07:20:15.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26f2b1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb268102dd0 0x7fb2681985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26f2b1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb268103780 0x7fb268198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26f2b1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb268108300 0x7fb26819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26f2b1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb2681120b0 con 0x7fb268103780 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26f2b1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb268111f30 con 0x7fb268108300 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26f2b1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb268112230 con 0x7fb268102dd0 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26c84c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb268103780 0x7fb268198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26c84c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb268103780 0x7fb268198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43122/0 (socket says 172.21.15.98:43122) 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26c84c640 1 -- 172.21.15.98:0/3702844546 learned_addr learned my addr 172.21.15.98:0/3702844546 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26d84e640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb268108300 0x7fb26819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26d04d640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb268102dd0 0x7fb2681985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26c84c640 1 -- 172.21.15.98:0/3702844546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb268102dd0 msgr2=0x7fb2681985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26c84c640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb268102dd0 0x7fb2681985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:15.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26c84c640 1 -- 172.21.15.98:0/3702844546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb268108300 msgr2=0x7fb26819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26c84c640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb268108300 0x7fb26819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26c84c640 1 -- 172.21.15.98:0/3702844546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26819d560 con 0x7fb268103780 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26c84c640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb268103780 0x7fb268198af0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb25800d750 tx=0x7fb25800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb25e7fc640 1 -- 172.21.15.98:0/3702844546 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258017070 con 0x7fb268103780 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26f2b1640 1 -- 172.21.15.98:0/3702844546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26819d850 con 0x7fb268103780 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb25e7fc640 1 -- 172.21.15.98:0/3702844546 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb258005500 con 0x7fb268103780 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb25e7fc640 1 -- 172.21.15.98:0/3702844546 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258004e00 con 0x7fb268103780 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.956+0000 7fb26f2b1640 1 -- 172.21.15.98:0/3702844546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2681a5130 con 0x7fb268103780 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.957+0000 7fb26f2b1640 1 -- 172.21.15.98:0/3702844546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26806a7b0 con 0x7fb268103780 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.958+0000 7fb25e7fc640 1 -- 172.21.15.98:0/3702844546 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb258004fa0 con 0x7fb268103780 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.959+0000 7fb25e7fc640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb2540a3240 0x7fb2540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.959+0000 7fb26d04d640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb2540a3240 0x7fb2540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.959+0000 7fb25e7fc640 1 -- 172.21.15.98:0/3702844546 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fb2580ceda0 con 0x7fb268103780 2024-09-19T07:20:15.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.960+0000 7fb26d04d640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb2540a3240 0x7fb2540a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb264009900 tx=0x7fb2640058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:15.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:15.963+0000 7fb25e7fc640 1 -- 172.21.15.98:0/3702844546 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb25809b8f0 con 0x7fb268103780 2024-09-19T07:20:16.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.145+0000 7fb26f2b1640 1 -- 172.21.15.98:0/3702844546 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb26810a290 con 0x7fb268103780 2024-09-19T07:20:16.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.497+0000 7fb25e7fc640 1 -- 172.21.15.98:0/3702844546 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7fb2580860c0 con 0x7fb268103780 2024-09-19T07:20:16.498 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' created 2024-09-19T07:20:16.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.499+0000 7fb26f2b1640 1 -- 172.21.15.98:0/3702844546 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb2540a3240 msgr2=0x7fb2540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:16.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.499+0000 7fb26f2b1640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb2540a3240 0x7fb2540a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb264009900 tx=0x7fb2640058d0 comp rx=0 tx=0).stop 2024-09-19T07:20:16.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.499+0000 7fb26f2b1640 1 -- 172.21.15.98:0/3702844546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb268103780 msgr2=0x7fb268198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:16.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.499+0000 7fb26f2b1640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb268103780 0x7fb268198af0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb25800d750 tx=0x7fb25800dc10 comp rx=0 tx=0).stop 2024-09-19T07:20:16.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.500+0000 7fb26f2b1640 1 -- 172.21.15.98:0/3702844546 shutdown_connections 2024-09-19T07:20:16.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.500+0000 7fb26f2b1640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb2540a3240 0x7fb2540a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:16.500 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.500+0000 7fb26f2b1640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb268108300 0x7fb26819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:16.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.500+0000 7fb26f2b1640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb268103780 0x7fb268198af0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:16.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.500+0000 7fb26f2b1640 1 --2- 172.21.15.98:0/3702844546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb268102dd0 0x7fb2681985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:16.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.500+0000 7fb26f2b1640 1 -- 172.21.15.98:0/3702844546 >> 172.21.15.98:0/3702844546 conn(0x7fb2680fc7d0 msgr2=0x7fb268105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:16.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.500+0000 7fb26f2b1640 1 -- 172.21.15.98:0/3702844546 shutdown_connections 2024-09-19T07:20:16.501 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:16.500+0000 7fb26f2b1640 1 -- 172.21.15.98:0/3702844546 wait complete. 2024-09-19T07:20:16.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:16 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3702844546' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T07:20:16.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:16.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:20:16.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:16 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3702844546' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T07:20:16.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:16.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:20:16.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:16 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3702844546' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T07:20:16.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:16.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:20:16.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:20:16.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:20:17.121 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T07:20:17.365 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:17.748 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:17 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3702844546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T07:20:17.748 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:17 smithi098 ceph-mon[30950]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T07:20:17.748 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:17 smithi098 ceph-mon[30950]: pgmap v264: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:17.784 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:17 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3702844546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T07:20:17.784 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:17 smithi162 ceph-mon[35726]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T07:20:17.784 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:17 smithi162 ceph-mon[35726]: pgmap v264: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:17.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:17 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3702844546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T07:20:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:17 smithi139 ceph-mon[35039]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T07:20:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:17 smithi139 ceph-mon[35039]: pgmap v264: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:17.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.833+0000 7fc6e96e8640 1 -- 172.21.15.98:0/1648936845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e4101420 msgr2=0x7fc6e410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:17.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.833+0000 7fc6e96e8640 1 --2- 172.21.15.98:0/1648936845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e4101420 0x7fc6e410d950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009cd0 tx=0x7fc6dc02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:20:17.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.833+0000 7fc6e96e8640 1 -- 172.21.15.98:0/1648936845 shutdown_connections 2024-09-19T07:20:17.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.833+0000 7fc6e96e8640 1 --2- 172.21.15.98:0/1648936845 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e4101420 0x7fc6e410d950 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:17.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.833+0000 7fc6e96e8640 1 --2- 172.21.15.98:0/1648936845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6e4100a80 0x7fc6e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.833+0000 7fc6e96e8640 1 --2- 172.21.15.98:0/1648936845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e4106a80 0x7fc6e4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.833+0000 7fc6e96e8640 1 -- 172.21.15.98:0/1648936845 >> 172.21.15.98:0/1648936845 conn(0x7fc6e40fc7a0 msgr2=0x7fc6e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.833+0000 7fc6e96e8640 1 -- 172.21.15.98:0/1648936845 shutdown_connections 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.833+0000 7fc6e96e8640 1 -- 172.21.15.98:0/1648936845 wait complete. 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.834+0000 7fc6e96e8640 1 Processor -- start 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.834+0000 7fc6e96e8640 1 -- start start 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.834+0000 7fc6e96e8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e4100a80 0x7fc6e41972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.834+0000 7fc6e96e8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e4101420 0x7fc6e41977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.834+0000 7fc6e96e8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6e4106a80 0x7fc6e419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.834+0000 7fc6e96e8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e4110e80 con 0x7fc6e4101420 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.834+0000 7fc6e96e8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e4110d00 con 0x7fc6e4106a80 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.834+0000 7fc6e96e8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e4111000 con 0x7fc6e4100a80 2024-09-19T07:20:17.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.834+0000 7fc6e27fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e4101420 0x7fc6e41977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:17.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.834+0000 7fc6e27fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e4101420 0x7fc6e41977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43142/0 (socket says 172.21.15.98:43142) 2024-09-19T07:20:17.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6e27fc640 1 -- 172.21.15.98:0/3150384409 learned_addr learned my addr 172.21.15.98:0/3150384409 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:17.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6e2ffd640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e4100a80 0x7fc6e41972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:17.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6e37fe640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6e4106a80 0x7fc6e419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:17.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6e27fc640 1 -- 172.21.15.98:0/3150384409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e4100a80 msgr2=0x7fc6e41972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:17.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6e27fc640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e4100a80 0x7fc6e41972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:17.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6e27fc640 1 -- 172.21.15.98:0/3150384409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6e4106a80 msgr2=0x7fc6e419bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:17.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6e27fc640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6e4106a80 0x7fc6e419bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:17.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6e27fc640 1 -- 172.21.15.98:0/3150384409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e419c260 con 0x7fc6e4101420 2024-09-19T07:20:17.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6e27fc640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e4101420 0x7fc6e41977f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800c920 tx=0x7fc6d800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:17.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6cbfff640 1 -- 172.21.15.98:0/3150384409 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8007c70 con 0x7fc6e4101420 2024-09-19T07:20:17.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6e96e8640 1 -- 172.21.15.98:0/3150384409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e419c550 con 0x7fc6e4101420 2024-09-19T07:20:17.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6cbfff640 1 -- 172.21.15.98:0/3150384409 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6d8007e10 con 0x7fc6e4101420 2024-09-19T07:20:17.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6cbfff640 1 -- 172.21.15.98:0/3150384409 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8018890 con 0x7fc6e4101420 2024-09-19T07:20:17.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.835+0000 7fc6e96e8640 1 -- 172.21.15.98:0/3150384409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e41a3e30 con 0x7fc6e4101420 2024-09-19T07:20:17.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.836+0000 7fc6e96e8640 1 -- 172.21.15.98:0/3150384409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e4100ee0 con 0x7fc6e4101420 2024-09-19T07:20:17.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.837+0000 7fc6cbfff640 1 -- 172.21.15.98:0/3150384409 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc6d8018a50 con 0x7fc6e4101420 2024-09-19T07:20:17.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.838+0000 7fc6cbfff640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc6cc0a3240 0x7fc6cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:17.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.838+0000 7fc6e2ffd640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc6cc0a3240 0x7fc6cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:17.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.838+0000 7fc6cbfff640 1 -- 172.21.15.98:0/3150384409 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7497+0+0 (secure 0 0 0) 0x7fc6d80cf9c0 con 0x7fc6e4101420 2024-09-19T07:20:17.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.838+0000 7fc6e2ffd640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc6cc0a3240 0x7fc6cc0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4005fd0 tx=0x7fc6d400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:17.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:17.841+0000 7fc6cbfff640 1 -- 172.21.15.98:0/3150384409 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc6d8014030 con 0x7fc6e4101420 2024-09-19T07:20:18.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.009+0000 7fc6e96e8640 1 -- 172.21.15.98:0/3150384409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc6e4198610 con 0x7fc6e4101420 2024-09-19T07:20:18.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.510+0000 7fc6cbfff640 1 -- 172.21.15.98:0/3150384409 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v76) ==== 170+0+0 (secure 0 0 0) 0x7fc6e4198610 con 0x7fc6e4101420 2024-09-19T07:20:18.510 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' created 2024-09-19T07:20:18.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.512+0000 7fc6e96e8640 1 -- 172.21.15.98:0/3150384409 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc6cc0a3240 msgr2=0x7fc6cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:18.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.512+0000 7fc6e96e8640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc6cc0a3240 0x7fc6cc0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4005fd0 tx=0x7fc6d400b390 comp rx=0 tx=0).stop 2024-09-19T07:20:18.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.512+0000 7fc6e96e8640 1 -- 172.21.15.98:0/3150384409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e4101420 msgr2=0x7fc6e41977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:18.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.512+0000 7fc6e96e8640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e4101420 0x7fc6e41977f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800c920 tx=0x7fc6d800cde0 comp rx=0 tx=0).stop 2024-09-19T07:20:18.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.513+0000 7fc6e96e8640 1 -- 172.21.15.98:0/3150384409 shutdown_connections 2024-09-19T07:20:18.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.513+0000 7fc6e96e8640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc6cc0a3240 0x7fc6cc0a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:18.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.513+0000 7fc6e96e8640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc6e4106a80 0x7fc6e419bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:18.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.513+0000 7fc6e96e8640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6e4101420 0x7fc6e41977f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:18.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.513+0000 7fc6e96e8640 1 --2- 172.21.15.98:0/3150384409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e4100a80 0x7fc6e41972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:18.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.513+0000 7fc6e96e8640 1 -- 172.21.15.98:0/3150384409 >> 172.21.15.98:0/3150384409 conn(0x7fc6e40fc7a0 msgr2=0x7fc6e40fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:18.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.513+0000 7fc6e96e8640 1 -- 172.21.15.98:0/3150384409 shutdown_connections 2024-09-19T07:20:18.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:18.513+0000 7fc6e96e8640 1 -- 172.21.15.98:0/3150384409 wait complete. 2024-09-19T07:20:18.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:18 smithi098 ceph-mon[30950]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:20:18.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:18 smithi098 ceph-mon[30950]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T07:20:18.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:18 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3150384409' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T07:20:18.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:18 smithi139 ceph-mon[35039]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:20:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:18 smithi139 ceph-mon[35039]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T07:20:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:18 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3150384409' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T07:20:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:18 smithi162 ceph-mon[35726]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T07:20:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:18 smithi162 ceph-mon[35726]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T07:20:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:18 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3150384409' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T07:20:19.130 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T07:20:19.376 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:19.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:19 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3150384409' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T07:20:19.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:19 smithi098 ceph-mon[30950]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T07:20:19.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:19 smithi098 ceph-mon[30950]: pgmap v267: 97 pgs: 5 creating+peering, 88 unknown, 4 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:19.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:19 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3150384409' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T07:20:19.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:19 smithi139 ceph-mon[35039]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T07:20:19.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:19 smithi139 ceph-mon[35039]: pgmap v267: 97 pgs: 5 creating+peering, 88 unknown, 4 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:19.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.863+0000 7f81b23e3640 1 -- 172.21.15.98:0/3499089103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac100a80 msgr2=0x7f81ac100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:19.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.863+0000 7f81b23e3640 1 --2- 172.21.15.98:0/3499089103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac100a80 0x7f81ac100ee0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8194009930 tx=0x7f819402a420 comp rx=0 tx=0).stop 2024-09-19T07:20:19.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.863+0000 7f81b23e3640 1 -- 172.21.15.98:0/3499089103 shutdown_connections 2024-09-19T07:20:19.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.863+0000 7f81b23e3640 1 --2- 172.21.15.98:0/3499089103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81ac101420 0x7f81ac10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.863+0000 7f81b23e3640 1 --2- 172.21.15.98:0/3499089103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac100a80 0x7f81ac100ee0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.863+0000 7f81b23e3640 1 --2- 172.21.15.98:0/3499089103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81ac106a80 0x7f81ac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.863+0000 7f81b23e3640 1 -- 172.21.15.98:0/3499089103 >> 172.21.15.98:0/3499089103 conn(0x7f81ac0fc7a0 msgr2=0x7f81ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:19.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.863+0000 7f81b23e3640 1 -- 172.21.15.98:0/3499089103 shutdown_connections 2024-09-19T07:20:19.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.863+0000 7f81b23e3640 1 -- 172.21.15.98:0/3499089103 wait complete. 2024-09-19T07:20:19.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.863+0000 7f81b23e3640 1 Processor -- start 2024-09-19T07:20:19.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.863+0000 7f81b23e3640 1 -- start start 2024-09-19T07:20:19.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81b23e3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac100a80 0x7f81ac198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81b23e3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81ac101420 0x7f81ac198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81b23e3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81ac106a80 0x7f81ac19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81b23e3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac110e80 con 0x7f81ac100a80 2024-09-19T07:20:19.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81b23e3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac110d00 con 0x7f81ac106a80 2024-09-19T07:20:19.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81b23e3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f81ac111000 con 0x7f81ac101420 2024-09-19T07:20:19.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81abfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac100a80 0x7f81ac198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81abfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac100a80 0x7f81ac198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43150/0 (socket says 172.21.15.98:43150) 2024-09-19T07:20:19.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81abfff640 1 -- 172.21.15.98:0/1133469527 learned_addr learned my addr 172.21.15.98:0/1133469527 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:19.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81b0980640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81ac106a80 0x7f81ac19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81a3fff640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81ac101420 0x7f81ac198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81abfff640 1 -- 172.21.15.98:0/1133469527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81ac101420 msgr2=0x7f81ac198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:19.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81abfff640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81ac101420 0x7f81ac198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81abfff640 1 -- 172.21.15.98:0/1133469527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81ac106a80 msgr2=0x7f81ac19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:19.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81abfff640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81ac106a80 0x7f81ac19ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:19.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81abfff640 1 -- 172.21.15.98:0/1133469527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ac19d3d0 con 0x7f81ac100a80 2024-09-19T07:20:19.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81abfff640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac100a80 0x7f81ac198420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f819c00c970 tx=0x7f819c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:19.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81a9ffb640 1 -- 172.21.15.98:0/1133469527 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c007bb0 con 0x7f81ac100a80 2024-09-19T07:20:19.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81a9ffb640 1 -- 172.21.15.98:0/1133469527 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f819c007d50 con 0x7f81ac100a80 2024-09-19T07:20:19.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81b23e3640 1 -- 172.21.15.98:0/1133469527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ac19d6c0 con 0x7f81ac100a80 2024-09-19T07:20:19.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.864+0000 7f81a9ffb640 1 -- 172.21.15.98:0/1133469527 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c00f450 con 0x7f81ac100a80 2024-09-19T07:20:19.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.865+0000 7f81b23e3640 1 -- 172.21.15.98:0/1133469527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ac1a4fa0 con 0x7f81ac100a80 2024-09-19T07:20:19.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.865+0000 7f81b23e3640 1 -- 172.21.15.98:0/1133469527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ac100ee0 con 0x7f81ac100a80 2024-09-19T07:20:19.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.867+0000 7f81a9ffb640 1 -- 172.21.15.98:0/1133469527 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f819c004fe0 con 0x7f81ac100a80 2024-09-19T07:20:19.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.868+0000 7f81a9ffb640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81980a32c0 0x7f81980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:19.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.868+0000 7f81a3fff640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81980a32c0 0x7f81980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:19.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.868+0000 7f81a9ffb640 1 -- 172.21.15.98:0/1133469527 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7879+0+0 (secure 0 0 0) 0x7f819c0cf760 con 0x7f81ac100a80 2024-09-19T07:20:19.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.868+0000 7f81a3fff640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81980a32c0 0x7f81980a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8194009900 tx=0x7f81940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:19.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:19.871+0000 7f81a9ffb640 1 -- 172.21.15.98:0/1133469527 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f819c014030 con 0x7f81ac100a80 2024-09-19T07:20:19.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:19 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3150384409' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T07:20:19.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:19 smithi162 ceph-mon[35726]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T07:20:19.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:19 smithi162 ceph-mon[35726]: pgmap v267: 97 pgs: 5 creating+peering, 88 unknown, 4 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:20.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.075+0000 7f81b23e3640 1 -- 172.21.15.98:0/1133469527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f81ac199780 con 0x7f81ac100a80 2024-09-19T07:20:20.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.516+0000 7f81a9ffb640 1 -- 172.21.15.98:0/1133469527 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f81ac199780 con 0x7f81ac100a80 2024-09-19T07:20:20.517 INFO:teuthology.orchestra.run.smithi098.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T07:20:20.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.519+0000 7f81b23e3640 1 -- 172.21.15.98:0/1133469527 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81980a32c0 msgr2=0x7f81980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:20.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.519+0000 7f81b23e3640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81980a32c0 0x7f81980a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8194009900 tx=0x7f81940058d0 comp rx=0 tx=0).stop 2024-09-19T07:20:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.519+0000 7f81b23e3640 1 -- 172.21.15.98:0/1133469527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac100a80 msgr2=0x7f81ac198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.519+0000 7f81b23e3640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac100a80 0x7f81ac198420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f819c00c970 tx=0x7f819c00ce30 comp rx=0 tx=0).stop 2024-09-19T07:20:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.519+0000 7f81b23e3640 1 -- 172.21.15.98:0/1133469527 shutdown_connections 2024-09-19T07:20:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.519+0000 7f81b23e3640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81980a32c0 0x7f81980a5780 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.519+0000 7f81b23e3640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81ac106a80 0x7f81ac19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.519+0000 7f81b23e3640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81ac101420 0x7f81ac198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.519+0000 7f81b23e3640 1 --2- 172.21.15.98:0/1133469527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81ac100a80 0x7f81ac198420 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.519+0000 7f81b23e3640 1 -- 172.21.15.98:0/1133469527 >> 172.21.15.98:0/1133469527 conn(0x7f81ac0fc7a0 msgr2=0x7f81ac06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.519+0000 7f81b23e3640 1 -- 172.21.15.98:0/1133469527 shutdown_connections 2024-09-19T07:20:20.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:20.519+0000 7f81b23e3640 1 -- 172.21.15.98:0/1133469527 wait complete. 2024-09-19T07:20:20.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:20 smithi098 ceph-mon[30950]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T07:20:20.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:20 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1133469527' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T07:20:20.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:20 smithi098 ceph-mon[30950]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T07:20:20.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:20 smithi139 ceph-mon[35039]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T07:20:20.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:20 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1133469527' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T07:20:20.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:20 smithi139 ceph-mon[35039]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T07:20:20.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:20 smithi162 ceph-mon[35726]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T07:20:20.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:20 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1133469527' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T07:20:20.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:20 smithi162 ceph-mon[35726]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T07:20:21.141 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:20:21.387 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:21 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1133469527' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T07:20:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:21 smithi098 ceph-mon[30950]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T07:20:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:21 smithi098 ceph-mon[30950]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T07:20:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:21 smithi098 ceph-mon[30950]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T07:20:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:21 smithi098 ceph-mon[30950]: pgmap v270: 97 pgs: 4 creating+activating, 13 creating+peering, 43 unknown, 37 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:21 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] up:active 2024-09-19T07:20:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:21 smithi098 ceph-mon[30950]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T07:20:21.816 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:20:21 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b[65424]: 2024-09-19T07:20:21.742+0000 7f4f346f2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T07:20:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:21 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1133469527' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T07:20:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:21 smithi139 ceph-mon[35039]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T07:20:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:21 smithi139 ceph-mon[35039]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T07:20:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:21 smithi139 ceph-mon[35039]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T07:20:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:21 smithi139 ceph-mon[35039]: pgmap v270: 97 pgs: 4 creating+activating, 13 creating+peering, 43 unknown, 37 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:21 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] up:active 2024-09-19T07:20:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:21 smithi139 ceph-mon[35039]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T07:20:21.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.826+0000 7fade9369640 1 -- 172.21.15.98:0/1748089043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade4100a80 msgr2=0x7fade4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:21.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.826+0000 7fade9369640 1 --2- 172.21.15.98:0/1748089043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade4100a80 0x7fade4100ee0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009930 tx=0x7fadcc02a420 comp rx=0 tx=0).stop 2024-09-19T07:20:21.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.826+0000 7fade9369640 1 -- 172.21.15.98:0/1748089043 shutdown_connections 2024-09-19T07:20:21.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.826+0000 7fade9369640 1 --2- 172.21.15.98:0/1748089043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fade4101420 0x7fade410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:21.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.826+0000 7fade9369640 1 --2- 172.21.15.98:0/1748089043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade4100a80 0x7fade4100ee0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:21.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.826+0000 7fade9369640 1 --2- 172.21.15.98:0/1748089043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade4106a80 0x7fade4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:21.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.826+0000 7fade9369640 1 -- 172.21.15.98:0/1748089043 >> 172.21.15.98:0/1748089043 conn(0x7fade40fc7a0 msgr2=0x7fade40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:21.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.826+0000 7fade9369640 1 -- 172.21.15.98:0/1748089043 shutdown_connections 2024-09-19T07:20:21.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.826+0000 7fade9369640 1 -- 172.21.15.98:0/1748089043 wait complete. 2024-09-19T07:20:21.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.826+0000 7fade9369640 1 Processor -- start 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.826+0000 7fade9369640 1 -- start start 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade9369640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fade4100a80 0x7fade4199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade9369640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade4101420 0x7fade4199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade9369640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade4106a80 0x7fade41a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade9369640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fade4110f20 con 0x7fade4106a80 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade9369640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fade4110da0 con 0x7fade4100a80 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade9369640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fade41110a0 con 0x7fade4101420 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade4106a80 0x7fade41a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade4106a80 0x7fade41a44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43162/0 (socket says 172.21.15.98:43162) 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade2ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fade4100a80 0x7fade4199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade37fe640 1 -- 172.21.15.98:0/2684276722 learned_addr learned my addr 172.21.15.98:0/2684276722 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade27fc640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade4101420 0x7fade4199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:21.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade37fe640 1 -- 172.21.15.98:0/2684276722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade4101420 msgr2=0x7fade4199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade37fe640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade4101420 0x7fade4199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade37fe640 1 -- 172.21.15.98:0/2684276722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fade4100a80 msgr2=0x7fade4199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade37fe640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fade4100a80 0x7fade4199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade37fe640 1 -- 172.21.15.98:0/2684276722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade41a4a10 con 0x7fade4106a80 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade37fe640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade4106a80 0x7fade41a44d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009fd0 tx=0x7fadd400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7faddbfff640 1 -- 172.21.15.98:0/2684276722 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd4011830 con 0x7fade4106a80 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade9369640 1 -- 172.21.15.98:0/2684276722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade41a4be0 con 0x7fade4106a80 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7faddbfff640 1 -- 172.21.15.98:0/2684276722 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fadd4016070 con 0x7fade4106a80 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7faddbfff640 1 -- 172.21.15.98:0/2684276722 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd400f2e0 con 0x7fade4106a80 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.827+0000 7fade9369640 1 -- 172.21.15.98:0/2684276722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade41a50a0 con 0x7fade4106a80 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.828+0000 7fade9369640 1 -- 172.21.15.98:0/2684276722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade4100f60 con 0x7fade4106a80 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.829+0000 7faddbfff640 1 -- 172.21.15.98:0/2684276722 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fadd40119d0 con 0x7fade4106a80 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.830+0000 7faddbfff640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fadd00a3240 0x7fadd00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.830+0000 7fade2ffd640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fadd00a3240 0x7fadd00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:21.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.830+0000 7faddbfff640 1 -- 172.21.15.98:0/2684276722 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fadd40ced80 con 0x7fade4106a80 2024-09-19T07:20:21.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.831+0000 7fade2ffd640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fadd00a3240 0x7fadd00a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faddc00a400 tx=0x7faddc00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:21.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:21.834+0000 7faddbfff640 1 -- 172.21.15.98:0/2684276722 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fadd409bbf0 con 0x7fade4106a80 2024-09-19T07:20:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:21 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1133469527' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T07:20:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:21 smithi162 ceph-mon[35726]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T07:20:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:21 smithi162 ceph-mon[35726]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T07:20:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:21 smithi162 ceph-mon[35726]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T07:20:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:21 smithi162 ceph-mon[35726]: pgmap v270: 97 pgs: 4 creating+activating, 13 creating+peering, 43 unknown, 37 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:20:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:21 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] up:active 2024-09-19T07:20:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:21 smithi162 ceph-mon[35726]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T07:20:22.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.002+0000 7fade9369640 1 -- 172.21.15.98:0/2684276722 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fade4109010 con 0x7fade4106a80 2024-09-19T07:20:22.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.003+0000 7faddbfff640 1 -- 172.21.15.98:0/2684276722 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22290 (secure 0 0 0) 0x7fadd409b4f0 con 0x7fade4106a80 2024-09-19T07:20:22.004 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:22.004 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":78,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:20:20.076793+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:20:16.391879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:20:18.243837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:20:22.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.005+0000 7fade9369640 1 -- 172.21.15.98:0/2684276722 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fadd00a3240 msgr2=0x7fadd00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:22.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.005+0000 7fade9369640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fadd00a3240 0x7fadd00a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faddc00a400 tx=0x7faddc00d040 comp rx=0 tx=0).stop 2024-09-19T07:20:22.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.005+0000 7fade9369640 1 -- 172.21.15.98:0/2684276722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade4106a80 msgr2=0x7fade41a44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:22.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.005+0000 7fade9369640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade4106a80 0x7fade41a44d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009fd0 tx=0x7fadd400b8e0 comp rx=0 tx=0).stop 2024-09-19T07:20:22.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.005+0000 7fade9369640 1 -- 172.21.15.98:0/2684276722 shutdown_connections 2024-09-19T07:20:22.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.006+0000 7fade9369640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fadd00a3240 0x7fadd00a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:22.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.006+0000 7fade9369640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fade4106a80 0x7fade41a44d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:22.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.006+0000 7fade9369640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fade4101420 0x7fade4199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:22.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.006+0000 7fade9369640 1 --2- 172.21.15.98:0/2684276722 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fade4100a80 0x7fade4199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:22.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.006+0000 7fade9369640 1 -- 172.21.15.98:0/2684276722 >> 172.21.15.98:0/2684276722 conn(0x7fade40fc7a0 msgr2=0x7fade40fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:22.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.006+0000 7fade9369640 1 -- 172.21.15.98:0/2684276722 shutdown_connections 2024-09-19T07:20:22.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:22.006+0000 7fade9369640 1 -- 172.21.15.98:0/2684276722 wait complete. 2024-09-19T07:20:22.585 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:22 smithi098 ceph-mon[30950]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T07:20:22.586 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:22 smithi098 ceph-mon[30950]: Cluster is now healthy 2024-09-19T07:20:22.586 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:22 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2684276722' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:22.614 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:20:22.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:22 smithi139 ceph-mon[35039]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T07:20:22.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:22 smithi139 ceph-mon[35039]: Cluster is now healthy 2024-09-19T07:20:22.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:22 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2684276722' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:22.860 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:22.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:22 smithi162 ceph-mon[35726]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T07:20:22.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:22 smithi162 ceph-mon[35726]: Cluster is now healthy 2024-09-19T07:20:22.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:22 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2684276722' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:23.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.342+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2160637610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62f4102790 msgr2=0x7f62f41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:23.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.342+0000 7f62fbdd3640 1 --2- 172.21.15.98:0/2160637610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62f4102790 0x7f62f41067e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009ca0 tx=0x7f62e802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:20:23.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.342+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2160637610 shutdown_connections 2024-09-19T07:20:23.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.342+0000 7f62fbdd3640 1 --2- 172.21.15.98:0/2160637610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f4106f10 0x7f62f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:23.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.342+0000 7f62fbdd3640 1 --2- 172.21.15.98:0/2160637610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62f4102790 0x7f62f41067e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:23.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.342+0000 7f62fbdd3640 1 --2- 172.21.15.98:0/2160637610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62f4101de0 0x7f62f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:23.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.342+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2160637610 >> 172.21.15.98:0/2160637610 conn(0x7f62f40fd8c0 msgr2=0x7f62f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:23.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.342+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2160637610 shutdown_connections 2024-09-19T07:20:23.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.342+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2160637610 wait complete. 2024-09-19T07:20:23.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62fbdd3640 1 Processor -- start 2024-09-19T07:20:23.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62fbdd3640 1 -- start start 2024-09-19T07:20:23.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62fbdd3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62f4101de0 0x7f62f40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:23.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62fbdd3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62f4102790 0x7f62f4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:23.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62fbdd3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f4106f10 0x7f62f4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:23.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62fbdd3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f62f4111f70 con 0x7f62f4102790 2024-09-19T07:20:23.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62fbdd3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f62f4111df0 con 0x7f62f4101de0 2024-09-19T07:20:23.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62fbdd3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62f41120f0 con 0x7f62f4106f10 2024-09-19T07:20:23.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62f936e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62f4102790 0x7f62f4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:23.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62f936e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62f4102790 0x7f62f4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53444/0 (socket says 172.21.15.98:53444) 2024-09-19T07:20:23.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62f936e640 1 -- 172.21.15.98:0/2446194334 learned_addr learned my addr 172.21.15.98:0/2446194334 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:23.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62f9b6f640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62f4101de0 0x7f62f40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:23.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62fa370640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f4106f10 0x7f62f4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:23.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62f936e640 1 -- 172.21.15.98:0/2446194334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f4106f10 msgr2=0x7f62f4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:23.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62f936e640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f4106f10 0x7f62f4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:23.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62f936e640 1 -- 172.21.15.98:0/2446194334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62f4101de0 msgr2=0x7f62f40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:23.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62f936e640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62f4101de0 0x7f62f40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:23.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62f936e640 1 -- 172.21.15.98:0/2446194334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f41a6820 con 0x7f62f4102790 2024-09-19T07:20:23.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62fa370640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f4106f10 0x7f62f4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:23.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62f9b6f640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62f4101de0 0x7f62f40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:23.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.343+0000 7f62f936e640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62f4102790 0x7f62f4074a30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f62e802ade0 tx=0x7f62e80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:23.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.344+0000 7f62f2ffd640 1 -- 172.21.15.98:0/2446194334 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e802fa20 con 0x7f62f4102790 2024-09-19T07:20:23.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.344+0000 7f62f2ffd640 1 -- 172.21.15.98:0/2446194334 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62e802fbc0 con 0x7f62f4102790 2024-09-19T07:20:23.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.344+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2446194334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f41a6ab0 con 0x7f62f4102790 2024-09-19T07:20:23.401 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.344+0000 7f62f2ffd640 1 -- 172.21.15.98:0/2446194334 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e80467b0 con 0x7f62f4102790 2024-09-19T07:20:23.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.344+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2446194334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f41a6ff0 con 0x7f62f4102790 2024-09-19T07:20:23.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.345+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2446194334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f41021c0 con 0x7f62f4102790 2024-09-19T07:20:23.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.346+0000 7f62f2ffd640 1 -- 172.21.15.98:0/2446194334 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f62e8046950 con 0x7f62f4102790 2024-09-19T07:20:23.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.346+0000 7f62f2ffd640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f62dc0a3240 0x7f62dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:23.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.346+0000 7f62f9b6f640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f62dc0a3240 0x7f62dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:23.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.346+0000 7f62f2ffd640 1 -- 172.21.15.98:0/2446194334 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f62e80f0d70 con 0x7f62f4102790 2024-09-19T07:20:23.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.347+0000 7f62f9b6f640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f62dc0a3240 0x7f62dc0a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00abe0 tx=0x7f62ec00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:23.402 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.350+0000 7f62f2ffd640 1 -- 172.21.15.98:0/2446194334 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f62e80453e0 con 0x7f62f4102790 2024-09-19T07:20:23.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.520+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2446194334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62f4109b60 con 0x7f62f4102790 2024-09-19T07:20:23.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.521+0000 7f62f2ffd640 1 -- 172.21.15.98:0/2446194334 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22290 (secure 0 0 0) 0x7f62e80bdc70 con 0x7f62f4102790 2024-09-19T07:20:23.522 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:23.522 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":78,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:20:20.076793+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:20:16.391879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:20:18.243837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:20:23.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.524+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2446194334 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f62dc0a3240 msgr2=0x7f62dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.524+0000 7f62fbdd3640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f62dc0a3240 0x7f62dc0a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00abe0 tx=0x7f62ec00a5c0 comp rx=0 tx=0).stop 2024-09-19T07:20:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.524+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2446194334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62f4102790 msgr2=0x7f62f4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.524+0000 7f62fbdd3640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62f4102790 0x7f62f4074a30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f62e802ade0 tx=0x7f62e80319f0 comp rx=0 tx=0).stop 2024-09-19T07:20:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.524+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2446194334 shutdown_connections 2024-09-19T07:20:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.524+0000 7f62fbdd3640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f62dc0a3240 0x7f62dc0a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.524+0000 7f62fbdd3640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f4106f10 0x7f62f4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.524+0000 7f62fbdd3640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f62f4102790 0x7f62f4074a30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.524+0000 7f62fbdd3640 1 --2- 172.21.15.98:0/2446194334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f62f4101de0 0x7f62f40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.524+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2446194334 >> 172.21.15.98:0/2446194334 conn(0x7f62f40fd8c0 msgr2=0x7f62f40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.524+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2446194334 shutdown_connections 2024-09-19T07:20:23.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:23.524+0000 7f62fbdd3640 1 -- 172.21.15.98:0/2446194334 wait complete. 2024-09-19T07:20:23.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:23 smithi098 ceph-mon[30950]: pgmap v271: 97 pgs: 4 creating+activating, 8 creating+peering, 11 unknown, 74 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 2 op/s 2024-09-19T07:20:23.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:23 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2446194334' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:23.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:23 smithi139 ceph-mon[35039]: pgmap v271: 97 pgs: 4 creating+activating, 8 creating+peering, 11 unknown, 74 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 2 op/s 2024-09-19T07:20:23.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:23 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2446194334' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:23.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:23 smithi162 ceph-mon[35726]: pgmap v271: 97 pgs: 4 creating+activating, 8 creating+peering, 11 unknown, 74 active+clean; 577 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 2 op/s 2024-09-19T07:20:23.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:23 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2446194334' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:24.147 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T07:20:24.393 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:24.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.855+0000 7f906e7b4640 1 -- 172.21.15.98:0/1199153400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9068101bc0 msgr2=0x7f906810d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:24.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.855+0000 7f906e7b4640 1 --2- 172.21.15.98:0/1199153400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9068101bc0 0x7f906810d910 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9060009ca0 tx=0x7f906002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.855+0000 7f906e7b4640 1 -- 172.21.15.98:0/1199153400 shutdown_connections 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.855+0000 7f906e7b4640 1 --2- 172.21.15.98:0/1199153400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9068101bc0 0x7f906810d910 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.855+0000 7f906e7b4640 1 --2- 172.21.15.98:0/1199153400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9068101240 0x7f9068101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.855+0000 7f906e7b4640 1 --2- 172.21.15.98:0/1199153400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9068105a90 0x7f9068105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.855+0000 7f906e7b4640 1 -- 172.21.15.98:0/1199153400 >> 172.21.15.98:0/1199153400 conn(0x7f9068077210 msgr2=0x7f90680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.855+0000 7f906e7b4640 1 -- 172.21.15.98:0/1199153400 shutdown_connections 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.855+0000 7f906e7b4640 1 -- 172.21.15.98:0/1199153400 wait complete. 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f906e7b4640 1 Processor -- start 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f906e7b4640 1 -- start start 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f906e7b4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9068101240 0x7f90681972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f906e7b4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9068101bc0 0x7f9068197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f906e7b4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9068105a90 0x7f906819bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:24.882 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f906e7b4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9068110f70 con 0x7f9068101bc0 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f906e7b4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9068110df0 con 0x7f9068101240 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f906e7b4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90681110f0 con 0x7f9068105a90 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f90677fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9068101bc0 0x7f9068197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f90677fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9068101bc0 0x7f9068197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53460/0 (socket says 172.21.15.98:53460) 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f90677fe640 1 -- 172.21.15.98:0/1266575227 learned_addr learned my addr 172.21.15.98:0/1266575227 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f906cd51640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9068105a90 0x7f906819bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f9067fff640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9068101240 0x7f90681972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f90677fe640 1 -- 172.21.15.98:0/1266575227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9068105a90 msgr2=0x7f906819bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f90677fe640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9068105a90 0x7f906819bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f90677fe640 1 -- 172.21.15.98:0/1266575227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9068101240 msgr2=0x7f90681972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f90677fe640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9068101240 0x7f90681972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.856+0000 7f90677fe640 1 -- 172.21.15.98:0/1266575227 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906819c280 con 0x7f9068101bc0 2024-09-19T07:20:24.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.857+0000 7f90677fe640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9068101bc0 0x7f9068197810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f905c00c890 tx=0x7f905c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.857+0000 7f90657fa640 1 -- 172.21.15.98:0/1266575227 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905c004220 con 0x7f9068101bc0 2024-09-19T07:20:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.857+0000 7f90657fa640 1 -- 172.21.15.98:0/1266575227 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f905c0043c0 con 0x7f9068101bc0 2024-09-19T07:20:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.857+0000 7f906e7b4640 1 -- 172.21.15.98:0/1266575227 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906819c570 con 0x7f9068101bc0 2024-09-19T07:20:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.857+0000 7f90657fa640 1 -- 172.21.15.98:0/1266575227 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905c0049e0 con 0x7f9068101bc0 2024-09-19T07:20:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.857+0000 7f906e7b4640 1 -- 172.21.15.98:0/1266575227 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90681a3e50 con 0x7f9068101bc0 2024-09-19T07:20:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.858+0000 7f906e7b4640 1 -- 172.21.15.98:0/1266575227 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9068101680 con 0x7f9068101bc0 2024-09-19T07:20:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.859+0000 7f90657fa640 1 -- 172.21.15.98:0/1266575227 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f905c0079b0 con 0x7f9068101bc0 2024-09-19T07:20:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.860+0000 7f90657fa640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f90500a3240 0x7f90500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.860+0000 7f9067fff640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f90500a3240 0x7f90500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.860+0000 7f90657fa640 1 -- 172.21.15.98:0/1266575227 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f905c0cf8d0 con 0x7f9068101bc0 2024-09-19T07:20:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.860+0000 7f9067fff640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f90500a3240 0x7f90500a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9058005e10 tx=0x7f9058005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:24.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:24.864+0000 7f90657fa640 1 -- 172.21.15.98:0/1266575227 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f905c014030 con 0x7f9068101bc0 2024-09-19T07:20:25.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.066+0000 7f906e7b4640 1 -- 172.21.15.98:0/1266575227 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f90681a4050 con 0x7f9068101bc0 2024-09-19T07:20:25.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.703+0000 7f90657fa640 1 -- 172.21.15.98:0/1266575227 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f905c09c740 con 0x7f9068101bc0 2024-09-19T07:20:25.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.706+0000 7f906e7b4640 1 -- 172.21.15.98:0/1266575227 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f90500a3240 msgr2=0x7f90500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:25.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.706+0000 7f906e7b4640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f90500a3240 0x7f90500a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9058005e10 tx=0x7f9058005da0 comp rx=0 tx=0).stop 2024-09-19T07:20:25.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.706+0000 7f906e7b4640 1 -- 172.21.15.98:0/1266575227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9068101bc0 msgr2=0x7f9068197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.706+0000 7f906e7b4640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9068101bc0 0x7f9068197810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f905c00c890 tx=0x7f905c00cd50 comp rx=0 tx=0).stop 2024-09-19T07:20:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.707+0000 7f906e7b4640 1 -- 172.21.15.98:0/1266575227 shutdown_connections 2024-09-19T07:20:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.707+0000 7f906e7b4640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f90500a3240 0x7f90500a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.707+0000 7f906e7b4640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9068105a90 0x7f906819bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.707+0000 7f906e7b4640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9068101bc0 0x7f9068197810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.707+0000 7f906e7b4640 1 --2- 172.21.15.98:0/1266575227 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9068101240 0x7f90681972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.707+0000 7f906e7b4640 1 -- 172.21.15.98:0/1266575227 >> 172.21.15.98:0/1266575227 conn(0x7f9068077210 msgr2=0x7f9068103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.707+0000 7f906e7b4640 1 -- 172.21.15.98:0/1266575227 shutdown_connections 2024-09-19T07:20:25.708 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:25.707+0000 7f906e7b4640 1 -- 172.21.15.98:0/1266575227 wait complete. 2024-09-19T07:20:25.994 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:25 smithi098 ceph-mon[30950]: pgmap v272: 97 pgs: 97 active+clean; 578 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-19T07:20:25.994 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:25 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1266575227' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T07:20:26.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:25 smithi139 ceph-mon[35039]: pgmap v272: 97 pgs: 97 active+clean; 578 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-19T07:20:26.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:25 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1266575227' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T07:20:26.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:25 smithi162 ceph-mon[35726]: pgmap v272: 97 pgs: 97 active+clean; 578 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-19T07:20:26.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:25 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1266575227' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T07:20:26.305 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T07:20:26.306 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-19T07:20:26.553 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:26.931 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:26 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1266575227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T07:20:26.931 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:26 smithi098 ceph-mon[30950]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T07:20:27.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.011+0000 7f9229175640 1 -- 172.21.15.98:0/1949731715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f922410c170 msgr2=0x7f922410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:27.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.011+0000 7f9229175640 1 --2- 172.21.15.98:0/1949731715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f922410c170 0x7f922410e610 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f921c009ca0 tx=0x7f921c02a950 comp rx=0 tx=0).stop 2024-09-19T07:20:27.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.011+0000 7f9229175640 1 -- 172.21.15.98:0/1949731715 shutdown_connections 2024-09-19T07:20:27.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.011+0000 7f9229175640 1 --2- 172.21.15.98:0/1949731715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f922410c170 0x7f922410e610 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.011+0000 7f9229175640 1 --2- 172.21.15.98:0/1949731715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9224103660 0x7f922410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.011+0000 7f9229175640 1 --2- 172.21.15.98:0/1949731715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9224102d40 0x7f9224103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.011+0000 7f9229175640 1 -- 172.21.15.98:0/1949731715 >> 172.21.15.98:0/1949731715 conn(0x7f92240fc7a0 msgr2=0x7f92240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.011+0000 7f9229175640 1 -- 172.21.15.98:0/1949731715 shutdown_connections 2024-09-19T07:20:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.011+0000 7f9229175640 1 -- 172.21.15.98:0/1949731715 wait complete. 2024-09-19T07:20:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.012+0000 7f9229175640 1 Processor -- start 2024-09-19T07:20:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.012+0000 7f9229175640 1 -- start start 2024-09-19T07:20:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.012+0000 7f9229175640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9224102d40 0x7f9224198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.012+0000 7f9229175640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103660 0x7f92241989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.012+0000 7f9229175640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f922410c170 0x7f922419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.012+0000 7f9229175640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9224111fd0 con 0x7f9224103660 2024-09-19T07:20:27.023 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.012+0000 7f9229175640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9224111e50 con 0x7f9224102d40 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.012+0000 7f9229175640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9224112150 con 0x7f922410c170 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.012+0000 7f922259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103660 0x7f92241989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.012+0000 7f922259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103660 0x7f92241989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53464/0 (socket says 172.21.15.98:53464) 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.012+0000 7f922259c640 1 -- 172.21.15.98:0/2566756335 learned_addr learned my addr 172.21.15.98:0/2566756335 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f922359e640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f922410c170 0x7f922419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f9222d9d640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9224102d40 0x7f9224198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f922259c640 1 -- 172.21.15.98:0/2566756335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f922410c170 msgr2=0x7f922419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f922259c640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f922410c170 0x7f922419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f922259c640 1 -- 172.21.15.98:0/2566756335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9224102d40 msgr2=0x7f9224198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f922259c640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9224102d40 0x7f9224198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f922259c640 1 -- 172.21.15.98:0/2566756335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922419d420 con 0x7f9224103660 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f9222d9d640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9224102d40 0x7f9224198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:27.024 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f922259c640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103660 0x7f92241989b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f921400d750 tx=0x7f921400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:27.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f920bfff640 1 -- 172.21.15.98:0/2566756335 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214017070 con 0x7f9224103660 2024-09-19T07:20:27.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f920bfff640 1 -- 172.21.15.98:0/2566756335 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9214005020 con 0x7f9224103660 2024-09-19T07:20:27.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f920bfff640 1 -- 172.21.15.98:0/2566756335 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214004d00 con 0x7f9224103660 2024-09-19T07:20:27.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f9229175640 1 -- 172.21.15.98:0/2566756335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922419d710 con 0x7f9224103660 2024-09-19T07:20:27.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.013+0000 7f9229175640 1 -- 172.21.15.98:0/2566756335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92241a4ff0 con 0x7f9224103660 2024-09-19T07:20:27.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.014+0000 7f9229175640 1 -- 172.21.15.98:0/2566756335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9224103120 con 0x7f9224103660 2024-09-19T07:20:27.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.016+0000 7f920bfff640 1 -- 172.21.15.98:0/2566756335 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9214009a30 con 0x7f9224103660 2024-09-19T07:20:27.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.017+0000 7f920bfff640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f920c0a3240 0x7f920c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:27.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.017+0000 7f9222d9d640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f920c0a3240 0x7f920c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:27.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.017+0000 7f920bfff640 1 -- 172.21.15.98:0/2566756335 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f92140cf6d0 con 0x7f9224103660 2024-09-19T07:20:27.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.017+0000 7f9222d9d640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f920c0a3240 0x7f920c0a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9218009930 tx=0x7f9218008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:27.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.020+0000 7f920bfff640 1 -- 172.21.15.98:0/2566756335 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f921409c4a0 con 0x7f9224103660 2024-09-19T07:20:27.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:26 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1266575227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T07:20:27.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:26 smithi139 ceph-mon[35039]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T07:20:27.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:26 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1266575227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T07:20:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:26 smithi162 ceph-mon[35726]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T07:20:27.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.219+0000 7f9229175640 1 -- 172.21.15.98:0/2566756335 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f92241071e0 con 0x7f9224103660 2024-09-19T07:20:27.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.725+0000 7f920bfff640 1 -- 172.21.15.98:0/2566756335 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7f921409bda0 con 0x7f9224103660 2024-09-19T07:20:27.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.728+0000 7f9229175640 1 -- 172.21.15.98:0/2566756335 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f920c0a3240 msgr2=0x7f920c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:27.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.728+0000 7f9229175640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f920c0a3240 0x7f920c0a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9218009930 tx=0x7f9218008040 comp rx=0 tx=0).stop 2024-09-19T07:20:27.728 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.728+0000 7f9229175640 1 -- 172.21.15.98:0/2566756335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103660 msgr2=0x7f92241989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.728+0000 7f9229175640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103660 0x7f92241989b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f921400d750 tx=0x7f921400dc10 comp rx=0 tx=0).stop 2024-09-19T07:20:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.728+0000 7f9229175640 1 -- 172.21.15.98:0/2566756335 shutdown_connections 2024-09-19T07:20:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.728+0000 7f9229175640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f920c0a3240 0x7f920c0a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.728+0000 7f9229175640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f922410c170 0x7f922419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.728+0000 7f9229175640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103660 0x7f92241989b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.728+0000 7f9229175640 1 --2- 172.21.15.98:0/2566756335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9224102d40 0x7f9224198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.728+0000 7f9229175640 1 -- 172.21.15.98:0/2566756335 >> 172.21.15.98:0/2566756335 conn(0x7f92240fc7a0 msgr2=0x7f92240fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.728+0000 7f9229175640 1 -- 172.21.15.98:0/2566756335 shutdown_connections 2024-09-19T07:20:27.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:27.728+0000 7f9229175640 1 -- 172.21.15.98:0/2566756335 wait complete. 2024-09-19T07:20:28.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:27 smithi098 ceph-mon[30950]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T07:20:28.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:27 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2566756335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T07:20:28.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:27 smithi139 ceph-mon[35039]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T07:20:28.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:27 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2566756335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T07:20:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:27 smithi162 ceph-mon[35726]: pgmap v273: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T07:20:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:27 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2566756335' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T07:20:28.375 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T07:20:28.624 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:28.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:28 smithi162 ceph-mon[35726]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T07:20:28.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:28 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2566756335' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T07:20:28.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:28 smithi162 ceph-mon[35726]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T07:20:28.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:28 smithi162 ceph-mon[35726]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T07:20:28.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:28 smithi162 ceph-mon[35726]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-19T07:20:28.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:28 smithi162 ceph-mon[35726]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-19T07:20:29.022 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:28 smithi098 ceph-mon[30950]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T07:20:29.022 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:28 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2566756335' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T07:20:29.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:28 smithi098 ceph-mon[30950]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T07:20:29.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:28 smithi098 ceph-mon[30950]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T07:20:29.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:28 smithi098 ceph-mon[30950]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-19T07:20:29.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:28 smithi098 ceph-mon[30950]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-19T07:20:29.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:28 smithi139 ceph-mon[35039]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T07:20:29.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:28 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2566756335' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T07:20:29.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:28 smithi139 ceph-mon[35039]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T07:20:29.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:28 smithi139 ceph-mon[35039]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T07:20:29.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:28 smithi139 ceph-mon[35039]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-19T07:20:29.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:28 smithi139 ceph-mon[35039]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-19T07:20:29.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.102+0000 7f134310d640 1 -- 172.21.15.98:0/1772380437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c106a80 msgr2=0x7f133c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:29.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.102+0000 7f134310d640 1 --2- 172.21.15.98:0/1772380437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c106a80 0x7f133c106e60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1330009930 tx=0x7f133002a420 comp rx=0 tx=0).stop 2024-09-19T07:20:29.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.102+0000 7f134310d640 1 -- 172.21.15.98:0/1772380437 shutdown_connections 2024-09-19T07:20:29.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.102+0000 7f134310d640 1 --2- 172.21.15.98:0/1772380437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c101420 0x7f133c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:29.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.102+0000 7f134310d640 1 --2- 172.21.15.98:0/1772380437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f133c100a80 0x7f133c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:29.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.102+0000 7f134310d640 1 --2- 172.21.15.98:0/1772380437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c106a80 0x7f133c106e60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:29.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.102+0000 7f134310d640 1 -- 172.21.15.98:0/1772380437 >> 172.21.15.98:0/1772380437 conn(0x7f133c0fc7a0 msgr2=0x7f133c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:29.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.102+0000 7f134310d640 1 -- 172.21.15.98:0/1772380437 shutdown_connections 2024-09-19T07:20:29.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.102+0000 7f134310d640 1 -- 172.21.15.98:0/1772380437 wait complete. 2024-09-19T07:20:29.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.102+0000 7f134310d640 1 Processor -- start 2024-09-19T07:20:29.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f134310d640 1 -- start start 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f134310d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f133c100a80 0x7f133c102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f134310d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c101420 0x7f133c102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f134310d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c106a80 0x7f133c1030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f134310d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f133c110f20 con 0x7f133c106a80 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f134310d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f133c110da0 con 0x7f133c101420 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f134310d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f133c1110a0 con 0x7f133c100a80 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f13416aa640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c106a80 0x7f133c1030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f13416aa640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c106a80 0x7f133c1030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53484/0 (socket says 172.21.15.98:53484) 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f13416aa640 1 -- 172.21.15.98:0/4291378339 learned_addr learned my addr 172.21.15.98:0/4291378339 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f1340ea9640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f133c100a80 0x7f133c102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f133bfff640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c101420 0x7f133c102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f13416aa640 1 -- 172.21.15.98:0/4291378339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f133c100a80 msgr2=0x7f133c102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:29.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f13416aa640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f133c100a80 0x7f133c102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f13416aa640 1 -- 172.21.15.98:0/4291378339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c101420 msgr2=0x7f133c102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f13416aa640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c101420 0x7f133c102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f13416aa640 1 -- 172.21.15.98:0/4291378339 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133c1a6a60 con 0x7f133c106a80 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f1340ea9640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f133c100a80 0x7f133c102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f133bfff640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c101420 0x7f133c102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f13416aa640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c106a80 0x7f133c1030d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f133400b970 tx=0x7f133400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f1339ffb640 1 -- 172.21.15.98:0/4291378339 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1334019070 con 0x7f133c106a80 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f1339ffb640 1 -- 172.21.15.98:0/4291378339 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f133400cb40 con 0x7f133c106a80 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f1339ffb640 1 -- 172.21.15.98:0/4291378339 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1334007650 con 0x7f133c106a80 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.103+0000 7f134310d640 1 -- 172.21.15.98:0/4291378339 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f133c1a6d50 con 0x7f133c106a80 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.104+0000 7f134310d640 1 -- 172.21.15.98:0/4291378339 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f133c1a7240 con 0x7f133c106a80 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.105+0000 7f134310d640 1 -- 172.21.15.98:0/4291378339 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f133c100f60 con 0x7f133c106a80 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.106+0000 7f1339ffb640 1 -- 172.21.15.98:0/4291378339 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f133401c070 con 0x7f133c106a80 2024-09-19T07:20:29.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.106+0000 7f1339ffb640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f132c0a3240 0x7f132c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:29.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.106+0000 7f1340ea9640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f132c0a3240 0x7f132c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:29.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.106+0000 7f1339ffb640 1 -- 172.21.15.98:0/4291378339 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f13340cee50 con 0x7f133c106a80 2024-09-19T07:20:29.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.107+0000 7f1340ea9640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f132c0a3240 0x7f132c0a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1330000c00 tx=0x7f1330005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:29.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.110+0000 7f1339ffb640 1 -- 172.21.15.98:0/4291378339 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f133409bcc0 con 0x7f133c106a80 2024-09-19T07:20:29.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.312+0000 7f134310d640 1 -- 172.21.15.98:0/4291378339 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f133c1a74d0 con 0x7f133c106a80 2024-09-19T07:20:29.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.749+0000 7f1339ffb640 1 -- 172.21.15.98:0/4291378339 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f133409b5c0 con 0x7f133c106a80 2024-09-19T07:20:29.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.751+0000 7f134310d640 1 -- 172.21.15.98:0/4291378339 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f132c0a3240 msgr2=0x7f132c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:29.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.751+0000 7f134310d640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f132c0a3240 0x7f132c0a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1330000c00 tx=0x7f1330005a20 comp rx=0 tx=0).stop 2024-09-19T07:20:29.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.751+0000 7f134310d640 1 -- 172.21.15.98:0/4291378339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c106a80 msgr2=0x7f133c1030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:29.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.751+0000 7f134310d640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c106a80 0x7f133c1030d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f133400b970 tx=0x7f133400be30 comp rx=0 tx=0).stop 2024-09-19T07:20:29.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.751+0000 7f134310d640 1 -- 172.21.15.98:0/4291378339 shutdown_connections 2024-09-19T07:20:29.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.751+0000 7f134310d640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f132c0a3240 0x7f132c0a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:29.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.751+0000 7f134310d640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f133c106a80 0x7f133c1030d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:29.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.751+0000 7f134310d640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f133c101420 0x7f133c102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:29.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.751+0000 7f134310d640 1 --2- 172.21.15.98:0/4291378339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f133c100a80 0x7f133c102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:29.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.751+0000 7f134310d640 1 -- 172.21.15.98:0/4291378339 >> 172.21.15.98:0/4291378339 conn(0x7f133c0fc7a0 msgr2=0x7f133c1048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:29.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.751+0000 7f134310d640 1 -- 172.21.15.98:0/4291378339 shutdown_connections 2024-09-19T07:20:29.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:29.751+0000 7f134310d640 1 -- 172.21.15.98:0/4291378339 wait complete. 2024-09-19T07:20:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:29 smithi098 ceph-mon[30950]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-19T07:20:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:29 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] up:active 2024-09-19T07:20:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:29 smithi098 ceph-mon[30950]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T07:20:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:29 smithi098 ceph-mon[30950]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T07:20:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:29 smithi098 ceph-mon[30950]: Cluster is now healthy 2024-09-19T07:20:30.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:29 smithi098 ceph-mon[30950]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-19T07:20:30.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:29 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-19T07:20:30.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:29 smithi098 ceph-mon[30950]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-19T07:20:30.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:29 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4291378339' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T07:20:30.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:29 smithi139 ceph-mon[35039]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-19T07:20:30.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:29 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] up:active 2024-09-19T07:20:30.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:29 smithi139 ceph-mon[35039]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T07:20:30.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:29 smithi139 ceph-mon[35039]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T07:20:30.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:29 smithi139 ceph-mon[35039]: Cluster is now healthy 2024-09-19T07:20:30.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:29 smithi139 ceph-mon[35039]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-19T07:20:30.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:29 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-19T07:20:30.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:29 smithi139 ceph-mon[35039]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-19T07:20:30.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:29 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4291378339' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T07:20:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:29 smithi162 ceph-mon[35726]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-19T07:20:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:29 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] up:active 2024-09-19T07:20:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:29 smithi162 ceph-mon[35726]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T07:20:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:29 smithi162 ceph-mon[35726]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T07:20:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:29 smithi162 ceph-mon[35726]: Cluster is now healthy 2024-09-19T07:20:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:29 smithi162 ceph-mon[35726]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-19T07:20:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:29 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-19T07:20:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:29 smithi162 ceph-mon[35726]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-19T07:20:30.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:29 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4291378339' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T07:20:30.413 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T07:20:30.674 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:31.014 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:30 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4291378339' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T07:20:31.014 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:30 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] up:active 2024-09-19T07:20:31.014 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:30 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-19T07:20:31.014 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:30 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:20:31.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:30 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4291378339' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T07:20:31.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:30 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] up:active 2024-09-19T07:20:31.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:30 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-19T07:20:31.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:30 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:20:31.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.098+0000 7fbf3b868640 1 -- 172.21.15.98:0/3823474418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34100b30 msgr2=0x7fbf34100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:31.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.098+0000 7fbf3b868640 1 --2- 172.21.15.98:0/3823474418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34100b30 0x7fbf34100f10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009900 tx=0x7fbf3002a470 comp rx=0 tx=0).stop 2024-09-19T07:20:31.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.098+0000 7fbf3b868640 1 -- 172.21.15.98:0/3823474418 shutdown_connections 2024-09-19T07:20:31.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.098+0000 7fbf3b868640 1 --2- 172.21.15.98:0/3823474418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf34105f40 0x7fbf341063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:31.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.098+0000 7fbf3b868640 1 --2- 172.21.15.98:0/3823474418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf34101450 0x7fbf34105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:31.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.098+0000 7fbf3b868640 1 --2- 172.21.15.98:0/3823474418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34100b30 0x7fbf34100f10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:31.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.098+0000 7fbf3b868640 1 -- 172.21.15.98:0/3823474418 >> 172.21.15.98:0/3823474418 conn(0x7fbf340fc7a0 msgr2=0x7fbf340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:31.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.098+0000 7fbf3b868640 1 -- 172.21.15.98:0/3823474418 shutdown_connections 2024-09-19T07:20:31.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.098+0000 7fbf3b868640 1 -- 172.21.15.98:0/3823474418 wait complete. 2024-09-19T07:20:31.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.099+0000 7fbf3b868640 1 Processor -- start 2024-09-19T07:20:31.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.099+0000 7fbf3b868640 1 -- start start 2024-09-19T07:20:31.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.099+0000 7fbf3b868640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf34100b30 0x7fbf341a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:31.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.099+0000 7fbf3b868640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf34101450 0x7fbf341a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:31.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.099+0000 7fbf3b868640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34105f40 0x7fbf3419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:31.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.099+0000 7fbf3b868640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbf34118550 con 0x7fbf34105f40 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.099+0000 7fbf3b868640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbf341183d0 con 0x7fbf34100b30 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.099+0000 7fbf3b868640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbf341186d0 con 0x7fbf34101450 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.099+0000 7fbf39e05640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34105f40 0x7fbf3419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.099+0000 7fbf39e05640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34105f40 0x7fbf3419e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53512/0 (socket says 172.21.15.98:53512) 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.099+0000 7fbf39e05640 1 -- 172.21.15.98:0/4000531375 learned_addr learned my addr 172.21.15.98:0/4000531375 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf38e03640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf34101450 0x7fbf341a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf39604640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf34100b30 0x7fbf341a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf39e05640 1 -- 172.21.15.98:0/4000531375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf34101450 msgr2=0x7fbf341a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf39e05640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf34101450 0x7fbf341a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf39e05640 1 -- 172.21.15.98:0/4000531375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf34100b30 msgr2=0x7fbf341a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf39e05640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf34100b30 0x7fbf341a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf39e05640 1 -- 172.21.15.98:0/4000531375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3419efe0 con 0x7fbf34105f40 2024-09-19T07:20:31.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf38e03640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf34101450 0x7fbf341a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf39604640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf34100b30 0x7fbf341a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf39e05640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34105f40 0x7fbf3419e8b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00eaa0 tx=0x7fbf2c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf2a7fc640 1 -- 172.21.15.98:0/4000531375 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c00cdb0 con 0x7fbf34105f40 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf3b868640 1 -- 172.21.15.98:0/4000531375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3419f2d0 con 0x7fbf34105f40 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf2a7fc640 1 -- 172.21.15.98:0/4000531375 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf2c005020 con 0x7fbf34105f40 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf2a7fc640 1 -- 172.21.15.98:0/4000531375 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0116b0 con 0x7fbf34105f40 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.100+0000 7fbf3b868640 1 -- 172.21.15.98:0/4000531375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf341ab5c0 con 0x7fbf34105f40 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.101+0000 7fbf3b868640 1 -- 172.21.15.98:0/4000531375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf34105920 con 0x7fbf34105f40 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.102+0000 7fbf2a7fc640 1 -- 172.21.15.98:0/4000531375 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbf2c005560 con 0x7fbf34105f40 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.103+0000 7fbf2a7fc640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbf200a3240 0x7fbf200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.103+0000 7fbf39604640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbf200a3240 0x7fbf200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.103+0000 7fbf2a7fc640 1 -- 172.21.15.98:0/4000531375 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fbf2c0cfa60 con 0x7fbf34105f40 2024-09-19T07:20:31.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.103+0000 7fbf39604640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbf200a3240 0x7fbf200a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbf30000c00 tx=0x7fbf30032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:31.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.107+0000 7fbf2a7fc640 1 -- 172.21.15.98:0/4000531375 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbf2c016030 con 0x7fbf34105f40 2024-09-19T07:20:31.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:30 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4291378339' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T07:20:31.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:30 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] up:active 2024-09-19T07:20:31.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:30 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-19T07:20:31.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:30 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:20:31.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.307+0000 7fbf3b868640 1 -- 172.21.15.98:0/4000531375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fbf341ab950 con 0x7fbf34105f40 2024-09-19T07:20:31.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.764+0000 7fbf2a7fc640 1 -- 172.21.15.98:0/4000531375 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7fbf2c09c8d0 con 0x7fbf34105f40 2024-09-19T07:20:31.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.766+0000 7fbf3b868640 1 -- 172.21.15.98:0/4000531375 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbf200a3240 msgr2=0x7fbf200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:31.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.766+0000 7fbf3b868640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbf200a3240 0x7fbf200a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbf30000c00 tx=0x7fbf30032c70 comp rx=0 tx=0).stop 2024-09-19T07:20:31.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.766+0000 7fbf3b868640 1 -- 172.21.15.98:0/4000531375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34105f40 msgr2=0x7fbf3419e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:31.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.766+0000 7fbf3b868640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34105f40 0x7fbf3419e8b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00eaa0 tx=0x7fbf2c00ef60 comp rx=0 tx=0).stop 2024-09-19T07:20:31.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.767+0000 7fbf3b868640 1 -- 172.21.15.98:0/4000531375 shutdown_connections 2024-09-19T07:20:31.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.767+0000 7fbf3b868640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbf200a3240 0x7fbf200a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:31.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.767+0000 7fbf3b868640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf34105f40 0x7fbf3419e8b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:31.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.767+0000 7fbf3b868640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf34101450 0x7fbf341a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:31.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.767+0000 7fbf3b868640 1 --2- 172.21.15.98:0/4000531375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbf34100b30 0x7fbf341a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:31.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.767+0000 7fbf3b868640 1 -- 172.21.15.98:0/4000531375 >> 172.21.15.98:0/4000531375 conn(0x7fbf340fc7a0 msgr2=0x7fbf3410f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:31.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.767+0000 7fbf3b868640 1 -- 172.21.15.98:0/4000531375 shutdown_connections 2024-09-19T07:20:31.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:31.767+0000 7fbf3b868640 1 -- 172.21.15.98:0/4000531375 wait complete. 2024-09-19T07:20:32.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:31 smithi098 ceph-mon[30950]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-19T07:20:32.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:31 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4000531375' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T07:20:32.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:31 smithi139 ceph-mon[35039]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-19T07:20:32.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:31 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4000531375' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T07:20:32.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:31 smithi162 ceph-mon[35726]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-19T07:20:32.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:31 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4000531375' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T07:20:32.374 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T07:20:32.374 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T07:20:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:33.014 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:32 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4000531375' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T07:20:33.014 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:32 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:20:33.014 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:32 smithi098 ceph-mon[30950]: pgmap v276: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 3.1 KiB/s wr, 10 op/s 2024-09-19T07:20:33.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:32 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4000531375' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T07:20:33.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:32 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:20:33.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:32 smithi139 ceph-mon[35039]: pgmap v276: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 3.1 KiB/s wr, 10 op/s 2024-09-19T07:20:33.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.096+0000 7fa71e138640 1 -- 172.21.15.98:0/783190734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa718102dd0 msgr2=0x7fa7181031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.096+0000 7fa71e138640 1 --2- 172.21.15.98:0/783190734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa718102dd0 0x7fa7181031b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa708009900 tx=0x7fa70802a480 comp rx=0 tx=0).stop 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.096+0000 7fa71e138640 1 -- 172.21.15.98:0/783190734 shutdown_connections 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.096+0000 7fa71e138640 1 --2- 172.21.15.98:0/783190734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71810c1b0 0x7fa71810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.096+0000 7fa71e138640 1 --2- 172.21.15.98:0/783190734 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7181036f0 0x7fa71810bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.096+0000 7fa71e138640 1 --2- 172.21.15.98:0/783190734 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa718102dd0 0x7fa7181031b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.096+0000 7fa71e138640 1 -- 172.21.15.98:0/783190734 >> 172.21.15.98:0/783190734 conn(0x7fa7180fc7d0 msgr2=0x7fa7180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.096+0000 7fa71e138640 1 -- 172.21.15.98:0/783190734 shutdown_connections 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.096+0000 7fa71e138640 1 -- 172.21.15.98:0/783190734 wait complete. 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa71e138640 1 Processor -- start 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa71e138640 1 -- start start 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa71e138640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa718102dd0 0x7fa7181985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa71e138640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7181036f0 0x7fa718198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:33.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa71e138640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71810c1b0 0x7fa71819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa71e138640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa718112040 con 0x7fa7181036f0 2024-09-19T07:20:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa71e138640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa718111ec0 con 0x7fa718102dd0 2024-09-19T07:20:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa71e138640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa7181121c0 con 0x7fa71810c1b0 2024-09-19T07:20:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa716ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7181036f0 0x7fa718198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa716ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7181036f0 0x7fa718198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34062/0 (socket says 172.21.15.98:34062) 2024-09-19T07:20:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa716ffd640 1 -- 172.21.15.98:0/2268071057 learned_addr learned my addr 172.21.15.98:0/2268071057 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa7177fe640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa718102dd0 0x7fa7181985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa717fff640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71810c1b0 0x7fa71819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa716ffd640 1 -- 172.21.15.98:0/2268071057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71810c1b0 msgr2=0x7fa71819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa716ffd640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71810c1b0 0x7fa71819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:33.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa716ffd640 1 -- 172.21.15.98:0/2268071057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa718102dd0 msgr2=0x7fa7181985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa716ffd640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa718102dd0 0x7fa7181985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.097+0000 7fa716ffd640 1 -- 172.21.15.98:0/2268071057 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa71819d590 con 0x7fa7181036f0 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.098+0000 7fa716ffd640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7181036f0 0x7fa718198b20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00b4a0 tx=0x7fa70c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.098+0000 7fa714ff9640 1 -- 172.21.15.98:0/2268071057 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c014070 con 0x7fa7181036f0 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.098+0000 7fa714ff9640 1 -- 172.21.15.98:0/2268071057 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa70c010af0 con 0x7fa7181036f0 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.098+0000 7fa71e138640 1 -- 172.21.15.98:0/2268071057 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa71819d880 con 0x7fa7181036f0 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.098+0000 7fa714ff9640 1 -- 172.21.15.98:0/2268071057 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa70c017d10 con 0x7fa7181036f0 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.098+0000 7fa71e138640 1 -- 172.21.15.98:0/2268071057 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7181a5160 con 0x7fa7181036f0 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.099+0000 7fa71e138640 1 -- 172.21.15.98:0/2268071057 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa718103230 con 0x7fa7181036f0 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.100+0000 7fa714ff9640 1 -- 172.21.15.98:0/2268071057 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa70c017070 con 0x7fa7181036f0 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.101+0000 7fa714ff9640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa7000a3240 0x7fa7000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.101+0000 7fa7177fe640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa7000a3240 0x7fa7000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:33.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.101+0000 7fa714ff9640 1 -- 172.21.15.98:0/2268071057 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fa70c0cef20 con 0x7fa7181036f0 2024-09-19T07:20:33.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.101+0000 7fa7177fe640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa7000a3240 0x7fa7000a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa708000c00 tx=0x7fa7080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:33.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.104+0000 7fa714ff9640 1 -- 172.21.15.98:0/2268071057 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa70c09bd90 con 0x7fa7181036f0 2024-09-19T07:20:33.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:32 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4000531375' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T07:20:33.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:32 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:20:33.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:32 smithi162 ceph-mon[35726]: pgmap v276: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 3.1 KiB/s wr, 10 op/s 2024-09-19T07:20:33.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.293+0000 7fa71e138640 1 -- 172.21.15.98:0/2268071057 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa718062630 con 0x7fa7000a3240 2024-09-19T07:20:33.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.314+0000 7fa714ff9640 1 -- 172.21.15.98:0/2268071057 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa718062630 con 0x7fa7000a3240 2024-09-19T07:20:33.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.316+0000 7fa71e138640 1 -- 172.21.15.98:0/2268071057 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa7000a3240 msgr2=0x7fa7000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:33.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.316+0000 7fa71e138640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa7000a3240 0x7fa7000a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa708000c00 tx=0x7fa7080058d0 comp rx=0 tx=0).stop 2024-09-19T07:20:33.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.316+0000 7fa71e138640 1 -- 172.21.15.98:0/2268071057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7181036f0 msgr2=0x7fa718198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:33.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.316+0000 7fa71e138640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7181036f0 0x7fa718198b20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00b4a0 tx=0x7fa70c00b960 comp rx=0 tx=0).stop 2024-09-19T07:20:33.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.316+0000 7fa71e138640 1 -- 172.21.15.98:0/2268071057 shutdown_connections 2024-09-19T07:20:33.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.316+0000 7fa71e138640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa7000a3240 0x7fa7000a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:33.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.316+0000 7fa71e138640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa71810c1b0 0x7fa71819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:33.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.316+0000 7fa71e138640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7181036f0 0x7fa718198b20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:33.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.316+0000 7fa71e138640 1 --2- 172.21.15.98:0/2268071057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa718102dd0 0x7fa7181985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:33.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.316+0000 7fa71e138640 1 -- 172.21.15.98:0/2268071057 >> 172.21.15.98:0/2268071057 conn(0x7fa7180fc7d0 msgr2=0x7fa7180fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:33.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.316+0000 7fa71e138640 1 -- 172.21.15.98:0/2268071057 shutdown_connections 2024-09-19T07:20:33.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:33.316+0000 7fa71e138640 1 -- 172.21.15.98:0/2268071057 wait complete. 2024-09-19T07:20:33.693 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:20:33 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:20:33.298+0000 7ffa3ba10640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:20:33.693 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:20:33 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:20:33.298+0000 7ffa3ba10640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:20:33.693 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:20:33 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:20:33.298+0000 7ffa3ba10640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:20:33.693 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:20:33 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:20:33.298+0000 7ffa3ba10640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:20:33.693 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:20:33 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:20:33.298+0000 7ffa3ba10640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:20:34.001 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:33 smithi098 ceph-mon[30950]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:34.029 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T07:20:34.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:33 smithi139 ceph-mon[35039]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:34.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:33 smithi162 ceph-mon[35726]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:34.275 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:34.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.775+0000 7fbd249c4640 1 -- 172.21.15.98:0/3649459366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd20106f10 msgr2=0x7fbd2010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:34.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.775+0000 7fbd249c4640 1 --2- 172.21.15.98:0/3649459366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd20106f10 0x7fbd2010ea90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009ca0 tx=0x7fbd1802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:20:34.789 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.775+0000 7fbd249c4640 1 -- 172.21.15.98:0/3649459366 shutdown_connections 2024-09-19T07:20:34.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.775+0000 7fbd249c4640 1 --2- 172.21.15.98:0/3649459366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd20106f10 0x7fbd2010ea90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:34.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.775+0000 7fbd249c4640 1 --2- 172.21.15.98:0/3649459366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd20102790 0x7fbd201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:34.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.775+0000 7fbd249c4640 1 --2- 172.21.15.98:0/3649459366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd20101de0 0x7fbd201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:34.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.775+0000 7fbd249c4640 1 -- 172.21.15.98:0/3649459366 >> 172.21.15.98:0/3649459366 conn(0x7fbd200fd8c0 msgr2=0x7fbd200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:34.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.775+0000 7fbd249c4640 1 -- 172.21.15.98:0/3649459366 shutdown_connections 2024-09-19T07:20:34.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.775+0000 7fbd249c4640 1 -- 172.21.15.98:0/3649459366 wait complete. 2024-09-19T07:20:34.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd249c4640 1 Processor -- start 2024-09-19T07:20:34.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd249c4640 1 -- start start 2024-09-19T07:20:34.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd249c4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd20101de0 0x7fbd201983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd249c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd20102790 0x7fbd201988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd249c4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd20106f10 0x7fbd2019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd249c4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20111fc0 con 0x7fbd20101de0 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd249c4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20111e40 con 0x7fbd20106f10 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd249c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20112140 con 0x7fbd20102790 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd1e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd20101de0 0x7fbd201983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd1e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd20101de0 0x7fbd201983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34104/0 (socket says 172.21.15.98:34104) 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd1e59c640 1 -- 172.21.15.98:0/2183664079 learned_addr learned my addr 172.21.15.98:0/2183664079 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd17fff640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd20102790 0x7fbd201988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.776+0000 7fbd1ed9d640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd20106f10 0x7fbd2019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.777+0000 7fbd1e59c640 1 -- 172.21.15.98:0/2183664079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd20102790 msgr2=0x7fbd201988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.777+0000 7fbd1e59c640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd20102790 0x7fbd201988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.777+0000 7fbd1e59c640 1 -- 172.21.15.98:0/2183664079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd20106f10 msgr2=0x7fbd2019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:34.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.777+0000 7fbd1e59c640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd20106f10 0x7fbd2019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:34.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.777+0000 7fbd1e59c640 1 -- 172.21.15.98:0/2183664079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2019d350 con 0x7fbd20101de0 2024-09-19T07:20:34.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.777+0000 7fbd1e59c640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd20101de0 0x7fbd201983a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000d950 tx=0x7fbd1000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:34.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.786+0000 7fbd177fe640 1 -- 172.21.15.98:0/2183664079 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd10017030 con 0x7fbd20101de0 2024-09-19T07:20:34.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.786+0000 7fbd249c4640 1 -- 172.21.15.98:0/2183664079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2019d640 con 0x7fbd20101de0 2024-09-19T07:20:34.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.786+0000 7fbd249c4640 1 -- 172.21.15.98:0/2183664079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd201a4f20 con 0x7fbd20101de0 2024-09-19T07:20:34.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.786+0000 7fbd177fe640 1 -- 172.21.15.98:0/2183664079 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd10004020 con 0x7fbd20101de0 2024-09-19T07:20:34.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.786+0000 7fbd177fe640 1 -- 172.21.15.98:0/2183664079 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd100047a0 con 0x7fbd20101de0 2024-09-19T07:20:34.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.787+0000 7fbd249c4640 1 -- 172.21.15.98:0/2183664079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd201021c0 con 0x7fbd20101de0 2024-09-19T07:20:34.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.788+0000 7fbd177fe640 1 -- 172.21.15.98:0/2183664079 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbd10009a30 con 0x7fbd20101de0 2024-09-19T07:20:34.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.789+0000 7fbd177fe640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbd0c0a32d0 0x7fbd0c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:34.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.789+0000 7fbd17fff640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbd0c0a32d0 0x7fbd0c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:34.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.789+0000 7fbd177fe640 1 -- 172.21.15.98:0/2183664079 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fbd100cf1a0 con 0x7fbd20101de0 2024-09-19T07:20:34.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.789+0000 7fbd17fff640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbd0c0a32d0 0x7fbd0c0a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbd201088e0 tx=0x7fbd0800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:34.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.793+0000 7fbd177fe640 1 -- 172.21.15.98:0/2183664079 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbd10022020 con 0x7fbd20101de0 2024-09-19T07:20:34.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:34.984+0000 7fbd249c4640 1 -- 172.21.15.98:0/2183664079 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fbd20062630 con 0x7fbd0c0a32d0 2024-09-19T07:20:34.985 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:34 smithi098 ceph-mon[30950]: pgmap v277: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-09-19T07:20:35.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.008+0000 7fbd177fe640 1 -- 172.21.15.98:0/2183664079 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbd20062630 con 0x7fbd0c0a32d0 2024-09-19T07:20:35.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.010+0000 7fbd249c4640 1 -- 172.21.15.98:0/2183664079 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbd0c0a32d0 msgr2=0x7fbd0c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:35.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.010+0000 7fbd249c4640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbd0c0a32d0 0x7fbd0c0a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbd201088e0 tx=0x7fbd0800b390 comp rx=0 tx=0).stop 2024-09-19T07:20:35.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.010+0000 7fbd249c4640 1 -- 172.21.15.98:0/2183664079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd20101de0 msgr2=0x7fbd201983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:35.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.010+0000 7fbd249c4640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd20101de0 0x7fbd201983a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000d950 tx=0x7fbd1000de10 comp rx=0 tx=0).stop 2024-09-19T07:20:35.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.010+0000 7fbd249c4640 1 -- 172.21.15.98:0/2183664079 shutdown_connections 2024-09-19T07:20:35.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.010+0000 7fbd249c4640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fbd0c0a32d0 0x7fbd0c0a5790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:35.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.010+0000 7fbd249c4640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd20106f10 0x7fbd2019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:35.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.010+0000 7fbd249c4640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd20102790 0x7fbd201988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:35.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.010+0000 7fbd249c4640 1 --2- 172.21.15.98:0/2183664079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbd20101de0 0x7fbd201983a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:35.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.010+0000 7fbd249c4640 1 -- 172.21.15.98:0/2183664079 >> 172.21.15.98:0/2183664079 conn(0x7fbd200fd8c0 msgr2=0x7fbd200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:35.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.010+0000 7fbd249c4640 1 -- 172.21.15.98:0/2183664079 shutdown_connections 2024-09-19T07:20:35.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:35.010+0000 7fbd249c4640 1 -- 172.21.15.98:0/2183664079 wait complete. 2024-09-19T07:20:35.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:34 smithi139 ceph-mon[35039]: pgmap v277: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-09-19T07:20:35.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:34 smithi162 ceph-mon[35726]: pgmap v277: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2.4 KiB/s wr, 12 op/s 2024-09-19T07:20:35.654 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T07:20:35.901 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:36.052 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:35 smithi098 ceph-mon[30950]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-19T07:20:36.052 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:35 smithi098 ceph-mon[30950]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:36.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:35 smithi139 ceph-mon[35039]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-19T07:20:36.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:35 smithi139 ceph-mon[35039]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:36.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:35 smithi162 ceph-mon[35726]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-19T07:20:36.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:35 smithi162 ceph-mon[35726]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:36.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.362+0000 7fc290fa2640 1 -- 172.21.15.98:0/1056458323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c1027a0 msgr2=0x7fc28c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:36.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.362+0000 7fc290fa2640 1 --2- 172.21.15.98:0/1056458323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c1027a0 0x7fc28c1067f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc280009900 tx=0x7fc28002a410 comp rx=0 tx=0).stop 2024-09-19T07:20:36.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.362+0000 7fc290fa2640 1 -- 172.21.15.98:0/1056458323 shutdown_connections 2024-09-19T07:20:36.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.362+0000 7fc290fa2640 1 --2- 172.21.15.98:0/1056458323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c106f20 0x7fc28c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.362+0000 7fc290fa2640 1 --2- 172.21.15.98:0/1056458323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c1027a0 0x7fc28c1067f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.362+0000 7fc290fa2640 1 --2- 172.21.15.98:0/1056458323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28c101df0 0x7fc28c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.363+0000 7fc290fa2640 1 -- 172.21.15.98:0/1056458323 >> 172.21.15.98:0/1056458323 conn(0x7fc28c0fd8b0 msgr2=0x7fc28c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.363+0000 7fc290fa2640 1 -- 172.21.15.98:0/1056458323 shutdown_connections 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.363+0000 7fc290fa2640 1 -- 172.21.15.98:0/1056458323 wait complete. 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.363+0000 7fc290fa2640 1 Processor -- start 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.363+0000 7fc290fa2640 1 -- start start 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc290fa2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c101df0 0x7fc28c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc290fa2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28c1027a0 0x7fc28c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc290fa2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c106f20 0x7fc28c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc290fa2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c111fa0 con 0x7fc28c101df0 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc290fa2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c111e20 con 0x7fc28c106f20 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc290fa2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c112120 con 0x7fc28c1027a0 2024-09-19T07:20:36.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc28a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c101df0 0x7fc28c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc28a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c101df0 0x7fc28c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34122/0 (socket says 172.21.15.98:34122) 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc28a59c640 1 -- 172.21.15.98:0/578153102 learned_addr learned my addr 172.21.15.98:0/578153102 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc28ad9d640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c106f20 0x7fc28c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc289d9b640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28c1027a0 0x7fc28c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc28a59c640 1 -- 172.21.15.98:0/578153102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28c1027a0 msgr2=0x7fc28c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc28a59c640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28c1027a0 0x7fc28c198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc28a59c640 1 -- 172.21.15.98:0/578153102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c106f20 msgr2=0x7fc28c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc28a59c640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c106f20 0x7fc28c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc28a59c640 1 -- 172.21.15.98:0/578153102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c19d3e0 con 0x7fc28c101df0 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc28a59c640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c101df0 0x7fc28c198430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00b4a0 tx=0x7fc27c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc27b7fe640 1 -- 172.21.15.98:0/578153102 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c014070 con 0x7fc28c101df0 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc27b7fe640 1 -- 172.21.15.98:0/578153102 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc27c010af0 con 0x7fc28c101df0 2024-09-19T07:20:36.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc290fa2640 1 -- 172.21.15.98:0/578153102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28c19d6d0 con 0x7fc28c101df0 2024-09-19T07:20:36.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.364+0000 7fc27b7fe640 1 -- 172.21.15.98:0/578153102 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c017d10 con 0x7fc28c101df0 2024-09-19T07:20:36.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.365+0000 7fc290fa2640 1 -- 172.21.15.98:0/578153102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc28c1a4fb0 con 0x7fc28c101df0 2024-09-19T07:20:36.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.366+0000 7fc290fa2640 1 -- 172.21.15.98:0/578153102 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc28c1021d0 con 0x7fc28c101df0 2024-09-19T07:20:36.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.366+0000 7fc27b7fe640 1 -- 172.21.15.98:0/578153102 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc27c017070 con 0x7fc28c101df0 2024-09-19T07:20:36.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.367+0000 7fc27b7fe640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc2740a32d0 0x7fc2740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:36.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.367+0000 7fc289d9b640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc2740a32d0 0x7fc2740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:36.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.367+0000 7fc27b7fe640 1 -- 172.21.15.98:0/578153102 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7fc27c0cec60 con 0x7fc28c101df0 2024-09-19T07:20:36.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.368+0000 7fc289d9b640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc2740a32d0 0x7fc2740a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc2800096c0 tx=0x7fc280000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:36.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.371+0000 7fc27b7fe640 1 -- 172.21.15.98:0/578153102 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc27c09bae0 con 0x7fc28c101df0 2024-09-19T07:20:36.568 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.566+0000 7fc290fa2640 1 -- 172.21.15.98:0/578153102 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fc28c062630 con 0x7fc2740a32d0 2024-09-19T07:20:36.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.571+0000 7fc27b7fe640 1 -- 172.21.15.98:0/578153102 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc28c062630 con 0x7fc2740a32d0 2024-09-19T07:20:36.572 INFO:teuthology.orchestra.run.smithi098.stdout:/volumes/qa/sv_0/5636bf24-b9da-43af-8491-caccaddd589f 2024-09-19T07:20:36.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.573+0000 7fc290fa2640 1 -- 172.21.15.98:0/578153102 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc2740a32d0 msgr2=0x7fc2740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:36.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.573+0000 7fc290fa2640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc2740a32d0 0x7fc2740a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc2800096c0 tx=0x7fc280000bc0 comp rx=0 tx=0).stop 2024-09-19T07:20:36.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.573+0000 7fc290fa2640 1 -- 172.21.15.98:0/578153102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c101df0 msgr2=0x7fc28c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:36.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.573+0000 7fc290fa2640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c101df0 0x7fc28c198430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00b4a0 tx=0x7fc27c00b960 comp rx=0 tx=0).stop 2024-09-19T07:20:36.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.573+0000 7fc290fa2640 1 -- 172.21.15.98:0/578153102 shutdown_connections 2024-09-19T07:20:36.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.573+0000 7fc290fa2640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc2740a32d0 0x7fc2740a5790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:36.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.573+0000 7fc290fa2640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c106f20 0x7fc28c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:36.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.573+0000 7fc290fa2640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28c1027a0 0x7fc28c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:36.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.573+0000 7fc290fa2640 1 --2- 172.21.15.98:0/578153102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c101df0 0x7fc28c198430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:36.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.573+0000 7fc290fa2640 1 -- 172.21.15.98:0/578153102 >> 172.21.15.98:0/578153102 conn(0x7fc28c0fd8b0 msgr2=0x7fc28c0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:36.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.573+0000 7fc290fa2640 1 -- 172.21.15.98:0/578153102 shutdown_connections 2024-09-19T07:20:36.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:36.573+0000 7fc290fa2640 1 -- 172.21.15.98:0/578153102 wait complete. 2024-09-19T07:20:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:36 smithi139 ceph-mon[35039]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-19T07:20:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T07:20:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T07:20:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-09-19T07:20:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-09-19T07:20:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]: dispatch 2024-09-19T07:20:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T07:20:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]: dispatch 2024-09-19T07:20:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-19T07:20:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:36 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-19T07:20:37.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:36 smithi139 ceph-mon[35039]: pgmap v278: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-19T07:20:37.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:36 smithi162 ceph-mon[35726]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:37.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-19T07:20:37.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T07:20:37.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T07:20:37.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-09-19T07:20:37.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-09-19T07:20:37.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]: dispatch 2024-09-19T07:20:37.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T07:20:37.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]: dispatch 2024-09-19T07:20:37.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-19T07:20:37.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:36 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-19T07:20:37.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:36 smithi162 ceph-mon[35726]: pgmap v278: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-19T07:20:37.176 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:36 smithi098 ceph-mon[30950]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:37.177 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2024-09-19T07:20:37.177 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T07:20:37.177 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-09-19T07:20:37.177 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-09-19T07:20:37.177 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-09-19T07:20:37.177 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]: dispatch 2024-09-19T07:20:37.177 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T07:20:37.177 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]: dispatch 2024-09-19T07:20:37.177 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-09-19T07:20:37.177 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:36 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-19T07:20:37.177 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:36 smithi098 ceph-mon[30950]: pgmap v278: 97 pgs: 97 active+clean; 582 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-19T07:20:37.202 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T07:20:37.448 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:37.831 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:37 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-19T07:20:37.832 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:37 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T07:20:37.832 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:37 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T07:20:37.832 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:37 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-09-19T07:20:37.832 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:37 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-19T07:20:37.832 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:37 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2024-09-19T07:20:37.832 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:37 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T07:20:37.832 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:37 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2024-09-19T07:20:37.832 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:37 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-19T07:20:37.832 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:37 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-19T07:20:37.832 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:37 smithi098 ceph-mon[30950]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T07:20:37.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.916+0000 7f2bf952a640 1 -- 172.21.15.98:0/2876613146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf41036e0 msgr2=0x7f2bf4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:37.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.916+0000 7f2bf952a640 1 --2- 172.21.15.98:0/2876613146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf41036e0 0x7f2bf4107b90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc009930 tx=0x7f2bdc02a420 comp rx=0 tx=0).stop 2024-09-19T07:20:37.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.916+0000 7f2bf952a640 1 -- 172.21.15.98:0/2876613146 shutdown_connections 2024-09-19T07:20:37.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.916+0000 7f2bf952a640 1 --2- 172.21.15.98:0/2876613146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf41082a0 0x7f2bf410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.916+0000 7f2bf952a640 1 --2- 172.21.15.98:0/2876613146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf41036e0 0x7f2bf4107b90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.916+0000 7f2bf952a640 1 --2- 172.21.15.98:0/2876613146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bf4102d30 0x7f2bf4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.916+0000 7f2bf952a640 1 -- 172.21.15.98:0/2876613146 >> 172.21.15.98:0/2876613146 conn(0x7f2bf40fc7d0 msgr2=0x7f2bf40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.916+0000 7f2bf952a640 1 -- 172.21.15.98:0/2876613146 shutdown_connections 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.916+0000 7f2bf952a640 1 -- 172.21.15.98:0/2876613146 wait complete. 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf952a640 1 Processor -- start 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf952a640 1 -- start start 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf952a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4102d30 0x7f2bf4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf952a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bf41036e0 0x7f2bf4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf952a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf41082a0 0x7f2bf4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf952a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4112140 con 0x7f2bf41082a0 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf952a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf4111fc0 con 0x7f2bf4102d30 2024-09-19T07:20:37.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf952a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf41122c0 con 0x7f2bf41036e0 2024-09-19T07:20:37.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf41082a0 0x7f2bf4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:37.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf41082a0 0x7f2bf4101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34144/0 (socket says 172.21.15.98:34144) 2024-09-19T07:20:37.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf37fe640 1 -- 172.21.15.98:0/3226782120 learned_addr learned my addr 172.21.15.98:0/3226782120 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:37.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bea7fc640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bf41036e0 0x7f2bf4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:37.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf2ffd640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4102d30 0x7f2bf4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:37.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf37fe640 1 -- 172.21.15.98:0/3226782120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bf41036e0 msgr2=0x7f2bf4100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:37.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf37fe640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bf41036e0 0x7f2bf4100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:37.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf37fe640 1 -- 172.21.15.98:0/3226782120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4102d30 msgr2=0x7f2bf4100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:37.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf37fe640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4102d30 0x7f2bf4100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:37.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.917+0000 7f2bf37fe640 1 -- 172.21.15.98:0/3226782120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf41a6bc0 con 0x7f2bf41082a0 2024-09-19T07:20:37.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.918+0000 7f2bf37fe640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf41082a0 0x7f2bf4101410 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00b970 tx=0x7f2bec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:37.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.918+0000 7f2bf0ff9640 1 -- 172.21.15.98:0/3226782120 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec019070 con 0x7f2bf41082a0 2024-09-19T07:20:37.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.918+0000 7f2bf0ff9640 1 -- 172.21.15.98:0/3226782120 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bec00cb40 con 0x7f2bf41082a0 2024-09-19T07:20:37.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.918+0000 7f2bf952a640 1 -- 172.21.15.98:0/3226782120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf41a6eb0 con 0x7f2bf41082a0 2024-09-19T07:20:37.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.918+0000 7f2bf0ff9640 1 -- 172.21.15.98:0/3226782120 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec007650 con 0x7f2bf41082a0 2024-09-19T07:20:37.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.918+0000 7f2bf952a640 1 -- 172.21.15.98:0/3226782120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf41a7310 con 0x7f2bf41082a0 2024-09-19T07:20:37.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.919+0000 7f2bf952a640 1 -- 172.21.15.98:0/3226782120 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf4103190 con 0x7f2bf41082a0 2024-09-19T07:20:37.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.920+0000 7f2bf0ff9640 1 -- 172.21.15.98:0/3226782120 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2bec01c070 con 0x7f2bf41082a0 2024-09-19T07:20:37.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.920+0000 7f2bf0ff9640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f2be00a32d0 0x7f2be00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:37.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.920+0000 7f2bf0ff9640 1 -- 172.21.15.98:0/3226782120 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f2bec0cefd0 con 0x7f2bf41082a0 2024-09-19T07:20:37.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.920+0000 7f2bf2ffd640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f2be00a32d0 0x7f2be00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:37.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.921+0000 7f2bf2ffd640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f2be00a32d0 0x7f2be00a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2be4009890 tx=0x7f2be4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:37.950 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:37.925+0000 7f2bf0ff9640 1 -- 172.21.15.98:0/3226782120 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2bec09bc80 con 0x7f2bf41082a0 2024-09-19T07:20:38.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:37 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-19T07:20:38.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:37 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T07:20:38.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:37 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T07:20:38.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:37 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-09-19T07:20:38.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:37 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-19T07:20:38.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:37 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2024-09-19T07:20:38.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:37 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T07:20:38.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:37 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2024-09-19T07:20:38.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:37 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-19T07:20:38.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:37 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-19T07:20:38.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:37 smithi139 ceph-mon[35039]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T07:20:38.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.115+0000 7f2bf952a640 1 -- 172.21.15.98:0/3226782120 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2bf4062630 con 0x7f2be00a32d0 2024-09-19T07:20:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:37 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2024-09-19T07:20:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:37 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T07:20:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:37 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-19T07:20:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:37 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-09-19T07:20:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:37 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-19T07:20:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:37 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2024-09-19T07:20:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:37 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T07:20:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:37 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2024-09-19T07:20:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:37 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-19T07:20:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:37 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-19T07:20:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:37 smithi162 ceph-mon[35726]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T07:20:38.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.139+0000 7f2bf0ff9640 1 -- 172.21.15.98:0/3226782120 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2bf4062630 con 0x7f2be00a32d0 2024-09-19T07:20:38.142 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.141+0000 7f2bf952a640 1 -- 172.21.15.98:0/3226782120 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f2be00a32d0 msgr2=0x7f2be00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:38.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.141+0000 7f2bf952a640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f2be00a32d0 0x7f2be00a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2be4009890 tx=0x7f2be4008040 comp rx=0 tx=0).stop 2024-09-19T07:20:38.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.141+0000 7f2bf952a640 1 -- 172.21.15.98:0/3226782120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf41082a0 msgr2=0x7f2bf4101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:38.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.141+0000 7f2bf952a640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf41082a0 0x7f2bf4101410 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00b970 tx=0x7f2bec00be30 comp rx=0 tx=0).stop 2024-09-19T07:20:38.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.141+0000 7f2bf952a640 1 -- 172.21.15.98:0/3226782120 shutdown_connections 2024-09-19T07:20:38.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.141+0000 7f2bf952a640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f2be00a32d0 0x7f2be00a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:38.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.141+0000 7f2bf952a640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2bf41082a0 0x7f2bf4101410 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:38.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.141+0000 7f2bf952a640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2bf41036e0 0x7f2bf4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:38.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.141+0000 7f2bf952a640 1 --2- 172.21.15.98:0/3226782120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf4102d30 0x7f2bf4100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:38.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.141+0000 7f2bf952a640 1 -- 172.21.15.98:0/3226782120 >> 172.21.15.98:0/3226782120 conn(0x7f2bf40fc7d0 msgr2=0x7f2bf4105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:38.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.141+0000 7f2bf952a640 1 -- 172.21.15.98:0/3226782120 shutdown_connections 2024-09-19T07:20:38.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:38.141+0000 7f2bf952a640 1 -- 172.21.15.98:0/3226782120 wait complete. 2024-09-19T07:20:38.736 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T07:20:38.980 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:39.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:38 smithi098 ceph-mon[30950]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T07:20:39.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:38 smithi098 ceph-mon[30950]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:39.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:38 smithi098 ceph-mon[30950]: pgmap v281: 97 pgs: 1 peering, 96 active+clean; 606 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.4 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T07:20:39.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:38 smithi139 ceph-mon[35039]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T07:20:39.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:38 smithi139 ceph-mon[35039]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:39.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:38 smithi139 ceph-mon[35039]: pgmap v281: 97 pgs: 1 peering, 96 active+clean; 606 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.4 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T07:20:39.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:38 smithi162 ceph-mon[35726]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T07:20:39.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:38 smithi162 ceph-mon[35726]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:39.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:38 smithi162 ceph-mon[35726]: pgmap v281: 97 pgs: 1 peering, 96 active+clean; 606 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.4 KiB/s wr, 14 op/s; 0 B/s, 0 objects/s recovering 2024-09-19T07:20:39.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 -- 172.21.15.98:0/2291825983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c102ef0 msgr2=0x7f1c9c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:39.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 --2- 172.21.15.98:0/2291825983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c102ef0 0x7f1c9c10da40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009900 tx=0x7f1c9402a480 comp rx=0 tx=0).stop 2024-09-19T07:20:39.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 -- 172.21.15.98:0/2291825983 shutdown_connections 2024-09-19T07:20:39.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 --2- 172.21.15.98:0/2291825983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c102ef0 0x7f1c9c10da40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:39.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 --2- 172.21.15.98:0/2291825983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c9c102570 0x7f1c9c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:39.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 --2- 172.21.15.98:0/2291825983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c9c100e20 0x7f1c9c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:39.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 -- 172.21.15.98:0/2291825983 >> 172.21.15.98:0/2291825983 conn(0x7f1c9c0fc7d0 msgr2=0x7f1c9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:39.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 -- 172.21.15.98:0/2291825983 shutdown_connections 2024-09-19T07:20:39.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 -- 172.21.15.98:0/2291825983 wait complete. 2024-09-19T07:20:39.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 Processor -- start 2024-09-19T07:20:39.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 -- start start 2024-09-19T07:20:39.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c9c100e20 0x7f1c9c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:39.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c9c102570 0x7f1c9c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:39.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c102ef0 0x7f1c9c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:39.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.437+0000 7f1ca3153640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c111020 con 0x7f1c9c102ef0 2024-09-19T07:20:39.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca3153640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c110ea0 con 0x7f1c9c102570 2024-09-19T07:20:39.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca3153640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c1111a0 con 0x7f1c9c100e20 2024-09-19T07:20:39.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca16f0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c102ef0 0x7f1c9c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:39.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca16f0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c102ef0 0x7f1c9c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34158/0 (socket says 172.21.15.98:34158) 2024-09-19T07:20:39.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca16f0640 1 -- 172.21.15.98:0/4221059309 learned_addr learned my addr 172.21.15.98:0/4221059309 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca0eef640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c9c100e20 0x7f1c9c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1c9bfff640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c9c102570 0x7f1c9c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca16f0640 1 -- 172.21.15.98:0/4221059309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c9c100e20 msgr2=0x7f1c9c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca16f0640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c9c100e20 0x7f1c9c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca16f0640 1 -- 172.21.15.98:0/4221059309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c9c102570 msgr2=0x7f1c9c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca16f0640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c9c102570 0x7f1c9c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca16f0640 1 -- 172.21.15.98:0/4221059309 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c1a6b50 con 0x7f1c9c102ef0 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1c9bfff640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c9c102570 0x7f1c9c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca0eef640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c9c100e20 0x7f1c9c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca16f0640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c102ef0 0x7f1c9c0fd700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1c94005ab0 tx=0x7f1c94003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1c99ffb640 1 -- 172.21.15.98:0/4221059309 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9403f070 con 0x7f1c9c102ef0 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca3153640 1 -- 172.21.15.98:0/4221059309 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9c1a6de0 con 0x7f1c9c102ef0 2024-09-19T07:20:39.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1c99ffb640 1 -- 172.21.15.98:0/4221059309 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c94031e30 con 0x7f1c9c102ef0 2024-09-19T07:20:39.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1c99ffb640 1 -- 172.21.15.98:0/4221059309 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c94035030 con 0x7f1c9c102ef0 2024-09-19T07:20:39.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.438+0000 7f1ca3153640 1 -- 172.21.15.98:0/4221059309 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9c1a72c0 con 0x7f1c9c102ef0 2024-09-19T07:20:39.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.439+0000 7f1ca3153640 1 -- 172.21.15.98:0/4221059309 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c9c101280 con 0x7f1c9c102ef0 2024-09-19T07:20:39.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.440+0000 7f1c99ffb640 1 -- 172.21.15.98:0/4221059309 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1c94042070 con 0x7f1c9c102ef0 2024-09-19T07:20:39.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.441+0000 7f1c99ffb640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1c880a32d0 0x7f1c880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:39.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.441+0000 7f1ca0eef640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1c880a32d0 0x7f1c880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:39.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.441+0000 7f1c99ffb640 1 -- 172.21.15.98:0/4221059309 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f1c940f0430 con 0x7f1c9c102ef0 2024-09-19T07:20:39.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.442+0000 7f1ca0eef640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1c880a32d0 0x7f1c880a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009fa0 tx=0x7f1c8c009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:39.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.445+0000 7f1c99ffb640 1 -- 172.21.15.98:0/4221059309 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c94003e20 con 0x7f1c9c102ef0 2024-09-19T07:20:39.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.641+0000 7f1ca3153640 1 -- 172.21.15.98:0/4221059309 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f1c9c062630 con 0x7f1c880a32d0 2024-09-19T07:20:39.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.645+0000 7f1c99ffb640 1 -- 172.21.15.98:0/4221059309 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1c9c062630 con 0x7f1c880a32d0 2024-09-19T07:20:39.646 INFO:teuthology.orchestra.run.smithi098.stdout:/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 2024-09-19T07:20:39.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.647+0000 7f1ca3153640 1 -- 172.21.15.98:0/4221059309 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1c880a32d0 msgr2=0x7f1c880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:39.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.647+0000 7f1ca3153640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1c880a32d0 0x7f1c880a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009fa0 tx=0x7f1c8c009570 comp rx=0 tx=0).stop 2024-09-19T07:20:39.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.647+0000 7f1ca3153640 1 -- 172.21.15.98:0/4221059309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c102ef0 msgr2=0x7f1c9c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:39.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.647+0000 7f1ca3153640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c102ef0 0x7f1c9c0fd700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1c94005ab0 tx=0x7f1c94003c30 comp rx=0 tx=0).stop 2024-09-19T07:20:39.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.647+0000 7f1ca3153640 1 -- 172.21.15.98:0/4221059309 shutdown_connections 2024-09-19T07:20:39.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.647+0000 7f1ca3153640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1c880a32d0 0x7f1c880a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:39.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.647+0000 7f1ca3153640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c9c102ef0 0x7f1c9c0fd700 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:39.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.647+0000 7f1ca3153640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c9c102570 0x7f1c9c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:39.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.647+0000 7f1ca3153640 1 --2- 172.21.15.98:0/4221059309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c9c100e20 0x7f1c9c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:39.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.647+0000 7f1ca3153640 1 -- 172.21.15.98:0/4221059309 >> 172.21.15.98:0/4221059309 conn(0x7f1c9c0fc7d0 msgr2=0x7f1c9c06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:39.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.647+0000 7f1ca3153640 1 -- 172.21.15.98:0/4221059309 shutdown_connections 2024-09-19T07:20:39.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:39.647+0000 7f1ca3153640 1 -- 172.21.15.98:0/4221059309 wait complete. 2024-09-19T07:20:40.018 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:39 smithi098 ceph-mon[30950]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:40.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:39 smithi139 ceph-mon[35039]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:40.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:39 smithi162 ceph-mon[35726]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:20:40.288 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:20:40.535 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:40.956 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:40 smithi098 ceph-mon[30950]: pgmap v282: 97 pgs: 1 peering, 96 active+clean; 607 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.4 KiB/s wr, 10 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T07:20:41.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.035+0000 7f5de6f3d640 1 -- 172.21.15.98:0/2624470544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5de0100a80 msgr2=0x7f5de0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:41.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.035+0000 7f5de6f3d640 1 --2- 172.21.15.98:0/2624470544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5de0100a80 0x7f5de0100ee0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009930 tx=0x7f5dcc02a420 comp rx=0 tx=0).stop 2024-09-19T07:20:41.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.035+0000 7f5de6f3d640 1 -- 172.21.15.98:0/2624470544 shutdown_connections 2024-09-19T07:20:41.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.035+0000 7f5de6f3d640 1 --2- 172.21.15.98:0/2624470544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de0101420 0x7f5de010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:41.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.035+0000 7f5de6f3d640 1 --2- 172.21.15.98:0/2624470544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5de0100a80 0x7f5de0100ee0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:41.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.035+0000 7f5de6f3d640 1 --2- 172.21.15.98:0/2624470544 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5de0106a80 0x7f5de0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:41.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.035+0000 7f5de6f3d640 1 -- 172.21.15.98:0/2624470544 >> 172.21.15.98:0/2624470544 conn(0x7f5de00fc7a0 msgr2=0x7f5de00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:41.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.035+0000 7f5de6f3d640 1 -- 172.21.15.98:0/2624470544 shutdown_connections 2024-09-19T07:20:41.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.035+0000 7f5de6f3d640 1 -- 172.21.15.98:0/2624470544 wait complete. 2024-09-19T07:20:41.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.035+0000 7f5de6f3d640 1 Processor -- start 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.035+0000 7f5de6f3d640 1 -- start start 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de6f3d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5de0100a80 0x7f5de010e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de6f3d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5de0101420 0x7f5de010e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de6f3d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de0106a80 0x7f5de010ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de6f3d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5de0112030 con 0x7f5de0100a80 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de6f3d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5de0111eb0 con 0x7f5de0101420 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de6f3d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5de01121b0 con 0x7f5de0106a80 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de4cd9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5de0100a80 0x7f5de010e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de4cd9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5de0100a80 0x7f5de010e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34170/0 (socket says 172.21.15.98:34170) 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de4cd9640 1 -- 172.21.15.98:0/3701570671 learned_addr learned my addr 172.21.15.98:0/3701570671 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de54da640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de0106a80 0x7f5de010ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5ddffff640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5de0101420 0x7f5de010e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:41.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de4cd9640 1 -- 172.21.15.98:0/3701570671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de0106a80 msgr2=0x7f5de010ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de4cd9640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de0106a80 0x7f5de010ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de4cd9640 1 -- 172.21.15.98:0/3701570671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5de0101420 msgr2=0x7f5de010e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de4cd9640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5de0101420 0x7f5de010e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de4cd9640 1 -- 172.21.15.98:0/3701570671 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de01a6a90 con 0x7f5de0100a80 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5ddffff640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5de0101420 0x7f5de010e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de4cd9640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5de0100a80 0x7f5de010e260 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400b4a0 tx=0x7f5dd400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5dddffb640 1 -- 172.21.15.98:0/3701570671 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4014070 con 0x7f5de0100a80 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5de6f3d640 1 -- 172.21.15.98:0/3701570671 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de01a6d80 con 0x7f5de0100a80 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5dddffb640 1 -- 172.21.15.98:0/3701570671 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd4010af0 con 0x7f5de0100a80 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.036+0000 7f5dddffb640 1 -- 172.21.15.98:0/3701570671 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4017d10 con 0x7f5de0100a80 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.037+0000 7f5de6f3d640 1 -- 172.21.15.98:0/3701570671 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de01a7240 con 0x7f5de0100a80 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.038+0000 7f5de6f3d640 1 -- 172.21.15.98:0/3701570671 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de0100f60 con 0x7f5de0100a80 2024-09-19T07:20:41.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.040+0000 7f5dddffb640 1 -- 172.21.15.98:0/3701570671 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5dd4017070 con 0x7f5de0100a80 2024-09-19T07:20:41.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.040+0000 7f5dddffb640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5dd00a32d0 0x7f5dd00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:41.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.040+0000 7f5ddffff640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5dd00a32d0 0x7f5dd00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:41.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.040+0000 7f5dddffb640 1 -- 172.21.15.98:0/3701570671 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f5dd40cf1c0 con 0x7f5de0100a80 2024-09-19T07:20:41.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.041+0000 7f5ddffff640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5dd00a32d0 0x7f5dd00a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc000c00 tx=0x7f5dcc032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:41.051 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.043+0000 7f5dddffb640 1 -- 172.21.15.98:0/3701570671 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5dd409be70 con 0x7f5de0100a80 2024-09-19T07:20:41.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:40 smithi139 ceph-mon[35039]: pgmap v282: 97 pgs: 1 peering, 96 active+clean; 607 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.4 KiB/s wr, 10 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T07:20:41.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:40 smithi162 ceph-mon[35726]: pgmap v282: 97 pgs: 1 peering, 96 active+clean; 607 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.4 KiB/s wr, 10 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T07:20:41.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.244+0000 7f5de6f3d640 1 -- 172.21.15.98:0/3701570671 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5de010f790 con 0x7f5de0100a80 2024-09-19T07:20:41.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.245+0000 7f5dddffb640 1 -- 172.21.15.98:0/3701570671 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11917 (secure 0 0 0) 0x7f5dd409b770 con 0x7f5de0100a80 2024-09-19T07:20:41.248 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:41.248 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"btime":"2024-09-19T07:20:31:757871+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:20:31.309254+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24442,24458,24479]},"id":1}]} 2024-09-19T07:20:41.248 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2024-09-19T07:20:41.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.247+0000 7f5de6f3d640 1 -- 172.21.15.98:0/3701570671 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5dd00a32d0 msgr2=0x7f5dd00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:41.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.247+0000 7f5de6f3d640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5dd00a32d0 0x7f5dd00a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc000c00 tx=0x7f5dcc032d50 comp rx=0 tx=0).stop 2024-09-19T07:20:41.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.247+0000 7f5de6f3d640 1 -- 172.21.15.98:0/3701570671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5de0100a80 msgr2=0x7f5de010e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:41.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.247+0000 7f5de6f3d640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5de0100a80 0x7f5de010e260 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400b4a0 tx=0x7f5dd400b960 comp rx=0 tx=0).stop 2024-09-19T07:20:41.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.248+0000 7f5de6f3d640 1 -- 172.21.15.98:0/3701570671 shutdown_connections 2024-09-19T07:20:41.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.248+0000 7f5de6f3d640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5dd00a32d0 0x7f5dd00a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:41.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.248+0000 7f5de6f3d640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5de0106a80 0x7f5de010ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:41.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.248+0000 7f5de6f3d640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5de0101420 0x7f5de010e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:41.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.248+0000 7f5de6f3d640 1 --2- 172.21.15.98:0/3701570671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5de0100a80 0x7f5de010e260 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:41.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.248+0000 7f5de6f3d640 1 -- 172.21.15.98:0/3701570671 >> 172.21.15.98:0/3701570671 conn(0x7f5de00fc7a0 msgr2=0x7f5de00fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:41.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.248+0000 7f5de6f3d640 1 -- 172.21.15.98:0/3701570671 shutdown_connections 2024-09-19T07:20:41.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:41.248+0000 7f5de6f3d640 1 -- 172.21.15.98:0/3701570671 wait complete. 2024-09-19T07:20:41.945 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:41 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3701570671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:41.947 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:20:42.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:41 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3701570671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:42.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:41 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3701570671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:20:42.192 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:42.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.676+0000 7f21f01c5640 1 -- 172.21.15.98:0/3669765643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21e8101450 msgr2=0x7f21e8105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:42.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.676+0000 7f21f01c5640 1 --2- 172.21.15.98:0/3669765643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21e8101450 0x7f21e8105920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f21d8009900 tx=0x7f21d802a470 comp rx=0 tx=0).stop 2024-09-19T07:20:42.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.676+0000 7f21f01c5640 1 -- 172.21.15.98:0/3669765643 shutdown_connections 2024-09-19T07:20:42.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.676+0000 7f21f01c5640 1 --2- 172.21.15.98:0/3669765643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e8105f40 0x7f21e81063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:42.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.676+0000 7f21f01c5640 1 --2- 172.21.15.98:0/3669765643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21e8101450 0x7f21e8105920 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:42.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.676+0000 7f21f01c5640 1 --2- 172.21.15.98:0/3669765643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21e8100b30 0x7f21e8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:42.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.676+0000 7f21f01c5640 1 -- 172.21.15.98:0/3669765643 >> 172.21.15.98:0/3669765643 conn(0x7f21e80fc7a0 msgr2=0x7f21e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:42.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.676+0000 7f21f01c5640 1 -- 172.21.15.98:0/3669765643 shutdown_connections 2024-09-19T07:20:42.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.676+0000 7f21f01c5640 1 -- 172.21.15.98:0/3669765643 wait complete. 2024-09-19T07:20:42.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21f01c5640 1 Processor -- start 2024-09-19T07:20:42.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21f01c5640 1 -- start start 2024-09-19T07:20:42.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21f01c5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e8100b30 0x7f21e81a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:42.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21f01c5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21e8101450 0x7f21e81a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:42.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21f01c5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21e8105f40 0x7f21e819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:42.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21f01c5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81185c0 con 0x7f21e8101450 2024-09-19T07:20:42.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21f01c5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f21e8118440 con 0x7f21e8105f40 2024-09-19T07:20:42.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21f01c5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21e8118740 con 0x7f21e8100b30 2024-09-19T07:20:42.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21ed760640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21e8101450 0x7f21e81a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:42.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21ed760640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21e8101450 0x7f21e81a4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40460/0 (socket says 172.21.15.98:40460) 2024-09-19T07:20:42.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21ed760640 1 -- 172.21.15.98:0/1526352415 learned_addr learned my addr 172.21.15.98:0/1526352415 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21ee762640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21e8105f40 0x7f21e819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21edf61640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e8100b30 0x7f21e81a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21ed760640 1 -- 172.21.15.98:0/1526352415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e8100b30 msgr2=0x7f21e81a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21ed760640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e8100b30 0x7f21e81a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21ed760640 1 -- 172.21.15.98:0/1526352415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21e8105f40 msgr2=0x7f21e819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21ed760640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21e8105f40 0x7f21e819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.677+0000 7f21ed760640 1 -- 172.21.15.98:0/1526352415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e819f000 con 0x7f21e8101450 2024-09-19T07:20:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.678+0000 7f21ed760640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21e8101450 0x7f21e81a4c50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f21d8005ab0 tx=0x7f21d80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.678+0000 7f21deffd640 1 -- 172.21.15.98:0/1526352415 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d803f030 con 0x7f21e8101450 2024-09-19T07:20:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.678+0000 7f21deffd640 1 -- 172.21.15.98:0/1526352415 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21d8003ce0 con 0x7f21e8101450 2024-09-19T07:20:42.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.678+0000 7f21f01c5640 1 -- 172.21.15.98:0/1526352415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e819f290 con 0x7f21e8101450 2024-09-19T07:20:42.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.678+0000 7f21deffd640 1 -- 172.21.15.98:0/1526352415 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8035070 con 0x7f21e8101450 2024-09-19T07:20:42.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.678+0000 7f21f01c5640 1 -- 172.21.15.98:0/1526352415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e81ab5e0 con 0x7f21e8101450 2024-09-19T07:20:42.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.679+0000 7f21f01c5640 1 -- 172.21.15.98:0/1526352415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e8105920 con 0x7f21e8101450 2024-09-19T07:20:42.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.680+0000 7f21deffd640 1 -- 172.21.15.98:0/1526352415 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f21d8042030 con 0x7f21e8101450 2024-09-19T07:20:42.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.680+0000 7f21deffd640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f21d40a32d0 0x7f21d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:42.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.680+0000 7f21edf61640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f21d40a32d0 0x7f21d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:42.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.681+0000 7f21deffd640 1 -- 172.21.15.98:0/1526352415 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f21d80f03d0 con 0x7f21e8101450 2024-09-19T07:20:42.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.681+0000 7f21edf61640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f21d40a32d0 0x7f21d40a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f21e4005e10 tx=0x7f21e4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:42.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.685+0000 7f21deffd640 1 -- 172.21.15.98:0/1526352415 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f21d80bcf70 con 0x7f21e8101450 2024-09-19T07:20:42.855 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.854+0000 7f21f01c5640 1 -- 172.21.15.98:0/1526352415 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21e81ab7b0 con 0x7f21e8101450 2024-09-19T07:20:42.856 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:42 smithi098 ceph-mon[30950]: pgmap v283: 97 pgs: 1 peering, 96 active+clean; 607 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.2 KiB/s wr, 8 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T07:20:42.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.856+0000 7f21deffd640 1 -- 172.21.15.98:0/1526352415 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22762 (secure 0 0 0) 0x7f21d80bc870 con 0x7f21e8101450 2024-09-19T07:20:42.858 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:42.858 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":80,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:20:37.783934+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:20:16.391879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:20:18.243837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:20:42.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.859+0000 7f21f01c5640 1 -- 172.21.15.98:0/1526352415 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f21d40a32d0 msgr2=0x7f21d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:42.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.859+0000 7f21f01c5640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f21d40a32d0 0x7f21d40a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f21e4005e10 tx=0x7f21e4005da0 comp rx=0 tx=0).stop 2024-09-19T07:20:42.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.859+0000 7f21f01c5640 1 -- 172.21.15.98:0/1526352415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21e8101450 msgr2=0x7f21e81a4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:42.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.859+0000 7f21f01c5640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21e8101450 0x7f21e81a4c50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f21d8005ab0 tx=0x7f21d80042f0 comp rx=0 tx=0).stop 2024-09-19T07:20:42.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.859+0000 7f21f01c5640 1 -- 172.21.15.98:0/1526352415 shutdown_connections 2024-09-19T07:20:42.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.859+0000 7f21f01c5640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f21d40a32d0 0x7f21d40a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:42.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.859+0000 7f21f01c5640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21e8105f40 0x7f21e819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:42.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.859+0000 7f21f01c5640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21e8101450 0x7f21e81a4c50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:42.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.859+0000 7f21f01c5640 1 --2- 172.21.15.98:0/1526352415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e8100b30 0x7f21e81a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:42.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.859+0000 7f21f01c5640 1 -- 172.21.15.98:0/1526352415 >> 172.21.15.98:0/1526352415 conn(0x7f21e80fc7a0 msgr2=0x7f21e81038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:42.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.859+0000 7f21f01c5640 1 -- 172.21.15.98:0/1526352415 shutdown_connections 2024-09-19T07:20:42.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:42.859+0000 7f21f01c5640 1 -- 172.21.15.98:0/1526352415 wait complete. 2024-09-19T07:20:43.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:42 smithi139 ceph-mon[35039]: pgmap v283: 97 pgs: 1 peering, 96 active+clean; 607 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.2 KiB/s wr, 8 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T07:20:43.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:42 smithi162 ceph-mon[35726]: pgmap v283: 97 pgs: 1 peering, 96 active+clean; 607 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.2 KiB/s wr, 8 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T07:20:43.500 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T07:20:43.500 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:20:43.747 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:44.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:43 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1526352415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:44.115 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:43 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1526352415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:44.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:43 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1526352415' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:44.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.194+0000 7fb986d0a640 1 -- 172.21.15.98:0/1920243759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb980102d40 msgr2=0x7fb980103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:44.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.194+0000 7fb986d0a640 1 --2- 172.21.15.98:0/1920243759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb980102d40 0x7fb980103120 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb978009900 tx=0x7fb97802a480 comp rx=0 tx=0).stop 2024-09-19T07:20:44.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.194+0000 7fb986d0a640 1 -- 172.21.15.98:0/1920243759 shutdown_connections 2024-09-19T07:20:44.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.194+0000 7fb986d0a640 1 --2- 172.21.15.98:0/1920243759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb98010c170 0x7fb98010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:44.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.194+0000 7fb986d0a640 1 --2- 172.21.15.98:0/1920243759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb980103660 0x7fb98010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:44.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.194+0000 7fb986d0a640 1 --2- 172.21.15.98:0/1920243759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb980102d40 0x7fb980103120 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:44.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.194+0000 7fb986d0a640 1 -- 172.21.15.98:0/1920243759 >> 172.21.15.98:0/1920243759 conn(0x7fb9800fc7a0 msgr2=0x7fb9800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:44.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.194+0000 7fb986d0a640 1 -- 172.21.15.98:0/1920243759 shutdown_connections 2024-09-19T07:20:44.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.194+0000 7fb986d0a640 1 -- 172.21.15.98:0/1920243759 wait complete. 2024-09-19T07:20:44.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.194+0000 7fb986d0a640 1 Processor -- start 2024-09-19T07:20:44.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb986d0a640 1 -- start start 2024-09-19T07:20:44.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb986d0a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb980102d40 0x7fb980198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:44.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb986d0a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb980103660 0x7fb980198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:44.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb986d0a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb98010c170 0x7fb98019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:44.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb986d0a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb980111f70 con 0x7fb980103660 2024-09-19T07:20:44.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb986d0a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb980111df0 con 0x7fb98010c170 2024-09-19T07:20:44.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb986d0a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb9801120f0 con 0x7fb980102d40 2024-09-19T07:20:44.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb97ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb980103660 0x7fb980198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:44.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb97ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb980103660 0x7fb980198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40490/0 (socket says 172.21.15.98:40490) 2024-09-19T07:20:44.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb97ffff640 1 -- 172.21.15.98:0/4129524049 learned_addr learned my addr 172.21.15.98:0/4129524049 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb984aa6640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb980102d40 0x7fb980198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb9852a7640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb98010c170 0x7fb98019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb97ffff640 1 -- 172.21.15.98:0/4129524049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb980102d40 msgr2=0x7fb980198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb97ffff640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb980102d40 0x7fb980198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb97ffff640 1 -- 172.21.15.98:0/4129524049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb98010c170 msgr2=0x7fb98019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb97ffff640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb98010c170 0x7fb98019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb97ffff640 1 -- 172.21.15.98:0/4129524049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98019d400 con 0x7fb980103660 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb984aa6640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb980102d40 0x7fb980198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb97ffff640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb980103660 0x7fb980198990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb97000dae0 tx=0x7fb97000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb97dffb640 1 -- 172.21.15.98:0/4129524049 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970017070 con 0x7fb980103660 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb986d0a640 1 -- 172.21.15.98:0/4129524049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98019d6f0 con 0x7fb980103660 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb97dffb640 1 -- 172.21.15.98:0/4129524049 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb970003e50 con 0x7fb980103660 2024-09-19T07:20:44.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.195+0000 7fb97dffb640 1 -- 172.21.15.98:0/4129524049 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9700106c0 con 0x7fb980103660 2024-09-19T07:20:44.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.196+0000 7fb986d0a640 1 -- 172.21.15.98:0/4129524049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9801a4fd0 con 0x7fb980103660 2024-09-19T07:20:44.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.197+0000 7fb986d0a640 1 -- 172.21.15.98:0/4129524049 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb980103120 con 0x7fb980103660 2024-09-19T07:20:44.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.198+0000 7fb97dffb640 1 -- 172.21.15.98:0/4129524049 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb9700040b0 con 0x7fb980103660 2024-09-19T07:20:44.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.198+0000 7fb97dffb640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb96c0a32d0 0x7fb96c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:44.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.199+0000 7fb984aa6640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb96c0a32d0 0x7fb96c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:44.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.199+0000 7fb97dffb640 1 -- 172.21.15.98:0/4129524049 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb9700cf860 con 0x7fb980103660 2024-09-19T07:20:44.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.199+0000 7fb984aa6640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb96c0a32d0 0x7fb96c0a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb978005ab0 tx=0x7fb978005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:44.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.203+0000 7fb97dffb640 1 -- 172.21.15.98:0/4129524049 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb970020070 con 0x7fb980103660 2024-09-19T07:20:44.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.366+0000 7fb986d0a640 1 -- 172.21.15.98:0/4129524049 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb980107270 con 0x7fb96c0a32d0 2024-09-19T07:20:44.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.372+0000 7fb97dffb640 1 -- 172.21.15.98:0/4129524049 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258710 (secure 0 0 0) 0x7fb980107270 con 0x7fb96c0a32d0 2024-09-19T07:20:44.376 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:44.378 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-19T07:20:44.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.375+0000 7fb986d0a640 1 -- 172.21.15.98:0/4129524049 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb96c0a32d0 msgr2=0x7fb96c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:44.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.375+0000 7fb986d0a640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb96c0a32d0 0x7fb96c0a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb978005ab0 tx=0x7fb978005a20 comp rx=0 tx=0).stop 2024-09-19T07:20:44.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.375+0000 7fb986d0a640 1 -- 172.21.15.98:0/4129524049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb980103660 msgr2=0x7fb980198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:44.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.375+0000 7fb986d0a640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb980103660 0x7fb980198990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb97000dae0 tx=0x7fb97000b260 comp rx=0 tx=0).stop 2024-09-19T07:20:44.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.375+0000 7fb986d0a640 1 -- 172.21.15.98:0/4129524049 shutdown_connections 2024-09-19T07:20:44.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.375+0000 7fb986d0a640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb96c0a32d0 0x7fb96c0a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:44.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.375+0000 7fb986d0a640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb98010c170 0x7fb98019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:44.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.375+0000 7fb986d0a640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb980103660 0x7fb980198990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:44.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.375+0000 7fb986d0a640 1 --2- 172.21.15.98:0/4129524049 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb980102d40 0x7fb980198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:44.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.375+0000 7fb986d0a640 1 -- 172.21.15.98:0/4129524049 >> 172.21.15.98:0/4129524049 conn(0x7fb9800fc7a0 msgr2=0x7fb9800fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:44.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.376+0000 7fb986d0a640 1 -- 172.21.15.98:0/4129524049 shutdown_connections 2024-09-19T07:20:44.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:44.376+0000 7fb986d0a640 1 -- 172.21.15.98:0/4129524049 wait complete. 2024-09-19T07:20:45.062 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:44 smithi098 ceph-mon[30950]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:20:45.062 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:44 smithi098 ceph-mon[30950]: pgmap v284: 97 pgs: 97 active+clean; 629 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.2 KiB/s wr, 9 op/s; 3.4 KiB/s, 1 objects/s recovering 2024-09-19T07:20:45.089 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-19T07:20:42.655132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":621159,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":214,"num_read_kb":185,"num_write":325,"num_write_kb":3010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":261,"ondisk_log_size":261,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353324,"kb_used_data":12340,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588500,"statfs":{"total":1151940427776,"available":1151578624000,"internally_reserved":0,"allocated":12636160,"data_stored":7006787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25569,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":41,"num_write":19,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002243"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788444+0000","last_change":"2024-09-19T07:20:19.535372+0000","last_active":"2024-09-19T07:20:37.788444+0000","last_peered":"2024-09-19T07:20:37.788444+0000","last_clean":"2024-09-19T07:20:37.788444+0000","last_became_active":"2024-09-19T07:20:19.535079+0000","last_became_peered":"2024-09-19T07:20:19.535079+0000","last_unstale":"2024-09-19T07:20:37.788444+0000","last_undegraded":"2024-09-19T07:20:37.788444+0000","last_fullsized":"2024-09-19T07:20:37.788444+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:56.856451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480864+0000","last_change":"2024-09-19T07:20:19.528531+0000","last_active":"2024-09-19T07:20:38.480864+0000","last_peered":"2024-09-19T07:20:38.480864+0000","last_clean":"2024-09-19T07:20:38.480864+0000","last_became_active":"2024-09-19T07:20:19.528218+0000","last_became_peered":"2024-09-19T07:20:19.528218+0000","last_unstale":"2024-09-19T07:20:38.480864+0000","last_undegraded":"2024-09-19T07:20:38.480864+0000","last_fullsized":"2024-09-19T07:20:38.480864+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:44.730220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480860+0000","last_change":"2024-09-19T07:20:19.533516+0000","last_active":"2024-09-19T07:20:38.480860+0000","last_peered":"2024-09-19T07:20:38.480860+0000","last_clean":"2024-09-19T07:20:38.480860+0000","last_became_active":"2024-09-19T07:20:19.533247+0000","last_became_peered":"2024-09-19T07:20:19.533247+0000","last_unstale":"2024-09-19T07:20:38.480860+0000","last_undegraded":"2024-09-19T07:20:38.480860+0000","last_fullsized":"2024-09-19T07:20:38.480860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:29.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943443+0000","last_change":"2024-09-19T07:20:19.543245+0000","last_active":"2024-09-19T07:20:37.943443+0000","last_peered":"2024-09-19T07:20:37.943443+0000","last_clean":"2024-09-19T07:20:37.943443+0000","last_became_active":"2024-09-19T07:20:19.542840+0000","last_became_peered":"2024-09-19T07:20:19.542840+0000","last_unstale":"2024-09-19T07:20:37.943443+0000","last_undegraded":"2024-09-19T07:20:37.943443+0000","last_fullsized":"2024-09-19T07:20:37.943443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:21.780027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790342+0000","last_change":"2024-09-19T07:20:19.528880+0000","last_active":"2024-09-19T07:20:37.790342+0000","last_peered":"2024-09-19T07:20:37.790342+0000","last_clean":"2024-09-19T07:20:37.790342+0000","last_became_active":"2024-09-19T07:20:19.528592+0000","last_became_peered":"2024-09-19T07:20:19.528592+0000","last_unstale":"2024-09-19T07:20:37.790342+0000","last_undegraded":"2024-09-19T07:20:37.790342+0000","last_fullsized":"2024-09-19T07:20:37.790342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:59.718929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T07:20:36.788162+0000","last_change":"2024-09-19T07:20:19.538480+0000","last_active":"2024-09-19T07:20:36.788162+0000","last_peered":"2024-09-19T07:20:36.788162+0000","last_clean":"2024-09-19T07:20:36.788162+0000","last_became_active":"2024-09-19T07:20:19.538189+0000","last_became_peered":"2024-09-19T07:20:19.538189+0000","last_unstale":"2024-09-19T07:20:36.788162+0000","last_undegraded":"2024-09-19T07:20:36.788162+0000","last_fullsized":"2024-09-19T07:20:36.788162+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:29.607974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791790+0000","last_change":"2024-09-19T07:20:19.538877+0000","last_active":"2024-09-19T07:20:37.791790+0000","last_peered":"2024-09-19T07:20:37.791790+0000","last_clean":"2024-09-19T07:20:37.791790+0000","last_became_active":"2024-09-19T07:20:19.538551+0000","last_became_peered":"2024-09-19T07:20:19.538551+0000","last_unstale":"2024-09-19T07:20:37.791790+0000","last_undegraded":"2024-09-19T07:20:37.791790+0000","last_fullsized":"2024-09-19T07:20:37.791790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:52.114115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786641+0000","last_change":"2024-09-19T07:20:19.538135+0000","last_active":"2024-09-19T07:20:37.786641+0000","last_peered":"2024-09-19T07:20:37.786641+0000","last_clean":"2024-09-19T07:20:37.786641+0000","last_became_active":"2024-09-19T07:20:19.537769+0000","last_became_peered":"2024-09-19T07:20:19.537769+0000","last_unstale":"2024-09-19T07:20:37.786641+0000","last_undegraded":"2024-09-19T07:20:37.786641+0000","last_fullsized":"2024-09-19T07:20:37.786641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:21.304262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.794226+0000","last_change":"2024-09-19T07:20:19.531569+0000","last_active":"2024-09-19T07:20:37.794226+0000","last_peered":"2024-09-19T07:20:37.794226+0000","last_clean":"2024-09-19T07:20:37.794226+0000","last_became_active":"2024-09-19T07:20:19.529455+0000","last_became_peered":"2024-09-19T07:20:19.529455+0000","last_unstale":"2024-09-19T07:20:37.794226+0000","last_undegraded":"2024-09-19T07:20:37.794226+0000","last_fullsized":"2024-09-19T07:20:37.794226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:22.187968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T07:20:36.788606+0000","last_change":"2024-09-19T07:20:19.540342+0000","last_active":"2024-09-19T07:20:36.788606+0000","last_peered":"2024-09-19T07:20:36.788606+0000","last_clean":"2024-09-19T07:20:36.788606+0000","last_became_active":"2024-09-19T07:20:19.539870+0000","last_became_peered":"2024-09-19T07:20:19.539870+0000","last_unstale":"2024-09-19T07:20:36.788606+0000","last_undegraded":"2024-09-19T07:20:36.788606+0000","last_fullsized":"2024-09-19T07:20:36.788606+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:39.930671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791533+0000","last_change":"2024-09-19T07:20:19.536004+0000","last_active":"2024-09-19T07:20:37.791533+0000","last_peered":"2024-09-19T07:20:37.791533+0000","last_clean":"2024-09-19T07:20:37.791533+0000","last_became_active":"2024-09-19T07:20:19.535640+0000","last_became_peered":"2024-09-19T07:20:19.535640+0000","last_unstale":"2024-09-19T07:20:37.791533+0000","last_undegraded":"2024-09-19T07:20:37.791533+0000","last_fullsized":"2024-09-19T07:20:37.791533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:47.853411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943531+0000","last_change":"2024-09-19T07:20:19.539374+0000","last_active":"2024-09-19T07:20:37.943531+0000","last_peered":"2024-09-19T07:20:37.943531+0000","last_clean":"2024-09-19T07:20:37.943531+0000","last_became_active":"2024-09-19T07:20:19.538880+0000","last_became_peered":"2024-09-19T07:20:19.538880+0000","last_unstale":"2024-09-19T07:20:37.943531+0000","last_undegraded":"2024-09-19T07:20:37.943531+0000","last_fullsized":"2024-09-19T07:20:37.943531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:55.484232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792753+0000","last_change":"2024-09-19T07:20:37.792753+0000","last_active":"2024-09-19T07:20:37.792753+0000","last_peered":"2024-09-19T07:20:37.792753+0000","last_clean":"2024-09-19T07:20:37.792753+0000","last_became_active":"2024-09-19T07:20:37.792417+0000","last_became_peered":"2024-09-19T07:20:37.792417+0000","last_unstale":"2024-09-19T07:20:37.792753+0000","last_undegraded":"2024-09-19T07:20:37.792753+0000","last_fullsized":"2024-09-19T07:20:37.792753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:10.417367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480887+0000","last_change":"2024-09-19T07:20:19.528842+0000","last_active":"2024-09-19T07:20:38.480887+0000","last_peered":"2024-09-19T07:20:38.480887+0000","last_clean":"2024-09-19T07:20:38.480887+0000","last_became_active":"2024-09-19T07:20:19.528042+0000","last_became_peered":"2024-09-19T07:20:19.528042+0000","last_unstale":"2024-09-19T07:20:38.480887+0000","last_undegraded":"2024-09-19T07:20:38.480887+0000","last_fullsized":"2024-09-19T07:20:38.480887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:34.970509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480784+0000","last_change":"2024-09-19T07:20:19.535013+0000","last_active":"2024-09-19T07:20:38.480784+0000","last_peered":"2024-09-19T07:20:38.480784+0000","last_clean":"2024-09-19T07:20:38.480784+0000","last_became_active":"2024-09-19T07:20:19.534302+0000","last_became_peered":"2024-09-19T07:20:19.534302+0000","last_unstale":"2024-09-19T07:20:38.480784+0000","last_undegraded":"2024-09-19T07:20:38.480784+0000","last_fullsized":"2024-09-19T07:20:38.480784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:52.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793587+0000","last_change":"2024-09-19T07:20:19.534930+0000","last_active":"2024-09-19T07:20:37.793587+0000","last_peered":"2024-09-19T07:20:37.793587+0000","last_clean":"2024-09-19T07:20:37.793587+0000","last_became_active":"2024-09-19T07:20:19.534640+0000","last_became_peered":"2024-09-19T07:20:19.534640+0000","last_unstale":"2024-09-19T07:20:37.793587+0000","last_undegraded":"2024-09-19T07:20:37.793587+0000","last_fullsized":"2024-09-19T07:20:37.793587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:23.055097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788533+0000","last_change":"2024-09-19T07:20:19.535856+0000","last_active":"2024-09-19T07:20:37.788533+0000","last_peered":"2024-09-19T07:20:37.788533+0000","last_clean":"2024-09-19T07:20:37.788533+0000","last_became_active":"2024-09-19T07:20:19.535561+0000","last_became_peered":"2024-09-19T07:20:19.535561+0000","last_unstale":"2024-09-19T07:20:37.788533+0000","last_undegraded":"2024-09-19T07:20:37.788533+0000","last_fullsized":"2024-09-19T07:20:37.788533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:03.943339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788597+0000","last_change":"2024-09-19T07:20:19.528429+0000","last_active":"2024-09-19T07:20:37.788597+0000","last_peered":"2024-09-19T07:20:37.788597+0000","last_clean":"2024-09-19T07:20:37.788597+0000","last_became_active":"2024-09-19T07:20:19.528107+0000","last_became_peered":"2024-09-19T07:20:19.528107+0000","last_unstale":"2024-09-19T07:20:37.788597+0000","last_undegraded":"2024-09-19T07:20:37.788597+0000","last_fullsized":"2024-09-19T07:20:37.788597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:49.520514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791782+0000","last_change":"2024-09-19T07:20:19.532966+0000","last_active":"2024-09-19T07:20:37.791782+0000","last_peered":"2024-09-19T07:20:37.791782+0000","last_clean":"2024-09-19T07:20:37.791782+0000","last_became_active":"2024-09-19T07:20:19.532412+0000","last_became_peered":"2024-09-19T07:20:19.532412+0000","last_unstale":"2024-09-19T07:20:37.791782+0000","last_undegraded":"2024-09-19T07:20:37.791782+0000","last_fullsized":"2024-09-19T07:20:37.791782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:42.900136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.797952+0000","last_change":"2024-09-19T07:20:37.797952+0000","last_active":"2024-09-19T07:20:37.797952+0000","last_peered":"2024-09-19T07:20:37.797952+0000","last_clean":"2024-09-19T07:20:37.797952+0000","last_became_active":"2024-09-19T07:20:37.797459+0000","last_became_peered":"2024-09-19T07:20:37.797459+0000","last_unstale":"2024-09-19T07:20:37.797952+0000","last_undegraded":"2024-09-19T07:20:37.797952+0000","last_fullsized":"2024-09-19T07:20:37.797952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:44.132477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790125+0000","last_change":"2024-09-19T07:20:19.532193+0000","last_active":"2024-09-19T07:20:37.790125+0000","last_peered":"2024-09-19T07:20:37.790125+0000","last_clean":"2024-09-19T07:20:37.790125+0000","last_became_active":"2024-09-19T07:20:19.531890+0000","last_became_peered":"2024-09-19T07:20:19.531890+0000","last_unstale":"2024-09-19T07:20:37.790125+0000","last_undegraded":"2024-09-19T07:20:37.790125+0000","last_fullsized":"2024-09-19T07:20:37.790125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:21.168993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793717+0000","last_change":"2024-09-19T07:20:19.535034+0000","last_active":"2024-09-19T07:20:37.793717+0000","last_peered":"2024-09-19T07:20:37.793717+0000","last_clean":"2024-09-19T07:20:37.793717+0000","last_became_active":"2024-09-19T07:20:19.534732+0000","last_became_peered":"2024-09-19T07:20:19.534732+0000","last_unstale":"2024-09-19T07:20:37.793717+0000","last_undegraded":"2024-09-19T07:20:37.793717+0000","last_fullsized":"2024-09-19T07:20:37.793717+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:13.726672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786690+0000","last_change":"2024-09-19T07:20:19.532644+0000","last_active":"2024-09-19T07:20:37.786690+0000","last_peered":"2024-09-19T07:20:37.786690+0000","last_clean":"2024-09-19T07:20:37.786690+0000","last_became_active":"2024-09-19T07:20:19.532364+0000","last_became_peered":"2024-09-19T07:20:19.532364+0000","last_unstale":"2024-09-19T07:20:37.786690+0000","last_undegraded":"2024-09-19T07:20:37.786690+0000","last_fullsized":"2024-09-19T07:20:37.786690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:17.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792578+0000","last_change":"2024-09-19T07:20:19.533500+0000","last_active":"2024-09-19T07:20:37.792578+0000","last_peered":"2024-09-19T07:20:37.792578+0000","last_clean":"2024-09-19T07:20:37.792578+0000","last_became_active":"2024-09-19T07:20:19.532759+0000","last_became_peered":"2024-09-19T07:20:19.532759+0000","last_unstale":"2024-09-19T07:20:37.792578+0000","last_undegraded":"2024-09-19T07:20:37.792578+0000","last_fullsized":"2024-09-19T07:20:37.792578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:35.549776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793776+0000","last_change":"2024-09-19T07:20:37.793776+0000","last_active":"2024-09-19T07:20:37.793776+0000","last_peered":"2024-09-19T07:20:37.793776+0000","last_clean":"2024-09-19T07:20:37.793776+0000","last_became_active":"2024-09-19T07:20:37.793382+0000","last_became_peered":"2024-09-19T07:20:37.793382+0000","last_unstale":"2024-09-19T07:20:37.793776+0000","last_undegraded":"2024-09-19T07:20:37.793776+0000","last_fullsized":"2024-09-19T07:20:37.793776+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:00.422534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791854+0000","last_change":"2024-09-19T07:20:19.532840+0000","last_active":"2024-09-19T07:20:37.791854+0000","last_peered":"2024-09-19T07:20:37.791854+0000","last_clean":"2024-09-19T07:20:37.791854+0000","last_became_active":"2024-09-19T07:20:19.532059+0000","last_became_peered":"2024-09-19T07:20:19.532059+0000","last_unstale":"2024-09-19T07:20:37.791854+0000","last_undegraded":"2024-09-19T07:20:37.791854+0000","last_fullsized":"2024-09-19T07:20:37.791854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:49.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788391+0000","last_change":"2024-09-19T07:20:19.528150+0000","last_active":"2024-09-19T07:20:37.788391+0000","last_peered":"2024-09-19T07:20:37.788391+0000","last_clean":"2024-09-19T07:20:37.788391+0000","last_became_active":"2024-09-19T07:20:19.527873+0000","last_became_peered":"2024-09-19T07:20:19.527873+0000","last_unstale":"2024-09-19T07:20:37.788391+0000","last_undegraded":"2024-09-19T07:20:37.788391+0000","last_fullsized":"2024-09-19T07:20:37.788391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.561937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789841+0000","last_change":"2024-09-19T07:20:19.540160+0000","last_active":"2024-09-19T07:20:37.789841+0000","last_peered":"2024-09-19T07:20:37.789841+0000","last_clean":"2024-09-19T07:20:37.789841+0000","last_became_active":"2024-09-19T07:20:19.539862+0000","last_became_peered":"2024-09-19T07:20:19.539862+0000","last_unstale":"2024-09-19T07:20:37.789841+0000","last_undegraded":"2024-09-19T07:20:37.789841+0000","last_fullsized":"2024-09-19T07:20:37.789841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:22.229785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480983+0000","last_change":"2024-09-19T07:20:19.540363+0000","last_active":"2024-09-19T07:20:38.480983+0000","last_peered":"2024-09-19T07:20:38.480983+0000","last_clean":"2024-09-19T07:20:38.480983+0000","last_became_active":"2024-09-19T07:20:19.540068+0000","last_became_peered":"2024-09-19T07:20:19.540068+0000","last_unstale":"2024-09-19T07:20:38.480983+0000","last_undegraded":"2024-09-19T07:20:38.480983+0000","last_fullsized":"2024-09-19T07:20:38.480983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:07.955849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790286+0000","last_change":"2024-09-19T07:20:19.533546+0000","last_active":"2024-09-19T07:20:37.790286+0000","last_peered":"2024-09-19T07:20:37.790286+0000","last_clean":"2024-09-19T07:20:37.790286+0000","last_became_active":"2024-09-19T07:20:19.533232+0000","last_became_peered":"2024-09-19T07:20:19.533232+0000","last_unstale":"2024-09-19T07:20:37.790286+0000","last_undegraded":"2024-09-19T07:20:37.790286+0000","last_fullsized":"2024-09-19T07:20:37.790286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:29.674866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791434+0000","last_change":"2024-09-19T07:20:19.542842+0000","last_active":"2024-09-19T07:20:37.791434+0000","last_peered":"2024-09-19T07:20:37.791434+0000","last_clean":"2024-09-19T07:20:37.791434+0000","last_became_active":"2024-09-19T07:20:19.542477+0000","last_became_peered":"2024-09-19T07:20:19.542477+0000","last_unstale":"2024-09-19T07:20:37.791434+0000","last_undegraded":"2024-09-19T07:20:37.791434+0000","last_fullsized":"2024-09-19T07:20:37.791434+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:30.921099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788038+0000","last_change":"2024-09-19T07:20:19.530472+0000","last_active":"2024-09-19T07:20:37.788038+0000","last_peered":"2024-09-19T07:20:37.788038+0000","last_clean":"2024-09-19T07:20:37.788038+0000","last_became_active":"2024-09-19T07:20:19.529457+0000","last_became_peered":"2024-09-19T07:20:19.529457+0000","last_unstale":"2024-09-19T07:20:37.788038+0000","last_undegraded":"2024-09-19T07:20:37.788038+0000","last_fullsized":"2024-09-19T07:20:37.788038+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:16.410723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.801168+0000","last_change":"2024-09-19T07:20:37.801168+0000","last_active":"2024-09-19T07:20:37.801168+0000","last_peered":"2024-09-19T07:20:37.801168+0000","last_clean":"2024-09-19T07:20:37.801168+0000","last_became_active":"2024-09-19T07:20:37.800613+0000","last_became_peered":"2024-09-19T07:20:37.800613+0000","last_unstale":"2024-09-19T07:20:37.801168+0000","last_undegraded":"2024-09-19T07:20:37.801168+0000","last_fullsized":"2024-09-19T07:20:37.801168+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:27.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:39.776552+0000","last_change":"2024-09-19T07:20:17.524656+0000","last_active":"2024-09-19T07:20:39.776552+0000","last_peered":"2024-09-19T07:20:39.776552+0000","last_clean":"2024-09-19T07:20:39.776552+0000","last_became_active":"2024-09-19T07:20:17.524350+0000","last_became_peered":"2024-09-19T07:20:17.524350+0000","last_unstale":"2024-09-19T07:20:39.776552+0000","last_undegraded":"2024-09-19T07:20:39.776552+0000","last_fullsized":"2024-09-19T07:20:39.776552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:00.459283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792702+0000","last_change":"2024-09-19T07:20:19.536895+0000","last_active":"2024-09-19T07:20:37.792702+0000","last_peered":"2024-09-19T07:20:37.792702+0000","last_clean":"2024-09-19T07:20:37.792702+0000","last_became_active":"2024-09-19T07:20:19.536569+0000","last_became_peered":"2024-09-19T07:20:19.536569+0000","last_unstale":"2024-09-19T07:20:37.792702+0000","last_undegraded":"2024-09-19T07:20:37.792702+0000","last_fullsized":"2024-09-19T07:20:37.792702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:56.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T07:20:36.788306+0000","last_change":"2024-09-19T07:20:17.519800+0000","last_active":"2024-09-19T07:20:36.788306+0000","last_peered":"2024-09-19T07:20:36.788306+0000","last_clean":"2024-09-19T07:20:36.788306+0000","last_became_active":"2024-09-19T07:20:17.519384+0000","last_became_peered":"2024-09-19T07:20:17.519384+0000","last_unstale":"2024-09-19T07:20:36.788306+0000","last_undegraded":"2024-09-19T07:20:36.788306+0000","last_fullsized":"2024-09-19T07:20:36.788306+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:17.346946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789970+0000","last_change":"2024-09-19T07:20:17.511178+0000","last_active":"2024-09-19T07:20:37.789970+0000","last_peered":"2024-09-19T07:20:37.789970+0000","last_clean":"2024-09-19T07:20:37.789970+0000","last_became_active":"2024-09-19T07:20:17.510646+0000","last_became_peered":"2024-09-19T07:20:17.510646+0000","last_unstale":"2024-09-19T07:20:37.789970+0000","last_undegraded":"2024-09-19T07:20:37.789970+0000","last_fullsized":"2024-09-19T07:20:37.789970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:58.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786720+0000","last_change":"2024-09-19T07:20:19.532979+0000","last_active":"2024-09-19T07:20:37.786720+0000","last_peered":"2024-09-19T07:20:37.786720+0000","last_clean":"2024-09-19T07:20:37.786720+0000","last_became_active":"2024-09-19T07:20:19.532396+0000","last_became_peered":"2024-09-19T07:20:19.532396+0000","last_unstale":"2024-09-19T07:20:37.786720+0000","last_undegraded":"2024-09-19T07:20:37.786720+0000","last_fullsized":"2024-09-19T07:20:37.786720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:24.313572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792865+0000","last_change":"2024-09-19T07:20:17.519327+0000","last_active":"2024-09-19T07:20:37.792865+0000","last_peered":"2024-09-19T07:20:37.792865+0000","last_clean":"2024-09-19T07:20:37.792865+0000","last_became_active":"2024-09-19T07:20:17.518916+0000","last_became_peered":"2024-09-19T07:20:17.518916+0000","last_unstale":"2024-09-19T07:20:37.792865+0000","last_undegraded":"2024-09-19T07:20:37.792865+0000","last_fullsized":"2024-09-19T07:20:37.792865+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:52.672016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788221+0000","last_change":"2024-09-19T07:20:19.528642+0000","last_active":"2024-09-19T07:20:37.788221+0000","last_peered":"2024-09-19T07:20:37.788221+0000","last_clean":"2024-09-19T07:20:37.788221+0000","last_became_active":"2024-09-19T07:20:19.528302+0000","last_became_peered":"2024-09-19T07:20:19.528302+0000","last_unstale":"2024-09-19T07:20:37.788221+0000","last_undegraded":"2024-09-19T07:20:37.788221+0000","last_fullsized":"2024-09-19T07:20:37.788221+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:22.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T07:20:36.788646+0000","last_change":"2024-09-19T07:20:17.519144+0000","last_active":"2024-09-19T07:20:36.788646+0000","last_peered":"2024-09-19T07:20:36.788646+0000","last_clean":"2024-09-19T07:20:36.788646+0000","last_became_active":"2024-09-19T07:20:17.518714+0000","last_became_peered":"2024-09-19T07:20:17.518714+0000","last_unstale":"2024-09-19T07:20:36.788646+0000","last_undegraded":"2024-09-19T07:20:36.788646+0000","last_fullsized":"2024-09-19T07:20:36.788646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:09.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793978+0000","last_change":"2024-09-19T07:20:19.532293+0000","last_active":"2024-09-19T07:20:37.793978+0000","last_peered":"2024-09-19T07:20:37.793978+0000","last_clean":"2024-09-19T07:20:37.793978+0000","last_became_active":"2024-09-19T07:20:19.531427+0000","last_became_peered":"2024-09-19T07:20:19.531427+0000","last_unstale":"2024-09-19T07:20:37.793978+0000","last_undegraded":"2024-09-19T07:20:37.793978+0000","last_fullsized":"2024-09-19T07:20:37.793978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:31.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791783+0000","last_change":"2024-09-19T07:20:17.521743+0000","last_active":"2024-09-19T07:20:37.791783+0000","last_peered":"2024-09-19T07:20:37.791783+0000","last_clean":"2024-09-19T07:20:37.791783+0000","last_became_active":"2024-09-19T07:20:17.521321+0000","last_became_peered":"2024-09-19T07:20:17.521321+0000","last_unstale":"2024-09-19T07:20:37.791783+0000","last_undegraded":"2024-09-19T07:20:37.791783+0000","last_fullsized":"2024-09-19T07:20:37.791783+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:21.107210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.481104+0000","last_change":"2024-09-19T07:20:19.532879+0000","last_active":"2024-09-19T07:20:38.481104+0000","last_peered":"2024-09-19T07:20:38.481104+0000","last_clean":"2024-09-19T07:20:38.481104+0000","last_became_active":"2024-09-19T07:20:19.532490+0000","last_became_peered":"2024-09-19T07:20:19.532490+0000","last_unstale":"2024-09-19T07:20:38.481104+0000","last_undegraded":"2024-09-19T07:20:38.481104+0000","last_fullsized":"2024-09-19T07:20:38.481104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:06.534849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793822+0000","last_change":"2024-09-19T07:20:17.565759+0000","last_active":"2024-09-19T07:20:37.793822+0000","last_peered":"2024-09-19T07:20:37.793822+0000","last_clean":"2024-09-19T07:20:37.793822+0000","last_became_active":"2024-09-19T07:20:17.565334+0000","last_became_peered":"2024-09-19T07:20:17.565334+0000","last_unstale":"2024-09-19T07:20:37.793822+0000","last_undegraded":"2024-09-19T07:20:37.793822+0000","last_fullsized":"2024-09-19T07:20:37.793822+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.588515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793971+0000","last_change":"2024-09-19T07:20:19.537397+0000","last_active":"2024-09-19T07:20:37.793971+0000","last_peered":"2024-09-19T07:20:37.793971+0000","last_clean":"2024-09-19T07:20:37.793971+0000","last_became_active":"2024-09-19T07:20:19.537059+0000","last_became_peered":"2024-09-19T07:20:19.537059+0000","last_unstale":"2024-09-19T07:20:37.793971+0000","last_undegraded":"2024-09-19T07:20:37.793971+0000","last_fullsized":"2024-09-19T07:20:37.793971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:30.146934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'17","reported_seq":57,"reported_epoch":78,"state":"peering","last_fresh":"2024-09-19T07:20:36.772810+0000","last_change":"2024-09-19T07:20:36.788858+0000","last_active":"2024-09-19T07:20:36.788858+0000","last_peered":"2024-09-19T07:20:36.772810+0000","last_clean":"2024-09-19T07:20:36.772810+0000","last_became_active":"2024-09-19T07:20:17.521978+0000","last_became_peered":"2024-09-19T07:20:17.521978+0000","last_unstale":"2024-09-19T07:20:36.772810+0000","last_undegraded":"2024-09-19T07:20:36.772810+0000","last_fullsized":"2024-09-19T07:20:36.772810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26947,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":18,"num_read_kb":30,"num_write":18,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2,4],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790648+0000","last_change":"2024-09-19T07:20:19.531533+0000","last_active":"2024-09-19T07:20:37.790648+0000","last_peered":"2024-09-19T07:20:37.790648+0000","last_clean":"2024-09-19T07:20:37.790648+0000","last_became_active":"2024-09-19T07:20:19.531228+0000","last_became_peered":"2024-09-19T07:20:19.531228+0000","last_unstale":"2024-09-19T07:20:37.790648+0000","last_undegraded":"2024-09-19T07:20:37.790648+0000","last_fullsized":"2024-09-19T07:20:37.790648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:34.606957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791767+0000","last_change":"2024-09-19T07:20:17.522411+0000","last_active":"2024-09-19T07:20:37.791767+0000","last_peered":"2024-09-19T07:20:37.791767+0000","last_clean":"2024-09-19T07:20:37.791767+0000","last_became_active":"2024-09-19T07:20:17.522086+0000","last_became_peered":"2024-09-19T07:20:17.522086+0000","last_unstale":"2024-09-19T07:20:37.791767+0000","last_undegraded":"2024-09-19T07:20:37.791767+0000","last_fullsized":"2024-09-19T07:20:37.791767+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.299624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789801+0000","last_change":"2024-09-19T07:20:19.532527+0000","last_active":"2024-09-19T07:20:37.789801+0000","last_peered":"2024-09-19T07:20:37.789801+0000","last_clean":"2024-09-19T07:20:37.789801+0000","last_became_active":"2024-09-19T07:20:19.532219+0000","last_became_peered":"2024-09-19T07:20:19.532219+0000","last_unstale":"2024-09-19T07:20:37.789801+0000","last_undegraded":"2024-09-19T07:20:37.789801+0000","last_fullsized":"2024-09-19T07:20:37.789801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:05.878229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792401+0000","last_change":"2024-09-19T07:20:17.518014+0000","last_active":"2024-09-19T07:20:37.792401+0000","last_peered":"2024-09-19T07:20:37.792401+0000","last_clean":"2024-09-19T07:20:37.792401+0000","last_became_active":"2024-09-19T07:20:17.517077+0000","last_became_peered":"2024-09-19T07:20:17.517077+0000","last_unstale":"2024-09-19T07:20:37.792401+0000","last_undegraded":"2024-09-19T07:20:37.792401+0000","last_fullsized":"2024-09-19T07:20:37.792401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:45.893365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791494+0000","last_change":"2024-09-19T07:20:19.539347+0000","last_active":"2024-09-19T07:20:37.791494+0000","last_peered":"2024-09-19T07:20:37.791494+0000","last_clean":"2024-09-19T07:20:37.791494+0000","last_became_active":"2024-09-19T07:20:19.538884+0000","last_became_peered":"2024-09-19T07:20:19.538884+0000","last_unstale":"2024-09-19T07:20:37.791494+0000","last_undegraded":"2024-09-19T07:20:37.791494+0000","last_fullsized":"2024-09-19T07:20:37.791494+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:23.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:39.776108+0000","last_change":"2024-09-19T07:20:17.513756+0000","last_active":"2024-09-19T07:20:39.776108+0000","last_peered":"2024-09-19T07:20:39.776108+0000","last_clean":"2024-09-19T07:20:39.776108+0000","last_became_active":"2024-09-19T07:20:17.513433+0000","last_became_peered":"2024-09-19T07:20:17.513433+0000","last_unstale":"2024-09-19T07:20:39.776108+0000","last_undegraded":"2024-09-19T07:20:39.776108+0000","last_fullsized":"2024-09-19T07:20:39.776108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:27.681161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792289+0000","last_change":"2024-09-19T07:20:19.539873+0000","last_active":"2024-09-19T07:20:37.792289+0000","last_peered":"2024-09-19T07:20:37.792289+0000","last_clean":"2024-09-19T07:20:37.792289+0000","last_became_active":"2024-09-19T07:20:19.539581+0000","last_became_peered":"2024-09-19T07:20:19.539581+0000","last_unstale":"2024-09-19T07:20:37.792289+0000","last_undegraded":"2024-09-19T07:20:37.792289+0000","last_fullsized":"2024-09-19T07:20:37.792289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:31.164179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790603+0000","last_change":"2024-09-19T07:20:17.565864+0000","last_active":"2024-09-19T07:20:37.790603+0000","last_peered":"2024-09-19T07:20:37.790603+0000","last_clean":"2024-09-19T07:20:37.790603+0000","last_became_active":"2024-09-19T07:20:17.565459+0000","last_became_peered":"2024-09-19T07:20:17.565459+0000","last_unstale":"2024-09-19T07:20:37.790603+0000","last_undegraded":"2024-09-19T07:20:37.790603+0000","last_fullsized":"2024-09-19T07:20:37.790603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:15.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.800857+0000","last_change":"2024-09-19T07:20:37.800857+0000","last_active":"2024-09-19T07:20:37.800857+0000","last_peered":"2024-09-19T07:20:37.800857+0000","last_clean":"2024-09-19T07:20:37.800857+0000","last_became_active":"2024-09-19T07:20:37.800347+0000","last_became_peered":"2024-09-19T07:20:37.800347+0000","last_unstale":"2024-09-19T07:20:37.800857+0000","last_undegraded":"2024-09-19T07:20:37.800857+0000","last_fullsized":"2024-09-19T07:20:37.800857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:48.678208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791580+0000","last_change":"2024-09-19T07:20:17.521439+0000","last_active":"2024-09-19T07:20:37.791580+0000","last_peered":"2024-09-19T07:20:37.791580+0000","last_clean":"2024-09-19T07:20:37.791580+0000","last_became_active":"2024-09-19T07:20:17.521021+0000","last_became_peered":"2024-09-19T07:20:17.521021+0000","last_unstale":"2024-09-19T07:20:37.791580+0000","last_undegraded":"2024-09-19T07:20:37.791580+0000","last_fullsized":"2024-09-19T07:20:37.791580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.322352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788196+0000","last_change":"2024-09-19T07:20:19.531234+0000","last_active":"2024-09-19T07:20:37.788196+0000","last_peered":"2024-09-19T07:20:37.788196+0000","last_clean":"2024-09-19T07:20:37.788196+0000","last_became_active":"2024-09-19T07:20:19.530422+0000","last_became_peered":"2024-09-19T07:20:19.530422+0000","last_unstale":"2024-09-19T07:20:37.788196+0000","last_undegraded":"2024-09-19T07:20:37.788196+0000","last_fullsized":"2024-09-19T07:20:37.788196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:57.325415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789844+0000","last_change":"2024-09-19T07:20:17.522426+0000","last_active":"2024-09-19T07:20:37.789844+0000","last_peered":"2024-09-19T07:20:37.789844+0000","last_clean":"2024-09-19T07:20:37.789844+0000","last_became_active":"2024-09-19T07:20:17.522061+0000","last_became_peered":"2024-09-19T07:20:17.522061+0000","last_unstale":"2024-09-19T07:20:37.789844+0000","last_undegraded":"2024-09-19T07:20:37.789844+0000","last_fullsized":"2024-09-19T07:20:37.789844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:04.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792454+0000","last_change":"2024-09-19T07:20:19.543420+0000","last_active":"2024-09-19T07:20:37.792454+0000","last_peered":"2024-09-19T07:20:37.792454+0000","last_clean":"2024-09-19T07:20:37.792454+0000","last_became_active":"2024-09-19T07:20:19.542294+0000","last_became_peered":"2024-09-19T07:20:19.542294+0000","last_unstale":"2024-09-19T07:20:37.792454+0000","last_undegraded":"2024-09-19T07:20:37.792454+0000","last_fullsized":"2024-09-19T07:20:37.792454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:32.119366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.794273+0000","last_change":"2024-09-19T07:20:17.518402+0000","last_active":"2024-09-19T07:20:37.794273+0000","last_peered":"2024-09-19T07:20:37.794273+0000","last_clean":"2024-09-19T07:20:37.794273+0000","last_became_active":"2024-09-19T07:20:17.517524+0000","last_became_peered":"2024-09-19T07:20:17.517524+0000","last_unstale":"2024-09-19T07:20:37.794273+0000","last_undegraded":"2024-09-19T07:20:37.794273+0000","last_fullsized":"2024-09-19T07:20:37.794273+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:49.843442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791877+0000","last_change":"2024-09-19T07:20:19.540945+0000","last_active":"2024-09-19T07:20:37.791877+0000","last_peered":"2024-09-19T07:20:37.791877+0000","last_clean":"2024-09-19T07:20:37.791877+0000","last_became_active":"2024-09-19T07:20:19.540641+0000","last_became_peered":"2024-09-19T07:20:19.540641+0000","last_unstale":"2024-09-19T07:20:37.791877+0000","last_undegraded":"2024-09-19T07:20:37.791877+0000","last_fullsized":"2024-09-19T07:20:37.791877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.487418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792157+0000","last_change":"2024-09-19T07:20:17.567010+0000","last_active":"2024-09-19T07:20:37.792157+0000","last_peered":"2024-09-19T07:20:37.792157+0000","last_clean":"2024-09-19T07:20:37.792157+0000","last_became_active":"2024-09-19T07:20:17.566560+0000","last_became_peered":"2024-09-19T07:20:17.566560+0000","last_unstale":"2024-09-19T07:20:37.792157+0000","last_undegraded":"2024-09-19T07:20:37.792157+0000","last_fullsized":"2024-09-19T07:20:37.792157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.349568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791673+0000","last_change":"2024-09-19T07:20:19.541808+0000","last_active":"2024-09-19T07:20:37.791673+0000","last_peered":"2024-09-19T07:20:37.791673+0000","last_clean":"2024-09-19T07:20:37.791673+0000","last_became_active":"2024-09-19T07:20:19.541510+0000","last_became_peered":"2024-09-19T07:20:19.541510+0000","last_unstale":"2024-09-19T07:20:37.791673+0000","last_undegraded":"2024-09-19T07:20:37.791673+0000","last_fullsized":"2024-09-19T07:20:37.791673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:04.156121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792406+0000","last_change":"2024-09-19T07:19:11.632651+0000","last_active":"2024-09-19T07:20:37.792406+0000","last_peered":"2024-09-19T07:20:37.792406+0000","last_clean":"2024-09-19T07:20:37.792406+0000","last_became_active":"2024-09-19T07:19:11.632229+0000","last_became_peered":"2024-09-19T07:19:11.632229+0000","last_unstale":"2024-09-19T07:20:37.792406+0000","last_undegraded":"2024-09-19T07:20:37.792406+0000","last_fullsized":"2024-09-19T07:20:37.792406+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_clean_scrub_stamp":"2024-09-19T07:15:50.875302+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:32.716049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943206+0000","last_change":"2024-09-19T07:20:17.512387+0000","last_active":"2024-09-19T07:20:37.943206+0000","last_peered":"2024-09-19T07:20:37.943206+0000","last_clean":"2024-09-19T07:20:37.943206+0000","last_became_active":"2024-09-19T07:20:17.511956+0000","last_became_peered":"2024-09-19T07:20:17.511956+0000","last_unstale":"2024-09-19T07:20:37.943206+0000","last_undegraded":"2024-09-19T07:20:37.943206+0000","last_fullsized":"2024-09-19T07:20:37.943206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:13.098347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786903+0000","last_change":"2024-09-19T07:20:19.536280+0000","last_active":"2024-09-19T07:20:37.786903+0000","last_peered":"2024-09-19T07:20:37.786903+0000","last_clean":"2024-09-19T07:20:37.786903+0000","last_became_active":"2024-09-19T07:20:19.535809+0000","last_became_peered":"2024-09-19T07:20:19.535809+0000","last_unstale":"2024-09-19T07:20:37.786903+0000","last_undegraded":"2024-09-19T07:20:37.786903+0000","last_fullsized":"2024-09-19T07:20:37.786903+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:07.645476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.801203+0000","last_change":"2024-09-19T07:20:37.800603+0000","last_active":"2024-09-19T07:20:37.801203+0000","last_peered":"2024-09-19T07:20:37.801203+0000","last_clean":"2024-09-19T07:20:37.801203+0000","last_became_active":"2024-09-19T07:20:37.794728+0000","last_became_peered":"2024-09-19T07:20:37.794728+0000","last_unstale":"2024-09-19T07:20:37.801203+0000","last_undegraded":"2024-09-19T07:20:37.801203+0000","last_fullsized":"2024-09-19T07:20:37.801203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:46.606645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789726+0000","last_change":"2024-09-19T07:20:19.540203+0000","last_active":"2024-09-19T07:20:37.789726+0000","last_peered":"2024-09-19T07:20:37.789726+0000","last_clean":"2024-09-19T07:20:37.789726+0000","last_became_active":"2024-09-19T07:20:19.539813+0000","last_became_peered":"2024-09-19T07:20:19.539813+0000","last_unstale":"2024-09-19T07:20:37.789726+0000","last_undegraded":"2024-09-19T07:20:37.789726+0000","last_fullsized":"2024-09-19T07:20:37.789726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:52.164881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790197+0000","last_change":"2024-09-19T07:20:17.565449+0000","last_active":"2024-09-19T07:20:37.790197+0000","last_peered":"2024-09-19T07:20:37.790197+0000","last_clean":"2024-09-19T07:20:37.790197+0000","last_became_active":"2024-09-19T07:20:17.565079+0000","last_became_peered":"2024-09-19T07:20:17.565079+0000","last_unstale":"2024-09-19T07:20:37.790197+0000","last_undegraded":"2024-09-19T07:20:37.790197+0000","last_fullsized":"2024-09-19T07:20:37.790197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:50.791388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792603+0000","last_change":"2024-09-19T07:20:19.533817+0000","last_active":"2024-09-19T07:20:37.792603+0000","last_peered":"2024-09-19T07:20:37.792603+0000","last_clean":"2024-09-19T07:20:37.792603+0000","last_became_active":"2024-09-19T07:20:19.532144+0000","last_became_peered":"2024-09-19T07:20:19.532144+0000","last_unstale":"2024-09-19T07:20:37.792603+0000","last_undegraded":"2024-09-19T07:20:37.792603+0000","last_fullsized":"2024-09-19T07:20:37.792603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:18.928739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791873+0000","last_change":"2024-09-19T07:20:17.514063+0000","last_active":"2024-09-19T07:20:37.791873+0000","last_peered":"2024-09-19T07:20:37.791873+0000","last_clean":"2024-09-19T07:20:37.791873+0000","last_became_active":"2024-09-19T07:20:17.513633+0000","last_became_peered":"2024-09-19T07:20:17.513633+0000","last_unstale":"2024-09-19T07:20:37.791873+0000","last_undegraded":"2024-09-19T07:20:37.791873+0000","last_fullsized":"2024-09-19T07:20:37.791873+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:24.113053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T07:20:36.788604+0000","last_change":"2024-09-19T07:20:19.540209+0000","last_active":"2024-09-19T07:20:36.788604+0000","last_peered":"2024-09-19T07:20:36.788604+0000","last_clean":"2024-09-19T07:20:36.788604+0000","last_became_active":"2024-09-19T07:20:19.539855+0000","last_became_peered":"2024-09-19T07:20:19.539855+0000","last_unstale":"2024-09-19T07:20:36.788604+0000","last_undegraded":"2024-09-19T07:20:36.788604+0000","last_fullsized":"2024-09-19T07:20:36.788604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:40.878905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788482+0000","last_change":"2024-09-19T07:20:17.565627+0000","last_active":"2024-09-19T07:20:37.788482+0000","last_peered":"2024-09-19T07:20:37.788482+0000","last_clean":"2024-09-19T07:20:37.788482+0000","last_became_active":"2024-09-19T07:20:17.565231+0000","last_became_peered":"2024-09-19T07:20:17.565231+0000","last_unstale":"2024-09-19T07:20:37.788482+0000","last_undegraded":"2024-09-19T07:20:37.788482+0000","last_fullsized":"2024-09-19T07:20:37.788482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:53.105336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-19T07:20:36.788419+0000","last_change":"2024-09-19T07:20:19.532418+0000","last_active":"2024-09-19T07:20:36.788419+0000","last_peered":"2024-09-19T07:20:36.788419+0000","last_clean":"2024-09-19T07:20:36.788419+0000","last_became_active":"2024-09-19T07:20:19.532113+0000","last_became_peered":"2024-09-19T07:20:19.532113+0000","last_unstale":"2024-09-19T07:20:36.788419+0000","last_undegraded":"2024-09-19T07:20:36.788419+0000","last_fullsized":"2024-09-19T07:20:36.788419+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:24.953720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790920+0000","last_change":"2024-09-19T07:20:17.565984+0000","last_active":"2024-09-19T07:20:37.790920+0000","last_peered":"2024-09-19T07:20:37.790920+0000","last_clean":"2024-09-19T07:20:37.790920+0000","last_became_active":"2024-09-19T07:20:17.565240+0000","last_became_peered":"2024-09-19T07:20:17.565240+0000","last_unstale":"2024-09-19T07:20:37.790920+0000","last_undegraded":"2024-09-19T07:20:37.790920+0000","last_fullsized":"2024-09-19T07:20:37.790920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:07.906716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789919+0000","last_change":"2024-09-19T07:20:19.534400+0000","last_active":"2024-09-19T07:20:37.789919+0000","last_peered":"2024-09-19T07:20:37.789919+0000","last_clean":"2024-09-19T07:20:37.789919+0000","last_became_active":"2024-09-19T07:20:19.534130+0000","last_became_peered":"2024-09-19T07:20:19.534130+0000","last_unstale":"2024-09-19T07:20:37.789919+0000","last_undegraded":"2024-09-19T07:20:37.789919+0000","last_fullsized":"2024-09-19T07:20:37.789919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:09.398112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'7","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788699+0000","last_change":"2024-09-19T07:20:17.519628+0000","last_active":"2024-09-19T07:20:37.788699+0000","last_peered":"2024-09-19T07:20:37.788699+0000","last_clean":"2024-09-19T07:20:37.788699+0000","last_became_active":"2024-09-19T07:20:17.519276+0000","last_became_peered":"2024-09-19T07:20:17.519276+0000","last_unstale":"2024-09-19T07:20:37.788699+0000","last_undegraded":"2024-09-19T07:20:37.788699+0000","last_fullsized":"2024-09-19T07:20:37.788699+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.193091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786947+0000","last_change":"2024-09-19T07:20:19.533425+0000","last_active":"2024-09-19T07:20:37.786947+0000","last_peered":"2024-09-19T07:20:37.786947+0000","last_clean":"2024-09-19T07:20:37.786947+0000","last_became_active":"2024-09-19T07:20:19.533142+0000","last_became_peered":"2024-09-19T07:20:19.533142+0000","last_unstale":"2024-09-19T07:20:37.786947+0000","last_undegraded":"2024-09-19T07:20:37.786947+0000","last_fullsized":"2024-09-19T07:20:37.786947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:07.048006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943680+0000","last_change":"2024-09-19T07:20:17.512776+0000","last_active":"2024-09-19T07:20:37.943680+0000","last_peered":"2024-09-19T07:20:37.943680+0000","last_clean":"2024-09-19T07:20:37.943680+0000","last_became_active":"2024-09-19T07:20:17.511862+0000","last_became_peered":"2024-09-19T07:20:17.511862+0000","last_unstale":"2024-09-19T07:20:37.943680+0000","last_undegraded":"2024-09-19T07:20:37.943680+0000","last_fullsized":"2024-09-19T07:20:37.943680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:08.211654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.481028+0000","last_change":"2024-09-19T07:20:19.539260+0000","last_active":"2024-09-19T07:20:38.481028+0000","last_peered":"2024-09-19T07:20:38.481028+0000","last_clean":"2024-09-19T07:20:38.481028+0000","last_became_active":"2024-09-19T07:20:19.538868+0000","last_became_peered":"2024-09-19T07:20:19.538868+0000","last_unstale":"2024-09-19T07:20:38.481028+0000","last_undegraded":"2024-09-19T07:20:38.481028+0000","last_fullsized":"2024-09-19T07:20:38.481028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:44.198084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793712+0000","last_change":"2024-09-19T07:20:17.565544+0000","last_active":"2024-09-19T07:20:37.793712+0000","last_peered":"2024-09-19T07:20:37.793712+0000","last_clean":"2024-09-19T07:20:37.793712+0000","last_became_active":"2024-09-19T07:20:17.565250+0000","last_became_peered":"2024-09-19T07:20:17.565250+0000","last_unstale":"2024-09-19T07:20:37.793712+0000","last_undegraded":"2024-09-19T07:20:37.793712+0000","last_fullsized":"2024-09-19T07:20:37.793712+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:25.523136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791794+0000","last_change":"2024-09-19T07:20:19.531467+0000","last_active":"2024-09-19T07:20:37.791794+0000","last_peered":"2024-09-19T07:20:37.791794+0000","last_clean":"2024-09-19T07:20:37.791794+0000","last_became_active":"2024-09-19T07:20:19.531170+0000","last_became_peered":"2024-09-19T07:20:19.531170+0000","last_unstale":"2024-09-19T07:20:37.791794+0000","last_undegraded":"2024-09-19T07:20:37.791794+0000","last_fullsized":"2024-09-19T07:20:37.791794+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:23.113097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786781+0000","last_change":"2024-09-19T07:20:17.511400+0000","last_active":"2024-09-19T07:20:37.786781+0000","last_peered":"2024-09-19T07:20:37.786781+0000","last_clean":"2024-09-19T07:20:37.786781+0000","last_became_active":"2024-09-19T07:20:17.511126+0000","last_became_peered":"2024-09-19T07:20:17.511126+0000","last_unstale":"2024-09-19T07:20:37.786781+0000","last_undegraded":"2024-09-19T07:20:37.786781+0000","last_fullsized":"2024-09-19T07:20:37.786781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.485406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788319+0000","last_change":"2024-09-19T07:20:19.529171+0000","last_active":"2024-09-19T07:20:37.788319+0000","last_peered":"2024-09-19T07:20:37.788319+0000","last_clean":"2024-09-19T07:20:37.788319+0000","last_became_active":"2024-09-19T07:20:19.528489+0000","last_became_peered":"2024-09-19T07:20:19.528489+0000","last_unstale":"2024-09-19T07:20:37.788319+0000","last_undegraded":"2024-09-19T07:20:37.788319+0000","last_fullsized":"2024-09-19T07:20:37.788319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:10.842619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.803998+0000","last_change":"2024-09-19T07:20:37.803560+0000","last_active":"2024-09-19T07:20:37.803998+0000","last_peered":"2024-09-19T07:20:37.803998+0000","last_clean":"2024-09-19T07:20:37.803998+0000","last_became_active":"2024-09-19T07:20:37.797396+0000","last_became_peered":"2024-09-19T07:20:37.797396+0000","last_unstale":"2024-09-19T07:20:37.803998+0000","last_undegraded":"2024-09-19T07:20:37.803998+0000","last_fullsized":"2024-09-19T07:20:37.803998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:41.944179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786827+0000","last_change":"2024-09-19T07:20:19.532698+0000","last_active":"2024-09-19T07:20:37.786827+0000","last_peered":"2024-09-19T07:20:37.786827+0000","last_clean":"2024-09-19T07:20:37.786827+0000","last_became_active":"2024-09-19T07:20:19.531978+0000","last_became_peered":"2024-09-19T07:20:19.531978+0000","last_unstale":"2024-09-19T07:20:37.786827+0000","last_undegraded":"2024-09-19T07:20:37.786827+0000","last_fullsized":"2024-09-19T07:20:37.786827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:44.257024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791819+0000","last_change":"2024-09-19T07:20:17.525240+0000","last_active":"2024-09-19T07:20:37.791819+0000","last_peered":"2024-09-19T07:20:37.791819+0000","last_clean":"2024-09-19T07:20:37.791819+0000","last_became_active":"2024-09-19T07:20:17.524880+0000","last_became_peered":"2024-09-19T07:20:17.524880+0000","last_unstale":"2024-09-19T07:20:37.791819+0000","last_undegraded":"2024-09-19T07:20:37.791819+0000","last_fullsized":"2024-09-19T07:20:37.791819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:41.380246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791596+0000","last_change":"2024-09-19T07:20:19.537116+0000","last_active":"2024-09-19T07:20:37.791596+0000","last_peered":"2024-09-19T07:20:37.791596+0000","last_clean":"2024-09-19T07:20:37.791596+0000","last_became_active":"2024-09-19T07:20:19.536799+0000","last_became_peered":"2024-09-19T07:20:19.536799+0000","last_unstale":"2024-09-19T07:20:37.791596+0000","last_undegraded":"2024-09-19T07:20:37.791596+0000","last_fullsized":"2024-09-19T07:20:37.791596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:48.401159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792890+0000","last_change":"2024-09-19T07:20:19.527965+0000","last_active":"2024-09-19T07:20:37.792890+0000","last_peered":"2024-09-19T07:20:37.792890+0000","last_clean":"2024-09-19T07:20:37.792890+0000","last_became_active":"2024-09-19T07:20:19.527522+0000","last_became_peered":"2024-09-19T07:20:19.527522+0000","last_unstale":"2024-09-19T07:20:37.792890+0000","last_undegraded":"2024-09-19T07:20:37.792890+0000","last_fullsized":"2024-09-19T07:20:37.792890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:16.034153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793263+0000","last_change":"2024-09-19T07:20:17.519400+0000","last_active":"2024-09-19T07:20:37.793263+0000","last_peered":"2024-09-19T07:20:37.793263+0000","last_clean":"2024-09-19T07:20:37.793263+0000","last_became_active":"2024-09-19T07:20:17.518993+0000","last_became_peered":"2024-09-19T07:20:17.518993+0000","last_unstale":"2024-09-19T07:20:37.793263+0000","last_undegraded":"2024-09-19T07:20:37.793263+0000","last_fullsized":"2024-09-19T07:20:37.793263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:37.086763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793704+0000","last_change":"2024-09-19T07:20:19.531016+0000","last_active":"2024-09-19T07:20:37.793704+0000","last_peered":"2024-09-19T07:20:37.793704+0000","last_clean":"2024-09-19T07:20:37.793704+0000","last_became_active":"2024-09-19T07:20:19.530706+0000","last_became_peered":"2024-09-19T07:20:19.530706+0000","last_unstale":"2024-09-19T07:20:37.793704+0000","last_undegraded":"2024-09-19T07:20:37.793704+0000","last_fullsized":"2024-09-19T07:20:37.793704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:36.566185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790803+0000","last_change":"2024-09-19T07:20:17.524215+0000","last_active":"2024-09-19T07:20:37.790803+0000","last_peered":"2024-09-19T07:20:37.790803+0000","last_clean":"2024-09-19T07:20:37.790803+0000","last_became_active":"2024-09-19T07:20:17.523813+0000","last_became_peered":"2024-09-19T07:20:17.523813+0000","last_unstale":"2024-09-19T07:20:37.790803+0000","last_undegraded":"2024-09-19T07:20:37.790803+0000","last_fullsized":"2024-09-19T07:20:37.790803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:58.803225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.481093+0000","last_change":"2024-09-19T07:20:19.540994+0000","last_active":"2024-09-19T07:20:38.481093+0000","last_peered":"2024-09-19T07:20:38.481093+0000","last_clean":"2024-09-19T07:20:38.481093+0000","last_became_active":"2024-09-19T07:20:19.540703+0000","last_became_peered":"2024-09-19T07:20:19.540703+0000","last_unstale":"2024-09-19T07:20:38.481093+0000","last_undegraded":"2024-09-19T07:20:38.481093+0000","last_fullsized":"2024-09-19T07:20:38.481093+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:37.065187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.787038+0000","last_change":"2024-09-19T07:20:17.565438+0000","last_active":"2024-09-19T07:20:37.787038+0000","last_peered":"2024-09-19T07:20:37.787038+0000","last_clean":"2024-09-19T07:20:37.787038+0000","last_became_active":"2024-09-19T07:20:17.565128+0000","last_became_peered":"2024-09-19T07:20:17.565128+0000","last_unstale":"2024-09-19T07:20:37.787038+0000","last_undegraded":"2024-09-19T07:20:37.787038+0000","last_fullsized":"2024-09-19T07:20:37.787038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:02.048971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.794751+0000","last_change":"2024-09-19T07:20:37.794369+0000","last_active":"2024-09-19T07:20:37.794751+0000","last_peered":"2024-09-19T07:20:37.794751+0000","last_clean":"2024-09-19T07:20:37.794751+0000","last_became_active":"2024-09-19T07:20:37.794036+0000","last_became_peered":"2024-09-19T07:20:37.794036+0000","last_unstale":"2024-09-19T07:20:37.794751+0000","last_undegraded":"2024-09-19T07:20:37.794751+0000","last_fullsized":"2024-09-19T07:20:37.794751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:02.684191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.950846+0000","last_change":"2024-09-19T07:20:37.950846+0000","last_active":"2024-09-19T07:20:37.950846+0000","last_peered":"2024-09-19T07:20:37.950846+0000","last_clean":"2024-09-19T07:20:37.950846+0000","last_became_active":"2024-09-19T07:20:37.944266+0000","last_became_peered":"2024-09-19T07:20:37.944266+0000","last_unstale":"2024-09-19T07:20:37.950846+0000","last_undegraded":"2024-09-19T07:20:37.950846+0000","last_fullsized":"2024-09-19T07:20:37.950846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:12.952833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":30557,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":142,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":128954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645328,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":864256,"data_stored":419734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874260,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1527808,"data_stored":1038162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037785,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":428495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266719,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495651,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1490944,"data_stored":1019954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659176,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":427884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888110,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1503232,"data_stored":1019638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018930,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":942080,"data_stored":469968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":428195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444092,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":429027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":925696,"data_stored":468742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":429155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":51338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":28525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:20:45.095 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:20:45.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:44 smithi162 ceph-mon[35726]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:20:45.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:44 smithi162 ceph-mon[35726]: pgmap v284: 97 pgs: 97 active+clean; 629 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.2 KiB/s wr, 9 op/s; 3.4 KiB/s, 1 objects/s recovering 2024-09-19T07:20:45.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:44 smithi139 ceph-mon[35039]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:20:45.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:44 smithi139 ceph-mon[35039]: pgmap v284: 97 pgs: 97 active+clean; 629 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.2 KiB/s wr, 9 op/s; 3.4 KiB/s, 1 objects/s recovering 2024-09-19T07:20:45.339 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:45.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.823+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/251699704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a88102de0 msgr2=0x7f1a881031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:45.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.823+0000 7f1a8c9bd640 1 --2- 172.21.15.98:0/251699704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a88102de0 0x7f1a881031c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1a78009900 tx=0x7f1a7802a480 comp rx=0 tx=0).stop 2024-09-19T07:20:45.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.823+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/251699704 shutdown_connections 2024-09-19T07:20:45.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.823+0000 7f1a8c9bd640 1 --2- 172.21.15.98:0/251699704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a8810c180 0x7f1a8810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.823+0000 7f1a8c9bd640 1 --2- 172.21.15.98:0/251699704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a88103700 0x7f1a8810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.823+0000 7f1a8c9bd640 1 --2- 172.21.15.98:0/251699704 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a88102de0 0x7f1a881031c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.823+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/251699704 >> 172.21.15.98:0/251699704 conn(0x7f1a880fc7a0 msgr2=0x7f1a880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.824+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/251699704 shutdown_connections 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.824+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/251699704 wait complete. 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.824+0000 7f1a8c9bd640 1 Processor -- start 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.824+0000 7f1a8c9bd640 1 -- start start 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.824+0000 7f1a8c9bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a88102de0 0x7f1a881984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.824+0000 7f1a8c9bd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a88103700 0x7f1a88198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a8c9bd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a8810c180 0x7f1a8819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a8c9bd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1a88111fd0 con 0x7f1a88103700 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a8c9bd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1a88111e50 con 0x7f1a8810c180 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a8c9bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1a88112150 con 0x7f1a88102de0 2024-09-19T07:20:45.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a85d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a88103700 0x7f1a88198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a85d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a88103700 0x7f1a88198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40502/0 (socket says 172.21.15.98:40502) 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a85d9b640 1 -- 172.21.15.98:0/2918086653 learned_addr learned my addr 172.21.15.98:0/2918086653 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a8659c640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a88102de0 0x7f1a881984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a86d9d640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a8810c180 0x7f1a8819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a85d9b640 1 -- 172.21.15.98:0/2918086653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a88102de0 msgr2=0x7f1a881984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a85d9b640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a88102de0 0x7f1a881984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a85d9b640 1 -- 172.21.15.98:0/2918086653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a8810c180 msgr2=0x7f1a8819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a85d9b640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a8810c180 0x7f1a8819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a85d9b640 1 -- 172.21.15.98:0/2918086653 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8819d470 con 0x7f1a88103700 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a85d9b640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a88103700 0x7f1a88198a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00b4a0 tx=0x7f1a7c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a777fe640 1 -- 172.21.15.98:0/2918086653 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c014070 con 0x7f1a88103700 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/2918086653 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a8819d760 con 0x7f1a88103700 2024-09-19T07:20:45.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a777fe640 1 -- 172.21.15.98:0/2918086653 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a7c010af0 con 0x7f1a88103700 2024-09-19T07:20:45.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a777fe640 1 -- 172.21.15.98:0/2918086653 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c017d10 con 0x7f1a88103700 2024-09-19T07:20:45.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.825+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/2918086653 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a881a5040 con 0x7f1a88103700 2024-09-19T07:20:45.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.826+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/2918086653 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a881031c0 con 0x7f1a88103700 2024-09-19T07:20:45.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.827+0000 7f1a777fe640 1 -- 172.21.15.98:0/2918086653 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1a7c017070 con 0x7f1a88103700 2024-09-19T07:20:45.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.828+0000 7f1a777fe640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1a700a32d0 0x7f1a700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:45.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.828+0000 7f1a8659c640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1a700a32d0 0x7f1a700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:45.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.828+0000 7f1a777fe640 1 -- 172.21.15.98:0/2918086653 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f1a7c0cecd0 con 0x7f1a88103700 2024-09-19T07:20:45.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.828+0000 7f1a8659c640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1a700a32d0 0x7f1a700a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1a78000c00 tx=0x7f1a780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:45.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.832+0000 7f1a777fe640 1 -- 172.21.15.98:0/2918086653 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1a7c09b330 con 0x7f1a88103700 2024-09-19T07:20:45.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:45.996+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/2918086653 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a88062630 con 0x7f1a700a32d0 2024-09-19T07:20:46.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.005+0000 7f1a777fe640 1 -- 172.21.15.98:0/2918086653 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258747 (secure 0 0 0) 0x7f1a88062630 con 0x7f1a700a32d0 2024-09-19T07:20:46.008 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:46.009 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-19T07:20:46.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.008+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/2918086653 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1a700a32d0 msgr2=0x7f1a700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:46.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.008+0000 7f1a8c9bd640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1a700a32d0 0x7f1a700a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1a78000c00 tx=0x7f1a780058d0 comp rx=0 tx=0).stop 2024-09-19T07:20:46.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.008+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/2918086653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a88103700 msgr2=0x7f1a88198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:46.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.008+0000 7f1a8c9bd640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a88103700 0x7f1a88198a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c00b4a0 tx=0x7f1a7c00b960 comp rx=0 tx=0).stop 2024-09-19T07:20:46.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.008+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/2918086653 shutdown_connections 2024-09-19T07:20:46.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.008+0000 7f1a8c9bd640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1a700a32d0 0x7f1a700a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:46.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.008+0000 7f1a8c9bd640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a8810c180 0x7f1a8819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:46.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.008+0000 7f1a8c9bd640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a88103700 0x7f1a88198a00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:46.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.008+0000 7f1a8c9bd640 1 --2- 172.21.15.98:0/2918086653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a88102de0 0x7f1a881984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:46.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.008+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/2918086653 >> 172.21.15.98:0/2918086653 conn(0x7f1a880fc7a0 msgr2=0x7f1a880fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:46.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.008+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/2918086653 shutdown_connections 2024-09-19T07:20:46.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:46.008+0000 7f1a8c9bd640 1 -- 172.21.15.98:0/2918086653 wait complete. 2024-09-19T07:20:46.703 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-19T07:20:44.655581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644324,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":231,"num_read_kb":218,"num_write":333,"num_write_kb":3035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1208265,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353380,"kb_used_data":12396,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588444,"statfs":{"total":1151940427776,"available":1151578566656,"internally_reserved":0,"allocated":12693504,"data_stored":7047002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48734,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":68,"num_write":25,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27529,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002176"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788444+0000","last_change":"2024-09-19T07:20:19.535372+0000","last_active":"2024-09-19T07:20:37.788444+0000","last_peered":"2024-09-19T07:20:37.788444+0000","last_clean":"2024-09-19T07:20:37.788444+0000","last_became_active":"2024-09-19T07:20:19.535079+0000","last_became_peered":"2024-09-19T07:20:19.535079+0000","last_unstale":"2024-09-19T07:20:37.788444+0000","last_undegraded":"2024-09-19T07:20:37.788444+0000","last_fullsized":"2024-09-19T07:20:37.788444+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:56.856451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480864+0000","last_change":"2024-09-19T07:20:19.528531+0000","last_active":"2024-09-19T07:20:38.480864+0000","last_peered":"2024-09-19T07:20:38.480864+0000","last_clean":"2024-09-19T07:20:38.480864+0000","last_became_active":"2024-09-19T07:20:19.528218+0000","last_became_peered":"2024-09-19T07:20:19.528218+0000","last_unstale":"2024-09-19T07:20:38.480864+0000","last_undegraded":"2024-09-19T07:20:38.480864+0000","last_fullsized":"2024-09-19T07:20:38.480864+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:44.730220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480860+0000","last_change":"2024-09-19T07:20:19.533516+0000","last_active":"2024-09-19T07:20:38.480860+0000","last_peered":"2024-09-19T07:20:38.480860+0000","last_clean":"2024-09-19T07:20:38.480860+0000","last_became_active":"2024-09-19T07:20:19.533247+0000","last_became_peered":"2024-09-19T07:20:19.533247+0000","last_unstale":"2024-09-19T07:20:38.480860+0000","last_undegraded":"2024-09-19T07:20:38.480860+0000","last_fullsized":"2024-09-19T07:20:38.480860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:29.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943443+0000","last_change":"2024-09-19T07:20:19.543245+0000","last_active":"2024-09-19T07:20:37.943443+0000","last_peered":"2024-09-19T07:20:37.943443+0000","last_clean":"2024-09-19T07:20:37.943443+0000","last_became_active":"2024-09-19T07:20:19.542840+0000","last_became_peered":"2024-09-19T07:20:19.542840+0000","last_unstale":"2024-09-19T07:20:37.943443+0000","last_undegraded":"2024-09-19T07:20:37.943443+0000","last_fullsized":"2024-09-19T07:20:37.943443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:21.780027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790342+0000","last_change":"2024-09-19T07:20:19.528880+0000","last_active":"2024-09-19T07:20:37.790342+0000","last_peered":"2024-09-19T07:20:37.790342+0000","last_clean":"2024-09-19T07:20:37.790342+0000","last_became_active":"2024-09-19T07:20:19.528592+0000","last_became_peered":"2024-09-19T07:20:19.528592+0000","last_unstale":"2024-09-19T07:20:37.790342+0000","last_undegraded":"2024-09-19T07:20:37.790342+0000","last_fullsized":"2024-09-19T07:20:37.790342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:59.718929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790665+0000","last_change":"2024-09-19T07:20:19.538480+0000","last_active":"2024-09-19T07:20:37.790665+0000","last_peered":"2024-09-19T07:20:37.790665+0000","last_clean":"2024-09-19T07:20:37.790665+0000","last_became_active":"2024-09-19T07:20:19.538189+0000","last_became_peered":"2024-09-19T07:20:19.538189+0000","last_unstale":"2024-09-19T07:20:37.790665+0000","last_undegraded":"2024-09-19T07:20:37.790665+0000","last_fullsized":"2024-09-19T07:20:37.790665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:29.607974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791790+0000","last_change":"2024-09-19T07:20:19.538877+0000","last_active":"2024-09-19T07:20:37.791790+0000","last_peered":"2024-09-19T07:20:37.791790+0000","last_clean":"2024-09-19T07:20:37.791790+0000","last_became_active":"2024-09-19T07:20:19.538551+0000","last_became_peered":"2024-09-19T07:20:19.538551+0000","last_unstale":"2024-09-19T07:20:37.791790+0000","last_undegraded":"2024-09-19T07:20:37.791790+0000","last_fullsized":"2024-09-19T07:20:37.791790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:52.114115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786641+0000","last_change":"2024-09-19T07:20:19.538135+0000","last_active":"2024-09-19T07:20:37.786641+0000","last_peered":"2024-09-19T07:20:37.786641+0000","last_clean":"2024-09-19T07:20:37.786641+0000","last_became_active":"2024-09-19T07:20:19.537769+0000","last_became_peered":"2024-09-19T07:20:19.537769+0000","last_unstale":"2024-09-19T07:20:37.786641+0000","last_undegraded":"2024-09-19T07:20:37.786641+0000","last_fullsized":"2024-09-19T07:20:37.786641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:21.304262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.794226+0000","last_change":"2024-09-19T07:20:19.531569+0000","last_active":"2024-09-19T07:20:37.794226+0000","last_peered":"2024-09-19T07:20:37.794226+0000","last_clean":"2024-09-19T07:20:37.794226+0000","last_became_active":"2024-09-19T07:20:19.529455+0000","last_became_peered":"2024-09-19T07:20:19.529455+0000","last_unstale":"2024-09-19T07:20:37.794226+0000","last_undegraded":"2024-09-19T07:20:37.794226+0000","last_fullsized":"2024-09-19T07:20:37.794226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:22.187968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791187+0000","last_change":"2024-09-19T07:20:19.540342+0000","last_active":"2024-09-19T07:20:37.791187+0000","last_peered":"2024-09-19T07:20:37.791187+0000","last_clean":"2024-09-19T07:20:37.791187+0000","last_became_active":"2024-09-19T07:20:19.539870+0000","last_became_peered":"2024-09-19T07:20:19.539870+0000","last_unstale":"2024-09-19T07:20:37.791187+0000","last_undegraded":"2024-09-19T07:20:37.791187+0000","last_fullsized":"2024-09-19T07:20:37.791187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:39.930671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791533+0000","last_change":"2024-09-19T07:20:19.536004+0000","last_active":"2024-09-19T07:20:37.791533+0000","last_peered":"2024-09-19T07:20:37.791533+0000","last_clean":"2024-09-19T07:20:37.791533+0000","last_became_active":"2024-09-19T07:20:19.535640+0000","last_became_peered":"2024-09-19T07:20:19.535640+0000","last_unstale":"2024-09-19T07:20:37.791533+0000","last_undegraded":"2024-09-19T07:20:37.791533+0000","last_fullsized":"2024-09-19T07:20:37.791533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:47.853411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943531+0000","last_change":"2024-09-19T07:20:19.539374+0000","last_active":"2024-09-19T07:20:37.943531+0000","last_peered":"2024-09-19T07:20:37.943531+0000","last_clean":"2024-09-19T07:20:37.943531+0000","last_became_active":"2024-09-19T07:20:19.538880+0000","last_became_peered":"2024-09-19T07:20:19.538880+0000","last_unstale":"2024-09-19T07:20:37.943531+0000","last_undegraded":"2024-09-19T07:20:37.943531+0000","last_fullsized":"2024-09-19T07:20:37.943531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:55.484232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792753+0000","last_change":"2024-09-19T07:20:37.792753+0000","last_active":"2024-09-19T07:20:37.792753+0000","last_peered":"2024-09-19T07:20:37.792753+0000","last_clean":"2024-09-19T07:20:37.792753+0000","last_became_active":"2024-09-19T07:20:37.792417+0000","last_became_peered":"2024-09-19T07:20:37.792417+0000","last_unstale":"2024-09-19T07:20:37.792753+0000","last_undegraded":"2024-09-19T07:20:37.792753+0000","last_fullsized":"2024-09-19T07:20:37.792753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:10.417367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480887+0000","last_change":"2024-09-19T07:20:19.528842+0000","last_active":"2024-09-19T07:20:38.480887+0000","last_peered":"2024-09-19T07:20:38.480887+0000","last_clean":"2024-09-19T07:20:38.480887+0000","last_became_active":"2024-09-19T07:20:19.528042+0000","last_became_peered":"2024-09-19T07:20:19.528042+0000","last_unstale":"2024-09-19T07:20:38.480887+0000","last_undegraded":"2024-09-19T07:20:38.480887+0000","last_fullsized":"2024-09-19T07:20:38.480887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:34.970509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480784+0000","last_change":"2024-09-19T07:20:19.535013+0000","last_active":"2024-09-19T07:20:38.480784+0000","last_peered":"2024-09-19T07:20:38.480784+0000","last_clean":"2024-09-19T07:20:38.480784+0000","last_became_active":"2024-09-19T07:20:19.534302+0000","last_became_peered":"2024-09-19T07:20:19.534302+0000","last_unstale":"2024-09-19T07:20:38.480784+0000","last_undegraded":"2024-09-19T07:20:38.480784+0000","last_fullsized":"2024-09-19T07:20:38.480784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:52.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793587+0000","last_change":"2024-09-19T07:20:19.534930+0000","last_active":"2024-09-19T07:20:37.793587+0000","last_peered":"2024-09-19T07:20:37.793587+0000","last_clean":"2024-09-19T07:20:37.793587+0000","last_became_active":"2024-09-19T07:20:19.534640+0000","last_became_peered":"2024-09-19T07:20:19.534640+0000","last_unstale":"2024-09-19T07:20:37.793587+0000","last_undegraded":"2024-09-19T07:20:37.793587+0000","last_fullsized":"2024-09-19T07:20:37.793587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:23.055097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788533+0000","last_change":"2024-09-19T07:20:19.535856+0000","last_active":"2024-09-19T07:20:37.788533+0000","last_peered":"2024-09-19T07:20:37.788533+0000","last_clean":"2024-09-19T07:20:37.788533+0000","last_became_active":"2024-09-19T07:20:19.535561+0000","last_became_peered":"2024-09-19T07:20:19.535561+0000","last_unstale":"2024-09-19T07:20:37.788533+0000","last_undegraded":"2024-09-19T07:20:37.788533+0000","last_fullsized":"2024-09-19T07:20:37.788533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:03.943339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788597+0000","last_change":"2024-09-19T07:20:19.528429+0000","last_active":"2024-09-19T07:20:37.788597+0000","last_peered":"2024-09-19T07:20:37.788597+0000","last_clean":"2024-09-19T07:20:37.788597+0000","last_became_active":"2024-09-19T07:20:19.528107+0000","last_became_peered":"2024-09-19T07:20:19.528107+0000","last_unstale":"2024-09-19T07:20:37.788597+0000","last_undegraded":"2024-09-19T07:20:37.788597+0000","last_fullsized":"2024-09-19T07:20:37.788597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:49.520514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791782+0000","last_change":"2024-09-19T07:20:19.532966+0000","last_active":"2024-09-19T07:20:37.791782+0000","last_peered":"2024-09-19T07:20:37.791782+0000","last_clean":"2024-09-19T07:20:37.791782+0000","last_became_active":"2024-09-19T07:20:19.532412+0000","last_became_peered":"2024-09-19T07:20:19.532412+0000","last_unstale":"2024-09-19T07:20:37.791782+0000","last_undegraded":"2024-09-19T07:20:37.791782+0000","last_fullsized":"2024-09-19T07:20:37.791782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:42.900136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.797952+0000","last_change":"2024-09-19T07:20:37.797952+0000","last_active":"2024-09-19T07:20:37.797952+0000","last_peered":"2024-09-19T07:20:37.797952+0000","last_clean":"2024-09-19T07:20:37.797952+0000","last_became_active":"2024-09-19T07:20:37.797459+0000","last_became_peered":"2024-09-19T07:20:37.797459+0000","last_unstale":"2024-09-19T07:20:37.797952+0000","last_undegraded":"2024-09-19T07:20:37.797952+0000","last_fullsized":"2024-09-19T07:20:37.797952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:44.132477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790125+0000","last_change":"2024-09-19T07:20:19.532193+0000","last_active":"2024-09-19T07:20:37.790125+0000","last_peered":"2024-09-19T07:20:37.790125+0000","last_clean":"2024-09-19T07:20:37.790125+0000","last_became_active":"2024-09-19T07:20:19.531890+0000","last_became_peered":"2024-09-19T07:20:19.531890+0000","last_unstale":"2024-09-19T07:20:37.790125+0000","last_undegraded":"2024-09-19T07:20:37.790125+0000","last_fullsized":"2024-09-19T07:20:37.790125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:21.168993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793717+0000","last_change":"2024-09-19T07:20:19.535034+0000","last_active":"2024-09-19T07:20:37.793717+0000","last_peered":"2024-09-19T07:20:37.793717+0000","last_clean":"2024-09-19T07:20:37.793717+0000","last_became_active":"2024-09-19T07:20:19.534732+0000","last_became_peered":"2024-09-19T07:20:19.534732+0000","last_unstale":"2024-09-19T07:20:37.793717+0000","last_undegraded":"2024-09-19T07:20:37.793717+0000","last_fullsized":"2024-09-19T07:20:37.793717+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:13.726672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786690+0000","last_change":"2024-09-19T07:20:19.532644+0000","last_active":"2024-09-19T07:20:37.786690+0000","last_peered":"2024-09-19T07:20:37.786690+0000","last_clean":"2024-09-19T07:20:37.786690+0000","last_became_active":"2024-09-19T07:20:19.532364+0000","last_became_peered":"2024-09-19T07:20:19.532364+0000","last_unstale":"2024-09-19T07:20:37.786690+0000","last_undegraded":"2024-09-19T07:20:37.786690+0000","last_fullsized":"2024-09-19T07:20:37.786690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:17.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792578+0000","last_change":"2024-09-19T07:20:19.533500+0000","last_active":"2024-09-19T07:20:37.792578+0000","last_peered":"2024-09-19T07:20:37.792578+0000","last_clean":"2024-09-19T07:20:37.792578+0000","last_became_active":"2024-09-19T07:20:19.532759+0000","last_became_peered":"2024-09-19T07:20:19.532759+0000","last_unstale":"2024-09-19T07:20:37.792578+0000","last_undegraded":"2024-09-19T07:20:37.792578+0000","last_fullsized":"2024-09-19T07:20:37.792578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:35.549776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793776+0000","last_change":"2024-09-19T07:20:37.793776+0000","last_active":"2024-09-19T07:20:37.793776+0000","last_peered":"2024-09-19T07:20:37.793776+0000","last_clean":"2024-09-19T07:20:37.793776+0000","last_became_active":"2024-09-19T07:20:37.793382+0000","last_became_peered":"2024-09-19T07:20:37.793382+0000","last_unstale":"2024-09-19T07:20:37.793776+0000","last_undegraded":"2024-09-19T07:20:37.793776+0000","last_fullsized":"2024-09-19T07:20:37.793776+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:00.422534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791854+0000","last_change":"2024-09-19T07:20:19.532840+0000","last_active":"2024-09-19T07:20:37.791854+0000","last_peered":"2024-09-19T07:20:37.791854+0000","last_clean":"2024-09-19T07:20:37.791854+0000","last_became_active":"2024-09-19T07:20:19.532059+0000","last_became_peered":"2024-09-19T07:20:19.532059+0000","last_unstale":"2024-09-19T07:20:37.791854+0000","last_undegraded":"2024-09-19T07:20:37.791854+0000","last_fullsized":"2024-09-19T07:20:37.791854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:49.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788391+0000","last_change":"2024-09-19T07:20:19.528150+0000","last_active":"2024-09-19T07:20:37.788391+0000","last_peered":"2024-09-19T07:20:37.788391+0000","last_clean":"2024-09-19T07:20:37.788391+0000","last_became_active":"2024-09-19T07:20:19.527873+0000","last_became_peered":"2024-09-19T07:20:19.527873+0000","last_unstale":"2024-09-19T07:20:37.788391+0000","last_undegraded":"2024-09-19T07:20:37.788391+0000","last_fullsized":"2024-09-19T07:20:37.788391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.561937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789841+0000","last_change":"2024-09-19T07:20:19.540160+0000","last_active":"2024-09-19T07:20:37.789841+0000","last_peered":"2024-09-19T07:20:37.789841+0000","last_clean":"2024-09-19T07:20:37.789841+0000","last_became_active":"2024-09-19T07:20:19.539862+0000","last_became_peered":"2024-09-19T07:20:19.539862+0000","last_unstale":"2024-09-19T07:20:37.789841+0000","last_undegraded":"2024-09-19T07:20:37.789841+0000","last_fullsized":"2024-09-19T07:20:37.789841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:22.229785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480983+0000","last_change":"2024-09-19T07:20:19.540363+0000","last_active":"2024-09-19T07:20:38.480983+0000","last_peered":"2024-09-19T07:20:38.480983+0000","last_clean":"2024-09-19T07:20:38.480983+0000","last_became_active":"2024-09-19T07:20:19.540068+0000","last_became_peered":"2024-09-19T07:20:19.540068+0000","last_unstale":"2024-09-19T07:20:38.480983+0000","last_undegraded":"2024-09-19T07:20:38.480983+0000","last_fullsized":"2024-09-19T07:20:38.480983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:07.955849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790286+0000","last_change":"2024-09-19T07:20:19.533546+0000","last_active":"2024-09-19T07:20:37.790286+0000","last_peered":"2024-09-19T07:20:37.790286+0000","last_clean":"2024-09-19T07:20:37.790286+0000","last_became_active":"2024-09-19T07:20:19.533232+0000","last_became_peered":"2024-09-19T07:20:19.533232+0000","last_unstale":"2024-09-19T07:20:37.790286+0000","last_undegraded":"2024-09-19T07:20:37.790286+0000","last_fullsized":"2024-09-19T07:20:37.790286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:29.674866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791434+0000","last_change":"2024-09-19T07:20:19.542842+0000","last_active":"2024-09-19T07:20:37.791434+0000","last_peered":"2024-09-19T07:20:37.791434+0000","last_clean":"2024-09-19T07:20:37.791434+0000","last_became_active":"2024-09-19T07:20:19.542477+0000","last_became_peered":"2024-09-19T07:20:19.542477+0000","last_unstale":"2024-09-19T07:20:37.791434+0000","last_undegraded":"2024-09-19T07:20:37.791434+0000","last_fullsized":"2024-09-19T07:20:37.791434+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:30.921099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788038+0000","last_change":"2024-09-19T07:20:19.530472+0000","last_active":"2024-09-19T07:20:37.788038+0000","last_peered":"2024-09-19T07:20:37.788038+0000","last_clean":"2024-09-19T07:20:37.788038+0000","last_became_active":"2024-09-19T07:20:19.529457+0000","last_became_peered":"2024-09-19T07:20:19.529457+0000","last_unstale":"2024-09-19T07:20:37.788038+0000","last_undegraded":"2024-09-19T07:20:37.788038+0000","last_fullsized":"2024-09-19T07:20:37.788038+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:16.410723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.801168+0000","last_change":"2024-09-19T07:20:37.801168+0000","last_active":"2024-09-19T07:20:37.801168+0000","last_peered":"2024-09-19T07:20:37.801168+0000","last_clean":"2024-09-19T07:20:37.801168+0000","last_became_active":"2024-09-19T07:20:37.800613+0000","last_became_peered":"2024-09-19T07:20:37.800613+0000","last_unstale":"2024-09-19T07:20:37.801168+0000","last_undegraded":"2024-09-19T07:20:37.801168+0000","last_fullsized":"2024-09-19T07:20:37.801168+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:27.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":41,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:39.776552+0000","last_change":"2024-09-19T07:20:17.524656+0000","last_active":"2024-09-19T07:20:39.776552+0000","last_peered":"2024-09-19T07:20:39.776552+0000","last_clean":"2024-09-19T07:20:39.776552+0000","last_became_active":"2024-09-19T07:20:17.524350+0000","last_became_peered":"2024-09-19T07:20:17.524350+0000","last_unstale":"2024-09-19T07:20:39.776552+0000","last_undegraded":"2024-09-19T07:20:39.776552+0000","last_fullsized":"2024-09-19T07:20:39.776552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:00.459283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792702+0000","last_change":"2024-09-19T07:20:19.536895+0000","last_active":"2024-09-19T07:20:37.792702+0000","last_peered":"2024-09-19T07:20:37.792702+0000","last_clean":"2024-09-19T07:20:37.792702+0000","last_became_active":"2024-09-19T07:20:19.536569+0000","last_became_peered":"2024-09-19T07:20:19.536569+0000","last_unstale":"2024-09-19T07:20:37.792702+0000","last_undegraded":"2024-09-19T07:20:37.792702+0000","last_fullsized":"2024-09-19T07:20:37.792702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:56.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790688+0000","last_change":"2024-09-19T07:20:17.519800+0000","last_active":"2024-09-19T07:20:37.790688+0000","last_peered":"2024-09-19T07:20:37.790688+0000","last_clean":"2024-09-19T07:20:37.790688+0000","last_became_active":"2024-09-19T07:20:17.519384+0000","last_became_peered":"2024-09-19T07:20:17.519384+0000","last_unstale":"2024-09-19T07:20:37.790688+0000","last_undegraded":"2024-09-19T07:20:37.790688+0000","last_fullsized":"2024-09-19T07:20:37.790688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:17.346946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789970+0000","last_change":"2024-09-19T07:20:17.511178+0000","last_active":"2024-09-19T07:20:37.789970+0000","last_peered":"2024-09-19T07:20:37.789970+0000","last_clean":"2024-09-19T07:20:37.789970+0000","last_became_active":"2024-09-19T07:20:17.510646+0000","last_became_peered":"2024-09-19T07:20:17.510646+0000","last_unstale":"2024-09-19T07:20:37.789970+0000","last_undegraded":"2024-09-19T07:20:37.789970+0000","last_fullsized":"2024-09-19T07:20:37.789970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:58.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786720+0000","last_change":"2024-09-19T07:20:19.532979+0000","last_active":"2024-09-19T07:20:37.786720+0000","last_peered":"2024-09-19T07:20:37.786720+0000","last_clean":"2024-09-19T07:20:37.786720+0000","last_became_active":"2024-09-19T07:20:19.532396+0000","last_became_peered":"2024-09-19T07:20:19.532396+0000","last_unstale":"2024-09-19T07:20:37.786720+0000","last_undegraded":"2024-09-19T07:20:37.786720+0000","last_fullsized":"2024-09-19T07:20:37.786720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:24.313572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792865+0000","last_change":"2024-09-19T07:20:17.519327+0000","last_active":"2024-09-19T07:20:37.792865+0000","last_peered":"2024-09-19T07:20:37.792865+0000","last_clean":"2024-09-19T07:20:37.792865+0000","last_became_active":"2024-09-19T07:20:17.518916+0000","last_became_peered":"2024-09-19T07:20:17.518916+0000","last_unstale":"2024-09-19T07:20:37.792865+0000","last_undegraded":"2024-09-19T07:20:37.792865+0000","last_fullsized":"2024-09-19T07:20:37.792865+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:52.672016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788221+0000","last_change":"2024-09-19T07:20:19.528642+0000","last_active":"2024-09-19T07:20:37.788221+0000","last_peered":"2024-09-19T07:20:37.788221+0000","last_clean":"2024-09-19T07:20:37.788221+0000","last_became_active":"2024-09-19T07:20:19.528302+0000","last_became_peered":"2024-09-19T07:20:19.528302+0000","last_unstale":"2024-09-19T07:20:37.788221+0000","last_undegraded":"2024-09-19T07:20:37.788221+0000","last_fullsized":"2024-09-19T07:20:37.788221+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:22.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:40.777437+0000","last_change":"2024-09-19T07:20:17.519144+0000","last_active":"2024-09-19T07:20:40.777437+0000","last_peered":"2024-09-19T07:20:40.777437+0000","last_clean":"2024-09-19T07:20:40.777437+0000","last_became_active":"2024-09-19T07:20:17.518714+0000","last_became_peered":"2024-09-19T07:20:17.518714+0000","last_unstale":"2024-09-19T07:20:40.777437+0000","last_undegraded":"2024-09-19T07:20:40.777437+0000","last_fullsized":"2024-09-19T07:20:40.777437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:09.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793978+0000","last_change":"2024-09-19T07:20:19.532293+0000","last_active":"2024-09-19T07:20:37.793978+0000","last_peered":"2024-09-19T07:20:37.793978+0000","last_clean":"2024-09-19T07:20:37.793978+0000","last_became_active":"2024-09-19T07:20:19.531427+0000","last_became_peered":"2024-09-19T07:20:19.531427+0000","last_unstale":"2024-09-19T07:20:37.793978+0000","last_undegraded":"2024-09-19T07:20:37.793978+0000","last_fullsized":"2024-09-19T07:20:37.793978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:31.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791783+0000","last_change":"2024-09-19T07:20:17.521743+0000","last_active":"2024-09-19T07:20:37.791783+0000","last_peered":"2024-09-19T07:20:37.791783+0000","last_clean":"2024-09-19T07:20:37.791783+0000","last_became_active":"2024-09-19T07:20:17.521321+0000","last_became_peered":"2024-09-19T07:20:17.521321+0000","last_unstale":"2024-09-19T07:20:37.791783+0000","last_undegraded":"2024-09-19T07:20:37.791783+0000","last_fullsized":"2024-09-19T07:20:37.791783+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:21.107210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.481104+0000","last_change":"2024-09-19T07:20:19.532879+0000","last_active":"2024-09-19T07:20:38.481104+0000","last_peered":"2024-09-19T07:20:38.481104+0000","last_clean":"2024-09-19T07:20:38.481104+0000","last_became_active":"2024-09-19T07:20:19.532490+0000","last_became_peered":"2024-09-19T07:20:19.532490+0000","last_unstale":"2024-09-19T07:20:38.481104+0000","last_undegraded":"2024-09-19T07:20:38.481104+0000","last_fullsized":"2024-09-19T07:20:38.481104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:06.534849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793822+0000","last_change":"2024-09-19T07:20:17.565759+0000","last_active":"2024-09-19T07:20:37.793822+0000","last_peered":"2024-09-19T07:20:37.793822+0000","last_clean":"2024-09-19T07:20:37.793822+0000","last_became_active":"2024-09-19T07:20:17.565334+0000","last_became_peered":"2024-09-19T07:20:17.565334+0000","last_unstale":"2024-09-19T07:20:37.793822+0000","last_undegraded":"2024-09-19T07:20:37.793822+0000","last_fullsized":"2024-09-19T07:20:37.793822+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.588515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793971+0000","last_change":"2024-09-19T07:20:19.537397+0000","last_active":"2024-09-19T07:20:37.793971+0000","last_peered":"2024-09-19T07:20:37.793971+0000","last_clean":"2024-09-19T07:20:37.793971+0000","last_became_active":"2024-09-19T07:20:19.537059+0000","last_became_peered":"2024-09-19T07:20:19.537059+0000","last_unstale":"2024-09-19T07:20:37.793971+0000","last_undegraded":"2024-09-19T07:20:37.793971+0000","last_fullsized":"2024-09-19T07:20:37.793971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:30.146934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'25","reported_seq":98,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:41.955119+0000","last_change":"2024-09-19T07:20:37.956721+0000","last_active":"2024-09-19T07:20:41.955119+0000","last_peered":"2024-09-19T07:20:41.955119+0000","last_clean":"2024-09-19T07:20:41.955119+0000","last_became_active":"2024-09-19T07:20:37.944159+0000","last_became_peered":"2024-09-19T07:20:37.944159+0000","last_unstale":"2024-09-19T07:20:41.955119+0000","last_undegraded":"2024-09-19T07:20:41.955119+0000","last_fullsized":"2024-09-19T07:20:41.955119+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:52.944073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":58,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790648+0000","last_change":"2024-09-19T07:20:19.531533+0000","last_active":"2024-09-19T07:20:37.790648+0000","last_peered":"2024-09-19T07:20:37.790648+0000","last_clean":"2024-09-19T07:20:37.790648+0000","last_became_active":"2024-09-19T07:20:19.531228+0000","last_became_peered":"2024-09-19T07:20:19.531228+0000","last_unstale":"2024-09-19T07:20:37.790648+0000","last_undegraded":"2024-09-19T07:20:37.790648+0000","last_fullsized":"2024-09-19T07:20:37.790648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:34.606957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791767+0000","last_change":"2024-09-19T07:20:17.522411+0000","last_active":"2024-09-19T07:20:37.791767+0000","last_peered":"2024-09-19T07:20:37.791767+0000","last_clean":"2024-09-19T07:20:37.791767+0000","last_became_active":"2024-09-19T07:20:17.522086+0000","last_became_peered":"2024-09-19T07:20:17.522086+0000","last_unstale":"2024-09-19T07:20:37.791767+0000","last_undegraded":"2024-09-19T07:20:37.791767+0000","last_fullsized":"2024-09-19T07:20:37.791767+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.299624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789801+0000","last_change":"2024-09-19T07:20:19.532527+0000","last_active":"2024-09-19T07:20:37.789801+0000","last_peered":"2024-09-19T07:20:37.789801+0000","last_clean":"2024-09-19T07:20:37.789801+0000","last_became_active":"2024-09-19T07:20:19.532219+0000","last_became_peered":"2024-09-19T07:20:19.532219+0000","last_unstale":"2024-09-19T07:20:37.789801+0000","last_undegraded":"2024-09-19T07:20:37.789801+0000","last_fullsized":"2024-09-19T07:20:37.789801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:05.878229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792401+0000","last_change":"2024-09-19T07:20:17.518014+0000","last_active":"2024-09-19T07:20:37.792401+0000","last_peered":"2024-09-19T07:20:37.792401+0000","last_clean":"2024-09-19T07:20:37.792401+0000","last_became_active":"2024-09-19T07:20:17.517077+0000","last_became_peered":"2024-09-19T07:20:17.517077+0000","last_unstale":"2024-09-19T07:20:37.792401+0000","last_undegraded":"2024-09-19T07:20:37.792401+0000","last_fullsized":"2024-09-19T07:20:37.792401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:45.893365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791494+0000","last_change":"2024-09-19T07:20:19.539347+0000","last_active":"2024-09-19T07:20:37.791494+0000","last_peered":"2024-09-19T07:20:37.791494+0000","last_clean":"2024-09-19T07:20:37.791494+0000","last_became_active":"2024-09-19T07:20:19.538884+0000","last_became_peered":"2024-09-19T07:20:19.538884+0000","last_unstale":"2024-09-19T07:20:37.791494+0000","last_undegraded":"2024-09-19T07:20:37.791494+0000","last_fullsized":"2024-09-19T07:20:37.791494+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:23.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":39,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:39.776108+0000","last_change":"2024-09-19T07:20:17.513756+0000","last_active":"2024-09-19T07:20:39.776108+0000","last_peered":"2024-09-19T07:20:39.776108+0000","last_clean":"2024-09-19T07:20:39.776108+0000","last_became_active":"2024-09-19T07:20:17.513433+0000","last_became_peered":"2024-09-19T07:20:17.513433+0000","last_unstale":"2024-09-19T07:20:39.776108+0000","last_undegraded":"2024-09-19T07:20:39.776108+0000","last_fullsized":"2024-09-19T07:20:39.776108+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:27.681161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792289+0000","last_change":"2024-09-19T07:20:19.539873+0000","last_active":"2024-09-19T07:20:37.792289+0000","last_peered":"2024-09-19T07:20:37.792289+0000","last_clean":"2024-09-19T07:20:37.792289+0000","last_became_active":"2024-09-19T07:20:19.539581+0000","last_became_peered":"2024-09-19T07:20:19.539581+0000","last_unstale":"2024-09-19T07:20:37.792289+0000","last_undegraded":"2024-09-19T07:20:37.792289+0000","last_fullsized":"2024-09-19T07:20:37.792289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:31.164179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790603+0000","last_change":"2024-09-19T07:20:17.565864+0000","last_active":"2024-09-19T07:20:37.790603+0000","last_peered":"2024-09-19T07:20:37.790603+0000","last_clean":"2024-09-19T07:20:37.790603+0000","last_became_active":"2024-09-19T07:20:17.565459+0000","last_became_peered":"2024-09-19T07:20:17.565459+0000","last_unstale":"2024-09-19T07:20:37.790603+0000","last_undegraded":"2024-09-19T07:20:37.790603+0000","last_fullsized":"2024-09-19T07:20:37.790603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:15.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.800857+0000","last_change":"2024-09-19T07:20:37.800857+0000","last_active":"2024-09-19T07:20:37.800857+0000","last_peered":"2024-09-19T07:20:37.800857+0000","last_clean":"2024-09-19T07:20:37.800857+0000","last_became_active":"2024-09-19T07:20:37.800347+0000","last_became_peered":"2024-09-19T07:20:37.800347+0000","last_unstale":"2024-09-19T07:20:37.800857+0000","last_undegraded":"2024-09-19T07:20:37.800857+0000","last_fullsized":"2024-09-19T07:20:37.800857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:48.678208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791580+0000","last_change":"2024-09-19T07:20:17.521439+0000","last_active":"2024-09-19T07:20:37.791580+0000","last_peered":"2024-09-19T07:20:37.791580+0000","last_clean":"2024-09-19T07:20:37.791580+0000","last_became_active":"2024-09-19T07:20:17.521021+0000","last_became_peered":"2024-09-19T07:20:17.521021+0000","last_unstale":"2024-09-19T07:20:37.791580+0000","last_undegraded":"2024-09-19T07:20:37.791580+0000","last_fullsized":"2024-09-19T07:20:37.791580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.322352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788196+0000","last_change":"2024-09-19T07:20:19.531234+0000","last_active":"2024-09-19T07:20:37.788196+0000","last_peered":"2024-09-19T07:20:37.788196+0000","last_clean":"2024-09-19T07:20:37.788196+0000","last_became_active":"2024-09-19T07:20:19.530422+0000","last_became_peered":"2024-09-19T07:20:19.530422+0000","last_unstale":"2024-09-19T07:20:37.788196+0000","last_undegraded":"2024-09-19T07:20:37.788196+0000","last_fullsized":"2024-09-19T07:20:37.788196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:57.325415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789844+0000","last_change":"2024-09-19T07:20:17.522426+0000","last_active":"2024-09-19T07:20:37.789844+0000","last_peered":"2024-09-19T07:20:37.789844+0000","last_clean":"2024-09-19T07:20:37.789844+0000","last_became_active":"2024-09-19T07:20:17.522061+0000","last_became_peered":"2024-09-19T07:20:17.522061+0000","last_unstale":"2024-09-19T07:20:37.789844+0000","last_undegraded":"2024-09-19T07:20:37.789844+0000","last_fullsized":"2024-09-19T07:20:37.789844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:04.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792454+0000","last_change":"2024-09-19T07:20:19.543420+0000","last_active":"2024-09-19T07:20:37.792454+0000","last_peered":"2024-09-19T07:20:37.792454+0000","last_clean":"2024-09-19T07:20:37.792454+0000","last_became_active":"2024-09-19T07:20:19.542294+0000","last_became_peered":"2024-09-19T07:20:19.542294+0000","last_unstale":"2024-09-19T07:20:37.792454+0000","last_undegraded":"2024-09-19T07:20:37.792454+0000","last_fullsized":"2024-09-19T07:20:37.792454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:32.119366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.794273+0000","last_change":"2024-09-19T07:20:17.518402+0000","last_active":"2024-09-19T07:20:37.794273+0000","last_peered":"2024-09-19T07:20:37.794273+0000","last_clean":"2024-09-19T07:20:37.794273+0000","last_became_active":"2024-09-19T07:20:17.517524+0000","last_became_peered":"2024-09-19T07:20:17.517524+0000","last_unstale":"2024-09-19T07:20:37.794273+0000","last_undegraded":"2024-09-19T07:20:37.794273+0000","last_fullsized":"2024-09-19T07:20:37.794273+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:49.843442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791877+0000","last_change":"2024-09-19T07:20:19.540945+0000","last_active":"2024-09-19T07:20:37.791877+0000","last_peered":"2024-09-19T07:20:37.791877+0000","last_clean":"2024-09-19T07:20:37.791877+0000","last_became_active":"2024-09-19T07:20:19.540641+0000","last_became_peered":"2024-09-19T07:20:19.540641+0000","last_unstale":"2024-09-19T07:20:37.791877+0000","last_undegraded":"2024-09-19T07:20:37.791877+0000","last_fullsized":"2024-09-19T07:20:37.791877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.487418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792157+0000","last_change":"2024-09-19T07:20:17.567010+0000","last_active":"2024-09-19T07:20:37.792157+0000","last_peered":"2024-09-19T07:20:37.792157+0000","last_clean":"2024-09-19T07:20:37.792157+0000","last_became_active":"2024-09-19T07:20:17.566560+0000","last_became_peered":"2024-09-19T07:20:17.566560+0000","last_unstale":"2024-09-19T07:20:37.792157+0000","last_undegraded":"2024-09-19T07:20:37.792157+0000","last_fullsized":"2024-09-19T07:20:37.792157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.349568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791673+0000","last_change":"2024-09-19T07:20:19.541808+0000","last_active":"2024-09-19T07:20:37.791673+0000","last_peered":"2024-09-19T07:20:37.791673+0000","last_clean":"2024-09-19T07:20:37.791673+0000","last_became_active":"2024-09-19T07:20:19.541510+0000","last_became_peered":"2024-09-19T07:20:19.541510+0000","last_unstale":"2024-09-19T07:20:37.791673+0000","last_undegraded":"2024-09-19T07:20:37.791673+0000","last_fullsized":"2024-09-19T07:20:37.791673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:04.156121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792406+0000","last_change":"2024-09-19T07:19:11.632651+0000","last_active":"2024-09-19T07:20:37.792406+0000","last_peered":"2024-09-19T07:20:37.792406+0000","last_clean":"2024-09-19T07:20:37.792406+0000","last_became_active":"2024-09-19T07:19:11.632229+0000","last_became_peered":"2024-09-19T07:19:11.632229+0000","last_unstale":"2024-09-19T07:20:37.792406+0000","last_undegraded":"2024-09-19T07:20:37.792406+0000","last_fullsized":"2024-09-19T07:20:37.792406+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_clean_scrub_stamp":"2024-09-19T07:15:50.875302+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:32.716049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943206+0000","last_change":"2024-09-19T07:20:17.512387+0000","last_active":"2024-09-19T07:20:37.943206+0000","last_peered":"2024-09-19T07:20:37.943206+0000","last_clean":"2024-09-19T07:20:37.943206+0000","last_became_active":"2024-09-19T07:20:17.511956+0000","last_became_peered":"2024-09-19T07:20:17.511956+0000","last_unstale":"2024-09-19T07:20:37.943206+0000","last_undegraded":"2024-09-19T07:20:37.943206+0000","last_fullsized":"2024-09-19T07:20:37.943206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:13.098347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786903+0000","last_change":"2024-09-19T07:20:19.536280+0000","last_active":"2024-09-19T07:20:37.786903+0000","last_peered":"2024-09-19T07:20:37.786903+0000","last_clean":"2024-09-19T07:20:37.786903+0000","last_became_active":"2024-09-19T07:20:19.535809+0000","last_became_peered":"2024-09-19T07:20:19.535809+0000","last_unstale":"2024-09-19T07:20:37.786903+0000","last_undegraded":"2024-09-19T07:20:37.786903+0000","last_fullsized":"2024-09-19T07:20:37.786903+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:07.645476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.801203+0000","last_change":"2024-09-19T07:20:37.800603+0000","last_active":"2024-09-19T07:20:37.801203+0000","last_peered":"2024-09-19T07:20:37.801203+0000","last_clean":"2024-09-19T07:20:37.801203+0000","last_became_active":"2024-09-19T07:20:37.794728+0000","last_became_peered":"2024-09-19T07:20:37.794728+0000","last_unstale":"2024-09-19T07:20:37.801203+0000","last_undegraded":"2024-09-19T07:20:37.801203+0000","last_fullsized":"2024-09-19T07:20:37.801203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:46.606645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789726+0000","last_change":"2024-09-19T07:20:19.540203+0000","last_active":"2024-09-19T07:20:37.789726+0000","last_peered":"2024-09-19T07:20:37.789726+0000","last_clean":"2024-09-19T07:20:37.789726+0000","last_became_active":"2024-09-19T07:20:19.539813+0000","last_became_peered":"2024-09-19T07:20:19.539813+0000","last_unstale":"2024-09-19T07:20:37.789726+0000","last_undegraded":"2024-09-19T07:20:37.789726+0000","last_fullsized":"2024-09-19T07:20:37.789726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:52.164881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790197+0000","last_change":"2024-09-19T07:20:17.565449+0000","last_active":"2024-09-19T07:20:37.790197+0000","last_peered":"2024-09-19T07:20:37.790197+0000","last_clean":"2024-09-19T07:20:37.790197+0000","last_became_active":"2024-09-19T07:20:17.565079+0000","last_became_peered":"2024-09-19T07:20:17.565079+0000","last_unstale":"2024-09-19T07:20:37.790197+0000","last_undegraded":"2024-09-19T07:20:37.790197+0000","last_fullsized":"2024-09-19T07:20:37.790197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:50.791388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792603+0000","last_change":"2024-09-19T07:20:19.533817+0000","last_active":"2024-09-19T07:20:37.792603+0000","last_peered":"2024-09-19T07:20:37.792603+0000","last_clean":"2024-09-19T07:20:37.792603+0000","last_became_active":"2024-09-19T07:20:19.532144+0000","last_became_peered":"2024-09-19T07:20:19.532144+0000","last_unstale":"2024-09-19T07:20:37.792603+0000","last_undegraded":"2024-09-19T07:20:37.792603+0000","last_fullsized":"2024-09-19T07:20:37.792603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:18.928739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791873+0000","last_change":"2024-09-19T07:20:17.514063+0000","last_active":"2024-09-19T07:20:37.791873+0000","last_peered":"2024-09-19T07:20:37.791873+0000","last_clean":"2024-09-19T07:20:37.791873+0000","last_became_active":"2024-09-19T07:20:17.513633+0000","last_became_peered":"2024-09-19T07:20:17.513633+0000","last_unstale":"2024-09-19T07:20:37.791873+0000","last_undegraded":"2024-09-19T07:20:37.791873+0000","last_fullsized":"2024-09-19T07:20:37.791873+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:24.113053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790844+0000","last_change":"2024-09-19T07:20:19.540209+0000","last_active":"2024-09-19T07:20:37.790844+0000","last_peered":"2024-09-19T07:20:37.790844+0000","last_clean":"2024-09-19T07:20:37.790844+0000","last_became_active":"2024-09-19T07:20:19.539855+0000","last_became_peered":"2024-09-19T07:20:19.539855+0000","last_unstale":"2024-09-19T07:20:37.790844+0000","last_undegraded":"2024-09-19T07:20:37.790844+0000","last_fullsized":"2024-09-19T07:20:37.790844+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:40.878905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788482+0000","last_change":"2024-09-19T07:20:17.565627+0000","last_active":"2024-09-19T07:20:37.788482+0000","last_peered":"2024-09-19T07:20:37.788482+0000","last_clean":"2024-09-19T07:20:37.788482+0000","last_became_active":"2024-09-19T07:20:17.565231+0000","last_became_peered":"2024-09-19T07:20:17.565231+0000","last_unstale":"2024-09-19T07:20:37.788482+0000","last_undegraded":"2024-09-19T07:20:37.788482+0000","last_fullsized":"2024-09-19T07:20:37.788482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:53.105336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790960+0000","last_change":"2024-09-19T07:20:19.532418+0000","last_active":"2024-09-19T07:20:37.790960+0000","last_peered":"2024-09-19T07:20:37.790960+0000","last_clean":"2024-09-19T07:20:37.790960+0000","last_became_active":"2024-09-19T07:20:19.532113+0000","last_became_peered":"2024-09-19T07:20:19.532113+0000","last_unstale":"2024-09-19T07:20:37.790960+0000","last_undegraded":"2024-09-19T07:20:37.790960+0000","last_fullsized":"2024-09-19T07:20:37.790960+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:24.953720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790920+0000","last_change":"2024-09-19T07:20:17.565984+0000","last_active":"2024-09-19T07:20:37.790920+0000","last_peered":"2024-09-19T07:20:37.790920+0000","last_clean":"2024-09-19T07:20:37.790920+0000","last_became_active":"2024-09-19T07:20:17.565240+0000","last_became_peered":"2024-09-19T07:20:17.565240+0000","last_unstale":"2024-09-19T07:20:37.790920+0000","last_undegraded":"2024-09-19T07:20:37.790920+0000","last_fullsized":"2024-09-19T07:20:37.790920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:07.906716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789919+0000","last_change":"2024-09-19T07:20:19.534400+0000","last_active":"2024-09-19T07:20:37.789919+0000","last_peered":"2024-09-19T07:20:37.789919+0000","last_clean":"2024-09-19T07:20:37.789919+0000","last_became_active":"2024-09-19T07:20:19.534130+0000","last_became_peered":"2024-09-19T07:20:19.534130+0000","last_unstale":"2024-09-19T07:20:37.789919+0000","last_undegraded":"2024-09-19T07:20:37.789919+0000","last_fullsized":"2024-09-19T07:20:37.789919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:09.398112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'7","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788699+0000","last_change":"2024-09-19T07:20:17.519628+0000","last_active":"2024-09-19T07:20:37.788699+0000","last_peered":"2024-09-19T07:20:37.788699+0000","last_clean":"2024-09-19T07:20:37.788699+0000","last_became_active":"2024-09-19T07:20:17.519276+0000","last_became_peered":"2024-09-19T07:20:17.519276+0000","last_unstale":"2024-09-19T07:20:37.788699+0000","last_undegraded":"2024-09-19T07:20:37.788699+0000","last_fullsized":"2024-09-19T07:20:37.788699+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.193091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786947+0000","last_change":"2024-09-19T07:20:19.533425+0000","last_active":"2024-09-19T07:20:37.786947+0000","last_peered":"2024-09-19T07:20:37.786947+0000","last_clean":"2024-09-19T07:20:37.786947+0000","last_became_active":"2024-09-19T07:20:19.533142+0000","last_became_peered":"2024-09-19T07:20:19.533142+0000","last_unstale":"2024-09-19T07:20:37.786947+0000","last_undegraded":"2024-09-19T07:20:37.786947+0000","last_fullsized":"2024-09-19T07:20:37.786947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:07.048006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943680+0000","last_change":"2024-09-19T07:20:17.512776+0000","last_active":"2024-09-19T07:20:37.943680+0000","last_peered":"2024-09-19T07:20:37.943680+0000","last_clean":"2024-09-19T07:20:37.943680+0000","last_became_active":"2024-09-19T07:20:17.511862+0000","last_became_peered":"2024-09-19T07:20:17.511862+0000","last_unstale":"2024-09-19T07:20:37.943680+0000","last_undegraded":"2024-09-19T07:20:37.943680+0000","last_fullsized":"2024-09-19T07:20:37.943680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:08.211654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.481028+0000","last_change":"2024-09-19T07:20:19.539260+0000","last_active":"2024-09-19T07:20:38.481028+0000","last_peered":"2024-09-19T07:20:38.481028+0000","last_clean":"2024-09-19T07:20:38.481028+0000","last_became_active":"2024-09-19T07:20:19.538868+0000","last_became_peered":"2024-09-19T07:20:19.538868+0000","last_unstale":"2024-09-19T07:20:38.481028+0000","last_undegraded":"2024-09-19T07:20:38.481028+0000","last_fullsized":"2024-09-19T07:20:38.481028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:44.198084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793712+0000","last_change":"2024-09-19T07:20:17.565544+0000","last_active":"2024-09-19T07:20:37.793712+0000","last_peered":"2024-09-19T07:20:37.793712+0000","last_clean":"2024-09-19T07:20:37.793712+0000","last_became_active":"2024-09-19T07:20:17.565250+0000","last_became_peered":"2024-09-19T07:20:17.565250+0000","last_unstale":"2024-09-19T07:20:37.793712+0000","last_undegraded":"2024-09-19T07:20:37.793712+0000","last_fullsized":"2024-09-19T07:20:37.793712+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:25.523136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791794+0000","last_change":"2024-09-19T07:20:19.531467+0000","last_active":"2024-09-19T07:20:37.791794+0000","last_peered":"2024-09-19T07:20:37.791794+0000","last_clean":"2024-09-19T07:20:37.791794+0000","last_became_active":"2024-09-19T07:20:19.531170+0000","last_became_peered":"2024-09-19T07:20:19.531170+0000","last_unstale":"2024-09-19T07:20:37.791794+0000","last_undegraded":"2024-09-19T07:20:37.791794+0000","last_fullsized":"2024-09-19T07:20:37.791794+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:23.113097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786781+0000","last_change":"2024-09-19T07:20:17.511400+0000","last_active":"2024-09-19T07:20:37.786781+0000","last_peered":"2024-09-19T07:20:37.786781+0000","last_clean":"2024-09-19T07:20:37.786781+0000","last_became_active":"2024-09-19T07:20:17.511126+0000","last_became_peered":"2024-09-19T07:20:17.511126+0000","last_unstale":"2024-09-19T07:20:37.786781+0000","last_undegraded":"2024-09-19T07:20:37.786781+0000","last_fullsized":"2024-09-19T07:20:37.786781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.485406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788319+0000","last_change":"2024-09-19T07:20:19.529171+0000","last_active":"2024-09-19T07:20:37.788319+0000","last_peered":"2024-09-19T07:20:37.788319+0000","last_clean":"2024-09-19T07:20:37.788319+0000","last_became_active":"2024-09-19T07:20:19.528489+0000","last_became_peered":"2024-09-19T07:20:19.528489+0000","last_unstale":"2024-09-19T07:20:37.788319+0000","last_undegraded":"2024-09-19T07:20:37.788319+0000","last_fullsized":"2024-09-19T07:20:37.788319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:10.842619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.803998+0000","last_change":"2024-09-19T07:20:37.803560+0000","last_active":"2024-09-19T07:20:37.803998+0000","last_peered":"2024-09-19T07:20:37.803998+0000","last_clean":"2024-09-19T07:20:37.803998+0000","last_became_active":"2024-09-19T07:20:37.797396+0000","last_became_peered":"2024-09-19T07:20:37.797396+0000","last_unstale":"2024-09-19T07:20:37.803998+0000","last_undegraded":"2024-09-19T07:20:37.803998+0000","last_fullsized":"2024-09-19T07:20:37.803998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:41.944179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786827+0000","last_change":"2024-09-19T07:20:19.532698+0000","last_active":"2024-09-19T07:20:37.786827+0000","last_peered":"2024-09-19T07:20:37.786827+0000","last_clean":"2024-09-19T07:20:37.786827+0000","last_became_active":"2024-09-19T07:20:19.531978+0000","last_became_peered":"2024-09-19T07:20:19.531978+0000","last_unstale":"2024-09-19T07:20:37.786827+0000","last_undegraded":"2024-09-19T07:20:37.786827+0000","last_fullsized":"2024-09-19T07:20:37.786827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:44.257024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791819+0000","last_change":"2024-09-19T07:20:17.525240+0000","last_active":"2024-09-19T07:20:37.791819+0000","last_peered":"2024-09-19T07:20:37.791819+0000","last_clean":"2024-09-19T07:20:37.791819+0000","last_became_active":"2024-09-19T07:20:17.524880+0000","last_became_peered":"2024-09-19T07:20:17.524880+0000","last_unstale":"2024-09-19T07:20:37.791819+0000","last_undegraded":"2024-09-19T07:20:37.791819+0000","last_fullsized":"2024-09-19T07:20:37.791819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:41.380246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791596+0000","last_change":"2024-09-19T07:20:19.537116+0000","last_active":"2024-09-19T07:20:37.791596+0000","last_peered":"2024-09-19T07:20:37.791596+0000","last_clean":"2024-09-19T07:20:37.791596+0000","last_became_active":"2024-09-19T07:20:19.536799+0000","last_became_peered":"2024-09-19T07:20:19.536799+0000","last_unstale":"2024-09-19T07:20:37.791596+0000","last_undegraded":"2024-09-19T07:20:37.791596+0000","last_fullsized":"2024-09-19T07:20:37.791596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:48.401159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792890+0000","last_change":"2024-09-19T07:20:19.527965+0000","last_active":"2024-09-19T07:20:37.792890+0000","last_peered":"2024-09-19T07:20:37.792890+0000","last_clean":"2024-09-19T07:20:37.792890+0000","last_became_active":"2024-09-19T07:20:19.527522+0000","last_became_peered":"2024-09-19T07:20:19.527522+0000","last_unstale":"2024-09-19T07:20:37.792890+0000","last_undegraded":"2024-09-19T07:20:37.792890+0000","last_fullsized":"2024-09-19T07:20:37.792890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:16.034153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793263+0000","last_change":"2024-09-19T07:20:17.519400+0000","last_active":"2024-09-19T07:20:37.793263+0000","last_peered":"2024-09-19T07:20:37.793263+0000","last_clean":"2024-09-19T07:20:37.793263+0000","last_became_active":"2024-09-19T07:20:17.518993+0000","last_became_peered":"2024-09-19T07:20:17.518993+0000","last_unstale":"2024-09-19T07:20:37.793263+0000","last_undegraded":"2024-09-19T07:20:37.793263+0000","last_fullsized":"2024-09-19T07:20:37.793263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:37.086763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793704+0000","last_change":"2024-09-19T07:20:19.531016+0000","last_active":"2024-09-19T07:20:37.793704+0000","last_peered":"2024-09-19T07:20:37.793704+0000","last_clean":"2024-09-19T07:20:37.793704+0000","last_became_active":"2024-09-19T07:20:19.530706+0000","last_became_peered":"2024-09-19T07:20:19.530706+0000","last_unstale":"2024-09-19T07:20:37.793704+0000","last_undegraded":"2024-09-19T07:20:37.793704+0000","last_fullsized":"2024-09-19T07:20:37.793704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:36.566185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790803+0000","last_change":"2024-09-19T07:20:17.524215+0000","last_active":"2024-09-19T07:20:37.790803+0000","last_peered":"2024-09-19T07:20:37.790803+0000","last_clean":"2024-09-19T07:20:37.790803+0000","last_became_active":"2024-09-19T07:20:17.523813+0000","last_became_peered":"2024-09-19T07:20:17.523813+0000","last_unstale":"2024-09-19T07:20:37.790803+0000","last_undegraded":"2024-09-19T07:20:37.790803+0000","last_fullsized":"2024-09-19T07:20:37.790803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:58.803225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.481093+0000","last_change":"2024-09-19T07:20:19.540994+0000","last_active":"2024-09-19T07:20:38.481093+0000","last_peered":"2024-09-19T07:20:38.481093+0000","last_clean":"2024-09-19T07:20:38.481093+0000","last_became_active":"2024-09-19T07:20:19.540703+0000","last_became_peered":"2024-09-19T07:20:19.540703+0000","last_unstale":"2024-09-19T07:20:38.481093+0000","last_undegraded":"2024-09-19T07:20:38.481093+0000","last_fullsized":"2024-09-19T07:20:38.481093+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:37.065187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.787038+0000","last_change":"2024-09-19T07:20:17.565438+0000","last_active":"2024-09-19T07:20:37.787038+0000","last_peered":"2024-09-19T07:20:37.787038+0000","last_clean":"2024-09-19T07:20:37.787038+0000","last_became_active":"2024-09-19T07:20:17.565128+0000","last_became_peered":"2024-09-19T07:20:17.565128+0000","last_unstale":"2024-09-19T07:20:37.787038+0000","last_undegraded":"2024-09-19T07:20:37.787038+0000","last_fullsized":"2024-09-19T07:20:37.787038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:02.048971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.794751+0000","last_change":"2024-09-19T07:20:37.794369+0000","last_active":"2024-09-19T07:20:37.794751+0000","last_peered":"2024-09-19T07:20:37.794751+0000","last_clean":"2024-09-19T07:20:37.794751+0000","last_became_active":"2024-09-19T07:20:37.794036+0000","last_became_peered":"2024-09-19T07:20:37.794036+0000","last_unstale":"2024-09-19T07:20:37.794751+0000","last_undegraded":"2024-09-19T07:20:37.794751+0000","last_fullsized":"2024-09-19T07:20:37.794751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:02.684191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.950846+0000","last_change":"2024-09-19T07:20:37.950846+0000","last_active":"2024-09-19T07:20:37.950846+0000","last_peered":"2024-09-19T07:20:37.950846+0000","last_clean":"2024-09-19T07:20:37.950846+0000","last_became_active":"2024-09-19T07:20:37.944266+0000","last_became_peered":"2024-09-19T07:20:37.944266+0000","last_unstale":"2024-09-19T07:20:37.950846+0000","last_undegraded":"2024-09-19T07:20:37.950846+0000","last_fullsized":"2024-09-19T07:20:37.950846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:12.952833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53722,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":95,"num_read_kb":99,"num_write":150,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27529,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":152119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645329,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":428259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874261,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1568768,"data_stored":1069852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037785,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":428495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266720,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495652,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1490944,"data_stored":1019954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659176,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":427884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888110,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1503232,"data_stored":1019638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018930,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":942080,"data_stored":469968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":428195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444092,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":429027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607617,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":925696,"data_stored":468742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":429155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":51338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":51690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:20:46.707 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T07:20:46.708 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T07:20:46.709 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T07:20:46.953 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:47.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.465+0000 7f54a3474640 1 -- 172.21.15.98:0/2393266667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f549c102e00 msgr2=0x7f549c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:47.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.465+0000 7f54a3474640 1 --2- 172.21.15.98:0/2393266667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f549c102e00 0x7f549c103280 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f548c009900 tx=0x7f548c02a410 comp rx=0 tx=0).stop 2024-09-19T07:20:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.465+0000 7f54a3474640 1 -- 172.21.15.98:0/2393266667 shutdown_connections 2024-09-19T07:20:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.465+0000 7f54a3474640 1 --2- 172.21.15.98:0/2393266667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f549c1037c0 0x7f549c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.465+0000 7f54a3474640 1 --2- 172.21.15.98:0/2393266667 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f549c102e00 0x7f549c103280 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.465+0000 7f54a3474640 1 --2- 172.21.15.98:0/2393266667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f549c101c00 0x7f549c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.465+0000 7f54a3474640 1 -- 172.21.15.98:0/2393266667 >> 172.21.15.98:0/2393266667 conn(0x7f549c0fd390 msgr2=0x7f549c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.465+0000 7f54a3474640 1 -- 172.21.15.98:0/2393266667 shutdown_connections 2024-09-19T07:20:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.465+0000 7f54a3474640 1 -- 172.21.15.98:0/2393266667 wait complete. 2024-09-19T07:20:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a3474640 1 Processor -- start 2024-09-19T07:20:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a3474640 1 -- start start 2024-09-19T07:20:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a3474640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f549c101c00 0x7f549c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a3474640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f549c102e00 0x7f549c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:47.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a3474640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f549c1037c0 0x7f549c19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a3474640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f549c10d8e0 con 0x7f549c102e00 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a3474640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f549c10d760 con 0x7f549c101c00 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a3474640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f549c10da60 con 0x7f549c1037c0 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a0a0f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f549c102e00 0x7f549c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a0a0f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f549c102e00 0x7f549c1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40516/0 (socket says 172.21.15.98:40516) 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a0a0f640 1 -- 172.21.15.98:0/1038386437 learned_addr learned my addr 172.21.15.98:0/1038386437 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a1210640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f549c101c00 0x7f549c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a0a0f640 1 -- 172.21.15.98:0/1038386437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f549c1037c0 msgr2=0x7f549c19f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a0a0f640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f549c1037c0 0x7f549c19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a0a0f640 1 -- 172.21.15.98:0/1038386437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f549c101c00 msgr2=0x7f549c197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a0a0f640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f549c101c00 0x7f549c197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.466+0000 7f54a0a0f640 1 -- 172.21.15.98:0/1038386437 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549c19fb90 con 0x7f549c102e00 2024-09-19T07:20:47.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.467+0000 7f54a0a0f640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f549c102e00 0x7f549c1984a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f548c009230 tx=0x7f548c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.467+0000 7f54927fc640 1 -- 172.21.15.98:0/1038386437 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c03f030 con 0x7f549c102e00 2024-09-19T07:20:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.467+0000 7f54927fc640 1 -- 172.21.15.98:0/1038386437 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f548c003ce0 con 0x7f549c102e00 2024-09-19T07:20:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.467+0000 7f54a3474640 1 -- 172.21.15.98:0/1038386437 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f549c19fe20 con 0x7f549c102e00 2024-09-19T07:20:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.467+0000 7f54927fc640 1 -- 172.21.15.98:0/1038386437 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c035070 con 0x7f549c102e00 2024-09-19T07:20:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.467+0000 7f54a3474640 1 -- 172.21.15.98:0/1038386437 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f549c1a02f0 con 0x7f549c102e00 2024-09-19T07:20:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.468+0000 7f54a3474640 1 -- 172.21.15.98:0/1038386437 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f549c108fd0 con 0x7f549c102e00 2024-09-19T07:20:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.469+0000 7f54927fc640 1 -- 172.21.15.98:0/1038386437 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f548c042030 con 0x7f549c102e00 2024-09-19T07:20:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.470+0000 7f54927fc640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f54880a3380 0x7f54880a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.470+0000 7f54a1210640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f54880a3380 0x7f54880a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.470+0000 7f54927fc640 1 -- 172.21.15.98:0/1038386437 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f548c0f0100 con 0x7f549c102e00 2024-09-19T07:20:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.470+0000 7f54a1210640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f54880a3380 0x7f54880a5840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5498005fd0 tx=0x7f5498005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:47.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.474+0000 7f54927fc640 1 -- 172.21.15.98:0/1038386437 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f548c0bcca0 con 0x7f549c102e00 2024-09-19T07:20:47.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.704+0000 7f54a3474640 1 -- 172.21.15.98:0/1038386437 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f549c02d7c0 con 0x7f549c102e00 2024-09-19T07:20:47.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.706+0000 7f54927fc640 1 -- 172.21.15.98:0/1038386437 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7f548c0bc5a0 con 0x7f549c102e00 2024-09-19T07:20:47.707 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2024-09-19T07:20:47.707 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDP0Otm4BEUKhAAlWAg3rII6E268Xb/RaSbVg== 2024-09-19T07:20:47.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.709+0000 7f54a3474640 1 -- 172.21.15.98:0/1038386437 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f54880a3380 msgr2=0x7f54880a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:47.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.709+0000 7f54a3474640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f54880a3380 0x7f54880a5840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5498005fd0 tx=0x7f5498005850 comp rx=0 tx=0).stop 2024-09-19T07:20:47.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.709+0000 7f54a3474640 1 -- 172.21.15.98:0/1038386437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f549c102e00 msgr2=0x7f549c1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:47.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.709+0000 7f54a3474640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f549c102e00 0x7f549c1984a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f548c009230 tx=0x7f548c004360 comp rx=0 tx=0).stop 2024-09-19T07:20:47.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.709+0000 7f54a3474640 1 -- 172.21.15.98:0/1038386437 shutdown_connections 2024-09-19T07:20:47.709 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.709+0000 7f54a3474640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f54880a3380 0x7f54880a5840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:47.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.709+0000 7f54a3474640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f549c1037c0 0x7f549c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:47.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.709+0000 7f54a3474640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f549c102e00 0x7f549c1984a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:47.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.709+0000 7f54a3474640 1 --2- 172.21.15.98:0/1038386437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f549c101c00 0x7f549c197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:47.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.709+0000 7f54a3474640 1 -- 172.21.15.98:0/1038386437 >> 172.21.15.98:0/1038386437 conn(0x7f549c0fd390 msgr2=0x7f549c1061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:47.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.709+0000 7f54a3474640 1 -- 172.21.15.98:0/1038386437 shutdown_connections 2024-09-19T07:20:47.710 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:47.709+0000 7f54a3474640 1 -- 172.21.15.98:0/1038386437 wait complete. 2024-09-19T07:20:48.020 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:47 smithi139 ceph-mon[35039]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:20:48.020 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:47 smithi139 ceph-mon[35039]: pgmap v285: 97 pgs: 97 active+clean; 629 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.0 KiB/s wr, 9 op/s; 2.7 KiB/s, 1 objects/s recovering 2024-09-19T07:20:48.020 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:47 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1038386437' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T07:20:48.020 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:47 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1038386437' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T07:20:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:47 smithi098 ceph-mon[30950]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:20:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:47 smithi098 ceph-mon[30950]: pgmap v285: 97 pgs: 97 active+clean; 629 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.0 KiB/s wr, 9 op/s; 2.7 KiB/s, 1 objects/s recovering 2024-09-19T07:20:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:47 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1038386437' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T07:20:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:47 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1038386437' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T07:20:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:47 smithi162 ceph-mon[35726]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:20:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:47 smithi162 ceph-mon[35726]: pgmap v285: 97 pgs: 97 active+clean; 629 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.0 KiB/s wr, 9 op/s; 2.7 KiB/s, 1 objects/s recovering 2024-09-19T07:20:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:47 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1038386437' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T07:20:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:47 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1038386437' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T07:20:48.412 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:20:48.412 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T07:20:48.412 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T07:20:48.449 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T07:20:48.450 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T07:20:48.450 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T07:20:48.732 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:49.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.198+0000 7f4b91b90640 1 -- 172.21.15.98:0/2681289625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8c108290 msgr2=0x7f4b8c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:49.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.198+0000 7f4b91b90640 1 --2- 172.21.15.98:0/2681289625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8c108290 0x7f4b8c10ec30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4b84009cd0 tx=0x7f4b8402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:20:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.198+0000 7f4b91b90640 1 -- 172.21.15.98:0/2681289625 shutdown_connections 2024-09-19T07:20:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.198+0000 7f4b91b90640 1 --2- 172.21.15.98:0/2681289625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8c108290 0x7f4b8c10ec30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.198+0000 7f4b91b90640 1 --2- 172.21.15.98:0/2681289625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b8c103740 0x7f4b8c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.198+0000 7f4b91b90640 1 --2- 172.21.15.98:0/2681289625 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b8c102d90 0x7f4b8c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.198+0000 7f4b91b90640 1 -- 172.21.15.98:0/2681289625 >> 172.21.15.98:0/2681289625 conn(0x7f4b8c0fc7d0 msgr2=0x7f4b8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:49.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.198+0000 7f4b91b90640 1 -- 172.21.15.98:0/2681289625 shutdown_connections 2024-09-19T07:20:49.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.198+0000 7f4b91b90640 1 -- 172.21.15.98:0/2681289625 wait complete. 2024-09-19T07:20:49.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.198+0000 7f4b91b90640 1 Processor -- start 2024-09-19T07:20:49.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.198+0000 7f4b91b90640 1 -- start start 2024-09-19T07:20:49.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b91b90640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8c102d90 0x7f4b8c1986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b91b90640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b8c103740 0x7f4b8c198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b91b90640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b8c108290 0x7f4b8c19cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b91b90640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c112150 con 0x7f4b8c102d90 2024-09-19T07:20:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b91b90640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c111fd0 con 0x7f4b8c103740 2024-09-19T07:20:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b91b90640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c1122d0 con 0x7f4b8c108290 2024-09-19T07:20:49.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b8b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8c102d90 0x7f4b8c1986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:49.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b8b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8c102d90 0x7f4b8c1986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40528/0 (socket says 172.21.15.98:40528) 2024-09-19T07:20:49.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b8b7fe640 1 -- 172.21.15.98:0/1422160292 learned_addr learned my addr 172.21.15.98:0/1422160292 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:49.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b82ffd640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b8c103740 0x7f4b8c198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:49.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b8bfff640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b8c108290 0x7f4b8c19cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:49.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b8b7fe640 1 -- 172.21.15.98:0/1422160292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b8c108290 msgr2=0x7f4b8c19cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:49.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b8b7fe640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b8c108290 0x7f4b8c19cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:49.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b8b7fe640 1 -- 172.21.15.98:0/1422160292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b8c103740 msgr2=0x7f4b8c198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:49.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b8b7fe640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b8c103740 0x7f4b8c198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:49.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b8b7fe640 1 -- 172.21.15.98:0/1422160292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8c19d6a0 con 0x7f4b8c102d90 2024-09-19T07:20:49.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b8bfff640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b8c108290 0x7f4b8c19cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:49.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b8b7fe640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8c102d90 0x7f4b8c1986f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00b4a0 tx=0x7f4b7c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:49.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b897fa640 1 -- 172.21.15.98:0/1422160292 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c014070 con 0x7f4b8c102d90 2024-09-19T07:20:49.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b91b90640 1 -- 172.21.15.98:0/1422160292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8c19d990 con 0x7f4b8c102d90 2024-09-19T07:20:49.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.199+0000 7f4b897fa640 1 -- 172.21.15.98:0/1422160292 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b7c010af0 con 0x7f4b8c102d90 2024-09-19T07:20:49.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.200+0000 7f4b897fa640 1 -- 172.21.15.98:0/1422160292 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c017d10 con 0x7f4b8c102d90 2024-09-19T07:20:49.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.200+0000 7f4b91b90640 1 -- 172.21.15.98:0/1422160292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8c1a5270 con 0x7f4b8c102d90 2024-09-19T07:20:49.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.201+0000 7f4b91b90640 1 -- 172.21.15.98:0/1422160292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b8c06a7f0 con 0x7f4b8c102d90 2024-09-19T07:20:49.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.202+0000 7f4b897fa640 1 -- 172.21.15.98:0/1422160292 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4b7c017070 con 0x7f4b8c102d90 2024-09-19T07:20:49.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.202+0000 7f4b897fa640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f4b780a32d0 0x7f4b780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:49.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.202+0000 7f4b82ffd640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f4b780a32d0 0x7f4b780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:49.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.203+0000 7f4b897fa640 1 -- 172.21.15.98:0/1422160292 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f4b7c0cee30 con 0x7f4b8c102d90 2024-09-19T07:20:49.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.203+0000 7f4b82ffd640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f4b780a32d0 0x7f4b780a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0fee30 tx=0x7f4b74008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:49.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.206+0000 7f4b897fa640 1 -- 172.21.15.98:0/1422160292 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b7c09bae0 con 0x7f4b8c102d90 2024-09-19T07:20:49.419 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.418+0000 7f4b91b90640 1 -- 172.21.15.98:0/1422160292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4b8c1031f0 con 0x7f4b8c102d90 2024-09-19T07:20:49.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.424+0000 7f4b897fa640 1 -- 172.21.15.98:0/1422160292 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264049 (secure 0 0 0) 0x7f4b7c09b3e0 con 0x7f4b8c102d90 2024-09-19T07:20:49.427 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:49.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.427+0000 7f4b91b90640 1 -- 172.21.15.98:0/1422160292 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f4b780a32d0 msgr2=0x7f4b780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:49.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.427+0000 7f4b91b90640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f4b780a32d0 0x7f4b780a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0fee30 tx=0x7f4b74008040 comp rx=0 tx=0).stop 2024-09-19T07:20:49.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.427+0000 7f4b91b90640 1 -- 172.21.15.98:0/1422160292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8c102d90 msgr2=0x7f4b8c1986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:49.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.427+0000 7f4b91b90640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8c102d90 0x7f4b8c1986f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00b4a0 tx=0x7f4b7c00b960 comp rx=0 tx=0).stop 2024-09-19T07:20:49.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.427+0000 7f4b91b90640 1 -- 172.21.15.98:0/1422160292 shutdown_connections 2024-09-19T07:20:49.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.427+0000 7f4b91b90640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f4b780a32d0 0x7f4b780a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:49.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.427+0000 7f4b91b90640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b8c108290 0x7f4b8c19cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:49.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.427+0000 7f4b91b90640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4b8c103740 0x7f4b8c198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:49.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.427+0000 7f4b91b90640 1 --2- 172.21.15.98:0/1422160292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4b8c102d90 0x7f4b8c1986f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:49.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.427+0000 7f4b91b90640 1 -- 172.21.15.98:0/1422160292 >> 172.21.15.98:0/1422160292 conn(0x7f4b8c0fc7d0 msgr2=0x7f4b8c105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:49.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.427+0000 7f4b91b90640 1 -- 172.21.15.98:0/1422160292 shutdown_connections 2024-09-19T07:20:49.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:49.427+0000 7f4b91b90640 1 -- 172.21.15.98:0/1422160292 wait complete. 2024-09-19T07:20:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:49 smithi098 ceph-mon[30950]: pgmap v286: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s; 2.5 KiB/s, 1 objects/s recovering 2024-09-19T07:20:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:49 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1422160292' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T07:20:50.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:49 smithi139 ceph-mon[35039]: pgmap v286: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s; 2.5 KiB/s, 1 objects/s recovering 2024-09-19T07:20:50.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:49 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1422160292' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T07:20:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:49 smithi162 ceph-mon[35726]: pgmap v286: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.6 KiB/s wr, 8 op/s; 2.5 KiB/s, 1 objects/s recovering 2024-09-19T07:20:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:49 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1422160292' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T07:20:50.324 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2172632890},{"type":"v1","addr":"172.21.15.98:6801","nonce":2172632890}]},"active_addr":"172.21.15.98:6801/2172632890","active_change":"2024-09-19T07:13:36.570251+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.98:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":1123383068}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":1543222160}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":617371908}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":3732813400}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.98:0","nonce":2271200719}]}]} 2024-09-19T07:20:50.332 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T07:20:50.332 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T07:20:50.333 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:20:50.583 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:51.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.058+0000 7fce1db11640 1 -- 172.21.15.98:0/3800545985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce18106f20 msgr2=0x7fce1810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:51.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.058+0000 7fce1db11640 1 --2- 172.21.15.98:0/3800545985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce18106f20 0x7fce1810eaa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fce10009ca0 tx=0x7fce1002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:20:51.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.058+0000 7fce1db11640 1 -- 172.21.15.98:0/3800545985 shutdown_connections 2024-09-19T07:20:51.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.058+0000 7fce1db11640 1 --2- 172.21.15.98:0/3800545985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce18106f20 0x7fce1810eaa0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:51.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.058+0000 7fce1db11640 1 --2- 172.21.15.98:0/3800545985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce181027a0 0x7fce181067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:51.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.058+0000 7fce1db11640 1 --2- 172.21.15.98:0/3800545985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce18101df0 0x7fce181021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:51.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.058+0000 7fce1db11640 1 -- 172.21.15.98:0/3800545985 >> 172.21.15.98:0/3800545985 conn(0x7fce180fd8f0 msgr2=0x7fce180ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:51.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.058+0000 7fce1db11640 1 -- 172.21.15.98:0/3800545985 shutdown_connections 2024-09-19T07:20:51.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.058+0000 7fce1db11640 1 -- 172.21.15.98:0/3800545985 wait complete. 2024-09-19T07:20:51.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.058+0000 7fce1db11640 1 Processor -- start 2024-09-19T07:20:51.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.058+0000 7fce1db11640 1 -- start start 2024-09-19T07:20:51.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce1db11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce18101df0 0x7fce18198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:51.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce1db11640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce181027a0 0x7fce18198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:51.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce1db11640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce18106f20 0x7fce1819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:51.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce1db11640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce18111fa0 con 0x7fce181027a0 2024-09-19T07:20:51.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce1db11640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fce18111e20 con 0x7fce18106f20 2024-09-19T07:20:51.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce1db11640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fce18112120 con 0x7fce18101df0 2024-09-19T07:20:51.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce16ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce181027a0 0x7fce18198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:51.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce16ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce181027a0 0x7fce18198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40550/0 (socket says 172.21.15.98:40550) 2024-09-19T07:20:51.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce16ffd640 1 -- 172.21.15.98:0/3104619383 learned_addr learned my addr 172.21.15.98:0/3104619383 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:51.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce177fe640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce18101df0 0x7fce18198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:51.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce17fff640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce18106f20 0x7fce1819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:51.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce16ffd640 1 -- 172.21.15.98:0/3104619383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce18101df0 msgr2=0x7fce18198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:51.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce16ffd640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce18101df0 0x7fce18198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:51.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce16ffd640 1 -- 172.21.15.98:0/3104619383 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce18106f20 msgr2=0x7fce1819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:51.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce16ffd640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce18106f20 0x7fce1819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:51.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce16ffd640 1 -- 172.21.15.98:0/3104619383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1819d4b0 con 0x7fce181027a0 2024-09-19T07:20:51.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce16ffd640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce181027a0 0x7fce18198a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fce0000b4a0 tx=0x7fce0000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:51.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce14ff9640 1 -- 172.21.15.98:0/3104619383 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce00014070 con 0x7fce181027a0 2024-09-19T07:20:51.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce1db11640 1 -- 172.21.15.98:0/3104619383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1819d7a0 con 0x7fce181027a0 2024-09-19T07:20:51.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce14ff9640 1 -- 172.21.15.98:0/3104619383 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce00010af0 con 0x7fce181027a0 2024-09-19T07:20:51.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.059+0000 7fce14ff9640 1 -- 172.21.15.98:0/3104619383 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce00017d10 con 0x7fce181027a0 2024-09-19T07:20:51.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.060+0000 7fce1db11640 1 -- 172.21.15.98:0/3104619383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce181a5080 con 0x7fce181027a0 2024-09-19T07:20:51.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.060+0000 7fce1db11640 1 -- 172.21.15.98:0/3104619383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce181021d0 con 0x7fce181027a0 2024-09-19T07:20:51.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.062+0000 7fce14ff9640 1 -- 172.21.15.98:0/3104619383 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fce00017070 con 0x7fce181027a0 2024-09-19T07:20:51.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.062+0000 7fce14ff9640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fce040a32d0 0x7fce040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:51.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.062+0000 7fce177fe640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fce040a32d0 0x7fce040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:51.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.062+0000 7fce14ff9640 1 -- 172.21.15.98:0/3104619383 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fce000ced40 con 0x7fce181027a0 2024-09-19T07:20:51.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.063+0000 7fce177fe640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fce040a32d0 0x7fce040a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fce0800bbe0 tx=0x7fce0800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:51.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.066+0000 7fce14ff9640 1 -- 172.21.15.98:0/3104619383 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce0009b3a0 con 0x7fce181027a0 2024-09-19T07:20:51.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.234+0000 7fce1db11640 1 -- 172.21.15.98:0/3104619383 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce1810a1c0 con 0x7fce181027a0 2024-09-19T07:20:51.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.235+0000 7fce14ff9640 1 -- 172.21.15.98:0/3104619383 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22762 (secure 0 0 0) 0x7fce0009f6a0 con 0x7fce181027a0 2024-09-19T07:20:51.236 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:51.236 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":80,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:20:37.783934+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:20:16.391879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:20:18.243837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:20:51.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.238+0000 7fce1db11640 1 -- 172.21.15.98:0/3104619383 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fce040a32d0 msgr2=0x7fce040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.238+0000 7fce1db11640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fce040a32d0 0x7fce040a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fce0800bbe0 tx=0x7fce0800b390 comp rx=0 tx=0).stop 2024-09-19T07:20:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.238+0000 7fce1db11640 1 -- 172.21.15.98:0/3104619383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce181027a0 msgr2=0x7fce18198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.238+0000 7fce1db11640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce181027a0 0x7fce18198a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fce0000b4a0 tx=0x7fce0000b960 comp rx=0 tx=0).stop 2024-09-19T07:20:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.238+0000 7fce1db11640 1 -- 172.21.15.98:0/3104619383 shutdown_connections 2024-09-19T07:20:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.238+0000 7fce1db11640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fce040a32d0 0x7fce040a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.238+0000 7fce1db11640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce18106f20 0x7fce1819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.238+0000 7fce1db11640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce181027a0 0x7fce18198a40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.238+0000 7fce1db11640 1 --2- 172.21.15.98:0/3104619383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce18101df0 0x7fce18198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.238+0000 7fce1db11640 1 -- 172.21.15.98:0/3104619383 >> 172.21.15.98:0/3104619383 conn(0x7fce180fd8f0 msgr2=0x7fce180fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:51.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.238+0000 7fce1db11640 1 -- 172.21.15.98:0/3104619383 shutdown_connections 2024-09-19T07:20:51.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:51.238+0000 7fce1db11640 1 -- 172.21.15.98:0/3104619383 wait complete. 2024-09-19T07:20:51.901 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T07:20:51.902 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:20:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:51 smithi098 ceph-mon[30950]: pgmap v287: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 7 op/s; 2.2 KiB/s, 0 objects/s recovering 2024-09-19T07:20:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:51 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3104619383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:52.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:51 smithi139 ceph-mon[35039]: pgmap v287: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 7 op/s; 2.2 KiB/s, 0 objects/s recovering 2024-09-19T07:20:52.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:51 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3104619383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:51 smithi162 ceph-mon[35726]: pgmap v287: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 7 op/s; 2.2 KiB/s, 0 objects/s recovering 2024-09-19T07:20:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:51 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3104619383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:52.147 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:52.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.632+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2807183358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd654102790 msgr2=0x7fd6541067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:52.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.632+0000 7fd65b4bf640 1 --2- 172.21.15.98:0/2807183358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd654102790 0x7fd6541067e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd648009900 tx=0x7fd64802a410 comp rx=0 tx=0).stop 2024-09-19T07:20:52.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.632+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2807183358 shutdown_connections 2024-09-19T07:20:52.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.632+0000 7fd65b4bf640 1 --2- 172.21.15.98:0/2807183358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd654106f10 0x7fd65410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:52.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.632+0000 7fd65b4bf640 1 --2- 172.21.15.98:0/2807183358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd654102790 0x7fd6541067e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:52.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.632+0000 7fd65b4bf640 1 --2- 172.21.15.98:0/2807183358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd654101de0 0x7fd6541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:52.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.632+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2807183358 >> 172.21.15.98:0/2807183358 conn(0x7fd6540fd8c0 msgr2=0x7fd6540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.632+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2807183358 shutdown_connections 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.632+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2807183358 wait complete. 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65b4bf640 1 Processor -- start 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65b4bf640 1 -- start start 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65b4bf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd654101de0 0x7fd6540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65b4bf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd654102790 0x7fd654074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65b4bf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd654106f10 0x7fd654074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65b4bf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd654111f90 con 0x7fd654101de0 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65b4bf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd654111e10 con 0x7fd654102790 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65b4bf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd654112110 con 0x7fd654106f10 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65925b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd654101de0 0x7fd6540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65925b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd654101de0 0x7fd6540744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44742/0 (socket says 172.21.15.98:44742) 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65925b640 1 -- 172.21.15.98:0/2627240199 learned_addr learned my addr 172.21.15.98:0/2627240199 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:52.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd658a5a640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd654102790 0x7fd654074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd659a5c640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd654106f10 0x7fd654074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65925b640 1 -- 172.21.15.98:0/2627240199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd654106f10 msgr2=0x7fd654074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65925b640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd654106f10 0x7fd654074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65925b640 1 -- 172.21.15.98:0/2627240199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd654102790 msgr2=0x7fd654074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65925b640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd654102790 0x7fd654074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd65925b640 1 -- 172.21.15.98:0/2627240199 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6541a6950 con 0x7fd654101de0 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd658a5a640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd654102790 0x7fd654074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.633+0000 7fd659a5c640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd654106f10 0x7fd654074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.634+0000 7fd65925b640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd654101de0 0x7fd6540744f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00b4a0 tx=0x7fd64c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.634+0000 7fd6527fc640 1 -- 172.21.15.98:0/2627240199 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c014070 con 0x7fd654101de0 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.634+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2627240199 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6541a6c40 con 0x7fd654101de0 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.634+0000 7fd6527fc640 1 -- 172.21.15.98:0/2627240199 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd64c010af0 con 0x7fd654101de0 2024-09-19T07:20:52.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.634+0000 7fd6527fc640 1 -- 172.21.15.98:0/2627240199 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c017d10 con 0x7fd654101de0 2024-09-19T07:20:52.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.634+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2627240199 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6541a7180 con 0x7fd654101de0 2024-09-19T07:20:52.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.635+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2627240199 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6541021c0 con 0x7fd654101de0 2024-09-19T07:20:52.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.636+0000 7fd6527fc640 1 -- 172.21.15.98:0/2627240199 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd64c017070 con 0x7fd654101de0 2024-09-19T07:20:52.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.637+0000 7fd6527fc640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd63c0a32d0 0x7fd63c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:52.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.637+0000 7fd658a5a640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd63c0a32d0 0x7fd63c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:52.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.637+0000 7fd6527fc640 1 -- 172.21.15.98:0/2627240199 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fd64c0cf1c0 con 0x7fd654101de0 2024-09-19T07:20:52.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.638+0000 7fd658a5a640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd63c0a32d0 0x7fd63c0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd648000c00 tx=0x7fd648032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:52.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.640+0000 7fd6527fc640 1 -- 172.21.15.98:0/2627240199 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd64c09be70 con 0x7fd654101de0 2024-09-19T07:20:52.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.812+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2627240199 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd654075a20 con 0x7fd654101de0 2024-09-19T07:20:52.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.813+0000 7fd6527fc640 1 -- 172.21.15.98:0/2627240199 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22762 (secure 0 0 0) 0x7fd64c09b770 con 0x7fd654101de0 2024-09-19T07:20:52.814 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:20:52.814 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":80,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:20:37.783934+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:20:16.391879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:20:18.243837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:20:52.815 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.815+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2627240199 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd63c0a32d0 msgr2=0x7fd63c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:52.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.815+0000 7fd65b4bf640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd63c0a32d0 0x7fd63c0a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd648000c00 tx=0x7fd648032c70 comp rx=0 tx=0).stop 2024-09-19T07:20:52.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.815+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2627240199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd654101de0 msgr2=0x7fd6540744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:52.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.815+0000 7fd65b4bf640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd654101de0 0x7fd6540744f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00b4a0 tx=0x7fd64c00b960 comp rx=0 tx=0).stop 2024-09-19T07:20:52.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.815+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2627240199 shutdown_connections 2024-09-19T07:20:52.816 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.815+0000 7fd65b4bf640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd63c0a32d0 0x7fd63c0a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:52.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.815+0000 7fd65b4bf640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd654106f10 0x7fd654074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:52.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.815+0000 7fd65b4bf640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd654102790 0x7fd654074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:52.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.815+0000 7fd65b4bf640 1 --2- 172.21.15.98:0/2627240199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd654101de0 0x7fd6540744f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:52.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.815+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2627240199 >> 172.21.15.98:0/2627240199 conn(0x7fd6540fd8c0 msgr2=0x7fd6540fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:52.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.816+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2627240199 shutdown_connections 2024-09-19T07:20:52.817 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:52.816+0000 7fd65b4bf640 1 -- 172.21.15.98:0/2627240199 wait complete. 2024-09-19T07:20:53.520 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T07:20:53.521 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T07:20:53.521 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T07:20:53.522 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T07:20:53.522 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T07:20:53.522 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T07:20:53.523 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T07:20:53.523 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T07:20:53.524 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T07:20:53.524 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T07:20:53.525 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T07:20:53.525 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T07:20:53.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:53 smithi098 ceph-mon[30950]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 7 op/s; 2.2 KiB/s, 0 objects/s recovering 2024-09-19T07:20:53.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:53 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2627240199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:54.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:53 smithi139 ceph-mon[35039]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 7 op/s; 2.2 KiB/s, 0 objects/s recovering 2024-09-19T07:20:54.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:53 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2627240199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:54.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:53 smithi162 ceph-mon[35726]: pgmap v288: 97 pgs: 97 active+clean; 638 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.9 KiB/s wr, 7 op/s; 2.2 KiB/s, 0 objects/s recovering 2024-09-19T07:20:54.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:53 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2627240199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:20:54.158 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:54.410 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:54.410 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:54.413 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:54.415 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:54.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.761+0000 7f8bba2cb640 1 -- 172.21.15.98:0/4075216139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb4100e20 msgr2=0x7f8bb4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:54.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.761+0000 7f8bba2cb640 1 --2- 172.21.15.98:0/4075216139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb4100e20 0x7f8bb4101200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009900 tx=0x7f8ba402a480 comp rx=0 tx=0).stop 2024-09-19T07:20:54.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.761+0000 7f8bba2cb640 1 -- 172.21.15.98:0/4075216139 shutdown_connections 2024-09-19T07:20:54.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.761+0000 7f8bba2cb640 1 --2- 172.21.15.98:0/4075216139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bb4102ef0 0x7f8bb410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:54.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.761+0000 7f8bba2cb640 1 --2- 172.21.15.98:0/4075216139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bb4102570 0x7f8bb41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:54.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.761+0000 7f8bba2cb640 1 --2- 172.21.15.98:0/4075216139 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb4100e20 0x7f8bb4101200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:54.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.761+0000 7f8bba2cb640 1 -- 172.21.15.98:0/4075216139 >> 172.21.15.98:0/4075216139 conn(0x7f8bb40fc7d0 msgr2=0x7f8bb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:54.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.761+0000 7f8bba2cb640 1 -- 172.21.15.98:0/4075216139 shutdown_connections 2024-09-19T07:20:54.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.761+0000 7f8bba2cb640 1 -- 172.21.15.98:0/4075216139 wait complete. 2024-09-19T07:20:54.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.762+0000 7f8bba2cb640 1 Processor -- start 2024-09-19T07:20:54.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.762+0000 7f8bba2cb640 1 -- start start 2024-09-19T07:20:54.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.762+0000 7f8bba2cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb4100e20 0x7f8bb4197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:54.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.762+0000 7f8bba2cb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bb4102570 0x7f8bb41979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:54.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.762+0000 7f8bba2cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bb4102ef0 0x7f8bb419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:54.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.762+0000 7f8bba2cb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb4110f80 con 0x7f8bb4100e20 2024-09-19T07:20:54.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.762+0000 7f8bba2cb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb4110e00 con 0x7f8bb4102ef0 2024-09-19T07:20:54.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.762+0000 7f8bba2cb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb4111100 con 0x7f8bb4102570 2024-09-19T07:20:54.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.762+0000 7f8bb3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb4100e20 0x7f8bb4197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:54.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.762+0000 7f8bb3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb4100e20 0x7f8bb4197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44766/0 (socket says 172.21.15.98:44766) 2024-09-19T07:20:54.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.762+0000 7f8bb3fff640 1 -- 172.21.15.98:0/1457393511 learned_addr learned my addr 172.21.15.98:0/1457393511 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:54.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.762+0000 7f8bb37fe640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bb4102570 0x7f8bb41979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bb8868640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bb4102ef0 0x7f8bb419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bb3fff640 1 -- 172.21.15.98:0/1457393511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bb4102570 msgr2=0x7f8bb41979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bb3fff640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bb4102570 0x7f8bb41979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bb3fff640 1 -- 172.21.15.98:0/1457393511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bb4102ef0 msgr2=0x7f8bb419bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bb3fff640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bb4102ef0 0x7f8bb419bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bb3fff640 1 -- 172.21.15.98:0/1457393511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb419c410 con 0x7f8bb4100e20 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bb8868640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bb4102ef0 0x7f8bb419bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bb3fff640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb4100e20 0x7f8bb4197460 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4006010 tx=0x7f8ba4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bb17fa640 1 -- 172.21.15.98:0/1457393511 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba403f070 con 0x7f8bb4100e20 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bba2cb640 1 -- 172.21.15.98:0/1457393511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb419c6a0 con 0x7f8bb4100e20 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bb17fa640 1 -- 172.21.15.98:0/1457393511 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ba4031c30 con 0x7f8bb4100e20 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bb17fa640 1 -- 172.21.15.98:0/1457393511 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4035030 con 0x7f8bb4100e20 2024-09-19T07:20:54.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.763+0000 7f8bba2cb640 1 -- 172.21.15.98:0/1457393511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb41a3fe0 con 0x7f8bb4100e20 2024-09-19T07:20:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.764+0000 7f8bba2cb640 1 -- 172.21.15.98:0/1457393511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8bb4062980 con 0x7f8bb4100e20 2024-09-19T07:20:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.765+0000 7f8bb17fa640 1 -- 172.21.15.98:0/1457393511 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8ba4042070 con 0x7f8bb4100e20 2024-09-19T07:20:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.766+0000 7f8bb17fa640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f8b9c0a32d0 0x7f8b9c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.766+0000 7f8bb37fe640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f8b9c0a32d0 0x7f8b9c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.766+0000 7f8bb17fa640 1 -- 172.21.15.98:0/1457393511 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8ba40f0b70 con 0x7f8bb4100e20 2024-09-19T07:20:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.766+0000 7f8bb17fa640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368] conn(0x7f8b9c0acf80 0x7f8b9c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.766+0000 7f8bb17fa640 1 -- 172.21.15.98:0/1457393511 --> [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b9c0afaf0 con 0x7f8b9c0acf80 2024-09-19T07:20:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.766+0000 7f8bb17fa640 1 -- 172.21.15.98:0/1457393511 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f8ba40f0fc0 con 0x7f8bb4100e20 2024-09-19T07:20:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.766+0000 7f8bb37fe640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f8b9c0a32d0 0x7f8b9c0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40fffb0 tx=0x7f8ba800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.766+0000 7f8bb8868640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368] conn(0x7f8b9c0acf80 0x7f8b9c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.767+0000 7f8bb8868640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368] conn(0x7f8b9c0acf80 0x7f8b9c0af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:54.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.767+0000 7f8bb17fa640 1 -- 172.21.15.98:0/1457393511 <== osd.10 v2:172.21.15.139:6824/2203263368 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b9c0afaf0 con 0x7f8b9c0acf80 2024-09-19T07:20:54.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.781+0000 7f8bba2cb640 1 -- 172.21.15.98:0/1457393511 --> [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8bb4062e00 con 0x7f8b9c0acf80 2024-09-19T07:20:54.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.781+0000 7f8bb17fa640 1 -- 172.21.15.98:0/1457393511 <== osd.10 v2:172.21.15.139:6824/2203263368 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8bb4062e00 con 0x7f8b9c0acf80 2024-09-19T07:20:54.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.782+0000 7f8bba2cb640 1 -- 172.21.15.98:0/1457393511 >> [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368] conn(0x7f8b9c0acf80 msgr2=0x7f8b9c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:54.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.782+0000 7f8bba2cb640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368] conn(0x7f8b9c0acf80 0x7f8b9c0af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:54.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.782+0000 7f8bba2cb640 1 -- 172.21.15.98:0/1457393511 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f8b9c0a32d0 msgr2=0x7f8b9c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:54.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.782+0000 7f8bba2cb640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f8b9c0a32d0 0x7f8b9c0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8bb40fffb0 tx=0x7f8ba800a2d0 comp rx=0 tx=0).stop 2024-09-19T07:20:54.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.782+0000 7f8bba2cb640 1 -- 172.21.15.98:0/1457393511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb4100e20 msgr2=0x7f8bb4197460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:54.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.782+0000 7f8bba2cb640 1 --2- 172.21.15.98:0/1457393511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8bb4100e20 0x7f8bb4197460 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4006010 tx=0x7f8ba4003c10 comp rx=0 tx=0).stop 2024-09-19T07:20:54.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.782+0000 7f8bb8868640 1 -- 172.21.15.98:0/1457393511 reap_dead start 2024-09-19T07:20:54.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.782+0000 7f8bba2cb640 1 -- 172.21.15.98:0/1457393511 shutdown_connections 2024-09-19T07:20:54.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.782+0000 7f8bba2cb640 1 -- 172.21.15.98:0/1457393511 >> 172.21.15.98:0/1457393511 conn(0x7f8bb40fc7d0 msgr2=0x7f8bb40fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:54.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.782+0000 7f8bba2cb640 1 -- 172.21.15.98:0/1457393511 shutdown_connections 2024-09-19T07:20:54.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:54.782+0000 7f8bba2cb640 1 -- 172.21.15.98:0/1457393511 wait complete. 2024-09-19T07:20:55.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.760+0000 7feeb219c640 1 -- 172.21.15.98:0/219415814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feeac102570 msgr2=0x7feeac1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:55.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.760+0000 7feeb219c640 1 --2- 172.21.15.98:0/219415814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feeac102570 0x7feeac1029b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fee94009900 tx=0x7fee9402a480 comp rx=0 tx=0).stop 2024-09-19T07:20:55.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.760+0000 7feeb219c640 1 -- 172.21.15.98:0/219415814 shutdown_connections 2024-09-19T07:20:55.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.760+0000 7feeb219c640 1 --2- 172.21.15.98:0/219415814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feeac102ef0 0x7feeac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:55.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.760+0000 7feeb219c640 1 --2- 172.21.15.98:0/219415814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feeac102570 0x7feeac1029b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:55.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.760+0000 7feeb219c640 1 --2- 172.21.15.98:0/219415814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feeac100e20 0x7feeac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:55.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.760+0000 7feeb219c640 1 -- 172.21.15.98:0/219415814 >> 172.21.15.98:0/219415814 conn(0x7feeac0fc7d0 msgr2=0x7feeac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:55.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.760+0000 7feeb219c640 1 -- 172.21.15.98:0/219415814 shutdown_connections 2024-09-19T07:20:55.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.760+0000 7feeb219c640 1 -- 172.21.15.98:0/219415814 wait complete. 2024-09-19T07:20:55.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.760+0000 7feeb219c640 1 Processor -- start 2024-09-19T07:20:55.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeb219c640 1 -- start start 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeb219c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feeac100e20 0x7feeac199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeb219c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feeac102570 0x7feeac199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeb219c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feeac102ef0 0x7feeac1a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeb219c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feeac110fa0 con 0x7feeac100e20 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeb219c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feeac110e20 con 0x7feeac102ef0 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeb219c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feeac111120 con 0x7feeac102570 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeab7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feeac100e20 0x7feeac199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeab7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feeac100e20 0x7feeac199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44806/0 (socket says 172.21.15.98:44806) 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeab7fe640 1 -- 172.21.15.98:0/544775752 learned_addr learned my addr 172.21.15.98:0/544775752 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeab7fe640 1 -- 172.21.15.98:0/544775752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feeac102570 msgr2=0x7feeac199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeab7fe640 1 --2- 172.21.15.98:0/544775752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feeac102570 0x7feeac199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeab7fe640 1 -- 172.21.15.98:0/544775752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feeac102ef0 msgr2=0x7feeac1a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:55.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeab7fe640 1 --2- 172.21.15.98:0/544775752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feeac102ef0 0x7feeac1a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:55.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeab7fe640 1 -- 172.21.15.98:0/544775752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac1a4910 con 0x7feeac100e20 2024-09-19T07:20:55.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeab7fe640 1 --2- 172.21.15.98:0/544775752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feeac100e20 0x7feeac199350 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c920 tx=0x7fee9c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:55.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feea97fa640 1 -- 172.21.15.98:0/544775752 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c007c70 con 0x7feeac100e20 2024-09-19T07:20:55.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.761+0000 7feeb219c640 1 -- 172.21.15.98:0/544775752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeac1a4ae0 con 0x7feeac100e20 2024-09-19T07:20:55.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.762+0000 7feea97fa640 1 -- 172.21.15.98:0/544775752 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee9c007e10 con 0x7feeac100e20 2024-09-19T07:20:55.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.762+0000 7feea97fa640 1 -- 172.21.15.98:0/544775752 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee9c018890 con 0x7feeac100e20 2024-09-19T07:20:55.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.762+0000 7feeb219c640 1 -- 172.21.15.98:0/544775752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeac1a5020 con 0x7feeac100e20 2024-09-19T07:20:55.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.762+0000 7feeb219c640 1 -- 172.21.15.98:0/544775752 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feeac1072a0 con 0x7feeac100e20 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.764+0000 7feea97fa640 1 -- 172.21.15.98:0/544775752 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fee9c018a30 con 0x7feeac100e20 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.764+0000 7feea97fa640 1 --2- 172.21.15.98:0/544775752 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fee980a32d0 0x7fee980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.764+0000 7feea3fff640 1 --2- 172.21.15.98:0/544775752 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fee980a32d0 0x7fee980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.764+0000 7feea97fa640 1 -- 172.21.15.98:0/544775752 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fee9c0d00d0 con 0x7feeac100e20 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.765+0000 7feea97fa640 1 --2- 172.21.15.98:0/544775752 >> [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399] conn(0x7fee980acf80 0x7fee980af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.765+0000 7feea97fa640 1 -- 172.21.15.98:0/544775752 --> [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee980afaf0 con 0x7fee980acf80 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.765+0000 7feea97fa640 1 -- 172.21.15.98:0/544775752 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fee9c0d0520 con 0x7feeac100e20 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.765+0000 7feea3fff640 1 --2- 172.21.15.98:0/544775752 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fee980a32d0 0x7fee980a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fee940096c0 tx=0x7fee94000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.765+0000 7feeabfff640 1 --2- 172.21.15.98:0/544775752 >> [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399] conn(0x7fee980acf80 0x7fee980af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.765+0000 7feeabfff640 1 --2- 172.21.15.98:0/544775752 >> [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399] conn(0x7fee980acf80 0x7fee980af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.766+0000 7feea97fa640 1 -- 172.21.15.98:0/544775752 <== osd.2 v2:172.21.15.162:6800/2473103399 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee980afaf0 con 0x7fee980acf80 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.779+0000 7feeb219c640 1 -- 172.21.15.98:0/544775752 --> [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feeac1021b0 con 0x7fee980acf80 2024-09-19T07:20:55.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.780+0000 7feea97fa640 1 -- 172.21.15.98:0/544775752 <== osd.2 v2:172.21.15.162:6800/2473103399 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feeac1021b0 con 0x7fee980acf80 2024-09-19T07:20:55.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.780+0000 7feeb219c640 1 -- 172.21.15.98:0/544775752 >> [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399] conn(0x7fee980acf80 msgr2=0x7fee980af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:55.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.780+0000 7feeb219c640 1 --2- 172.21.15.98:0/544775752 >> [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399] conn(0x7fee980acf80 0x7fee980af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:55.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.780+0000 7feeb219c640 1 -- 172.21.15.98:0/544775752 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fee980a32d0 msgr2=0x7fee980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:55.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.780+0000 7feeb219c640 1 --2- 172.21.15.98:0/544775752 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fee980a32d0 0x7fee980a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fee940096c0 tx=0x7fee94000bc0 comp rx=0 tx=0).stop 2024-09-19T07:20:55.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.780+0000 7feeb219c640 1 -- 172.21.15.98:0/544775752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feeac100e20 msgr2=0x7feeac199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:55.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.780+0000 7feeb219c640 1 --2- 172.21.15.98:0/544775752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feeac100e20 0x7feeac199350 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fee9c00c920 tx=0x7fee9c00cde0 comp rx=0 tx=0).stop 2024-09-19T07:20:55.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.780+0000 7feeabfff640 1 -- 172.21.15.98:0/544775752 reap_dead start 2024-09-19T07:20:55.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.780+0000 7feeb219c640 1 -- 172.21.15.98:0/544775752 shutdown_connections 2024-09-19T07:20:55.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.780+0000 7feeb219c640 1 -- 172.21.15.98:0/544775752 >> 172.21.15.98:0/544775752 conn(0x7feeac0fc7d0 msgr2=0x7feeac106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:55.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.780+0000 7feeb219c640 1 -- 172.21.15.98:0/544775752 shutdown_connections 2024-09-19T07:20:55.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.780+0000 7feeb219c640 1 -- 172.21.15.98:0/544775752 wait complete. 2024-09-19T07:20:56.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:55 smithi098 ceph-mon[30950]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 8 op/s; 2.2 KiB/s, 0 objects/s recovering 2024-09-19T07:20:56.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:55 smithi139 ceph-mon[35039]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 8 op/s; 2.2 KiB/s, 0 objects/s recovering 2024-09-19T07:20:56.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:55 smithi162 ceph-mon[35726]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 8 op/s; 2.2 KiB/s, 0 objects/s recovering 2024-09-19T07:20:56.419 INFO:teuthology.orchestra.run.smithi098.stdout:73014444096 2024-09-19T07:20:56.420 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T07:20:56.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.640+0000 7f6413e64640 1 -- 172.21.15.98:0/1770600580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c106f10 msgr2=0x7f640c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:56.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.640+0000 7f6413e64640 1 --2- 172.21.15.98:0/1770600580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c106f10 0x7f640c10ea90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f63fc009900 tx=0x7f63fc02a410 comp rx=0 tx=0).stop 2024-09-19T07:20:56.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.640+0000 7f6413e64640 1 -- 172.21.15.98:0/1770600580 shutdown_connections 2024-09-19T07:20:56.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.640+0000 7f6413e64640 1 --2- 172.21.15.98:0/1770600580 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c106f10 0x7f640c10ea90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:56.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.640+0000 7f6413e64640 1 --2- 172.21.15.98:0/1770600580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f640c102790 0x7f640c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:56.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.640+0000 7f6413e64640 1 --2- 172.21.15.98:0/1770600580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f640c101de0 0x7f640c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:56.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.640+0000 7f6413e64640 1 -- 172.21.15.98:0/1770600580 >> 172.21.15.98:0/1770600580 conn(0x7f640c0fd8c0 msgr2=0x7f640c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:56.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.640+0000 7f6413e64640 1 -- 172.21.15.98:0/1770600580 shutdown_connections 2024-09-19T07:20:56.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.640+0000 7f6413e64640 1 -- 172.21.15.98:0/1770600580 wait complete. 2024-09-19T07:20:56.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6413e64640 1 Processor -- start 2024-09-19T07:20:56.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6413e64640 1 -- start start 2024-09-19T07:20:56.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6413e64640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f640c101de0 0x7f640c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:56.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6413e64640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f640c102790 0x7f640c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:56.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6413e64640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c106f10 0x7f640c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:56.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6413e64640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f640c111f70 con 0x7f640c106f10 2024-09-19T07:20:56.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6413e64640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f640c111df0 con 0x7f640c101de0 2024-09-19T07:20:56.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6413e64640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f640c1120f0 con 0x7f640c102790 2024-09-19T07:20:56.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6412401640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c106f10 0x7f640c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:56.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6412401640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c106f10 0x7f640c19cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44784/0 (socket says 172.21.15.98:44784) 2024-09-19T07:20:56.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6412401640 1 -- 172.21.15.98:0/2568349153 learned_addr learned my addr 172.21.15.98:0/2568349153 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:56.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6411c00640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f640c101de0 0x7f640c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:56.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6412401640 1 -- 172.21.15.98:0/2568349153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f640c102790 msgr2=0x7f640c1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:56.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f64113ff640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f640c102790 0x7f640c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:56.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.641+0000 7f6412401640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f640c102790 0x7f640c1988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:56.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.642+0000 7f6412401640 1 -- 172.21.15.98:0/2568349153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f640c101de0 msgr2=0x7f640c1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:56.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.642+0000 7f6412401640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f640c101de0 0x7f640c1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:56.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.642+0000 7f6412401640 1 -- 172.21.15.98:0/2568349153 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640c19d360 con 0x7f640c106f10 2024-09-19T07:20:56.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.642+0000 7f6411c00640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f640c101de0 0x7f640c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.642+0000 7f6412401640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c106f10 0x7f640c19cc80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f63fc005ab0 tx=0x7f63fc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.642+0000 7f640affd640 1 -- 172.21.15.98:0/2568349153 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc03f030 con 0x7f640c106f10 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.642+0000 7f640affd640 1 -- 172.21.15.98:0/2568349153 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63fc003ad0 con 0x7f640c106f10 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.642+0000 7f6413e64640 1 -- 172.21.15.98:0/2568349153 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640c19d5f0 con 0x7f640c106f10 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.642+0000 7f640affd640 1 -- 172.21.15.98:0/2568349153 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc035070 con 0x7f640c106f10 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.642+0000 7f6413e64640 1 -- 172.21.15.98:0/2568349153 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f640c1a4f30 con 0x7f640c106f10 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.643+0000 7f6413e64640 1 -- 172.21.15.98:0/2568349153 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f640c062980 con 0x7f640c106f10 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.644+0000 7f640affd640 1 -- 172.21.15.98:0/2568349153 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f63fc042030 con 0x7f640c106f10 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.645+0000 7f640affd640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63f40a3350 0x7f63f40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.645+0000 7f6411c00640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63f40a3350 0x7f63f40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.645+0000 7f640affd640 1 -- 172.21.15.98:0/2568349153 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f63fc0f0690 con 0x7f640c106f10 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.645+0000 7f640affd640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034] conn(0x7f63f40aced0 0x7f63f40af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:56.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.645+0000 7f640affd640 1 -- 172.21.15.98:0/2568349153 --> [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63fc001d30 con 0x7f63f40aced0 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.645+0000 7f640affd640 1 -- 172.21.15.98:0/2568349153 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f63fc0f0ae0 con 0x7f640c106f10 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.645+0000 7f6411c00640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63f40a3350 0x7f63f40a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6404005fd0 tx=0x7f6404009970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.645+0000 7f64113ff640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034] conn(0x7f63f40aced0 0x7f63f40af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.646+0000 7f64113ff640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034] conn(0x7f63f40aced0 0x7f63f40af370 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.647+0000 7f640affd640 1 -- 172.21.15.98:0/2568349153 <== osd.4 v2:172.21.15.139:6808/4282134034 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f63fc001d30 con 0x7f63f40aced0 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.660+0000 7f6413e64640 1 -- 172.21.15.98:0/2568349153 --> [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f640c062d80 con 0x7f63f40aced0 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.660+0000 7f640affd640 1 -- 172.21.15.98:0/2568349153 <== osd.4 v2:172.21.15.139:6808/4282134034 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f640c062d80 con 0x7f63f40aced0 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.660+0000 7f6413e64640 1 -- 172.21.15.98:0/2568349153 >> [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034] conn(0x7f63f40aced0 msgr2=0x7f63f40af370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.660+0000 7f6413e64640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034] conn(0x7f63f40aced0 0x7f63f40af370 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.661+0000 7f6413e64640 1 -- 172.21.15.98:0/2568349153 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63f40a3350 msgr2=0x7f63f40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.661+0000 7f6413e64640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63f40a3350 0x7f63f40a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6404005fd0 tx=0x7f6404009970 comp rx=0 tx=0).stop 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.661+0000 7f6413e64640 1 -- 172.21.15.98:0/2568349153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c106f10 msgr2=0x7f640c19cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:56.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.661+0000 7f6413e64640 1 --2- 172.21.15.98:0/2568349153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f640c106f10 0x7f640c19cc80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f63fc005ab0 tx=0x7f63fc004270 comp rx=0 tx=0).stop 2024-09-19T07:20:56.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.661+0000 7f6412401640 1 -- 172.21.15.98:0/2568349153 reap_dead start 2024-09-19T07:20:56.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.661+0000 7f6413e64640 1 -- 172.21.15.98:0/2568349153 shutdown_connections 2024-09-19T07:20:56.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.661+0000 7f6413e64640 1 -- 172.21.15.98:0/2568349153 >> 172.21.15.98:0/2568349153 conn(0x7f640c0fd8c0 msgr2=0x7f640c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:56.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.661+0000 7f6413e64640 1 -- 172.21.15.98:0/2568349153 shutdown_connections 2024-09-19T07:20:56.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:55.661+0000 7f6413e64640 1 -- 172.21.15.98:0/2568349153 wait complete. 2024-09-19T07:20:56.784 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:56.786 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:57.029 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:57.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.624+0000 7f3082d2d640 1 -- 172.21.15.98:0/1269287700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c100a80 msgr2=0x7f307c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:57.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.624+0000 7f3082d2d640 1 --2- 172.21.15.98:0/1269287700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c100a80 0x7f307c100ee0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3068009930 tx=0x7f306802a420 comp rx=0 tx=0).stop 2024-09-19T07:20:57.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.624+0000 7f3082d2d640 1 -- 172.21.15.98:0/1269287700 shutdown_connections 2024-09-19T07:20:57.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.624+0000 7f3082d2d640 1 --2- 172.21.15.98:0/1269287700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f307c101420 0x7f307c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:57.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.624+0000 7f3082d2d640 1 --2- 172.21.15.98:0/1269287700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c100a80 0x7f307c100ee0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:57.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.624+0000 7f3082d2d640 1 --2- 172.21.15.98:0/1269287700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f307c106a80 0x7f307c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:57.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.624+0000 7f3082d2d640 1 -- 172.21.15.98:0/1269287700 >> 172.21.15.98:0/1269287700 conn(0x7f307c0fc7a0 msgr2=0x7f307c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:57.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.624+0000 7f3082d2d640 1 -- 172.21.15.98:0/1269287700 shutdown_connections 2024-09-19T07:20:57.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.624+0000 7f3082d2d640 1 -- 172.21.15.98:0/1269287700 wait complete. 2024-09-19T07:20:57.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f3082d2d640 1 Processor -- start 2024-09-19T07:20:57.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f3082d2d640 1 -- start start 2024-09-19T07:20:57.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f3082d2d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f307c100a80 0x7f307c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:57.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f3082d2d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c101420 0x7f307c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:57.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f3082d2d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f307c106a80 0x7f307c1a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:57.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f3082d2d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f307c110ec0 con 0x7f307c101420 2024-09-19T07:20:57.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f3082d2d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f307c110d40 con 0x7f307c106a80 2024-09-19T07:20:57.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f3082d2d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f307c111040 con 0x7f307c100a80 2024-09-19T07:20:57.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f307bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c101420 0x7f307c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:57.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f307bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c101420 0x7f307c1998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44818/0 (socket says 172.21.15.98:44818) 2024-09-19T07:20:57.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f307bfff640 1 -- 172.21.15.98:0/2635940458 learned_addr learned my addr 172.21.15.98:0/2635940458 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:57.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f30812ca640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f307c106a80 0x7f307c1a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:57.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f307bfff640 1 -- 172.21.15.98:0/2635940458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f307c100a80 msgr2=0x7f307c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:57.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f307bfff640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f307c100a80 0x7f307c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:57.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f307bfff640 1 -- 172.21.15.98:0/2635940458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f307c106a80 msgr2=0x7f307c1a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:57.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f307bfff640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f307c106a80 0x7f307c1a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:57.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.625+0000 7f307bfff640 1 -- 172.21.15.98:0/2635940458 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c1a4930 con 0x7f307c101420 2024-09-19T07:20:57.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.626+0000 7f307bfff640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c101420 0x7f307c1998b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3068009230 tx=0x7f3068004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:57.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.626+0000 7f3079ffb640 1 -- 172.21.15.98:0/2635940458 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306803f030 con 0x7f307c101420 2024-09-19T07:20:57.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.626+0000 7f3079ffb640 1 -- 172.21.15.98:0/2635940458 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3068003ad0 con 0x7f307c101420 2024-09-19T07:20:57.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.626+0000 7f3082d2d640 1 -- 172.21.15.98:0/2635940458 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307c1a4b00 con 0x7f307c101420 2024-09-19T07:20:57.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.626+0000 7f3079ffb640 1 -- 172.21.15.98:0/2635940458 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068035070 con 0x7f307c101420 2024-09-19T07:20:57.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.626+0000 7f3082d2d640 1 -- 172.21.15.98:0/2635940458 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307c1a4f50 con 0x7f307c101420 2024-09-19T07:20:57.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.627+0000 7f3082d2d640 1 -- 172.21.15.98:0/2635940458 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f307c062900 con 0x7f307c101420 2024-09-19T07:20:57.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.628+0000 7f3079ffb640 1 -- 172.21.15.98:0/2635940458 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3068042030 con 0x7f307c101420 2024-09-19T07:20:57.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.629+0000 7f3079ffb640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f306c0a32d0 0x7f306c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:57.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.629+0000 7f3080ac9640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f306c0a32d0 0x7f306c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:57.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.629+0000 7f3079ffb640 1 -- 172.21.15.98:0/2635940458 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f30680f0490 con 0x7f307c101420 2024-09-19T07:20:57.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.629+0000 7f3079ffb640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006] conn(0x7f306c0acf80 0x7f306c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:57.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.629+0000 7f3079ffb640 1 -- 172.21.15.98:0/2635940458 --> [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f306c0afaf0 con 0x7f306c0acf80 2024-09-19T07:20:57.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.629+0000 7f3079ffb640 1 -- 172.21.15.98:0/2635940458 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f30680f08e0 con 0x7f307c101420 2024-09-19T07:20:57.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.629+0000 7f30812ca640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006] conn(0x7f306c0acf80 0x7f306c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:57.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.629+0000 7f3080ac9640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f306c0a32d0 0x7f306c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3070009710 tx=0x7f3070006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:57.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.629+0000 7f30812ca640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006] conn(0x7f306c0acf80 0x7f306c0af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:57.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.630+0000 7f3079ffb640 1 -- 172.21.15.98:0/2635940458 <== osd.9 v2:172.21.15.98:6826/1615504006 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f306c0afaf0 con 0x7f306c0acf80 2024-09-19T07:20:57.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.643+0000 7f3082d2d640 1 -- 172.21.15.98:0/2635940458 --> [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f307c062d80 con 0x7f306c0acf80 2024-09-19T07:20:57.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.644+0000 7f3079ffb640 1 -- 172.21.15.98:0/2635940458 <== osd.9 v2:172.21.15.98:6826/1615504006 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f307c062d80 con 0x7f306c0acf80 2024-09-19T07:20:57.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.644+0000 7f3082d2d640 1 -- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006] conn(0x7f306c0acf80 msgr2=0x7f306c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:57.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.644+0000 7f3082d2d640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006] conn(0x7f306c0acf80 0x7f306c0af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:57.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.644+0000 7f3082d2d640 1 -- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f306c0a32d0 msgr2=0x7f306c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:57.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.644+0000 7f3082d2d640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f306c0a32d0 0x7f306c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3070009710 tx=0x7f3070006c90 comp rx=0 tx=0).stop 2024-09-19T07:20:57.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.644+0000 7f3082d2d640 1 -- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c101420 msgr2=0x7f307c1998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:57.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.644+0000 7f3082d2d640 1 --2- 172.21.15.98:0/2635940458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c101420 0x7f307c1998b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3068009230 tx=0x7f3068004270 comp rx=0 tx=0).stop 2024-09-19T07:20:57.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.644+0000 7f30812ca640 1 -- 172.21.15.98:0/2635940458 reap_dead start 2024-09-19T07:20:57.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.644+0000 7f3082d2d640 1 -- 172.21.15.98:0/2635940458 shutdown_connections 2024-09-19T07:20:57.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.644+0000 7f3082d2d640 1 -- 172.21.15.98:0/2635940458 >> 172.21.15.98:0/2635940458 conn(0x7f307c0fc7a0 msgr2=0x7f307c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:57.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.644+0000 7f3082d2d640 1 -- 172.21.15.98:0/2635940458 shutdown_connections 2024-09-19T07:20:57.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:57.644+0000 7f3082d2d640 1 -- 172.21.15.98:0/2635940458 wait complete. 2024-09-19T07:20:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:57 smithi098 ceph-mon[30950]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T07:20:58.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:57 smithi139 ceph-mon[35039]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T07:20:58.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:57 smithi162 ceph-mon[35726]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-19T07:20:58.299 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:20:58.327 INFO:teuthology.orchestra.run.smithi098.stdout:257698037789 2024-09-19T07:20:58.328 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T07:20:58.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.612+0000 7fa88c0e2640 1 -- 172.21.15.98:0/4073096980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884102570 msgr2=0x7fa8841029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.612+0000 7fa88c0e2640 1 --2- 172.21.15.98:0/4073096980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884102570 0x7fa8841029b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa878009900 tx=0x7fa87802a480 comp rx=0 tx=0).stop 2024-09-19T07:20:58.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.612+0000 7fa88c0e2640 1 -- 172.21.15.98:0/4073096980 shutdown_connections 2024-09-19T07:20:58.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.612+0000 7fa88c0e2640 1 --2- 172.21.15.98:0/4073096980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa884102ef0 0x7fa88410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.612+0000 7fa88c0e2640 1 --2- 172.21.15.98:0/4073096980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884102570 0x7fa8841029b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.612+0000 7fa88c0e2640 1 --2- 172.21.15.98:0/4073096980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa884100e20 0x7fa884101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.612+0000 7fa88c0e2640 1 -- 172.21.15.98:0/4073096980 >> 172.21.15.98:0/4073096980 conn(0x7fa8840fc7d0 msgr2=0x7fa8840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:58.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.613+0000 7fa88c0e2640 1 -- 172.21.15.98:0/4073096980 shutdown_connections 2024-09-19T07:20:58.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.613+0000 7fa88c0e2640 1 -- 172.21.15.98:0/4073096980 wait complete. 2024-09-19T07:20:58.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.613+0000 7fa88c0e2640 1 Processor -- start 2024-09-19T07:20:58.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.613+0000 7fa88c0e2640 1 -- start start 2024-09-19T07:20:58.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa88c0e2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884100e20 0x7fa8841993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa88c0e2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa884102570 0x7fa8841998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa88c0e2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa884102ef0 0x7fa8841a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa88c0e2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa884110fc0 con 0x7fa884100e20 2024-09-19T07:20:58.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa88c0e2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa884110e40 con 0x7fa884102ef0 2024-09-19T07:20:58.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa88c0e2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa884111140 con 0x7fa884102570 2024-09-19T07:20:58.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa889e7e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884100e20 0x7fa8841993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa889e7e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884100e20 0x7fa8841993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44856/0 (socket says 172.21.15.98:44856) 2024-09-19T07:20:58.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa889e7e640 1 -- 172.21.15.98:0/1321302789 learned_addr learned my addr 172.21.15.98:0/1321302789 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:58.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa88a67f640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa884102ef0 0x7fa8841a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa88967d640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa884102570 0x7fa8841998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa889e7e640 1 -- 172.21.15.98:0/1321302789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa884102570 msgr2=0x7fa8841998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa889e7e640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa884102570 0x7fa8841998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa889e7e640 1 -- 172.21.15.98:0/1321302789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa884102ef0 msgr2=0x7fa8841a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa889e7e640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa884102ef0 0x7fa8841a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa889e7e640 1 -- 172.21.15.98:0/1321302789 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8841a4970 con 0x7fa884100e20 2024-09-19T07:20:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa88a67f640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa884102ef0 0x7fa8841a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa889e7e640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884100e20 0x7fa8841993b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa87400ea80 tx=0x7fa87400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:58.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa882ffd640 1 -- 172.21.15.98:0/1321302789 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87400ce40 con 0x7fa884100e20 2024-09-19T07:20:58.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa88c0e2640 1 -- 172.21.15.98:0/1321302789 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8841a4b40 con 0x7fa884100e20 2024-09-19T07:20:58.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa882ffd640 1 -- 172.21.15.98:0/1321302789 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa874005020 con 0x7fa884100e20 2024-09-19T07:20:58.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa882ffd640 1 -- 172.21.15.98:0/1321302789 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874011760 con 0x7fa884100e20 2024-09-19T07:20:58.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.614+0000 7fa88c0e2640 1 -- 172.21.15.98:0/1321302789 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8841a5050 con 0x7fa884100e20 2024-09-19T07:20:58.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.615+0000 7fa88c0e2640 1 -- 172.21.15.98:0/1321302789 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa884062940 con 0x7fa884100e20 2024-09-19T07:20:58.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.616+0000 7fa882ffd640 1 -- 172.21.15.98:0/1321302789 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa8740051d0 con 0x7fa884100e20 2024-09-19T07:20:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.617+0000 7fa882ffd640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa86c0a32d0 0x7fa86c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.617+0000 7fa88967d640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa86c0a32d0 0x7fa86c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.617+0000 7fa882ffd640 1 -- 172.21.15.98:0/1321302789 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fa8740d0300 con 0x7fa884100e20 2024-09-19T07:20:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.617+0000 7fa882ffd640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028] conn(0x7fa86c0acf80 0x7fa86c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:58.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.617+0000 7fa882ffd640 1 -- 172.21.15.98:0/1321302789 --> [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa874026ea0 con 0x7fa86c0acf80 2024-09-19T07:20:58.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.617+0000 7fa882ffd640 1 -- 172.21.15.98:0/1321302789 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fa8740d0750 con 0x7fa884100e20 2024-09-19T07:20:58.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.617+0000 7fa88967d640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa86c0a32d0 0x7fa86c0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa88406aac0 tx=0x7fa878005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:58.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.617+0000 7fa88a67f640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028] conn(0x7fa86c0acf80 0x7fa86c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:58.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.618+0000 7fa88a67f640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028] conn(0x7fa86c0acf80 0x7fa86c0af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:58.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.619+0000 7fa882ffd640 1 -- 172.21.15.98:0/1321302789 <== osd.5 v2:172.21.15.162:6808/4205554028 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa874026ea0 con 0x7fa86c0acf80 2024-09-19T07:20:58.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.632+0000 7fa88c0e2640 1 -- 172.21.15.98:0/1321302789 --> [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa884062dc0 con 0x7fa86c0acf80 2024-09-19T07:20:58.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.633+0000 7fa882ffd640 1 -- 172.21.15.98:0/1321302789 <== osd.5 v2:172.21.15.162:6808/4205554028 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa884062dc0 con 0x7fa86c0acf80 2024-09-19T07:20:58.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.634+0000 7fa88c0e2640 1 -- 172.21.15.98:0/1321302789 >> [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028] conn(0x7fa86c0acf80 msgr2=0x7fa86c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.634+0000 7fa88c0e2640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028] conn(0x7fa86c0acf80 0x7fa86c0af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:58.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.634+0000 7fa88c0e2640 1 -- 172.21.15.98:0/1321302789 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa86c0a32d0 msgr2=0x7fa86c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.634+0000 7fa88c0e2640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fa86c0a32d0 0x7fa86c0a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa88406aac0 tx=0x7fa878005a20 comp rx=0 tx=0).stop 2024-09-19T07:20:58.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.634+0000 7fa88c0e2640 1 -- 172.21.15.98:0/1321302789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884100e20 msgr2=0x7fa8841993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:58.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.634+0000 7fa88c0e2640 1 --2- 172.21.15.98:0/1321302789 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa884100e20 0x7fa8841993b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa87400ea80 tx=0x7fa87400ef40 comp rx=0 tx=0).stop 2024-09-19T07:20:58.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.634+0000 7fa88a67f640 1 -- 172.21.15.98:0/1321302789 reap_dead start 2024-09-19T07:20:58.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.634+0000 7fa88c0e2640 1 -- 172.21.15.98:0/1321302789 shutdown_connections 2024-09-19T07:20:58.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.634+0000 7fa88c0e2640 1 -- 172.21.15.98:0/1321302789 >> 172.21.15.98:0/1321302789 conn(0x7fa8840fc7d0 msgr2=0x7fa8840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:58.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.634+0000 7fa88c0e2640 1 -- 172.21.15.98:0/1321302789 shutdown_connections 2024-09-19T07:20:58.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.634+0000 7fa88c0e2640 1 -- 172.21.15.98:0/1321302789 wait complete. 2024-09-19T07:20:59.382 INFO:teuthology.orchestra.run.smithi098.stdout:146028888114 2024-09-19T07:20:59.383 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T07:20:59.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.508+0000 7f93158cf640 1 -- 172.21.15.98:0/846137302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9310100aa0 msgr2=0x7f931010ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:59.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.508+0000 7f93158cf640 1 --2- 172.21.15.98:0/846137302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9310100aa0 0x7f931010ea20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9308009900 tx=0x7f930802a410 comp rx=0 tx=0).stop 2024-09-19T07:20:59.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.508+0000 7f93158cf640 1 -- 172.21.15.98:0/846137302 shutdown_connections 2024-09-19T07:20:59.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.508+0000 7f93158cf640 1 --2- 172.21.15.98:0/846137302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9310100aa0 0x7f931010ea20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.508+0000 7f93158cf640 1 --2- 172.21.15.98:0/846137302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9310100100 0x7f9310100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.508+0000 7f93158cf640 1 --2- 172.21.15.98:0/846137302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9310106b80 0x7f9310106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.508+0000 7f93158cf640 1 -- 172.21.15.98:0/846137302 >> 172.21.15.98:0/846137302 conn(0x7f9310077230 msgr2=0x7f93100fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.508+0000 7f93158cf640 1 -- 172.21.15.98:0/846137302 shutdown_connections 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.508+0000 7f93158cf640 1 -- 172.21.15.98:0/846137302 wait complete. 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.508+0000 7f93158cf640 1 Processor -- start 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f93158cf640 1 -- start start 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f93158cf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9310100100 0x7f93101a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f93158cf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9310100aa0 0x7f93101a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f93158cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9310106b80 0x7f931019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f93158cf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f93101120f0 con 0x7f9310100aa0 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f93158cf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9310111f70 con 0x7f9310100100 2024-09-19T07:20:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f93158cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9310112270 con 0x7f9310106b80 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f930e7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9310100aa0 0x7f93101a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f930e7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9310100aa0 0x7f93101a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44838/0 (socket says 172.21.15.98:44838) 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f930e7fc640 1 -- 172.21.15.98:0/1881360926 learned_addr learned my addr 172.21.15.98:0/1881360926 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f930effd640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9310100100 0x7f93101a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f930f7fe640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9310106b80 0x7f931019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f930e7fc640 1 -- 172.21.15.98:0/1881360926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9310106b80 msgr2=0x7f931019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f930e7fc640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9310106b80 0x7f931019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f930e7fc640 1 -- 172.21.15.98:0/1881360926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9310100100 msgr2=0x7f93101a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f930e7fc640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9310100100 0x7f93101a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f930e7fc640 1 -- 172.21.15.98:0/1881360926 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931019ace0 con 0x7f9310100aa0 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f930effd640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9310100100 0x7f93101a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.509+0000 7f930f7fe640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9310106b80 0x7f931019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:20:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.510+0000 7f930e7fc640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9310100aa0 0x7f93101a0930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f930000ba50 tx=0x7f930000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.510+0000 7f93148cd640 1 -- 172.21.15.98:0/1881360926 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300019070 con 0x7f9310100aa0 2024-09-19T07:20:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.510+0000 7f93158cf640 1 -- 172.21.15.98:0/1881360926 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931019afd0 con 0x7f9310100aa0 2024-09-19T07:20:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.510+0000 7f93148cd640 1 -- 172.21.15.98:0/1881360926 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f930000cbe0 con 0x7f9310100aa0 2024-09-19T07:20:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.510+0000 7f93148cd640 1 -- 172.21.15.98:0/1881360926 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93000076e0 con 0x7f9310100aa0 2024-09-19T07:20:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.510+0000 7f93158cf640 1 -- 172.21.15.98:0/1881360926 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93101a72c0 con 0x7f9310100aa0 2024-09-19T07:20:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.511+0000 7f93158cf640 1 -- 172.21.15.98:0/1881360926 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9310102570 con 0x7f9310100aa0 2024-09-19T07:20:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.512+0000 7f93148cd640 1 -- 172.21.15.98:0/1881360926 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f930001c070 con 0x7f9310100aa0 2024-09-19T07:20:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.513+0000 7f93148cd640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f92f80a32d0 0x7f92f80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.513+0000 7f930effd640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f92f80a32d0 0x7f92f80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.513+0000 7f93148cd640 1 -- 172.21.15.98:0/1881360926 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f93000cf070 con 0x7f9310100aa0 2024-09-19T07:20:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.513+0000 7f93148cd640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110] conn(0x7f92f80acf80 0x7f92f80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:20:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.513+0000 7f93148cd640 1 -- 172.21.15.98:0/1881360926 --> [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9300010ec0 con 0x7f92f80acf80 2024-09-19T07:20:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.513+0000 7f93148cd640 1 -- 172.21.15.98:0/1881360926 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f93000d6050 con 0x7f9310100aa0 2024-09-19T07:20:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.513+0000 7f930effd640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f92f80a32d0 0x7f92f80a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9304009930 tx=0x7f9304008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.513+0000 7f930f7fe640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110] conn(0x7f92f80acf80 0x7f92f80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.514+0000 7f930f7fe640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110] conn(0x7f92f80acf80 0x7f92f80af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.515+0000 7f93148cd640 1 -- 172.21.15.98:0/1881360926 <== osd.7 v2:172.21.15.139:6816/1139952110 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9300010ec0 con 0x7f92f80acf80 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.530+0000 7f93158cf640 1 -- 172.21.15.98:0/1881360926 --> [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9310103420 con 0x7f92f80acf80 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.531+0000 7f93148cd640 1 -- 172.21.15.98:0/1881360926 <== osd.7 v2:172.21.15.139:6816/1139952110 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9310103420 con 0x7f92f80acf80 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.531+0000 7f93158cf640 1 -- 172.21.15.98:0/1881360926 >> [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110] conn(0x7f92f80acf80 msgr2=0x7f92f80af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.531+0000 7f93158cf640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110] conn(0x7f92f80acf80 0x7f92f80af420 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.532+0000 7f93158cf640 1 -- 172.21.15.98:0/1881360926 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f92f80a32d0 msgr2=0x7f92f80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.532+0000 7f93158cf640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f92f80a32d0 0x7f92f80a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9304009930 tx=0x7f9304008040 comp rx=0 tx=0).stop 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.532+0000 7f93158cf640 1 -- 172.21.15.98:0/1881360926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9310100aa0 msgr2=0x7f93101a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.532+0000 7f93158cf640 1 --2- 172.21.15.98:0/1881360926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9310100aa0 0x7f93101a0930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f930000ba50 tx=0x7f930000bf10 comp rx=0 tx=0).stop 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.532+0000 7f930f7fe640 1 -- 172.21.15.98:0/1881360926 reap_dead start 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.532+0000 7f93158cf640 1 -- 172.21.15.98:0/1881360926 shutdown_connections 2024-09-19T07:20:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.532+0000 7f93158cf640 1 -- 172.21.15.98:0/1881360926 >> 172.21.15.98:0/1881360926 conn(0x7f9310077230 msgr2=0x7f9310104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:20:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.532+0000 7f93158cf640 1 -- 172.21.15.98:0/1881360926 shutdown_connections 2024-09-19T07:20:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:20:58.532+0000 7f93158cf640 1 -- 172.21.15.98:0/1881360926 wait complete. 2024-09-19T07:20:59.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:20:59 smithi098 ceph-mon[30950]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-19T07:21:00.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:20:59 smithi139 ceph-mon[35039]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-19T07:21:00.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.081+0000 7f3e9fd51640 1 -- 172.21.15.98:0/2630446422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e981082a0 msgr2=0x7f3e9810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:00.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.081+0000 7f3e9fd51640 1 --2- 172.21.15.98:0/2630446422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e981082a0 0x7f3e9810ec40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009930 tx=0x7f3e9002a440 comp rx=0 tx=0).stop 2024-09-19T07:21:00.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.082+0000 7f3e9fd51640 1 -- 172.21.15.98:0/2630446422 shutdown_connections 2024-09-19T07:21:00.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.082+0000 7f3e9fd51640 1 --2- 172.21.15.98:0/2630446422 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e981082a0 0x7f3e9810ec40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:00.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.082+0000 7f3e9fd51640 1 --2- 172.21.15.98:0/2630446422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e981036e0 0x7f3e98107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:00.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.082+0000 7f3e9fd51640 1 --2- 172.21.15.98:0/2630446422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e98102d30 0x7f3e98103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:00.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.082+0000 7f3e9fd51640 1 -- 172.21.15.98:0/2630446422 >> 172.21.15.98:0/2630446422 conn(0x7f3e980fc7d0 msgr2=0x7f3e980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:00.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.082+0000 7f3e9fd51640 1 -- 172.21.15.98:0/2630446422 shutdown_connections 2024-09-19T07:21:00.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.082+0000 7f3e9fd51640 1 -- 172.21.15.98:0/2630446422 wait complete. 2024-09-19T07:21:00.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.082+0000 7f3e9fd51640 1 Processor -- start 2024-09-19T07:21:00.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.082+0000 7f3e9fd51640 1 -- start start 2024-09-19T07:21:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9fd51640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e98102d30 0x7f3e981986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9fd51640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e981036e0 0x7f3e98198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9fd51640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e981082a0 0x7f3e9819cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9fd51640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3e98112160 con 0x7f3e98102d30 2024-09-19T07:21:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9fd51640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3e98111fe0 con 0x7f3e981082a0 2024-09-19T07:21:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9fd51640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e981122e0 con 0x7f3e981036e0 2024-09-19T07:21:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9daed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e98102d30 0x7f3e981986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9daed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e98102d30 0x7f3e981986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44888/0 (socket says 172.21.15.98:44888) 2024-09-19T07:21:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9daed640 1 -- 172.21.15.98:0/1981794740 learned_addr learned my addr 172.21.15.98:0/1981794740 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9e2ee640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e981082a0 0x7f3e9819cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:00.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9daed640 1 -- 172.21.15.98:0/1981794740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e981036e0 msgr2=0x7f3e98198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9daed640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e981036e0 0x7f3e98198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9daed640 1 -- 172.21.15.98:0/1981794740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e981082a0 msgr2=0x7f3e9819cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9daed640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e981082a0 0x7f3e9819cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9daed640 1 -- 172.21.15.98:0/1981794740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e9819d670 con 0x7f3e98102d30 2024-09-19T07:21:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9daed640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e98102d30 0x7f3e981986c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800ba50 tx=0x7f3e8800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e96ffd640 1 -- 172.21.15.98:0/1981794740 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88019070 con 0x7f3e98102d30 2024-09-19T07:21:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e96ffd640 1 -- 172.21.15.98:0/1981794740 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e8800cbe0 con 0x7f3e98102d30 2024-09-19T07:21:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.083+0000 7f3e9fd51640 1 -- 172.21.15.98:0/1981794740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9819d960 con 0x7f3e98102d30 2024-09-19T07:21:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.084+0000 7f3e96ffd640 1 -- 172.21.15.98:0/1981794740 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e880076e0 con 0x7f3e98102d30 2024-09-19T07:21:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.084+0000 7f3e9fd51640 1 -- 172.21.15.98:0/1981794740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e981a5240 con 0x7f3e98102d30 2024-09-19T07:21:00.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.084+0000 7f3e9fd51640 1 -- 172.21.15.98:0/1981794740 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e98062980 con 0x7f3e98102d30 2024-09-19T07:21:00.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.086+0000 7f3e96ffd640 1 -- 172.21.15.98:0/1981794740 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3e8801c070 con 0x7f3e98102d30 2024-09-19T07:21:00.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.086+0000 7f3e96ffd640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f3e800a3350 0x7f3e800a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:00.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.086+0000 7f3e9d2ec640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f3e800a3350 0x7f3e800a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:00.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.086+0000 7f3e96ffd640 1 -- 172.21.15.98:0/1981794740 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f3e880cf860 con 0x7f3e98102d30 2024-09-19T07:21:00.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.086+0000 7f3e96ffd640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302] conn(0x7f3e800ad000 0x7f3e800af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:00.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.086+0000 7f3e96ffd640 1 -- 172.21.15.98:0/1981794740 --> [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e800afb70 con 0x7f3e800ad000 2024-09-19T07:21:00.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.086+0000 7f3e96ffd640 1 -- 172.21.15.98:0/1981794740 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f3e880cfcb0 con 0x7f3e98102d30 2024-09-19T07:21:00.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.087+0000 7f3e9d2ec640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f3e800a3350 0x7f3e800a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3e980fee50 tx=0x7f3e8c006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:00.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.087+0000 7f3e9e2ee640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302] conn(0x7f3e800ad000 0x7f3e800af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:00.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.088+0000 7f3e9e2ee640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302] conn(0x7f3e800ad000 0x7f3e800af4a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:00.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.089+0000 7f3e96ffd640 1 -- 172.21.15.98:0/1981794740 <== osd.1 v2:172.21.15.139:6800/1737478302 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e800afb70 con 0x7f3e800ad000 2024-09-19T07:21:00.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.102+0000 7f3e9fd51640 1 -- 172.21.15.98:0/1981794740 --> [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e98062e00 con 0x7f3e800ad000 2024-09-19T07:21:00.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.103+0000 7f3e96ffd640 1 -- 172.21.15.98:0/1981794740 <== osd.1 v2:172.21.15.139:6800/1737478302 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3e98062e00 con 0x7f3e800ad000 2024-09-19T07:21:00.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.103+0000 7f3e9fd51640 1 -- 172.21.15.98:0/1981794740 >> [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302] conn(0x7f3e800ad000 msgr2=0x7f3e800af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:00.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.103+0000 7f3e9fd51640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302] conn(0x7f3e800ad000 0x7f3e800af4a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:00.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.103+0000 7f3e9fd51640 1 -- 172.21.15.98:0/1981794740 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f3e800a3350 msgr2=0x7f3e800a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:00.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.103+0000 7f3e9fd51640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f3e800a3350 0x7f3e800a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3e980fee50 tx=0x7f3e8c006c90 comp rx=0 tx=0).stop 2024-09-19T07:21:00.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.103+0000 7f3e9fd51640 1 -- 172.21.15.98:0/1981794740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e98102d30 msgr2=0x7f3e981986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:00.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.103+0000 7f3e9fd51640 1 --2- 172.21.15.98:0/1981794740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e98102d30 0x7f3e981986c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800ba50 tx=0x7f3e8800bf10 comp rx=0 tx=0).stop 2024-09-19T07:21:00.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.103+0000 7f3e9e2ee640 1 -- 172.21.15.98:0/1981794740 reap_dead start 2024-09-19T07:21:00.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.103+0000 7f3e9fd51640 1 -- 172.21.15.98:0/1981794740 shutdown_connections 2024-09-19T07:21:00.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.103+0000 7f3e9fd51640 1 -- 172.21.15.98:0/1981794740 >> 172.21.15.98:0/1981794740 conn(0x7f3e980fc7d0 msgr2=0x7f3e98105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:00.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.103+0000 7f3e9fd51640 1 -- 172.21.15.98:0/1981794740 shutdown_connections 2024-09-19T07:21:00.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:00.103+0000 7f3e9fd51640 1 -- 172.21.15.98:0/1981794740 wait complete. 2024-09-19T07:21:00.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:20:59 smithi162 ceph-mon[35726]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-19T07:21:00.598 INFO:teuthology.orchestra.run.smithi098.stdout:279172874264 2024-09-19T07:21:00.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T07:21:01.285 INFO:teuthology.orchestra.run.smithi098.stdout:128849018933 2024-09-19T07:21:01.285 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T07:21:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.500+0000 7fb84350d640 1 -- 172.21.15.98:0/2349517916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb83c106f30 msgr2=0x7fb83c10eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.500+0000 7fb84350d640 1 --2- 172.21.15.98:0/2349517916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb83c106f30 0x7fb83c10eab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb834009ca0 tx=0x7fb83402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:21:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.500+0000 7fb84350d640 1 -- 172.21.15.98:0/2349517916 shutdown_connections 2024-09-19T07:21:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.500+0000 7fb84350d640 1 --2- 172.21.15.98:0/2349517916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb83c106f30 0x7fb83c10eab0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.500+0000 7fb84350d640 1 --2- 172.21.15.98:0/2349517916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb83c100cc0 0x7fb83c106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.501+0000 7fb84350d640 1 --2- 172.21.15.98:0/2349517916 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb83c100310 0x7fb83c1006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.501+0000 7fb84350d640 1 -- 172.21.15.98:0/2349517916 >> 172.21.15.98:0/2349517916 conn(0x7fb83c077210 msgr2=0x7fb83c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:01.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.501+0000 7fb84350d640 1 -- 172.21.15.98:0/2349517916 shutdown_connections 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.501+0000 7fb84350d640 1 -- 172.21.15.98:0/2349517916 wait complete. 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.501+0000 7fb84350d640 1 Processor -- start 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.501+0000 7fb84350d640 1 -- start start 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.501+0000 7fb84350d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb83c100310 0x7fb83c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.501+0000 7fb84350d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb83c100cc0 0x7fb83c1989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.501+0000 7fb84350d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb83c106f30 0x7fb83c19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.501+0000 7fb84350d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c112020 con 0x7fb83c106f30 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.501+0000 7fb84350d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c111ea0 con 0x7fb83c100310 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.501+0000 7fb84350d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb83c1121a0 con 0x7fb83c100cc0 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb841aaa640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb83c106f30 0x7fb83c19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb841aaa640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb83c106f30 0x7fb83c19cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44906/0 (socket says 172.21.15.98:44906) 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb841aaa640 1 -- 172.21.15.98:0/3030040105 learned_addr learned my addr 172.21.15.98:0/3030040105 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:01.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb8412a9640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb83c100310 0x7fb83c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb840aa8640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb83c100cc0 0x7fb83c1989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb841aaa640 1 -- 172.21.15.98:0/3030040105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb83c100cc0 msgr2=0x7fb83c1989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb841aaa640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb83c100cc0 0x7fb83c1989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb841aaa640 1 -- 172.21.15.98:0/3030040105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb83c100310 msgr2=0x7fb83c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb841aaa640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb83c100310 0x7fb83c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb841aaa640 1 -- 172.21.15.98:0/3030040105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83c19d430 con 0x7fb83c106f30 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb840aa8640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb83c100cc0 0x7fb83c1989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb841aaa640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb83c106f30 0x7fb83c19cd50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb834003f40 tx=0x7fb834003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb8327fc640 1 -- 172.21.15.98:0/3030040105 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8340318c0 con 0x7fb83c106f30 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb84350d640 1 -- 172.21.15.98:0/3030040105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb83c19d6c0 con 0x7fb83c106f30 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb8327fc640 1 -- 172.21.15.98:0/3030040105 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb834004520 con 0x7fb83c106f30 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb8327fc640 1 -- 172.21.15.98:0/3030040105 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83402fe10 con 0x7fb83c106f30 2024-09-19T07:21:01.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.502+0000 7fb84350d640 1 -- 172.21.15.98:0/3030040105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb83c1a5000 con 0x7fb83c106f30 2024-09-19T07:21:01.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.503+0000 7fb84350d640 1 -- 172.21.15.98:0/3030040105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb83c062980 con 0x7fb83c106f30 2024-09-19T07:21:01.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.504+0000 7fb8327fc640 1 -- 172.21.15.98:0/3030040105 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb8340046d0 con 0x7fb83c106f30 2024-09-19T07:21:01.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.505+0000 7fb8327fc640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb8280a32d0 0x7fb8280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:01.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.505+0000 7fb8412a9640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb8280a32d0 0x7fb8280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:01.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.505+0000 7fb8327fc640 1 -- 172.21.15.98:0/3030040105 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb8340f1280 con 0x7fb83c106f30 2024-09-19T07:21:01.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.505+0000 7fb8327fc640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351] conn(0x7fb8280acf80 0x7fb8280af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:01.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.505+0000 7fb8327fc640 1 -- 172.21.15.98:0/3030040105 --> [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb834039e50 con 0x7fb8280acf80 2024-09-19T07:21:01.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.505+0000 7fb8327fc640 1 -- 172.21.15.98:0/3030040105 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fb8340f16d0 con 0x7fb83c106f30 2024-09-19T07:21:01.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.506+0000 7fb8412a9640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb8280a32d0 0x7fb8280a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb8380058c0 tx=0x7fb83800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:01.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.506+0000 7fb840aa8640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351] conn(0x7fb8280acf80 0x7fb8280af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:01.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.506+0000 7fb840aa8640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351] conn(0x7fb8280acf80 0x7fb8280af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:01.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.506+0000 7fb8327fc640 1 -- 172.21.15.98:0/3030040105 <== osd.6 v2:172.21.15.98:6818/1426401351 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb834039e50 con 0x7fb8280acf80 2024-09-19T07:21:01.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.521+0000 7fb84350d640 1 -- 172.21.15.98:0/3030040105 --> [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb83c062d80 con 0x7fb8280acf80 2024-09-19T07:21:01.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.522+0000 7fb8327fc640 1 -- 172.21.15.98:0/3030040105 <== osd.6 v2:172.21.15.98:6818/1426401351 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb83c062d80 con 0x7fb8280acf80 2024-09-19T07:21:01.523 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:01.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.522+0000 7fb84350d640 1 -- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351] conn(0x7fb8280acf80 msgr2=0x7fb8280af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:01.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.522+0000 7fb84350d640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351] conn(0x7fb8280acf80 0x7fb8280af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:01.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.522+0000 7fb84350d640 1 -- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb8280a32d0 msgr2=0x7fb8280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:01.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.522+0000 7fb84350d640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb8280a32d0 0x7fb8280a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb8380058c0 tx=0x7fb83800a250 comp rx=0 tx=0).stop 2024-09-19T07:21:01.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.522+0000 7fb84350d640 1 -- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb83c106f30 msgr2=0x7fb83c19cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:01.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.522+0000 7fb84350d640 1 --2- 172.21.15.98:0/3030040105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb83c106f30 0x7fb83c19cd50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb834003f40 tx=0x7fb834003f70 comp rx=0 tx=0).stop 2024-09-19T07:21:01.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.523+0000 7fb841aaa640 1 -- 172.21.15.98:0/3030040105 reap_dead start 2024-09-19T07:21:01.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.523+0000 7fb84350d640 1 -- 172.21.15.98:0/3030040105 shutdown_connections 2024-09-19T07:21:01.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.523+0000 7fb84350d640 1 -- 172.21.15.98:0/3030040105 >> 172.21.15.98:0/3030040105 conn(0x7fb83c077210 msgr2=0x7fb83c1056c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:01.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.523+0000 7fb84350d640 1 -- 172.21.15.98:0/3030040105 shutdown_connections 2024-09-19T07:21:01.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:01.523+0000 7fb84350d640 1 -- 172.21.15.98:0/3030040105 wait complete. 2024-09-19T07:21:01.526 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:01.763 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:01 smithi098 ceph-mon[30950]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:21:02.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:01 smithi139 ceph-mon[35039]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:21:02.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:01 smithi162 ceph-mon[35726]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:21:02.450 INFO:teuthology.orchestra.run.smithi098.stdout:51539607621 2024-09-19T07:21:02.450 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T07:21:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.116+0000 7ff775a9c640 1 -- 172.21.15.98:0/2254789695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770106a80 msgr2=0x7ff770106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.116+0000 7ff775a9c640 1 --2- 172.21.15.98:0/2254789695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770106a80 0x7ff770106e60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff760009930 tx=0x7ff76002a420 comp rx=0 tx=0).stop 2024-09-19T07:21:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.116+0000 7ff775a9c640 1 -- 172.21.15.98:0/2254789695 shutdown_connections 2024-09-19T07:21:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.116+0000 7ff775a9c640 1 --2- 172.21.15.98:0/2254789695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff770101420 0x7ff77010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.116+0000 7ff775a9c640 1 --2- 172.21.15.98:0/2254789695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff770100a80 0x7ff770100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:03.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.116+0000 7ff775a9c640 1 --2- 172.21.15.98:0/2254789695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770106a80 0x7ff770106e60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:03.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.116+0000 7ff775a9c640 1 -- 172.21.15.98:0/2254789695 >> 172.21.15.98:0/2254789695 conn(0x7ff7700fc7a0 msgr2=0x7ff7700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:03.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.116+0000 7ff775a9c640 1 -- 172.21.15.98:0/2254789695 shutdown_connections 2024-09-19T07:21:03.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.116+0000 7ff775a9c640 1 -- 172.21.15.98:0/2254789695 wait complete. 2024-09-19T07:21:03.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.117+0000 7ff775a9c640 1 Processor -- start 2024-09-19T07:21:03.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.117+0000 7ff775a9c640 1 -- start start 2024-09-19T07:21:03.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.117+0000 7ff775a9c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770100a80 0x7ff770199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:03.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.117+0000 7ff775a9c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff770101420 0x7ff7701998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:03.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.117+0000 7ff775a9c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff770106a80 0x7ff7701a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:03.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.117+0000 7ff775a9c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff770110ea0 con 0x7ff770100a80 2024-09-19T07:21:03.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.117+0000 7ff775a9c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff770110d20 con 0x7ff770106a80 2024-09-19T07:21:03.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.117+0000 7ff775a9c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff770111020 con 0x7ff770101420 2024-09-19T07:21:03.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.117+0000 7ff76f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770100a80 0x7ff770199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:03.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.117+0000 7ff76f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770100a80 0x7ff770199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51298/0 (socket says 172.21.15.98:51298) 2024-09-19T07:21:03.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.117+0000 7ff76f7fe640 1 -- 172.21.15.98:0/1419179943 learned_addr learned my addr 172.21.15.98:0/1419179943 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:03.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff76f7fe640 1 -- 172.21.15.98:0/1419179943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff770101420 msgr2=0x7ff7701998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:03.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff767fff640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff770101420 0x7ff7701998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:03.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff76ffff640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff770106a80 0x7ff7701a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:03.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff76f7fe640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff770101420 0x7ff7701998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:03.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff76f7fe640 1 -- 172.21.15.98:0/1419179943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff770106a80 msgr2=0x7ff7701a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:03.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff76f7fe640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff770106a80 0x7ff7701a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:03.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff76f7fe640 1 -- 172.21.15.98:0/1419179943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7701a4930 con 0x7ff770100a80 2024-09-19T07:21:03.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff767fff640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff770101420 0x7ff7701998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:03.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff76ffff640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff770106a80 0x7ff7701a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:03.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff76f7fe640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770100a80 0x7ff770199370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff760009a50 tx=0x7ff760004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:03.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff76d7fa640 1 -- 172.21.15.98:0/1419179943 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76003f030 con 0x7ff770100a80 2024-09-19T07:21:03.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff76d7fa640 1 -- 172.21.15.98:0/1419179943 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff760003ce0 con 0x7ff770100a80 2024-09-19T07:21:03.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff76d7fa640 1 -- 172.21.15.98:0/1419179943 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760035070 con 0x7ff770100a80 2024-09-19T07:21:03.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff775a9c640 1 -- 172.21.15.98:0/1419179943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7701a4b00 con 0x7ff770100a80 2024-09-19T07:21:03.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.118+0000 7ff775a9c640 1 -- 172.21.15.98:0/1419179943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7701a4fb0 con 0x7ff770100a80 2024-09-19T07:21:03.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.119+0000 7ff775a9c640 1 -- 172.21.15.98:0/1419179943 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7700628c0 con 0x7ff770100a80 2024-09-19T07:21:03.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.120+0000 7ff76d7fa640 1 -- 172.21.15.98:0/1419179943 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff760042030 con 0x7ff770100a80 2024-09-19T07:21:03.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.121+0000 7ff76d7fa640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff75c0a3350 0x7ff75c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:03.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.121+0000 7ff767fff640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff75c0a3350 0x7ff75c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:03.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.121+0000 7ff76d7fa640 1 -- 172.21.15.98:0/1419179943 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff7600f0510 con 0x7ff770100a80 2024-09-19T07:21:03.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.121+0000 7ff76d7fa640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723] conn(0x7ff75c0aced0 0x7ff75c0af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:03.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.121+0000 7ff76d7fa640 1 -- 172.21.15.98:0/1419179943 --> [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff75c0afa40 con 0x7ff75c0aced0 2024-09-19T07:21:03.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.121+0000 7ff76d7fa640 1 -- 172.21.15.98:0/1419179943 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7ff7600f0960 con 0x7ff770100a80 2024-09-19T07:21:03.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.121+0000 7ff767fff640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff75c0a3350 0x7ff75c0a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff77006b2e0 tx=0x7ff758005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:03.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.121+0000 7ff76ffff640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723] conn(0x7ff75c0aced0 0x7ff75c0af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:03.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.122+0000 7ff76ffff640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723] conn(0x7ff75c0aced0 0x7ff75c0af370 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:03.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.123+0000 7ff76d7fa640 1 -- 172.21.15.98:0/1419179943 <== osd.11 v2:172.21.15.162:6824/3479073723 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff75c0afa40 con 0x7ff75c0aced0 2024-09-19T07:21:03.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.136+0000 7ff775a9c640 1 -- 172.21.15.98:0/1419179943 --> [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff770062d40 con 0x7ff75c0aced0 2024-09-19T07:21:03.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.137+0000 7ff76d7fa640 1 -- 172.21.15.98:0/1419179943 <== osd.11 v2:172.21.15.162:6824/3479073723 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff770062d40 con 0x7ff75c0aced0 2024-09-19T07:21:03.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.137+0000 7ff775a9c640 1 -- 172.21.15.98:0/1419179943 >> [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723] conn(0x7ff75c0aced0 msgr2=0x7ff75c0af370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:03.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.137+0000 7ff775a9c640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723] conn(0x7ff75c0aced0 0x7ff75c0af370 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:03.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.137+0000 7ff775a9c640 1 -- 172.21.15.98:0/1419179943 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff75c0a3350 msgr2=0x7ff75c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:03.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.137+0000 7ff775a9c640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff75c0a3350 0x7ff75c0a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff77006b2e0 tx=0x7ff758005d30 comp rx=0 tx=0).stop 2024-09-19T07:21:03.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.137+0000 7ff775a9c640 1 -- 172.21.15.98:0/1419179943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770100a80 msgr2=0x7ff770199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:03.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.137+0000 7ff775a9c640 1 --2- 172.21.15.98:0/1419179943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff770100a80 0x7ff770199370 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff760009a50 tx=0x7ff760004270 comp rx=0 tx=0).stop 2024-09-19T07:21:03.138 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.137+0000 7ff76ffff640 1 -- 172.21.15.98:0/1419179943 reap_dead start 2024-09-19T07:21:03.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.137+0000 7ff775a9c640 1 -- 172.21.15.98:0/1419179943 shutdown_connections 2024-09-19T07:21:03.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.137+0000 7ff775a9c640 1 -- 172.21.15.98:0/1419179943 >> 172.21.15.98:0/1419179943 conn(0x7ff7700fc7a0 msgr2=0x7ff7700fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:03.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.137+0000 7ff775a9c640 1 -- 172.21.15.98:0/1419179943 shutdown_connections 2024-09-19T07:21:03.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:03.137+0000 7ff775a9c640 1 -- 172.21.15.98:0/1419179943 wait complete. 2024-09-19T07:21:03.575 INFO:teuthology.orchestra.run.smithi098.stdout:176093659181 2024-09-19T07:21:03.575 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T07:21:03.876 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:03 smithi098 ceph-mon[30950]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:21:04.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:03 smithi139 ceph-mon[35039]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:21:04.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:03 smithi162 ceph-mon[35726]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:21:04.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.223+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/2214809553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5f4101de0 msgr2=0x7fe5f41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:04.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.223+0000 7fe5fbcc6640 1 --2- 172.21.15.98:0/2214809553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5f4101de0 0x7fe5f41021c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009900 tx=0x7fe5f002a410 comp rx=0 tx=0).stop 2024-09-19T07:21:04.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.223+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/2214809553 shutdown_connections 2024-09-19T07:21:04.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.223+0000 7fe5fbcc6640 1 --2- 172.21.15.98:0/2214809553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f4106f10 0x7fe5f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:04.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.223+0000 7fe5fbcc6640 1 --2- 172.21.15.98:0/2214809553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f4102790 0x7fe5f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.223+0000 7fe5fbcc6640 1 --2- 172.21.15.98:0/2214809553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5f4101de0 0x7fe5f41021c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.223+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/2214809553 >> 172.21.15.98:0/2214809553 conn(0x7fe5f40fd8c0 msgr2=0x7fe5f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.223+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/2214809553 shutdown_connections 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.223+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/2214809553 wait complete. 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.223+0000 7fe5fbcc6640 1 Processor -- start 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.223+0000 7fe5fbcc6640 1 -- start start 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fbcc6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f4101de0 0x7fe5f4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fbcc6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f4102790 0x7fe5f41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fbcc6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5f4106f10 0x7fe5f419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fbcc6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f4111f70 con 0x7fe5f4106f10 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fbcc6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f4111df0 con 0x7fe5f4102790 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fbcc6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f41120f0 con 0x7fe5f4101de0 2024-09-19T07:21:04.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fa263640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5f4106f10 0x7fe5f419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fa263640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5f4106f10 0x7fe5f419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51312/0 (socket says 172.21.15.98:51312) 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fa263640 1 -- 172.21.15.98:0/776466930 learned_addr learned my addr 172.21.15.98:0/776466930 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5f9a62640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f4101de0 0x7fe5f4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5f9261640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f4102790 0x7fe5f41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fa263640 1 -- 172.21.15.98:0/776466930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f4101de0 msgr2=0x7fe5f4198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fa263640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f4101de0 0x7fe5f4198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fa263640 1 -- 172.21.15.98:0/776466930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f4102790 msgr2=0x7fe5f41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fa263640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe5f4102790 0x7fe5f41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fa263640 1 -- 172.21.15.98:0/776466930 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f419d410 con 0x7fe5f4106f10 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fa263640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5f4106f10 0x7fe5f419cd30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00cad0 tx=0x7fe5ec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5e6ffd640 1 -- 172.21.15.98:0/776466930 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00ae20 con 0x7fe5f4106f10 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/776466930 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f419d700 con 0x7fe5f4106f10 2024-09-19T07:21:04.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5e6ffd640 1 -- 172.21.15.98:0/776466930 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5ec005020 con 0x7fe5f4106f10 2024-09-19T07:21:04.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5e6ffd640 1 -- 172.21.15.98:0/776466930 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00f6f0 con 0x7fe5f4106f10 2024-09-19T07:21:04.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.224+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/776466930 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f4074420 con 0x7fe5f4106f10 2024-09-19T07:21:04.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.225+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/776466930 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5f4062980 con 0x7fe5f4106f10 2024-09-19T07:21:04.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.227+0000 7fe5e6ffd640 1 -- 172.21.15.98:0/776466930 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe5ec0051d0 con 0x7fe5f4106f10 2024-09-19T07:21:04.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.227+0000 7fe5e6ffd640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe5e00a76e0 0x7fe5e00a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:04.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.227+0000 7fe5f9a62640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe5e00a76e0 0x7fe5e00a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:04.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.227+0000 7fe5e6ffd640 1 -- 172.21.15.98:0/776466930 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fe5ec0cfe00 con 0x7fe5f4106f10 2024-09-19T07:21:04.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.227+0000 7fe5e6ffd640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395] conn(0x7fe5e00b1390 0x7fe5e00b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:04.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.227+0000 7fe5e6ffd640 1 -- 172.21.15.98:0/776466930 --> [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5e00b3f00 con 0x7fe5e00b1390 2024-09-19T07:21:04.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.228+0000 7fe5e6ffd640 1 -- 172.21.15.98:0/776466930 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fe5ec0d0250 con 0x7fe5f4106f10 2024-09-19T07:21:04.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.228+0000 7fe5f9261640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395] conn(0x7fe5e00b1390 0x7fe5e00b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:04.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.228+0000 7fe5f9a62640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe5e00a76e0 0x7fe5e00a9ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0000c00 tx=0x7fe5f00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:04.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.228+0000 7fe5f9261640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395] conn(0x7fe5e00b1390 0x7fe5e00b3830 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:04.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.229+0000 7fe5e6ffd640 1 -- 172.21.15.98:0/776466930 <== osd.3 v2:172.21.15.98:6810/970037395 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe5e00b3f00 con 0x7fe5e00b1390 2024-09-19T07:21:04.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.242+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/776466930 --> [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe5f4062e00 con 0x7fe5e00b1390 2024-09-19T07:21:04.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.242+0000 7fe5e6ffd640 1 -- 172.21.15.98:0/776466930 <== osd.3 v2:172.21.15.98:6810/970037395 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe5f4062e00 con 0x7fe5e00b1390 2024-09-19T07:21:04.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.243+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395] conn(0x7fe5e00b1390 msgr2=0x7fe5e00b3830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:04.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.243+0000 7fe5fbcc6640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395] conn(0x7fe5e00b1390 0x7fe5e00b3830 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:04.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.243+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe5e00a76e0 msgr2=0x7fe5e00a9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:04.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.243+0000 7fe5fbcc6640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fe5e00a76e0 0x7fe5e00a9ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0000c00 tx=0x7fe5f00058d0 comp rx=0 tx=0).stop 2024-09-19T07:21:04.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.243+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5f4106f10 msgr2=0x7fe5f419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:04.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.243+0000 7fe5fbcc6640 1 --2- 172.21.15.98:0/776466930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5f4106f10 0x7fe5f419cd30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00cad0 tx=0x7fe5ec00cf90 comp rx=0 tx=0).stop 2024-09-19T07:21:04.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.243+0000 7fe5fa263640 1 -- 172.21.15.98:0/776466930 reap_dead start 2024-09-19T07:21:04.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.243+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/776466930 shutdown_connections 2024-09-19T07:21:04.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.243+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/776466930 >> 172.21.15.98:0/776466930 conn(0x7fe5f40fd8c0 msgr2=0x7fe5f40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:04.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.243+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/776466930 shutdown_connections 2024-09-19T07:21:04.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:04.243+0000 7fe5fbcc6640 1 -- 172.21.15.98:0/776466930 wait complete. 2024-09-19T07:21:04.928 INFO:teuthology.orchestra.run.smithi098.stdout:98784247868 2024-09-19T07:21:04.929 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T07:21:05.439 INFO:teuthology.orchestra.run.smithi098.stdout:197568495655 2024-09-19T07:21:05.439 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T07:21:05.493 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:05.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.673+0000 7f7f7a441640 1 -- 172.21.15.98:0/2465966316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f74102570 msgr2=0x7f7f741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:05.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.673+0000 7f7f7a441640 1 --2- 172.21.15.98:0/2465966316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f74102570 0x7f7f741029b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009900 tx=0x7f7f6802a480 comp rx=0 tx=0).stop 2024-09-19T07:21:05.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.673+0000 7f7f7a441640 1 -- 172.21.15.98:0/2465966316 shutdown_connections 2024-09-19T07:21:05.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.673+0000 7f7f7a441640 1 --2- 172.21.15.98:0/2465966316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f74102ef0 0x7f7f7410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:05.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.673+0000 7f7f7a441640 1 --2- 172.21.15.98:0/2465966316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f74102570 0x7f7f741029b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:05.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.673+0000 7f7f7a441640 1 --2- 172.21.15.98:0/2465966316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f74100e20 0x7f7f74101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:05.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.673+0000 7f7f7a441640 1 -- 172.21.15.98:0/2465966316 >> 172.21.15.98:0/2465966316 conn(0x7f7f740fc7d0 msgr2=0x7f7f740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:05.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.674+0000 7f7f7a441640 1 -- 172.21.15.98:0/2465966316 shutdown_connections 2024-09-19T07:21:05.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.674+0000 7f7f7a441640 1 -- 172.21.15.98:0/2465966316 wait complete. 2024-09-19T07:21:05.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.675+0000 7f7f7a441640 1 Processor -- start 2024-09-19T07:21:05.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.675+0000 7f7f7a441640 1 -- start start 2024-09-19T07:21:05.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f7a441640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f74100e20 0x7f7f741984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f7a441640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f74102570 0x7f7f741989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f7a441640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f74102ef0 0x7f7f7419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f7a441640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7f74112140 con 0x7f7f74100e20 2024-09-19T07:21:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f7a441640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7406ae40 con 0x7f7f74102570 2024-09-19T07:21:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f7a441640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741122c0 con 0x7f7f74102ef0 2024-09-19T07:21:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f73fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f74100e20 0x7f7f741984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f73fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f74100e20 0x7f7f741984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51330/0 (socket says 172.21.15.98:51330) 2024-09-19T07:21:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f73fff640 1 -- 172.21.15.98:0/407264247 learned_addr learned my addr 172.21.15.98:0/407264247 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f737fe640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f74102570 0x7f7f741989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:05.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f789de640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f74102ef0 0x7f7f7419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:05.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f73fff640 1 -- 172.21.15.98:0/407264247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f74102ef0 msgr2=0x7f7f7419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:05.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.676+0000 7f7f73fff640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f74102ef0 0x7f7f7419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:05.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.677+0000 7f7f73fff640 1 -- 172.21.15.98:0/407264247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f74102570 msgr2=0x7f7f741989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:05.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.677+0000 7f7f73fff640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f74102570 0x7f7f741989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.677+0000 7f7f73fff640 1 -- 172.21.15.98:0/407264247 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7419d460 con 0x7f7f74100e20 2024-09-19T07:21:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.677+0000 7f7f789de640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f74102ef0 0x7f7f7419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.677+0000 7f7f73fff640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f74100e20 0x7f7f741984b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009f20 tx=0x7f7f6400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.677+0000 7f7f717fa640 1 -- 172.21.15.98:0/407264247 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64020070 con 0x7f7f74100e20 2024-09-19T07:21:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.677+0000 7f7f7a441640 1 -- 172.21.15.98:0/407264247 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7419d750 con 0x7f7f74100e20 2024-09-19T07:21:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.677+0000 7f7f717fa640 1 -- 172.21.15.98:0/407264247 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f6400cd80 con 0x7f7f74100e20 2024-09-19T07:21:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.677+0000 7f7f717fa640 1 -- 172.21.15.98:0/407264247 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6401bbb0 con 0x7f7f74100e20 2024-09-19T07:21:05.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.677+0000 7f7f7a441640 1 -- 172.21.15.98:0/407264247 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7410ff30 con 0x7f7f74100e20 2024-09-19T07:21:05.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.679+0000 7f7f7a441640 1 -- 172.21.15.98:0/407264247 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f741072c0 con 0x7f7f74100e20 2024-09-19T07:21:05.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.680+0000 7f7f717fa640 1 -- 172.21.15.98:0/407264247 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7f64023070 con 0x7f7f74100e20 2024-09-19T07:21:05.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.681+0000 7f7f717fa640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7f5c0a3350 0x7f7f5c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:05.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.681+0000 7f7f717fa640 1 -- 172.21.15.98:0/407264247 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f7f640d4020 con 0x7f7f74100e20 2024-09-19T07:21:05.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.681+0000 7f7f717fa640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015] conn(0x7f7f5c0ad000 0x7f7f5c0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:05.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.681+0000 7f7f717fa640 1 -- 172.21.15.98:0/407264247 --> [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f5c0afb70 con 0x7f7f5c0ad000 2024-09-19T07:21:05.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.681+0000 7f7f717fa640 1 -- 172.21.15.98:0/407264247 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f7f640d4470 con 0x7f7f74100e20 2024-09-19T07:21:05.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.681+0000 7f7f737fe640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7f5c0a3350 0x7f7f5c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:05.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.681+0000 7f7f789de640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015] conn(0x7f7f5c0ad000 0x7f7f5c0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:05.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.682+0000 7f7f737fe640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7f5c0a3350 0x7f7f5c0a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009230 tx=0x7f7f680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:05.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.682+0000 7f7f789de640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015] conn(0x7f7f5c0ad000 0x7f7f5c0af4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:05.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.683+0000 7f7f717fa640 1 -- 172.21.15.98:0/407264247 <== osd.0 v2:172.21.15.98:6802/1895935015 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7f5c0afb70 con 0x7f7f5c0ad000 2024-09-19T07:21:05.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.702+0000 7f7f7a441640 1 -- 172.21.15.98:0/407264247 --> [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f741021b0 con 0x7f7f5c0ad000 2024-09-19T07:21:05.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.702+0000 7f7f717fa640 1 -- 172.21.15.98:0/407264247 <== osd.0 v2:172.21.15.98:6802/1895935015 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7f741021b0 con 0x7f7f5c0ad000 2024-09-19T07:21:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.703+0000 7f7f7a441640 1 -- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015] conn(0x7f7f5c0ad000 msgr2=0x7f7f5c0af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.703+0000 7f7f7a441640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015] conn(0x7f7f5c0ad000 0x7f7f5c0af4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.703+0000 7f7f7a441640 1 -- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7f5c0a3350 msgr2=0x7f7f5c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.703+0000 7f7f7a441640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7f5c0a3350 0x7f7f5c0a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7f68009230 tx=0x7f7f680058d0 comp rx=0 tx=0).stop 2024-09-19T07:21:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.703+0000 7f7f7a441640 1 -- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f74100e20 msgr2=0x7f7f741984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.703+0000 7f7f7a441640 1 --2- 172.21.15.98:0/407264247 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f74100e20 0x7f7f741984b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009f20 tx=0x7f7f6400ee80 comp rx=0 tx=0).stop 2024-09-19T07:21:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.703+0000 7f7f789de640 1 -- 172.21.15.98:0/407264247 reap_dead start 2024-09-19T07:21:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.703+0000 7f7f7a441640 1 -- 172.21.15.98:0/407264247 shutdown_connections 2024-09-19T07:21:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.703+0000 7f7f7a441640 1 -- 172.21.15.98:0/407264247 >> 172.21.15.98:0/407264247 conn(0x7f7f740fc7d0 msgr2=0x7f7f740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.703+0000 7f7f7a441640 1 -- 172.21.15.98:0/407264247 shutdown_connections 2024-09-19T07:21:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:05.703+0000 7f7f7a441640 1 -- 172.21.15.98:0/407264247 wait complete. 2024-09-19T07:21:05.934 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:05.950 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:05.955 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:05.959 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:05.960 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:05.979 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:06.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:05 smithi098 ceph-mon[30950]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:21:06.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:05 smithi139 ceph-mon[35039]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:21:06.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:05 smithi162 ceph-mon[35726]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T07:21:06.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.592+0000 7f0a30093640 1 -- 172.21.15.98:0/1077947229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a28100e20 msgr2=0x7f0a28101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.592+0000 7f0a30093640 1 --2- 172.21.15.98:0/1077947229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a28100e20 0x7f0a28101200 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009900 tx=0x7f0a2402a480 comp rx=0 tx=0).stop 2024-09-19T07:21:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.592+0000 7f0a30093640 1 -- 172.21.15.98:0/1077947229 shutdown_connections 2024-09-19T07:21:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.592+0000 7f0a30093640 1 --2- 172.21.15.98:0/1077947229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a28102ef0 0x7f0a2810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.592+0000 7f0a30093640 1 --2- 172.21.15.98:0/1077947229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a28102570 0x7f0a281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.592+0000 7f0a30093640 1 --2- 172.21.15.98:0/1077947229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a28100e20 0x7f0a28101200 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.592+0000 7f0a30093640 1 -- 172.21.15.98:0/1077947229 >> 172.21.15.98:0/1077947229 conn(0x7f0a280fc7d0 msgr2=0x7f0a280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.592+0000 7f0a30093640 1 -- 172.21.15.98:0/1077947229 shutdown_connections 2024-09-19T07:21:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.592+0000 7f0a30093640 1 -- 172.21.15.98:0/1077947229 wait complete. 2024-09-19T07:21:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a30093640 1 Processor -- start 2024-09-19T07:21:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a30093640 1 -- start start 2024-09-19T07:21:06.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a30093640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a28100e20 0x7f0a28198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a30093640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a28102570 0x7f0a28198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a30093640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a28102ef0 0x7f0a2819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a30093640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a28110fa0 con 0x7f0a28102ef0 2024-09-19T07:21:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a30093640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0a28110e20 con 0x7f0a28102570 2024-09-19T07:21:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a30093640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0a28111120 con 0x7f0a28100e20 2024-09-19T07:21:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a2e630640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a28102ef0 0x7f0a2819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a2e630640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a28102ef0 0x7f0a2819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51356/0 (socket says 172.21.15.98:51356) 2024-09-19T07:21:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a2e630640 1 -- 172.21.15.98:0/1598063558 learned_addr learned my addr 172.21.15.98:0/1598063558 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a2d62e640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a28102570 0x7f0a28198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a2de2f640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a28100e20 0x7f0a28198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a2e630640 1 -- 172.21.15.98:0/1598063558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a28100e20 msgr2=0x7f0a28198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:06.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a2e630640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a28100e20 0x7f0a28198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a2e630640 1 -- 172.21.15.98:0/1598063558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a28102570 msgr2=0x7f0a28198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.593+0000 7f0a2e630640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a28102570 0x7f0a28198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.594+0000 7f0a2e630640 1 -- 172.21.15.98:0/1598063558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2819d4c0 con 0x7f0a28102ef0 2024-09-19T07:21:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.594+0000 7f0a2de2f640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a28100e20 0x7f0a28198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.594+0000 7f0a2d62e640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a28102570 0x7f0a28198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.594+0000 7f0a2e630640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a28102ef0 0x7f0a2819cde0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000b970 tx=0x7f0a2000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.594+0000 7f0a1effd640 1 -- 172.21.15.98:0/1598063558 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20019070 con 0x7f0a28102ef0 2024-09-19T07:21:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.594+0000 7f0a30093640 1 -- 172.21.15.98:0/1598063558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2819d7b0 con 0x7f0a28102ef0 2024-09-19T07:21:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.594+0000 7f0a1effd640 1 -- 172.21.15.98:0/1598063558 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a2000cb40 con 0x7f0a28102ef0 2024-09-19T07:21:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.594+0000 7f0a1effd640 1 -- 172.21.15.98:0/1598063558 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20007610 con 0x7f0a28102ef0 2024-09-19T07:21:06.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.594+0000 7f0a30093640 1 -- 172.21.15.98:0/1598063558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a281a5090 con 0x7f0a28102ef0 2024-09-19T07:21:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.595+0000 7f0a30093640 1 -- 172.21.15.98:0/1598063558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a28101200 con 0x7f0a28102ef0 2024-09-19T07:21:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.597+0000 7f0a1effd640 1 -- 172.21.15.98:0/1598063558 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0a2001c070 con 0x7f0a28102ef0 2024-09-19T07:21:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.597+0000 7f0a1effd640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0a140a32d0 0x7f0a140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.598+0000 7f0a2de2f640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0a140a32d0 0x7f0a140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.598+0000 7f0a1effd640 1 -- 172.21.15.98:0/1598063558 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0a200cf4a0 con 0x7f0a28102ef0 2024-09-19T07:21:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.598+0000 7f0a2de2f640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0a140a32d0 0x7f0a140a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a24000c00 tx=0x7f0a240041e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:06.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.601+0000 7f0a1effd640 1 -- 172.21.15.98:0/1598063558 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a2009c150 con 0x7f0a28102ef0 2024-09-19T07:21:06.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.780+0000 7f0a30093640 1 -- 172.21.15.98:0/1598063558 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0a2810a0a0 con 0x7f0a28102ef0 2024-09-19T07:21:06.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.780+0000 7f0a1effd640 1 -- 172.21.15.98:0/1598063558 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a2009ba50 con 0x7f0a28102ef0 2024-09-19T07:21:06.781 INFO:teuthology.orchestra.run.smithi098.stdout:98784247869 2024-09-19T07:21:06.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.782+0000 7f0a30093640 1 -- 172.21.15.98:0/1598063558 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0a140a32d0 msgr2=0x7f0a140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:06.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.782+0000 7f0a30093640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0a140a32d0 0x7f0a140a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a24000c00 tx=0x7f0a240041e0 comp rx=0 tx=0).stop 2024-09-19T07:21:06.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.782+0000 7f0a30093640 1 -- 172.21.15.98:0/1598063558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a28102ef0 msgr2=0x7f0a2819cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:06.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.782+0000 7f0a30093640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a28102ef0 0x7f0a2819cde0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000b970 tx=0x7f0a2000be30 comp rx=0 tx=0).stop 2024-09-19T07:21:06.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.782+0000 7f0a30093640 1 -- 172.21.15.98:0/1598063558 shutdown_connections 2024-09-19T07:21:06.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.782+0000 7f0a30093640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0a140a32d0 0x7f0a140a5790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:06.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.782+0000 7f0a30093640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a28102ef0 0x7f0a2819cde0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:06.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.782+0000 7f0a30093640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0a28102570 0x7f0a28198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:06.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.782+0000 7f0a30093640 1 --2- 172.21.15.98:0/1598063558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a28100e20 0x7f0a28198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:06.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.782+0000 7f0a30093640 1 -- 172.21.15.98:0/1598063558 >> 172.21.15.98:0/1598063558 conn(0x7f0a280fc7d0 msgr2=0x7f0a2806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:06.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.783+0000 7f0a30093640 1 -- 172.21.15.98:0/1598063558 shutdown_connections 2024-09-19T07:21:06.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:06.783+0000 7f0a30093640 1 -- 172.21.15.98:0/1598063558 wait complete. 2024-09-19T07:21:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.341+0000 7f703dde2640 1 -- 172.21.15.98:0/704103424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f703810c170 msgr2=0x7f703810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.341+0000 7f703dde2640 1 --2- 172.21.15.98:0/704103424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f703810c170 0x7f703810e610 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7030009ca0 tx=0x7f703002a950 comp rx=0 tx=0).stop 2024-09-19T07:21:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.341+0000 7f703dde2640 1 -- 172.21.15.98:0/704103424 shutdown_connections 2024-09-19T07:21:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.341+0000 7f703dde2640 1 --2- 172.21.15.98:0/704103424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f703810c170 0x7f703810e610 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.341+0000 7f703dde2640 1 --2- 172.21.15.98:0/704103424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7038103660 0x7f703810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.341+0000 7f703dde2640 1 --2- 172.21.15.98:0/704103424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7038102d40 0x7f7038103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.341+0000 7f703dde2640 1 -- 172.21.15.98:0/704103424 >> 172.21.15.98:0/704103424 conn(0x7f70380fc7a0 msgr2=0x7f70380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.341+0000 7f703dde2640 1 -- 172.21.15.98:0/704103424 shutdown_connections 2024-09-19T07:21:07.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.341+0000 7f703dde2640 1 -- 172.21.15.98:0/704103424 wait complete. 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f703dde2640 1 Processor -- start 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f703dde2640 1 -- start start 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f703dde2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7038102d40 0x7f70381984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f703dde2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7038103660 0x7f7038198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f703dde2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f703810c170 0x7f703819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f703dde2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7038111fb0 con 0x7f703810c170 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f703dde2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7038111e30 con 0x7f7038102d40 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f703dde2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7038112130 con 0x7f7038103660 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f7037fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f703810c170 0x7f703819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f7037fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f703810c170 0x7f703819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51368/0 (socket says 172.21.15.98:51368) 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f7037fff640 1 -- 172.21.15.98:0/3709298910 learned_addr learned my addr 172.21.15.98:0/3709298910 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f70377fe640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7038102d40 0x7f70381984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:07.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f7037fff640 1 -- 172.21.15.98:0/3709298910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7038103660 msgr2=0x7f7038198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f702ffff640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7038103660 0x7f7038198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f7037fff640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7038103660 0x7f7038198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f7037fff640 1 -- 172.21.15.98:0/3709298910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7038102d40 msgr2=0x7f70381984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f7037fff640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7038102d40 0x7f70381984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f7037fff640 1 -- 172.21.15.98:0/3709298910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703819d490 con 0x7f703810c170 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.342+0000 7f70377fe640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7038102d40 0x7f70381984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.343+0000 7f7037fff640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f703810c170 0x7f703819cdb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7030006010 tx=0x7f703002f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.343+0000 7f70357fa640 1 -- 172.21.15.98:0/3709298910 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030034040 con 0x7f703810c170 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.343+0000 7f703dde2640 1 -- 172.21.15.98:0/3709298910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703819d720 con 0x7f703810c170 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.343+0000 7f70357fa640 1 -- 172.21.15.98:0/3709298910 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7030003e00 con 0x7f703810c170 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.343+0000 7f70357fa640 1 -- 172.21.15.98:0/3709298910 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70300456e0 con 0x7f703810c170 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.343+0000 7f703dde2640 1 -- 172.21.15.98:0/3709298910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70381a5060 con 0x7f703810c170 2024-09-19T07:21:07.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.344+0000 7f703dde2640 1 -- 172.21.15.98:0/3709298910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f703806b070 con 0x7f703810c170 2024-09-19T07:21:07.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.345+0000 7f70357fa640 1 -- 172.21.15.98:0/3709298910 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7030037020 con 0x7f703810c170 2024-09-19T07:21:07.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.346+0000 7f70357fa640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f70240a32d0 0x7f70240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:07.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.346+0000 7f70377fe640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f70240a32d0 0x7f70240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:07.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.346+0000 7f70357fa640 1 -- 172.21.15.98:0/3709298910 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f70300f0b20 con 0x7f703810c170 2024-09-19T07:21:07.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.346+0000 7f70377fe640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f70240a32d0 0x7f70240a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f70280058c0 tx=0x7f7028005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:07.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.350+0000 7f70357fa640 1 -- 172.21.15.98:0/3709298910 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f70300bd7d0 con 0x7f703810c170 2024-09-19T07:21:07.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.521+0000 7f703dde2640 1 -- 172.21.15.98:0/3709298910 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7038107210 con 0x7f703810c170 2024-09-19T07:21:07.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.521+0000 7f70357fa640 1 -- 172.21.15.98:0/3709298910 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f70300bd0d0 con 0x7f703810c170 2024-09-19T07:21:07.522 INFO:teuthology.orchestra.run.smithi098.stdout:51539607623 2024-09-19T07:21:07.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.523+0000 7f703dde2640 1 -- 172.21.15.98:0/3709298910 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f70240a32d0 msgr2=0x7f70240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.523+0000 7f703dde2640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f70240a32d0 0x7f70240a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f70280058c0 tx=0x7f7028005ec0 comp rx=0 tx=0).stop 2024-09-19T07:21:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.523+0000 7f703dde2640 1 -- 172.21.15.98:0/3709298910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f703810c170 msgr2=0x7f703819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.523+0000 7f703dde2640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f703810c170 0x7f703819cdb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7030006010 tx=0x7f703002f710 comp rx=0 tx=0).stop 2024-09-19T07:21:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.523+0000 7f703dde2640 1 -- 172.21.15.98:0/3709298910 shutdown_connections 2024-09-19T07:21:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.523+0000 7f703dde2640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f70240a32d0 0x7f70240a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.523+0000 7f703dde2640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f703810c170 0x7f703819cdb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.523+0000 7f703dde2640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7038103660 0x7f7038198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.523+0000 7f703dde2640 1 --2- 172.21.15.98:0/3709298910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7038102d40 0x7f70381984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.523+0000 7f703dde2640 1 -- 172.21.15.98:0/3709298910 >> 172.21.15.98:0/3709298910 conn(0x7f70380fc7a0 msgr2=0x7f70380fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.523+0000 7f703dde2640 1 -- 172.21.15.98:0/3709298910 shutdown_connections 2024-09-19T07:21:07.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:07.523+0000 7f703dde2640 1 -- 172.21.15.98:0/3709298910 wait complete. 2024-09-19T07:21:07.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:07 smithi098 ceph-mon[30950]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:07.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:07 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1598063558' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T07:21:07.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:07 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3709298910' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T07:21:07.783 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247868 got 98784247869 for osd.3 2024-09-19T07:21:07.784 DEBUG:teuthology.parallel:result is None 2024-09-19T07:21:08.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:07 smithi139 ceph-mon[35039]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:07 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1598063558' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T07:21:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:07 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3709298910' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T07:21:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:07 smithi162 ceph-mon[35726]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:07 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1598063558' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T07:21:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:07 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3709298910' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T07:21:08.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.183+0000 7f13a9631640 1 -- 172.21.15.98:0/2626119086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13a4101420 msgr2=0x7f13a410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:08.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.183+0000 7f13a9631640 1 --2- 172.21.15.98:0/2626119086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13a4101420 0x7f13a410d950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f139c009cd0 tx=0x7f139c02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:21:08.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.183+0000 7f13a9631640 1 -- 172.21.15.98:0/2626119086 shutdown_connections 2024-09-19T07:21:08.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.183+0000 7f13a9631640 1 --2- 172.21.15.98:0/2626119086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13a4101420 0x7f13a410d950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:08.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.183+0000 7f13a9631640 1 --2- 172.21.15.98:0/2626119086 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13a4100a80 0x7f13a4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:08.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.183+0000 7f13a9631640 1 --2- 172.21.15.98:0/2626119086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13a4106a80 0x7f13a4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:08.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.183+0000 7f13a9631640 1 -- 172.21.15.98:0/2626119086 >> 172.21.15.98:0/2626119086 conn(0x7f13a40fc7a0 msgr2=0x7f13a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:08.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.184+0000 7f13a9631640 1 -- 172.21.15.98:0/2626119086 shutdown_connections 2024-09-19T07:21:08.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.184+0000 7f13a9631640 1 -- 172.21.15.98:0/2626119086 wait complete. 2024-09-19T07:21:08.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.184+0000 7f13a9631640 1 Processor -- start 2024-09-19T07:21:08.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.184+0000 7f13a9631640 1 -- start start 2024-09-19T07:21:08.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.184+0000 7f13a9631640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13a4100a80 0x7f13a41993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:08.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.184+0000 7f13a9631640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13a4101420 0x7f13a4199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.184+0000 7f13a9631640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13a4106a80 0x7f13a41a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.184+0000 7f13a9631640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f13a4110f20 con 0x7f13a4106a80 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.184+0000 7f13a9631640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f13a4110da0 con 0x7f13a4101420 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.184+0000 7f13a9631640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f13a41110a0 con 0x7f13a4100a80 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13a4106a80 0x7f13a41a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13a4106a80 0x7f13a41a4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51390/0 (socket says 172.21.15.98:51390) 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a37fe640 1 -- 172.21.15.98:0/1691997275 learned_addr learned my addr 172.21.15.98:0/1691997275 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f139bfff640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13a4101420 0x7f13a4199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a2ffd640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13a4100a80 0x7f13a41993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a37fe640 1 -- 172.21.15.98:0/1691997275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13a4100a80 msgr2=0x7f13a41993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a37fe640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13a4100a80 0x7f13a41993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a37fe640 1 -- 172.21.15.98:0/1691997275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13a4101420 msgr2=0x7f13a4199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:08.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a37fe640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13a4101420 0x7f13a4199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:08.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a37fe640 1 -- 172.21.15.98:0/1691997275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a41a49b0 con 0x7f13a4106a80 2024-09-19T07:21:08.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a37fe640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13a4106a80 0x7f13a41a4470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f139c006010 tx=0x7f139c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:08.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a0ff9640 1 -- 172.21.15.98:0/1691997275 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c004450 con 0x7f13a4106a80 2024-09-19T07:21:08.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a9631640 1 -- 172.21.15.98:0/1691997275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a41a4b80 con 0x7f13a4106a80 2024-09-19T07:21:08.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a0ff9640 1 -- 172.21.15.98:0/1691997275 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f139c003e10 con 0x7f13a4106a80 2024-09-19T07:21:08.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a0ff9640 1 -- 172.21.15.98:0/1691997275 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c046480 con 0x7f13a4106a80 2024-09-19T07:21:08.188 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.185+0000 7f13a9631640 1 -- 172.21.15.98:0/1691997275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a41a5060 con 0x7f13a4106a80 2024-09-19T07:21:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.187+0000 7f13a9631640 1 -- 172.21.15.98:0/1691997275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a41021c0 con 0x7f13a4106a80 2024-09-19T07:21:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.188+0000 7f13a0ff9640 1 -- 172.21.15.98:0/1691997275 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f139c0045f0 con 0x7f13a4106a80 2024-09-19T07:21:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.188+0000 7f13a0ff9640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f13900a32d0 0x7f13900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.188+0000 7f13a2ffd640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f13900a32d0 0x7f13900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.188+0000 7f13a0ff9640 1 -- 172.21.15.98:0/1691997275 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f139c02e030 con 0x7f13a4106a80 2024-09-19T07:21:08.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.189+0000 7f13a2ffd640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f13900a32d0 0x7f13900a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1394009990 tx=0x7f1394009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:08.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.194+0000 7f13a0ff9640 1 -- 172.21.15.98:0/1691997275 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f139c04b060 con 0x7f13a4106a80 2024-09-19T07:21:08.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.365+0000 7f13a9631640 1 -- 172.21.15.98:0/1691997275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f13a4109010 con 0x7f13a4106a80 2024-09-19T07:21:08.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.365+0000 7f13a0ff9640 1 -- 172.21.15.98:0/1691997275 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f139c0b9030 con 0x7f13a4106a80 2024-09-19T07:21:08.366 INFO:teuthology.orchestra.run.smithi098.stdout:73014444098 2024-09-19T07:21:08.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.367+0000 7f13a9631640 1 -- 172.21.15.98:0/1691997275 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f13900a32d0 msgr2=0x7f13900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:08.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.367+0000 7f13a9631640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f13900a32d0 0x7f13900a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1394009990 tx=0x7f1394009110 comp rx=0 tx=0).stop 2024-09-19T07:21:08.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.367+0000 7f13a9631640 1 -- 172.21.15.98:0/1691997275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13a4106a80 msgr2=0x7f13a41a4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:08.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.367+0000 7f13a9631640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13a4106a80 0x7f13a41a4470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f139c006010 tx=0x7f139c003c20 comp rx=0 tx=0).stop 2024-09-19T07:21:08.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.367+0000 7f13a9631640 1 -- 172.21.15.98:0/1691997275 shutdown_connections 2024-09-19T07:21:08.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.367+0000 7f13a9631640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f13900a32d0 0x7f13900a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:08.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.367+0000 7f13a9631640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f13a4106a80 0x7f13a41a4470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:08.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.367+0000 7f13a9631640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13a4101420 0x7f13a4199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:08.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.367+0000 7f13a9631640 1 --2- 172.21.15.98:0/1691997275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13a4100a80 0x7f13a41993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:08.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.368+0000 7f13a9631640 1 -- 172.21.15.98:0/1691997275 >> 172.21.15.98:0/1691997275 conn(0x7f13a40fc7a0 msgr2=0x7f13a40fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:08.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.368+0000 7f13a9631640 1 -- 172.21.15.98:0/1691997275 shutdown_connections 2024-09-19T07:21:08.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:08.368+0000 7f13a9631640 1 -- 172.21.15.98:0/1691997275 wait complete. 2024-09-19T07:21:08.650 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607621 got 51539607623 for osd.1 2024-09-19T07:21:08.651 DEBUG:teuthology.parallel:result is None 2024-09-19T07:21:08.879 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:08 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1691997275' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T07:21:09.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:08 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1691997275' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T07:21:09.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:08 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1691997275' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T07:21:09.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.231+0000 7f1c172f5640 1 -- 172.21.15.98:0/2818392465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c10101420 msgr2=0x7f1c1010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:09.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.231+0000 7f1c172f5640 1 --2- 172.21.15.98:0/2818392465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c10101420 0x7f1c1010d950 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1c08009cd0 tx=0x7f1c0802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.231+0000 7f1c172f5640 1 -- 172.21.15.98:0/2818392465 shutdown_connections 2024-09-19T07:21:09.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.231+0000 7f1c172f5640 1 --2- 172.21.15.98:0/2818392465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c10101420 0x7f1c1010d950 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.231+0000 7f1c172f5640 1 --2- 172.21.15.98:0/2818392465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c10100a80 0x7f1c10100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.231+0000 7f1c172f5640 1 --2- 172.21.15.98:0/2818392465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c10106a80 0x7f1c10106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.231+0000 7f1c172f5640 1 -- 172.21.15.98:0/2818392465 >> 172.21.15.98:0/2818392465 conn(0x7f1c100fc7a0 msgr2=0x7f1c100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:09.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.231+0000 7f1c172f5640 1 -- 172.21.15.98:0/2818392465 shutdown_connections 2024-09-19T07:21:09.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.231+0000 7f1c172f5640 1 -- 172.21.15.98:0/2818392465 wait complete. 2024-09-19T07:21:09.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c172f5640 1 Processor -- start 2024-09-19T07:21:09.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c172f5640 1 -- start start 2024-09-19T07:21:09.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c172f5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c10100a80 0x7f1c10199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:09.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c172f5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c10101420 0x7f1c101997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:09.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c172f5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c10106a80 0x7f1c101a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:09.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c172f5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10110e80 con 0x7f1c10100a80 2024-09-19T07:21:09.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c172f5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10110d00 con 0x7f1c10106a80 2024-09-19T07:21:09.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c172f5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10111000 con 0x7f1c10101420 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c15091640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c10100a80 0x7f1c10199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c15091640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c10100a80 0x7f1c10199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51402/0 (socket says 172.21.15.98:51402) 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c15091640 1 -- 172.21.15.98:0/642401813 learned_addr learned my addr 172.21.15.98:0/642401813 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c15892640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c10106a80 0x7f1c101a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.232+0000 7f1c14890640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c10101420 0x7f1c101997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.233+0000 7f1c15091640 1 -- 172.21.15.98:0/642401813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c10101420 msgr2=0x7f1c101997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.233+0000 7f1c15091640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c10101420 0x7f1c101997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.233+0000 7f1c15091640 1 -- 172.21.15.98:0/642401813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c10106a80 msgr2=0x7f1c101a4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.233+0000 7f1c15091640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c10106a80 0x7f1c101a4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.233+0000 7f1c15091640 1 -- 172.21.15.98:0/642401813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c101a4850 con 0x7f1c10100a80 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.233+0000 7f1c15091640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c10100a80 0x7f1c10199290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00d950 tx=0x7f1c0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.233+0000 7f1c067fc640 1 -- 172.21.15.98:0/642401813 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c017070 con 0x7f1c10100a80 2024-09-19T07:21:09.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.233+0000 7f1c067fc640 1 -- 172.21.15.98:0/642401813 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c0c009c30 con 0x7f1c10100a80 2024-09-19T07:21:09.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.233+0000 7f1c172f5640 1 -- 172.21.15.98:0/642401813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c101a4a20 con 0x7f1c10100a80 2024-09-19T07:21:09.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.233+0000 7f1c067fc640 1 -- 172.21.15.98:0/642401813 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00f6b0 con 0x7f1c10100a80 2024-09-19T07:21:09.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.233+0000 7f1c172f5640 1 -- 172.21.15.98:0/642401813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c101a4f30 con 0x7f1c10100a80 2024-09-19T07:21:09.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.234+0000 7f1c172f5640 1 -- 172.21.15.98:0/642401813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c10100ee0 con 0x7f1c10100a80 2024-09-19T07:21:09.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.235+0000 7f1c067fc640 1 -- 172.21.15.98:0/642401813 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1c0c0109d0 con 0x7f1c10100a80 2024-09-19T07:21:09.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.236+0000 7f1c067fc640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1bfc0a32d0 0x7f1bfc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:09.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.236+0000 7f1c14890640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1bfc0a32d0 0x7f1bfc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:09.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.236+0000 7f1c067fc640 1 -- 172.21.15.98:0/642401813 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f1c0c0cf5a0 con 0x7f1c10100a80 2024-09-19T07:21:09.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.236+0000 7f1c14890640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1bfc0a32d0 0x7f1bfc0a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c1006b2e0 tx=0x7f1c0000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:09.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.239+0000 7f1c067fc640 1 -- 172.21.15.98:0/642401813 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c0c009de0 con 0x7f1c10100a80 2024-09-19T07:21:09.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.410+0000 7f1c172f5640 1 -- 172.21.15.98:0/642401813 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1c101a5190 con 0x7f1c10100a80 2024-09-19T07:21:09.411 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.410+0000 7f1c067fc640 1 -- 172.21.15.98:0/642401813 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1c0c09baf0 con 0x7f1c10100a80 2024-09-19T07:21:09.411 INFO:teuthology.orchestra.run.smithi098.stdout:128849018936 2024-09-19T07:21:09.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.413+0000 7f1c172f5640 1 -- 172.21.15.98:0/642401813 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1bfc0a32d0 msgr2=0x7f1bfc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:09.413 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.413+0000 7f1c172f5640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1bfc0a32d0 0x7f1bfc0a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c1006b2e0 tx=0x7f1c0000a250 comp rx=0 tx=0).stop 2024-09-19T07:21:09.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.413+0000 7f1c172f5640 1 -- 172.21.15.98:0/642401813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c10100a80 msgr2=0x7f1c10199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:09.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.413+0000 7f1c172f5640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c10100a80 0x7f1c10199290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c00d950 tx=0x7f1c0c00de10 comp rx=0 tx=0).stop 2024-09-19T07:21:09.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.413+0000 7f1c172f5640 1 -- 172.21.15.98:0/642401813 shutdown_connections 2024-09-19T07:21:09.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.413+0000 7f1c172f5640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f1bfc0a32d0 0x7f1bfc0a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.413+0000 7f1c172f5640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c10106a80 0x7f1c101a4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.413+0000 7f1c172f5640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c10101420 0x7f1c101997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.413+0000 7f1c172f5640 1 --2- 172.21.15.98:0/642401813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c10100a80 0x7f1c10199290 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.413+0000 7f1c172f5640 1 -- 172.21.15.98:0/642401813 >> 172.21.15.98:0/642401813 conn(0x7f1c100fc7a0 msgr2=0x7f1c100fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:09.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.413+0000 7f1c172f5640 1 -- 172.21.15.98:0/642401813 shutdown_connections 2024-09-19T07:21:09.414 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.413+0000 7f1c172f5640 1 -- 172.21.15.98:0/642401813 wait complete. 2024-09-19T07:21:09.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.434+0000 7fb3a7635640 1 -- 172.21.15.98:0/1727169184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3a0103660 msgr2=0x7fb3a010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:09.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.434+0000 7fb3a7635640 1 --2- 172.21.15.98:0/1727169184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3a0103660 0x7fb3a010bb50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb390009900 tx=0x7fb39002a480 comp rx=0 tx=0).stop 2024-09-19T07:21:09.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.434+0000 7fb3a7635640 1 -- 172.21.15.98:0/1727169184 shutdown_connections 2024-09-19T07:21:09.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.434+0000 7fb3a7635640 1 --2- 172.21.15.98:0/1727169184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3a010c170 0x7fb3a010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.434+0000 7fb3a7635640 1 --2- 172.21.15.98:0/1727169184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3a0103660 0x7fb3a010bb50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.434+0000 7fb3a7635640 1 --2- 172.21.15.98:0/1727169184 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a0102d40 0x7fb3a0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.434+0000 7fb3a7635640 1 -- 172.21.15.98:0/1727169184 >> 172.21.15.98:0/1727169184 conn(0x7fb3a00fc7a0 msgr2=0x7fb3a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:09.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.434+0000 7fb3a7635640 1 -- 172.21.15.98:0/1727169184 shutdown_connections 2024-09-19T07:21:09.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.434+0000 7fb3a7635640 1 -- 172.21.15.98:0/1727169184 wait complete. 2024-09-19T07:21:09.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.435+0000 7fb3a7635640 1 Processor -- start 2024-09-19T07:21:09.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.435+0000 7fb3a7635640 1 -- start start 2024-09-19T07:21:09.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.435+0000 7fb3a7635640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a0102d40 0x7fb3a01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:09.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.435+0000 7fb3a7635640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3a0103660 0x7fb3a0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:09.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.435+0000 7fb3a7635640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3a010c170 0x7fb3a0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:09.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.435+0000 7fb3a7635640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a0111f70 con 0x7fb3a0103660 2024-09-19T07:21:09.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.435+0000 7fb3a7635640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a0111df0 con 0x7fb3a0102d40 2024-09-19T07:21:09.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.435+0000 7fb3a7635640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a01120f0 con 0x7fb3a010c170 2024-09-19T07:21:09.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.435+0000 7fb3a4bd0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3a0103660 0x7fb3a0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:09.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.435+0000 7fb3a4bd0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3a0103660 0x7fb3a0100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51414/0 (socket says 172.21.15.98:51414) 2024-09-19T07:21:09.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.435+0000 7fb3a4bd0640 1 -- 172.21.15.98:0/2064171437 learned_addr learned my addr 172.21.15.98:0/2064171437 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:09.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3a5bd2640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3a010c170 0x7fb3a0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:09.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3a53d1640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a0102d40 0x7fb3a01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3a4bd0640 1 -- 172.21.15.98:0/2064171437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3a010c170 msgr2=0x7fb3a0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3a4bd0640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3a010c170 0x7fb3a0101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3a4bd0640 1 -- 172.21.15.98:0/2064171437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a0102d40 msgr2=0x7fb3a01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3a4bd0640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a0102d40 0x7fb3a01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3a4bd0640 1 -- 172.21.15.98:0/2064171437 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a01a68f0 con 0x7fb3a0103660 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3a53d1640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb3a0102d40 0x7fb3a01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3a4bd0640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3a0103660 0x7fb3a0100ee0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb390006010 tx=0x7fb3900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3967fc640 1 -- 172.21.15.98:0/2064171437 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39003f030 con 0x7fb3a0103660 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3967fc640 1 -- 172.21.15.98:0/2064171437 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb390003ce0 con 0x7fb3a0103660 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3a7635640 1 -- 172.21.15.98:0/2064171437 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a01a6b80 con 0x7fb3a0103660 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.436+0000 7fb3967fc640 1 -- 172.21.15.98:0/2064171437 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb390035070 con 0x7fb3a0103660 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.437+0000 7fb3a7635640 1 -- 172.21.15.98:0/2064171437 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a01a70b0 con 0x7fb3a0103660 2024-09-19T07:21:09.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.438+0000 7fb3a7635640 1 -- 172.21.15.98:0/2064171437 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb3a00628c0 con 0x7fb3a0103660 2024-09-19T07:21:09.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.439+0000 7fb3967fc640 1 -- 172.21.15.98:0/2064171437 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb390042030 con 0x7fb3a0103660 2024-09-19T07:21:09.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.440+0000 7fb3967fc640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb38c0a3350 0x7fb38c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:09.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.440+0000 7fb3a53d1640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb38c0a3350 0x7fb38c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:09.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.440+0000 7fb3967fc640 1 -- 172.21.15.98:0/2064171437 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb3900f06b0 con 0x7fb3a0103660 2024-09-19T07:21:09.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.441+0000 7fb3967fc640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188] conn(0x7fb38c0ad000 0x7fb38c0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:09.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.441+0000 7fb3967fc640 1 -- 172.21.15.98:0/2064171437 --> [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb38c0afb70 con 0x7fb38c0ad000 2024-09-19T07:21:09.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.441+0000 7fb3a53d1640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb38c0a3350 0x7fb38c0a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0058c0 tx=0x7fb39c005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:09.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.441+0000 7fb3967fc640 1 -- 172.21.15.98:0/2064171437 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fb3900f0b00 con 0x7fb3a0103660 2024-09-19T07:21:09.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.441+0000 7fb3a5bd2640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188] conn(0x7fb38c0ad000 0x7fb38c0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:09.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.442+0000 7fb3a5bd2640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188] conn(0x7fb38c0ad000 0x7fb38c0af4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:09.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.443+0000 7fb3967fc640 1 -- 172.21.15.98:0/2064171437 <== osd.8 v2:172.21.15.162:6816/81102188 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb38c0afb70 con 0x7fb38c0ad000 2024-09-19T07:21:09.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.456+0000 7fb3a7635640 1 -- 172.21.15.98:0/2064171437 --> [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb3a0062cc0 con 0x7fb38c0ad000 2024-09-19T07:21:09.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.457+0000 7fb3967fc640 1 -- 172.21.15.98:0/2064171437 <== osd.8 v2:172.21.15.162:6816/81102188 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb3a0062cc0 con 0x7fb38c0ad000 2024-09-19T07:21:09.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.457+0000 7fb3a7635640 1 -- 172.21.15.98:0/2064171437 >> [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188] conn(0x7fb38c0ad000 msgr2=0x7fb38c0af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:09.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.457+0000 7fb3a7635640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188] conn(0x7fb38c0ad000 0x7fb38c0af4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.457+0000 7fb3a7635640 1 -- 172.21.15.98:0/2064171437 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb38c0a3350 msgr2=0x7fb38c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:09.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.457+0000 7fb3a7635640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb38c0a3350 0x7fb38c0a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb39c0058c0 tx=0x7fb39c005ec0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.457+0000 7fb3a7635640 1 -- 172.21.15.98:0/2064171437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3a0103660 msgr2=0x7fb3a0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:09.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.457+0000 7fb3a7635640 1 --2- 172.21.15.98:0/2064171437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3a0103660 0x7fb3a0100ee0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb390006010 tx=0x7fb3900042f0 comp rx=0 tx=0).stop 2024-09-19T07:21:09.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.457+0000 7fb3a5bd2640 1 -- 172.21.15.98:0/2064171437 reap_dead start 2024-09-19T07:21:09.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.457+0000 7fb3a7635640 1 -- 172.21.15.98:0/2064171437 shutdown_connections 2024-09-19T07:21:09.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.457+0000 7fb3a7635640 1 -- 172.21.15.98:0/2064171437 >> 172.21.15.98:0/2064171437 conn(0x7fb3a00fc7a0 msgr2=0x7fb3a00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:09.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.457+0000 7fb3a7635640 1 -- 172.21.15.98:0/2064171437 shutdown_connections 2024-09-19T07:21:09.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:09.457+0000 7fb3a7635640 1 -- 172.21.15.98:0/2064171437 wait complete. 2024-09-19T07:21:09.968 INFO:teuthology.orchestra.run.smithi098.stdout:309237645333 2024-09-19T07:21:09.968 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T07:21:09.993 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:09 smithi098 ceph-mon[30950]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-19T07:21:09.993 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:09 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/642401813' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T07:21:10.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:09 smithi139 ceph-mon[35039]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-19T07:21:10.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:09 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/642401813' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T07:21:10.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:09 smithi162 ceph-mon[35726]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-19T07:21:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:09 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/642401813' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T07:21:10.585 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018933 got 128849018936 for osd.4 2024-09-19T07:21:10.585 DEBUG:teuthology.parallel:result is None 2024-09-19T07:21:11.252 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:11.287 INFO:teuthology.orchestra.run.smithi098.stdout:34359738445 2024-09-19T07:21:11.287 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T07:21:11.795 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:11 smithi098 ceph-mon[30950]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:12.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:11 smithi139 ceph-mon[35039]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:12.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:11 smithi162 ceph-mon[35726]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:12.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.152+0000 7f5cc9047640 1 -- 172.21.15.98:0/1202139524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cc4101de0 msgr2=0x7f5cc41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.152+0000 7f5cc9047640 1 --2- 172.21.15.98:0/1202139524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cc4101de0 0x7f5cc41021c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4009900 tx=0x7f5cb402a410 comp rx=0 tx=0).stop 2024-09-19T07:21:12.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.152+0000 7f5cc9047640 1 -- 172.21.15.98:0/1202139524 shutdown_connections 2024-09-19T07:21:12.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.152+0000 7f5cc9047640 1 --2- 172.21.15.98:0/1202139524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cc4106f10 0x7f5cc410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.152+0000 7f5cc9047640 1 --2- 172.21.15.98:0/1202139524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cc4102790 0x7f5cc41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.152+0000 7f5cc9047640 1 --2- 172.21.15.98:0/1202139524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cc4101de0 0x7f5cc41021c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.152+0000 7f5cc9047640 1 -- 172.21.15.98:0/1202139524 >> 172.21.15.98:0/1202139524 conn(0x7f5cc40fd8c0 msgr2=0x7f5cc40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:12.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.152+0000 7f5cc9047640 1 -- 172.21.15.98:0/1202139524 shutdown_connections 2024-09-19T07:21:12.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.152+0000 7f5cc9047640 1 -- 172.21.15.98:0/1202139524 wait complete. 2024-09-19T07:21:12.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.153+0000 7f5cc9047640 1 Processor -- start 2024-09-19T07:21:12.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.153+0000 7f5cc9047640 1 -- start start 2024-09-19T07:21:12.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.153+0000 7f5cc9047640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cc4101de0 0x7f5cc41984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.153+0000 7f5cc9047640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cc4102790 0x7f5cc4198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.153+0000 7f5cc9047640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cc4106f10 0x7f5cc419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.153+0000 7f5cc9047640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc4111fb0 con 0x7f5cc4101de0 2024-09-19T07:21:12.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.153+0000 7f5cc9047640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc4111e30 con 0x7f5cc4106f10 2024-09-19T07:21:12.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.153+0000 7f5cc9047640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc4112130 con 0x7f5cc4102790 2024-09-19T07:21:12.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc2d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cc4101de0 0x7f5cc41984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc2d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cc4101de0 0x7f5cc41984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51424/0 (socket says 172.21.15.98:51424) 2024-09-19T07:21:12.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc2d9d640 1 -- 172.21.15.98:0/3291093192 learned_addr learned my addr 172.21.15.98:0/3291093192 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:12.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc359e640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cc4106f10 0x7f5cc419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cba59c640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cc4102790 0x7f5cc4198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc2d9d640 1 -- 172.21.15.98:0/3291093192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cc4102790 msgr2=0x7f5cc4198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc2d9d640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cc4102790 0x7f5cc4198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc2d9d640 1 -- 172.21.15.98:0/3291093192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cc4106f10 msgr2=0x7f5cc419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc2d9d640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cc4106f10 0x7f5cc419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc2d9d640 1 -- 172.21.15.98:0/3291093192 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc419d470 con 0x7f5cc4101de0 2024-09-19T07:21:12.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cba59c640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cc4102790 0x7f5cc4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:12.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc2d9d640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cc4101de0 0x7f5cc41984c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4005ab0 tx=0x7f5cb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:12.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc0d99640 1 -- 172.21.15.98:0/3291093192 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb403f030 con 0x7f5cc4101de0 2024-09-19T07:21:12.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc9047640 1 -- 172.21.15.98:0/3291093192 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc419d700 con 0x7f5cc4101de0 2024-09-19T07:21:12.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc0d99640 1 -- 172.21.15.98:0/3291093192 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cb4003ce0 con 0x7f5cc4101de0 2024-09-19T07:21:12.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc0d99640 1 -- 172.21.15.98:0/3291093192 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4035070 con 0x7f5cc4101de0 2024-09-19T07:21:12.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.154+0000 7f5cc9047640 1 -- 172.21.15.98:0/3291093192 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc41a5040 con 0x7f5cc4101de0 2024-09-19T07:21:12.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.156+0000 7f5cc9047640 1 -- 172.21.15.98:0/3291093192 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc41021c0 con 0x7f5cc4101de0 2024-09-19T07:21:12.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.156+0000 7f5cc0d99640 1 -- 172.21.15.98:0/3291093192 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5cb4042030 con 0x7f5cc4101de0 2024-09-19T07:21:12.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.157+0000 7f5cc0d99640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5cb00a32d0 0x7f5cb00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.157+0000 7f5cba59c640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5cb00a32d0 0x7f5cb00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.157+0000 7f5cc0d99640 1 -- 172.21.15.98:0/3291093192 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f5cb40f0390 con 0x7f5cc4101de0 2024-09-19T07:21:12.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.158+0000 7f5cba59c640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5cb00a32d0 0x7f5cb00a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5cac006fd0 tx=0x7f5cac008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:12.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.161+0000 7f5cc0d99640 1 -- 172.21.15.98:0/3291093192 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5cb40bcf30 con 0x7f5cc4101de0 2024-09-19T07:21:12.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.332+0000 7f5cc9047640 1 -- 172.21.15.98:0/3291093192 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5cc410a0f0 con 0x7f5cc4101de0 2024-09-19T07:21:12.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.333+0000 7f5cc0d99640 1 -- 172.21.15.98:0/3291093192 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5cb40bc830 con 0x7f5cc4101de0 2024-09-19T07:21:12.334 INFO:teuthology.orchestra.run.smithi098.stdout:197568495658 2024-09-19T07:21:12.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.335+0000 7f5cc9047640 1 -- 172.21.15.98:0/3291093192 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5cb00a32d0 msgr2=0x7f5cb00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.335+0000 7f5cc9047640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5cb00a32d0 0x7f5cb00a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5cac006fd0 tx=0x7f5cac008040 comp rx=0 tx=0).stop 2024-09-19T07:21:12.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.335+0000 7f5cc9047640 1 -- 172.21.15.98:0/3291093192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cc4101de0 msgr2=0x7f5cc41984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.335+0000 7f5cc9047640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cc4101de0 0x7f5cc41984c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4005ab0 tx=0x7f5cb40042f0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.335+0000 7f5cc9047640 1 -- 172.21.15.98:0/3291093192 shutdown_connections 2024-09-19T07:21:12.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.335+0000 7f5cc9047640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f5cb00a32d0 0x7f5cb00a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.335+0000 7f5cc9047640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cc4106f10 0x7f5cc419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.335+0000 7f5cc9047640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cc4102790 0x7f5cc4198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.335+0000 7f5cc9047640 1 --2- 172.21.15.98:0/3291093192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5cc4101de0 0x7f5cc41984c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.335+0000 7f5cc9047640 1 -- 172.21.15.98:0/3291093192 >> 172.21.15.98:0/3291093192 conn(0x7f5cc40fd8c0 msgr2=0x7f5cc40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:12.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.335+0000 7f5cc9047640 1 -- 172.21.15.98:0/3291093192 shutdown_connections 2024-09-19T07:21:12.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.335+0000 7f5cc9047640 1 -- 172.21.15.98:0/3291093192 wait complete. 2024-09-19T07:21:12.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.344+0000 7f63bde8c640 1 -- 172.21.15.98:0/3105211980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8100100 msgr2=0x7f63b8100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.344+0000 7f63bde8c640 1 --2- 172.21.15.98:0/3105211980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8100100 0x7f63b8100560 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009900 tx=0x7f63ac02a410 comp rx=0 tx=0).stop 2024-09-19T07:21:12.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.344+0000 7f63bde8c640 1 -- 172.21.15.98:0/3105211980 shutdown_connections 2024-09-19T07:21:12.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.344+0000 7f63bde8c640 1 --2- 172.21.15.98:0/3105211980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63b8100aa0 0x7f63b810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.344+0000 7f63bde8c640 1 --2- 172.21.15.98:0/3105211980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8100100 0x7f63b8100560 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.344+0000 7f63bde8c640 1 --2- 172.21.15.98:0/3105211980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b8106b80 0x7f63b8106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.344+0000 7f63bde8c640 1 -- 172.21.15.98:0/3105211980 >> 172.21.15.98:0/3105211980 conn(0x7f63b8077230 msgr2=0x7f63b80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:12.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.344+0000 7f63bde8c640 1 -- 172.21.15.98:0/3105211980 shutdown_connections 2024-09-19T07:21:12.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.344+0000 7f63bde8c640 1 -- 172.21.15.98:0/3105211980 wait complete. 2024-09-19T07:21:12.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63bde8c640 1 Processor -- start 2024-09-19T07:21:12.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63bde8c640 1 -- start start 2024-09-19T07:21:12.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63bde8c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63b8100100 0x7f63b81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63bde8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b8100aa0 0x7f63b8198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63bde8c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8106b80 0x7f63b819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63bde8c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f63b8112070 con 0x7f63b8106b80 2024-09-19T07:21:12.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63bde8c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f63b8111ef0 con 0x7f63b8100100 2024-09-19T07:21:12.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63bde8c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f63b81121f0 con 0x7f63b8100aa0 2024-09-19T07:21:12.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63b8100100 0x7f63b81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63b8100100 0x7f63b81985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:41234/0 (socket says 172.21.15.98:41234) 2024-09-19T07:21:12.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63b6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b8100aa0 0x7f63b8198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63b77fe640 1 -- 172.21.15.98:0/735598668 learned_addr learned my addr 172.21.15.98:0/735598668 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:12.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.345+0000 7f63b7fff640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8106b80 0x7f63b819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.346+0000 7f63b77fe640 1 -- 172.21.15.98:0/735598668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b8100aa0 msgr2=0x7f63b8198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.346+0000 7f63b77fe640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b8100aa0 0x7f63b8198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.346+0000 7f63b77fe640 1 -- 172.21.15.98:0/735598668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8106b80 msgr2=0x7f63b819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.346+0000 7f63b77fe640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8106b80 0x7f63b819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.346+0000 7f63b77fe640 1 -- 172.21.15.98:0/735598668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b819d5a0 con 0x7f63b8100100 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.346+0000 7f63b77fe640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63b8100100 0x7f63b81985f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f63a800b4a0 tx=0x7f63a800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.346+0000 7f63b4ff9640 1 -- 172.21.15.98:0/735598668 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8014070 con 0x7f63b8100100 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.346+0000 7f63bde8c640 1 -- 172.21.15.98:0/735598668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b819d890 con 0x7f63b8100100 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.346+0000 7f63b4ff9640 1 -- 172.21.15.98:0/735598668 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f63a8010af0 con 0x7f63b8100100 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.346+0000 7f63b4ff9640 1 -- 172.21.15.98:0/735598668 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8017d10 con 0x7f63b8100100 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.346+0000 7f63bde8c640 1 -- 172.21.15.98:0/735598668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b81a5170 con 0x7f63b8100100 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.347+0000 7f63bde8c640 1 -- 172.21.15.98:0/735598668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b8100560 con 0x7f63b8100100 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.350+0000 7f63b4ff9640 1 -- 172.21.15.98:0/735598668 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f63a8017070 con 0x7f63b8100100 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.350+0000 7f63b4ff9640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63a00a32d0 0x7f63a00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.350+0000 7f63b4ff9640 1 -- 172.21.15.98:0/735598668 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f63a80cf0e0 con 0x7f63b8100100 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.350+0000 7f63b6ffd640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63a00a32d0 0x7f63a00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.351+0000 7f63b6ffd640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63a00a32d0 0x7f63a00a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009230 tx=0x7f63ac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:12.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.353+0000 7f63b4ff9640 1 -- 172.21.15.98:0/735598668 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f63a809b740 con 0x7f63b8100100 2024-09-19T07:21:12.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.532+0000 7f63bde8c640 1 -- 172.21.15.98:0/735598668 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f63b8199950 con 0x7f63b8100100 2024-09-19T07:21:12.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.533+0000 7f63b4ff9640 1 -- 172.21.15.98:0/735598668 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f63a809fa40 con 0x7f63b8100100 2024-09-19T07:21:12.534 INFO:teuthology.orchestra.run.smithi098.stdout:146028888116 2024-09-19T07:21:12.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.535+0000 7f63bde8c640 1 -- 172.21.15.98:0/735598668 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63a00a32d0 msgr2=0x7f63a00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.535+0000 7f63bde8c640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63a00a32d0 0x7f63a00a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009230 tx=0x7f63ac0058d0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.535+0000 7f63bde8c640 1 -- 172.21.15.98:0/735598668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63b8100100 msgr2=0x7f63b81985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:12.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.535+0000 7f63bde8c640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63b8100100 0x7f63b81985f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f63a800b4a0 tx=0x7f63a800b960 comp rx=0 tx=0).stop 2024-09-19T07:21:12.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.536+0000 7f63bde8c640 1 -- 172.21.15.98:0/735598668 shutdown_connections 2024-09-19T07:21:12.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.536+0000 7f63bde8c640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f63a00a32d0 0x7f63a00a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.536+0000 7f63bde8c640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f63b8106b80 0x7f63b819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.536+0000 7f63bde8c640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b8100aa0 0x7f63b8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.536+0000 7f63bde8c640 1 --2- 172.21.15.98:0/735598668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63b8100100 0x7f63b81985f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:12.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.536+0000 7f63bde8c640 1 -- 172.21.15.98:0/735598668 >> 172.21.15.98:0/735598668 conn(0x7f63b8077230 msgr2=0x7f63b8104c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:12.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.536+0000 7f63bde8c640 1 -- 172.21.15.98:0/735598668 shutdown_connections 2024-09-19T07:21:12.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:12.536+0000 7f63bde8c640 1 -- 172.21.15.98:0/735598668 wait complete. 2024-09-19T07:21:12.912 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:12 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3291093192' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T07:21:12.912 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:12 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/735598668' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T07:21:13.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:12 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3291093192' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T07:21:13.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:12 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/735598668' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T07:21:13.089 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495655 got 197568495658 for osd.7 2024-09-19T07:21:13.090 DEBUG:teuthology.parallel:result is None 2024-09-19T07:21:13.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:12 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3291093192' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T07:21:13.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:12 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/735598668' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T07:21:13.674 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888114 got 146028888116 for osd.5 2024-09-19T07:21:13.674 DEBUG:teuthology.parallel:result is None 2024-09-19T07:21:14.003 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:13 smithi098 ceph-mon[30950]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:14.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:13 smithi139 ceph-mon[35039]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:14.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.084+0000 7f91335db640 1 -- 172.21.15.98:0/1072224013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f912c101420 msgr2=0x7f912c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:14.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.084+0000 7f91335db640 1 --2- 172.21.15.98:0/1072224013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f912c101420 0x7f912c10d950 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9124009cd0 tx=0x7f912402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:21:14.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.084+0000 7f91335db640 1 -- 172.21.15.98:0/1072224013 shutdown_connections 2024-09-19T07:21:14.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.084+0000 7f91335db640 1 --2- 172.21.15.98:0/1072224013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f912c101420 0x7f912c10d950 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:14.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.084+0000 7f91335db640 1 --2- 172.21.15.98:0/1072224013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912c100a80 0x7f912c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:14.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.084+0000 7f91335db640 1 --2- 172.21.15.98:0/1072224013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f912c106a80 0x7f912c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:14.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.084+0000 7f91335db640 1 -- 172.21.15.98:0/1072224013 >> 172.21.15.98:0/1072224013 conn(0x7f912c0fc7a0 msgr2=0x7f912c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:14.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.084+0000 7f91335db640 1 -- 172.21.15.98:0/1072224013 shutdown_connections 2024-09-19T07:21:14.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.084+0000 7f91335db640 1 -- 172.21.15.98:0/1072224013 wait complete. 2024-09-19T07:21:14.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.084+0000 7f91335db640 1 Processor -- start 2024-09-19T07:21:14.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.084+0000 7f91335db640 1 -- start start 2024-09-19T07:21:14.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f91335db640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f912c100a80 0x7f912c1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:14.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f91335db640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912c101420 0x7f912c198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:14.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f91335db640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f912c106a80 0x7f912c19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:14.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f91335db640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f912c112020 con 0x7f912c106a80 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f91335db640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f912c111ea0 con 0x7f912c100a80 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f91335db640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f912c1121a0 con 0x7f912c101420 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f9131b78640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f912c106a80 0x7f912c19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f9131b78640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f912c106a80 0x7f912c19cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50958/0 (socket says 172.21.15.98:50958) 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f9131b78640 1 -- 172.21.15.98:0/1066135345 learned_addr learned my addr 172.21.15.98:0/1066135345 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f9131377640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f912c100a80 0x7f912c1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f9130b76640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912c101420 0x7f912c198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f9131b78640 1 -- 172.21.15.98:0/1066135345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912c101420 msgr2=0x7f912c198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f9131b78640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912c101420 0x7f912c198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f9131b78640 1 -- 172.21.15.98:0/1066135345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f912c100a80 msgr2=0x7f912c1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f9131b78640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f912c100a80 0x7f912c1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f9131b78640 1 -- 172.21.15.98:0/1066135345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912c19d580 con 0x7f912c106a80 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f9130b76640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912c101420 0x7f912c198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:14.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f9131b78640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f912c106a80 0x7f912c19cea0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9124006010 tx=0x7f9124003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:14.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f911e7fc640 1 -- 172.21.15.98:0/1066135345 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124004450 con 0x7f912c106a80 2024-09-19T07:21:14.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f911e7fc640 1 -- 172.21.15.98:0/1066135345 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9124003e10 con 0x7f912c106a80 2024-09-19T07:21:14.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f91335db640 1 -- 172.21.15.98:0/1066135345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912c19d810 con 0x7f912c106a80 2024-09-19T07:21:14.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.085+0000 7f911e7fc640 1 -- 172.21.15.98:0/1066135345 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91240466e0 con 0x7f912c106a80 2024-09-19T07:21:14.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.086+0000 7f91335db640 1 -- 172.21.15.98:0/1066135345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f912c1a5150 con 0x7f912c106a80 2024-09-19T07:21:14.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.086+0000 7f91335db640 1 -- 172.21.15.98:0/1066135345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f912c100f60 con 0x7f912c106a80 2024-09-19T07:21:14.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.088+0000 7f911e7fc640 1 -- 172.21.15.98:0/1066135345 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f91240305a0 con 0x7f912c106a80 2024-09-19T07:21:14.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.088+0000 7f911e7fc640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f91180a32d0 0x7f91180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:14.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.088+0000 7f9131377640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f91180a32d0 0x7f91180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:14.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.088+0000 7f911e7fc640 1 -- 172.21.15.98:0/1066135345 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f912402e030 con 0x7f912c106a80 2024-09-19T07:21:14.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.089+0000 7f9131377640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f91180a32d0 0x7f91180a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9128009890 tx=0x7f9128008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:14.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.091+0000 7f911e7fc640 1 -- 172.21.15.98:0/1066135345 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f912404b060 con 0x7f912c106a80 2024-09-19T07:21:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:13 smithi162 ceph-mon[35726]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:14.140 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:14.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.271+0000 7f91335db640 1 -- 172.21.15.98:0/1066135345 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f912c199930 con 0x7f912c106a80 2024-09-19T07:21:14.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.272+0000 7f911e7fc640 1 -- 172.21.15.98:0/1066135345 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f912c199930 con 0x7f912c106a80 2024-09-19T07:21:14.272 INFO:teuthology.orchestra.run.smithi098.stdout:279172874267 2024-09-19T07:21:14.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.274+0000 7f91335db640 1 -- 172.21.15.98:0/1066135345 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f91180a32d0 msgr2=0x7f91180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:14.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.274+0000 7f91335db640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f91180a32d0 0x7f91180a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9128009890 tx=0x7f9128008040 comp rx=0 tx=0).stop 2024-09-19T07:21:14.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.274+0000 7f91335db640 1 -- 172.21.15.98:0/1066135345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f912c106a80 msgr2=0x7f912c19cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:14.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.274+0000 7f91335db640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f912c106a80 0x7f912c19cea0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9124006010 tx=0x7f9124003c20 comp rx=0 tx=0).stop 2024-09-19T07:21:14.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.274+0000 7f91335db640 1 -- 172.21.15.98:0/1066135345 shutdown_connections 2024-09-19T07:21:14.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.274+0000 7f91335db640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f91180a32d0 0x7f91180a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:14.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.274+0000 7f91335db640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f912c106a80 0x7f912c19cea0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:14.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.274+0000 7f91335db640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912c101420 0x7f912c198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:14.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.274+0000 7f91335db640 1 --2- 172.21.15.98:0/1066135345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f912c100a80 0x7f912c1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:14.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.274+0000 7f91335db640 1 -- 172.21.15.98:0/1066135345 >> 172.21.15.98:0/1066135345 conn(0x7f912c0fc7a0 msgr2=0x7f912c0fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:14.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.274+0000 7f91335db640 1 -- 172.21.15.98:0/1066135345 shutdown_connections 2024-09-19T07:21:14.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:14.274+0000 7f91335db640 1 -- 172.21.15.98:0/1066135345 wait complete. 2024-09-19T07:21:14.551 INFO:teuthology.orchestra.run.smithi098.stdout:227633266725 2024-09-19T07:21:14.552 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T07:21:14.911 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:14 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1066135345' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T07:21:14.938 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444096 got 73014444098 for osd.2 2024-09-19T07:21:14.938 DEBUG:teuthology.parallel:result is None 2024-09-19T07:21:15.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:14 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1066135345' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T07:21:15.110 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:14 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1066135345' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T07:21:15.546 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874264 got 279172874267 for osd.10 2024-09-19T07:21:15.546 DEBUG:teuthology.parallel:result is None 2024-09-19T07:21:15.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:15 smithi098 ceph-mon[30950]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T07:21:16.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:15 smithi139 ceph-mon[35039]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T07:21:16.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:15 smithi162 ceph-mon[35726]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T07:21:16.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.243+0000 7f811fc31640 1 -- 172.21.15.98:0/2370975511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8118102780 msgr2=0x7f81181067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:16.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.243+0000 7f811fc31640 1 --2- 172.21.15.98:0/2370975511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8118102780 0x7f81181067d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8114009900 tx=0x7f811402a410 comp rx=0 tx=0).stop 2024-09-19T07:21:16.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 -- 172.21.15.98:0/2370975511 shutdown_connections 2024-09-19T07:21:16.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 --2- 172.21.15.98:0/2370975511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8118106f00 0x7f811810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 --2- 172.21.15.98:0/2370975511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8118102780 0x7f81181067d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 --2- 172.21.15.98:0/2370975511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8118101dd0 0x7f81181021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 -- 172.21.15.98:0/2370975511 >> 172.21.15.98:0/2370975511 conn(0x7f81180fd890 msgr2=0x7f81180ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:16.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 -- 172.21.15.98:0/2370975511 shutdown_connections 2024-09-19T07:21:16.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 -- 172.21.15.98:0/2370975511 wait complete. 2024-09-19T07:21:16.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 Processor -- start 2024-09-19T07:21:16.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 -- start start 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8118101dd0 0x7f81181985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8118102780 0x7f8118198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8118106f00 0x7f811819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8118112000 con 0x7f8118106f00 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8118111e80 con 0x7f8118101dd0 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811fc31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8118112180 con 0x7f8118102780 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.244+0000 7f811e1ce640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8118106f00 0x7f811819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811e1ce640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8118106f00 0x7f811819ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:50982/0 (socket says 172.21.15.98:50982) 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811e1ce640 1 -- 172.21.15.98:0/1323819079 learned_addr learned my addr 172.21.15.98:0/1323819079 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811d9cd640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8118101dd0 0x7f81181985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811d1cc640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8118102780 0x7f8118198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811e1ce640 1 -- 172.21.15.98:0/1323819079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8118102780 msgr2=0x7f8118198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:16.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811e1ce640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8118102780 0x7f8118198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811e1ce640 1 -- 172.21.15.98:0/1323819079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8118101dd0 msgr2=0x7f81181985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:16.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811e1ce640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8118101dd0 0x7f81181985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811e1ce640 1 -- 172.21.15.98:0/1323819079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811819d570 con 0x7f8118106f00 2024-09-19T07:21:16.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811d9cd640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8118101dd0 0x7f81181985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:16.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811e1ce640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8118106f00 0x7f811819ce90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f811000b970 tx=0x7f811000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:16.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f810affd640 1 -- 172.21.15.98:0/1323819079 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8110019070 con 0x7f8118106f00 2024-09-19T07:21:16.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f810affd640 1 -- 172.21.15.98:0/1323819079 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f811000cb40 con 0x7f8118106f00 2024-09-19T07:21:16.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811fc31640 1 -- 172.21.15.98:0/1323819079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811819d860 con 0x7f8118106f00 2024-09-19T07:21:16.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f810affd640 1 -- 172.21.15.98:0/1323819079 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8110007650 con 0x7f8118106f00 2024-09-19T07:21:16.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.245+0000 7f811fc31640 1 -- 172.21.15.98:0/1323819079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81181a5140 con 0x7f8118106f00 2024-09-19T07:21:16.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.246+0000 7f811fc31640 1 -- 172.21.15.98:0/1323819079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8118102230 con 0x7f8118106f00 2024-09-19T07:21:16.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.247+0000 7f810affd640 1 -- 172.21.15.98:0/1323819079 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f811001c070 con 0x7f8118106f00 2024-09-19T07:21:16.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.248+0000 7f810affd640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81040a3350 0x7f81040a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:16.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.248+0000 7f811d9cd640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81040a3350 0x7f81040a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:16.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.248+0000 7f810affd640 1 -- 172.21.15.98:0/1323819079 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f81100cef90 con 0x7f8118106f00 2024-09-19T07:21:16.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.249+0000 7f811d9cd640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81040a3350 0x7f81040a5810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f810c009930 tx=0x7f810c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:16.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.253+0000 7f810affd640 1 -- 172.21.15.98:0/1323819079 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f811009bc40 con 0x7f8118106f00 2024-09-19T07:21:16.254 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:16.254 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:16.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.436+0000 7f811fc31640 1 -- 172.21.15.98:0/1323819079 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f8118109b50 con 0x7f8118106f00 2024-09-19T07:21:16.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.436+0000 7f810affd640 1 -- 172.21.15.98:0/1323819079 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f811009b540 con 0x7f8118106f00 2024-09-19T07:21:16.437 INFO:teuthology.orchestra.run.smithi098.stdout:257698037792 2024-09-19T07:21:16.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.438+0000 7f811fc31640 1 -- 172.21.15.98:0/1323819079 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81040a3350 msgr2=0x7f81040a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:16.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.438+0000 7f811fc31640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81040a3350 0x7f81040a5810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f810c009930 tx=0x7f810c008040 comp rx=0 tx=0).stop 2024-09-19T07:21:16.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.438+0000 7f811fc31640 1 -- 172.21.15.98:0/1323819079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8118106f00 msgr2=0x7f811819ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:16.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.438+0000 7f811fc31640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8118106f00 0x7f811819ce90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f811000b970 tx=0x7f811000be30 comp rx=0 tx=0).stop 2024-09-19T07:21:16.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.438+0000 7f811fc31640 1 -- 172.21.15.98:0/1323819079 shutdown_connections 2024-09-19T07:21:16.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.438+0000 7f811fc31640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f81040a3350 0x7f81040a5810 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.438+0000 7f811fc31640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8118106f00 0x7f811819ce90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.438+0000 7f811fc31640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8118102780 0x7f8118198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.438+0000 7f811fc31640 1 --2- 172.21.15.98:0/1323819079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8118101dd0 0x7f81181985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.439 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.438+0000 7f811fc31640 1 -- 172.21.15.98:0/1323819079 >> 172.21.15.98:0/1323819079 conn(0x7f81180fd890 msgr2=0x7f81180fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:16.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.438+0000 7f811fc31640 1 -- 172.21.15.98:0/1323819079 shutdown_connections 2024-09-19T07:21:16.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.438+0000 7f811fc31640 1 -- 172.21.15.98:0/1323819079 wait complete. 2024-09-19T07:21:16.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.439+0000 7fb84ea1f640 1 -- 172.21.15.98:0/2568256639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb848102570 msgr2=0x7fb8481029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:16.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.439+0000 7fb84ea1f640 1 --2- 172.21.15.98:0/2568256639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb848102570 0x7fb8481029b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009900 tx=0x7fb83c02a480 comp rx=0 tx=0).stop 2024-09-19T07:21:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.439+0000 7fb84ea1f640 1 -- 172.21.15.98:0/2568256639 shutdown_connections 2024-09-19T07:21:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.439+0000 7fb84ea1f640 1 --2- 172.21.15.98:0/2568256639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb848102ef0 0x7fb84810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.439+0000 7fb84ea1f640 1 --2- 172.21.15.98:0/2568256639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb848102570 0x7fb8481029b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.439+0000 7fb84ea1f640 1 --2- 172.21.15.98:0/2568256639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb848100e20 0x7fb848101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.439+0000 7fb84ea1f640 1 -- 172.21.15.98:0/2568256639 >> 172.21.15.98:0/2568256639 conn(0x7fb8480fc7d0 msgr2=0x7fb8480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.439+0000 7fb84ea1f640 1 -- 172.21.15.98:0/2568256639 shutdown_connections 2024-09-19T07:21:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.439+0000 7fb84ea1f640 1 -- 172.21.15.98:0/2568256639 wait complete. 2024-09-19T07:21:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.440+0000 7fb84ea1f640 1 Processor -- start 2024-09-19T07:21:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.440+0000 7fb84ea1f640 1 -- start start 2024-09-19T07:21:16.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.440+0000 7fb84ea1f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb848100e20 0x7fb848197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.440+0000 7fb84ea1f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb848102570 0x7fb848197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.440+0000 7fb84ea1f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb848102ef0 0x7fb84819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.440+0000 7fb84ea1f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb848111020 con 0x7fb848100e20 2024-09-19T07:21:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.440+0000 7fb84ea1f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb848110ea0 con 0x7fb848102570 2024-09-19T07:21:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.440+0000 7fb84ea1f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb8481111a0 con 0x7fb848102ef0 2024-09-19T07:21:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.440+0000 7fb847fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb848100e20 0x7fb848197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.440+0000 7fb847fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb848100e20 0x7fb848197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51004/0 (socket says 172.21.15.98:51004) 2024-09-19T07:21:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.440+0000 7fb847fff640 1 -- 172.21.15.98:0/3987980880 learned_addr learned my addr 172.21.15.98:0/3987980880 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.440+0000 7fb8477fe640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb848102570 0x7fb848197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.441+0000 7fb84cfbc640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb848102ef0 0x7fb84819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.441+0000 7fb847fff640 1 -- 172.21.15.98:0/3987980880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb848102ef0 msgr2=0x7fb84819be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:16.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.441+0000 7fb847fff640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb848102ef0 0x7fb84819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.441+0000 7fb847fff640 1 -- 172.21.15.98:0/3987980880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb848102570 msgr2=0x7fb848197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.441+0000 7fb847fff640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb848102570 0x7fb848197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.441+0000 7fb847fff640 1 -- 172.21.15.98:0/3987980880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84819c4f0 con 0x7fb848100e20 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.441+0000 7fb847fff640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb848100e20 0x7fb848197540 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb83800b4a0 tx=0x7fb83800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.441+0000 7fb8457fa640 1 -- 172.21.15.98:0/3987980880 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838014070 con 0x7fb848100e20 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.441+0000 7fb8457fa640 1 -- 172.21.15.98:0/3987980880 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb838010af0 con 0x7fb848100e20 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.441+0000 7fb84ea1f640 1 -- 172.21.15.98:0/3987980880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84819c7e0 con 0x7fb848100e20 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.441+0000 7fb8457fa640 1 -- 172.21.15.98:0/3987980880 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb838017d10 con 0x7fb848100e20 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.441+0000 7fb84ea1f640 1 -- 172.21.15.98:0/3987980880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8481a40c0 con 0x7fb848100e20 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.442+0000 7fb84ea1f640 1 -- 172.21.15.98:0/3987980880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb848101280 con 0x7fb848100e20 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.443+0000 7fb8457fa640 1 -- 172.21.15.98:0/3987980880 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb838017070 con 0x7fb848100e20 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.444+0000 7fb8457fa640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb8300a3350 0x7fb8300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.444+0000 7fb8477fe640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb8300a3350 0x7fb8300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:16.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.445+0000 7fb8457fa640 1 -- 172.21.15.98:0/3987980880 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb8380cf1c0 con 0x7fb848100e20 2024-09-19T07:21:16.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.445+0000 7fb8477fe640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb8300a3350 0x7fb8300a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb8480ffe70 tx=0x7fb83c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:16.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.447+0000 7fb8457fa640 1 -- 172.21.15.98:0/3987980880 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb83809be10 con 0x7fb848100e20 2024-09-19T07:21:16.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.623+0000 7fb84ea1f640 1 -- 172.21.15.98:0/3987980880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb8481988a0 con 0x7fb848100e20 2024-09-19T07:21:16.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.624+0000 7fb8457fa640 1 -- 172.21.15.98:0/3987980880 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb8481988a0 con 0x7fb848100e20 2024-09-19T07:21:16.624 INFO:teuthology.orchestra.run.smithi098.stdout:176093659183 2024-09-19T07:21:16.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.626+0000 7fb84ea1f640 1 -- 172.21.15.98:0/3987980880 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb8300a3350 msgr2=0x7fb8300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:16.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.626+0000 7fb84ea1f640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb8300a3350 0x7fb8300a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb8480ffe70 tx=0x7fb83c005a20 comp rx=0 tx=0).stop 2024-09-19T07:21:16.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.626+0000 7fb84ea1f640 1 -- 172.21.15.98:0/3987980880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb848100e20 msgr2=0x7fb848197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.626+0000 7fb84ea1f640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb848100e20 0x7fb848197540 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb83800b4a0 tx=0x7fb83800b960 comp rx=0 tx=0).stop 2024-09-19T07:21:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.626+0000 7fb84ea1f640 1 -- 172.21.15.98:0/3987980880 shutdown_connections 2024-09-19T07:21:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.626+0000 7fb84ea1f640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb8300a3350 0x7fb8300a5810 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.626+0000 7fb84ea1f640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb848102ef0 0x7fb84819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.626+0000 7fb84ea1f640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb848102570 0x7fb848197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.626+0000 7fb84ea1f640 1 --2- 172.21.15.98:0/3987980880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb848100e20 0x7fb848197540 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.626+0000 7fb84ea1f640 1 -- 172.21.15.98:0/3987980880 >> 172.21.15.98:0/3987980880 conn(0x7fb8480fc7d0 msgr2=0x7fb8480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.626+0000 7fb84ea1f640 1 -- 172.21.15.98:0/3987980880 shutdown_connections 2024-09-19T07:21:16.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:16.626+0000 7fb84ea1f640 1 -- 172.21.15.98:0/3987980880 wait complete. 2024-09-19T07:21:16.945 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:16 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1323819079' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T07:21:16.946 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:16 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:21:16.946 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:16 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3987980880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T07:21:17.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:16 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1323819079' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T07:21:17.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:16 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:21:17.032 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:16 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3987980880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T07:21:17.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:16 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1323819079' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T07:21:17.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:16 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:21:17.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:16 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3987980880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T07:21:17.248 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659181 got 176093659183 for osd.6 2024-09-19T07:21:17.248 DEBUG:teuthology.parallel:result is None 2024-09-19T07:21:17.782 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:17 smithi098 ceph-mon[30950]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:21:18.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:17 smithi139 ceph-mon[35039]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:21:18.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:17 smithi162 ceph-mon[35726]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:21:18.171 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:18.174 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037789 got 257698037792 for osd.9 2024-09-19T07:21:18.174 DEBUG:teuthology.parallel:result is None 2024-09-19T07:21:18.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.359+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/2311401324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6ac100e20 msgr2=0x7ff6ac101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:18.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.359+0000 7ff6b1dfd640 1 --2- 172.21.15.98:0/2311401324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6ac100e20 0x7ff6ac101200 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff69c009ca0 tx=0x7ff69c02a950 comp rx=0 tx=0).stop 2024-09-19T07:21:18.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.359+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/2311401324 shutdown_connections 2024-09-19T07:21:18.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.359+0000 7ff6b1dfd640 1 --2- 172.21.15.98:0/2311401324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ac102ef0 0x7ff6ac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:18.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.359+0000 7ff6b1dfd640 1 --2- 172.21.15.98:0/2311401324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6ac102570 0x7ff6ac1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:18.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.359+0000 7ff6b1dfd640 1 --2- 172.21.15.98:0/2311401324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6ac100e20 0x7ff6ac101200 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:18.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.359+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/2311401324 >> 172.21.15.98:0/2311401324 conn(0x7ff6ac0fc7d0 msgr2=0x7ff6ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:18.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.359+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/2311401324 shutdown_connections 2024-09-19T07:21:18.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.359+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/2311401324 wait complete. 2024-09-19T07:21:18.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.360+0000 7ff6b1dfd640 1 Processor -- start 2024-09-19T07:21:18.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.360+0000 7ff6b1dfd640 1 -- start start 2024-09-19T07:21:18.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.360+0000 7ff6b1dfd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6ac100e20 0x7ff6ac199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:18.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.360+0000 7ff6b1dfd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6ac102570 0x7ff6ac1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:18.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.360+0000 7ff6b1dfd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ac102ef0 0x7ff6ac1a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:18.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.360+0000 7ff6b1dfd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac110f80 con 0x7ff6ac102570 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.360+0000 7ff6b1dfd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac110e00 con 0x7ff6ac102ef0 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.360+0000 7ff6b1dfd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ac111100 con 0x7ff6ac100e20 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6aaffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6ac102570 0x7ff6ac1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6aaffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6ac102570 0x7ff6ac1998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51022/0 (socket says 172.21.15.98:51022) 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6ab7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6ac100e20 0x7ff6ac199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6aaffd640 1 -- 172.21.15.98:0/3981024808 learned_addr learned my addr 172.21.15.98:0/3981024808 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6abfff640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ac102ef0 0x7ff6ac1a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6aaffd640 1 -- 172.21.15.98:0/3981024808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6ac100e20 msgr2=0x7ff6ac199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6aaffd640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6ac100e20 0x7ff6ac199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6aaffd640 1 -- 172.21.15.98:0/3981024808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ac102ef0 msgr2=0x7ff6ac1a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6aaffd640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ac102ef0 0x7ff6ac1a4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6aaffd640 1 -- 172.21.15.98:0/3981024808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ac1a4940 con 0x7ff6ac102570 2024-09-19T07:21:18.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6aaffd640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6ac102570 0x7ff6ac1998c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000e9f0 tx=0x7ff6a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:18.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6a8ff9640 1 -- 172.21.15.98:0/3981024808 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000cd80 con 0x7ff6ac102570 2024-09-19T07:21:18.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/3981024808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ac1a4b10 con 0x7ff6ac102570 2024-09-19T07:21:18.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6a8ff9640 1 -- 172.21.15.98:0/3981024808 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6a0005500 con 0x7ff6ac102570 2024-09-19T07:21:18.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.361+0000 7ff6a8ff9640 1 -- 172.21.15.98:0/3981024808 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0010690 con 0x7ff6ac102570 2024-09-19T07:21:18.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.362+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/3981024808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ac1a4fd0 con 0x7ff6ac102570 2024-09-19T07:21:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.363+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/3981024808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ac101200 con 0x7ff6ac102570 2024-09-19T07:21:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.363+0000 7ff6a8ff9640 1 -- 172.21.15.98:0/3981024808 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff6a00046c0 con 0x7ff6ac102570 2024-09-19T07:21:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.364+0000 7ff6a8ff9640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff6940a32d0 0x7ff6940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.364+0000 7ff6ab7fe640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff6940a32d0 0x7ff6940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.364+0000 7ff6a8ff9640 1 -- 172.21.15.98:0/3981024808 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff6a00cff10 con 0x7ff6ac102570 2024-09-19T07:21:18.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.364+0000 7ff6ab7fe640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff6940a32d0 0x7ff6940a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff69c004ad0 tx=0x7ff69c004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:18.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.368+0000 7ff6a8ff9640 1 -- 172.21.15.98:0/3981024808 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff6a009cab0 con 0x7ff6ac102570 2024-09-19T07:21:18.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.543+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/3981024808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7ff6ac109090 con 0x7ff6ac102570 2024-09-19T07:21:18.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.544+0000 7ff6a8ff9640 1 -- 172.21.15.98:0/3981024808 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ff6a009c3b0 con 0x7ff6ac102570 2024-09-19T07:21:18.544 INFO:teuthology.orchestra.run.smithi098.stdout:309237645336 2024-09-19T07:21:18.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.546+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/3981024808 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff6940a32d0 msgr2=0x7ff6940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:18.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.546+0000 7ff6b1dfd640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff6940a32d0 0x7ff6940a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff69c004ad0 tx=0x7ff69c004a60 comp rx=0 tx=0).stop 2024-09-19T07:21:18.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.546+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/3981024808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6ac102570 msgr2=0x7ff6ac1998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:18.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.546+0000 7ff6b1dfd640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6ac102570 0x7ff6ac1998c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000e9f0 tx=0x7ff6a000edf0 comp rx=0 tx=0).stop 2024-09-19T07:21:18.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.546+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/3981024808 shutdown_connections 2024-09-19T07:21:18.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.546+0000 7ff6b1dfd640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff6940a32d0 0x7ff6940a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:18.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.546+0000 7ff6b1dfd640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ac102ef0 0x7ff6ac1a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:18.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.546+0000 7ff6b1dfd640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6ac102570 0x7ff6ac1998c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:18.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.546+0000 7ff6b1dfd640 1 --2- 172.21.15.98:0/3981024808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff6ac100e20 0x7ff6ac199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:18.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.546+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/3981024808 >> 172.21.15.98:0/3981024808 conn(0x7ff6ac0fc7d0 msgr2=0x7ff6ac0fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:18.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.546+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/3981024808 shutdown_connections 2024-09-19T07:21:18.547 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:18.546+0000 7ff6b1dfd640 1 -- 172.21.15.98:0/3981024808 wait complete. 2024-09-19T07:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.085+0000 7fc319c70640 1 -- 172.21.15.98:0/3082420825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc314102570 msgr2=0x7fc3141029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.085+0000 7fc319c70640 1 --2- 172.21.15.98:0/3082420825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc314102570 0x7fc3141029b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc009900 tx=0x7fc2fc02a480 comp rx=0 tx=0).stop 2024-09-19T07:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.085+0000 7fc319c70640 1 -- 172.21.15.98:0/3082420825 shutdown_connections 2024-09-19T07:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.085+0000 7fc319c70640 1 --2- 172.21.15.98:0/3082420825 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc314102ef0 0x7fc31410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.085+0000 7fc319c70640 1 --2- 172.21.15.98:0/3082420825 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc314102570 0x7fc3141029b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.085+0000 7fc319c70640 1 --2- 172.21.15.98:0/3082420825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc314100e20 0x7fc314101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.085+0000 7fc319c70640 1 -- 172.21.15.98:0/3082420825 >> 172.21.15.98:0/3082420825 conn(0x7fc3140fc7d0 msgr2=0x7fc3140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.085+0000 7fc319c70640 1 -- 172.21.15.98:0/3082420825 shutdown_connections 2024-09-19T07:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.085+0000 7fc319c70640 1 -- 172.21.15.98:0/3082420825 wait complete. 2024-09-19T07:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.085+0000 7fc319c70640 1 Processor -- start 2024-09-19T07:21:19.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc319c70640 1 -- start start 2024-09-19T07:21:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc319c70640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc314100e20 0x7fc3140fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc319c70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc314102570 0x7fc3140fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc319c70640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc314102ef0 0x7fc3140fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc319c70640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc314110f80 con 0x7fc314102ef0 2024-09-19T07:21:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc319c70640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc314110e00 con 0x7fc314100e20 2024-09-19T07:21:19.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc319c70640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc314111100 con 0x7fc314102570 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc313fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc314102ef0 0x7fc3140fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc3137fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc314100e20 0x7fc3140fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc313fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc314102ef0 0x7fc3140fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51044/0 (socket says 172.21.15.98:51044) 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc3137fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc314100e20 0x7fc3140fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:43654/0 (socket says 172.21.15.98:43654) 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc313fff640 1 -- 172.21.15.98:0/2750336644 learned_addr learned my addr 172.21.15.98:0/2750336644 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc30bfff640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc314102570 0x7fc3140fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc313fff640 1 -- 172.21.15.98:0/2750336644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc314102570 msgr2=0x7fc3140fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc313fff640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc314102570 0x7fc3140fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc313fff640 1 -- 172.21.15.98:0/2750336644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc314100e20 msgr2=0x7fc3140fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc313fff640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc314100e20 0x7fc3140fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc313fff640 1 -- 172.21.15.98:0/2750336644 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3141a6920 con 0x7fc314102ef0 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc3137fe640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc314100e20 0x7fc3140fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:21:19.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.086+0000 7fc313fff640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc314102ef0 0x7fc3140fd700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00cce0 tx=0x7fc30c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:19.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.087+0000 7fc3117fa640 1 -- 172.21.15.98:0/2750336644 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00f450 con 0x7fc314102ef0 2024-09-19T07:21:19.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.087+0000 7fc319c70640 1 -- 172.21.15.98:0/2750336644 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3141a6c10 con 0x7fc314102ef0 2024-09-19T07:21:19.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.087+0000 7fc3117fa640 1 -- 172.21.15.98:0/2750336644 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc30c00fad0 con 0x7fc314102ef0 2024-09-19T07:21:19.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.087+0000 7fc3117fa640 1 -- 172.21.15.98:0/2750336644 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c018c10 con 0x7fc314102ef0 2024-09-19T07:21:19.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.087+0000 7fc319c70640 1 -- 172.21.15.98:0/2750336644 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3141a7120 con 0x7fc314102ef0 2024-09-19T07:21:19.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.088+0000 7fc319c70640 1 -- 172.21.15.98:0/2750336644 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc314101200 con 0x7fc314102ef0 2024-09-19T07:21:19.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.089+0000 7fc3117fa640 1 -- 172.21.15.98:0/2750336644 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc30c00f5f0 con 0x7fc314102ef0 2024-09-19T07:21:19.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.089+0000 7fc3117fa640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc3000a32d0 0x7fc3000a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:19.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.089+0000 7fc3137fe640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc3000a32d0 0x7fc3000a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:19.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.090+0000 7fc3117fa640 1 -- 172.21.15.98:0/2750336644 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fc30c0cfff0 con 0x7fc314102ef0 2024-09-19T07:21:19.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.090+0000 7fc3137fe640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc3000a32d0 0x7fc3000a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc304009fc0 tx=0x7fc304005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:19.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.093+0000 7fc3117fa640 1 -- 172.21.15.98:0/2750336644 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc30c014030 con 0x7fc314102ef0 2024-09-19T07:21:19.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:18 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:19.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:18 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:19.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:18 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:19.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:18 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:19.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:18 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3981024808' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T07:21:19.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:18 smithi098 ceph-mon[30950]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:19.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.265+0000 7fc319c70640 1 -- 172.21.15.98:0/2750336644 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fc3140fe1b0 con 0x7fc314102ef0 2024-09-19T07:21:19.266 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.265+0000 7fc3117fa640 1 -- 172.21.15.98:0/2750336644 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc3140fe1b0 con 0x7fc314102ef0 2024-09-19T07:21:19.266 INFO:teuthology.orchestra.run.smithi098.stdout:227633266727 2024-09-19T07:21:19.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.267+0000 7fc319c70640 1 -- 172.21.15.98:0/2750336644 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc3000a32d0 msgr2=0x7fc3000a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:19.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.267+0000 7fc319c70640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc3000a32d0 0x7fc3000a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc304009fc0 tx=0x7fc304005f90 comp rx=0 tx=0).stop 2024-09-19T07:21:19.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.267+0000 7fc319c70640 1 -- 172.21.15.98:0/2750336644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc314102ef0 msgr2=0x7fc3140fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:19.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.267+0000 7fc319c70640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc314102ef0 0x7fc3140fd700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00cce0 tx=0x7fc30c00a620 comp rx=0 tx=0).stop 2024-09-19T07:21:19.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.267+0000 7fc319c70640 1 -- 172.21.15.98:0/2750336644 shutdown_connections 2024-09-19T07:21:19.268 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.267+0000 7fc319c70640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fc3000a32d0 0x7fc3000a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.267+0000 7fc319c70640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc314102ef0 0x7fc3140fd700 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.267+0000 7fc319c70640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc314102570 0x7fc3140fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.267+0000 7fc319c70640 1 --2- 172.21.15.98:0/2750336644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc314100e20 0x7fc3140fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.267+0000 7fc319c70640 1 -- 172.21.15.98:0/2750336644 >> 172.21.15.98:0/2750336644 conn(0x7fc3140fc7d0 msgr2=0x7fc314069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:19.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.268+0000 7fc319c70640 1 -- 172.21.15.98:0/2750336644 shutdown_connections 2024-09-19T07:21:19.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.268+0000 7fc319c70640 1 -- 172.21.15.98:0/2750336644 wait complete. 2024-09-19T07:21:19.312 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.288+0000 7feed3cfa640 1 -- 172.21.15.98:0/64944079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feecc1082a0 msgr2=0x7feecc10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:19.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.288+0000 7feed3cfa640 1 --2- 172.21.15.98:0/64944079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feecc1082a0 0x7feecc10ec40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feec4009cd0 tx=0x7feec402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.288+0000 7feed3cfa640 1 -- 172.21.15.98:0/64944079 shutdown_connections 2024-09-19T07:21:19.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.288+0000 7feed3cfa640 1 --2- 172.21.15.98:0/64944079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feecc1082a0 0x7feecc10ec40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.288+0000 7feed3cfa640 1 --2- 172.21.15.98:0/64944079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feecc1036e0 0x7feecc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.288+0000 7feed3cfa640 1 --2- 172.21.15.98:0/64944079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feecc102d30 0x7feecc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.288+0000 7feed3cfa640 1 -- 172.21.15.98:0/64944079 >> 172.21.15.98:0/64944079 conn(0x7feecc0fc7d0 msgr2=0x7feecc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:19.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.288+0000 7feed3cfa640 1 -- 172.21.15.98:0/64944079 shutdown_connections 2024-09-19T07:21:19.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.288+0000 7feed3cfa640 1 -- 172.21.15.98:0/64944079 wait complete. 2024-09-19T07:21:19.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed3cfa640 1 Processor -- start 2024-09-19T07:21:19.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed3cfa640 1 -- start start 2024-09-19T07:21:19.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed3cfa640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feecc102d30 0x7feecc198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:19.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed3cfa640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feecc1036e0 0x7feecc198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:19.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed3cfa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feecc1082a0 0x7feecc19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:19.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed3cfa640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feecc1120a0 con 0x7feecc102d30 2024-09-19T07:21:19.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed3cfa640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feecc111f20 con 0x7feecc1036e0 2024-09-19T07:21:19.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed3cfa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feecc112220 con 0x7feecc1082a0 2024-09-19T07:21:19.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed1a96640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feecc102d30 0x7feecc198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:19.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed1a96640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feecc102d30 0x7feecc198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51060/0 (socket says 172.21.15.98:51060) 2024-09-19T07:21:19.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed1a96640 1 -- 172.21.15.98:0/2060356115 learned_addr learned my addr 172.21.15.98:0/2060356115 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:19.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed1295640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feecc1036e0 0x7feecc198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:19.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed2297640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feecc1082a0 0x7feecc19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:19.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed1a96640 1 -- 172.21.15.98:0/2060356115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feecc1082a0 msgr2=0x7feecc19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:19.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed1a96640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feecc1082a0 0x7feecc19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed1a96640 1 -- 172.21.15.98:0/2060356115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feecc1036e0 msgr2=0x7feecc198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:19.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed1a96640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feecc1036e0 0x7feecc198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed1a96640 1 -- 172.21.15.98:0/2060356115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc19d510 con 0x7feecc102d30 2024-09-19T07:21:19.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.289+0000 7feed1295640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feecc1036e0 0x7feecc198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:21:19.315 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.290+0000 7feed1a96640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feecc102d30 0x7feecc198560 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7feec800e9f0 tx=0x7feec800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:19.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.290+0000 7feec2ffd640 1 -- 172.21.15.98:0/2060356115 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec800cd80 con 0x7feecc102d30 2024-09-19T07:21:19.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.290+0000 7feed3cfa640 1 -- 172.21.15.98:0/2060356115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feecc19d800 con 0x7feecc102d30 2024-09-19T07:21:19.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.290+0000 7feec2ffd640 1 -- 172.21.15.98:0/2060356115 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feec8010910 con 0x7feecc102d30 2024-09-19T07:21:19.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.290+0000 7feec2ffd640 1 -- 172.21.15.98:0/2060356115 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8018990 con 0x7feecc102d30 2024-09-19T07:21:19.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.290+0000 7feed3cfa640 1 -- 172.21.15.98:0/2060356115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feecc1008c0 con 0x7feecc102d30 2024-09-19T07:21:19.316 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.291+0000 7feed3cfa640 1 -- 172.21.15.98:0/2060356115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feecc103110 con 0x7feecc102d30 2024-09-19T07:21:19.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.292+0000 7feec2ffd640 1 -- 172.21.15.98:0/2060356115 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7feec8010ac0 con 0x7feecc102d30 2024-09-19T07:21:19.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.293+0000 7feec2ffd640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7feeb80a3350 0x7feeb80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:19.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.293+0000 7feed1295640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7feeb80a3350 0x7feeb80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:19.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.294+0000 7feec2ffd640 1 -- 172.21.15.98:0/2060356115 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7feec80cfd20 con 0x7feecc102d30 2024-09-19T07:21:19.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.294+0000 7feed1295640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7feeb80a3350 0x7feeb80a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feecc0fee00 tx=0x7feebc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:19.317 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.298+0000 7feec2ffd640 1 -- 172.21.15.98:0/2060356115 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feec809c270 con 0x7feecc102d30 2024-09-19T07:21:19.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:18 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:19.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:18 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:19.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:18 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:19.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:18 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:19.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:18 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3981024808' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T07:21:19.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:18 smithi139 ceph-mon[35039]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:19.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:18 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:19.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:18 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:19.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:18 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:19.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:18 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:19.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:18 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3981024808' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T07:21:19.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:18 smithi162 ceph-mon[35726]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:19.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.472+0000 7feed3cfa640 1 -- 172.21.15.98:0/2060356115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7feecc10a2b0 con 0x7feecc102d30 2024-09-19T07:21:19.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.472+0000 7feec2ffd640 1 -- 172.21.15.98:0/2060356115 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feec80a0570 con 0x7feecc102d30 2024-09-19T07:21:19.473 INFO:teuthology.orchestra.run.smithi098.stdout:34359738447 2024-09-19T07:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.474+0000 7feed3cfa640 1 -- 172.21.15.98:0/2060356115 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7feeb80a3350 msgr2=0x7feeb80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.474+0000 7feed3cfa640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7feeb80a3350 0x7feeb80a5810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feecc0fee00 tx=0x7feebc005f90 comp rx=0 tx=0).stop 2024-09-19T07:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.474+0000 7feed3cfa640 1 -- 172.21.15.98:0/2060356115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feecc102d30 msgr2=0x7feecc198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.474+0000 7feed3cfa640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feecc102d30 0x7feecc198560 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7feec800e9f0 tx=0x7feec800eeb0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.474+0000 7feed3cfa640 1 -- 172.21.15.98:0/2060356115 shutdown_connections 2024-09-19T07:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.474+0000 7feed3cfa640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7feeb80a3350 0x7feeb80a5810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.474+0000 7feed3cfa640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feecc1082a0 0x7feecc19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.474+0000 7feed3cfa640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feecc1036e0 0x7feecc198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.474+0000 7feed3cfa640 1 --2- 172.21.15.98:0/2060356115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feecc102d30 0x7feecc198560 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.474+0000 7feed3cfa640 1 -- 172.21.15.98:0/2060356115 >> 172.21.15.98:0/2060356115 conn(0x7feecc0fc7d0 msgr2=0x7feecc105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.474+0000 7feed3cfa640 1 -- 172.21.15.98:0/2060356115 shutdown_connections 2024-09-19T07:21:19.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:19.475+0000 7feed3cfa640 1 -- 172.21.15.98:0/2060356115 wait complete. 2024-09-19T07:21:19.963 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266725 got 227633266727 for osd.8 2024-09-19T07:21:19.964 DEBUG:teuthology.parallel:result is None 2024-09-19T07:21:20.270 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:19 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2750336644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T07:21:20.270 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:19 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2060356115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T07:21:20.297 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645333 got 309237645336 for osd.11 2024-09-19T07:21:20.298 DEBUG:teuthology.parallel:result is None 2024-09-19T07:21:20.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:19 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2750336644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T07:21:20.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:19 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2060356115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T07:21:20.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:19 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2750336644' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T07:21:20.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:19 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2060356115' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T07:21:20.970 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738445 got 34359738447 for osd.0 2024-09-19T07:21:20.970 DEBUG:teuthology.parallel:result is None 2024-09-19T07:21:20.970 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T07:21:20.971 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:21:21.260 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:20 smithi098 ceph-mon[30950]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:21.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:20 smithi139 ceph-mon[35039]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:21.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:20 smithi162 ceph-mon[35726]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:21.794 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:22.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.251+0000 7fb961962640 1 -- 172.21.15.98:0/428364057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c10c170 msgr2=0x7fb95c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:22.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.251+0000 7fb961962640 1 --2- 172.21.15.98:0/428364057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c10c170 0x7fb95c10e610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb954009ca0 tx=0x7fb95402a950 comp rx=0 tx=0).stop 2024-09-19T07:21:22.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.251+0000 7fb961962640 1 -- 172.21.15.98:0/428364057 shutdown_connections 2024-09-19T07:21:22.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.251+0000 7fb961962640 1 --2- 172.21.15.98:0/428364057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c10c170 0x7fb95c10e610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:22.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.251+0000 7fb961962640 1 --2- 172.21.15.98:0/428364057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c103660 0x7fb95c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:22.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.251+0000 7fb961962640 1 --2- 172.21.15.98:0/428364057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c102d40 0x7fb95c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:22.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.251+0000 7fb961962640 1 -- 172.21.15.98:0/428364057 >> 172.21.15.98:0/428364057 conn(0x7fb95c0fc7a0 msgr2=0x7fb95c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:22.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.251+0000 7fb961962640 1 -- 172.21.15.98:0/428364057 shutdown_connections 2024-09-19T07:21:22.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.251+0000 7fb961962640 1 -- 172.21.15.98:0/428364057 wait complete. 2024-09-19T07:21:22.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.252+0000 7fb961962640 1 Processor -- start 2024-09-19T07:21:22.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.252+0000 7fb961962640 1 -- start start 2024-09-19T07:21:22.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.252+0000 7fb961962640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c102d40 0x7fb95c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:22.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.252+0000 7fb961962640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c103660 0x7fb95c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:22.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.252+0000 7fb961962640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c10c170 0x7fb95c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:22.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.252+0000 7fb961962640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c112030 con 0x7fb95c102d40 2024-09-19T07:21:22.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.252+0000 7fb961962640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c111eb0 con 0x7fb95c103660 2024-09-19T07:21:22.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.252+0000 7fb961962640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1121b0 con 0x7fb95c10c170 2024-09-19T07:21:22.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb95affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c102d40 0x7fb95c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:22.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb95affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c102d40 0x7fb95c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51072/0 (socket says 172.21.15.98:51072) 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb95affd640 1 -- 172.21.15.98:0/4137957498 learned_addr learned my addr 172.21.15.98:0/4137957498 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb95b7fe640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c10c170 0x7fb95c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb9527fc640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c103660 0x7fb95c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb95affd640 1 -- 172.21.15.98:0/4137957498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c10c170 msgr2=0x7fb95c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb95affd640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c10c170 0x7fb95c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb95affd640 1 -- 172.21.15.98:0/4137957498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c103660 msgr2=0x7fb95c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb95affd640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c103660 0x7fb95c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb95affd640 1 -- 172.21.15.98:0/4137957498 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c19d4e0 con 0x7fb95c102d40 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb9527fc640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c103660 0x7fb95c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb95affd640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c102d40 0x7fb95c198530 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00b4a0 tx=0x7fb94c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb960960640 1 -- 172.21.15.98:0/4137957498 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c014070 con 0x7fb95c102d40 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb960960640 1 -- 172.21.15.98:0/4137957498 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb94c010af0 con 0x7fb95c102d40 2024-09-19T07:21:22.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb961962640 1 -- 172.21.15.98:0/4137957498 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95c19d7d0 con 0x7fb95c102d40 2024-09-19T07:21:22.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb960960640 1 -- 172.21.15.98:0/4137957498 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c017d10 con 0x7fb95c102d40 2024-09-19T07:21:22.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.253+0000 7fb961962640 1 -- 172.21.15.98:0/4137957498 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb95c1a50b0 con 0x7fb95c102d40 2024-09-19T07:21:22.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.254+0000 7fb961962640 1 -- 172.21.15.98:0/4137957498 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb95c1031a0 con 0x7fb95c102d40 2024-09-19T07:21:22.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.255+0000 7fb960960640 1 -- 172.21.15.98:0/4137957498 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb94c017070 con 0x7fb95c102d40 2024-09-19T07:21:22.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.256+0000 7fb960960640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb9480a32d0 0x7fb9480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:22.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.256+0000 7fb9527fc640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb9480a32d0 0x7fb9480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:22.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.256+0000 7fb960960640 1 -- 172.21.15.98:0/4137957498 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb94c0cf1c0 con 0x7fb95c102d40 2024-09-19T07:21:22.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.257+0000 7fb9527fc640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb9480a32d0 0x7fb9480a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb944006fd0 tx=0x7fb944008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:22.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.259+0000 7fb960960640 1 -- 172.21.15.98:0/4137957498 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb94c09be70 con 0x7fb95c102d40 2024-09-19T07:21:22.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.442+0000 7fb961962640 1 -- 172.21.15.98:0/4137957498 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb95c062630 con 0x7fb9480a32d0 2024-09-19T07:21:22.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.449+0000 7fb960960640 1 -- 172.21.15.98:0/4137957498 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258711 (secure 0 0 0) 0x7fb95c062630 con 0x7fb9480a32d0 2024-09-19T07:21:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:22.454 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-19T07:21:22.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.453+0000 7fb961962640 1 -- 172.21.15.98:0/4137957498 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb9480a32d0 msgr2=0x7fb9480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:22.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.453+0000 7fb961962640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb9480a32d0 0x7fb9480a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb944006fd0 tx=0x7fb944008040 comp rx=0 tx=0).stop 2024-09-19T07:21:22.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.453+0000 7fb961962640 1 -- 172.21.15.98:0/4137957498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c102d40 msgr2=0x7fb95c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:22.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.453+0000 7fb961962640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c102d40 0x7fb95c198530 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00b4a0 tx=0x7fb94c00b960 comp rx=0 tx=0).stop 2024-09-19T07:21:22.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.454+0000 7fb961962640 1 -- 172.21.15.98:0/4137957498 shutdown_connections 2024-09-19T07:21:22.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.454+0000 7fb961962640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb9480a32d0 0x7fb9480a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:22.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.454+0000 7fb961962640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c10c170 0x7fb95c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:22.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.454+0000 7fb961962640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c103660 0x7fb95c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:22.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.454+0000 7fb961962640 1 --2- 172.21.15.98:0/4137957498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c102d40 0x7fb95c198530 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:22.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.454+0000 7fb961962640 1 -- 172.21.15.98:0/4137957498 >> 172.21.15.98:0/4137957498 conn(0x7fb95c0fc7a0 msgr2=0x7fb95c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:22.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.454+0000 7fb961962640 1 -- 172.21.15.98:0/4137957498 shutdown_connections 2024-09-19T07:21:22.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:22.454+0000 7fb961962640 1 -- 172.21.15.98:0/4137957498 wait complete. 2024-09-19T07:21:23.131 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2024-09-19T07:21:20.664174+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653976,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":448,"num_read_kb":339,"num_write":346,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1208265,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353404,"kb_used_data":12444,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588420,"statfs":{"total":1151940427776,"available":1151578542080,"internally_reserved":0,"allocated":12742656,"data_stored":7094052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002706"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788444+0000","last_change":"2024-09-19T07:20:19.535372+0000","last_active":"2024-09-19T07:20:37.788444+0000","last_peered":"2024-09-19T07:20:37.788444+0000","last_clean":"2024-09-19T07:20:37.788444+0000","last_became_active":"2024-09-19T07:20:19.535079+0000","last_became_peered":"2024-09-19T07:20:19.535079+0000","last_unstale":"2024-09-19T07:20:37.788444+0000","last_undegraded":"2024-09-19T07:20:37.788444+0000","last_fullsized":"2024-09-19T07:20:37.788444+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:56.856451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480864+0000","last_change":"2024-09-19T07:20:19.528531+0000","last_active":"2024-09-19T07:20:38.480864+0000","last_peered":"2024-09-19T07:20:38.480864+0000","last_clean":"2024-09-19T07:20:38.480864+0000","last_became_active":"2024-09-19T07:20:19.528218+0000","last_became_peered":"2024-09-19T07:20:19.528218+0000","last_unstale":"2024-09-19T07:20:38.480864+0000","last_undegraded":"2024-09-19T07:20:38.480864+0000","last_fullsized":"2024-09-19T07:20:38.480864+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:44.730220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480860+0000","last_change":"2024-09-19T07:20:19.533516+0000","last_active":"2024-09-19T07:20:38.480860+0000","last_peered":"2024-09-19T07:20:38.480860+0000","last_clean":"2024-09-19T07:20:38.480860+0000","last_became_active":"2024-09-19T07:20:19.533247+0000","last_became_peered":"2024-09-19T07:20:19.533247+0000","last_unstale":"2024-09-19T07:20:38.480860+0000","last_undegraded":"2024-09-19T07:20:38.480860+0000","last_fullsized":"2024-09-19T07:20:38.480860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:29.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943443+0000","last_change":"2024-09-19T07:20:19.543245+0000","last_active":"2024-09-19T07:20:37.943443+0000","last_peered":"2024-09-19T07:20:37.943443+0000","last_clean":"2024-09-19T07:20:37.943443+0000","last_became_active":"2024-09-19T07:20:19.542840+0000","last_became_peered":"2024-09-19T07:20:19.542840+0000","last_unstale":"2024-09-19T07:20:37.943443+0000","last_undegraded":"2024-09-19T07:20:37.943443+0000","last_fullsized":"2024-09-19T07:20:37.943443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:21.780027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790342+0000","last_change":"2024-09-19T07:20:19.528880+0000","last_active":"2024-09-19T07:20:37.790342+0000","last_peered":"2024-09-19T07:20:37.790342+0000","last_clean":"2024-09-19T07:20:37.790342+0000","last_became_active":"2024-09-19T07:20:19.528592+0000","last_became_peered":"2024-09-19T07:20:19.528592+0000","last_unstale":"2024-09-19T07:20:37.790342+0000","last_undegraded":"2024-09-19T07:20:37.790342+0000","last_fullsized":"2024-09-19T07:20:37.790342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:59.718929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790665+0000","last_change":"2024-09-19T07:20:19.538480+0000","last_active":"2024-09-19T07:20:37.790665+0000","last_peered":"2024-09-19T07:20:37.790665+0000","last_clean":"2024-09-19T07:20:37.790665+0000","last_became_active":"2024-09-19T07:20:19.538189+0000","last_became_peered":"2024-09-19T07:20:19.538189+0000","last_unstale":"2024-09-19T07:20:37.790665+0000","last_undegraded":"2024-09-19T07:20:37.790665+0000","last_fullsized":"2024-09-19T07:20:37.790665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:29.607974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791790+0000","last_change":"2024-09-19T07:20:19.538877+0000","last_active":"2024-09-19T07:20:37.791790+0000","last_peered":"2024-09-19T07:20:37.791790+0000","last_clean":"2024-09-19T07:20:37.791790+0000","last_became_active":"2024-09-19T07:20:19.538551+0000","last_became_peered":"2024-09-19T07:20:19.538551+0000","last_unstale":"2024-09-19T07:20:37.791790+0000","last_undegraded":"2024-09-19T07:20:37.791790+0000","last_fullsized":"2024-09-19T07:20:37.791790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:52.114115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786641+0000","last_change":"2024-09-19T07:20:19.538135+0000","last_active":"2024-09-19T07:20:37.786641+0000","last_peered":"2024-09-19T07:20:37.786641+0000","last_clean":"2024-09-19T07:20:37.786641+0000","last_became_active":"2024-09-19T07:20:19.537769+0000","last_became_peered":"2024-09-19T07:20:19.537769+0000","last_unstale":"2024-09-19T07:20:37.786641+0000","last_undegraded":"2024-09-19T07:20:37.786641+0000","last_fullsized":"2024-09-19T07:20:37.786641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:21.304262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.794226+0000","last_change":"2024-09-19T07:20:19.531569+0000","last_active":"2024-09-19T07:20:37.794226+0000","last_peered":"2024-09-19T07:20:37.794226+0000","last_clean":"2024-09-19T07:20:37.794226+0000","last_became_active":"2024-09-19T07:20:19.529455+0000","last_became_peered":"2024-09-19T07:20:19.529455+0000","last_unstale":"2024-09-19T07:20:37.794226+0000","last_undegraded":"2024-09-19T07:20:37.794226+0000","last_fullsized":"2024-09-19T07:20:37.794226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:22.187968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791187+0000","last_change":"2024-09-19T07:20:19.540342+0000","last_active":"2024-09-19T07:20:37.791187+0000","last_peered":"2024-09-19T07:20:37.791187+0000","last_clean":"2024-09-19T07:20:37.791187+0000","last_became_active":"2024-09-19T07:20:19.539870+0000","last_became_peered":"2024-09-19T07:20:19.539870+0000","last_unstale":"2024-09-19T07:20:37.791187+0000","last_undegraded":"2024-09-19T07:20:37.791187+0000","last_fullsized":"2024-09-19T07:20:37.791187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:39.930671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791533+0000","last_change":"2024-09-19T07:20:19.536004+0000","last_active":"2024-09-19T07:20:37.791533+0000","last_peered":"2024-09-19T07:20:37.791533+0000","last_clean":"2024-09-19T07:20:37.791533+0000","last_became_active":"2024-09-19T07:20:19.535640+0000","last_became_peered":"2024-09-19T07:20:19.535640+0000","last_unstale":"2024-09-19T07:20:37.791533+0000","last_undegraded":"2024-09-19T07:20:37.791533+0000","last_fullsized":"2024-09-19T07:20:37.791533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:47.853411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943531+0000","last_change":"2024-09-19T07:20:19.539374+0000","last_active":"2024-09-19T07:20:37.943531+0000","last_peered":"2024-09-19T07:20:37.943531+0000","last_clean":"2024-09-19T07:20:37.943531+0000","last_became_active":"2024-09-19T07:20:19.538880+0000","last_became_peered":"2024-09-19T07:20:19.538880+0000","last_unstale":"2024-09-19T07:20:37.943531+0000","last_undegraded":"2024-09-19T07:20:37.943531+0000","last_fullsized":"2024-09-19T07:20:37.943531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:55.484232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792753+0000","last_change":"2024-09-19T07:20:37.792753+0000","last_active":"2024-09-19T07:20:37.792753+0000","last_peered":"2024-09-19T07:20:37.792753+0000","last_clean":"2024-09-19T07:20:37.792753+0000","last_became_active":"2024-09-19T07:20:37.792417+0000","last_became_peered":"2024-09-19T07:20:37.792417+0000","last_unstale":"2024-09-19T07:20:37.792753+0000","last_undegraded":"2024-09-19T07:20:37.792753+0000","last_fullsized":"2024-09-19T07:20:37.792753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:10.417367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480887+0000","last_change":"2024-09-19T07:20:19.528842+0000","last_active":"2024-09-19T07:20:38.480887+0000","last_peered":"2024-09-19T07:20:38.480887+0000","last_clean":"2024-09-19T07:20:38.480887+0000","last_became_active":"2024-09-19T07:20:19.528042+0000","last_became_peered":"2024-09-19T07:20:19.528042+0000","last_unstale":"2024-09-19T07:20:38.480887+0000","last_undegraded":"2024-09-19T07:20:38.480887+0000","last_fullsized":"2024-09-19T07:20:38.480887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:34.970509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480784+0000","last_change":"2024-09-19T07:20:19.535013+0000","last_active":"2024-09-19T07:20:38.480784+0000","last_peered":"2024-09-19T07:20:38.480784+0000","last_clean":"2024-09-19T07:20:38.480784+0000","last_became_active":"2024-09-19T07:20:19.534302+0000","last_became_peered":"2024-09-19T07:20:19.534302+0000","last_unstale":"2024-09-19T07:20:38.480784+0000","last_undegraded":"2024-09-19T07:20:38.480784+0000","last_fullsized":"2024-09-19T07:20:38.480784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:52.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793587+0000","last_change":"2024-09-19T07:20:19.534930+0000","last_active":"2024-09-19T07:20:37.793587+0000","last_peered":"2024-09-19T07:20:37.793587+0000","last_clean":"2024-09-19T07:20:37.793587+0000","last_became_active":"2024-09-19T07:20:19.534640+0000","last_became_peered":"2024-09-19T07:20:19.534640+0000","last_unstale":"2024-09-19T07:20:37.793587+0000","last_undegraded":"2024-09-19T07:20:37.793587+0000","last_fullsized":"2024-09-19T07:20:37.793587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:23.055097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788533+0000","last_change":"2024-09-19T07:20:19.535856+0000","last_active":"2024-09-19T07:20:37.788533+0000","last_peered":"2024-09-19T07:20:37.788533+0000","last_clean":"2024-09-19T07:20:37.788533+0000","last_became_active":"2024-09-19T07:20:19.535561+0000","last_became_peered":"2024-09-19T07:20:19.535561+0000","last_unstale":"2024-09-19T07:20:37.788533+0000","last_undegraded":"2024-09-19T07:20:37.788533+0000","last_fullsized":"2024-09-19T07:20:37.788533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:03.943339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788597+0000","last_change":"2024-09-19T07:20:19.528429+0000","last_active":"2024-09-19T07:20:37.788597+0000","last_peered":"2024-09-19T07:20:37.788597+0000","last_clean":"2024-09-19T07:20:37.788597+0000","last_became_active":"2024-09-19T07:20:19.528107+0000","last_became_peered":"2024-09-19T07:20:19.528107+0000","last_unstale":"2024-09-19T07:20:37.788597+0000","last_undegraded":"2024-09-19T07:20:37.788597+0000","last_fullsized":"2024-09-19T07:20:37.788597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:49.520514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791782+0000","last_change":"2024-09-19T07:20:19.532966+0000","last_active":"2024-09-19T07:20:37.791782+0000","last_peered":"2024-09-19T07:20:37.791782+0000","last_clean":"2024-09-19T07:20:37.791782+0000","last_became_active":"2024-09-19T07:20:19.532412+0000","last_became_peered":"2024-09-19T07:20:19.532412+0000","last_unstale":"2024-09-19T07:20:37.791782+0000","last_undegraded":"2024-09-19T07:20:37.791782+0000","last_fullsized":"2024-09-19T07:20:37.791782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:42.900136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.797952+0000","last_change":"2024-09-19T07:20:37.797952+0000","last_active":"2024-09-19T07:20:37.797952+0000","last_peered":"2024-09-19T07:20:37.797952+0000","last_clean":"2024-09-19T07:20:37.797952+0000","last_became_active":"2024-09-19T07:20:37.797459+0000","last_became_peered":"2024-09-19T07:20:37.797459+0000","last_unstale":"2024-09-19T07:20:37.797952+0000","last_undegraded":"2024-09-19T07:20:37.797952+0000","last_fullsized":"2024-09-19T07:20:37.797952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:44.132477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790125+0000","last_change":"2024-09-19T07:20:19.532193+0000","last_active":"2024-09-19T07:20:37.790125+0000","last_peered":"2024-09-19T07:20:37.790125+0000","last_clean":"2024-09-19T07:20:37.790125+0000","last_became_active":"2024-09-19T07:20:19.531890+0000","last_became_peered":"2024-09-19T07:20:19.531890+0000","last_unstale":"2024-09-19T07:20:37.790125+0000","last_undegraded":"2024-09-19T07:20:37.790125+0000","last_fullsized":"2024-09-19T07:20:37.790125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:21.168993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793717+0000","last_change":"2024-09-19T07:20:19.535034+0000","last_active":"2024-09-19T07:20:37.793717+0000","last_peered":"2024-09-19T07:20:37.793717+0000","last_clean":"2024-09-19T07:20:37.793717+0000","last_became_active":"2024-09-19T07:20:19.534732+0000","last_became_peered":"2024-09-19T07:20:19.534732+0000","last_unstale":"2024-09-19T07:20:37.793717+0000","last_undegraded":"2024-09-19T07:20:37.793717+0000","last_fullsized":"2024-09-19T07:20:37.793717+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:13.726672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786690+0000","last_change":"2024-09-19T07:20:19.532644+0000","last_active":"2024-09-19T07:20:37.786690+0000","last_peered":"2024-09-19T07:20:37.786690+0000","last_clean":"2024-09-19T07:20:37.786690+0000","last_became_active":"2024-09-19T07:20:19.532364+0000","last_became_peered":"2024-09-19T07:20:19.532364+0000","last_unstale":"2024-09-19T07:20:37.786690+0000","last_undegraded":"2024-09-19T07:20:37.786690+0000","last_fullsized":"2024-09-19T07:20:37.786690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:17.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792578+0000","last_change":"2024-09-19T07:20:19.533500+0000","last_active":"2024-09-19T07:20:37.792578+0000","last_peered":"2024-09-19T07:20:37.792578+0000","last_clean":"2024-09-19T07:20:37.792578+0000","last_became_active":"2024-09-19T07:20:19.532759+0000","last_became_peered":"2024-09-19T07:20:19.532759+0000","last_unstale":"2024-09-19T07:20:37.792578+0000","last_undegraded":"2024-09-19T07:20:37.792578+0000","last_fullsized":"2024-09-19T07:20:37.792578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:35.549776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793776+0000","last_change":"2024-09-19T07:20:37.793776+0000","last_active":"2024-09-19T07:20:37.793776+0000","last_peered":"2024-09-19T07:20:37.793776+0000","last_clean":"2024-09-19T07:20:37.793776+0000","last_became_active":"2024-09-19T07:20:37.793382+0000","last_became_peered":"2024-09-19T07:20:37.793382+0000","last_unstale":"2024-09-19T07:20:37.793776+0000","last_undegraded":"2024-09-19T07:20:37.793776+0000","last_fullsized":"2024-09-19T07:20:37.793776+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:00.422534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791854+0000","last_change":"2024-09-19T07:20:19.532840+0000","last_active":"2024-09-19T07:20:37.791854+0000","last_peered":"2024-09-19T07:20:37.791854+0000","last_clean":"2024-09-19T07:20:37.791854+0000","last_became_active":"2024-09-19T07:20:19.532059+0000","last_became_peered":"2024-09-19T07:20:19.532059+0000","last_unstale":"2024-09-19T07:20:37.791854+0000","last_undegraded":"2024-09-19T07:20:37.791854+0000","last_fullsized":"2024-09-19T07:20:37.791854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:49.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788391+0000","last_change":"2024-09-19T07:20:19.528150+0000","last_active":"2024-09-19T07:20:37.788391+0000","last_peered":"2024-09-19T07:20:37.788391+0000","last_clean":"2024-09-19T07:20:37.788391+0000","last_became_active":"2024-09-19T07:20:19.527873+0000","last_became_peered":"2024-09-19T07:20:19.527873+0000","last_unstale":"2024-09-19T07:20:37.788391+0000","last_undegraded":"2024-09-19T07:20:37.788391+0000","last_fullsized":"2024-09-19T07:20:37.788391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.561937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789841+0000","last_change":"2024-09-19T07:20:19.540160+0000","last_active":"2024-09-19T07:20:37.789841+0000","last_peered":"2024-09-19T07:20:37.789841+0000","last_clean":"2024-09-19T07:20:37.789841+0000","last_became_active":"2024-09-19T07:20:19.539862+0000","last_became_peered":"2024-09-19T07:20:19.539862+0000","last_unstale":"2024-09-19T07:20:37.789841+0000","last_undegraded":"2024-09-19T07:20:37.789841+0000","last_fullsized":"2024-09-19T07:20:37.789841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:22.229785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480983+0000","last_change":"2024-09-19T07:20:19.540363+0000","last_active":"2024-09-19T07:20:38.480983+0000","last_peered":"2024-09-19T07:20:38.480983+0000","last_clean":"2024-09-19T07:20:38.480983+0000","last_became_active":"2024-09-19T07:20:19.540068+0000","last_became_peered":"2024-09-19T07:20:19.540068+0000","last_unstale":"2024-09-19T07:20:38.480983+0000","last_undegraded":"2024-09-19T07:20:38.480983+0000","last_fullsized":"2024-09-19T07:20:38.480983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:07.955849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790286+0000","last_change":"2024-09-19T07:20:19.533546+0000","last_active":"2024-09-19T07:20:37.790286+0000","last_peered":"2024-09-19T07:20:37.790286+0000","last_clean":"2024-09-19T07:20:37.790286+0000","last_became_active":"2024-09-19T07:20:19.533232+0000","last_became_peered":"2024-09-19T07:20:19.533232+0000","last_unstale":"2024-09-19T07:20:37.790286+0000","last_undegraded":"2024-09-19T07:20:37.790286+0000","last_fullsized":"2024-09-19T07:20:37.790286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:29.674866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791434+0000","last_change":"2024-09-19T07:20:19.542842+0000","last_active":"2024-09-19T07:20:37.791434+0000","last_peered":"2024-09-19T07:20:37.791434+0000","last_clean":"2024-09-19T07:20:37.791434+0000","last_became_active":"2024-09-19T07:20:19.542477+0000","last_became_peered":"2024-09-19T07:20:19.542477+0000","last_unstale":"2024-09-19T07:20:37.791434+0000","last_undegraded":"2024-09-19T07:20:37.791434+0000","last_fullsized":"2024-09-19T07:20:37.791434+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:30.921099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788038+0000","last_change":"2024-09-19T07:20:19.530472+0000","last_active":"2024-09-19T07:20:37.788038+0000","last_peered":"2024-09-19T07:20:37.788038+0000","last_clean":"2024-09-19T07:20:37.788038+0000","last_became_active":"2024-09-19T07:20:19.529457+0000","last_became_peered":"2024-09-19T07:20:19.529457+0000","last_unstale":"2024-09-19T07:20:37.788038+0000","last_undegraded":"2024-09-19T07:20:37.788038+0000","last_fullsized":"2024-09-19T07:20:37.788038+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:16.410723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.801168+0000","last_change":"2024-09-19T07:20:37.801168+0000","last_active":"2024-09-19T07:20:37.801168+0000","last_peered":"2024-09-19T07:20:37.801168+0000","last_clean":"2024-09-19T07:20:37.801168+0000","last_became_active":"2024-09-19T07:20:37.800613+0000","last_became_peered":"2024-09-19T07:20:37.800613+0000","last_unstale":"2024-09-19T07:20:37.801168+0000","last_undegraded":"2024-09-19T07:20:37.801168+0000","last_fullsized":"2024-09-19T07:20:37.801168+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:27.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:21:14.828020+0000","last_change":"2024-09-19T07:20:17.524656+0000","last_active":"2024-09-19T07:21:14.828020+0000","last_peered":"2024-09-19T07:21:14.828020+0000","last_clean":"2024-09-19T07:21:14.828020+0000","last_became_active":"2024-09-19T07:20:17.524350+0000","last_became_peered":"2024-09-19T07:20:17.524350+0000","last_unstale":"2024-09-19T07:21:14.828020+0000","last_undegraded":"2024-09-19T07:21:14.828020+0000","last_fullsized":"2024-09-19T07:21:14.828020+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:00.459283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792702+0000","last_change":"2024-09-19T07:20:19.536895+0000","last_active":"2024-09-19T07:20:37.792702+0000","last_peered":"2024-09-19T07:20:37.792702+0000","last_clean":"2024-09-19T07:20:37.792702+0000","last_became_active":"2024-09-19T07:20:19.536569+0000","last_became_peered":"2024-09-19T07:20:19.536569+0000","last_unstale":"2024-09-19T07:20:37.792702+0000","last_undegraded":"2024-09-19T07:20:37.792702+0000","last_fullsized":"2024-09-19T07:20:37.792702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:56.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790688+0000","last_change":"2024-09-19T07:20:17.519800+0000","last_active":"2024-09-19T07:20:37.790688+0000","last_peered":"2024-09-19T07:20:37.790688+0000","last_clean":"2024-09-19T07:20:37.790688+0000","last_became_active":"2024-09-19T07:20:17.519384+0000","last_became_peered":"2024-09-19T07:20:17.519384+0000","last_unstale":"2024-09-19T07:20:37.790688+0000","last_undegraded":"2024-09-19T07:20:37.790688+0000","last_fullsized":"2024-09-19T07:20:37.790688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:17.346946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789970+0000","last_change":"2024-09-19T07:20:17.511178+0000","last_active":"2024-09-19T07:20:37.789970+0000","last_peered":"2024-09-19T07:20:37.789970+0000","last_clean":"2024-09-19T07:20:37.789970+0000","last_became_active":"2024-09-19T07:20:17.510646+0000","last_became_peered":"2024-09-19T07:20:17.510646+0000","last_unstale":"2024-09-19T07:20:37.789970+0000","last_undegraded":"2024-09-19T07:20:37.789970+0000","last_fullsized":"2024-09-19T07:20:37.789970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:58.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786720+0000","last_change":"2024-09-19T07:20:19.532979+0000","last_active":"2024-09-19T07:20:37.786720+0000","last_peered":"2024-09-19T07:20:37.786720+0000","last_clean":"2024-09-19T07:20:37.786720+0000","last_became_active":"2024-09-19T07:20:19.532396+0000","last_became_peered":"2024-09-19T07:20:19.532396+0000","last_unstale":"2024-09-19T07:20:37.786720+0000","last_undegraded":"2024-09-19T07:20:37.786720+0000","last_fullsized":"2024-09-19T07:20:37.786720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:24.313572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792865+0000","last_change":"2024-09-19T07:20:17.519327+0000","last_active":"2024-09-19T07:20:37.792865+0000","last_peered":"2024-09-19T07:20:37.792865+0000","last_clean":"2024-09-19T07:20:37.792865+0000","last_became_active":"2024-09-19T07:20:17.518916+0000","last_became_peered":"2024-09-19T07:20:17.518916+0000","last_unstale":"2024-09-19T07:20:37.792865+0000","last_undegraded":"2024-09-19T07:20:37.792865+0000","last_fullsized":"2024-09-19T07:20:37.792865+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:52.672016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788221+0000","last_change":"2024-09-19T07:20:19.528642+0000","last_active":"2024-09-19T07:20:37.788221+0000","last_peered":"2024-09-19T07:20:37.788221+0000","last_clean":"2024-09-19T07:20:37.788221+0000","last_became_active":"2024-09-19T07:20:19.528302+0000","last_became_peered":"2024-09-19T07:20:19.528302+0000","last_unstale":"2024-09-19T07:20:37.788221+0000","last_undegraded":"2024-09-19T07:20:37.788221+0000","last_fullsized":"2024-09-19T07:20:37.788221+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:22.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:21:15.828907+0000","last_change":"2024-09-19T07:20:17.519144+0000","last_active":"2024-09-19T07:21:15.828907+0000","last_peered":"2024-09-19T07:21:15.828907+0000","last_clean":"2024-09-19T07:21:15.828907+0000","last_became_active":"2024-09-19T07:20:17.518714+0000","last_became_peered":"2024-09-19T07:20:17.518714+0000","last_unstale":"2024-09-19T07:21:15.828907+0000","last_undegraded":"2024-09-19T07:21:15.828907+0000","last_fullsized":"2024-09-19T07:21:15.828907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:09.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793978+0000","last_change":"2024-09-19T07:20:19.532293+0000","last_active":"2024-09-19T07:20:37.793978+0000","last_peered":"2024-09-19T07:20:37.793978+0000","last_clean":"2024-09-19T07:20:37.793978+0000","last_became_active":"2024-09-19T07:20:19.531427+0000","last_became_peered":"2024-09-19T07:20:19.531427+0000","last_unstale":"2024-09-19T07:20:37.793978+0000","last_undegraded":"2024-09-19T07:20:37.793978+0000","last_fullsized":"2024-09-19T07:20:37.793978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:31.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791783+0000","last_change":"2024-09-19T07:20:17.521743+0000","last_active":"2024-09-19T07:20:37.791783+0000","last_peered":"2024-09-19T07:20:37.791783+0000","last_clean":"2024-09-19T07:20:37.791783+0000","last_became_active":"2024-09-19T07:20:17.521321+0000","last_became_peered":"2024-09-19T07:20:17.521321+0000","last_unstale":"2024-09-19T07:20:37.791783+0000","last_undegraded":"2024-09-19T07:20:37.791783+0000","last_fullsized":"2024-09-19T07:20:37.791783+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:21.107210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.481104+0000","last_change":"2024-09-19T07:20:19.532879+0000","last_active":"2024-09-19T07:20:38.481104+0000","last_peered":"2024-09-19T07:20:38.481104+0000","last_clean":"2024-09-19T07:20:38.481104+0000","last_became_active":"2024-09-19T07:20:19.532490+0000","last_became_peered":"2024-09-19T07:20:19.532490+0000","last_unstale":"2024-09-19T07:20:38.481104+0000","last_undegraded":"2024-09-19T07:20:38.481104+0000","last_fullsized":"2024-09-19T07:20:38.481104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:06.534849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793822+0000","last_change":"2024-09-19T07:20:17.565759+0000","last_active":"2024-09-19T07:20:37.793822+0000","last_peered":"2024-09-19T07:20:37.793822+0000","last_clean":"2024-09-19T07:20:37.793822+0000","last_became_active":"2024-09-19T07:20:17.565334+0000","last_became_peered":"2024-09-19T07:20:17.565334+0000","last_unstale":"2024-09-19T07:20:37.793822+0000","last_undegraded":"2024-09-19T07:20:37.793822+0000","last_fullsized":"2024-09-19T07:20:37.793822+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.588515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793971+0000","last_change":"2024-09-19T07:20:19.537397+0000","last_active":"2024-09-19T07:20:37.793971+0000","last_peered":"2024-09-19T07:20:37.793971+0000","last_clean":"2024-09-19T07:20:37.793971+0000","last_became_active":"2024-09-19T07:20:19.537059+0000","last_became_peered":"2024-09-19T07:20:19.537059+0000","last_unstale":"2024-09-19T07:20:37.793971+0000","last_undegraded":"2024-09-19T07:20:37.793971+0000","last_fullsized":"2024-09-19T07:20:37.793971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:30.146934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":173,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:21:17.005423+0000","last_change":"2024-09-19T07:20:37.956721+0000","last_active":"2024-09-19T07:21:17.005423+0000","last_peered":"2024-09-19T07:21:17.005423+0000","last_clean":"2024-09-19T07:21:17.005423+0000","last_became_active":"2024-09-19T07:20:37.944159+0000","last_became_peered":"2024-09-19T07:20:37.944159+0000","last_unstale":"2024-09-19T07:21:17.005423+0000","last_undegraded":"2024-09-19T07:21:17.005423+0000","last_fullsized":"2024-09-19T07:21:17.005423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:52.944073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":104,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790648+0000","last_change":"2024-09-19T07:20:19.531533+0000","last_active":"2024-09-19T07:20:37.790648+0000","last_peered":"2024-09-19T07:20:37.790648+0000","last_clean":"2024-09-19T07:20:37.790648+0000","last_became_active":"2024-09-19T07:20:19.531228+0000","last_became_peered":"2024-09-19T07:20:19.531228+0000","last_unstale":"2024-09-19T07:20:37.790648+0000","last_undegraded":"2024-09-19T07:20:37.790648+0000","last_fullsized":"2024-09-19T07:20:37.790648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:34.606957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791767+0000","last_change":"2024-09-19T07:20:17.522411+0000","last_active":"2024-09-19T07:20:37.791767+0000","last_peered":"2024-09-19T07:20:37.791767+0000","last_clean":"2024-09-19T07:20:37.791767+0000","last_became_active":"2024-09-19T07:20:17.522086+0000","last_became_peered":"2024-09-19T07:20:17.522086+0000","last_unstale":"2024-09-19T07:20:37.791767+0000","last_undegraded":"2024-09-19T07:20:37.791767+0000","last_fullsized":"2024-09-19T07:20:37.791767+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.299624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789801+0000","last_change":"2024-09-19T07:20:19.532527+0000","last_active":"2024-09-19T07:20:37.789801+0000","last_peered":"2024-09-19T07:20:37.789801+0000","last_clean":"2024-09-19T07:20:37.789801+0000","last_became_active":"2024-09-19T07:20:19.532219+0000","last_became_peered":"2024-09-19T07:20:19.532219+0000","last_unstale":"2024-09-19T07:20:37.789801+0000","last_undegraded":"2024-09-19T07:20:37.789801+0000","last_fullsized":"2024-09-19T07:20:37.789801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:05.878229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792401+0000","last_change":"2024-09-19T07:20:17.518014+0000","last_active":"2024-09-19T07:20:37.792401+0000","last_peered":"2024-09-19T07:20:37.792401+0000","last_clean":"2024-09-19T07:20:37.792401+0000","last_became_active":"2024-09-19T07:20:17.517077+0000","last_became_peered":"2024-09-19T07:20:17.517077+0000","last_unstale":"2024-09-19T07:20:37.792401+0000","last_undegraded":"2024-09-19T07:20:37.792401+0000","last_fullsized":"2024-09-19T07:20:37.792401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:45.893365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791494+0000","last_change":"2024-09-19T07:20:19.539347+0000","last_active":"2024-09-19T07:20:37.791494+0000","last_peered":"2024-09-19T07:20:37.791494+0000","last_clean":"2024-09-19T07:20:37.791494+0000","last_became_active":"2024-09-19T07:20:19.538884+0000","last_became_peered":"2024-09-19T07:20:19.538884+0000","last_unstale":"2024-09-19T07:20:37.791494+0000","last_undegraded":"2024-09-19T07:20:37.791494+0000","last_fullsized":"2024-09-19T07:20:37.791494+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:23.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:21:14.827317+0000","last_change":"2024-09-19T07:20:17.513756+0000","last_active":"2024-09-19T07:21:14.827317+0000","last_peered":"2024-09-19T07:21:14.827317+0000","last_clean":"2024-09-19T07:21:14.827317+0000","last_became_active":"2024-09-19T07:20:17.513433+0000","last_became_peered":"2024-09-19T07:20:17.513433+0000","last_unstale":"2024-09-19T07:21:14.827317+0000","last_undegraded":"2024-09-19T07:21:14.827317+0000","last_fullsized":"2024-09-19T07:21:14.827317+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:27.681161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792289+0000","last_change":"2024-09-19T07:20:19.539873+0000","last_active":"2024-09-19T07:20:37.792289+0000","last_peered":"2024-09-19T07:20:37.792289+0000","last_clean":"2024-09-19T07:20:37.792289+0000","last_became_active":"2024-09-19T07:20:19.539581+0000","last_became_peered":"2024-09-19T07:20:19.539581+0000","last_unstale":"2024-09-19T07:20:37.792289+0000","last_undegraded":"2024-09-19T07:20:37.792289+0000","last_fullsized":"2024-09-19T07:20:37.792289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:31.164179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790603+0000","last_change":"2024-09-19T07:20:17.565864+0000","last_active":"2024-09-19T07:20:37.790603+0000","last_peered":"2024-09-19T07:20:37.790603+0000","last_clean":"2024-09-19T07:20:37.790603+0000","last_became_active":"2024-09-19T07:20:17.565459+0000","last_became_peered":"2024-09-19T07:20:17.565459+0000","last_unstale":"2024-09-19T07:20:37.790603+0000","last_undegraded":"2024-09-19T07:20:37.790603+0000","last_fullsized":"2024-09-19T07:20:37.790603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:15.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.800857+0000","last_change":"2024-09-19T07:20:37.800857+0000","last_active":"2024-09-19T07:20:37.800857+0000","last_peered":"2024-09-19T07:20:37.800857+0000","last_clean":"2024-09-19T07:20:37.800857+0000","last_became_active":"2024-09-19T07:20:37.800347+0000","last_became_peered":"2024-09-19T07:20:37.800347+0000","last_unstale":"2024-09-19T07:20:37.800857+0000","last_undegraded":"2024-09-19T07:20:37.800857+0000","last_fullsized":"2024-09-19T07:20:37.800857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:48.678208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791580+0000","last_change":"2024-09-19T07:20:17.521439+0000","last_active":"2024-09-19T07:20:37.791580+0000","last_peered":"2024-09-19T07:20:37.791580+0000","last_clean":"2024-09-19T07:20:37.791580+0000","last_became_active":"2024-09-19T07:20:17.521021+0000","last_became_peered":"2024-09-19T07:20:17.521021+0000","last_unstale":"2024-09-19T07:20:37.791580+0000","last_undegraded":"2024-09-19T07:20:37.791580+0000","last_fullsized":"2024-09-19T07:20:37.791580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.322352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788196+0000","last_change":"2024-09-19T07:20:19.531234+0000","last_active":"2024-09-19T07:20:37.788196+0000","last_peered":"2024-09-19T07:20:37.788196+0000","last_clean":"2024-09-19T07:20:37.788196+0000","last_became_active":"2024-09-19T07:20:19.530422+0000","last_became_peered":"2024-09-19T07:20:19.530422+0000","last_unstale":"2024-09-19T07:20:37.788196+0000","last_undegraded":"2024-09-19T07:20:37.788196+0000","last_fullsized":"2024-09-19T07:20:37.788196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:57.325415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789844+0000","last_change":"2024-09-19T07:20:17.522426+0000","last_active":"2024-09-19T07:20:37.789844+0000","last_peered":"2024-09-19T07:20:37.789844+0000","last_clean":"2024-09-19T07:20:37.789844+0000","last_became_active":"2024-09-19T07:20:17.522061+0000","last_became_peered":"2024-09-19T07:20:17.522061+0000","last_unstale":"2024-09-19T07:20:37.789844+0000","last_undegraded":"2024-09-19T07:20:37.789844+0000","last_fullsized":"2024-09-19T07:20:37.789844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:04.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792454+0000","last_change":"2024-09-19T07:20:19.543420+0000","last_active":"2024-09-19T07:20:37.792454+0000","last_peered":"2024-09-19T07:20:37.792454+0000","last_clean":"2024-09-19T07:20:37.792454+0000","last_became_active":"2024-09-19T07:20:19.542294+0000","last_became_peered":"2024-09-19T07:20:19.542294+0000","last_unstale":"2024-09-19T07:20:37.792454+0000","last_undegraded":"2024-09-19T07:20:37.792454+0000","last_fullsized":"2024-09-19T07:20:37.792454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:32.119366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.794273+0000","last_change":"2024-09-19T07:20:17.518402+0000","last_active":"2024-09-19T07:20:37.794273+0000","last_peered":"2024-09-19T07:20:37.794273+0000","last_clean":"2024-09-19T07:20:37.794273+0000","last_became_active":"2024-09-19T07:20:17.517524+0000","last_became_peered":"2024-09-19T07:20:17.517524+0000","last_unstale":"2024-09-19T07:20:37.794273+0000","last_undegraded":"2024-09-19T07:20:37.794273+0000","last_fullsized":"2024-09-19T07:20:37.794273+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:49.843442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791877+0000","last_change":"2024-09-19T07:20:19.540945+0000","last_active":"2024-09-19T07:20:37.791877+0000","last_peered":"2024-09-19T07:20:37.791877+0000","last_clean":"2024-09-19T07:20:37.791877+0000","last_became_active":"2024-09-19T07:20:19.540641+0000","last_became_peered":"2024-09-19T07:20:19.540641+0000","last_unstale":"2024-09-19T07:20:37.791877+0000","last_undegraded":"2024-09-19T07:20:37.791877+0000","last_fullsized":"2024-09-19T07:20:37.791877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.487418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792157+0000","last_change":"2024-09-19T07:20:17.567010+0000","last_active":"2024-09-19T07:20:37.792157+0000","last_peered":"2024-09-19T07:20:37.792157+0000","last_clean":"2024-09-19T07:20:37.792157+0000","last_became_active":"2024-09-19T07:20:17.566560+0000","last_became_peered":"2024-09-19T07:20:17.566560+0000","last_unstale":"2024-09-19T07:20:37.792157+0000","last_undegraded":"2024-09-19T07:20:37.792157+0000","last_fullsized":"2024-09-19T07:20:37.792157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.349568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791673+0000","last_change":"2024-09-19T07:20:19.541808+0000","last_active":"2024-09-19T07:20:37.791673+0000","last_peered":"2024-09-19T07:20:37.791673+0000","last_clean":"2024-09-19T07:20:37.791673+0000","last_became_active":"2024-09-19T07:20:19.541510+0000","last_became_peered":"2024-09-19T07:20:19.541510+0000","last_unstale":"2024-09-19T07:20:37.791673+0000","last_undegraded":"2024-09-19T07:20:37.791673+0000","last_fullsized":"2024-09-19T07:20:37.791673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:04.156121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792406+0000","last_change":"2024-09-19T07:19:11.632651+0000","last_active":"2024-09-19T07:20:37.792406+0000","last_peered":"2024-09-19T07:20:37.792406+0000","last_clean":"2024-09-19T07:20:37.792406+0000","last_became_active":"2024-09-19T07:19:11.632229+0000","last_became_peered":"2024-09-19T07:19:11.632229+0000","last_unstale":"2024-09-19T07:20:37.792406+0000","last_undegraded":"2024-09-19T07:20:37.792406+0000","last_fullsized":"2024-09-19T07:20:37.792406+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_clean_scrub_stamp":"2024-09-19T07:15:50.875302+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:32.716049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943206+0000","last_change":"2024-09-19T07:20:17.512387+0000","last_active":"2024-09-19T07:20:37.943206+0000","last_peered":"2024-09-19T07:20:37.943206+0000","last_clean":"2024-09-19T07:20:37.943206+0000","last_became_active":"2024-09-19T07:20:17.511956+0000","last_became_peered":"2024-09-19T07:20:17.511956+0000","last_unstale":"2024-09-19T07:20:37.943206+0000","last_undegraded":"2024-09-19T07:20:37.943206+0000","last_fullsized":"2024-09-19T07:20:37.943206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:13.098347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786903+0000","last_change":"2024-09-19T07:20:19.536280+0000","last_active":"2024-09-19T07:20:37.786903+0000","last_peered":"2024-09-19T07:20:37.786903+0000","last_clean":"2024-09-19T07:20:37.786903+0000","last_became_active":"2024-09-19T07:20:19.535809+0000","last_became_peered":"2024-09-19T07:20:19.535809+0000","last_unstale":"2024-09-19T07:20:37.786903+0000","last_undegraded":"2024-09-19T07:20:37.786903+0000","last_fullsized":"2024-09-19T07:20:37.786903+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:07.645476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.801203+0000","last_change":"2024-09-19T07:20:37.800603+0000","last_active":"2024-09-19T07:20:37.801203+0000","last_peered":"2024-09-19T07:20:37.801203+0000","last_clean":"2024-09-19T07:20:37.801203+0000","last_became_active":"2024-09-19T07:20:37.794728+0000","last_became_peered":"2024-09-19T07:20:37.794728+0000","last_unstale":"2024-09-19T07:20:37.801203+0000","last_undegraded":"2024-09-19T07:20:37.801203+0000","last_fullsized":"2024-09-19T07:20:37.801203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:46.606645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789726+0000","last_change":"2024-09-19T07:20:19.540203+0000","last_active":"2024-09-19T07:20:37.789726+0000","last_peered":"2024-09-19T07:20:37.789726+0000","last_clean":"2024-09-19T07:20:37.789726+0000","last_became_active":"2024-09-19T07:20:19.539813+0000","last_became_peered":"2024-09-19T07:20:19.539813+0000","last_unstale":"2024-09-19T07:20:37.789726+0000","last_undegraded":"2024-09-19T07:20:37.789726+0000","last_fullsized":"2024-09-19T07:20:37.789726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:52.164881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:21:17.831157+0000","last_change":"2024-09-19T07:20:17.565449+0000","last_active":"2024-09-19T07:21:17.831157+0000","last_peered":"2024-09-19T07:21:17.831157+0000","last_clean":"2024-09-19T07:21:17.831157+0000","last_became_active":"2024-09-19T07:20:17.565079+0000","last_became_peered":"2024-09-19T07:20:17.565079+0000","last_unstale":"2024-09-19T07:21:17.831157+0000","last_undegraded":"2024-09-19T07:21:17.831157+0000","last_fullsized":"2024-09-19T07:21:17.831157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:50.791388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792603+0000","last_change":"2024-09-19T07:20:19.533817+0000","last_active":"2024-09-19T07:20:37.792603+0000","last_peered":"2024-09-19T07:20:37.792603+0000","last_clean":"2024-09-19T07:20:37.792603+0000","last_became_active":"2024-09-19T07:20:19.532144+0000","last_became_peered":"2024-09-19T07:20:19.532144+0000","last_unstale":"2024-09-19T07:20:37.792603+0000","last_undegraded":"2024-09-19T07:20:37.792603+0000","last_fullsized":"2024-09-19T07:20:37.792603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:18.928739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791873+0000","last_change":"2024-09-19T07:20:17.514063+0000","last_active":"2024-09-19T07:20:37.791873+0000","last_peered":"2024-09-19T07:20:37.791873+0000","last_clean":"2024-09-19T07:20:37.791873+0000","last_became_active":"2024-09-19T07:20:17.513633+0000","last_became_peered":"2024-09-19T07:20:17.513633+0000","last_unstale":"2024-09-19T07:20:37.791873+0000","last_undegraded":"2024-09-19T07:20:37.791873+0000","last_fullsized":"2024-09-19T07:20:37.791873+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:24.113053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790844+0000","last_change":"2024-09-19T07:20:19.540209+0000","last_active":"2024-09-19T07:20:37.790844+0000","last_peered":"2024-09-19T07:20:37.790844+0000","last_clean":"2024-09-19T07:20:37.790844+0000","last_became_active":"2024-09-19T07:20:19.539855+0000","last_became_peered":"2024-09-19T07:20:19.539855+0000","last_unstale":"2024-09-19T07:20:37.790844+0000","last_undegraded":"2024-09-19T07:20:37.790844+0000","last_fullsized":"2024-09-19T07:20:37.790844+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:40.878905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788482+0000","last_change":"2024-09-19T07:20:17.565627+0000","last_active":"2024-09-19T07:20:37.788482+0000","last_peered":"2024-09-19T07:20:37.788482+0000","last_clean":"2024-09-19T07:20:37.788482+0000","last_became_active":"2024-09-19T07:20:17.565231+0000","last_became_peered":"2024-09-19T07:20:17.565231+0000","last_unstale":"2024-09-19T07:20:37.788482+0000","last_undegraded":"2024-09-19T07:20:37.788482+0000","last_fullsized":"2024-09-19T07:20:37.788482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:53.105336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790960+0000","last_change":"2024-09-19T07:20:19.532418+0000","last_active":"2024-09-19T07:20:37.790960+0000","last_peered":"2024-09-19T07:20:37.790960+0000","last_clean":"2024-09-19T07:20:37.790960+0000","last_became_active":"2024-09-19T07:20:19.532113+0000","last_became_peered":"2024-09-19T07:20:19.532113+0000","last_unstale":"2024-09-19T07:20:37.790960+0000","last_undegraded":"2024-09-19T07:20:37.790960+0000","last_fullsized":"2024-09-19T07:20:37.790960+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:24.953720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790920+0000","last_change":"2024-09-19T07:20:17.565984+0000","last_active":"2024-09-19T07:20:37.790920+0000","last_peered":"2024-09-19T07:20:37.790920+0000","last_clean":"2024-09-19T07:20:37.790920+0000","last_became_active":"2024-09-19T07:20:17.565240+0000","last_became_peered":"2024-09-19T07:20:17.565240+0000","last_unstale":"2024-09-19T07:20:37.790920+0000","last_undegraded":"2024-09-19T07:20:37.790920+0000","last_fullsized":"2024-09-19T07:20:37.790920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:07.906716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789919+0000","last_change":"2024-09-19T07:20:19.534400+0000","last_active":"2024-09-19T07:20:37.789919+0000","last_peered":"2024-09-19T07:20:37.789919+0000","last_clean":"2024-09-19T07:20:37.789919+0000","last_became_active":"2024-09-19T07:20:19.534130+0000","last_became_peered":"2024-09-19T07:20:19.534130+0000","last_unstale":"2024-09-19T07:20:37.789919+0000","last_undegraded":"2024-09-19T07:20:37.789919+0000","last_fullsized":"2024-09-19T07:20:37.789919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:09.398112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:43.527774+0000","last_change":"2024-09-19T07:20:17.519628+0000","last_active":"2024-09-19T07:20:43.527774+0000","last_peered":"2024-09-19T07:20:43.527774+0000","last_clean":"2024-09-19T07:20:43.527774+0000","last_became_active":"2024-09-19T07:20:17.519276+0000","last_became_peered":"2024-09-19T07:20:17.519276+0000","last_unstale":"2024-09-19T07:20:43.527774+0000","last_undegraded":"2024-09-19T07:20:43.527774+0000","last_fullsized":"2024-09-19T07:20:43.527774+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.193091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786947+0000","last_change":"2024-09-19T07:20:19.533425+0000","last_active":"2024-09-19T07:20:37.786947+0000","last_peered":"2024-09-19T07:20:37.786947+0000","last_clean":"2024-09-19T07:20:37.786947+0000","last_became_active":"2024-09-19T07:20:19.533142+0000","last_became_peered":"2024-09-19T07:20:19.533142+0000","last_unstale":"2024-09-19T07:20:37.786947+0000","last_undegraded":"2024-09-19T07:20:37.786947+0000","last_fullsized":"2024-09-19T07:20:37.786947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:07.048006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943680+0000","last_change":"2024-09-19T07:20:17.512776+0000","last_active":"2024-09-19T07:20:37.943680+0000","last_peered":"2024-09-19T07:20:37.943680+0000","last_clean":"2024-09-19T07:20:37.943680+0000","last_became_active":"2024-09-19T07:20:17.511862+0000","last_became_peered":"2024-09-19T07:20:17.511862+0000","last_unstale":"2024-09-19T07:20:37.943680+0000","last_undegraded":"2024-09-19T07:20:37.943680+0000","last_fullsized":"2024-09-19T07:20:37.943680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:08.211654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.481028+0000","last_change":"2024-09-19T07:20:19.539260+0000","last_active":"2024-09-19T07:20:38.481028+0000","last_peered":"2024-09-19T07:20:38.481028+0000","last_clean":"2024-09-19T07:20:38.481028+0000","last_became_active":"2024-09-19T07:20:19.538868+0000","last_became_peered":"2024-09-19T07:20:19.538868+0000","last_unstale":"2024-09-19T07:20:38.481028+0000","last_undegraded":"2024-09-19T07:20:38.481028+0000","last_fullsized":"2024-09-19T07:20:38.481028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:44.198084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793712+0000","last_change":"2024-09-19T07:20:17.565544+0000","last_active":"2024-09-19T07:20:37.793712+0000","last_peered":"2024-09-19T07:20:37.793712+0000","last_clean":"2024-09-19T07:20:37.793712+0000","last_became_active":"2024-09-19T07:20:17.565250+0000","last_became_peered":"2024-09-19T07:20:17.565250+0000","last_unstale":"2024-09-19T07:20:37.793712+0000","last_undegraded":"2024-09-19T07:20:37.793712+0000","last_fullsized":"2024-09-19T07:20:37.793712+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:25.523136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791794+0000","last_change":"2024-09-19T07:20:19.531467+0000","last_active":"2024-09-19T07:20:37.791794+0000","last_peered":"2024-09-19T07:20:37.791794+0000","last_clean":"2024-09-19T07:20:37.791794+0000","last_became_active":"2024-09-19T07:20:19.531170+0000","last_became_peered":"2024-09-19T07:20:19.531170+0000","last_unstale":"2024-09-19T07:20:37.791794+0000","last_undegraded":"2024-09-19T07:20:37.791794+0000","last_fullsized":"2024-09-19T07:20:37.791794+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:23.113097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786781+0000","last_change":"2024-09-19T07:20:17.511400+0000","last_active":"2024-09-19T07:20:37.786781+0000","last_peered":"2024-09-19T07:20:37.786781+0000","last_clean":"2024-09-19T07:20:37.786781+0000","last_became_active":"2024-09-19T07:20:17.511126+0000","last_became_peered":"2024-09-19T07:20:17.511126+0000","last_unstale":"2024-09-19T07:20:37.786781+0000","last_undegraded":"2024-09-19T07:20:37.786781+0000","last_fullsized":"2024-09-19T07:20:37.786781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.485406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788319+0000","last_change":"2024-09-19T07:20:19.529171+0000","last_active":"2024-09-19T07:20:37.788319+0000","last_peered":"2024-09-19T07:20:37.788319+0000","last_clean":"2024-09-19T07:20:37.788319+0000","last_became_active":"2024-09-19T07:20:19.528489+0000","last_became_peered":"2024-09-19T07:20:19.528489+0000","last_unstale":"2024-09-19T07:20:37.788319+0000","last_undegraded":"2024-09-19T07:20:37.788319+0000","last_fullsized":"2024-09-19T07:20:37.788319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:10.842619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.803998+0000","last_change":"2024-09-19T07:20:37.803560+0000","last_active":"2024-09-19T07:20:37.803998+0000","last_peered":"2024-09-19T07:20:37.803998+0000","last_clean":"2024-09-19T07:20:37.803998+0000","last_became_active":"2024-09-19T07:20:37.797396+0000","last_became_peered":"2024-09-19T07:20:37.797396+0000","last_unstale":"2024-09-19T07:20:37.803998+0000","last_undegraded":"2024-09-19T07:20:37.803998+0000","last_fullsized":"2024-09-19T07:20:37.803998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:41.944179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786827+0000","last_change":"2024-09-19T07:20:19.532698+0000","last_active":"2024-09-19T07:20:37.786827+0000","last_peered":"2024-09-19T07:20:37.786827+0000","last_clean":"2024-09-19T07:20:37.786827+0000","last_became_active":"2024-09-19T07:20:19.531978+0000","last_became_peered":"2024-09-19T07:20:19.531978+0000","last_unstale":"2024-09-19T07:20:37.786827+0000","last_undegraded":"2024-09-19T07:20:37.786827+0000","last_fullsized":"2024-09-19T07:20:37.786827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:44.257024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791819+0000","last_change":"2024-09-19T07:20:17.525240+0000","last_active":"2024-09-19T07:20:37.791819+0000","last_peered":"2024-09-19T07:20:37.791819+0000","last_clean":"2024-09-19T07:20:37.791819+0000","last_became_active":"2024-09-19T07:20:17.524880+0000","last_became_peered":"2024-09-19T07:20:17.524880+0000","last_unstale":"2024-09-19T07:20:37.791819+0000","last_undegraded":"2024-09-19T07:20:37.791819+0000","last_fullsized":"2024-09-19T07:20:37.791819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:41.380246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791596+0000","last_change":"2024-09-19T07:20:19.537116+0000","last_active":"2024-09-19T07:20:37.791596+0000","last_peered":"2024-09-19T07:20:37.791596+0000","last_clean":"2024-09-19T07:20:37.791596+0000","last_became_active":"2024-09-19T07:20:19.536799+0000","last_became_peered":"2024-09-19T07:20:19.536799+0000","last_unstale":"2024-09-19T07:20:37.791596+0000","last_undegraded":"2024-09-19T07:20:37.791596+0000","last_fullsized":"2024-09-19T07:20:37.791596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:48.401159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792890+0000","last_change":"2024-09-19T07:20:19.527965+0000","last_active":"2024-09-19T07:20:37.792890+0000","last_peered":"2024-09-19T07:20:37.792890+0000","last_clean":"2024-09-19T07:20:37.792890+0000","last_became_active":"2024-09-19T07:20:19.527522+0000","last_became_peered":"2024-09-19T07:20:19.527522+0000","last_unstale":"2024-09-19T07:20:37.792890+0000","last_undegraded":"2024-09-19T07:20:37.792890+0000","last_fullsized":"2024-09-19T07:20:37.792890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:16.034153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793263+0000","last_change":"2024-09-19T07:20:17.519400+0000","last_active":"2024-09-19T07:20:37.793263+0000","last_peered":"2024-09-19T07:20:37.793263+0000","last_clean":"2024-09-19T07:20:37.793263+0000","last_became_active":"2024-09-19T07:20:17.518993+0000","last_became_peered":"2024-09-19T07:20:17.518993+0000","last_unstale":"2024-09-19T07:20:37.793263+0000","last_undegraded":"2024-09-19T07:20:37.793263+0000","last_fullsized":"2024-09-19T07:20:37.793263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:37.086763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793704+0000","last_change":"2024-09-19T07:20:19.531016+0000","last_active":"2024-09-19T07:20:37.793704+0000","last_peered":"2024-09-19T07:20:37.793704+0000","last_clean":"2024-09-19T07:20:37.793704+0000","last_became_active":"2024-09-19T07:20:19.530706+0000","last_became_peered":"2024-09-19T07:20:19.530706+0000","last_unstale":"2024-09-19T07:20:37.793704+0000","last_undegraded":"2024-09-19T07:20:37.793704+0000","last_fullsized":"2024-09-19T07:20:37.793704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:36.566185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790803+0000","last_change":"2024-09-19T07:20:17.524215+0000","last_active":"2024-09-19T07:20:37.790803+0000","last_peered":"2024-09-19T07:20:37.790803+0000","last_clean":"2024-09-19T07:20:37.790803+0000","last_became_active":"2024-09-19T07:20:17.523813+0000","last_became_peered":"2024-09-19T07:20:17.523813+0000","last_unstale":"2024-09-19T07:20:37.790803+0000","last_undegraded":"2024-09-19T07:20:37.790803+0000","last_fullsized":"2024-09-19T07:20:37.790803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:58.803225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.481093+0000","last_change":"2024-09-19T07:20:19.540994+0000","last_active":"2024-09-19T07:20:38.481093+0000","last_peered":"2024-09-19T07:20:38.481093+0000","last_clean":"2024-09-19T07:20:38.481093+0000","last_became_active":"2024-09-19T07:20:19.540703+0000","last_became_peered":"2024-09-19T07:20:19.540703+0000","last_unstale":"2024-09-19T07:20:38.481093+0000","last_undegraded":"2024-09-19T07:20:38.481093+0000","last_fullsized":"2024-09-19T07:20:38.481093+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:37.065187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.787038+0000","last_change":"2024-09-19T07:20:17.565438+0000","last_active":"2024-09-19T07:20:37.787038+0000","last_peered":"2024-09-19T07:20:37.787038+0000","last_clean":"2024-09-19T07:20:37.787038+0000","last_became_active":"2024-09-19T07:20:17.565128+0000","last_became_peered":"2024-09-19T07:20:17.565128+0000","last_unstale":"2024-09-19T07:20:37.787038+0000","last_undegraded":"2024-09-19T07:20:37.787038+0000","last_fullsized":"2024-09-19T07:20:37.787038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:02.048971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.794751+0000","last_change":"2024-09-19T07:20:37.794369+0000","last_active":"2024-09-19T07:20:37.794751+0000","last_peered":"2024-09-19T07:20:37.794751+0000","last_clean":"2024-09-19T07:20:37.794751+0000","last_became_active":"2024-09-19T07:20:37.794036+0000","last_became_peered":"2024-09-19T07:20:37.794036+0000","last_unstale":"2024-09-19T07:20:37.794751+0000","last_undegraded":"2024-09-19T07:20:37.794751+0000","last_fullsized":"2024-09-19T07:20:37.794751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:02.684191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.950846+0000","last_change":"2024-09-19T07:20:37.950846+0000","last_active":"2024-09-19T07:20:37.950846+0000","last_peered":"2024-09-19T07:20:37.950846+0000","last_clean":"2024-09-19T07:20:37.950846+0000","last_became_active":"2024-09-19T07:20:37.944266+0000","last_became_peered":"2024-09-19T07:20:37.944266+0000","last_unstale":"2024-09-19T07:20:37.950846+0000","last_undegraded":"2024-09-19T07:20:37.950846+0000","last_fullsized":"2024-09-19T07:20:37.950846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:12.952833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63374,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":312,"num_read_kb":220,"num_write":163,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27529,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645337,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":428259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874269,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1079504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037794,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":428495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266728,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495660,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1490944,"data_stored":1019954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659185,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":427884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888118,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1503232,"data_stored":1019638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":488667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":428195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444100,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":429027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607625,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":487441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":429155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":60990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:21:23.135 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:21:23.390 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:23.762 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:23 smithi098 ceph-mon[30950]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:21:23.762 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:23 smithi098 ceph-mon[30950]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:23.762 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:23.762 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:23.762 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:21:23.762 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:21:23.763 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:23 smithi098 ceph-mon[30950]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:23.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.836+0000 7f21a49ec640 1 -- 172.21.15.98:0/798472439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a0102570 msgr2=0x7f21a01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:23.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.836+0000 7f21a49ec640 1 --2- 172.21.15.98:0/798472439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a0102570 0x7f21a01029b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2188009900 tx=0x7f218802a480 comp rx=0 tx=0).stop 2024-09-19T07:21:23.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.837+0000 7f21a49ec640 1 -- 172.21.15.98:0/798472439 shutdown_connections 2024-09-19T07:21:23.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.837+0000 7f21a49ec640 1 --2- 172.21.15.98:0/798472439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21a0102ef0 0x7f21a010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:23.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.837+0000 7f21a49ec640 1 --2- 172.21.15.98:0/798472439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a0102570 0x7f21a01029b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:23.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.837+0000 7f21a49ec640 1 --2- 172.21.15.98:0/798472439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a0100e20 0x7f21a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:23.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.837+0000 7f21a49ec640 1 -- 172.21.15.98:0/798472439 >> 172.21.15.98:0/798472439 conn(0x7f21a00fc7d0 msgr2=0x7f21a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:23.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.837+0000 7f21a49ec640 1 -- 172.21.15.98:0/798472439 shutdown_connections 2024-09-19T07:21:23.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.837+0000 7f21a49ec640 1 -- 172.21.15.98:0/798472439 wait complete. 2024-09-19T07:21:23.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.837+0000 7f21a49ec640 1 Processor -- start 2024-09-19T07:21:23.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.837+0000 7f21a49ec640 1 -- start start 2024-09-19T07:21:23.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f21a49ec640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21a0100e20 0x7f21a0197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:23.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f21a49ec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a0102570 0x7f21a0197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:23.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f21a49ec640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a0102ef0 0x7f21a019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:23.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f21a49ec640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f21a0111020 con 0x7f21a0102570 2024-09-19T07:21:23.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f21a49ec640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f21a0110ea0 con 0x7f21a0100e20 2024-09-19T07:21:23.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f21a49ec640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21a01111a0 con 0x7f21a0102ef0 2024-09-19T07:21:23.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f219dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a0102570 0x7f21a0197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:23.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f219dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a0102570 0x7f21a0197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48626/0 (socket says 172.21.15.98:48626) 2024-09-19T07:21:23.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f219dd9b640 1 -- 172.21.15.98:0/4200423276 learned_addr learned my addr 172.21.15.98:0/4200423276 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:23.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f219e59c640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21a0100e20 0x7f21a0197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:23.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f219ed9d640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a0102ef0 0x7f21a019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:23.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f219dd9b640 1 -- 172.21.15.98:0/4200423276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a0102ef0 msgr2=0x7f21a019be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:23.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f219dd9b640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a0102ef0 0x7f21a019be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:23.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f219dd9b640 1 -- 172.21.15.98:0/4200423276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21a0100e20 msgr2=0x7f21a0197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:23.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f219dd9b640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21a0100e20 0x7f21a0197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:23.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f219dd9b640 1 -- 172.21.15.98:0/4200423276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a019c4f0 con 0x7f21a0102570 2024-09-19T07:21:23.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f219ed9d640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a0102ef0 0x7f21a019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:23.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f219dd9b640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a0102570 0x7f21a0197a80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2188006010 tx=0x7f2188003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:23.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f21977fe640 1 -- 172.21.15.98:0/4200423276 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218803f070 con 0x7f21a0102570 2024-09-19T07:21:23.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f21977fe640 1 -- 172.21.15.98:0/4200423276 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2188031e30 con 0x7f21a0102570 2024-09-19T07:21:23.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f21a49ec640 1 -- 172.21.15.98:0/4200423276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a019c780 con 0x7f21a0102570 2024-09-19T07:21:23.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f21977fe640 1 -- 172.21.15.98:0/4200423276 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2188035030 con 0x7f21a0102570 2024-09-19T07:21:23.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.838+0000 7f21a49ec640 1 -- 172.21.15.98:0/4200423276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a01a40c0 con 0x7f21a0102570 2024-09-19T07:21:23.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.839+0000 7f21a49ec640 1 -- 172.21.15.98:0/4200423276 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a0101280 con 0x7f21a0102570 2024-09-19T07:21:23.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.841+0000 7f21977fe640 1 -- 172.21.15.98:0/4200423276 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2188042070 con 0x7f21a0102570 2024-09-19T07:21:23.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.841+0000 7f21977fe640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f218c0a32d0 0x7f218c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:23.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.842+0000 7f219e59c640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f218c0a32d0 0x7f218c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:23.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.842+0000 7f21977fe640 1 -- 172.21.15.98:0/4200423276 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f21880f0a00 con 0x7f21a0102570 2024-09-19T07:21:23.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.842+0000 7f219e59c640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f218c0a32d0 0x7f218c0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f219800a400 tx=0x7f219800d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:23.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:23.844+0000 7f21977fe640 1 -- 172.21.15.98:0/4200423276 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f21880bd630 con 0x7f21a0102570 2024-09-19T07:21:24.009 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.009+0000 7f21a49ec640 1 -- 172.21.15.98:0/4200423276 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21a0062630 con 0x7f218c0a32d0 2024-09-19T07:21:24.015 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.015+0000 7f21977fe640 1 -- 172.21.15.98:0/4200423276 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258711 (secure 0 0 0) 0x7f21a0062630 con 0x7f218c0a32d0 2024-09-19T07:21:24.019 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:24.020 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-19T07:21:24.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.017+0000 7f21a49ec640 1 -- 172.21.15.98:0/4200423276 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f218c0a32d0 msgr2=0x7f218c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:24.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.018+0000 7f21a49ec640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f218c0a32d0 0x7f218c0a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f219800a400 tx=0x7f219800d040 comp rx=0 tx=0).stop 2024-09-19T07:21:24.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.018+0000 7f21a49ec640 1 -- 172.21.15.98:0/4200423276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a0102570 msgr2=0x7f21a0197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:24.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.018+0000 7f21a49ec640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a0102570 0x7f21a0197a80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2188006010 tx=0x7f2188003c80 comp rx=0 tx=0).stop 2024-09-19T07:21:24.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.018+0000 7f21a49ec640 1 -- 172.21.15.98:0/4200423276 shutdown_connections 2024-09-19T07:21:24.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.018+0000 7f21a49ec640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f218c0a32d0 0x7f218c0a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:24.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.018+0000 7f21a49ec640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21a0102ef0 0x7f21a019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:24.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.018+0000 7f21a49ec640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21a0102570 0x7f21a0197a80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:24.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.018+0000 7f21a49ec640 1 --2- 172.21.15.98:0/4200423276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21a0100e20 0x7f21a0197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:24.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.018+0000 7f21a49ec640 1 -- 172.21.15.98:0/4200423276 >> 172.21.15.98:0/4200423276 conn(0x7f21a00fc7d0 msgr2=0x7f21a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:24.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.018+0000 7f21a49ec640 1 -- 172.21.15.98:0/4200423276 shutdown_connections 2024-09-19T07:21:24.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:24.018+0000 7f21a49ec640 1 -- 172.21.15.98:0/4200423276 wait complete. 2024-09-19T07:21:24.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:23 smithi139 ceph-mon[35039]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:21:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:23 smithi139 ceph-mon[35039]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:21:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:21:24.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:23 smithi139 ceph-mon[35039]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:23 smithi162 ceph-mon[35726]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:21:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:23 smithi162 ceph-mon[35726]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:21:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:21:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:23 smithi162 ceph-mon[35726]: from='mgr.14150 172.21.15.98:0/1305789804' entity='mgr.x' 2024-09-19T07:21:24.640 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-19T07:21:22.664744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653976,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":458,"num_read_kb":339,"num_write":346,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1208265,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":353404,"kb_used_data":12444,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124588420,"statfs":{"total":1151940427776,"available":1151578542080,"internally_reserved":0,"allocated":12742656,"data_stored":7094052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002869"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788444+0000","last_change":"2024-09-19T07:20:19.535372+0000","last_active":"2024-09-19T07:20:37.788444+0000","last_peered":"2024-09-19T07:20:37.788444+0000","last_clean":"2024-09-19T07:20:37.788444+0000","last_became_active":"2024-09-19T07:20:19.535079+0000","last_became_peered":"2024-09-19T07:20:19.535079+0000","last_unstale":"2024-09-19T07:20:37.788444+0000","last_undegraded":"2024-09-19T07:20:37.788444+0000","last_fullsized":"2024-09-19T07:20:37.788444+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:56.856451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480864+0000","last_change":"2024-09-19T07:20:19.528531+0000","last_active":"2024-09-19T07:20:38.480864+0000","last_peered":"2024-09-19T07:20:38.480864+0000","last_clean":"2024-09-19T07:20:38.480864+0000","last_became_active":"2024-09-19T07:20:19.528218+0000","last_became_peered":"2024-09-19T07:20:19.528218+0000","last_unstale":"2024-09-19T07:20:38.480864+0000","last_undegraded":"2024-09-19T07:20:38.480864+0000","last_fullsized":"2024-09-19T07:20:38.480864+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:44.730220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480860+0000","last_change":"2024-09-19T07:20:19.533516+0000","last_active":"2024-09-19T07:20:38.480860+0000","last_peered":"2024-09-19T07:20:38.480860+0000","last_clean":"2024-09-19T07:20:38.480860+0000","last_became_active":"2024-09-19T07:20:19.533247+0000","last_became_peered":"2024-09-19T07:20:19.533247+0000","last_unstale":"2024-09-19T07:20:38.480860+0000","last_undegraded":"2024-09-19T07:20:38.480860+0000","last_fullsized":"2024-09-19T07:20:38.480860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:29.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943443+0000","last_change":"2024-09-19T07:20:19.543245+0000","last_active":"2024-09-19T07:20:37.943443+0000","last_peered":"2024-09-19T07:20:37.943443+0000","last_clean":"2024-09-19T07:20:37.943443+0000","last_became_active":"2024-09-19T07:20:19.542840+0000","last_became_peered":"2024-09-19T07:20:19.542840+0000","last_unstale":"2024-09-19T07:20:37.943443+0000","last_undegraded":"2024-09-19T07:20:37.943443+0000","last_fullsized":"2024-09-19T07:20:37.943443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:21.780027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790342+0000","last_change":"2024-09-19T07:20:19.528880+0000","last_active":"2024-09-19T07:20:37.790342+0000","last_peered":"2024-09-19T07:20:37.790342+0000","last_clean":"2024-09-19T07:20:37.790342+0000","last_became_active":"2024-09-19T07:20:19.528592+0000","last_became_peered":"2024-09-19T07:20:19.528592+0000","last_unstale":"2024-09-19T07:20:37.790342+0000","last_undegraded":"2024-09-19T07:20:37.790342+0000","last_fullsized":"2024-09-19T07:20:37.790342+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:59.718929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790665+0000","last_change":"2024-09-19T07:20:19.538480+0000","last_active":"2024-09-19T07:20:37.790665+0000","last_peered":"2024-09-19T07:20:37.790665+0000","last_clean":"2024-09-19T07:20:37.790665+0000","last_became_active":"2024-09-19T07:20:19.538189+0000","last_became_peered":"2024-09-19T07:20:19.538189+0000","last_unstale":"2024-09-19T07:20:37.790665+0000","last_undegraded":"2024-09-19T07:20:37.790665+0000","last_fullsized":"2024-09-19T07:20:37.790665+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:29.607974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791790+0000","last_change":"2024-09-19T07:20:19.538877+0000","last_active":"2024-09-19T07:20:37.791790+0000","last_peered":"2024-09-19T07:20:37.791790+0000","last_clean":"2024-09-19T07:20:37.791790+0000","last_became_active":"2024-09-19T07:20:19.538551+0000","last_became_peered":"2024-09-19T07:20:19.538551+0000","last_unstale":"2024-09-19T07:20:37.791790+0000","last_undegraded":"2024-09-19T07:20:37.791790+0000","last_fullsized":"2024-09-19T07:20:37.791790+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:52.114115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786641+0000","last_change":"2024-09-19T07:20:19.538135+0000","last_active":"2024-09-19T07:20:37.786641+0000","last_peered":"2024-09-19T07:20:37.786641+0000","last_clean":"2024-09-19T07:20:37.786641+0000","last_became_active":"2024-09-19T07:20:19.537769+0000","last_became_peered":"2024-09-19T07:20:19.537769+0000","last_unstale":"2024-09-19T07:20:37.786641+0000","last_undegraded":"2024-09-19T07:20:37.786641+0000","last_fullsized":"2024-09-19T07:20:37.786641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:21.304262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.794226+0000","last_change":"2024-09-19T07:20:19.531569+0000","last_active":"2024-09-19T07:20:37.794226+0000","last_peered":"2024-09-19T07:20:37.794226+0000","last_clean":"2024-09-19T07:20:37.794226+0000","last_became_active":"2024-09-19T07:20:19.529455+0000","last_became_peered":"2024-09-19T07:20:19.529455+0000","last_unstale":"2024-09-19T07:20:37.794226+0000","last_undegraded":"2024-09-19T07:20:37.794226+0000","last_fullsized":"2024-09-19T07:20:37.794226+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:22.187968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791187+0000","last_change":"2024-09-19T07:20:19.540342+0000","last_active":"2024-09-19T07:20:37.791187+0000","last_peered":"2024-09-19T07:20:37.791187+0000","last_clean":"2024-09-19T07:20:37.791187+0000","last_became_active":"2024-09-19T07:20:19.539870+0000","last_became_peered":"2024-09-19T07:20:19.539870+0000","last_unstale":"2024-09-19T07:20:37.791187+0000","last_undegraded":"2024-09-19T07:20:37.791187+0000","last_fullsized":"2024-09-19T07:20:37.791187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:39.930671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791533+0000","last_change":"2024-09-19T07:20:19.536004+0000","last_active":"2024-09-19T07:20:37.791533+0000","last_peered":"2024-09-19T07:20:37.791533+0000","last_clean":"2024-09-19T07:20:37.791533+0000","last_became_active":"2024-09-19T07:20:19.535640+0000","last_became_peered":"2024-09-19T07:20:19.535640+0000","last_unstale":"2024-09-19T07:20:37.791533+0000","last_undegraded":"2024-09-19T07:20:37.791533+0000","last_fullsized":"2024-09-19T07:20:37.791533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:47.853411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943531+0000","last_change":"2024-09-19T07:20:19.539374+0000","last_active":"2024-09-19T07:20:37.943531+0000","last_peered":"2024-09-19T07:20:37.943531+0000","last_clean":"2024-09-19T07:20:37.943531+0000","last_became_active":"2024-09-19T07:20:19.538880+0000","last_became_peered":"2024-09-19T07:20:19.538880+0000","last_unstale":"2024-09-19T07:20:37.943531+0000","last_undegraded":"2024-09-19T07:20:37.943531+0000","last_fullsized":"2024-09-19T07:20:37.943531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:55.484232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792753+0000","last_change":"2024-09-19T07:20:37.792753+0000","last_active":"2024-09-19T07:20:37.792753+0000","last_peered":"2024-09-19T07:20:37.792753+0000","last_clean":"2024-09-19T07:20:37.792753+0000","last_became_active":"2024-09-19T07:20:37.792417+0000","last_became_peered":"2024-09-19T07:20:37.792417+0000","last_unstale":"2024-09-19T07:20:37.792753+0000","last_undegraded":"2024-09-19T07:20:37.792753+0000","last_fullsized":"2024-09-19T07:20:37.792753+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:10.417367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480887+0000","last_change":"2024-09-19T07:20:19.528842+0000","last_active":"2024-09-19T07:20:38.480887+0000","last_peered":"2024-09-19T07:20:38.480887+0000","last_clean":"2024-09-19T07:20:38.480887+0000","last_became_active":"2024-09-19T07:20:19.528042+0000","last_became_peered":"2024-09-19T07:20:19.528042+0000","last_unstale":"2024-09-19T07:20:38.480887+0000","last_undegraded":"2024-09-19T07:20:38.480887+0000","last_fullsized":"2024-09-19T07:20:38.480887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:34.970509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480784+0000","last_change":"2024-09-19T07:20:19.535013+0000","last_active":"2024-09-19T07:20:38.480784+0000","last_peered":"2024-09-19T07:20:38.480784+0000","last_clean":"2024-09-19T07:20:38.480784+0000","last_became_active":"2024-09-19T07:20:19.534302+0000","last_became_peered":"2024-09-19T07:20:19.534302+0000","last_unstale":"2024-09-19T07:20:38.480784+0000","last_undegraded":"2024-09-19T07:20:38.480784+0000","last_fullsized":"2024-09-19T07:20:38.480784+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:52.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793587+0000","last_change":"2024-09-19T07:20:19.534930+0000","last_active":"2024-09-19T07:20:37.793587+0000","last_peered":"2024-09-19T07:20:37.793587+0000","last_clean":"2024-09-19T07:20:37.793587+0000","last_became_active":"2024-09-19T07:20:19.534640+0000","last_became_peered":"2024-09-19T07:20:19.534640+0000","last_unstale":"2024-09-19T07:20:37.793587+0000","last_undegraded":"2024-09-19T07:20:37.793587+0000","last_fullsized":"2024-09-19T07:20:37.793587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:23.055097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788533+0000","last_change":"2024-09-19T07:20:19.535856+0000","last_active":"2024-09-19T07:20:37.788533+0000","last_peered":"2024-09-19T07:20:37.788533+0000","last_clean":"2024-09-19T07:20:37.788533+0000","last_became_active":"2024-09-19T07:20:19.535561+0000","last_became_peered":"2024-09-19T07:20:19.535561+0000","last_unstale":"2024-09-19T07:20:37.788533+0000","last_undegraded":"2024-09-19T07:20:37.788533+0000","last_fullsized":"2024-09-19T07:20:37.788533+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:03.943339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788597+0000","last_change":"2024-09-19T07:20:19.528429+0000","last_active":"2024-09-19T07:20:37.788597+0000","last_peered":"2024-09-19T07:20:37.788597+0000","last_clean":"2024-09-19T07:20:37.788597+0000","last_became_active":"2024-09-19T07:20:19.528107+0000","last_became_peered":"2024-09-19T07:20:19.528107+0000","last_unstale":"2024-09-19T07:20:37.788597+0000","last_undegraded":"2024-09-19T07:20:37.788597+0000","last_fullsized":"2024-09-19T07:20:37.788597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:49.520514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791782+0000","last_change":"2024-09-19T07:20:19.532966+0000","last_active":"2024-09-19T07:20:37.791782+0000","last_peered":"2024-09-19T07:20:37.791782+0000","last_clean":"2024-09-19T07:20:37.791782+0000","last_became_active":"2024-09-19T07:20:19.532412+0000","last_became_peered":"2024-09-19T07:20:19.532412+0000","last_unstale":"2024-09-19T07:20:37.791782+0000","last_undegraded":"2024-09-19T07:20:37.791782+0000","last_fullsized":"2024-09-19T07:20:37.791782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:42.900136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.797952+0000","last_change":"2024-09-19T07:20:37.797952+0000","last_active":"2024-09-19T07:20:37.797952+0000","last_peered":"2024-09-19T07:20:37.797952+0000","last_clean":"2024-09-19T07:20:37.797952+0000","last_became_active":"2024-09-19T07:20:37.797459+0000","last_became_peered":"2024-09-19T07:20:37.797459+0000","last_unstale":"2024-09-19T07:20:37.797952+0000","last_undegraded":"2024-09-19T07:20:37.797952+0000","last_fullsized":"2024-09-19T07:20:37.797952+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:44.132477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790125+0000","last_change":"2024-09-19T07:20:19.532193+0000","last_active":"2024-09-19T07:20:37.790125+0000","last_peered":"2024-09-19T07:20:37.790125+0000","last_clean":"2024-09-19T07:20:37.790125+0000","last_became_active":"2024-09-19T07:20:19.531890+0000","last_became_peered":"2024-09-19T07:20:19.531890+0000","last_unstale":"2024-09-19T07:20:37.790125+0000","last_undegraded":"2024-09-19T07:20:37.790125+0000","last_fullsized":"2024-09-19T07:20:37.790125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:21.168993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793717+0000","last_change":"2024-09-19T07:20:19.535034+0000","last_active":"2024-09-19T07:20:37.793717+0000","last_peered":"2024-09-19T07:20:37.793717+0000","last_clean":"2024-09-19T07:20:37.793717+0000","last_became_active":"2024-09-19T07:20:19.534732+0000","last_became_peered":"2024-09-19T07:20:19.534732+0000","last_unstale":"2024-09-19T07:20:37.793717+0000","last_undegraded":"2024-09-19T07:20:37.793717+0000","last_fullsized":"2024-09-19T07:20:37.793717+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:13.726672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786690+0000","last_change":"2024-09-19T07:20:19.532644+0000","last_active":"2024-09-19T07:20:37.786690+0000","last_peered":"2024-09-19T07:20:37.786690+0000","last_clean":"2024-09-19T07:20:37.786690+0000","last_became_active":"2024-09-19T07:20:19.532364+0000","last_became_peered":"2024-09-19T07:20:19.532364+0000","last_unstale":"2024-09-19T07:20:37.786690+0000","last_undegraded":"2024-09-19T07:20:37.786690+0000","last_fullsized":"2024-09-19T07:20:37.786690+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:17.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792578+0000","last_change":"2024-09-19T07:20:19.533500+0000","last_active":"2024-09-19T07:20:37.792578+0000","last_peered":"2024-09-19T07:20:37.792578+0000","last_clean":"2024-09-19T07:20:37.792578+0000","last_became_active":"2024-09-19T07:20:19.532759+0000","last_became_peered":"2024-09-19T07:20:19.532759+0000","last_unstale":"2024-09-19T07:20:37.792578+0000","last_undegraded":"2024-09-19T07:20:37.792578+0000","last_fullsized":"2024-09-19T07:20:37.792578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:35.549776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793776+0000","last_change":"2024-09-19T07:20:37.793776+0000","last_active":"2024-09-19T07:20:37.793776+0000","last_peered":"2024-09-19T07:20:37.793776+0000","last_clean":"2024-09-19T07:20:37.793776+0000","last_became_active":"2024-09-19T07:20:37.793382+0000","last_became_peered":"2024-09-19T07:20:37.793382+0000","last_unstale":"2024-09-19T07:20:37.793776+0000","last_undegraded":"2024-09-19T07:20:37.793776+0000","last_fullsized":"2024-09-19T07:20:37.793776+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:00.422534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791854+0000","last_change":"2024-09-19T07:20:19.532840+0000","last_active":"2024-09-19T07:20:37.791854+0000","last_peered":"2024-09-19T07:20:37.791854+0000","last_clean":"2024-09-19T07:20:37.791854+0000","last_became_active":"2024-09-19T07:20:19.532059+0000","last_became_peered":"2024-09-19T07:20:19.532059+0000","last_unstale":"2024-09-19T07:20:37.791854+0000","last_undegraded":"2024-09-19T07:20:37.791854+0000","last_fullsized":"2024-09-19T07:20:37.791854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:49.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788391+0000","last_change":"2024-09-19T07:20:19.528150+0000","last_active":"2024-09-19T07:20:37.788391+0000","last_peered":"2024-09-19T07:20:37.788391+0000","last_clean":"2024-09-19T07:20:37.788391+0000","last_became_active":"2024-09-19T07:20:19.527873+0000","last_became_peered":"2024-09-19T07:20:19.527873+0000","last_unstale":"2024-09-19T07:20:37.788391+0000","last_undegraded":"2024-09-19T07:20:37.788391+0000","last_fullsized":"2024-09-19T07:20:37.788391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.561937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789841+0000","last_change":"2024-09-19T07:20:19.540160+0000","last_active":"2024-09-19T07:20:37.789841+0000","last_peered":"2024-09-19T07:20:37.789841+0000","last_clean":"2024-09-19T07:20:37.789841+0000","last_became_active":"2024-09-19T07:20:19.539862+0000","last_became_peered":"2024-09-19T07:20:19.539862+0000","last_unstale":"2024-09-19T07:20:37.789841+0000","last_undegraded":"2024-09-19T07:20:37.789841+0000","last_fullsized":"2024-09-19T07:20:37.789841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:22.229785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.480983+0000","last_change":"2024-09-19T07:20:19.540363+0000","last_active":"2024-09-19T07:20:38.480983+0000","last_peered":"2024-09-19T07:20:38.480983+0000","last_clean":"2024-09-19T07:20:38.480983+0000","last_became_active":"2024-09-19T07:20:19.540068+0000","last_became_peered":"2024-09-19T07:20:19.540068+0000","last_unstale":"2024-09-19T07:20:38.480983+0000","last_undegraded":"2024-09-19T07:20:38.480983+0000","last_fullsized":"2024-09-19T07:20:38.480983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:07.955849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790286+0000","last_change":"2024-09-19T07:20:19.533546+0000","last_active":"2024-09-19T07:20:37.790286+0000","last_peered":"2024-09-19T07:20:37.790286+0000","last_clean":"2024-09-19T07:20:37.790286+0000","last_became_active":"2024-09-19T07:20:19.533232+0000","last_became_peered":"2024-09-19T07:20:19.533232+0000","last_unstale":"2024-09-19T07:20:37.790286+0000","last_undegraded":"2024-09-19T07:20:37.790286+0000","last_fullsized":"2024-09-19T07:20:37.790286+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:29.674866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791434+0000","last_change":"2024-09-19T07:20:19.542842+0000","last_active":"2024-09-19T07:20:37.791434+0000","last_peered":"2024-09-19T07:20:37.791434+0000","last_clean":"2024-09-19T07:20:37.791434+0000","last_became_active":"2024-09-19T07:20:19.542477+0000","last_became_peered":"2024-09-19T07:20:19.542477+0000","last_unstale":"2024-09-19T07:20:37.791434+0000","last_undegraded":"2024-09-19T07:20:37.791434+0000","last_fullsized":"2024-09-19T07:20:37.791434+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:30.921099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788038+0000","last_change":"2024-09-19T07:20:19.530472+0000","last_active":"2024-09-19T07:20:37.788038+0000","last_peered":"2024-09-19T07:20:37.788038+0000","last_clean":"2024-09-19T07:20:37.788038+0000","last_became_active":"2024-09-19T07:20:19.529457+0000","last_became_peered":"2024-09-19T07:20:19.529457+0000","last_unstale":"2024-09-19T07:20:37.788038+0000","last_undegraded":"2024-09-19T07:20:37.788038+0000","last_fullsized":"2024-09-19T07:20:37.788038+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:16.410723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.801168+0000","last_change":"2024-09-19T07:20:37.801168+0000","last_active":"2024-09-19T07:20:37.801168+0000","last_peered":"2024-09-19T07:20:37.801168+0000","last_clean":"2024-09-19T07:20:37.801168+0000","last_became_active":"2024-09-19T07:20:37.800613+0000","last_became_peered":"2024-09-19T07:20:37.800613+0000","last_unstale":"2024-09-19T07:20:37.801168+0000","last_undegraded":"2024-09-19T07:20:37.801168+0000","last_fullsized":"2024-09-19T07:20:37.801168+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:27.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'5","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:21:19.835110+0000","last_change":"2024-09-19T07:20:17.524656+0000","last_active":"2024-09-19T07:21:19.835110+0000","last_peered":"2024-09-19T07:21:19.835110+0000","last_clean":"2024-09-19T07:21:19.835110+0000","last_became_active":"2024-09-19T07:20:17.524350+0000","last_became_peered":"2024-09-19T07:20:17.524350+0000","last_unstale":"2024-09-19T07:21:19.835110+0000","last_undegraded":"2024-09-19T07:21:19.835110+0000","last_fullsized":"2024-09-19T07:21:19.835110+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:00.459283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792702+0000","last_change":"2024-09-19T07:20:19.536895+0000","last_active":"2024-09-19T07:20:37.792702+0000","last_peered":"2024-09-19T07:20:37.792702+0000","last_clean":"2024-09-19T07:20:37.792702+0000","last_became_active":"2024-09-19T07:20:19.536569+0000","last_became_peered":"2024-09-19T07:20:19.536569+0000","last_unstale":"2024-09-19T07:20:37.792702+0000","last_undegraded":"2024-09-19T07:20:37.792702+0000","last_fullsized":"2024-09-19T07:20:37.792702+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:56.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790688+0000","last_change":"2024-09-19T07:20:17.519800+0000","last_active":"2024-09-19T07:20:37.790688+0000","last_peered":"2024-09-19T07:20:37.790688+0000","last_clean":"2024-09-19T07:20:37.790688+0000","last_became_active":"2024-09-19T07:20:17.519384+0000","last_became_peered":"2024-09-19T07:20:17.519384+0000","last_unstale":"2024-09-19T07:20:37.790688+0000","last_undegraded":"2024-09-19T07:20:37.790688+0000","last_fullsized":"2024-09-19T07:20:37.790688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:17.346946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789970+0000","last_change":"2024-09-19T07:20:17.511178+0000","last_active":"2024-09-19T07:20:37.789970+0000","last_peered":"2024-09-19T07:20:37.789970+0000","last_clean":"2024-09-19T07:20:37.789970+0000","last_became_active":"2024-09-19T07:20:17.510646+0000","last_became_peered":"2024-09-19T07:20:17.510646+0000","last_unstale":"2024-09-19T07:20:37.789970+0000","last_undegraded":"2024-09-19T07:20:37.789970+0000","last_fullsized":"2024-09-19T07:20:37.789970+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:58.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786720+0000","last_change":"2024-09-19T07:20:19.532979+0000","last_active":"2024-09-19T07:20:37.786720+0000","last_peered":"2024-09-19T07:20:37.786720+0000","last_clean":"2024-09-19T07:20:37.786720+0000","last_became_active":"2024-09-19T07:20:19.532396+0000","last_became_peered":"2024-09-19T07:20:19.532396+0000","last_unstale":"2024-09-19T07:20:37.786720+0000","last_undegraded":"2024-09-19T07:20:37.786720+0000","last_fullsized":"2024-09-19T07:20:37.786720+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:24.313572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792865+0000","last_change":"2024-09-19T07:20:17.519327+0000","last_active":"2024-09-19T07:20:37.792865+0000","last_peered":"2024-09-19T07:20:37.792865+0000","last_clean":"2024-09-19T07:20:37.792865+0000","last_became_active":"2024-09-19T07:20:17.518916+0000","last_became_peered":"2024-09-19T07:20:17.518916+0000","last_unstale":"2024-09-19T07:20:37.792865+0000","last_undegraded":"2024-09-19T07:20:37.792865+0000","last_fullsized":"2024-09-19T07:20:37.792865+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:52.672016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788221+0000","last_change":"2024-09-19T07:20:19.528642+0000","last_active":"2024-09-19T07:20:37.788221+0000","last_peered":"2024-09-19T07:20:37.788221+0000","last_clean":"2024-09-19T07:20:37.788221+0000","last_became_active":"2024-09-19T07:20:19.528302+0000","last_became_peered":"2024-09-19T07:20:19.528302+0000","last_unstale":"2024-09-19T07:20:37.788221+0000","last_undegraded":"2024-09-19T07:20:37.788221+0000","last_fullsized":"2024-09-19T07:20:37.788221+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:22.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'3","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:21:15.828907+0000","last_change":"2024-09-19T07:20:17.519144+0000","last_active":"2024-09-19T07:21:15.828907+0000","last_peered":"2024-09-19T07:21:15.828907+0000","last_clean":"2024-09-19T07:21:15.828907+0000","last_became_active":"2024-09-19T07:20:17.518714+0000","last_became_peered":"2024-09-19T07:20:17.518714+0000","last_unstale":"2024-09-19T07:21:15.828907+0000","last_undegraded":"2024-09-19T07:21:15.828907+0000","last_fullsized":"2024-09-19T07:21:15.828907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:09.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793978+0000","last_change":"2024-09-19T07:20:19.532293+0000","last_active":"2024-09-19T07:20:37.793978+0000","last_peered":"2024-09-19T07:20:37.793978+0000","last_clean":"2024-09-19T07:20:37.793978+0000","last_became_active":"2024-09-19T07:20:19.531427+0000","last_became_peered":"2024-09-19T07:20:19.531427+0000","last_unstale":"2024-09-19T07:20:37.793978+0000","last_undegraded":"2024-09-19T07:20:37.793978+0000","last_fullsized":"2024-09-19T07:20:37.793978+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:31.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791783+0000","last_change":"2024-09-19T07:20:17.521743+0000","last_active":"2024-09-19T07:20:37.791783+0000","last_peered":"2024-09-19T07:20:37.791783+0000","last_clean":"2024-09-19T07:20:37.791783+0000","last_became_active":"2024-09-19T07:20:17.521321+0000","last_became_peered":"2024-09-19T07:20:17.521321+0000","last_unstale":"2024-09-19T07:20:37.791783+0000","last_undegraded":"2024-09-19T07:20:37.791783+0000","last_fullsized":"2024-09-19T07:20:37.791783+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:21.107210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.481104+0000","last_change":"2024-09-19T07:20:19.532879+0000","last_active":"2024-09-19T07:20:38.481104+0000","last_peered":"2024-09-19T07:20:38.481104+0000","last_clean":"2024-09-19T07:20:38.481104+0000","last_became_active":"2024-09-19T07:20:19.532490+0000","last_became_peered":"2024-09-19T07:20:19.532490+0000","last_unstale":"2024-09-19T07:20:38.481104+0000","last_undegraded":"2024-09-19T07:20:38.481104+0000","last_fullsized":"2024-09-19T07:20:38.481104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:06.534849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793822+0000","last_change":"2024-09-19T07:20:17.565759+0000","last_active":"2024-09-19T07:20:37.793822+0000","last_peered":"2024-09-19T07:20:37.793822+0000","last_clean":"2024-09-19T07:20:37.793822+0000","last_became_active":"2024-09-19T07:20:17.565334+0000","last_became_peered":"2024-09-19T07:20:17.565334+0000","last_unstale":"2024-09-19T07:20:37.793822+0000","last_undegraded":"2024-09-19T07:20:37.793822+0000","last_fullsized":"2024-09-19T07:20:37.793822+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.588515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793971+0000","last_change":"2024-09-19T07:20:19.537397+0000","last_active":"2024-09-19T07:20:37.793971+0000","last_peered":"2024-09-19T07:20:37.793971+0000","last_clean":"2024-09-19T07:20:37.793971+0000","last_became_active":"2024-09-19T07:20:19.537059+0000","last_became_peered":"2024-09-19T07:20:19.537059+0000","last_unstale":"2024-09-19T07:20:37.793971+0000","last_undegraded":"2024-09-19T07:20:37.793971+0000","last_fullsized":"2024-09-19T07:20:37.793971+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:30.146934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":173,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:21:17.005423+0000","last_change":"2024-09-19T07:20:37.956721+0000","last_active":"2024-09-19T07:21:17.005423+0000","last_peered":"2024-09-19T07:21:17.005423+0000","last_clean":"2024-09-19T07:21:17.005423+0000","last_became_active":"2024-09-19T07:20:37.944159+0000","last_became_peered":"2024-09-19T07:20:37.944159+0000","last_unstale":"2024-09-19T07:21:17.005423+0000","last_undegraded":"2024-09-19T07:21:17.005423+0000","last_fullsized":"2024-09-19T07:21:17.005423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:52.944073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":102,"num_read_kb":104,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790648+0000","last_change":"2024-09-19T07:20:19.531533+0000","last_active":"2024-09-19T07:20:37.790648+0000","last_peered":"2024-09-19T07:20:37.790648+0000","last_clean":"2024-09-19T07:20:37.790648+0000","last_became_active":"2024-09-19T07:20:19.531228+0000","last_became_peered":"2024-09-19T07:20:19.531228+0000","last_unstale":"2024-09-19T07:20:37.790648+0000","last_undegraded":"2024-09-19T07:20:37.790648+0000","last_fullsized":"2024-09-19T07:20:37.790648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:34.606957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791767+0000","last_change":"2024-09-19T07:20:17.522411+0000","last_active":"2024-09-19T07:20:37.791767+0000","last_peered":"2024-09-19T07:20:37.791767+0000","last_clean":"2024-09-19T07:20:37.791767+0000","last_became_active":"2024-09-19T07:20:17.522086+0000","last_became_peered":"2024-09-19T07:20:17.522086+0000","last_unstale":"2024-09-19T07:20:37.791767+0000","last_undegraded":"2024-09-19T07:20:37.791767+0000","last_fullsized":"2024-09-19T07:20:37.791767+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.299624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789801+0000","last_change":"2024-09-19T07:20:19.532527+0000","last_active":"2024-09-19T07:20:37.789801+0000","last_peered":"2024-09-19T07:20:37.789801+0000","last_clean":"2024-09-19T07:20:37.789801+0000","last_became_active":"2024-09-19T07:20:19.532219+0000","last_became_peered":"2024-09-19T07:20:19.532219+0000","last_unstale":"2024-09-19T07:20:37.789801+0000","last_undegraded":"2024-09-19T07:20:37.789801+0000","last_fullsized":"2024-09-19T07:20:37.789801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:05.878229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792401+0000","last_change":"2024-09-19T07:20:17.518014+0000","last_active":"2024-09-19T07:20:37.792401+0000","last_peered":"2024-09-19T07:20:37.792401+0000","last_clean":"2024-09-19T07:20:37.792401+0000","last_became_active":"2024-09-19T07:20:17.517077+0000","last_became_peered":"2024-09-19T07:20:17.517077+0000","last_unstale":"2024-09-19T07:20:37.792401+0000","last_undegraded":"2024-09-19T07:20:37.792401+0000","last_fullsized":"2024-09-19T07:20:37.792401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:45.893365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791494+0000","last_change":"2024-09-19T07:20:19.539347+0000","last_active":"2024-09-19T07:20:37.791494+0000","last_peered":"2024-09-19T07:20:37.791494+0000","last_clean":"2024-09-19T07:20:37.791494+0000","last_became_active":"2024-09-19T07:20:19.538884+0000","last_became_peered":"2024-09-19T07:20:19.538884+0000","last_unstale":"2024-09-19T07:20:37.791494+0000","last_undegraded":"2024-09-19T07:20:37.791494+0000","last_fullsized":"2024-09-19T07:20:37.791494+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:23.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"78'3","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:21:19.834422+0000","last_change":"2024-09-19T07:20:17.513756+0000","last_active":"2024-09-19T07:21:19.834422+0000","last_peered":"2024-09-19T07:21:19.834422+0000","last_clean":"2024-09-19T07:21:19.834422+0000","last_became_active":"2024-09-19T07:20:17.513433+0000","last_became_peered":"2024-09-19T07:20:17.513433+0000","last_unstale":"2024-09-19T07:21:19.834422+0000","last_undegraded":"2024-09-19T07:21:19.834422+0000","last_fullsized":"2024-09-19T07:21:19.834422+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:27.681161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792289+0000","last_change":"2024-09-19T07:20:19.539873+0000","last_active":"2024-09-19T07:20:37.792289+0000","last_peered":"2024-09-19T07:20:37.792289+0000","last_clean":"2024-09-19T07:20:37.792289+0000","last_became_active":"2024-09-19T07:20:19.539581+0000","last_became_peered":"2024-09-19T07:20:19.539581+0000","last_unstale":"2024-09-19T07:20:37.792289+0000","last_undegraded":"2024-09-19T07:20:37.792289+0000","last_fullsized":"2024-09-19T07:20:37.792289+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:31.164179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790603+0000","last_change":"2024-09-19T07:20:17.565864+0000","last_active":"2024-09-19T07:20:37.790603+0000","last_peered":"2024-09-19T07:20:37.790603+0000","last_clean":"2024-09-19T07:20:37.790603+0000","last_became_active":"2024-09-19T07:20:17.565459+0000","last_became_peered":"2024-09-19T07:20:17.565459+0000","last_unstale":"2024-09-19T07:20:37.790603+0000","last_undegraded":"2024-09-19T07:20:37.790603+0000","last_fullsized":"2024-09-19T07:20:37.790603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:15.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.800857+0000","last_change":"2024-09-19T07:20:37.800857+0000","last_active":"2024-09-19T07:20:37.800857+0000","last_peered":"2024-09-19T07:20:37.800857+0000","last_clean":"2024-09-19T07:20:37.800857+0000","last_became_active":"2024-09-19T07:20:37.800347+0000","last_became_peered":"2024-09-19T07:20:37.800347+0000","last_unstale":"2024-09-19T07:20:37.800857+0000","last_undegraded":"2024-09-19T07:20:37.800857+0000","last_fullsized":"2024-09-19T07:20:37.800857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:48.678208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'2","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791580+0000","last_change":"2024-09-19T07:20:17.521439+0000","last_active":"2024-09-19T07:20:37.791580+0000","last_peered":"2024-09-19T07:20:37.791580+0000","last_clean":"2024-09-19T07:20:37.791580+0000","last_became_active":"2024-09-19T07:20:17.521021+0000","last_became_peered":"2024-09-19T07:20:17.521021+0000","last_unstale":"2024-09-19T07:20:37.791580+0000","last_undegraded":"2024-09-19T07:20:37.791580+0000","last_fullsized":"2024-09-19T07:20:37.791580+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.322352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788196+0000","last_change":"2024-09-19T07:20:19.531234+0000","last_active":"2024-09-19T07:20:37.788196+0000","last_peered":"2024-09-19T07:20:37.788196+0000","last_clean":"2024-09-19T07:20:37.788196+0000","last_became_active":"2024-09-19T07:20:19.530422+0000","last_became_peered":"2024-09-19T07:20:19.530422+0000","last_unstale":"2024-09-19T07:20:37.788196+0000","last_undegraded":"2024-09-19T07:20:37.788196+0000","last_fullsized":"2024-09-19T07:20:37.788196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:57.325415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789844+0000","last_change":"2024-09-19T07:20:17.522426+0000","last_active":"2024-09-19T07:20:37.789844+0000","last_peered":"2024-09-19T07:20:37.789844+0000","last_clean":"2024-09-19T07:20:37.789844+0000","last_became_active":"2024-09-19T07:20:17.522061+0000","last_became_peered":"2024-09-19T07:20:17.522061+0000","last_unstale":"2024-09-19T07:20:37.789844+0000","last_undegraded":"2024-09-19T07:20:37.789844+0000","last_fullsized":"2024-09-19T07:20:37.789844+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:04.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792454+0000","last_change":"2024-09-19T07:20:19.543420+0000","last_active":"2024-09-19T07:20:37.792454+0000","last_peered":"2024-09-19T07:20:37.792454+0000","last_clean":"2024-09-19T07:20:37.792454+0000","last_became_active":"2024-09-19T07:20:19.542294+0000","last_became_peered":"2024-09-19T07:20:19.542294+0000","last_unstale":"2024-09-19T07:20:37.792454+0000","last_undegraded":"2024-09-19T07:20:37.792454+0000","last_fullsized":"2024-09-19T07:20:37.792454+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:32.119366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.794273+0000","last_change":"2024-09-19T07:20:17.518402+0000","last_active":"2024-09-19T07:20:37.794273+0000","last_peered":"2024-09-19T07:20:37.794273+0000","last_clean":"2024-09-19T07:20:37.794273+0000","last_became_active":"2024-09-19T07:20:17.517524+0000","last_became_peered":"2024-09-19T07:20:17.517524+0000","last_unstale":"2024-09-19T07:20:37.794273+0000","last_undegraded":"2024-09-19T07:20:37.794273+0000","last_fullsized":"2024-09-19T07:20:37.794273+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:49.843442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791877+0000","last_change":"2024-09-19T07:20:19.540945+0000","last_active":"2024-09-19T07:20:37.791877+0000","last_peered":"2024-09-19T07:20:37.791877+0000","last_clean":"2024-09-19T07:20:37.791877+0000","last_became_active":"2024-09-19T07:20:19.540641+0000","last_became_peered":"2024-09-19T07:20:19.540641+0000","last_unstale":"2024-09-19T07:20:37.791877+0000","last_undegraded":"2024-09-19T07:20:37.791877+0000","last_fullsized":"2024-09-19T07:20:37.791877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.487418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792157+0000","last_change":"2024-09-19T07:20:17.567010+0000","last_active":"2024-09-19T07:20:37.792157+0000","last_peered":"2024-09-19T07:20:37.792157+0000","last_clean":"2024-09-19T07:20:37.792157+0000","last_became_active":"2024-09-19T07:20:17.566560+0000","last_became_peered":"2024-09-19T07:20:17.566560+0000","last_unstale":"2024-09-19T07:20:37.792157+0000","last_undegraded":"2024-09-19T07:20:37.792157+0000","last_fullsized":"2024-09-19T07:20:37.792157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.349568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791673+0000","last_change":"2024-09-19T07:20:19.541808+0000","last_active":"2024-09-19T07:20:37.791673+0000","last_peered":"2024-09-19T07:20:37.791673+0000","last_clean":"2024-09-19T07:20:37.791673+0000","last_became_active":"2024-09-19T07:20:19.541510+0000","last_became_peered":"2024-09-19T07:20:19.541510+0000","last_unstale":"2024-09-19T07:20:37.791673+0000","last_undegraded":"2024-09-19T07:20:37.791673+0000","last_fullsized":"2024-09-19T07:20:37.791673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:04.156121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":341,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792406+0000","last_change":"2024-09-19T07:19:11.632651+0000","last_active":"2024-09-19T07:20:37.792406+0000","last_peered":"2024-09-19T07:20:37.792406+0000","last_clean":"2024-09-19T07:20:37.792406+0000","last_became_active":"2024-09-19T07:19:11.632229+0000","last_became_peered":"2024-09-19T07:19:11.632229+0000","last_unstale":"2024-09-19T07:20:37.792406+0000","last_undegraded":"2024-09-19T07:20:37.792406+0000","last_fullsized":"2024-09-19T07:20:37.792406+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_clean_scrub_stamp":"2024-09-19T07:15:50.875302+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:32.716049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943206+0000","last_change":"2024-09-19T07:20:17.512387+0000","last_active":"2024-09-19T07:20:37.943206+0000","last_peered":"2024-09-19T07:20:37.943206+0000","last_clean":"2024-09-19T07:20:37.943206+0000","last_became_active":"2024-09-19T07:20:17.511956+0000","last_became_peered":"2024-09-19T07:20:17.511956+0000","last_unstale":"2024-09-19T07:20:37.943206+0000","last_undegraded":"2024-09-19T07:20:37.943206+0000","last_fullsized":"2024-09-19T07:20:37.943206+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:13.098347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786903+0000","last_change":"2024-09-19T07:20:19.536280+0000","last_active":"2024-09-19T07:20:37.786903+0000","last_peered":"2024-09-19T07:20:37.786903+0000","last_clean":"2024-09-19T07:20:37.786903+0000","last_became_active":"2024-09-19T07:20:19.535809+0000","last_became_peered":"2024-09-19T07:20:19.535809+0000","last_unstale":"2024-09-19T07:20:37.786903+0000","last_undegraded":"2024-09-19T07:20:37.786903+0000","last_fullsized":"2024-09-19T07:20:37.786903+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:07.645476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.801203+0000","last_change":"2024-09-19T07:20:37.800603+0000","last_active":"2024-09-19T07:20:37.801203+0000","last_peered":"2024-09-19T07:20:37.801203+0000","last_clean":"2024-09-19T07:20:37.801203+0000","last_became_active":"2024-09-19T07:20:37.794728+0000","last_became_peered":"2024-09-19T07:20:37.794728+0000","last_unstale":"2024-09-19T07:20:37.801203+0000","last_undegraded":"2024-09-19T07:20:37.801203+0000","last_fullsized":"2024-09-19T07:20:37.801203+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:46.606645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789726+0000","last_change":"2024-09-19T07:20:19.540203+0000","last_active":"2024-09-19T07:20:37.789726+0000","last_peered":"2024-09-19T07:20:37.789726+0000","last_clean":"2024-09-19T07:20:37.789726+0000","last_became_active":"2024-09-19T07:20:19.539813+0000","last_became_peered":"2024-09-19T07:20:19.539813+0000","last_unstale":"2024-09-19T07:20:37.789726+0000","last_undegraded":"2024-09-19T07:20:37.789726+0000","last_fullsized":"2024-09-19T07:20:37.789726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:52.164881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"78'4","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:21:17.831157+0000","last_change":"2024-09-19T07:20:17.565449+0000","last_active":"2024-09-19T07:21:17.831157+0000","last_peered":"2024-09-19T07:21:17.831157+0000","last_clean":"2024-09-19T07:21:17.831157+0000","last_became_active":"2024-09-19T07:20:17.565079+0000","last_became_peered":"2024-09-19T07:20:17.565079+0000","last_unstale":"2024-09-19T07:21:17.831157+0000","last_undegraded":"2024-09-19T07:21:17.831157+0000","last_fullsized":"2024-09-19T07:21:17.831157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:50.791388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792603+0000","last_change":"2024-09-19T07:20:19.533817+0000","last_active":"2024-09-19T07:20:37.792603+0000","last_peered":"2024-09-19T07:20:37.792603+0000","last_clean":"2024-09-19T07:20:37.792603+0000","last_became_active":"2024-09-19T07:20:19.532144+0000","last_became_peered":"2024-09-19T07:20:19.532144+0000","last_unstale":"2024-09-19T07:20:37.792603+0000","last_undegraded":"2024-09-19T07:20:37.792603+0000","last_fullsized":"2024-09-19T07:20:37.792603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:18.928739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791873+0000","last_change":"2024-09-19T07:20:17.514063+0000","last_active":"2024-09-19T07:20:37.791873+0000","last_peered":"2024-09-19T07:20:37.791873+0000","last_clean":"2024-09-19T07:20:37.791873+0000","last_became_active":"2024-09-19T07:20:17.513633+0000","last_became_peered":"2024-09-19T07:20:17.513633+0000","last_unstale":"2024-09-19T07:20:37.791873+0000","last_undegraded":"2024-09-19T07:20:37.791873+0000","last_fullsized":"2024-09-19T07:20:37.791873+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:24.113053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790844+0000","last_change":"2024-09-19T07:20:19.540209+0000","last_active":"2024-09-19T07:20:37.790844+0000","last_peered":"2024-09-19T07:20:37.790844+0000","last_clean":"2024-09-19T07:20:37.790844+0000","last_became_active":"2024-09-19T07:20:19.539855+0000","last_became_peered":"2024-09-19T07:20:19.539855+0000","last_unstale":"2024-09-19T07:20:37.790844+0000","last_undegraded":"2024-09-19T07:20:37.790844+0000","last_fullsized":"2024-09-19T07:20:37.790844+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:40.878905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788482+0000","last_change":"2024-09-19T07:20:17.565627+0000","last_active":"2024-09-19T07:20:37.788482+0000","last_peered":"2024-09-19T07:20:37.788482+0000","last_clean":"2024-09-19T07:20:37.788482+0000","last_became_active":"2024-09-19T07:20:17.565231+0000","last_became_peered":"2024-09-19T07:20:17.565231+0000","last_unstale":"2024-09-19T07:20:37.788482+0000","last_undegraded":"2024-09-19T07:20:37.788482+0000","last_fullsized":"2024-09-19T07:20:37.788482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:53.105336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'1","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790960+0000","last_change":"2024-09-19T07:20:19.532418+0000","last_active":"2024-09-19T07:20:37.790960+0000","last_peered":"2024-09-19T07:20:37.790960+0000","last_clean":"2024-09-19T07:20:37.790960+0000","last_became_active":"2024-09-19T07:20:19.532113+0000","last_became_peered":"2024-09-19T07:20:19.532113+0000","last_unstale":"2024-09-19T07:20:37.790960+0000","last_undegraded":"2024-09-19T07:20:37.790960+0000","last_fullsized":"2024-09-19T07:20:37.790960+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:24.953720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790920+0000","last_change":"2024-09-19T07:20:17.565984+0000","last_active":"2024-09-19T07:20:37.790920+0000","last_peered":"2024-09-19T07:20:37.790920+0000","last_clean":"2024-09-19T07:20:37.790920+0000","last_became_active":"2024-09-19T07:20:17.565240+0000","last_became_peered":"2024-09-19T07:20:17.565240+0000","last_unstale":"2024-09-19T07:20:37.790920+0000","last_undegraded":"2024-09-19T07:20:37.790920+0000","last_fullsized":"2024-09-19T07:20:37.790920+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:07.906716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.789919+0000","last_change":"2024-09-19T07:20:19.534400+0000","last_active":"2024-09-19T07:20:37.789919+0000","last_peered":"2024-09-19T07:20:37.789919+0000","last_clean":"2024-09-19T07:20:37.789919+0000","last_became_active":"2024-09-19T07:20:19.534130+0000","last_became_peered":"2024-09-19T07:20:19.534130+0000","last_unstale":"2024-09-19T07:20:37.789919+0000","last_undegraded":"2024-09-19T07:20:37.789919+0000","last_fullsized":"2024-09-19T07:20:37.789919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:09.398112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":34,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:43.527774+0000","last_change":"2024-09-19T07:20:17.519628+0000","last_active":"2024-09-19T07:20:43.527774+0000","last_peered":"2024-09-19T07:20:43.527774+0000","last_clean":"2024-09-19T07:20:43.527774+0000","last_became_active":"2024-09-19T07:20:17.519276+0000","last_became_peered":"2024-09-19T07:20:17.519276+0000","last_unstale":"2024-09-19T07:20:43.527774+0000","last_undegraded":"2024-09-19T07:20:43.527774+0000","last_fullsized":"2024-09-19T07:20:43.527774+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.193091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786947+0000","last_change":"2024-09-19T07:20:19.533425+0000","last_active":"2024-09-19T07:20:37.786947+0000","last_peered":"2024-09-19T07:20:37.786947+0000","last_clean":"2024-09-19T07:20:37.786947+0000","last_became_active":"2024-09-19T07:20:19.533142+0000","last_became_peered":"2024-09-19T07:20:19.533142+0000","last_unstale":"2024-09-19T07:20:37.786947+0000","last_undegraded":"2024-09-19T07:20:37.786947+0000","last_fullsized":"2024-09-19T07:20:37.786947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:07.048006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.943680+0000","last_change":"2024-09-19T07:20:17.512776+0000","last_active":"2024-09-19T07:20:37.943680+0000","last_peered":"2024-09-19T07:20:37.943680+0000","last_clean":"2024-09-19T07:20:37.943680+0000","last_became_active":"2024-09-19T07:20:17.511862+0000","last_became_peered":"2024-09-19T07:20:17.511862+0000","last_unstale":"2024-09-19T07:20:37.943680+0000","last_undegraded":"2024-09-19T07:20:37.943680+0000","last_fullsized":"2024-09-19T07:20:37.943680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:08.211654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.481028+0000","last_change":"2024-09-19T07:20:19.539260+0000","last_active":"2024-09-19T07:20:38.481028+0000","last_peered":"2024-09-19T07:20:38.481028+0000","last_clean":"2024-09-19T07:20:38.481028+0000","last_became_active":"2024-09-19T07:20:19.538868+0000","last_became_peered":"2024-09-19T07:20:19.538868+0000","last_unstale":"2024-09-19T07:20:38.481028+0000","last_undegraded":"2024-09-19T07:20:38.481028+0000","last_fullsized":"2024-09-19T07:20:38.481028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:44.198084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793712+0000","last_change":"2024-09-19T07:20:17.565544+0000","last_active":"2024-09-19T07:20:37.793712+0000","last_peered":"2024-09-19T07:20:37.793712+0000","last_clean":"2024-09-19T07:20:37.793712+0000","last_became_active":"2024-09-19T07:20:17.565250+0000","last_became_peered":"2024-09-19T07:20:17.565250+0000","last_unstale":"2024-09-19T07:20:37.793712+0000","last_undegraded":"2024-09-19T07:20:37.793712+0000","last_fullsized":"2024-09-19T07:20:37.793712+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:25.523136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791794+0000","last_change":"2024-09-19T07:20:19.531467+0000","last_active":"2024-09-19T07:20:37.791794+0000","last_peered":"2024-09-19T07:20:37.791794+0000","last_clean":"2024-09-19T07:20:37.791794+0000","last_became_active":"2024-09-19T07:20:19.531170+0000","last_became_peered":"2024-09-19T07:20:19.531170+0000","last_unstale":"2024-09-19T07:20:37.791794+0000","last_undegraded":"2024-09-19T07:20:37.791794+0000","last_fullsized":"2024-09-19T07:20:37.791794+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:23.113097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786781+0000","last_change":"2024-09-19T07:20:17.511400+0000","last_active":"2024-09-19T07:20:37.786781+0000","last_peered":"2024-09-19T07:20:37.786781+0000","last_clean":"2024-09-19T07:20:37.786781+0000","last_became_active":"2024-09-19T07:20:17.511126+0000","last_became_peered":"2024-09-19T07:20:17.511126+0000","last_unstale":"2024-09-19T07:20:37.786781+0000","last_undegraded":"2024-09-19T07:20:37.786781+0000","last_fullsized":"2024-09-19T07:20:37.786781+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.485406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.788319+0000","last_change":"2024-09-19T07:20:19.529171+0000","last_active":"2024-09-19T07:20:37.788319+0000","last_peered":"2024-09-19T07:20:37.788319+0000","last_clean":"2024-09-19T07:20:37.788319+0000","last_became_active":"2024-09-19T07:20:19.528489+0000","last_became_peered":"2024-09-19T07:20:19.528489+0000","last_unstale":"2024-09-19T07:20:37.788319+0000","last_undegraded":"2024-09-19T07:20:37.788319+0000","last_fullsized":"2024-09-19T07:20:37.788319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:10.842619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.803998+0000","last_change":"2024-09-19T07:20:37.803560+0000","last_active":"2024-09-19T07:20:37.803998+0000","last_peered":"2024-09-19T07:20:37.803998+0000","last_clean":"2024-09-19T07:20:37.803998+0000","last_became_active":"2024-09-19T07:20:37.797396+0000","last_became_peered":"2024-09-19T07:20:37.797396+0000","last_unstale":"2024-09-19T07:20:37.803998+0000","last_undegraded":"2024-09-19T07:20:37.803998+0000","last_fullsized":"2024-09-19T07:20:37.803998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:41.944179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.786827+0000","last_change":"2024-09-19T07:20:19.532698+0000","last_active":"2024-09-19T07:20:37.786827+0000","last_peered":"2024-09-19T07:20:37.786827+0000","last_clean":"2024-09-19T07:20:37.786827+0000","last_became_active":"2024-09-19T07:20:19.531978+0000","last_became_peered":"2024-09-19T07:20:19.531978+0000","last_unstale":"2024-09-19T07:20:37.786827+0000","last_undegraded":"2024-09-19T07:20:37.786827+0000","last_fullsized":"2024-09-19T07:20:37.786827+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:44.257024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791819+0000","last_change":"2024-09-19T07:20:17.525240+0000","last_active":"2024-09-19T07:20:37.791819+0000","last_peered":"2024-09-19T07:20:37.791819+0000","last_clean":"2024-09-19T07:20:37.791819+0000","last_became_active":"2024-09-19T07:20:17.524880+0000","last_became_peered":"2024-09-19T07:20:17.524880+0000","last_unstale":"2024-09-19T07:20:37.791819+0000","last_undegraded":"2024-09-19T07:20:37.791819+0000","last_fullsized":"2024-09-19T07:20:37.791819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:41.380246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.791596+0000","last_change":"2024-09-19T07:20:19.537116+0000","last_active":"2024-09-19T07:20:37.791596+0000","last_peered":"2024-09-19T07:20:37.791596+0000","last_clean":"2024-09-19T07:20:37.791596+0000","last_became_active":"2024-09-19T07:20:19.536799+0000","last_became_peered":"2024-09-19T07:20:19.536799+0000","last_unstale":"2024-09-19T07:20:37.791596+0000","last_undegraded":"2024-09-19T07:20:37.791596+0000","last_fullsized":"2024-09-19T07:20:37.791596+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:48.401159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.792890+0000","last_change":"2024-09-19T07:20:19.527965+0000","last_active":"2024-09-19T07:20:37.792890+0000","last_peered":"2024-09-19T07:20:37.792890+0000","last_clean":"2024-09-19T07:20:37.792890+0000","last_became_active":"2024-09-19T07:20:19.527522+0000","last_became_peered":"2024-09-19T07:20:19.527522+0000","last_unstale":"2024-09-19T07:20:37.792890+0000","last_undegraded":"2024-09-19T07:20:37.792890+0000","last_fullsized":"2024-09-19T07:20:37.792890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:16.034153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793263+0000","last_change":"2024-09-19T07:20:17.519400+0000","last_active":"2024-09-19T07:20:37.793263+0000","last_peered":"2024-09-19T07:20:37.793263+0000","last_clean":"2024-09-19T07:20:37.793263+0000","last_became_active":"2024-09-19T07:20:17.518993+0000","last_became_peered":"2024-09-19T07:20:17.518993+0000","last_unstale":"2024-09-19T07:20:37.793263+0000","last_undegraded":"2024-09-19T07:20:37.793263+0000","last_fullsized":"2024-09-19T07:20:37.793263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:37.086763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.793704+0000","last_change":"2024-09-19T07:20:19.531016+0000","last_active":"2024-09-19T07:20:37.793704+0000","last_peered":"2024-09-19T07:20:37.793704+0000","last_clean":"2024-09-19T07:20:37.793704+0000","last_became_active":"2024-09-19T07:20:19.530706+0000","last_became_peered":"2024-09-19T07:20:19.530706+0000","last_unstale":"2024-09-19T07:20:37.793704+0000","last_undegraded":"2024-09-19T07:20:37.793704+0000","last_fullsized":"2024-09-19T07:20:37.793704+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:36.566185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.790803+0000","last_change":"2024-09-19T07:20:17.524215+0000","last_active":"2024-09-19T07:20:37.790803+0000","last_peered":"2024-09-19T07:20:37.790803+0000","last_clean":"2024-09-19T07:20:37.790803+0000","last_became_active":"2024-09-19T07:20:17.523813+0000","last_became_peered":"2024-09-19T07:20:17.523813+0000","last_unstale":"2024-09-19T07:20:37.790803+0000","last_undegraded":"2024-09-19T07:20:37.790803+0000","last_fullsized":"2024-09-19T07:20:37.790803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:58.803225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:38.481093+0000","last_change":"2024-09-19T07:20:19.540994+0000","last_active":"2024-09-19T07:20:38.481093+0000","last_peered":"2024-09-19T07:20:38.481093+0000","last_clean":"2024-09-19T07:20:38.481093+0000","last_became_active":"2024-09-19T07:20:19.540703+0000","last_became_peered":"2024-09-19T07:20:19.540703+0000","last_unstale":"2024-09-19T07:20:38.481093+0000","last_undegraded":"2024-09-19T07:20:38.481093+0000","last_fullsized":"2024-09-19T07:20:38.481093+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:37.065187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.787038+0000","last_change":"2024-09-19T07:20:17.565438+0000","last_active":"2024-09-19T07:20:37.787038+0000","last_peered":"2024-09-19T07:20:37.787038+0000","last_clean":"2024-09-19T07:20:37.787038+0000","last_became_active":"2024-09-19T07:20:17.565128+0000","last_became_peered":"2024-09-19T07:20:17.565128+0000","last_unstale":"2024-09-19T07:20:37.787038+0000","last_undegraded":"2024-09-19T07:20:37.787038+0000","last_fullsized":"2024-09-19T07:20:37.787038+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:02.048971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.794751+0000","last_change":"2024-09-19T07:20:37.794369+0000","last_active":"2024-09-19T07:20:37.794751+0000","last_peered":"2024-09-19T07:20:37.794751+0000","last_clean":"2024-09-19T07:20:37.794751+0000","last_became_active":"2024-09-19T07:20:37.794036+0000","last_became_peered":"2024-09-19T07:20:37.794036+0000","last_unstale":"2024-09-19T07:20:37.794751+0000","last_undegraded":"2024-09-19T07:20:37.794751+0000","last_fullsized":"2024-09-19T07:20:37.794751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:02.684191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T07:20:37.950846+0000","last_change":"2024-09-19T07:20:37.950846+0000","last_active":"2024-09-19T07:20:37.950846+0000","last_peered":"2024-09-19T07:20:37.950846+0000","last_clean":"2024-09-19T07:20:37.950846+0000","last_became_active":"2024-09-19T07:20:37.944266+0000","last_became_peered":"2024-09-19T07:20:37.944266+0000","last_unstale":"2024-09-19T07:20:37.950846+0000","last_undegraded":"2024-09-19T07:20:37.950846+0000","last_fullsized":"2024-09-19T07:20:37.950846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:12.952833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63374,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":322,"num_read_kb":220,"num_write":163,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27529,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":190122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645337,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":880640,"data_stored":428259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874269,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28564,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716588,"statfs":{"total":95995035648,"available":95965786112,"internally_reserved":0,"allocated":1576960,"data_stored":1079504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037794,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":428495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266728,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":892928,"data_stored":427833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495660,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1490944,"data_stored":1019954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659185,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":427884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888119,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1503232,"data_stored":1019638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":488667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247872,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":428195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444101,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":429027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607626,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":487441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":429155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":60990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:21:24.647 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T07:21:24.648 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T07:21:24.648 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T07:21:24.648 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T07:21:24.897 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:25.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.318+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1712206912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaa4100a90 msgr2=0x7fdaa4100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.318+0000 7fdaa89ee640 1 --2- 172.21.15.98:0/1712206912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaa4100a90 0x7fdaa4100ef0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fda98009cd0 tx=0x7fda9802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.318+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1712206912 shutdown_connections 2024-09-19T07:21:25.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.318+0000 7fdaa89ee640 1 --2- 172.21.15.98:0/1712206912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaa4101430 0x7fdaa410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.318+0000 7fdaa89ee640 1 --2- 172.21.15.98:0/1712206912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaa4100a90 0x7fdaa4100ef0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.318+0000 7fdaa89ee640 1 --2- 172.21.15.98:0/1712206912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa4106a90 0x7fdaa4106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.318+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1712206912 >> 172.21.15.98:0/1712206912 conn(0x7fdaa40fc7d0 msgr2=0x7fdaa40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:25.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.318+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1712206912 shutdown_connections 2024-09-19T07:21:25.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.318+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1712206912 wait complete. 2024-09-19T07:21:25.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.319+0000 7fdaa89ee640 1 Processor -- start 2024-09-19T07:21:25.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.319+0000 7fdaa89ee640 1 -- start start 2024-09-19T07:21:25.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.319+0000 7fdaa89ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa4100a90 0x7fdaa4199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.319+0000 7fdaa89ee640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaa4101430 0x7fdaa4199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.319+0000 7fdaa89ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaa4106a90 0x7fdaa41a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.319+0000 7fdaa89ee640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa4110f30 con 0x7fdaa4101430 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.319+0000 7fdaa89ee640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa4110db0 con 0x7fdaa4106a90 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.319+0000 7fdaa89ee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa41110b0 con 0x7fdaa4100a90 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.319+0000 7fdaa1d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaa4101430 0x7fdaa4199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.319+0000 7fdaa1d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaa4101430 0x7fdaa4199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48650/0 (socket says 172.21.15.98:48650) 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.319+0000 7fdaa1d9b640 1 -- 172.21.15.98:0/1124898164 learned_addr learned my addr 172.21.15.98:0/1124898164 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.319+0000 7fdaa259c640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa4100a90 0x7fdaa4199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fdaa2d9d640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaa4106a90 0x7fdaa41a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fdaa1d9b640 1 -- 172.21.15.98:0/1124898164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa4100a90 msgr2=0x7fdaa4199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fdaa1d9b640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa4100a90 0x7fdaa4199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fdaa1d9b640 1 -- 172.21.15.98:0/1124898164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaa4106a90 msgr2=0x7fdaa41a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fdaa1d9b640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaa4106a90 0x7fdaa41a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fdaa1d9b640 1 -- 172.21.15.98:0/1124898164 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa41a4a00 con 0x7fdaa4101430 2024-09-19T07:21:25.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fdaa2d9d640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaa4106a90 0x7fdaa41a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:25.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fdaa1d9b640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaa4101430 0x7fdaa4199980 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda9802ae00 tx=0x7fda98003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:25.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fda937fe640 1 -- 172.21.15.98:0/1124898164 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98004240 con 0x7fdaa4101430 2024-09-19T07:21:25.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fda937fe640 1 -- 172.21.15.98:0/1124898164 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda980305a0 con 0x7fdaa4101430 2024-09-19T07:21:25.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1124898164 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa41a4bd0 con 0x7fdaa4101430 2024-09-19T07:21:25.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fda937fe640 1 -- 172.21.15.98:0/1124898164 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9803a660 con 0x7fdaa4101430 2024-09-19T07:21:25.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.320+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1124898164 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa41a5080 con 0x7fdaa4101430 2024-09-19T07:21:25.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.321+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1124898164 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa4100f70 con 0x7fdaa4101430 2024-09-19T07:21:25.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.322+0000 7fda937fe640 1 -- 172.21.15.98:0/1124898164 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fda98030ac0 con 0x7fdaa4101430 2024-09-19T07:21:25.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.323+0000 7fda937fe640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fda8c0a32d0 0x7fda8c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:25.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.323+0000 7fdaa259c640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fda8c0a32d0 0x7fda8c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:25.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.323+0000 7fda937fe640 1 -- 172.21.15.98:0/1124898164 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fda9802e030 con 0x7fdaa4101430 2024-09-19T07:21:25.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.323+0000 7fdaa259c640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fda8c0a32d0 0x7fda8c0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009990 tx=0x7fda9c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:25.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.327+0000 7fda937fe640 1 -- 172.21.15.98:0/1124898164 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda980098b0 con 0x7fdaa4101430 2024-09-19T07:21:25.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.530+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1124898164 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdaa4109020 con 0x7fdaa4101430 2024-09-19T07:21:25.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.530+0000 7fda937fe640 1 -- 172.21.15.98:0/1124898164 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fda980bd8f0 con 0x7fdaa4101430 2024-09-19T07:21:25.531 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:25.531 INFO:teuthology.orchestra.run.smithi098.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T07:21:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.532+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1124898164 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fda8c0a32d0 msgr2=0x7fda8c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.532+0000 7fdaa89ee640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fda8c0a32d0 0x7fda8c0a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fda9c009990 tx=0x7fda9c009110 comp rx=0 tx=0).stop 2024-09-19T07:21:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.532+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1124898164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaa4101430 msgr2=0x7fdaa4199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.532+0000 7fdaa89ee640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaa4101430 0x7fdaa4199980 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda9802ae00 tx=0x7fda98003ba0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.532+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1124898164 shutdown_connections 2024-09-19T07:21:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.532+0000 7fdaa89ee640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fda8c0a32d0 0x7fda8c0a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.532+0000 7fdaa89ee640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdaa4106a90 0x7fdaa41a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.532+0000 7fdaa89ee640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdaa4101430 0x7fdaa4199980 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.532+0000 7fdaa89ee640 1 --2- 172.21.15.98:0/1124898164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdaa4100a90 0x7fdaa4199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:25.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.532+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1124898164 >> 172.21.15.98:0/1124898164 conn(0x7fdaa40fc7d0 msgr2=0x7fdaa40fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:25.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.532+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1124898164 shutdown_connections 2024-09-19T07:21:25.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:25.533+0000 7fdaa89ee640 1 -- 172.21.15.98:0/1124898164 wait complete. 2024-09-19T07:21:26.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:25 smithi098 ceph-mon[30950]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:21:26.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:25 smithi098 ceph-mon[30950]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:26.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:25 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1124898164' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T07:21:26.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:25 smithi139 ceph-mon[35039]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:21:26.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:25 smithi139 ceph-mon[35039]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:26.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:25 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1124898164' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T07:21:26.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:25 smithi162 ceph-mon[35726]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:21:26.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:25 smithi162 ceph-mon[35726]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:26.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:25 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1124898164' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T07:21:26.249 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T07:21:26.249 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:21:26.495 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:27.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.985+0000 7f6eab907640 1 -- 172.21.15.98:0/4230762485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ea4102ef0 msgr2=0x7f6ea410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:27.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.985+0000 7f6eab907640 1 --2- 172.21.15.98:0/4230762485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ea4102ef0 0x7f6ea410da40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009ca0 tx=0x7f6e9c02a950 comp rx=0 tx=0).stop 2024-09-19T07:21:27.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.985+0000 7f6eab907640 1 -- 172.21.15.98:0/4230762485 shutdown_connections 2024-09-19T07:21:27.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.985+0000 7f6eab907640 1 --2- 172.21.15.98:0/4230762485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ea4102ef0 0x7f6ea410da40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:27.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.985+0000 7f6eab907640 1 --2- 172.21.15.98:0/4230762485 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ea4102570 0x7f6ea41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:27.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.985+0000 7f6eab907640 1 --2- 172.21.15.98:0/4230762485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea4100e20 0x7f6ea4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:27.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.985+0000 7f6eab907640 1 -- 172.21.15.98:0/4230762485 >> 172.21.15.98:0/4230762485 conn(0x7f6ea40fc7d0 msgr2=0x7f6ea40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:27.016 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.986+0000 7f6eab907640 1 -- 172.21.15.98:0/4230762485 shutdown_connections 2024-09-19T07:21:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.986+0000 7f6eab907640 1 -- 172.21.15.98:0/4230762485 wait complete. 2024-09-19T07:21:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.986+0000 7f6eab907640 1 Processor -- start 2024-09-19T07:21:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.986+0000 7f6eab907640 1 -- start start 2024-09-19T07:21:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.986+0000 7f6eab907640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ea4100e20 0x7f6ea4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.986+0000 7f6eab907640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ea4102570 0x7f6ea41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.986+0000 7f6eab907640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea4102ef0 0x7f6ea419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.986+0000 7f6eab907640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea4110f80 con 0x7f6ea4100e20 2024-09-19T07:21:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6eab907640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea4110e00 con 0x7f6ea4102570 2024-09-19T07:21:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6eab907640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea4111100 con 0x7f6ea4102ef0 2024-09-19T07:21:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea96a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ea4100e20 0x7f6ea4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea96a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ea4100e20 0x7f6ea4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48666/0 (socket says 172.21.15.98:48666) 2024-09-19T07:21:27.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea96a3640 1 -- 172.21.15.98:0/2738051527 learned_addr learned my addr 172.21.15.98:0/2738051527 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea8ea2640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ea4102570 0x7f6ea41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea9ea4640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea4102ef0 0x7f6ea419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea96a3640 1 -- 172.21.15.98:0/2738051527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea4102ef0 msgr2=0x7f6ea419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea96a3640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea4102ef0 0x7f6ea419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea96a3640 1 -- 172.21.15.98:0/2738051527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ea4102570 msgr2=0x7f6ea41989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea96a3640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ea4102570 0x7f6ea41989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea96a3640 1 -- 172.21.15.98:0/2738051527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea419d440 con 0x7f6ea4100e20 2024-09-19T07:21:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea9ea4640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea4102ef0 0x7f6ea419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea8ea2640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ea4102570 0x7f6ea41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6ea96a3640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ea4100e20 0x7f6ea4198490 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000d770 tx=0x7f6ea000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6e9a7fc640 1 -- 172.21.15.98:0/2738051527 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0017070 con 0x7f6ea4100e20 2024-09-19T07:21:27.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6e9a7fc640 1 -- 172.21.15.98:0/2738051527 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ea0005500 con 0x7f6ea4100e20 2024-09-19T07:21:27.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6eab907640 1 -- 172.21.15.98:0/2738051527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea419d730 con 0x7f6ea4100e20 2024-09-19T07:21:27.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6e9a7fc640 1 -- 172.21.15.98:0/2738051527 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0004e00 con 0x7f6ea4100e20 2024-09-19T07:21:27.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.987+0000 7f6eab907640 1 -- 172.21.15.98:0/2738051527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea41a5010 con 0x7f6ea4100e20 2024-09-19T07:21:27.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.988+0000 7f6eab907640 1 -- 172.21.15.98:0/2738051527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea4101200 con 0x7f6ea4100e20 2024-09-19T07:21:27.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.989+0000 7f6e9a7fc640 1 -- 172.21.15.98:0/2738051527 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6ea0004fa0 con 0x7f6ea4100e20 2024-09-19T07:21:27.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.990+0000 7f6e9a7fc640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f6e900a32d0 0x7f6e900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:27.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.990+0000 7f6ea8ea2640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f6e900a32d0 0x7f6e900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:27.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.990+0000 7f6e9a7fc640 1 -- 172.21.15.98:0/2738051527 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f6ea00cf5f0 con 0x7f6ea4100e20 2024-09-19T07:21:27.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.990+0000 7f6ea8ea2640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f6e900a32d0 0x7f6e900a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40fef00 tx=0x7f6e9400b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:27.019 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:26.994+0000 7f6e9a7fc640 1 -- 172.21.15.98:0/2738051527 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ea009c190 con 0x7f6ea4100e20 2024-09-19T07:21:27.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.197+0000 7f6eab907640 1 -- 172.21.15.98:0/2738051527 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ea410a0a0 con 0x7f6ea4100e20 2024-09-19T07:21:27.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.197+0000 7f6e9a7fc640 1 -- 172.21.15.98:0/2738051527 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11917 (secure 0 0 0) 0x7f6ea009ba90 con 0x7f6ea4100e20 2024-09-19T07:21:27.198 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:27.198 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"btime":"2024-09-19T07:20:31:757871+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:20:31.309254+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24442,24458,24479]},"id":1}]} 2024-09-19T07:21:27.198 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2024-09-19T07:21:27.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.200+0000 7f6eab907640 1 -- 172.21.15.98:0/2738051527 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f6e900a32d0 msgr2=0x7f6e900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:27.200 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.200+0000 7f6eab907640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f6e900a32d0 0x7f6e900a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40fef00 tx=0x7f6e9400b5f0 comp rx=0 tx=0).stop 2024-09-19T07:21:27.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.200+0000 7f6eab907640 1 -- 172.21.15.98:0/2738051527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ea4100e20 msgr2=0x7f6ea4198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:27.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.200+0000 7f6eab907640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ea4100e20 0x7f6ea4198490 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000d770 tx=0x7f6ea000dc30 comp rx=0 tx=0).stop 2024-09-19T07:21:27.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.200+0000 7f6eab907640 1 -- 172.21.15.98:0/2738051527 shutdown_connections 2024-09-19T07:21:27.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.200+0000 7f6eab907640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f6e900a32d0 0x7f6e900a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:27.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.200+0000 7f6eab907640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea4102ef0 0x7f6ea419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:27.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.200+0000 7f6eab907640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ea4102570 0x7f6ea41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:27.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.200+0000 7f6eab907640 1 --2- 172.21.15.98:0/2738051527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ea4100e20 0x7f6ea4198490 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:27.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.200+0000 7f6eab907640 1 -- 172.21.15.98:0/2738051527 >> 172.21.15.98:0/2738051527 conn(0x7f6ea40fc7d0 msgr2=0x7f6ea406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:27.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.200+0000 7f6eab907640 1 -- 172.21.15.98:0/2738051527 shutdown_connections 2024-09-19T07:21:27.201 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:27.200+0000 7f6eab907640 1 -- 172.21.15.98:0/2738051527 wait complete. 2024-09-19T07:21:27.903 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:27 smithi098 ceph-mon[30950]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:27.903 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:27 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2738051527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:27.933 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:21:28.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:27 smithi139 ceph-mon[35039]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:28.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:27 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2738051527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:28.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:27 smithi162 ceph-mon[35726]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:28.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:27 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2738051527' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:28.178 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:28.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.660+0000 7f56b2442640 1 -- 172.21.15.98:0/709599430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ac100a80 msgr2=0x7f56ac100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.660+0000 7f56b2442640 1 --2- 172.21.15.98:0/709599430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ac100a80 0x7f56ac100ee0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5694009930 tx=0x7f569402a420 comp rx=0 tx=0).stop 2024-09-19T07:21:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.660+0000 7f56b2442640 1 -- 172.21.15.98:0/709599430 shutdown_connections 2024-09-19T07:21:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.660+0000 7f56b2442640 1 --2- 172.21.15.98:0/709599430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56ac101420 0x7f56ac10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.660+0000 7f56b2442640 1 --2- 172.21.15.98:0/709599430 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ac100a80 0x7f56ac100ee0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.660+0000 7f56b2442640 1 --2- 172.21.15.98:0/709599430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56ac106a80 0x7f56ac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.660+0000 7f56b2442640 1 -- 172.21.15.98:0/709599430 >> 172.21.15.98:0/709599430 conn(0x7f56ac0fc7a0 msgr2=0x7f56ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.660+0000 7f56b2442640 1 -- 172.21.15.98:0/709599430 shutdown_connections 2024-09-19T07:21:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.660+0000 7f56b2442640 1 -- 172.21.15.98:0/709599430 wait complete. 2024-09-19T07:21:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.660+0000 7f56b2442640 1 Processor -- start 2024-09-19T07:21:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56b2442640 1 -- start start 2024-09-19T07:21:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56b2442640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ac100a80 0x7f56ac1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:28.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56b2442640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56ac101420 0x7f56ac1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56b2442640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56ac106a80 0x7f56ac19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56b2442640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac06ada0 con 0x7f56ac100a80 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56b2442640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac06ac20 con 0x7f56ac106a80 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56b2442640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56ac06af20 con 0x7f56ac101420 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56abfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ac100a80 0x7f56ac1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56abfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ac100a80 0x7f56ac1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48688/0 (socket says 172.21.15.98:48688) 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56abfff640 1 -- 172.21.15.98:0/860990607 learned_addr learned my addr 172.21.15.98:0/860990607 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56ab7fe640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56ac101420 0x7f56ac1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56b09df640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56ac106a80 0x7f56ac19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56abfff640 1 -- 172.21.15.98:0/860990607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56ac101420 msgr2=0x7f56ac1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56abfff640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56ac101420 0x7f56ac1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56abfff640 1 -- 172.21.15.98:0/860990607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56ac106a80 msgr2=0x7f56ac19cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:28.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56abfff640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56ac106a80 0x7f56ac19cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56abfff640 1 -- 172.21.15.98:0/860990607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ac19d460 con 0x7f56ac100a80 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.661+0000 7f56ab7fe640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56ac101420 0x7f56ac1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.662+0000 7f56abfff640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ac100a80 0x7f56ac1984b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f569c00c970 tx=0x7f569c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.662+0000 7f56a97fa640 1 -- 172.21.15.98:0/860990607 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c007bb0 con 0x7f56ac100a80 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.662+0000 7f56a97fa640 1 -- 172.21.15.98:0/860990607 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f569c007d50 con 0x7f56ac100a80 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.662+0000 7f56b2442640 1 -- 172.21.15.98:0/860990607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ac19d750 con 0x7f56ac100a80 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.662+0000 7f56a97fa640 1 -- 172.21.15.98:0/860990607 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569c00f450 con 0x7f56ac100a80 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.662+0000 7f56b2442640 1 -- 172.21.15.98:0/860990607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ac1a5030 con 0x7f56ac100a80 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.663+0000 7f56b2442640 1 -- 172.21.15.98:0/860990607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ac100ee0 con 0x7f56ac100a80 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.664+0000 7f56a97fa640 1 -- 172.21.15.98:0/860990607 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f569c004fe0 con 0x7f56ac100a80 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.664+0000 7f56a97fa640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f56980a3350 0x7f56980a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.665+0000 7f56ab7fe640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f56980a3350 0x7f56980a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:28.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.665+0000 7f56a97fa640 1 -- 172.21.15.98:0/860990607 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f569c0cfcc0 con 0x7f56ac100a80 2024-09-19T07:21:28.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.665+0000 7f56ab7fe640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f56980a3350 0x7f56980a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5694000c00 tx=0x7f5694032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:28.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.668+0000 7f56a97fa640 1 -- 172.21.15.98:0/860990607 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f569c014030 con 0x7f56ac100a80 2024-09-19T07:21:28.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.870+0000 7f56b2442640 1 -- 172.21.15.98:0/860990607 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56ac199810 con 0x7f56ac100a80 2024-09-19T07:21:28.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.871+0000 7f56a97fa640 1 -- 172.21.15.98:0/860990607 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11917 (secure 0 0 0) 0x7f569c09c8e0 con 0x7f56ac100a80 2024-09-19T07:21:28.872 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:28.872 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"btime":"2024-09-19T07:20:31:757871+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:20:31.309254+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24442,24458,24479]},"id":1}]} 2024-09-19T07:21:28.872 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2024-09-19T07:21:28.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.874+0000 7f56b2442640 1 -- 172.21.15.98:0/860990607 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f56980a3350 msgr2=0x7f56980a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.874+0000 7f56b2442640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f56980a3350 0x7f56980a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5694000c00 tx=0x7f5694032d50 comp rx=0 tx=0).stop 2024-09-19T07:21:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.874+0000 7f56b2442640 1 -- 172.21.15.98:0/860990607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ac100a80 msgr2=0x7f56ac1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.874+0000 7f56b2442640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ac100a80 0x7f56ac1984b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f569c00c970 tx=0x7f569c00ce30 comp rx=0 tx=0).stop 2024-09-19T07:21:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.874+0000 7f56b2442640 1 -- 172.21.15.98:0/860990607 shutdown_connections 2024-09-19T07:21:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.874+0000 7f56b2442640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f56980a3350 0x7f56980a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.874+0000 7f56b2442640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56ac106a80 0x7f56ac19cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.874+0000 7f56b2442640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56ac101420 0x7f56ac1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.874+0000 7f56b2442640 1 --2- 172.21.15.98:0/860990607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ac100a80 0x7f56ac1984b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.874+0000 7f56b2442640 1 -- 172.21.15.98:0/860990607 >> 172.21.15.98:0/860990607 conn(0x7f56ac0fc7a0 msgr2=0x7f56ac0fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.874+0000 7f56b2442640 1 -- 172.21.15.98:0/860990607 shutdown_connections 2024-09-19T07:21:28.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:28.874+0000 7f56b2442640 1 -- 172.21.15.98:0/860990607 wait complete. 2024-09-19T07:21:29.542 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:21:29.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:29 smithi098 ceph-mon[30950]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:29.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:29 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/860990607' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:29.789 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:29.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:29 smithi139 ceph-mon[35039]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:29.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:29 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/860990607' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:29 smithi162 ceph-mon[35726]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:29 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/860990607' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:30.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.238+0000 7f7c35eb9640 1 -- 172.21.15.98:0/872879598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c30100aa0 msgr2=0x7f7c3010ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:30.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.238+0000 7f7c35eb9640 1 --2- 172.21.15.98:0/872879598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c30100aa0 0x7f7c3010ea20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009ca0 tx=0x7f7c2802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:21:30.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.238+0000 7f7c35eb9640 1 -- 172.21.15.98:0/872879598 shutdown_connections 2024-09-19T07:21:30.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.238+0000 7f7c35eb9640 1 --2- 172.21.15.98:0/872879598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c30100aa0 0x7f7c3010ea20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:30.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.238+0000 7f7c35eb9640 1 --2- 172.21.15.98:0/872879598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c30100100 0x7f7c30100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:30.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.238+0000 7f7c35eb9640 1 --2- 172.21.15.98:0/872879598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c30106b80 0x7f7c30106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:30.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.238+0000 7f7c35eb9640 1 -- 172.21.15.98:0/872879598 >> 172.21.15.98:0/872879598 conn(0x7f7c30077230 msgr2=0x7f7c300fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:30.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.238+0000 7f7c35eb9640 1 -- 172.21.15.98:0/872879598 shutdown_connections 2024-09-19T07:21:30.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.238+0000 7f7c35eb9640 1 -- 172.21.15.98:0/872879598 wait complete. 2024-09-19T07:21:30.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c35eb9640 1 Processor -- start 2024-09-19T07:21:30.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c35eb9640 1 -- start start 2024-09-19T07:21:30.292 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c35eb9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c30100100 0x7f7c301984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:30.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c35eb9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c30100aa0 0x7f7c30198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:30.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c35eb9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c30106b80 0x7f7c3019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:30.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c35eb9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30112070 con 0x7f7c30106b80 2024-09-19T07:21:30.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c35eb9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30111ef0 con 0x7f7c30100100 2024-09-19T07:21:30.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c35eb9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c301121f0 con 0x7f7c30100aa0 2024-09-19T07:21:30.293 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c2ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c30106b80 0x7f7c3019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:30.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c2ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c30106b80 0x7f7c3019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48706/0 (socket says 172.21.15.98:48706) 2024-09-19T07:21:30.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c2ffff640 1 -- 172.21.15.98:0/4196978392 learned_addr learned my addr 172.21.15.98:0/4196978392 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:30.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c2f7fe640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c30100100 0x7f7c301984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:30.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c2ffff640 1 -- 172.21.15.98:0/4196978392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c30100aa0 msgr2=0x7f7c30198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:30.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c2effd640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c30100aa0 0x7f7c30198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:30.294 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c2ffff640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c30100aa0 0x7f7c30198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:30.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c2ffff640 1 -- 172.21.15.98:0/4196978392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c30100100 msgr2=0x7f7c301984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:30.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c2ffff640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c30100100 0x7f7c301984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:30.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.239+0000 7f7c2ffff640 1 -- 172.21.15.98:0/4196978392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3019d490 con 0x7f7c30106b80 2024-09-19T07:21:30.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.240+0000 7f7c2ffff640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c30106b80 0x7f7c3019cdb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7c280319f0 tx=0x7f7c28031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:30.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.240+0000 7f7c2cff9640 1 -- 172.21.15.98:0/4196978392 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c28003b70 con 0x7f7c30106b80 2024-09-19T07:21:30.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.240+0000 7f7c35eb9640 1 -- 172.21.15.98:0/4196978392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3019d720 con 0x7f7c30106b80 2024-09-19T07:21:30.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.240+0000 7f7c2cff9640 1 -- 172.21.15.98:0/4196978392 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c28003d10 con 0x7f7c30106b80 2024-09-19T07:21:30.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.240+0000 7f7c2cff9640 1 -- 172.21.15.98:0/4196978392 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c2802fd60 con 0x7f7c30106b80 2024-09-19T07:21:30.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.240+0000 7f7c35eb9640 1 -- 172.21.15.98:0/4196978392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c301a5060 con 0x7f7c30106b80 2024-09-19T07:21:30.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.241+0000 7f7c35eb9640 1 -- 172.21.15.98:0/4196978392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c30100560 con 0x7f7c30106b80 2024-09-19T07:21:30.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.242+0000 7f7c2cff9640 1 -- 172.21.15.98:0/4196978392 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7c28004050 con 0x7f7c30106b80 2024-09-19T07:21:30.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.243+0000 7f7c2cff9640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7c180a32d0 0x7f7c180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:30.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.243+0000 7f7c2f7fe640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7c180a32d0 0x7f7c180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:30.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.243+0000 7f7c2cff9640 1 -- 172.21.15.98:0/4196978392 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f7c280f0be0 con 0x7f7c30106b80 2024-09-19T07:21:30.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.243+0000 7f7c2f7fe640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7c180a32d0 0x7f7c180a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009990 tx=0x7f7c20009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:30.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.247+0000 7f7c2cff9640 1 -- 172.21.15.98:0/4196978392 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c280bd920 con 0x7f7c30106b80 2024-09-19T07:21:30.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.424+0000 7f7c35eb9640 1 -- 172.21.15.98:0/4196978392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c301a5290 con 0x7f7c30106b80 2024-09-19T07:21:30.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.426+0000 7f7c2cff9640 1 -- 172.21.15.98:0/4196978392 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22762 (secure 0 0 0) 0x7f7c280bd220 con 0x7f7c30106b80 2024-09-19T07:21:30.426 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:30.427 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":80,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:20:37.783934+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:20:16.391879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:20:18.243837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.428+0000 7f7c35eb9640 1 -- 172.21.15.98:0/4196978392 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7c180a32d0 msgr2=0x7f7c180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.428+0000 7f7c35eb9640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7c180a32d0 0x7f7c180a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7c20009990 tx=0x7f7c20009110 comp rx=0 tx=0).stop 2024-09-19T07:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.428+0000 7f7c35eb9640 1 -- 172.21.15.98:0/4196978392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c30106b80 msgr2=0x7f7c3019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:30.428 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.428+0000 7f7c35eb9640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c30106b80 0x7f7c3019cdb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7c280319f0 tx=0x7f7c28031a20 comp rx=0 tx=0).stop 2024-09-19T07:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.428+0000 7f7c35eb9640 1 -- 172.21.15.98:0/4196978392 shutdown_connections 2024-09-19T07:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.428+0000 7f7c35eb9640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f7c180a32d0 0x7f7c180a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.428+0000 7f7c35eb9640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c30106b80 0x7f7c3019cdb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.428+0000 7f7c35eb9640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c30100aa0 0x7f7c30198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.428+0000 7f7c35eb9640 1 --2- 172.21.15.98:0/4196978392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c30100100 0x7f7c301984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.428+0000 7f7c35eb9640 1 -- 172.21.15.98:0/4196978392 >> 172.21.15.98:0/4196978392 conn(0x7f7c30077230 msgr2=0x7f7c30104b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.428+0000 7f7c35eb9640 1 -- 172.21.15.98:0/4196978392 shutdown_connections 2024-09-19T07:21:30.429 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:30.428+0000 7f7c35eb9640 1 -- 172.21.15.98:0/4196978392 wait complete. 2024-09-19T07:21:31.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:30 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4196978392' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:21:31.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:30 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4196978392' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:21:31.090 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:21:31.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:30 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4196978392' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:21:31.353 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.852+0000 7f667c15a640 1 -- 172.21.15.98:0/2634891742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6674102570 msgr2=0x7f66741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.852+0000 7f667c15a640 1 --2- 172.21.15.98:0/2634891742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6674102570 0x7f66741029b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6668009900 tx=0x7f666802a480 comp rx=0 tx=0).stop 2024-09-19T07:21:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.852+0000 7f667c15a640 1 -- 172.21.15.98:0/2634891742 shutdown_connections 2024-09-19T07:21:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.852+0000 7f667c15a640 1 --2- 172.21.15.98:0/2634891742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6674102ef0 0x7f667410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.852+0000 7f667c15a640 1 --2- 172.21.15.98:0/2634891742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6674102570 0x7f66741029b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.852+0000 7f667c15a640 1 --2- 172.21.15.98:0/2634891742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6674100e20 0x7f6674101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.852+0000 7f667c15a640 1 -- 172.21.15.98:0/2634891742 >> 172.21.15.98:0/2634891742 conn(0x7f66740fc7d0 msgr2=0x7f66740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.852+0000 7f667c15a640 1 -- 172.21.15.98:0/2634891742 shutdown_connections 2024-09-19T07:21:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.852+0000 7f667c15a640 1 -- 172.21.15.98:0/2634891742 wait complete. 2024-09-19T07:21:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.852+0000 7f667c15a640 1 Processor -- start 2024-09-19T07:21:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.852+0000 7f667c15a640 1 -- start start 2024-09-19T07:21:31.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f667c15a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6674100e20 0x7f6674198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f667c15a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6674102570 0x7f6674198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f667c15a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6674102ef0 0x7f667419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f667c15a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6674110fa0 con 0x7f6674102570 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f667c15a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6674110e20 con 0x7f6674102ef0 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f667c15a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6674111120 con 0x7f6674100e20 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f66796f5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6674102570 0x7f6674198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f66796f5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6674102570 0x7f6674198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48722/0 (socket says 172.21.15.98:48722) 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f66796f5640 1 -- 172.21.15.98:0/181393346 learned_addr learned my addr 172.21.15.98:0/181393346 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f6679ef6640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6674100e20 0x7f6674198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f667a6f7640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6674102ef0 0x7f667419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f66796f5640 1 -- 172.21.15.98:0/181393346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6674100e20 msgr2=0x7f6674198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f66796f5640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6674100e20 0x7f6674198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:31.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f66796f5640 1 -- 172.21.15.98:0/181393346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6674102ef0 msgr2=0x7f667419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:31.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f66796f5640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6674102ef0 0x7f667419ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:31.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f66796f5640 1 -- 172.21.15.98:0/181393346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667419d510 con 0x7f6674102570 2024-09-19T07:21:31.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f6679ef6640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6674100e20 0x7f6674198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:31.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f66796f5640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6674102570 0x7f6674198aa0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6668006010 tx=0x7f6668003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:31.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f6672ffd640 1 -- 172.21.15.98:0/181393346 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666803f070 con 0x7f6674102570 2024-09-19T07:21:31.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f667c15a640 1 -- 172.21.15.98:0/181393346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667419d7a0 con 0x7f6674102570 2024-09-19T07:21:31.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f6672ffd640 1 -- 172.21.15.98:0/181393346 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6668031c30 con 0x7f6674102570 2024-09-19T07:21:31.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f6672ffd640 1 -- 172.21.15.98:0/181393346 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6668035030 con 0x7f6674102570 2024-09-19T07:21:31.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.853+0000 7f667c15a640 1 -- 172.21.15.98:0/181393346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66741a50e0 con 0x7f6674102570 2024-09-19T07:21:31.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.854+0000 7f667c15a640 1 -- 172.21.15.98:0/181393346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6674101200 con 0x7f6674102570 2024-09-19T07:21:31.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.855+0000 7f6672ffd640 1 -- 172.21.15.98:0/181393346 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6668042070 con 0x7f6674102570 2024-09-19T07:21:31.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.856+0000 7f6672ffd640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f665c0a32d0 0x7f665c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:31.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.856+0000 7f6679ef6640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f665c0a32d0 0x7f665c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:31.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.857+0000 7f6672ffd640 1 -- 172.21.15.98:0/181393346 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f66680f03d0 con 0x7f6674102570 2024-09-19T07:21:31.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.857+0000 7f6679ef6640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f665c0a32d0 0x7f665c0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f666c009930 tx=0x7f666c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:31.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:31.861+0000 7f6672ffd640 1 -- 172.21.15.98:0/181393346 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6668031de0 con 0x7f6674102570 2024-09-19T07:21:32.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:31 smithi098 ceph-mon[30950]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:32.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.064+0000 7f667c15a640 1 -- 172.21.15.98:0/181393346 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f667410a0a0 con 0x7f6674102570 2024-09-19T07:21:32.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.064+0000 7f6672ffd640 1 -- 172.21.15.98:0/181393346 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11917 (secure 0 0 0) 0x7f66680bcf70 con 0x7f6674102570 2024-09-19T07:21:32.065 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:32.065 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"btime":"2024-09-19T07:20:31:757871+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:20:31.309254+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24442,24458,24479]},"id":1}]} 2024-09-19T07:21:32.065 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2024-09-19T07:21:32.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:31 smithi139 ceph-mon[35039]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:32.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.067+0000 7f667c15a640 1 -- 172.21.15.98:0/181393346 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f665c0a32d0 msgr2=0x7f665c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:32.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.067+0000 7f667c15a640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f665c0a32d0 0x7f665c0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f666c009930 tx=0x7f666c008040 comp rx=0 tx=0).stop 2024-09-19T07:21:32.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.067+0000 7f667c15a640 1 -- 172.21.15.98:0/181393346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6674102570 msgr2=0x7f6674198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:32.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.067+0000 7f667c15a640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6674102570 0x7f6674198aa0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6668006010 tx=0x7f6668003c10 comp rx=0 tx=0).stop 2024-09-19T07:21:32.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.067+0000 7f667c15a640 1 -- 172.21.15.98:0/181393346 shutdown_connections 2024-09-19T07:21:32.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.067+0000 7f667c15a640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f665c0a32d0 0x7f665c0a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:32.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.067+0000 7f667c15a640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6674102ef0 0x7f667419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:32.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.067+0000 7f667c15a640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6674102570 0x7f6674198aa0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:32.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.067+0000 7f667c15a640 1 --2- 172.21.15.98:0/181393346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6674100e20 0x7f6674198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:32.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.067+0000 7f667c15a640 1 -- 172.21.15.98:0/181393346 >> 172.21.15.98:0/181393346 conn(0x7f66740fc7d0 msgr2=0x7f667406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:32.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.067+0000 7f667c15a640 1 -- 172.21.15.98:0/181393346 shutdown_connections 2024-09-19T07:21:32.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:32.067+0000 7f667c15a640 1 -- 172.21.15.98:0/181393346 wait complete. 2024-09-19T07:21:32.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:31 smithi162 ceph-mon[35726]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:32.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T07:20:20.077021+0000', 'modified': '2024-09-19T07:20:31.309254+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24479, 'mds_1': 24458, 'mds_2': 24442}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24425': {'gid': 24425, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6833/587476912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6832', 'nonce': 587476912}, {'type': 'v1', 'addr': '172.21.15.139:6833', 'nonce': 587476912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6837/2810820400', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 2810820400}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 2810820400}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6835/4113105598', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6834', 'nonce': 4113105598}, {'type': 'v1', 'addr': '172.21.15.139:6835', 'nonce': 4113105598}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.162:6839/609705447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 609705447}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 609705447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.139:6837/3386684827', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6836', 'nonce': 3386684827}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 3386684827}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24479': {'gid': 24479, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.139:6839/2420704228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6838', 'nonce': 2420704228}, {'type': 'v1', 'addr': '172.21.15.139:6839', 'nonce': 2420704228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24479, 'qdb_cluster': [24442, 24458, 24479]} 2024-09-19T07:21:32.680 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T07:21:32.681 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T07:21:32.928 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:33.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:32 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/181393346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:33.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:32 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/181393346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:33.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:32 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/181393346' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:33.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.319+0000 7f08fa968640 1 -- 172.21.15.98:0/171167583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f4100a80 msgr2=0x7f08f4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:33.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.319+0000 7f08fa968640 1 --2- 172.21.15.98:0/171167583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f4100a80 0x7f08f4100ee0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009930 tx=0x7f08dc02a420 comp rx=0 tx=0).stop 2024-09-19T07:21:33.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.319+0000 7f08fa968640 1 -- 172.21.15.98:0/171167583 shutdown_connections 2024-09-19T07:21:33.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.319+0000 7f08fa968640 1 --2- 172.21.15.98:0/171167583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08f4101420 0x7f08f410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.319+0000 7f08fa968640 1 --2- 172.21.15.98:0/171167583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f4100a80 0x7f08f4100ee0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.319+0000 7f08fa968640 1 --2- 172.21.15.98:0/171167583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f4106a80 0x7f08f4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.319+0000 7f08fa968640 1 -- 172.21.15.98:0/171167583 >> 172.21.15.98:0/171167583 conn(0x7f08f40fc7a0 msgr2=0x7f08f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:33.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.319+0000 7f08fa968640 1 -- 172.21.15.98:0/171167583 shutdown_connections 2024-09-19T07:21:33.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.319+0000 7f08fa968640 1 -- 172.21.15.98:0/171167583 wait complete. 2024-09-19T07:21:33.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08fa968640 1 Processor -- start 2024-09-19T07:21:33.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08fa968640 1 -- start start 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08fa968640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f4100a80 0x7f08f419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08fa968640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08f4101420 0x7f08f419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08fa968640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f4106a80 0x7f08f419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08fa968640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4110ea0 con 0x7f08f4100a80 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08fa968640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4110d20 con 0x7f08f4101420 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08fa968640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4111020 con 0x7f08f4106a80 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08f3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f4100a80 0x7f08f419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08f3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f4100a80 0x7f08f419a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44846/0 (socket says 172.21.15.98:44846) 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08f3fff640 1 -- 172.21.15.98:0/3576831583 learned_addr learned my addr 172.21.15.98:0/3576831583 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08f8f05640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f4106a80 0x7f08f419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08ebfff640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08f4101420 0x7f08f419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08f3fff640 1 -- 172.21.15.98:0/3576831583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f4106a80 msgr2=0x7f08f419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08f3fff640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f4106a80 0x7f08f419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08f3fff640 1 -- 172.21.15.98:0/3576831583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08f4101420 msgr2=0x7f08f419ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:33.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08f3fff640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08f4101420 0x7f08f419ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08f3fff640 1 -- 172.21.15.98:0/3576831583 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f419f680 con 0x7f08f4100a80 2024-09-19T07:21:33.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08f8f05640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f4106a80 0x7f08f419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:33.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.320+0000 7f08ebfff640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08f4101420 0x7f08f419ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:33.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.321+0000 7f08f3fff640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f4100a80 0x7f08f419a6d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f08e400b4a0 tx=0x7f08e400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:33.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.321+0000 7f08f1ffb640 1 -- 172.21.15.98:0/3576831583 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e4014070 con 0x7f08f4100a80 2024-09-19T07:21:33.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.321+0000 7f08f1ffb640 1 -- 172.21.15.98:0/3576831583 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08e4010af0 con 0x7f08f4100a80 2024-09-19T07:21:33.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.321+0000 7f08fa968640 1 -- 172.21.15.98:0/3576831583 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f419f970 con 0x7f08f4100a80 2024-09-19T07:21:33.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.321+0000 7f08f1ffb640 1 -- 172.21.15.98:0/3576831583 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e4017d10 con 0x7f08f4100a80 2024-09-19T07:21:33.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.321+0000 7f08fa968640 1 -- 172.21.15.98:0/3576831583 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f41a7250 con 0x7f08f4100a80 2024-09-19T07:21:33.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.323+0000 7f08f1ffb640 1 -- 172.21.15.98:0/3576831583 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f08e4017070 con 0x7f08f4100a80 2024-09-19T07:21:33.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.323+0000 7f08fcd41740 1 Processor -- start 2024-09-19T07:21:33.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.323+0000 7f08fcd41740 1 -- start start 2024-09-19T07:21:33.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08fcd41740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 0x557d1443bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08fcd41740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443c2f0 0x557d14446670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08fcd41740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d14446bb0 0x557d14448fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08fcd41740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557d143a2090 con 0x557d1443b9d0 2024-09-19T07:21:33.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08fcd41740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557d14349a70 con 0x557d14446bb0 2024-09-19T07:21:33.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08fcd41740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557d1439e050 con 0x557d1443c2f0 2024-09-19T07:21:33.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f8f05640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 0x557d1443bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f8f05640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 0x557d1443bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44862/0 (socket says 172.21.15.98:44862) 2024-09-19T07:21:33.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f8f05640 1 -- 172.21.15.98:0/2569656838 learned_addr learned my addr 172.21.15.98:0/2569656838 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:33.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f1ffb640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f08e00a3350 0x7f08e00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f3fff640 1 --2- 172.21.15.98:0/2569656838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443c2f0 0x557d14446670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08ebfff640 1 --2- 172.21.15.98:0/2569656838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d14446bb0 0x557d14448fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f8f05640 1 -- 172.21.15.98:0/2569656838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443c2f0 msgr2=0x557d14446670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:33.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f8f05640 1 --2- 172.21.15.98:0/2569656838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443c2f0 0x557d14446670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f8f05640 1 -- 172.21.15.98:0/2569656838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d14446bb0 msgr2=0x557d14448fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:33.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f8f05640 1 --2- 172.21.15.98:0/2569656838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d14446bb0 0x557d14448fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f8f05640 1 -- 172.21.15.98:0/2569656838 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d14356130 con 0x557d1443b9d0 2024-09-19T07:21:33.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08ebfff640 1 --2- 172.21.15.98:0/2569656838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d14446bb0 0x557d14448fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:33.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f8f05640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f08e00a3350 0x7f08e00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f1ffb640 1 -- 172.21.15.98:0/3576831583 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f08e40ced50 con 0x7f08f4100a80 2024-09-19T07:21:33.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.324+0000 7f08f8f05640 1 --2- 172.21.15.98:0/2569656838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 0x557d1443bdb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00d340 tx=0x7f08ec00d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e7dfff0aa68fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:33.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08ea7fc640 1 -- 172.21.15.98:0/2569656838 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec01a920 con 0x557d1443b9d0 2024-09-19T07:21:33.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08f8f05640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f08e00a3350 0x7f08e00a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f08ec01e000 tx=0x7f08ec01f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:33.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08ea7fc640 1 -- 172.21.15.98:0/2569656838 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08ec011500 con 0x557d1443b9d0 2024-09-19T07:21:33.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08ea7fc640 1 -- 172.21.15.98:0/2569656838 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec00e3b0 con 0x557d1443b9d0 2024-09-19T07:21:33.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08fcd41740 1 -- 172.21.15.98:0/2569656838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 msgr2=0x557d1443bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:33.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08fcd41740 1 --2- 172.21.15.98:0/2569656838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 0x557d1443bdb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00d340 tx=0x7f08ec00d800 comp rx=0 tx=0).stop 2024-09-19T07:21:33.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08fcd41740 1 -- 172.21.15.98:0/2569656838 shutdown_connections 2024-09-19T07:21:33.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08fcd41740 1 --2- 172.21.15.98:0/2569656838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d14446bb0 0x557d14448fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08fcd41740 1 --2- 172.21.15.98:0/2569656838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443c2f0 0x557d14446670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08fcd41740 1 --2- 172.21.15.98:0/2569656838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 0x557d1443bdb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08fcd41740 1 -- 172.21.15.98:0/2569656838 >> 172.21.15.98:0/2569656838 conn(0x557d14437f60 msgr2=0x557d14438340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:33.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08fcd41740 1 -- 172.21.15.98:0/2569656838 shutdown_connections 2024-09-19T07:21:33.338 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.325+0000 7f08fcd41740 1 -- 172.21.15.98:0/2569656838 wait complete. 2024-09-19T07:21:33.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08fcd41740 1 -- start start 2024-09-19T07:21:33.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08fcd41740 1 Processor -- start 2024-09-19T07:21:33.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08fcd41740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443b9d0 0x557d14446400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08fcd41740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d1443c2f0 0x557d14443750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08fcd41740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d14446bb0 0x557d14443c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08fcd41740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557d14449780 con 0x557d14446bb0 2024-09-19T07:21:33.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08fcd41740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557d1435cf20 con 0x557d1443c2f0 2024-09-19T07:21:33.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08fcd41740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557d14449900 con 0x557d1443b9d0 2024-09-19T07:21:33.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08fcd41740 10 client.0 _ll_register_callbacks cb 0x557d14326030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:33.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08f8f05640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d14446bb0 0x557d14443c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08f8f05640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d14446bb0 0x557d14443c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44866/0 (socket says 172.21.15.98:44866) 2024-09-19T07:21:33.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08f8f05640 1 -- 172.21.15.98:0/1066117536 learned_addr learned my addr 172.21.15.98:0/1066117536 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:33.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.326+0000 7f08f3fff640 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443b9d0 0x557d14446400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08ebfff640 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d1443c2f0 0x557d14443750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08f8f05640 1 -- 172.21.15.98:0/1066117536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443b9d0 msgr2=0x557d14446400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:33.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08f8f05640 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443b9d0 0x557d14446400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08f8f05640 1 -- 172.21.15.98:0/1066117536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d1443c2f0 msgr2=0x557d14443750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:33.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08f8f05640 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d1443c2f0 0x557d14443750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08f8f05640 1 -- 172.21.15.98:0/1066117536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d141132b0 con 0x557d14446bb0 2024-09-19T07:21:33.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08ebfff640 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d1443c2f0 0x557d14443750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:33.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08f8f05640 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d14446bb0 0x557d14443c90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f08ec019a30 tx=0x7f08ec008980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f97335b00fed88c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:33.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:21:33.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08d37fe640 1 -- 172.21.15.98:0/1066117536 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec019620 con 0x557d14446bb0 2024-09-19T07:21:33.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08d37fe640 1 -- 172.21.15.98:0/1066117536 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f08ec020030 con 0x557d14446bb0 2024-09-19T07:21:33.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08fcd41740 1 -- 172.21.15.98:0/1066117536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08ec011500 con 0x557d14446bb0 2024-09-19T07:21:33.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08d37fe640 1 -- 172.21.15.98:0/1066117536 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f08ec0197c0 con 0x557d14446bb0 2024-09-19T07:21:33.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08fcd41740 10 client.14952 fetch_fsmap learned FSMap version 23 2024-09-19T07:21:33.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08fcd41740 1 -- 172.21.15.98:0/1066117536 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x557d14455050 con 0x557d14446bb0 2024-09-19T07:21:33.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.327+0000 7f08d37fe640 1 -- 172.21.15.98:0/1066117536 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08ec011500 con 0x557d14446bb0 2024-09-19T07:21:33.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.328+0000 7f08d37fe640 1 -- 172.21.15.98:0/1066117536 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f08ec024480 con 0x557d14446bb0 2024-09-19T07:21:33.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.328+0000 7f08fcd41740 10 client.14952 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T07:21:33.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.328+0000 7f08fcd41740 10 client.14952 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:21:33.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.328+0000 7f08fcd41740 20 client.14952 populate_metadata read hostname 'smithi098' 2024-09-19T07:21:33.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.328+0000 7f08fcd41740 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x557d14457420 0x557d14458890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.328+0000 7f08fcd41740 4 client.14952 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:33.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.328+0000 7f08fcd41740 1 -- 172.21.15.98:0/1066117536 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d143af600 con 0x557d14457420 2024-09-19T07:21:33.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.328+0000 7f08f3fff640 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x557d14457420 0x557d14458890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.329+0000 7f08d37fe640 10 client.14952 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:21:33.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.329+0000 7f08f3fff640 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x557d14457420 0x557d14458890 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9f5c6333d77ab80a server_cookie=4e21812f3acbbb53 in_seq=0 out_seq=0 2024-09-19T07:21:33.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.329+0000 7f08d37fe640 1 -- 172.21.15.98:0/1066117536 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d143af600 con 0x557d14457420 2024-09-19T07:21:33.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.329+0000 7f08d37fe640 10 client.14952 handle_command_reply: tid=0 2024-09-19T07:21:33.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.329+0000 7f08fcd41740 1 client.14952 shutdown 2024-09-19T07:21:33.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.330+0000 7f08fcd41740 1 -- 172.21.15.98:0/1066117536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d14446bb0 msgr2=0x557d14443c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:33.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.330+0000 7f08fcd41740 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d14446bb0 0x557d14443c90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f08ec019a30 tx=0x7f08ec008980 comp rx=0 tx=0).stop 2024-09-19T07:21:33.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.330+0000 7f08fcd41740 1 -- 172.21.15.98:0/1066117536 shutdown_connections 2024-09-19T07:21:33.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.330+0000 7f08fcd41740 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d14446bb0 0x557d14443c90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.330+0000 7f08fcd41740 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d1443c2f0 0x557d14443750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.330+0000 7f08fcd41740 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x557d14457420 0x557d14458890 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.330+0000 7f08fcd41740 1 --2- 172.21.15.98:0/1066117536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443b9d0 0x557d14446400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.330+0000 7f08d37fe640 0 client.14952 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:21:33.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.330+0000 7f08fcd41740 1 -- 172.21.15.98:0/1066117536 >> 172.21.15.98:0/1066117536 conn(0x557d14437f60 msgr2=0x557d1443dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:33.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.330+0000 7f08fcd41740 1 -- 172.21.15.98:0/1066117536 shutdown_connections 2024-09-19T07:21:33.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.330+0000 7f08fcd41740 1 -- 172.21.15.98:0/1066117536 wait complete. 2024-09-19T07:21:33.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.330+0000 7f08fcd41740 20 client.14952 trim_cache size 0 max 16384 2024-09-19T07:21:33.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.347+0000 7f08fcd41740 1 Processor -- start 2024-09-19T07:21:33.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.347+0000 7f08fcd41740 1 -- start start 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.347+0000 7f08fcd41740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d1443b9d0 0x557d14456d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08fcd41740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443c2f0 0x557d14457af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08fcd41740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d14446bb0 0x557d14436ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08fcd41740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557d14456bd0 con 0x557d1443c2f0 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08fcd41740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557d144572a0 con 0x557d1443b9d0 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08fcd41740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557d14457970 con 0x557d14446bb0 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08ebfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443c2f0 0x557d14457af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08ebfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443c2f0 0x557d14457af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44874/0 (socket says 172.21.15.98:44874) 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08ebfff640 1 -- 172.21.15.98:0/3468152502 learned_addr learned my addr 172.21.15.98:0/3468152502 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08f3fff640 1 --2- 172.21.15.98:0/3468152502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d1443b9d0 0x557d14456d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08ebfff640 1 -- 172.21.15.98:0/3468152502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d14446bb0 msgr2=0x557d14436ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08ebfff640 1 --2- 172.21.15.98:0/3468152502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d14446bb0 0x557d14436ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08ebfff640 1 -- 172.21.15.98:0/3468152502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d1443b9d0 msgr2=0x557d14456d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08ebfff640 1 --2- 172.21.15.98:0/3468152502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d1443b9d0 0x557d14456d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08ebfff640 1 -- 172.21.15.98:0/3468152502 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1443cee0 con 0x557d1443c2f0 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08ebfff640 1 --2- 172.21.15.98:0/3468152502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443c2f0 0x557d14457af0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009900 tx=0x7f08dc032f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd49ec54cb7529e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08e9ffb640 1 -- 172.21.15.98:0/3468152502 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc03f070 con 0x557d1443c2f0 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08e9ffb640 1 -- 172.21.15.98:0/3468152502 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08dc031830 con 0x557d1443c2f0 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.348+0000 7f08e9ffb640 1 -- 172.21.15.98:0/3468152502 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc035070 con 0x557d1443c2f0 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.349+0000 7f08fcd41740 1 -- 172.21.15.98:0/3468152502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443c2f0 msgr2=0x557d14457af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.349+0000 7f08fcd41740 1 --2- 172.21.15.98:0/3468152502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443c2f0 0x557d14457af0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009900 tx=0x7f08dc032f80 comp rx=0 tx=0).stop 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.349+0000 7f08fcd41740 1 -- 172.21.15.98:0/3468152502 shutdown_connections 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.349+0000 7f08fcd41740 1 --2- 172.21.15.98:0/3468152502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d14446bb0 0x557d14436ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.349+0000 7f08fcd41740 1 --2- 172.21.15.98:0/3468152502 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443c2f0 0x557d14457af0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.349+0000 7f08fcd41740 1 --2- 172.21.15.98:0/3468152502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d1443b9d0 0x557d14456d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.349+0000 7f08fcd41740 1 -- 172.21.15.98:0/3468152502 >> 172.21.15.98:0/3468152502 conn(0x557d14437f60 msgr2=0x557d144367e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:33.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.349+0000 7f08fcd41740 1 -- 172.21.15.98:0/3468152502 shutdown_connections 2024-09-19T07:21:33.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.349+0000 7f08fcd41740 1 -- 172.21.15.98:0/3468152502 wait complete. 2024-09-19T07:21:33.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.349+0000 7f08fcd41740 1 -- start start 2024-09-19T07:21:33.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.349+0000 7f08fcd41740 1 Processor -- start 2024-09-19T07:21:33.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08fcd41740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 0x557d14460f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08fcd41740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443c2f0 0x557d14461460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08fcd41740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d14446bb0 0x557d1445c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08fcd41740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557d14458710 con 0x557d1443b9d0 2024-09-19T07:21:33.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08fcd41740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557d14458040 con 0x557d14446bb0 2024-09-19T07:21:33.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08fcd41740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557d14458de0 con 0x557d1443c2f0 2024-09-19T07:21:33.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08fcd41740 10 client.0 _ll_register_callbacks cb 0x7f08ec01d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08f3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 0x557d14460f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08f3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 0x557d14460f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44882/0 (socket says 172.21.15.98:44882) 2024-09-19T07:21:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08f3fff640 1 -- 172.21.15.98:0/2052782549 learned_addr learned my addr 172.21.15.98:0/2052782549 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08f8f05640 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d14446bb0 0x557d1445c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08f3fff640 1 -- 172.21.15.98:0/2052782549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443c2f0 msgr2=0x557d14461460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08f3fff640 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443c2f0 0x557d14461460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08f3fff640 1 -- 172.21.15.98:0/2052782549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d14446bb0 msgr2=0x557d1445c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08f3fff640 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d14446bb0 0x557d1445c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08f3fff640 1 -- 172.21.15.98:0/2052782549 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d1445cd00 con 0x557d1443b9d0 2024-09-19T07:21:33.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08f8f05640 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d14446bb0 0x557d1445c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:33.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08f3fff640 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 0x557d14460f20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f08e40cc820 tx=0x7f08e4017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34dc84c61fb06cc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:33.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:21:33.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08d37fe640 1 -- 172.21.15.98:0/2052782549 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e40b3070 con 0x557d1443b9d0 2024-09-19T07:21:33.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08d37fe640 1 -- 172.21.15.98:0/2052782549 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f08e4017360 con 0x557d1443b9d0 2024-09-19T07:21:33.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.350+0000 7f08fcd41740 1 -- 172.21.15.98:0/2052782549 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08dc031830 con 0x557d1443b9d0 2024-09-19T07:21:33.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.351+0000 7f08d37fe640 1 -- 172.21.15.98:0/2052782549 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f08e401e040 con 0x557d1443b9d0 2024-09-19T07:21:33.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.351+0000 7f08fcd41740 10 client.14958 fetch_fsmap learned FSMap version 23 2024-09-19T07:21:33.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.351+0000 7f08fcd41740 1 -- 172.21.15.98:0/2052782549 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x557d144c1820 con 0x557d1443b9d0 2024-09-19T07:21:33.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.351+0000 7f08d37fe640 1 -- 172.21.15.98:0/2052782549 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08dc031830 con 0x557d1443b9d0 2024-09-19T07:21:33.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.351+0000 7f08d37fe640 1 -- 172.21.15.98:0/2052782549 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f08e40cc290 con 0x557d1443b9d0 2024-09-19T07:21:33.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.351+0000 7f08fcd41740 10 client.14958 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T07:21:33.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.351+0000 7f08fcd41740 10 client.14958 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:21:33.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.351+0000 7f08fcd41740 20 client.14958 populate_metadata read hostname 'smithi098' 2024-09-19T07:21:33.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.351+0000 7f08fcd41740 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x557d144c6420 0x557d144c5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:33.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.351+0000 7f08fcd41740 4 client.14958 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:21:33.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.351+0000 7f08fcd41740 1 -- 172.21.15.98:0/2052782549 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "status"}) -- 0x557d143a9b10 con 0x557d144c6420 2024-09-19T07:21:33.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.351+0000 7f08ebfff640 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x557d144c6420 0x557d144c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:33.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08d37fe640 10 client.14958 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:21:33.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08ebfff640 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x557d144c6420 0x557d144c5130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=60c3a0f693ec5641 server_cookie=319025e5170fd955 in_seq=0 out_seq=0 2024-09-19T07:21:33.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08d37fe640 1 -- 172.21.15.98:0/2052782549 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557d143a9b10 con 0x557d144c6420 2024-09-19T07:21:33.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08d37fe640 10 client.14958 handle_command_reply: tid=0 2024-09-19T07:21:33.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08fcd41740 1 client.14958 shutdown 2024-09-19T07:21:33.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08fcd41740 1 -- 172.21.15.98:0/2052782549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 msgr2=0x557d14460f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:33.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08fcd41740 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 0x557d14460f20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f08e40cc820 tx=0x7f08e4017730 comp rx=0 tx=0).stop 2024-09-19T07:21:33.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08fcd41740 1 -- 172.21.15.98:0/2052782549 shutdown_connections 2024-09-19T07:21:33.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08fcd41740 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d14446bb0 0x557d1445c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08fcd41740 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x557d144c6420 0x557d144c5130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08fcd41740 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d1443c2f0 0x557d14461460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08fcd41740 1 --2- 172.21.15.98:0/2052782549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d1443b9d0 0x557d14460f20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08d37fe640 0 client.14958 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:21:33.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08fcd41740 1 -- 172.21.15.98:0/2052782549 >> 172.21.15.98:0/2052782549 conn(0x557d14437f60 msgr2=0x557d14437000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:33.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08fcd41740 1 -- 172.21.15.98:0/2052782549 shutdown_connections 2024-09-19T07:21:33.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08fcd41740 1 -- 172.21.15.98:0/2052782549 wait complete. 2024-09-19T07:21:33.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.352+0000 7f08fcd41740 20 client.14958 trim_cache size 0 max 16384 2024-09-19T07:21:33.364 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:21:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "73438718-7656-11ef-bceb-c7b262605968", 2024-09-19T07:21:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 2, 2024-09-19T07:21:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 24442, 2024-09-19T07:21:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-19T07:21:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-19T07:21:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-19T07:21:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 64.607274477999994, 2024-09-19T07:21:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 23, 2024-09-19T07:21:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 80, 2024-09-19T07:21:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T07:21:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 91.385079258999994 2024-09-19T07:21:33.365 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:21:33.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.353+0000 7f08fa968640 1 -- 172.21.15.98:0/3576831583 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f08e00a3350 msgr2=0x7f08e00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:33.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.353+0000 7f08fa968640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f08e00a3350 0x7f08e00a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f08ec01e000 tx=0x7f08ec01f000 comp rx=0 tx=0).stop 2024-09-19T07:21:33.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.353+0000 7f08fa968640 1 -- 172.21.15.98:0/3576831583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f4100a80 msgr2=0x7f08f419a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:33.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.353+0000 7f08fa968640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f4100a80 0x7f08f419a6d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f08e400b4a0 tx=0x7f08e400b960 comp rx=0 tx=0).stop 2024-09-19T07:21:33.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.353+0000 7f08fa968640 1 -- 172.21.15.98:0/3576831583 shutdown_connections 2024-09-19T07:21:33.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.353+0000 7f08fa968640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f08e00a3350 0x7f08e00a5810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.353+0000 7f08fa968640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08f4106a80 0x7f08f419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.353+0000 7f08fa968640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f08f4101420 0x7f08f419ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.353+0000 7f08fa968640 1 --2- 172.21.15.98:0/3576831583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f08f4100a80 0x7f08f419a6d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:33.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.353+0000 7f08fa968640 1 -- 172.21.15.98:0/3576831583 >> 172.21.15.98:0/3576831583 conn(0x7f08f40fc7a0 msgr2=0x7f08f406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:33.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.353+0000 7f08fa968640 1 -- 172.21.15.98:0/3576831583 shutdown_connections 2024-09-19T07:21:33.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:33.353+0000 7f08fa968640 1 -- 172.21.15.98:0/3576831583 wait complete. 2024-09-19T07:21:34.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:33 smithi098 ceph-mon[30950]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:34.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:33 smithi139 ceph-mon[35039]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:34.087 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T07:21:34.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:33 smithi162 ceph-mon[35726]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:34.329 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:34.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.794+0000 7ff69f3e9640 1 -- 172.21.15.98:0/4070928787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff698102790 msgr2=0x7ff6981067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:34.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.794+0000 7ff69f3e9640 1 --2- 172.21.15.98:0/4070928787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff698102790 0x7ff6981067e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff688009900 tx=0x7ff68802a410 comp rx=0 tx=0).stop 2024-09-19T07:21:34.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.794+0000 7ff69f3e9640 1 -- 172.21.15.98:0/4070928787 shutdown_connections 2024-09-19T07:21:34.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.794+0000 7ff69f3e9640 1 --2- 172.21.15.98:0/4070928787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff698106f10 0x7ff69810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.794+0000 7ff69f3e9640 1 --2- 172.21.15.98:0/4070928787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff698102790 0x7ff6981067e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.794+0000 7ff69f3e9640 1 --2- 172.21.15.98:0/4070928787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff698101de0 0x7ff6981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.794+0000 7ff69f3e9640 1 -- 172.21.15.98:0/4070928787 >> 172.21.15.98:0/4070928787 conn(0x7ff6980fd8c0 msgr2=0x7ff6980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:34.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.794+0000 7ff69f3e9640 1 -- 172.21.15.98:0/4070928787 shutdown_connections 2024-09-19T07:21:34.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.794+0000 7ff69f3e9640 1 -- 172.21.15.98:0/4070928787 wait complete. 2024-09-19T07:21:34.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.795+0000 7ff69f3e9640 1 Processor -- start 2024-09-19T07:21:34.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.795+0000 7ff69f3e9640 1 -- start start 2024-09-19T07:21:34.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.795+0000 7ff69f3e9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff698101de0 0x7ff698198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.795+0000 7ff69f3e9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff698102790 0x7ff698198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.795+0000 7ff69f3e9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff698106f10 0x7ff69819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.795+0000 7ff69f3e9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff698111f70 con 0x7ff698102790 2024-09-19T07:21:34.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.795+0000 7ff69f3e9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff698111df0 con 0x7ff698106f10 2024-09-19T07:21:34.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.795+0000 7ff69f3e9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6981120f0 con 0x7ff698101de0 2024-09-19T07:21:34.833 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.795+0000 7ff69c984640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff698102790 0x7ff698198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.795+0000 7ff69c984640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff698102790 0x7ff698198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44896/0 (socket says 172.21.15.98:44896) 2024-09-19T07:21:34.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.795+0000 7ff69c984640 1 -- 172.21.15.98:0/955487506 learned_addr learned my addr 172.21.15.98:0/955487506 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:34.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.795+0000 7ff69d986640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff698106f10 0x7ff69819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.796+0000 7ff69d185640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff698101de0 0x7ff698198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.796+0000 7ff69c984640 1 -- 172.21.15.98:0/955487506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff698101de0 msgr2=0x7ff698198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:34.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.796+0000 7ff69c984640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff698101de0 0x7ff698198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.796+0000 7ff69c984640 1 -- 172.21.15.98:0/955487506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff698106f10 msgr2=0x7ff69819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:34.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.796+0000 7ff69c984640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff698106f10 0x7ff69819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.796+0000 7ff69c984640 1 -- 172.21.15.98:0/955487506 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69819d3c0 con 0x7ff698102790 2024-09-19T07:21:34.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.796+0000 7ff69c984640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff698102790 0x7ff698198950 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff688006010 tx=0x7ff6880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:34.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.796+0000 7ff68e7fc640 1 -- 172.21.15.98:0/955487506 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68803f030 con 0x7ff698102790 2024-09-19T07:21:34.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.796+0000 7ff69f3e9640 1 -- 172.21.15.98:0/955487506 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff69819d650 con 0x7ff698102790 2024-09-19T07:21:34.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.796+0000 7ff68e7fc640 1 -- 172.21.15.98:0/955487506 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff688003ce0 con 0x7ff698102790 2024-09-19T07:21:34.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.796+0000 7ff68e7fc640 1 -- 172.21.15.98:0/955487506 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688035070 con 0x7ff698102790 2024-09-19T07:21:34.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.796+0000 7ff69f3e9640 1 -- 172.21.15.98:0/955487506 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6981a4f90 con 0x7ff698102790 2024-09-19T07:21:34.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.798+0000 7ff68e7fc640 1 -- 172.21.15.98:0/955487506 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff688042030 con 0x7ff698102790 2024-09-19T07:21:34.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff6a17c2740 1 Processor -- start 2024-09-19T07:21:34.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff6a17c2740 1 -- start start 2024-09-19T07:21:34.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff6a17c2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b1407890 0x5623b1407c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff6a17c2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b14081b0 0x5623b1416a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff6a17c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 0x5623b14193b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff6a17c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5623b136e090 con 0x5623b1416fc0 2024-09-19T07:21:34.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff6a17c2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5623b1315a70 con 0x5623b1407890 2024-09-19T07:21:34.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff6a17c2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5623b136a050 con 0x5623b14081b0 2024-09-19T07:21:34.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff68e7fc640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff6840a32d0 0x7ff6840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff69c984640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 0x5623b14193b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff69c984640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 0x5623b14193b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44904/0 (socket says 172.21.15.98:44904) 2024-09-19T07:21:34.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff69c984640 1 -- 172.21.15.98:0/239659768 learned_addr learned my addr 172.21.15.98:0/239659768 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:34.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff69d986640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff6840a32d0 0x7ff6840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff69d185640 1 --2- 172.21.15.98:0/239659768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b14081b0 0x5623b1416a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff69d986640 1 --2- 172.21.15.98:0/239659768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b1407890 0x5623b1407c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.799+0000 7ff68e7fc640 1 -- 172.21.15.98:0/955487506 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff6880f0230 con 0x7ff698102790 2024-09-19T07:21:34.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.800+0000 7ff69c984640 1 -- 172.21.15.98:0/239659768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b14081b0 msgr2=0x5623b1416a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:34.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.800+0000 7ff69c984640 1 --2- 172.21.15.98:0/239659768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b14081b0 0x5623b1416a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.800+0000 7ff69c984640 1 -- 172.21.15.98:0/239659768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b1407890 msgr2=0x5623b1407c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:34.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.800+0000 7ff69c984640 1 --2- 172.21.15.98:0/239659768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b1407890 0x5623b1407c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.800+0000 7ff69c984640 1 -- 172.21.15.98:0/239659768 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b1322130 con 0x5623b1416fc0 2024-09-19T07:21:34.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.800+0000 7ff69d986640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff6840a32d0 0x7ff6840a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff6900126c0 tx=0x7ff6900078f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:34.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.800+0000 7ff69c984640 1 --2- 172.21.15.98:0/239659768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 0x5623b14193b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff6880b9160 tx=0x7ff6880b8b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf9972f78855e61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:34.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.800+0000 7ff6837fe640 1 -- 172.21.15.98:0/239659768 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688049070 con 0x5623b1416fc0 2024-09-19T07:21:34.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.800+0000 7ff6837fe640 1 -- 172.21.15.98:0/239659768 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff68803b580 con 0x5623b1416fc0 2024-09-19T07:21:34.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.800+0000 7ff6837fe640 1 -- 172.21.15.98:0/239659768 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6880c0b40 con 0x5623b1416fc0 2024-09-19T07:21:34.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 -- 172.21.15.98:0/239659768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 msgr2=0x5623b14193b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:34.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/239659768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 0x5623b14193b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff6880b9160 tx=0x7ff6880b8b60 comp rx=0 tx=0).stop 2024-09-19T07:21:34.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 -- 172.21.15.98:0/239659768 shutdown_connections 2024-09-19T07:21:34.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/239659768 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 0x5623b14193b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/239659768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b14081b0 0x5623b1416a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/239659768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b1407890 0x5623b1407c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 -- 172.21.15.98:0/239659768 >> 172.21.15.98:0/239659768 conn(0x5623b1403f60 msgr2=0x5623b1404340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:34.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 -- 172.21.15.98:0/239659768 shutdown_connections 2024-09-19T07:21:34.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 -- 172.21.15.98:0/239659768 wait complete. 2024-09-19T07:21:34.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 -- start start 2024-09-19T07:21:34.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 Processor -- start 2024-09-19T07:21:34.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1407890 0x5623b14167e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b14081b0 0x5623b1413b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1416fc0 0x5623b14140c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5623b136e090 con 0x5623b1407890 2024-09-19T07:21:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5623b1328f20 con 0x5623b14081b0 2024-09-19T07:21:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.801+0000 7ff6a17c2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5623b1419950 con 0x5623b1416fc0 2024-09-19T07:21:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff6a17c2740 10 client.0 _ll_register_callbacks cb 0x5623b12f2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff69d185640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1407890 0x5623b14167e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff69d185640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1407890 0x5623b14167e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44910/0 (socket says 172.21.15.98:44910) 2024-09-19T07:21:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff69d185640 1 -- 172.21.15.98:0/1467150063 learned_addr learned my addr 172.21.15.98:0/1467150063 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff69d986640 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1416fc0 0x5623b14140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff69c984640 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b14081b0 0x5623b1413b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff69d185640 1 -- 172.21.15.98:0/1467150063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1416fc0 msgr2=0x5623b14140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:34.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff69d185640 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1416fc0 0x5623b14140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff69d185640 1 -- 172.21.15.98:0/1467150063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b14081b0 msgr2=0x5623b1413b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff69d185640 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b14081b0 0x5623b1413b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff69d185640 1 -- 172.21.15.98:0/1467150063 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b10df2b0 con 0x5623b1407890 2024-09-19T07:21:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff69d185640 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1407890 0x5623b14167e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff694009e70 tx=0x7ff6940117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ca8e725d722e0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff680ff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:21:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff680ff9640 1 -- 172.21.15.98:0/1467150063 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff694012860 con 0x5623b1407890 2024-09-19T07:21:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff680ff9640 1 -- 172.21.15.98:0/1467150063 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff694012a00 con 0x5623b1407890 2024-09-19T07:21:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff6a17c2740 1 -- 172.21.15.98:0/1467150063 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5623b137b600 con 0x5623b1407890 2024-09-19T07:21:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff680ff9640 1 -- 172.21.15.98:0/1467150063 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff694012c00 con 0x5623b1407890 2024-09-19T07:21:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff6a17c2740 10 client.14970 fetch_fsmap learned FSMap version 23 2024-09-19T07:21:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff6a17c2740 1 -- 172.21.15.98:0/1467150063 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5623b1425140 con 0x5623b1407890 2024-09-19T07:21:34.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.802+0000 7ff680ff9640 1 -- 172.21.15.98:0/1467150063 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5623b137b600 con 0x5623b1407890 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.803+0000 7ff680ff9640 1 -- 172.21.15.98:0/1467150063 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7ff69400f040 con 0x5623b1407890 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.803+0000 7ff6a17c2740 10 client.14970 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.803+0000 7ff6a17c2740 10 client.14970 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.803+0000 7ff6a17c2740 20 client.14970 populate_metadata read hostname 'smithi098' 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.803+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5623b14277a0 0x5623b1428c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.803+0000 7ff6a17c2740 4 client.14970 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.803+0000 7ff6a17c2740 1 -- 172.21.15.98:0/1467150063 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623b1375b10 con 0x5623b14277a0 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.803+0000 7ff69c984640 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5623b14277a0 0x5623b1428c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.803+0000 7ff680ff9640 10 client.14970 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.803+0000 7ff69c984640 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5623b14277a0 0x5623b1428c10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d121eacfcef9b722 server_cookie=b960b669134f40b1 in_seq=0 out_seq=0 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.804+0000 7ff680ff9640 1 -- 172.21.15.98:0/1467150063 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623b1375b10 con 0x5623b14277a0 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.804+0000 7ff680ff9640 10 client.14970 handle_command_reply: tid=0 2024-09-19T07:21:34.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.804+0000 7ff6a17c2740 1 client.14970 shutdown 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.804+0000 7ff6a17c2740 1 -- 172.21.15.98:0/1467150063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1407890 msgr2=0x5623b14167e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.804+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1407890 0x5623b14167e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff694009e70 tx=0x7ff6940117b0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.804+0000 7ff6a17c2740 1 -- 172.21.15.98:0/1467150063 shutdown_connections 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.804+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5623b14277a0 0x5623b1428c10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.804+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1416fc0 0x5623b14140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.804+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b14081b0 0x5623b1413b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.804+0000 7ff680ff9640 0 client.14970 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.804+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/1467150063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1407890 0x5623b14167e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.804+0000 7ff6a17c2740 1 -- 172.21.15.98:0/1467150063 >> 172.21.15.98:0/1467150063 conn(0x5623b1403f60 msgr2=0x5623b1409cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.805+0000 7ff6a17c2740 1 -- 172.21.15.98:0/1467150063 shutdown_connections 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.805+0000 7ff6a17c2740 1 -- 172.21.15.98:0/1467150063 wait complete. 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.805+0000 7ff6a17c2740 20 client.14970 trim_cache size 0 max 16384 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.822+0000 7ff6a17c2740 1 Processor -- start 2024-09-19T07:21:34.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.822+0000 7ff6a17c2740 1 -- start start 2024-09-19T07:21:34.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.822+0000 7ff6a17c2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1407890 0x5623b13fece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.822+0000 7ff6a17c2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b14081b0 0x5623b140f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.822+0000 7ff6a17c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 0x5623b1410de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.822+0000 7ff6a17c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5623b1426f50 con 0x5623b1416fc0 2024-09-19T07:21:34.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.822+0000 7ff6a17c2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5623b1427620 con 0x5623b14081b0 2024-09-19T07:21:34.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.822+0000 7ff6a17c2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5623b1427cf0 con 0x5623b1407890 2024-09-19T07:21:34.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.822+0000 7ff69d986640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 0x5623b1410de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.822+0000 7ff69d986640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 0x5623b1410de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44922/0 (socket says 172.21.15.98:44922) 2024-09-19T07:21:34.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.822+0000 7ff69d986640 1 -- 172.21.15.98:0/3184941132 learned_addr learned my addr 172.21.15.98:0/3184941132 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:34.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.823+0000 7ff69c984640 1 --2- 172.21.15.98:0/3184941132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b14081b0 0x5623b140f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.823+0000 7ff69d986640 1 -- 172.21.15.98:0/3184941132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1407890 msgr2=0x5623b13fece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:34.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.823+0000 7ff69d986640 1 --2- 172.21.15.98:0/3184941132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1407890 0x5623b13fece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.823+0000 7ff69d986640 1 -- 172.21.15.98:0/3184941132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b14081b0 msgr2=0x5623b140f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:34.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.823+0000 7ff69d986640 1 --2- 172.21.15.98:0/3184941132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b14081b0 0x5623b140f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.823+0000 7ff69d986640 1 -- 172.21.15.98:0/3184941132 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b14120d0 con 0x5623b1416fc0 2024-09-19T07:21:34.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.823+0000 7ff69c984640 1 --2- 172.21.15.98:0/3184941132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b14081b0 0x5623b140f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:34.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.823+0000 7ff69d986640 1 --2- 172.21.15.98:0/3184941132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 0x5623b1410de0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff690003be0 tx=0x7ff690004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7501c745bb7e2c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:34.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.823+0000 7ff682ffd640 1 -- 172.21.15.98:0/3184941132 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690004b20 con 0x5623b1416fc0 2024-09-19T07:21:34.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.823+0000 7ff682ffd640 1 -- 172.21.15.98:0/3184941132 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff690004cc0 con 0x5623b1416fc0 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.823+0000 7ff682ffd640 1 -- 172.21.15.98:0/3184941132 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff690005460 con 0x5623b1416fc0 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.824+0000 7ff6a17c2740 1 -- 172.21.15.98:0/3184941132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 msgr2=0x5623b1410de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.824+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/3184941132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 0x5623b1410de0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff690003be0 tx=0x7ff690004ab0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.824+0000 7ff6a17c2740 1 -- 172.21.15.98:0/3184941132 shutdown_connections 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.824+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/3184941132 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b1416fc0 0x5623b1410de0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.824+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/3184941132 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b14081b0 0x5623b140f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.824+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/3184941132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1407890 0x5623b13fece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.824+0000 7ff6a17c2740 1 -- 172.21.15.98:0/3184941132 >> 172.21.15.98:0/3184941132 conn(0x5623b1403f60 msgr2=0x5623b140ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.824+0000 7ff6a17c2740 1 -- 172.21.15.98:0/3184941132 shutdown_connections 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.824+0000 7ff6a17c2740 1 -- 172.21.15.98:0/3184941132 wait complete. 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.824+0000 7ff6a17c2740 1 -- start start 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.824+0000 7ff6a17c2740 1 Processor -- start 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.824+0000 7ff6a17c2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1407890 0x5623b142a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff6a17c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b14081b0 0x5623b142a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff6a17c2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b1416fc0 0x5623b148fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff6a17c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5623b1428a90 con 0x5623b14081b0 2024-09-19T07:21:34.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff6a17c2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5623b14283c0 con 0x5623b1416fc0 2024-09-19T07:21:34.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff6a17c2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5623b1429160 con 0x5623b1407890 2024-09-19T07:21:34.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff6a17c2740 10 client.0 _ll_register_callbacks cb 0x7ff6940096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:34.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff69c984640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b14081b0 0x5623b142a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff69c984640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b14081b0 0x5623b142a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44926/0 (socket says 172.21.15.98:44926) 2024-09-19T07:21:34.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff69c984640 1 -- 172.21.15.98:0/4188146922 learned_addr learned my addr 172.21.15.98:0/4188146922 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:34.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff69d185640 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1407890 0x5623b142a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff69d986640 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b1416fc0 0x5623b148fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff69c984640 1 -- 172.21.15.98:0/4188146922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1407890 msgr2=0x5623b142a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:34.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff69c984640 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1407890 0x5623b142a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff69c984640 1 -- 172.21.15.98:0/4188146922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b1416fc0 msgr2=0x5623b148fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:34.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff69c984640 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b1416fc0 0x5623b148fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff69c984640 1 -- 172.21.15.98:0/4188146922 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b1490410 con 0x5623b14081b0 2024-09-19T07:21:34.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff69c984640 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b14081b0 0x5623b142a9e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff688005c40 tx=0x7ff68802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4176cac8ba0fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:34.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff680ff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:21:34.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff680ff9640 1 -- 172.21.15.98:0/4188146922 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688049040 con 0x5623b14081b0 2024-09-19T07:21:34.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff680ff9640 1 -- 172.21.15.98:0/4188146922 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7ff6880baa90 con 0x5623b14081b0 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff6a17c2740 1 -- 172.21.15.98:0/4188146922 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff690004cc0 con 0x5623b14081b0 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff680ff9640 1 -- 172.21.15.98:0/4188146922 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff6880bc560 con 0x5623b14081b0 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff6a17c2740 10 client.14976 fetch_fsmap learned FSMap version 23 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.825+0000 7ff6a17c2740 1 -- 172.21.15.98:0/4188146922 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5623b1491680 con 0x5623b14081b0 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.826+0000 7ff680ff9640 1 -- 172.21.15.98:0/4188146922 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff690004cc0 con 0x5623b14081b0 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.826+0000 7ff680ff9640 1 -- 172.21.15.98:0/4188146922 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7ff6880b8e00 con 0x5623b14081b0 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.826+0000 7ff6a17c2740 10 client.14976 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.826+0000 7ff6a17c2740 10 client.14976 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.826+0000 7ff6a17c2740 20 client.14976 populate_metadata read hostname 'smithi098' 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.826+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5623b1496000 0x5623b1494d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.826+0000 7ff6a17c2740 4 client.14976 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.826+0000 7ff6a17c2740 1 -- 172.21.15.98:0/4188146922 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "status"}) -- 0x5623b12f20e0 con 0x5623b1496000 2024-09-19T07:21:34.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.826+0000 7ff69d185640 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5623b1496000 0x5623b1494d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff680ff9640 10 client.14976 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff69d185640 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5623b1496000 0x5623b1494d10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bebd9ac7a905e6a8 server_cookie=718969cda2de7a9b in_seq=0 out_seq=0 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff680ff9640 1 -- 172.21.15.98:0/4188146922 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5623b12f20e0 con 0x5623b1496000 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff680ff9640 10 client.14976 handle_command_reply: tid=0 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff6a17c2740 1 client.14976 shutdown 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff6a17c2740 1 -- 172.21.15.98:0/4188146922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b14081b0 msgr2=0x5623b142a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b14081b0 0x5623b142a9e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff688005c40 tx=0x7ff68802a410 comp rx=0 tx=0).stop 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff6a17c2740 1 -- 172.21.15.98:0/4188146922 shutdown_connections 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5623b1496000 0x5623b1494d10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5623b1416fc0 0x5623b148fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5623b14081b0 0x5623b142a9e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff6a17c2740 1 --2- 172.21.15.98:0/4188146922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5623b1407890 0x5623b142a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff6a17c2740 1 -- 172.21.15.98:0/4188146922 >> 172.21.15.98:0/4188146922 conn(0x5623b1403f60 msgr2=0x5623b140f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:34.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff680ff9640 0 client.14976 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:21:34.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff6a17c2740 1 -- 172.21.15.98:0/4188146922 shutdown_connections 2024-09-19T07:21:34.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff6a17c2740 1 -- 172.21.15.98:0/4188146922 wait complete. 2024-09-19T07:21:34.854 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.827+0000 7ff6a17c2740 20 client.14976 trim_cache size 0 max 16384 2024-09-19T07:21:34.854 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:21:34.854 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "73438718-7656-11ef-bceb-c7b262605968", 2024-09-19T07:21:34.854 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 1, 2024-09-19T07:21:34.854 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 24458, 2024-09-19T07:21:34.854 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-19T07:21:34.855 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-19T07:21:34.855 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-19T07:21:34.855 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 67.093755633000001, 2024-09-19T07:21:34.855 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 23, 2024-09-19T07:21:34.855 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 80, 2024-09-19T07:21:34.855 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T07:21:34.855 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 95.329680526000004 2024-09-19T07:21:34.855 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:21:34.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.828+0000 7ff69f3e9640 1 -- 172.21.15.98:0/955487506 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff6840a32d0 msgr2=0x7ff6840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:34.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.828+0000 7ff69f3e9640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff6840a32d0 0x7ff6840a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff6900126c0 tx=0x7ff6900078f0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.828+0000 7ff69f3e9640 1 -- 172.21.15.98:0/955487506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff698102790 msgr2=0x7ff698198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:34.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.828+0000 7ff69f3e9640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff698102790 0x7ff698198950 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff688006010 tx=0x7ff6880042f0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.828+0000 7ff69f3e9640 1 -- 172.21.15.98:0/955487506 shutdown_connections 2024-09-19T07:21:34.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.828+0000 7ff69f3e9640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7ff6840a32d0 0x7ff6840a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.828+0000 7ff69f3e9640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff698106f10 0x7ff69819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.828+0000 7ff69f3e9640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff698102790 0x7ff698198950 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.828+0000 7ff69f3e9640 1 --2- 172.21.15.98:0/955487506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff698101de0 0x7ff698198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:34.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.828+0000 7ff69f3e9640 1 -- 172.21.15.98:0/955487506 >> 172.21.15.98:0/955487506 conn(0x7ff6980fd8c0 msgr2=0x7ff6980febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:34.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.828+0000 7ff69f3e9640 1 -- 172.21.15.98:0/955487506 shutdown_connections 2024-09-19T07:21:34.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:34.828+0000 7ff69f3e9640 1 -- 172.21.15.98:0/955487506 wait complete. 2024-09-19T07:21:35.471 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T07:21:35.715 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:36.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:35 smithi098 ceph-mon[30950]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:36.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:35 smithi139 ceph-mon[35039]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:36.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:35 smithi162 ceph-mon[35726]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:36.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.245+0000 7f72483da640 1 -- 172.21.15.98:0/3527977449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7240101420 msgr2=0x7f724010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:36.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.245+0000 7f72483da640 1 --2- 172.21.15.98:0/3527977449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7240101420 0x7f724010d950 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7238009cd0 tx=0x7f723802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.245+0000 7f72483da640 1 -- 172.21.15.98:0/3527977449 shutdown_connections 2024-09-19T07:21:36.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.245+0000 7f72483da640 1 --2- 172.21.15.98:0/3527977449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7240101420 0x7f724010d950 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.245+0000 7f72483da640 1 --2- 172.21.15.98:0/3527977449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7240100a80 0x7f7240100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.245+0000 7f72483da640 1 --2- 172.21.15.98:0/3527977449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7240106a80 0x7f7240106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.245+0000 7f72483da640 1 -- 172.21.15.98:0/3527977449 >> 172.21.15.98:0/3527977449 conn(0x7f72400fc7a0 msgr2=0x7f72400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:36.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.245+0000 7f72483da640 1 -- 172.21.15.98:0/3527977449 shutdown_connections 2024-09-19T07:21:36.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.245+0000 7f72483da640 1 -- 172.21.15.98:0/3527977449 wait complete. 2024-09-19T07:21:36.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f72483da640 1 Processor -- start 2024-09-19T07:21:36.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f72483da640 1 -- start start 2024-09-19T07:21:36.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f72483da640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7240100a80 0x7f72400fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f72483da640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7240101420 0x7f72400fd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f72483da640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7240106a80 0x7f72400fd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f72483da640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7240110ea0 con 0x7f7240101420 2024-09-19T07:21:36.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f72483da640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7240110d20 con 0x7f7240100a80 2024-09-19T07:21:36.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f72483da640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7240111020 con 0x7f7240106a80 2024-09-19T07:21:36.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f7245975640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7240101420 0x7f72400fd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f7245975640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7240101420 0x7f72400fd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44950/0 (socket says 172.21.15.98:44950) 2024-09-19T07:21:36.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f7245975640 1 -- 172.21.15.98:0/4254578595 learned_addr learned my addr 172.21.15.98:0/4254578595 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:36.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f7246176640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7240100a80 0x7f72400fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f7245975640 1 -- 172.21.15.98:0/4254578595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7240106a80 msgr2=0x7f72400fd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:36.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f7245975640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7240106a80 0x7f72400fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f7245975640 1 -- 172.21.15.98:0/4254578595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7240100a80 msgr2=0x7f72400fcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:36.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f7245975640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7240100a80 0x7f72400fcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f7245975640 1 -- 172.21.15.98:0/4254578595 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72401a6930 con 0x7f7240101420 2024-09-19T07:21:36.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.246+0000 7f7246176640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7240100a80 0x7f72400fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:36.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.247+0000 7f7245975640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7240101420 0x7f72400fd240 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f723000c920 tx=0x7f723000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:36.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.247+0000 7f72377fe640 1 -- 172.21.15.98:0/4254578595 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230007c70 con 0x7f7240101420 2024-09-19T07:21:36.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.247+0000 7f72483da640 1 -- 172.21.15.98:0/4254578595 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72401a6c20 con 0x7f7240101420 2024-09-19T07:21:36.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.247+0000 7f72377fe640 1 -- 172.21.15.98:0/4254578595 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7230007e10 con 0x7f7240101420 2024-09-19T07:21:36.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.247+0000 7f72377fe640 1 -- 172.21.15.98:0/4254578595 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230018890 con 0x7f7240101420 2024-09-19T07:21:36.252 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.247+0000 7f72483da640 1 -- 172.21.15.98:0/4254578595 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72401a7160 con 0x7f7240101420 2024-09-19T07:21:36.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.249+0000 7f72377fe640 1 -- 172.21.15.98:0/4254578595 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7230018a70 con 0x7f7240101420 2024-09-19T07:21:36.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.249+0000 7f724a7b3740 1 Processor -- start 2024-09-19T07:21:36.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f724a7b3740 1 -- start start 2024-09-19T07:21:36.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f724a7b3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9d9d0 0x55ce04c9ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f724a7b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04c9e2f0 0x55ce04ca8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f724a7b3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 0x55ce04caafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f724a7b3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce04c04090 con 0x55ce04ca8bb0 2024-09-19T07:21:36.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f724a7b3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ce04baba70 con 0x55ce04c9d9d0 2024-09-19T07:21:36.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f724a7b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ce04c00050 con 0x55ce04c9e2f0 2024-09-19T07:21:36.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f72377fe640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f722c0a32d0 0x7f722c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f7245975640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 0x55ce04caafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f7245975640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 0x55ce04caafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44966/0 (socket says 172.21.15.98:44966) 2024-09-19T07:21:36.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f7245975640 1 -- 172.21.15.98:0/3768813392 learned_addr learned my addr 172.21.15.98:0/3768813392 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:36.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f7246176640 1 --2- 172.21.15.98:0/3768813392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04c9e2f0 0x55ce04ca8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f7246977640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f722c0a32d0 0x7f722c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f7246977640 1 --2- 172.21.15.98:0/3768813392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9d9d0 0x55ce04c9ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f72377fe640 1 -- 172.21.15.98:0/4254578595 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f72300cfcc0 con 0x7f7240101420 2024-09-19T07:21:36.258 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f7245975640 1 -- 172.21.15.98:0/3768813392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04c9e2f0 msgr2=0x55ce04ca8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:36.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f7245975640 1 --2- 172.21.15.98:0/3768813392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04c9e2f0 0x55ce04ca8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f7245975640 1 -- 172.21.15.98:0/3768813392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9d9d0 msgr2=0x55ce04c9ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:36.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f7245975640 1 --2- 172.21.15.98:0/3768813392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9d9d0 0x55ce04c9ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.250+0000 7f7245975640 1 -- 172.21.15.98:0/3768813392 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce04bb8130 con 0x55ce04ca8bb0 2024-09-19T07:21:36.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.251+0000 7f7245975640 1 --2- 172.21.15.98:0/3768813392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 0x55ce04caafa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f723001b000 tx=0x7f723009bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfbab6b9777c8ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:36.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.251+0000 7f7246977640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f722c0a32d0 0x7f722c0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7238006010 tx=0x7f7238005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:36.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.251+0000 7f7234dea640 1 -- 172.21.15.98:0/3768813392 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723000de20 con 0x55ce04ca8bb0 2024-09-19T07:21:36.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.251+0000 7f7234dea640 1 -- 172.21.15.98:0/3768813392 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f723000fb30 con 0x55ce04ca8bb0 2024-09-19T07:21:36.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.251+0000 7f7234dea640 1 -- 172.21.15.98:0/3768813392 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230018d60 con 0x55ce04ca8bb0 2024-09-19T07:21:36.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 -- 172.21.15.98:0/3768813392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 msgr2=0x55ce04caafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:36.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 --2- 172.21.15.98:0/3768813392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 0x55ce04caafa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f723001b000 tx=0x7f723009bdd0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 -- 172.21.15.98:0/3768813392 shutdown_connections 2024-09-19T07:21:36.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 --2- 172.21.15.98:0/3768813392 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 0x55ce04caafa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 --2- 172.21.15.98:0/3768813392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04c9e2f0 0x55ce04ca8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 --2- 172.21.15.98:0/3768813392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9d9d0 0x55ce04c9ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 -- 172.21.15.98:0/3768813392 >> 172.21.15.98:0/3768813392 conn(0x55ce04c99f60 msgr2=0x55ce04c9a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:36.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 -- 172.21.15.98:0/3768813392 shutdown_connections 2024-09-19T07:21:36.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 -- 172.21.15.98:0/3768813392 wait complete. 2024-09-19T07:21:36.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 -- start start 2024-09-19T07:21:36.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 Processor -- start 2024-09-19T07:21:36.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9d9d0 0x55ce04ca8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9e2f0 0x55ce04ca5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04ca8bb0 0x55ce04ca5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce04cab780 con 0x55ce04c9e2f0 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ce04bbef20 con 0x55ce04c9d9d0 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.252+0000 7f724a7b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ce04cab900 con 0x55ce04ca8bb0 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f724a7b3740 10 client.0 _ll_register_callbacks cb 0x55ce04b88030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7245975640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9e2f0 0x55ce04ca5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7245975640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9e2f0 0x55ce04ca5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44974/0 (socket says 172.21.15.98:44974) 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7245975640 1 -- 172.21.15.98:0/2861940240 learned_addr learned my addr 172.21.15.98:0/2861940240 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7246977640 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04ca8bb0 0x55ce04ca5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7246176640 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9d9d0 0x55ce04ca8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7245975640 1 -- 172.21.15.98:0/2861940240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04ca8bb0 msgr2=0x55ce04ca5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7245975640 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04ca8bb0 0x55ce04ca5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7245975640 1 -- 172.21.15.98:0/2861940240 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9d9d0 msgr2=0x55ce04ca8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7245975640 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9d9d0 0x55ce04ca8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7245975640 1 -- 172.21.15.98:0/2861940240 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce049752b0 con 0x55ce04c9e2f0 2024-09-19T07:21:36.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7245975640 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9e2f0 0x55ce04ca5770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f723009be60 tx=0x7f72300a4e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae59ff4a73a9ab11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:36.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7229ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:21:36.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7229ffb640 1 -- 172.21.15.98:0/2861940240 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72300b5060 con 0x55ce04c9e2f0 2024-09-19T07:21:36.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7229ffb640 1 -- 172.21.15.98:0/2861940240 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f72300a0170 con 0x55ce04c9e2f0 2024-09-19T07:21:36.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f724a7b3740 1 -- 172.21.15.98:0/2861940240 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f723000fb30 con 0x55ce04c9e2f0 2024-09-19T07:21:36.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f7229ffb640 1 -- 172.21.15.98:0/2861940240 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f723000de20 con 0x55ce04c9e2f0 2024-09-19T07:21:36.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f724a7b3740 10 client.14988 fetch_fsmap learned FSMap version 23 2024-09-19T07:21:36.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.253+0000 7f724a7b3740 1 -- 172.21.15.98:0/2861940240 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55ce04cb7070 con 0x55ce04c9e2f0 2024-09-19T07:21:36.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.254+0000 7f7229ffb640 1 -- 172.21.15.98:0/2861940240 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f723000fb30 con 0x55ce04c9e2f0 2024-09-19T07:21:36.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.254+0000 7f7229ffb640 1 -- 172.21.15.98:0/2861940240 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f72300cd150 con 0x55ce04c9e2f0 2024-09-19T07:21:36.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.254+0000 7f724a7b3740 10 client.14988 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T07:21:36.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.254+0000 7f724a7b3740 10 client.14988 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:21:36.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.254+0000 7f724a7b3740 20 client.14988 populate_metadata read hostname 'smithi098' 2024-09-19T07:21:36.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.254+0000 7f724a7b3740 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ce04cb83c0 0x55ce04cba520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.254+0000 7f724a7b3740 4 client.14988 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:36.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.254+0000 7f724a7b3740 1 -- 172.21.15.98:0/2861940240 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce04c11600 con 0x55ce04cb83c0 2024-09-19T07:21:36.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.254+0000 7f7246176640 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ce04cb83c0 0x55ce04cba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.255+0000 7f7229ffb640 10 client.14988 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:21:36.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.255+0000 7f7246176640 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ce04cb83c0 0x55ce04cba520 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=390b395dbb9a6cfc server_cookie=52b29316c8e4a513 in_seq=0 out_seq=0 2024-09-19T07:21:36.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.255+0000 7f7229ffb640 1 -- 172.21.15.98:0/2861940240 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce04c11600 con 0x55ce04cb83c0 2024-09-19T07:21:36.263 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.255+0000 7f7229ffb640 10 client.14988 handle_command_reply: tid=0 2024-09-19T07:21:36.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.255+0000 7f724a7b3740 1 client.14988 shutdown 2024-09-19T07:21:36.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.255+0000 7f724a7b3740 1 -- 172.21.15.98:0/2861940240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9e2f0 msgr2=0x55ce04ca5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:36.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.255+0000 7f724a7b3740 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9e2f0 0x55ce04ca5770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f723009be60 tx=0x7f72300a4e60 comp rx=0 tx=0).stop 2024-09-19T07:21:36.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.256+0000 7f724a7b3740 1 -- 172.21.15.98:0/2861940240 shutdown_connections 2024-09-19T07:21:36.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.256+0000 7f724a7b3740 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04ca8bb0 0x55ce04ca5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.256+0000 7f724a7b3740 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ce04cb83c0 0x55ce04cba520 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.256+0000 7f724a7b3740 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9e2f0 0x55ce04ca5770 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.256+0000 7f724a7b3740 1 --2- 172.21.15.98:0/2861940240 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9d9d0 0x55ce04ca8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.256+0000 7f7229ffb640 0 client.14988 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:21:36.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.256+0000 7f724a7b3740 1 -- 172.21.15.98:0/2861940240 >> 172.21.15.98:0/2861940240 conn(0x55ce04c99f60 msgr2=0x55ce04c9fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:36.264 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.256+0000 7f724a7b3740 1 -- 172.21.15.98:0/2861940240 shutdown_connections 2024-09-19T07:21:36.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.256+0000 7f724a7b3740 1 -- 172.21.15.98:0/2861940240 wait complete. 2024-09-19T07:21:36.265 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.256+0000 7f724a7b3740 20 client.14988 trim_cache size 0 max 16384 2024-09-19T07:21:36.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.273+0000 7f724a7b3740 1 Processor -- start 2024-09-19T07:21:36.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.273+0000 7f724a7b3740 1 -- start start 2024-09-19T07:21:36.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.273+0000 7f724a7b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04c9d9d0 0x55ce04cb9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.273+0000 7f724a7b3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9e2f0 0x55ce04cb90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.273+0000 7f724a7b3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 0x55ce04cb89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.273+0000 7f724a7b3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce04cb8860 con 0x55ce04ca8bb0 2024-09-19T07:21:36.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.273+0000 7f724a7b3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ce04cb8f30 con 0x55ce04c9e2f0 2024-09-19T07:21:36.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.273+0000 7f724a7b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ce04cb9600 con 0x55ce04c9d9d0 2024-09-19T07:21:36.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f7246977640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 0x55ce04cb89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f7246977640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 0x55ce04cb89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44988/0 (socket says 172.21.15.98:44988) 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f7246977640 1 -- 172.21.15.98:0/3991943322 learned_addr learned my addr 172.21.15.98:0/3991943322 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f7245975640 1 --2- 172.21.15.98:0/3991943322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9e2f0 0x55ce04cb90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f7246176640 1 --2- 172.21.15.98:0/3991943322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04c9d9d0 0x55ce04cb9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f7246977640 1 -- 172.21.15.98:0/3991943322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04c9d9d0 msgr2=0x55ce04cb9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f7246977640 1 --2- 172.21.15.98:0/3991943322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04c9d9d0 0x55ce04cb9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f7246977640 1 -- 172.21.15.98:0/3991943322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9e2f0 msgr2=0x55ce04cb90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f7246977640 1 --2- 172.21.15.98:0/3991943322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9e2f0 0x55ce04cb90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f7246977640 1 -- 172.21.15.98:0/3991943322 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce04ca8040 con 0x55ce04ca8bb0 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f7245975640 1 --2- 172.21.15.98:0/3991943322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9e2f0 0x55ce04cb90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f7246977640 1 --2- 172.21.15.98:0/3991943322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 0x55ce04cb89e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7238009cd0 tx=0x7f7238047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4778018291778721 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f722bfff640 1 -- 172.21.15.98:0/3991943322 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238050070 con 0x55ce04ca8bb0 2024-09-19T07:21:36.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f722bfff640 1 -- 172.21.15.98:0/3991943322 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7238036040 con 0x55ce04ca8bb0 2024-09-19T07:21:36.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.274+0000 7f722bfff640 1 -- 172.21.15.98:0/3991943322 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238030ad0 con 0x55ce04ca8bb0 2024-09-19T07:21:36.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.275+0000 7f724a7b3740 1 -- 172.21.15.98:0/3991943322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 msgr2=0x55ce04cb89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:36.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.275+0000 7f724a7b3740 1 --2- 172.21.15.98:0/3991943322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 0x55ce04cb89e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7238009cd0 tx=0x7f7238047000 comp rx=0 tx=0).stop 2024-09-19T07:21:36.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.275+0000 7f724a7b3740 1 -- 172.21.15.98:0/3991943322 shutdown_connections 2024-09-19T07:21:36.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.275+0000 7f724a7b3740 1 --2- 172.21.15.98:0/3991943322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04ca8bb0 0x55ce04cb89e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.275+0000 7f724a7b3740 1 --2- 172.21.15.98:0/3991943322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9e2f0 0x55ce04cb90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.275+0000 7f724a7b3740 1 --2- 172.21.15.98:0/3991943322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04c9d9d0 0x55ce04cb9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.275+0000 7f724a7b3740 1 -- 172.21.15.98:0/3991943322 >> 172.21.15.98:0/3991943322 conn(0x55ce04c99f60 msgr2=0x55ce04ca05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:36.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.275+0000 7f724a7b3740 1 -- 172.21.15.98:0/3991943322 shutdown_connections 2024-09-19T07:21:36.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.275+0000 7f724a7b3740 1 -- 172.21.15.98:0/3991943322 wait complete. 2024-09-19T07:21:36.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f724a7b3740 1 -- start start 2024-09-19T07:21:36.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f724a7b3740 1 Processor -- start 2024-09-19T07:21:36.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f724a7b3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9d9d0 0x55ce04cc2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f724a7b3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9e2f0 0x55ce04cbc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f724a7b3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04ca8bb0 0x55ce04cbc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f724a7b3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ce04cba3a0 con 0x55ce04c9d9d0 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f724a7b3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ce04cb9cd0 con 0x55ce04c9e2f0 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f724a7b3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ce04cbaa70 con 0x55ce04ca8bb0 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f724a7b3740 10 client.0 _ll_register_callbacks cb 0x7f7238009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f7246176640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9d9d0 0x55ce04cc2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f7246176640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9d9d0 0x55ce04cc2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44990/0 (socket says 172.21.15.98:44990) 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f7246176640 1 -- 172.21.15.98:0/1583351091 learned_addr learned my addr 172.21.15.98:0/1583351091 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f7245975640 1 --2- 172.21.15.98:0/1583351091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9e2f0 0x55ce04cbc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f7246176640 1 -- 172.21.15.98:0/1583351091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04ca8bb0 msgr2=0x55ce04cbc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f7246176640 1 --2- 172.21.15.98:0/1583351091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04ca8bb0 0x55ce04cbc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f7246176640 1 -- 172.21.15.98:0/1583351091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9e2f0 msgr2=0x55ce04cbc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f7246176640 1 --2- 172.21.15.98:0/1583351091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9e2f0 0x55ce04cbc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.276+0000 7f7246176640 1 -- 172.21.15.98:0/1583351091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce04cbccb0 con 0x55ce04c9d9d0 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.277+0000 7f7246176640 1 --2- 172.21.15.98:0/1583351091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9d9d0 0x55ce04cc2dd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55ce04bbf070 tx=0x7f723c00af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68573ac8cc4d4aba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:36.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.277+0000 7f7229ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:21:36.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.277+0000 7f7229ffb640 1 -- 172.21.15.98:0/1583351091 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723c024620 con 0x55ce04c9d9d0 2024-09-19T07:21:36.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.277+0000 7f7229ffb640 1 -- 172.21.15.98:0/1583351091 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f723c0247c0 con 0x55ce04c9d9d0 2024-09-19T07:21:36.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.277+0000 7f724a7b3740 1 -- 172.21.15.98:0/1583351091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7238036040 con 0x55ce04c9d9d0 2024-09-19T07:21:36.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.277+0000 7f7229ffb640 1 -- 172.21.15.98:0/1583351091 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f723c02a070 con 0x55ce04c9d9d0 2024-09-19T07:21:36.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.277+0000 7f724a7b3740 10 client.14994 fetch_fsmap learned FSMap version 23 2024-09-19T07:21:36.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.277+0000 7f724a7b3740 1 -- 172.21.15.98:0/1583351091 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55ce04d237c0 con 0x55ce04c9d9d0 2024-09-19T07:21:36.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.277+0000 7f7229ffb640 1 -- 172.21.15.98:0/1583351091 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7238036040 con 0x55ce04c9d9d0 2024-09-19T07:21:36.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.277+0000 7f7229ffb640 1 -- 172.21.15.98:0/1583351091 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f723c023ba0 con 0x55ce04c9d9d0 2024-09-19T07:21:36.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.277+0000 7f724a7b3740 10 client.14994 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T07:21:36.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.277+0000 7f724a7b3740 10 client.14994 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:21:36.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f724a7b3740 20 client.14994 populate_metadata read hostname 'smithi098' 2024-09-19T07:21:36.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f724a7b3740 1 --2- 172.21.15.98:0/1583351091 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ce04d283b0 0x55ce04d270c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:36.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f724a7b3740 4 client.14994 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:21:36.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f724a7b3740 1 -- 172.21.15.98:0/1583351091 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "status"}) -- 0x55ce04c0bb10 con 0x55ce04d283b0 2024-09-19T07:21:36.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f7245975640 1 --2- 172.21.15.98:0/1583351091 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ce04d283b0 0x55ce04d270c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:36.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f7229ffb640 10 client.14994 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:21:36.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f7245975640 1 --2- 172.21.15.98:0/1583351091 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ce04d283b0 0x55ce04d270c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6ad571a81b18c53 server_cookie=998f15799b5c0c53 in_seq=0 out_seq=0 2024-09-19T07:21:36.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f7229ffb640 1 -- 172.21.15.98:0/1583351091 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ce04c0bb10 con 0x55ce04d283b0 2024-09-19T07:21:36.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f7229ffb640 10 client.14994 handle_command_reply: tid=0 2024-09-19T07:21:36.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f724a7b3740 1 client.14994 shutdown 2024-09-19T07:21:36.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f724a7b3740 1 -- 172.21.15.98:0/1583351091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9d9d0 msgr2=0x55ce04cc2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:36.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f724a7b3740 1 --2- 172.21.15.98:0/1583351091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9d9d0 0x55ce04cc2dd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x55ce04bbf070 tx=0x7f723c00af70 comp rx=0 tx=0).stop 2024-09-19T07:21:36.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f724a7b3740 1 -- 172.21.15.98:0/1583351091 shutdown_connections 2024-09-19T07:21:36.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f724a7b3740 1 --2- 172.21.15.98:0/1583351091 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ce04ca8bb0 0x55ce04cbc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f724a7b3740 1 --2- 172.21.15.98:0/1583351091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ce04c9e2f0 0x55ce04cbc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.278+0000 7f724a7b3740 1 --2- 172.21.15.98:0/1583351091 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ce04d283b0 0x55ce04d270c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.285 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f7229ffb640 0 client.14994 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:21:36.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f724a7b3740 1 --2- 172.21.15.98:0/1583351091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ce04c9d9d0 0x55ce04cc2dd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f724a7b3740 1 -- 172.21.15.98:0/1583351091 >> 172.21.15.98:0/1583351091 conn(0x55ce04c99f60 msgr2=0x55ce04ca0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:36.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f724a7b3740 1 -- 172.21.15.98:0/1583351091 shutdown_connections 2024-09-19T07:21:36.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f724a7b3740 1 -- 172.21.15.98:0/1583351091 wait complete. 2024-09-19T07:21:36.286 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f724a7b3740 20 client.14994 trim_cache size 0 max 16384 2024-09-19T07:21:36.286 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:21:36.287 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "73438718-7656-11ef-bceb-c7b262605968", 2024-09-19T07:21:36.287 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2024-09-19T07:21:36.287 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 24479, 2024-09-19T07:21:36.287 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-19T07:21:36.287 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-19T07:21:36.287 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-19T07:21:36.287 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 75.760326339000002, 2024-09-19T07:21:36.287 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 23, 2024-09-19T07:21:36.287 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 80, 2024-09-19T07:21:36.287 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T07:21:36.287 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 85.396202666999997 2024-09-19T07:21:36.287 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:21:36.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f72483da640 1 -- 172.21.15.98:0/4254578595 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f722c0a32d0 msgr2=0x7f722c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:36.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f72483da640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f722c0a32d0 0x7f722c0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7238006010 tx=0x7f7238005f80 comp rx=0 tx=0).stop 2024-09-19T07:21:36.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f72483da640 1 -- 172.21.15.98:0/4254578595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7240101420 msgr2=0x7f72400fd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:36.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f72483da640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7240101420 0x7f72400fd240 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f723000c920 tx=0x7f723000cde0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f72483da640 1 -- 172.21.15.98:0/4254578595 shutdown_connections 2024-09-19T07:21:36.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f72483da640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f722c0a32d0 0x7f722c0a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f72483da640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7240106a80 0x7f72400fd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f72483da640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7240101420 0x7f72400fd240 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f72483da640 1 --2- 172.21.15.98:0/4254578595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7240100a80 0x7f72400fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:36.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f72483da640 1 -- 172.21.15.98:0/4254578595 >> 172.21.15.98:0/4254578595 conn(0x7f72400fc7a0 msgr2=0x7f724006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:36.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f72483da640 1 -- 172.21.15.98:0/4254578595 shutdown_connections 2024-09-19T07:21:36.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:36.279+0000 7f72483da640 1 -- 172.21.15.98:0/4254578595 wait complete. 2024-09-19T07:21:36.989 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T07:21:36.989 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T07:21:37.000 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-19T07:21:37.000 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T07:21:37.242 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.728+0000 7f39df6cb640 1 -- 172.21.15.98:0/2865977063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39d8101c00 msgr2=0x7f39d8102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.728+0000 7f39df6cb640 1 --2- 172.21.15.98:0/2865977063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39d8101c00 0x7f39d8102000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009900 tx=0x7f39d402a410 comp rx=0 tx=0).stop 2024-09-19T07:21:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.728+0000 7f39df6cb640 1 -- 172.21.15.98:0/2865977063 shutdown_connections 2024-09-19T07:21:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.728+0000 7f39df6cb640 1 --2- 172.21.15.98:0/2865977063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d81037c0 0x7f39d810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.728+0000 7f39df6cb640 1 --2- 172.21.15.98:0/2865977063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d8102e00 0x7f39d8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.728+0000 7f39df6cb640 1 --2- 172.21.15.98:0/2865977063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39d8101c00 0x7f39d8102000 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.728+0000 7f39df6cb640 1 -- 172.21.15.98:0/2865977063 >> 172.21.15.98:0/2865977063 conn(0x7f39d80fd390 msgr2=0x7f39d80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.728+0000 7f39df6cb640 1 -- 172.21.15.98:0/2865977063 shutdown_connections 2024-09-19T07:21:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.728+0000 7f39df6cb640 1 -- 172.21.15.98:0/2865977063 wait complete. 2024-09-19T07:21:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39df6cb640 1 Processor -- start 2024-09-19T07:21:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39df6cb640 1 -- start start 2024-09-19T07:21:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39df6cb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d8101c00 0x7f39d8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39df6cb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d8102e00 0x7f39d80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39df6cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39d81037c0 0x7f39d8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39df6cb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f39d810d960 con 0x7f39d81037c0 2024-09-19T07:21:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39df6cb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f39d810d7e0 con 0x7f39d8102e00 2024-09-19T07:21:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39df6cb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39d810dae0 con 0x7f39d8101c00 2024-09-19T07:21:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39ddc68640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39d81037c0 0x7f39d8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39ddc68640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39d81037c0 0x7f39d8074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45014/0 (socket says 172.21.15.98:45014) 2024-09-19T07:21:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39ddc68640 1 -- 172.21.15.98:0/1626955540 learned_addr learned my addr 172.21.15.98:0/1626955540 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39dcc66640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d8102e00 0x7f39d80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39dd467640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d8101c00 0x7f39d8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39ddc68640 1 -- 172.21.15.98:0/1626955540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d8101c00 msgr2=0x7f39d8075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39ddc68640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d8101c00 0x7f39d8075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39ddc68640 1 -- 172.21.15.98:0/1626955540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d8102e00 msgr2=0x7f39d80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39ddc68640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d8102e00 0x7f39d80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39ddc68640 1 -- 172.21.15.98:0/1626955540 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d80753e0 con 0x7f39d81037c0 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39dcc66640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d8102e00 0x7f39d80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39ddc68640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39d81037c0 0x7f39d8074b20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f39d000b970 tx=0x7f39d000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.729+0000 7f39ce7fc640 1 -- 172.21.15.98:0/1626955540 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0019070 con 0x7f39d81037c0 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.730+0000 7f39ce7fc640 1 -- 172.21.15.98:0/1626955540 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39d000cb40 con 0x7f39d81037c0 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.730+0000 7f39df6cb640 1 -- 172.21.15.98:0/1626955540 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d81a21e0 con 0x7f39d81037c0 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.730+0000 7f39ce7fc640 1 -- 172.21.15.98:0/1626955540 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0007650 con 0x7f39d81037c0 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.730+0000 7f39df6cb640 1 -- 172.21.15.98:0/1626955540 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d81a2720 con 0x7f39d81037c0 2024-09-19T07:21:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.730+0000 7f39df6cb640 1 -- 172.21.15.98:0/1626955540 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d81090a0 con 0x7f39d81037c0 2024-09-19T07:21:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.732+0000 7f39ce7fc640 1 -- 172.21.15.98:0/1626955540 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f39d001c070 con 0x7f39d81037c0 2024-09-19T07:21:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.733+0000 7f39ce7fc640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f39c40a32d0 0x7f39c40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.733+0000 7f39dd467640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f39c40a32d0 0x7f39c40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:37.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.733+0000 7f39ce7fc640 1 -- 172.21.15.98:0/1626955540 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f39d00cf480 con 0x7f39d81037c0 2024-09-19T07:21:37.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.733+0000 7f39dd467640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f39c40a32d0 0x7f39c40a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39d4031610 tx=0x7f39d4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:37.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.736+0000 7f39ce7fc640 1 -- 172.21.15.98:0/1626955540 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f39d009c130 con 0x7f39d81037c0 2024-09-19T07:21:37.920 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:37 smithi098 ceph-mon[30950]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:37.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.919+0000 7f39df6cb640 1 -- 172.21.15.98:0/1626955540 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f39d8062630 con 0x7f39c40a32d0 2024-09-19T07:21:37.920 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.920+0000 7f39ce7fc640 1 -- 172.21.15.98:0/1626955540 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f39d8062630 con 0x7f39c40a32d0 2024-09-19T07:21:37.921 INFO:teuthology.orchestra.run.smithi098.stdout:Backend: cephadm 2024-09-19T07:21:37.921 INFO:teuthology.orchestra.run.smithi098.stdout:Available: Yes 2024-09-19T07:21:37.921 INFO:teuthology.orchestra.run.smithi098.stdout:Paused: No 2024-09-19T07:21:37.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.922+0000 7f39df6cb640 1 -- 172.21.15.98:0/1626955540 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f39c40a32d0 msgr2=0x7f39c40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:37.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.922+0000 7f39df6cb640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f39c40a32d0 0x7f39c40a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39d4031610 tx=0x7f39d4000bc0 comp rx=0 tx=0).stop 2024-09-19T07:21:37.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.922+0000 7f39df6cb640 1 -- 172.21.15.98:0/1626955540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39d81037c0 msgr2=0x7f39d8074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:37.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.922+0000 7f39df6cb640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39d81037c0 0x7f39d8074b20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f39d000b970 tx=0x7f39d000be30 comp rx=0 tx=0).stop 2024-09-19T07:21:37.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.922+0000 7f39df6cb640 1 -- 172.21.15.98:0/1626955540 shutdown_connections 2024-09-19T07:21:37.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.922+0000 7f39df6cb640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f39c40a32d0 0x7f39c40a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:37.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.922+0000 7f39df6cb640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39d81037c0 0x7f39d8074b20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:37.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.922+0000 7f39df6cb640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39d8102e00 0x7f39d80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:37.923 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.922+0000 7f39df6cb640 1 --2- 172.21.15.98:0/1626955540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39d8101c00 0x7f39d8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:37.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.922+0000 7f39df6cb640 1 -- 172.21.15.98:0/1626955540 >> 172.21.15.98:0/1626955540 conn(0x7f39d80fd390 msgr2=0x7f39d8106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:37.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.923+0000 7f39df6cb640 1 -- 172.21.15.98:0/1626955540 shutdown_connections 2024-09-19T07:21:37.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:37.923+0000 7f39df6cb640 1 -- 172.21.15.98:0/1626955540 wait complete. 2024-09-19T07:21:38.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:37 smithi139 ceph-mon[35039]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:38.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:37 smithi162 ceph-mon[35726]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:38.540 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T07:21:38.787 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:39.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.267+0000 7f8e7888c640 1 -- 172.21.15.98:0/2988981736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74101c00 msgr2=0x7f8e74102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:39.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.267+0000 7f8e7888c640 1 --2- 172.21.15.98:0/2988981736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74101c00 0x7f8e74102000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009900 tx=0x7f8e5c02a410 comp rx=0 tx=0).stop 2024-09-19T07:21:39.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.268+0000 7f8e7888c640 1 -- 172.21.15.98:0/2988981736 shutdown_connections 2024-09-19T07:21:39.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.268+0000 7f8e7888c640 1 --2- 172.21.15.98:0/2988981736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e741037c0 0x7f8e7410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:39.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.268+0000 7f8e7888c640 1 --2- 172.21.15.98:0/2988981736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e74102e00 0x7f8e74103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:39.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.268+0000 7f8e7888c640 1 --2- 172.21.15.98:0/2988981736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74101c00 0x7f8e74102000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:39.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.268+0000 7f8e7888c640 1 -- 172.21.15.98:0/2988981736 >> 172.21.15.98:0/2988981736 conn(0x7f8e740fd390 msgr2=0x7f8e740ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:39.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.268+0000 7f8e7888c640 1 -- 172.21.15.98:0/2988981736 shutdown_connections 2024-09-19T07:21:39.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.268+0000 7f8e7888c640 1 -- 172.21.15.98:0/2988981736 wait complete. 2024-09-19T07:21:39.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.268+0000 7f8e7888c640 1 Processor -- start 2024-09-19T07:21:39.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.268+0000 7f8e7888c640 1 -- start start 2024-09-19T07:21:39.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7888c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74101c00 0x7f8e74198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:39.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7888c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e74102e00 0x7f8e741985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:39.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7888c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e741037c0 0x7f8e7419f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:39.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7888c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7410d9b0 con 0x7f8e74101c00 2024-09-19T07:21:39.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7888c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7410d830 con 0x7f8e74102e00 2024-09-19T07:21:39.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7888c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7410db30 con 0x7f8e741037c0 2024-09-19T07:21:39.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74101c00 0x7f8e74198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:39.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74101c00 0x7f8e74198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45020/0 (socket says 172.21.15.98:45020) 2024-09-19T07:21:39.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7259c640 1 -- 172.21.15.98:0/3223576208 learned_addr learned my addr 172.21.15.98:0/3223576208 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:39.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e72d9d640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e741037c0 0x7f8e7419f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:39.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7259c640 1 -- 172.21.15.98:0/3223576208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e741037c0 msgr2=0x7f8e7419f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:39.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7259c640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e741037c0 0x7f8e7419f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e71d9b640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e74102e00 0x7f8e741985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7259c640 1 -- 172.21.15.98:0/3223576208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e74102e00 msgr2=0x7f8e741985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7259c640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e74102e00 0x7f8e741985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7259c640 1 -- 172.21.15.98:0/3223576208 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7419fca0 con 0x7f8e74101c00 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7259c640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74101c00 0x7f8e74198070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c02aa00 tx=0x7f8e5c032da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e6b7fe640 1 -- 172.21.15.98:0/3223576208 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c03f030 con 0x7f8e74101c00 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e6b7fe640 1 -- 172.21.15.98:0/3223576208 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e5c003ce0 con 0x7f8e74101c00 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7888c640 1 -- 172.21.15.98:0/3223576208 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7419ff30 con 0x7f8e74101c00 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e6b7fe640 1 -- 172.21.15.98:0/3223576208 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c035070 con 0x7f8e74101c00 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.269+0000 7f8e7888c640 1 -- 172.21.15.98:0/3223576208 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e741a03b0 con 0x7f8e74101c00 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.270+0000 7f8e7888c640 1 -- 172.21.15.98:0/3223576208 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e741090a0 con 0x7f8e74101c00 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.272+0000 7f8e6b7fe640 1 -- 172.21.15.98:0/3223576208 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8e5c042030 con 0x7f8e74101c00 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.272+0000 7f8e6b7fe640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f8e600a3300 0x7f8e600a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:39.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.272+0000 7f8e71d9b640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f8e600a3300 0x7f8e600a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:39.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.273+0000 7f8e6b7fe640 1 -- 172.21.15.98:0/3223576208 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f8e5c0efed0 con 0x7f8e74101c00 2024-09-19T07:21:39.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.273+0000 7f8e71d9b640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f8e600a3300 0x7f8e600a57c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8e74199590 tx=0x7f8e64008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:39.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.276+0000 7f8e6b7fe640 1 -- 172.21.15.98:0/3223576208 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e5c0bca70 con 0x7f8e74101c00 2024-09-19T07:21:39.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.451+0000 7f8e7888c640 1 -- 172.21.15.98:0/3223576208 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8e74062630 con 0x7f8e600a3300 2024-09-19T07:21:39.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.463+0000 7f8e6b7fe640 1 -- 172.21.15.98:0/3223576208 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f8e74062630 con 0x7f8e600a3300 2024-09-19T07:21:39.465 INFO:teuthology.orchestra.run.smithi098.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:21:39.465 INFO:teuthology.orchestra.run.smithi098.stdout:mds.a smithi098 running (91s) 16s ago 91s 15.7M - 19.1.1-361-g2f599a46 d2baa855c067 91c999fb46b4 2024-09-19T07:21:39.465 INFO:teuthology.orchestra.run.smithi098.stdout:mds.b smithi139 running (88s) 21s ago 88s 29.0M - 19.1.1-361-g2f599a46 d2baa855c067 dbcdc14ae0f9 2024-09-19T07:21:39.465 INFO:teuthology.orchestra.run.smithi098.stdout:mds.c smithi162 running (102s) 21s ago 102s 16.1M - 19.1.1-361-g2f599a46 d2baa855c067 0b8fea2a7a95 2024-09-19T07:21:39.465 INFO:teuthology.orchestra.run.smithi098.stdout:mds.d smithi098 running (110s) 16s ago 109s 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 2fe97c96888a 2024-09-19T07:21:39.465 INFO:teuthology.orchestra.run.smithi098.stdout:mds.e smithi139 running (107s) 21s ago 107s 18.1M - 19.1.1-361-g2f599a46 d2baa855c067 415d2f182a92 2024-09-19T07:21:39.465 INFO:teuthology.orchestra.run.smithi098.stdout:mds.f smithi162 running (105s) 21s ago 104s 16.5M - 19.1.1-361-g2f599a46 d2baa855c067 86dc30f84922 2024-09-19T07:21:39.465 INFO:teuthology.orchestra.run.smithi098.stdout:mds.g smithi098 running (94s) 16s ago 93s 14.2M - 19.1.1-361-g2f599a46 d2baa855c067 64cfe78985fc 2024-09-19T07:21:39.465 INFO:teuthology.orchestra.run.smithi098.stdout:mds.h smithi139 running (100s) 21s ago 99s 18.0M - 19.1.1-361-g2f599a46 d2baa855c067 d84c8446d0ef 2024-09-19T07:21:39.465 INFO:teuthology.orchestra.run.smithi098.stdout:mds.i smithi162 running (97s) 21s ago 97s 19.5M - 19.1.1-361-g2f599a46 d2baa855c067 18c87e98b427 2024-09-19T07:21:39.465 INFO:teuthology.orchestra.run.smithi098.stdout:mds.j smithi098 running (113s) 16s ago 112s 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 1dbde68a8eb5 2024-09-19T07:21:39.465 INFO:teuthology.orchestra.run.smithi098.stdout:mds.k smithi139 running (116s) 21s ago 116s 16.2M - 19.1.1-361-g2f599a46 d2baa855c067 69de78d0610f 2024-09-19T07:21:39.466 INFO:teuthology.orchestra.run.smithi098.stdout:mds.l smithi162 running (119s) 21s ago 118s 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 19646953c402 2024-09-19T07:21:39.466 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.x smithi098 *:9283,8765 running (8m) 16s ago 8m 508M - 19.1.1-361-g2f599a46 d2baa855c067 623c6bf1043f 2024-09-19T07:21:39.466 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.y smithi139 *:8443,8765 running (7m) 21s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 265e6fd6cc2f 2024-09-19T07:21:39.466 INFO:teuthology.orchestra.run.smithi098.stdout:mgr.z smithi162 *:8443,8765 running (7m) 21s ago 7m 443M - 19.1.1-361-g2f599a46 d2baa855c067 ec452004dd30 2024-09-19T07:21:39.466 INFO:teuthology.orchestra.run.smithi098.stdout:mon.a smithi098 running (8m) 16s ago 8m 49.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 11bd946099de 2024-09-19T07:21:39.466 INFO:teuthology.orchestra.run.smithi098.stdout:mon.b smithi139 running (7m) 21s ago 7m 40.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a8c956391da0 2024-09-19T07:21:39.466 INFO:teuthology.orchestra.run.smithi098.stdout:mon.c smithi162 running (7m) 21s ago 7m 40.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 84c03fd70312 2024-09-19T07:21:39.466 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 smithi098 running (6m) 16s ago 6m 56.3M 4272M 19.1.1-361-g2f599a46 d2baa855c067 f943037cb84f 2024-09-19T07:21:39.466 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 smithi139 running (6m) 21s ago 6m 59.3M 4272M 19.1.1-361-g2f599a46 d2baa855c067 bf4ab46860b2 2024-09-19T07:21:39.466 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 smithi162 running (5m) 21s ago 5m 49.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 ede76ae89389 2024-09-19T07:21:39.466 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 smithi098 running (5m) 16s ago 5m 50.3M 4272M 19.1.1-361-g2f599a46 d2baa855c067 84689524b4b4 2024-09-19T07:21:39.466 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 smithi139 running (5m) 21s ago 5m 52.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 5cf39cb1a4d3 2024-09-19T07:21:39.467 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 smithi162 running (4m) 21s ago 4m 46.6M 4272M 19.1.1-361-g2f599a46 d2baa855c067 7b3571e70020 2024-09-19T07:21:39.467 INFO:teuthology.orchestra.run.smithi098.stdout:osd.6 smithi098 running (4m) 16s ago 4m 48.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 25aa5cbbe0c7 2024-09-19T07:21:39.467 INFO:teuthology.orchestra.run.smithi098.stdout:osd.7 smithi139 running (3m) 21s ago 3m 44.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 1376af22d602 2024-09-19T07:21:39.467 INFO:teuthology.orchestra.run.smithi098.stdout:osd.8 smithi162 running (3m) 21s ago 3m 44.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 dd36bcbb5077 2024-09-19T07:21:39.467 INFO:teuthology.orchestra.run.smithi098.stdout:osd.9 smithi098 running (3m) 16s ago 3m 44.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 17397e5474c1 2024-09-19T07:21:39.467 INFO:teuthology.orchestra.run.smithi098.stdout:osd.10 smithi139 running (2m) 21s ago 2m 49.3M 4272M 19.1.1-361-g2f599a46 d2baa855c067 7e8fccf43244 2024-09-19T07:21:39.467 INFO:teuthology.orchestra.run.smithi098.stdout:osd.11 smithi162 running (2m) 21s ago 2m 51.6M 4272M 19.1.1-361-g2f599a46 d2baa855c067 713fba42b4b1 2024-09-19T07:21:39.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.465+0000 7f8e7888c640 1 -- 172.21.15.98:0/3223576208 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f8e600a3300 msgr2=0x7f8e600a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:39.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.465+0000 7f8e7888c640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f8e600a3300 0x7f8e600a57c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8e74199590 tx=0x7f8e64008040 comp rx=0 tx=0).stop 2024-09-19T07:21:39.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.465+0000 7f8e7888c640 1 -- 172.21.15.98:0/3223576208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74101c00 msgr2=0x7f8e74198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:39.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.465+0000 7f8e7888c640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74101c00 0x7f8e74198070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c02aa00 tx=0x7f8e5c032da0 comp rx=0 tx=0).stop 2024-09-19T07:21:39.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.465+0000 7f8e7888c640 1 -- 172.21.15.98:0/3223576208 shutdown_connections 2024-09-19T07:21:39.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.465+0000 7f8e7888c640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f8e600a3300 0x7f8e600a57c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:39.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.465+0000 7f8e7888c640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e741037c0 0x7f8e7419f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:39.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.465+0000 7f8e7888c640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e74102e00 0x7f8e741985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:39.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.465+0000 7f8e7888c640 1 --2- 172.21.15.98:0/3223576208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e74101c00 0x7f8e74198070 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:39.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.465+0000 7f8e7888c640 1 -- 172.21.15.98:0/3223576208 >> 172.21.15.98:0/3223576208 conn(0x7f8e740fd390 msgr2=0x7f8e74106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:39.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.466+0000 7f8e7888c640 1 -- 172.21.15.98:0/3223576208 shutdown_connections 2024-09-19T07:21:39.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:39.466+0000 7f8e7888c640 1 -- 172.21.15.98:0/3223576208 wait complete. 2024-09-19T07:21:40.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:39 smithi098 ceph-mon[30950]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:40.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:39 smithi098 ceph-mon[30950]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:40.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:39 smithi139 ceph-mon[35039]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:40.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:39 smithi139 ceph-mon[35039]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:40.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:39 smithi162 ceph-mon[35726]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:40.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:39 smithi162 ceph-mon[35726]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:40.163 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T07:21:40.408 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:40.790 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:40 smithi098 ceph-mon[30950]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 -- 172.21.15.98:0/1425565063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a8100b10 msgr2=0x7f03a8100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 --2- 172.21.15.98:0/1425565063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a8100b10 0x7f03a8100f10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0398009900 tx=0x7f039802a410 comp rx=0 tx=0).stop 2024-09-19T07:21:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 -- 172.21.15.98:0/1425565063 shutdown_connections 2024-09-19T07:21:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 --2- 172.21.15.98:0/1425565063 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03a81026d0 0x7f03a8108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 --2- 172.21.15.98:0/1425565063 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a8101d10 0x7f03a8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 --2- 172.21.15.98:0/1425565063 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a8100b10 0x7f03a8100f10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 -- 172.21.15.98:0/1425565063 >> 172.21.15.98:0/1425565063 conn(0x7f03a80fc2a0 msgr2=0x7f03a80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 -- 172.21.15.98:0/1425565063 shutdown_connections 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 -- 172.21.15.98:0/1425565063 wait complete. 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 Processor -- start 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 -- start start 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a8100b10 0x7f03a806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.870+0000 7f03b03f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a8101d10 0x7f03a819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03b03f9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03a81026d0 0x7f03a819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03b03f9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f03a810c870 con 0x7f03a8101d10 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03b03f9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f03a810c6f0 con 0x7f03a81026d0 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03b03f9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03a810c9f0 con 0x7f03a8100b10 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03ad994640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a8101d10 0x7f03a819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:40.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03ad994640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a8101d10 0x7f03a819cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45038/0 (socket says 172.21.15.98:45038) 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03ad994640 1 -- 172.21.15.98:0/1965438570 learned_addr learned my addr 172.21.15.98:0/1965438570 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03ae195640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a8100b10 0x7f03a806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03ae996640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03a81026d0 0x7f03a819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03ad994640 1 -- 172.21.15.98:0/1965438570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a8100b10 msgr2=0x7f03a806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03ad994640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a8100b10 0x7f03a806b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03ad994640 1 -- 172.21.15.98:0/1965438570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03a81026d0 msgr2=0x7f03a819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03ad994640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03a81026d0 0x7f03a819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03ad994640 1 -- 172.21.15.98:0/1965438570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a819fd10 con 0x7f03a8101d10 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03ae996640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03a81026d0 0x7f03a819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03ad994640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a8101d10 0x7f03a819cde0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f03a400b4a0 tx=0x7f03a400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f039f7fe640 1 -- 172.21.15.98:0/1965438570 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4014070 con 0x7f03a8101d10 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03b03f9640 1 -- 172.21.15.98:0/1965438570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a819ffa0 con 0x7f03a8101d10 2024-09-19T07:21:40.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f039f7fe640 1 -- 172.21.15.98:0/1965438570 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03a4010af0 con 0x7f03a8101d10 2024-09-19T07:21:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f039f7fe640 1 -- 172.21.15.98:0/1965438570 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4017d10 con 0x7f03a8101d10 2024-09-19T07:21:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.871+0000 7f03b03f9640 1 -- 172.21.15.98:0/1965438570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a81a0520 con 0x7f03a8101d10 2024-09-19T07:21:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.872+0000 7f03b03f9640 1 -- 172.21.15.98:0/1965438570 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a8108000 con 0x7f03a8101d10 2024-09-19T07:21:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.873+0000 7f039f7fe640 1 -- 172.21.15.98:0/1965438570 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f03a4017070 con 0x7f03a8101d10 2024-09-19T07:21:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.874+0000 7f039f7fe640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f03940a32d0 0x7f03940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.874+0000 7f03ae195640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f03940a32d0 0x7f03940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.874+0000 7f039f7fe640 1 -- 172.21.15.98:0/1965438570 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f03a40ced10 con 0x7f03a8101d10 2024-09-19T07:21:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.874+0000 7f03ae195640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f03940a32d0 0x7f03940a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0398005ab0 tx=0x7f0398000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:40.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:40.878+0000 7f039f7fe640 1 -- 172.21.15.98:0/1965438570 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f03a409b9c0 con 0x7f03a8101d10 2024-09-19T07:21:41.053 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.052+0000 7f03b03f9640 1 -- 172.21.15.98:0/1965438570 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f03a8062630 con 0x7f03940a32d0 2024-09-19T07:21:41.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.058+0000 7f039f7fe640 1 -- 172.21.15.98:0/1965438570 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f03a8062630 con 0x7f03940a32d0 2024-09-19T07:21:41.058 INFO:teuthology.orchestra.run.smithi098.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T07:21:41.059 INFO:teuthology.orchestra.run.smithi098.stdout:mds.all 12/12 23s ago 2m smithi098=a;smithi098=d;smithi098=g;smithi098=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-09-19T07:21:41.059 INFO:teuthology.orchestra.run.smithi098.stdout:mgr 3/3 23s ago 7m smithi098=x;smithi139=y;smithi162=z;count:3 2024-09-19T07:21:41.059 INFO:teuthology.orchestra.run.smithi098.stdout:mon 3/3 23s ago 7m smithi098:172.21.15.98=a;smithi139:172.21.15.139=b;smithi162:172.21.15.162=c;count:3 2024-09-19T07:21:41.059 INFO:teuthology.orchestra.run.smithi098.stdout:osd 12 23s ago - 2024-09-19T07:21:41.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.060+0000 7f03b03f9640 1 -- 172.21.15.98:0/1965438570 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f03940a32d0 msgr2=0x7f03940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:41.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.060+0000 7f03b03f9640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f03940a32d0 0x7f03940a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0398005ab0 tx=0x7f0398000bc0 comp rx=0 tx=0).stop 2024-09-19T07:21:41.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.060+0000 7f03b03f9640 1 -- 172.21.15.98:0/1965438570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a8101d10 msgr2=0x7f03a819cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:41.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.060+0000 7f03b03f9640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a8101d10 0x7f03a819cde0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f03a400b4a0 tx=0x7f03a400b960 comp rx=0 tx=0).stop 2024-09-19T07:21:41.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.060+0000 7f03b03f9640 1 -- 172.21.15.98:0/1965438570 shutdown_connections 2024-09-19T07:21:41.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.060+0000 7f03b03f9640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f03940a32d0 0x7f03940a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:41.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.060+0000 7f03b03f9640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03a81026d0 0x7f03a819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:41.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.060+0000 7f03b03f9640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f03a8101d10 0x7f03a819cde0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:41.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.060+0000 7f03b03f9640 1 --2- 172.21.15.98:0/1965438570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a8100b10 0x7f03a806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:41.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.060+0000 7f03b03f9640 1 -- 172.21.15.98:0/1965438570 >> 172.21.15.98:0/1965438570 conn(0x7f03a80fc2a0 msgr2=0x7f03a81051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:41.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.060+0000 7f03b03f9640 1 -- 172.21.15.98:0/1965438570 shutdown_connections 2024-09-19T07:21:41.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:41.060+0000 7f03b03f9640 1 -- 172.21.15.98:0/1965438570 wait complete. 2024-09-19T07:21:41.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:40 smithi139 ceph-mon[35039]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:41.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:40 smithi162 ceph-mon[35726]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:41.802 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:41 smithi098 ceph-mon[30950]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:41.803 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T07:21:42.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:41 smithi139 ceph-mon[35039]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:42.101 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:42.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:41 smithi162 ceph-mon[35726]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.514+0000 7f932e78a640 1 -- 172.21.15.98:0/2205074644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93281026d0 msgr2=0x7f9328108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.514+0000 7f932e78a640 1 --2- 172.21.15.98:0/2205074644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93281026d0 0x7f9328108f60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9320009ca0 tx=0x7f932002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.514+0000 7f932e78a640 1 -- 172.21.15.98:0/2205074644 shutdown_connections 2024-09-19T07:21:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.514+0000 7f932e78a640 1 --2- 172.21.15.98:0/2205074644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f93281026d0 0x7f9328108f60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.514+0000 7f932e78a640 1 --2- 172.21.15.98:0/2205074644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9328101d10 0x7f9328102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.514+0000 7f932e78a640 1 --2- 172.21.15.98:0/2205074644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9328100b10 0x7f9328100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.514+0000 7f932e78a640 1 -- 172.21.15.98:0/2205074644 >> 172.21.15.98:0/2205074644 conn(0x7f93280fc2a0 msgr2=0x7f93280fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.514+0000 7f932e78a640 1 -- 172.21.15.98:0/2205074644 shutdown_connections 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.514+0000 7f932e78a640 1 -- 172.21.15.98:0/2205074644 wait complete. 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.514+0000 7f932e78a640 1 Processor -- start 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.514+0000 7f932e78a640 1 -- start start 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f932e78a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328100b10 0x7f9328198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f932e78a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9328101d10 0x7f9328198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f932e78a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93281026d0 0x7f932819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f932e78a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f932810d9a0 con 0x7f9328100b10 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f932e78a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f932810d820 con 0x7f93281026d0 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f932e78a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f932810db20 con 0x7f9328101d10 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f9327fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328100b10 0x7f9328198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f9327fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328100b10 0x7f9328198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33046/0 (socket says 172.21.15.98:33046) 2024-09-19T07:21:42.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f9327fff640 1 -- 172.21.15.98:0/2717090121 learned_addr learned my addr 172.21.15.98:0/2717090121 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:42.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f932cd27640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93281026d0 0x7f932819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f93277fe640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9328101d10 0x7f9328198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f9327fff640 1 -- 172.21.15.98:0/2717090121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9328101d10 msgr2=0x7f9328198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:42.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f9327fff640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9328101d10 0x7f9328198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f9327fff640 1 -- 172.21.15.98:0/2717090121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93281026d0 msgr2=0x7f932819f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:42.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f9327fff640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93281026d0 0x7f932819f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.515+0000 7f9327fff640 1 -- 172.21.15.98:0/2717090121 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932819fc80 con 0x7f9328100b10 2024-09-19T07:21:42.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.516+0000 7f9327fff640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328100b10 0x7f9328198050 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f931800b450 tx=0x7f931800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:42.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.516+0000 7f93257fa640 1 -- 172.21.15.98:0/2717090121 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318015020 con 0x7f9328100b10 2024-09-19T07:21:42.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.516+0000 7f93257fa640 1 -- 172.21.15.98:0/2717090121 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9318011d70 con 0x7f9328100b10 2024-09-19T07:21:42.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.516+0000 7f932e78a640 1 -- 172.21.15.98:0/2717090121 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932819ff70 con 0x7f9328100b10 2024-09-19T07:21:42.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.516+0000 7f93257fa640 1 -- 172.21.15.98:0/2717090121 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931800f340 con 0x7f9328100b10 2024-09-19T07:21:42.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.516+0000 7f932e78a640 1 -- 172.21.15.98:0/2717090121 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93281a0440 con 0x7f9328100b10 2024-09-19T07:21:42.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.517+0000 7f932e78a640 1 -- 172.21.15.98:0/2717090121 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9328107fb0 con 0x7f9328100b10 2024-09-19T07:21:42.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.518+0000 7f93257fa640 1 -- 172.21.15.98:0/2717090121 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9318018020 con 0x7f9328100b10 2024-09-19T07:21:42.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.519+0000 7f93257fa640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f93100a3300 0x7f93100a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:42.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.519+0000 7f93277fe640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f93100a3300 0x7f93100a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:42.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.519+0000 7f93257fa640 1 -- 172.21.15.98:0/2717090121 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f93180cf930 con 0x7f9328100b10 2024-09-19T07:21:42.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.519+0000 7f93277fe640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f93100a3300 0x7f93100a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9328199570 tx=0x7f931c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:42.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.522+0000 7f93257fa640 1 -- 172.21.15.98:0/2717090121 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f931801f020 con 0x7f9328100b10 2024-09-19T07:21:42.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.698+0000 7f932e78a640 1 -- 172.21.15.98:0/2717090121 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f9328062630 con 0x7f93100a3300 2024-09-19T07:21:42.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.699+0000 7f93257fa640 1 -- 172.21.15.98:0/2717090121 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f9328062630 con 0x7f93100a3300 2024-09-19T07:21:42.699 INFO:teuthology.orchestra.run.smithi098.stdout:HOST ADDR LABELS STATUS 2024-09-19T07:21:42.700 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098 172.21.15.98 2024-09-19T07:21:42.700 INFO:teuthology.orchestra.run.smithi098.stdout:smithi139 172.21.15.139 2024-09-19T07:21:42.700 INFO:teuthology.orchestra.run.smithi098.stdout:smithi162 172.21.15.162 2024-09-19T07:21:42.700 INFO:teuthology.orchestra.run.smithi098.stdout:3 hosts in cluster 2024-09-19T07:21:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.701+0000 7f932e78a640 1 -- 172.21.15.98:0/2717090121 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f93100a3300 msgr2=0x7f93100a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.701+0000 7f932e78a640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f93100a3300 0x7f93100a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9328199570 tx=0x7f931c008040 comp rx=0 tx=0).stop 2024-09-19T07:21:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.701+0000 7f932e78a640 1 -- 172.21.15.98:0/2717090121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328100b10 msgr2=0x7f9328198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.701+0000 7f932e78a640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328100b10 0x7f9328198050 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f931800b450 tx=0x7f931800b910 comp rx=0 tx=0).stop 2024-09-19T07:21:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.701+0000 7f932e78a640 1 -- 172.21.15.98:0/2717090121 shutdown_connections 2024-09-19T07:21:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.701+0000 7f932e78a640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f93100a3300 0x7f93100a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.701+0000 7f932e78a640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93281026d0 0x7f932819f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.701+0000 7f932e78a640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9328101d10 0x7f9328198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.701+0000 7f932e78a640 1 --2- 172.21.15.98:0/2717090121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9328100b10 0x7f9328198050 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.701+0000 7f932e78a640 1 -- 172.21.15.98:0/2717090121 >> 172.21.15.98:0/2717090121 conn(0x7f93280fc2a0 msgr2=0x7f9328105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.701+0000 7f932e78a640 1 -- 172.21.15.98:0/2717090121 shutdown_connections 2024-09-19T07:21:42.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:42.701+0000 7f932e78a640 1 -- 172.21.15.98:0/2717090121 wait complete. 2024-09-19T07:21:42.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:42 smithi098 ceph-mon[30950]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:43.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:42 smithi139 ceph-mon[35039]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:43.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:42 smithi162 ceph-mon[35726]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:43.298 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T07:21:43.544 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:43.975 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:43 smithi098 ceph-mon[30950]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:43.975 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:43 smithi098 ceph-mon[30950]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:44.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.055+0000 7fd1ad079640 1 -- 172.21.15.98:0/1964866834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1a8101d10 msgr2=0x7fd1a8102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:44.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.055+0000 7fd1ad079640 1 --2- 172.21.15.98:0/1964866834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1a8101d10 0x7fd1a8102190 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009900 tx=0x7fd19c02a410 comp rx=0 tx=0).stop 2024-09-19T07:21:44.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.055+0000 7fd1ad079640 1 -- 172.21.15.98:0/1964866834 shutdown_connections 2024-09-19T07:21:44.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.055+0000 7fd1ad079640 1 --2- 172.21.15.98:0/1964866834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1a81026d0 0x7fd1a8108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.055+0000 7fd1ad079640 1 --2- 172.21.15.98:0/1964866834 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1a8101d10 0x7fd1a8102190 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.055+0000 7fd1ad079640 1 --2- 172.21.15.98:0/1964866834 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1a8100b10 0x7fd1a8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.055+0000 7fd1ad079640 1 -- 172.21.15.98:0/1964866834 >> 172.21.15.98:0/1964866834 conn(0x7fd1a80fc2a0 msgr2=0x7fd1a80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:44.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.055+0000 7fd1ad079640 1 -- 172.21.15.98:0/1964866834 shutdown_connections 2024-09-19T07:21:44.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.055+0000 7fd1ad079640 1 -- 172.21.15.98:0/1964866834 wait complete. 2024-09-19T07:21:44.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.056+0000 7fd1ad079640 1 Processor -- start 2024-09-19T07:21:44.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.056+0000 7fd1ad079640 1 -- start start 2024-09-19T07:21:44.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.056+0000 7fd1ad079640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1a8100b10 0x7fd1a8197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:44.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.056+0000 7fd1ad079640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1a8101d10 0x7fd1a81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.056+0000 7fd1ad079640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1a81026d0 0x7fd1a819f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.056+0000 7fd1ad079640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a810c790 con 0x7fd1a81026d0 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.056+0000 7fd1ad079640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a810c610 con 0x7fd1a8101d10 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.056+0000 7fd1ad079640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a810c910 con 0x7fd1a8100b10 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.056+0000 7fd1a759e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1a81026d0 0x7fd1a819f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.056+0000 7fd1a759e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1a81026d0 0x7fd1a819f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33058/0 (socket says 172.21.15.98:33058) 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.056+0000 7fd1a759e640 1 -- 172.21.15.98:0/1280824448 learned_addr learned my addr 172.21.15.98:0/1280824448 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.056+0000 7fd1a659c640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1a8101d10 0x7fd1a81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.057+0000 7fd1a6d9d640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1a8100b10 0x7fd1a8197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.057+0000 7fd1a759e640 1 -- 172.21.15.98:0/1280824448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1a8100b10 msgr2=0x7fd1a8197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.057+0000 7fd1a759e640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1a8100b10 0x7fd1a8197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.057+0000 7fd1a759e640 1 -- 172.21.15.98:0/1280824448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1a8101d10 msgr2=0x7fd1a81984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:44.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.057+0000 7fd1a759e640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1a8101d10 0x7fd1a81984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.057+0000 7fd1a759e640 1 -- 172.21.15.98:0/1280824448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a819fb90 con 0x7fd1a81026d0 2024-09-19T07:21:44.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.057+0000 7fd1a759e640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1a81026d0 0x7fd1a819f520 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000eaa0 tx=0x7fd1a000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:44.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.057+0000 7fd18ffff640 1 -- 172.21.15.98:0/1280824448 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a000cdb0 con 0x7fd1a81026d0 2024-09-19T07:21:44.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.057+0000 7fd18ffff640 1 -- 172.21.15.98:0/1280824448 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1a0005020 con 0x7fd1a81026d0 2024-09-19T07:21:44.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.057+0000 7fd18ffff640 1 -- 172.21.15.98:0/1280824448 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1a00116b0 con 0x7fd1a81026d0 2024-09-19T07:21:44.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.057+0000 7fd1ad079640 1 -- 172.21.15.98:0/1280824448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a819fe80 con 0x7fd1a81026d0 2024-09-19T07:21:44.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.057+0000 7fd1ad079640 1 -- 172.21.15.98:0/1280824448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a81a0330 con 0x7fd1a81026d0 2024-09-19T07:21:44.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.058+0000 7fd1ad079640 1 -- 172.21.15.98:0/1280824448 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1a81a05c0 con 0x7fd1a81026d0 2024-09-19T07:21:44.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.059+0000 7fd18ffff640 1 -- 172.21.15.98:0/1280824448 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd1a0005560 con 0x7fd1a81026d0 2024-09-19T07:21:44.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.060+0000 7fd18ffff640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd1900a3300 0x7fd1900a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:44.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.060+0000 7fd1a6d9d640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd1900a3300 0x7fd1900a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:44.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.060+0000 7fd18ffff640 1 -- 172.21.15.98:0/1280824448 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fd1a00cfc30 con 0x7fd1a81026d0 2024-09-19T07:21:44.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.061+0000 7fd1a6d9d640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd1900a3300 0x7fd1900a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd198005d00 tx=0x7fd198005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:44.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.065+0000 7fd18ffff640 1 -- 172.21.15.98:0/1280824448 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd1a0016030 con 0x7fd1a81026d0 2024-09-19T07:21:44.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:43 smithi139 ceph-mon[35039]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:44.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:43 smithi139 ceph-mon[35039]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:43 smithi162 ceph-mon[35726]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:43 smithi162 ceph-mon[35726]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.236+0000 7fd1ad079640 1 -- 172.21.15.98:0/1280824448 --> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fd1a81a0790 con 0x7fd1900a3300 2024-09-19T07:21:44.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.238+0000 7fd18ffff640 1 -- 172.21.15.98:0/1280824448 <== mgr.14150 v2:172.21.15.98:6800/2172632890 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fd1a81a0790 con 0x7fd1900a3300 2024-09-19T07:21:44.239 INFO:teuthology.orchestra.run.smithi098.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T07:21:44.239 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010H400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T07:21:44.239 INFO:teuthology.orchestra.run.smithi098.stdout:smithi139 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500N6400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T07:21:44.239 INFO:teuthology.orchestra.run.smithi098.stdout:smithi162 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JU400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T07:21:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.240+0000 7fd1ad079640 1 -- 172.21.15.98:0/1280824448 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd1900a3300 msgr2=0x7fd1900a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.240+0000 7fd1ad079640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd1900a3300 0x7fd1900a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd198005d00 tx=0x7fd198005c50 comp rx=0 tx=0).stop 2024-09-19T07:21:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.240+0000 7fd1ad079640 1 -- 172.21.15.98:0/1280824448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1a81026d0 msgr2=0x7fd1a819f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.240+0000 7fd1ad079640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1a81026d0 0x7fd1a819f520 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000eaa0 tx=0x7fd1a000ef60 comp rx=0 tx=0).stop 2024-09-19T07:21:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.240+0000 7fd1ad079640 1 -- 172.21.15.98:0/1280824448 shutdown_connections 2024-09-19T07:21:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.240+0000 7fd1ad079640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fd1900a3300 0x7fd1900a57c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.240+0000 7fd1ad079640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd1a81026d0 0x7fd1a819f520 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.240+0000 7fd1ad079640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1a8101d10 0x7fd1a81984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.240+0000 7fd1ad079640 1 --2- 172.21.15.98:0/1280824448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1a8100b10 0x7fd1a8197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.240+0000 7fd1ad079640 1 -- 172.21.15.98:0/1280824448 >> 172.21.15.98:0/1280824448 conn(0x7fd1a80fc2a0 msgr2=0x7fd1a806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:44.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.241+0000 7fd1ad079640 1 -- 172.21.15.98:0/1280824448 shutdown_connections 2024-09-19T07:21:44.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:44.241+0000 7fd1ad079640 1 -- 172.21.15.98:0/1280824448 wait complete. 2024-09-19T07:21:44.866 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T07:21:44.875 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-19T07:21:44.875 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T07:21:45.120 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:45.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.587+0000 7fe016015640 1 -- 172.21.15.98:0/1934056831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe010100b10 msgr2=0x7fe010100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.587+0000 7fe016015640 1 --2- 172.21.15.98:0/1934056831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe010100b10 0x7fe010100f10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe000009900 tx=0x7fe00002a410 comp rx=0 tx=0).stop 2024-09-19T07:21:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.587+0000 7fe016015640 1 -- 172.21.15.98:0/1934056831 shutdown_connections 2024-09-19T07:21:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.587+0000 7fe016015640 1 --2- 172.21.15.98:0/1934056831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0101026d0 0x7fe010108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.587+0000 7fe016015640 1 --2- 172.21.15.98:0/1934056831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe010101d10 0x7fe010102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.587+0000 7fe016015640 1 --2- 172.21.15.98:0/1934056831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe010100b10 0x7fe010100f10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.587+0000 7fe016015640 1 -- 172.21.15.98:0/1934056831 >> 172.21.15.98:0/1934056831 conn(0x7fe0100fc2a0 msgr2=0x7fe0100fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.587+0000 7fe016015640 1 -- 172.21.15.98:0/1934056831 shutdown_connections 2024-09-19T07:21:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.587+0000 7fe016015640 1 -- 172.21.15.98:0/1934056831 wait complete. 2024-09-19T07:21:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe016015640 1 Processor -- start 2024-09-19T07:21:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe016015640 1 -- start start 2024-09-19T07:21:45.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe016015640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe010100b10 0x7fe010197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe016015640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe010101d10 0x7fe010198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe016015640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0101026d0 0x7fe01019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe016015640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe01010c7f0 con 0x7fe010100b10 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe016015640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe01010c670 con 0x7fe0101026d0 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe016015640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe01010c970 con 0x7fe010101d10 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe00f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe010100b10 0x7fe010197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe00f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe010100b10 0x7fe010197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33072/0 (socket says 172.21.15.98:33072) 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe00f7fe640 1 -- 172.21.15.98:0/3526216840 learned_addr learned my addr 172.21.15.98:0/3526216840 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe00f7fe640 1 -- 172.21.15.98:0/3526216840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe010101d10 msgr2=0x7fe010198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe00f7fe640 1 --2- 172.21.15.98:0/3526216840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe010101d10 0x7fe010198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe00f7fe640 1 -- 172.21.15.98:0/3526216840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0101026d0 msgr2=0x7fe01019f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe00f7fe640 1 --2- 172.21.15.98:0/3526216840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0101026d0 0x7fe01019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.588+0000 7fe00f7fe640 1 -- 172.21.15.98:0/3526216840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01019fb30 con 0x7fe010100b10 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.589+0000 7fe00f7fe640 1 --2- 172.21.15.98:0/3526216840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe010100b10 0x7fe010197f00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe000031610 tx=0x7fe0000043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.589+0000 7fe00cff9640 1 -- 172.21.15.98:0/3526216840 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00003f030 con 0x7fe010100b10 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.589+0000 7fe00cff9640 1 -- 172.21.15.98:0/3526216840 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe000003ce0 con 0x7fe010100b10 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.589+0000 7fe016015640 1 -- 172.21.15.98:0/3526216840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01019fdc0 con 0x7fe010100b10 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.589+0000 7fe00cff9640 1 -- 172.21.15.98:0/3526216840 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe000035070 con 0x7fe010100b10 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.589+0000 7fe016015640 1 -- 172.21.15.98:0/3526216840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0101a02c0 con 0x7fe010100b10 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.590+0000 7fe016015640 1 -- 172.21.15.98:0/3526216840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0101a05b0 con 0x7fe010100b10 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.591+0000 7fe00cff9640 1 -- 172.21.15.98:0/3526216840 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe000042030 con 0x7fe010100b10 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.592+0000 7fe00cff9640 1 --2- 172.21.15.98:0/3526216840 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fdff80a3300 0x7fdff80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.592+0000 7fe00effd640 1 --2- 172.21.15.98:0/3526216840 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fdff80a3300 0x7fdff80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.592+0000 7fe00cff9640 1 -- 172.21.15.98:0/3526216840 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fe0000f0410 con 0x7fe010100b10 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.592+0000 7fe00effd640 1 --2- 172.21.15.98:0/3526216840 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fdff80a3300 0x7fdff80a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe010199420 tx=0x7fe004005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:45.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.595+0000 7fe00cff9640 1 -- 172.21.15.98:0/3526216840 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe0000bcfb0 con 0x7fe010100b10 2024-09-19T07:21:45.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.796+0000 7fe016015640 1 -- 172.21.15.98:0/3526216840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe0101a0940 con 0x7fe010100b10 2024-09-19T07:21:45.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.796+0000 7fe00cff9640 1 -- 172.21.15.98:0/3526216840 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+3090 (secure 0 0 0) 0x7fe0000bc8b0 con 0x7fe010100b10 2024-09-19T07:21:45.797 INFO:teuthology.orchestra.run.smithi098.stdout:e23 2024-09-19T07:21:45.797 INFO:teuthology.orchestra.run.smithi098.stdout:btime 2024-09-19T07:20:31:757871+0000 2024-09-19T07:21:45.797 INFO:teuthology.orchestra.run.smithi098.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout:legacy client fscid: 1 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout:fs_name cephfs 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 23 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-19T07:20:20.077021+0000 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-19T07:20:31.309254+0000 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout:tableserver 0 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout:root 0 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout:session_timeout 300 2024-09-19T07:21:45.798 INFO:teuthology.orchestra.run.smithi098.stdout:session_autoclose 300 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:max_file_size 1099511627776 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:max_xattr_size 65536 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:required_client_features {} 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure 0 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:last_failure_osd_epoch 0 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:max_mds 3 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:in 0,1,2 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:up {0=24479,1=24458,2=24442} 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:failed 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:damaged 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:stopped 2024-09-19T07:21:45.799 INFO:teuthology.orchestra.run.smithi098.stdout:data_pools [3] 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout:metadata_pool 2 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout:inline_data disabled 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout:balancer 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout:bal_rank_mask -1 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout:standby_count_wanted 0 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout:qdb_cluster leader: 24479 members: 24442,24458,24479 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.b{0:24479} state up:active seq 4 addr [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.e{0:24437} state up:standby-replay seq 1 addr [v2:172.21.15.139:6834/4113105598,v1:172.21.15.139:6835/4113105598] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.h{1:24458} state up:active seq 9 addr [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.c{1:24430} state up:standby-replay seq 1 addr [v2:172.21.15.162:6836/2810820400,v1:172.21.15.162:6837/2810820400] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.i{2:24442} state up:active seq 8 addr [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.k{2:24425} state up:standby-replay seq 1 addr [v2:172.21.15.139:6832/587476912,v1:172.21.15.139:6833/587476912] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:45.800 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:45.801 INFO:teuthology.orchestra.run.smithi098.stdout:Standby daemons: 2024-09-19T07:21:45.801 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:45.801 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.j{-1:14532} state up:standby seq 1 addr [v2:172.21.15.98:6834/181693932,v1:172.21.15.98:6835/181693932] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:21:45.801 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.d{-1:14544} state up:standby seq 1 addr [v2:172.21.15.98:6836/2912813887,v1:172.21.15.98:6837/2912813887] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:21:45.801 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.g{-1:14589} state up:standby seq 1 addr [v2:172.21.15.98:6838/2258357114,v1:172.21.15.98:6839/2258357114] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:21:45.801 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.a{-1:14601} state up:standby seq 1 addr [v2:172.21.15.98:6840/2652528346,v1:172.21.15.98:6841/2652528346] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:21:45.801 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.l{-1:24406} state up:standby seq 1 addr [v2:172.21.15.162:6832/1643362672,v1:172.21.15.162:6833/1643362672] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:21:45.801 INFO:teuthology.orchestra.run.smithi098.stdout:[mds.f{-1:24421} state up:standby seq 1 addr [v2:172.21.15.162:6834/2650670127,v1:172.21.15.162:6835/2650670127] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:21:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2024-09-19T07:21:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.799+0000 7fe016015640 1 -- 172.21.15.98:0/3526216840 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fdff80a3300 msgr2=0x7fdff80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.799+0000 7fe016015640 1 --2- 172.21.15.98:0/3526216840 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fdff80a3300 0x7fdff80a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe010199420 tx=0x7fe004005c70 comp rx=0 tx=0).stop 2024-09-19T07:21:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.799+0000 7fe016015640 1 -- 172.21.15.98:0/3526216840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe010100b10 msgr2=0x7fe010197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.799+0000 7fe016015640 1 --2- 172.21.15.98:0/3526216840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe010100b10 0x7fe010197f00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe000031610 tx=0x7fe0000043b0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.799+0000 7fe016015640 1 -- 172.21.15.98:0/3526216840 shutdown_connections 2024-09-19T07:21:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.799+0000 7fe016015640 1 --2- 172.21.15.98:0/3526216840 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fdff80a3300 0x7fdff80a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.799+0000 7fe016015640 1 --2- 172.21.15.98:0/3526216840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0101026d0 0x7fe01019f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.799+0000 7fe016015640 1 --2- 172.21.15.98:0/3526216840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe010101d10 0x7fe010198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.799+0000 7fe016015640 1 --2- 172.21.15.98:0/3526216840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe010100b10 0x7fe010197f00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:45.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.799+0000 7fe016015640 1 -- 172.21.15.98:0/3526216840 >> 172.21.15.98:0/3526216840 conn(0x7fe0100fc2a0 msgr2=0x7fe0100fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:45.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.799+0000 7fe016015640 1 -- 172.21.15.98:0/3526216840 shutdown_connections 2024-09-19T07:21:45.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:45.799+0000 7fe016015640 1 -- 172.21.15.98:0/3526216840 wait complete. 2024-09-19T07:21:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:45 smithi098 ceph-mon[30950]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:45 smithi098 ceph-mon[30950]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:46.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:45 smithi139 ceph-mon[35039]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:45 smithi139 ceph-mon[35039]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:46.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:45 smithi162 ceph-mon[35726]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:21:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:45 smithi162 ceph-mon[35726]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:46.431 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 73438718-7656-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T07:21:46.674 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:47.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:46 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3526216840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:21:47.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:46 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3526216840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:21:47.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:46 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3526216840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:21:47.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.213+0000 7f0ece79f640 1 -- 172.21.15.98:0/2266269872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec8101b50 msgr2=0x7f0ec8101fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:47.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.213+0000 7f0ece79f640 1 --2- 172.21.15.98:0/2266269872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec8101b50 0x7f0ec8101fd0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009900 tx=0x7f0ec402a410 comp rx=0 tx=0).stop 2024-09-19T07:21:47.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.213+0000 7f0ece79f640 1 -- 172.21.15.98:0/2266269872 shutdown_connections 2024-09-19T07:21:47.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.213+0000 7f0ece79f640 1 --2- 172.21.15.98:0/2266269872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8102510 0x7f0ec8108da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:47.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.213+0000 7f0ece79f640 1 --2- 172.21.15.98:0/2266269872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec8101b50 0x7f0ec8101fd0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:47.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.213+0000 7f0ece79f640 1 --2- 172.21.15.98:0/2266269872 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ec8100950 0x7f0ec8100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:47.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.213+0000 7f0ece79f640 1 -- 172.21.15.98:0/2266269872 >> 172.21.15.98:0/2266269872 conn(0x7f0ec80fc0e0 msgr2=0x7f0ec80fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:47.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.213+0000 7f0ece79f640 1 -- 172.21.15.98:0/2266269872 shutdown_connections 2024-09-19T07:21:47.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.213+0000 7f0ece79f640 1 -- 172.21.15.98:0/2266269872 wait complete. 2024-09-19T07:21:47.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0ece79f640 1 Processor -- start 2024-09-19T07:21:47.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0ece79f640 1 -- start start 2024-09-19T07:21:47.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0ece79f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8100950 0x7f0ec8197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:47.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0ece79f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec8101b50 0x7f0ec8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:47.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0ece79f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ec8102510 0x7f0ec819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:47.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0ece79f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec810c630 con 0x7f0ec8101b50 2024-09-19T07:21:47.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0ece79f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec810c4b0 con 0x7f0ec8102510 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0ece79f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec810c7b0 con 0x7f0ec8100950 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0eccf9c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec8101b50 0x7f0ec8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0eccf9c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec8101b50 0x7f0ec8198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33088/0 (socket says 172.21.15.98:33088) 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0eccf9c640 1 -- 172.21.15.98:0/552769794 learned_addr learned my addr 172.21.15.98:0/552769794 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0eccf9c640 1 -- 172.21.15.98:0/552769794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8100950 msgr2=0x7f0ec8197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.214+0000 7f0ecd79d640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8100950 0x7f0ec8197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.215+0000 7f0eccf9c640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8100950 0x7f0ec8197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.215+0000 7f0eccf9c640 1 -- 172.21.15.98:0/552769794 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ec8102510 msgr2=0x7f0ec819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.215+0000 7f0eccf9c640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ec8102510 0x7f0ec819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.215+0000 7f0eccf9c640 1 -- 172.21.15.98:0/552769794 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec819fa70 con 0x7f0ec8101b50 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.215+0000 7f0ecd79d640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8100950 0x7f0ec8197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.215+0000 7f0eccf9c640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec8101b50 0x7f0ec8198380 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4031610 tx=0x7f0ec4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:47.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.215+0000 7f0ebe7fc640 1 -- 172.21.15.98:0/552769794 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec403f030 con 0x7f0ec8101b50 2024-09-19T07:21:47.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.215+0000 7f0ece79f640 1 -- 172.21.15.98:0/552769794 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec819fd00 con 0x7f0ec8101b50 2024-09-19T07:21:47.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.215+0000 7f0ebe7fc640 1 -- 172.21.15.98:0/552769794 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec4003ce0 con 0x7f0ec8101b50 2024-09-19T07:21:47.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.215+0000 7f0ebe7fc640 1 -- 172.21.15.98:0/552769794 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4035070 con 0x7f0ec8101b50 2024-09-19T07:21:47.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.215+0000 7f0ece79f640 1 -- 172.21.15.98:0/552769794 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec81a0250 con 0x7f0ec8101b50 2024-09-19T07:21:47.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.216+0000 7f0ece79f640 1 -- 172.21.15.98:0/552769794 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec81a0480 con 0x7f0ec8101b50 2024-09-19T07:21:47.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.217+0000 7f0ebe7fc640 1 -- 172.21.15.98:0/552769794 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0ec4042030 con 0x7f0ec8101b50 2024-09-19T07:21:47.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.218+0000 7f0ebe7fc640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0eb40a3300 0x7f0eb40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:47.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.218+0000 7f0ecd79d640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0eb40a3300 0x7f0eb40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:47.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.218+0000 7f0ebe7fc640 1 -- 172.21.15.98:0/552769794 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0ec40f0130 con 0x7f0ec8101b50 2024-09-19T07:21:47.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.218+0000 7f0ecd79d640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0eb40a3300 0x7f0eb40a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0ec81019b0 tx=0x7f0eb8005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:47.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.222+0000 7f0ebe7fc640 1 -- 172.21.15.98:0/552769794 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ec40bccd0 con 0x7f0ec8101b50 2024-09-19T07:21:47.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.388+0000 7f0ece79f640 1 -- 172.21.15.98:0/552769794 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f0ec81a07c0 con 0x7f0ec8101b50 2024-09-19T07:21:47.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.390+0000 7f0ebe7fc640 1 -- 172.21.15.98:0/552769794 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v80) ==== 56+0+5335 (secure 0 0 0) 0x7f0ec40bc5d0 con 0x7f0ec8101b50 2024-09-19T07:21:47.390 INFO:teuthology.orchestra.run.smithi098.stdout:epoch 80 2024-09-19T07:21:47.390 INFO:teuthology.orchestra.run.smithi098.stdout:fsid 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:21:47.390 INFO:teuthology.orchestra.run.smithi098.stdout:created 2024-09-19T07:12:50.967816+0000 2024-09-19T07:21:47.390 INFO:teuthology.orchestra.run.smithi098.stdout:modified 2024-09-19T07:20:37.783934+0000 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:crush_version 26 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:full_ratio 0.95 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:backfillfull_ratio 0.9 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:nearfull_ratio 0.85 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:require_min_compat_client luminous 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:min_compat_client luminous 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:require_osd_release squid 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:stretch_mode_enabled false 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T07:21:47.391 INFO:teuthology.orchestra.run.smithi098.stdout:max_osd 12 2024-09-19T07:21:47.392 INFO:teuthology.orchestra.run.smithi098.stdout:osd.0 up in weight 1 up_from 8 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6802/1895935015,v1:172.21.15.98:6803/1895935015] [v2:172.21.15.98:6804/1895935015,v1:172.21.15.98:6805/1895935015] exists,up 716d8456-e227-4bd3-a17d-40eddbb7ccac 2024-09-19T07:21:47.392 INFO:teuthology.orchestra.run.smithi098.stdout:osd.1 up in weight 1 up_from 12 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6800/1737478302,v1:172.21.15.139:6801/1737478302] [v2:172.21.15.139:6802/1737478302,v1:172.21.15.139:6803/1737478302] exists,up 27725803-429d-4458-9881-4a4fdf82dc5d 2024-09-19T07:21:47.392 INFO:teuthology.orchestra.run.smithi098.stdout:osd.2 up in weight 1 up_from 17 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6800/2473103399,v1:172.21.15.162:6801/2473103399] [v2:172.21.15.162:6802/2473103399,v1:172.21.15.162:6803/2473103399] exists,up 40247362-cb89-41d9-9fab-b0dcb276bd71 2024-09-19T07:21:47.392 INFO:teuthology.orchestra.run.smithi098.stdout:osd.3 up in weight 1 up_from 23 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6810/970037395,v1:172.21.15.98:6811/970037395] [v2:172.21.15.98:6812/970037395,v1:172.21.15.98:6813/970037395] exists,up 4b314c43-b6f0-492c-bc66-10af912f4d59 2024-09-19T07:21:47.392 INFO:teuthology.orchestra.run.smithi098.stdout:osd.4 up in weight 1 up_from 30 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6808/4282134034,v1:172.21.15.139:6809/4282134034] [v2:172.21.15.139:6810/4282134034,v1:172.21.15.139:6811/4282134034] exists,up 62d22856-0d55-4a7c-90d2-ff68643ee0e0 2024-09-19T07:21:47.392 INFO:teuthology.orchestra.run.smithi098.stdout:osd.5 up in weight 1 up_from 34 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6808/4205554028,v1:172.21.15.162:6809/4205554028] [v2:172.21.15.162:6810/4205554028,v1:172.21.15.162:6811/4205554028] exists,up bbd4560c-4744-4863-aae3-a2c51b7c5e20 2024-09-19T07:21:47.392 INFO:teuthology.orchestra.run.smithi098.stdout:osd.6 up in weight 1 up_from 41 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6818/1426401351,v1:172.21.15.98:6819/1426401351] [v2:172.21.15.98:6820/1426401351,v1:172.21.15.98:6821/1426401351] exists,up ccb29a18-5a73-4e5c-86fb-1596e5386ce8 2024-09-19T07:21:47.392 INFO:teuthology.orchestra.run.smithi098.stdout:osd.7 up in weight 1 up_from 46 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6816/1139952110,v1:172.21.15.139:6817/1139952110] [v2:172.21.15.139:6818/1139952110,v1:172.21.15.139:6819/1139952110] exists,up 532269e4-0c74-4b64-95c0-1e4ff49d817e 2024-09-19T07:21:47.392 INFO:teuthology.orchestra.run.smithi098.stdout:osd.8 up in weight 1 up_from 53 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6816/81102188,v1:172.21.15.162:6817/81102188] [v2:172.21.15.162:6818/81102188,v1:172.21.15.162:6819/81102188] exists,up ca54d58c-9cc0-473c-88da-5e3b15c8cdca 2024-09-19T07:21:47.392 INFO:teuthology.orchestra.run.smithi098.stdout:osd.9 up in weight 1 up_from 60 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6826/1615504006,v1:172.21.15.98:6827/1615504006] [v2:172.21.15.98:6828/1615504006,v1:172.21.15.98:6829/1615504006] exists,up 1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899 2024-09-19T07:21:47.392 INFO:teuthology.orchestra.run.smithi098.stdout:osd.10 up in weight 1 up_from 65 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6824/2203263368,v1:172.21.15.139:6825/2203263368] [v2:172.21.15.139:6826/2203263368,v1:172.21.15.139:6827/2203263368] exists,up 5d940771-0407-4f30-95af-079e436759cc 2024-09-19T07:21:47.392 INFO:teuthology.orchestra.run.smithi098.stdout:osd.11 up in weight 1 up_from 72 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6824/3479073723,v1:172.21.15.162:6825/3479073723] [v2:172.21.15.162:6826/3479073723,v1:172.21.15.162:6827/3479073723] exists,up f91b69da-1ecf-46b5-a94d-401a7416be9c 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:pg_upmap_items 2.0 [7,11] 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:pg_upmap_items 2.a [2,11] 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:pg_upmap_items 2.14 [2,4] 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:pg_upmap_items 2.1f [8,4] 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:pg_upmap_items 3.11 [4,8] 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:pg_upmap_items 3.1a [5,7] 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:pg_upmap_items 3.1e [3,9] 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:pg_upmap_items 3.27 [4,6] 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:pg_upmap_items 3.2c [4,9] 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:pg_upmap_items 3.33 [5,9] 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:blocklist 172.21.15.98:6801/4041153215 expires 2024-09-20T07:13:36.570145+0000 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:blocklist 172.21.15.98:0/4070043354 expires 2024-09-20T07:13:36.570145+0000 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:blocklist 172.21.15.98:6800/4041153215 expires 2024-09-20T07:13:36.570145+0000 2024-09-19T07:21:47.393 INFO:teuthology.orchestra.run.smithi098.stdout:blocklist 172.21.15.98:0/813543838 expires 2024-09-20T07:13:13.007306+0000 2024-09-19T07:21:47.394 INFO:teuthology.orchestra.run.smithi098.stdout:blocklist 172.21.15.98:0/68446464 expires 2024-09-20T07:13:36.570145+0000 2024-09-19T07:21:47.394 INFO:teuthology.orchestra.run.smithi098.stdout:blocklist 172.21.15.98:0/1600483360 expires 2024-09-20T07:13:13.007306+0000 2024-09-19T07:21:47.394 INFO:teuthology.orchestra.run.smithi098.stdout:blocklist 172.21.15.98:0/1243774177 expires 2024-09-20T07:13:36.570145+0000 2024-09-19T07:21:47.394 INFO:teuthology.orchestra.run.smithi098.stdout:blocklist 172.21.15.98:0/2152340493 expires 2024-09-20T07:13:13.007306+0000 2024-09-19T07:21:47.394 INFO:teuthology.orchestra.run.smithi098.stdout:blocklist 172.21.15.98:6801/2881913098 expires 2024-09-20T07:13:13.007306+0000 2024-09-19T07:21:47.394 INFO:teuthology.orchestra.run.smithi098.stdout:blocklist 172.21.15.98:6800/2881913098 expires 2024-09-20T07:13:13.007306+0000 2024-09-19T07:21:47.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.392+0000 7f0ece79f640 1 -- 172.21.15.98:0/552769794 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0eb40a3300 msgr2=0x7f0eb40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:47.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.392+0000 7f0ece79f640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0eb40a3300 0x7f0eb40a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0ec81019b0 tx=0x7f0eb8005d30 comp rx=0 tx=0).stop 2024-09-19T07:21:47.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.392+0000 7f0ece79f640 1 -- 172.21.15.98:0/552769794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec8101b50 msgr2=0x7f0ec8198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:47.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.392+0000 7f0ece79f640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec8101b50 0x7f0ec8198380 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4031610 tx=0x7f0ec4004430 comp rx=0 tx=0).stop 2024-09-19T07:21:47.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.392+0000 7f0ece79f640 1 -- 172.21.15.98:0/552769794 shutdown_connections 2024-09-19T07:21:47.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.392+0000 7f0ece79f640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0eb40a3300 0x7f0eb40a57c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:47.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.392+0000 7f0ece79f640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ec8102510 0x7f0ec819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:47.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.392+0000 7f0ece79f640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ec8101b50 0x7f0ec8198380 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:47.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.392+0000 7f0ece79f640 1 --2- 172.21.15.98:0/552769794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ec8100950 0x7f0ec8197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:47.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.392+0000 7f0ece79f640 1 -- 172.21.15.98:0/552769794 >> 172.21.15.98:0/552769794 conn(0x7f0ec80fc0e0 msgr2=0x7f0ec806a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:47.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.392+0000 7f0ece79f640 1 -- 172.21.15.98:0/552769794 shutdown_connections 2024-09-19T07:21:47.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:47.392+0000 7f0ece79f640 1 -- 172.21.15.98:0/552769794 wait complete. 2024-09-19T07:21:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:47 smithi098 ceph-mon[30950]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:47 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/552769794' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T07:21:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:47 smithi139 ceph-mon[35039]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:47 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/552769794' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T07:21:48.109 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T07:21:48.122 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:21:48.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:47 smithi162 ceph-mon[35726]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:47 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/552769794' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T07:21:48.371 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:48.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.859+0000 7f3170fd4640 1 -- 172.21.15.98:0/2383181545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f316c106f10 msgr2=0x7f316c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:48.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.859+0000 7f3170fd4640 1 --2- 172.21.15.98:0/2383181545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f316c106f10 0x7f316c10ea90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3164009ca0 tx=0x7f316402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:21:48.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.859+0000 7f3170fd4640 1 -- 172.21.15.98:0/2383181545 shutdown_connections 2024-09-19T07:21:48.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.859+0000 7f3170fd4640 1 --2- 172.21.15.98:0/2383181545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f316c106f10 0x7f316c10ea90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:48.905 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.859+0000 7f3170fd4640 1 --2- 172.21.15.98:0/2383181545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f316c102790 0x7f316c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.859+0000 7f3170fd4640 1 --2- 172.21.15.98:0/2383181545 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f316c101de0 0x7f316c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.859+0000 7f3170fd4640 1 -- 172.21.15.98:0/2383181545 >> 172.21.15.98:0/2383181545 conn(0x7f316c0fd8c0 msgr2=0x7f316c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.859+0000 7f3170fd4640 1 -- 172.21.15.98:0/2383181545 shutdown_connections 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.859+0000 7f3170fd4640 1 -- 172.21.15.98:0/2383181545 wait complete. 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f3170fd4640 1 Processor -- start 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f3170fd4640 1 -- start start 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f3170fd4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f316c101de0 0x7f316c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f3170fd4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f316c102790 0x7f316c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f3170fd4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f316c106f10 0x7f316c19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f3170fd4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f316c112010 con 0x7f316c106f10 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f3170fd4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f316c111e90 con 0x7f316c101de0 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f3170fd4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f316c112190 con 0x7f316c102790 2024-09-19T07:21:48.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f316ad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f316c106f10 0x7f316c19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f316ad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f316c106f10 0x7f316c19cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33106/0 (socket says 172.21.15.98:33106) 2024-09-19T07:21:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f316ad9d640 1 -- 172.21.15.98:0/4114107878 learned_addr learned my addr 172.21.15.98:0/4114107878 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f3169d9b640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f316c102790 0x7f316c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f316a59c640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f316c101de0 0x7f316c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f316ad9d640 1 -- 172.21.15.98:0/4114107878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f316c102790 msgr2=0x7f316c198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f316ad9d640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f316c102790 0x7f316c198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f316ad9d640 1 -- 172.21.15.98:0/4114107878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f316c101de0 msgr2=0x7f316c1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f316ad9d640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f316c101de0 0x7f316c1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f316ad9d640 1 -- 172.21.15.98:0/4114107878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316c19d5a0 con 0x7f316c106f10 2024-09-19T07:21:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.860+0000 7f316ad9d640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f316c106f10 0x7f316c19cec0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3164031a60 tx=0x7f3164031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.861+0000 7f315b7fe640 1 -- 172.21.15.98:0/4114107878 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164003c30 con 0x7f316c106f10 2024-09-19T07:21:48.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.861+0000 7f3170fd4640 1 -- 172.21.15.98:0/4114107878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316c19d830 con 0x7f316c106f10 2024-09-19T07:21:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.861+0000 7f315b7fe640 1 -- 172.21.15.98:0/4114107878 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3164003dd0 con 0x7f316c106f10 2024-09-19T07:21:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.861+0000 7f315b7fe640 1 -- 172.21.15.98:0/4114107878 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31640047e0 con 0x7f316c106f10 2024-09-19T07:21:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.861+0000 7f3170fd4640 1 -- 172.21.15.98:0/4114107878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f316c1a5170 con 0x7f316c106f10 2024-09-19T07:21:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.862+0000 7f3170fd4640 1 -- 172.21.15.98:0/4114107878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316c102240 con 0x7f316c106f10 2024-09-19T07:21:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.863+0000 7f315b7fe640 1 -- 172.21.15.98:0/4114107878 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f316402f790 con 0x7f316c106f10 2024-09-19T07:21:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.863+0000 7f315b7fe640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f31540a32d0 0x7f31540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.864+0000 7f316a59c640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f31540a32d0 0x7f31540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.864+0000 7f315b7fe640 1 -- 172.21.15.98:0/4114107878 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f31640f0ef0 con 0x7f316c106f10 2024-09-19T07:21:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.864+0000 7f316a59c640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f31540a32d0 0x7f31540a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3160009890 tx=0x7f3160008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:48.908 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:48.867+0000 7f315b7fe640 1 -- 172.21.15.98:0/4114107878 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f31640bdb40 con 0x7f316c106f10 2024-09-19T07:21:49.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.068+0000 7f3170fd4640 1 -- 172.21.15.98:0/4114107878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f316c10a150 con 0x7f316c106f10 2024-09-19T07:21:49.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.069+0000 7f315b7fe640 1 -- 172.21.15.98:0/4114107878 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11917 (secure 0 0 0) 0x7f31640bd440 con 0x7f316c106f10 2024-09-19T07:21:49.070 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:49.070 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"btime":"2024-09-19T07:20:31:757871+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:20:31.309254+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24442,24458,24479]},"id":1}]} 2024-09-19T07:21:49.070 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2024-09-19T07:21:49.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.071+0000 7f3170fd4640 1 -- 172.21.15.98:0/4114107878 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f31540a32d0 msgr2=0x7f31540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.071+0000 7f3170fd4640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f31540a32d0 0x7f31540a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3160009890 tx=0x7f3160008040 comp rx=0 tx=0).stop 2024-09-19T07:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.071+0000 7f3170fd4640 1 -- 172.21.15.98:0/4114107878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f316c106f10 msgr2=0x7f316c19cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.071+0000 7f3170fd4640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f316c106f10 0x7f316c19cec0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3164031a60 tx=0x7f3164031a90 comp rx=0 tx=0).stop 2024-09-19T07:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.071+0000 7f3170fd4640 1 -- 172.21.15.98:0/4114107878 shutdown_connections 2024-09-19T07:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.071+0000 7f3170fd4640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f31540a32d0 0x7f31540a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.071+0000 7f3170fd4640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f316c106f10 0x7f316c19cec0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.071+0000 7f3170fd4640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f316c102790 0x7f316c198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.071+0000 7f3170fd4640 1 --2- 172.21.15.98:0/4114107878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f316c101de0 0x7f316c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.071+0000 7f3170fd4640 1 -- 172.21.15.98:0/4114107878 >> 172.21.15.98:0/4114107878 conn(0x7f316c0fd8c0 msgr2=0x7f316c0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.071+0000 7f3170fd4640 1 -- 172.21.15.98:0/4114107878 shutdown_connections 2024-09-19T07:21:49.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:49.071+0000 7f3170fd4640 1 -- 172.21.15.98:0/4114107878 wait complete. 2024-09-19T07:21:49.730 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:21:49.977 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:49 smithi098 ceph-mon[30950]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:49 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4114107878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:50.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:49 smithi139 ceph-mon[35039]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:50.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:49 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4114107878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:49 smithi162 ceph-mon[35726]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:49 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4114107878' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:50.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.445+0000 7f9d01d02640 1 -- 172.21.15.98:0/3328146514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cfc102570 msgr2=0x7f9cfc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:50.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.445+0000 7f9d01d02640 1 --2- 172.21.15.98:0/3328146514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cfc102570 0x7f9cfc1029b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009900 tx=0x7f9cf002a480 comp rx=0 tx=0).stop 2024-09-19T07:21:50.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.445+0000 7f9d01d02640 1 -- 172.21.15.98:0/3328146514 shutdown_connections 2024-09-19T07:21:50.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.445+0000 7f9d01d02640 1 --2- 172.21.15.98:0/3328146514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cfc102ef0 0x7f9cfc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:50.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.445+0000 7f9d01d02640 1 --2- 172.21.15.98:0/3328146514 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cfc102570 0x7f9cfc1029b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:50.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.445+0000 7f9d01d02640 1 --2- 172.21.15.98:0/3328146514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cfc100e20 0x7f9cfc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:50.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.445+0000 7f9d01d02640 1 -- 172.21.15.98:0/3328146514 >> 172.21.15.98:0/3328146514 conn(0x7f9cfc0fc7d0 msgr2=0x7f9cfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:50.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.445+0000 7f9d01d02640 1 -- 172.21.15.98:0/3328146514 shutdown_connections 2024-09-19T07:21:50.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.445+0000 7f9d01d02640 1 -- 172.21.15.98:0/3328146514 wait complete. 2024-09-19T07:21:50.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.446+0000 7f9d01d02640 1 Processor -- start 2024-09-19T07:21:50.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.446+0000 7f9d01d02640 1 -- start start 2024-09-19T07:21:50.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.446+0000 7f9d01d02640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cfc100e20 0x7f9cfc198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:50.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.446+0000 7f9d01d02640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cfc102570 0x7f9cfc198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:50.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.446+0000 7f9d01d02640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cfc102ef0 0x7f9cfc19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:50.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.446+0000 7f9d01d02640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc112120 con 0x7f9cfc102570 2024-09-19T07:21:50.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.446+0000 7f9d01d02640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc111fa0 con 0x7f9cfc100e20 2024-09-19T07:21:50.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.446+0000 7f9d01d02640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9cfc1122a0 con 0x7f9cfc102ef0 2024-09-19T07:21:50.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.446+0000 7f9cfaffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cfc102570 0x7f9cfc198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:50.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.446+0000 7f9cfaffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cfc102570 0x7f9cfc198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33120/0 (socket says 172.21.15.98:33120) 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.446+0000 7f9cfaffd640 1 -- 172.21.15.98:0/1624422554 learned_addr learned my addr 172.21.15.98:0/1624422554 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9cfbfff640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cfc102ef0 0x7f9cfc19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9cfb7fe640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cfc100e20 0x7f9cfc198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9cfaffd640 1 -- 172.21.15.98:0/1624422554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cfc102ef0 msgr2=0x7f9cfc19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9cfaffd640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cfc102ef0 0x7f9cfc19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9cfaffd640 1 -- 172.21.15.98:0/1624422554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cfc100e20 msgr2=0x7f9cfc198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9cfaffd640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cfc100e20 0x7f9cfc198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9cfaffd640 1 -- 172.21.15.98:0/1624422554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cfc19d5f0 con 0x7f9cfc102570 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9cfb7fe640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cfc100e20 0x7f9cfc198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9cfaffd640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cfc102570 0x7f9cfc198b80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0006010 tx=0x7f9cf0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9cf8ff9640 1 -- 172.21.15.98:0/1624422554 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf003f070 con 0x7f9cfc102570 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9cf8ff9640 1 -- 172.21.15.98:0/1624422554 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cf0031e30 con 0x7f9cfc102570 2024-09-19T07:21:50.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9cf8ff9640 1 -- 172.21.15.98:0/1624422554 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0035030 con 0x7f9cfc102570 2024-09-19T07:21:50.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9d01d02640 1 -- 172.21.15.98:0/1624422554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cfc19d880 con 0x7f9cfc102570 2024-09-19T07:21:50.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.447+0000 7f9d01d02640 1 -- 172.21.15.98:0/1624422554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cfc1a51c0 con 0x7f9cfc102570 2024-09-19T07:21:50.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.448+0000 7f9d01d02640 1 -- 172.21.15.98:0/1624422554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cfc101280 con 0x7f9cfc102570 2024-09-19T07:21:50.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.449+0000 7f9cf8ff9640 1 -- 172.21.15.98:0/1624422554 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9cf0042070 con 0x7f9cfc102570 2024-09-19T07:21:50.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.450+0000 7f9cf8ff9640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f9ce40a32d0 0x7f9ce40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:50.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.450+0000 7f9cf8ff9640 1 -- 172.21.15.98:0/1624422554 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f9cf00f0ab0 con 0x7f9cfc102570 2024-09-19T07:21:50.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.450+0000 7f9cfb7fe640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f9ce40a32d0 0x7f9ce40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:50.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.451+0000 7f9cfb7fe640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f9ce40a32d0 0x7f9ce40a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9cec006fd0 tx=0x7f9cec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:50.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.453+0000 7f9cf8ff9640 1 -- 172.21.15.98:0/1624422554 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9cf00bd6e0 con 0x7f9cfc102570 2024-09-19T07:21:50.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.654+0000 7f9d01d02640 1 -- 172.21.15.98:0/1624422554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cfc109090 con 0x7f9cfc102570 2024-09-19T07:21:50.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.655+0000 7f9cf8ff9640 1 -- 172.21.15.98:0/1624422554 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11917 (secure 0 0 0) 0x7f9cf00bcfe0 con 0x7f9cfc102570 2024-09-19T07:21:50.656 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:50.656 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":23,"btime":"2024-09-19T07:20:31:757871+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:20:31.309254+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24442,24458,24479]},"id":1}]} 2024-09-19T07:21:50.656 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 23 2024-09-19T07:21:50.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.658+0000 7f9d01d02640 1 -- 172.21.15.98:0/1624422554 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f9ce40a32d0 msgr2=0x7f9ce40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:50.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.658+0000 7f9d01d02640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f9ce40a32d0 0x7f9ce40a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9cec006fd0 tx=0x7f9cec008040 comp rx=0 tx=0).stop 2024-09-19T07:21:50.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.658+0000 7f9d01d02640 1 -- 172.21.15.98:0/1624422554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cfc102570 msgr2=0x7f9cfc198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:50.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.658+0000 7f9d01d02640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cfc102570 0x7f9cfc198b80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0006010 tx=0x7f9cf0003c80 comp rx=0 tx=0).stop 2024-09-19T07:21:50.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.658+0000 7f9d01d02640 1 -- 172.21.15.98:0/1624422554 shutdown_connections 2024-09-19T07:21:50.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.658+0000 7f9d01d02640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f9ce40a32d0 0x7f9ce40a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:50.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.658+0000 7f9d01d02640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9cfc102ef0 0x7f9cfc19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:50.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.658+0000 7f9d01d02640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9cfc102570 0x7f9cfc198b80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:50.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.658+0000 7f9d01d02640 1 --2- 172.21.15.98:0/1624422554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cfc100e20 0x7f9cfc198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:50.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.658+0000 7f9d01d02640 1 -- 172.21.15.98:0/1624422554 >> 172.21.15.98:0/1624422554 conn(0x7f9cfc0fc7d0 msgr2=0x7f9cfc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:50.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.658+0000 7f9d01d02640 1 -- 172.21.15.98:0/1624422554 shutdown_connections 2024-09-19T07:21:50.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:50.658+0000 7f9d01d02640 1 -- 172.21.15.98:0/1624422554 wait complete. 2024-09-19T07:21:50.980 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:50 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1624422554' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:50.980 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:50 smithi098 ceph-mon[30950]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:51.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:50 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1624422554' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:51.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:50 smithi139 ceph-mon[35039]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:51.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:50 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1624422554' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:21:51.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:50 smithi162 ceph-mon[35726]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:51.300 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:21:51.547 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:52.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.998+0000 7fb08bace640 1 -- 172.21.15.98:0/637997637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb084101220 msgr2=0x7fb084101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:52.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.998+0000 7fb08bace640 1 --2- 172.21.15.98:0/637997637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb084101220 0x7fb084101660 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb074009900 tx=0x7fb07402a410 comp rx=0 tx=0).stop 2024-09-19T07:21:52.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.998+0000 7fb08bace640 1 -- 172.21.15.98:0/637997637 shutdown_connections 2024-09-19T07:21:52.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.998+0000 7fb08bace640 1 --2- 172.21.15.98:0/637997637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb084101ba0 0x7fb08410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:52.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.998+0000 7fb08bace640 1 --2- 172.21.15.98:0/637997637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb084101220 0x7fb084101660 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:52.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.998+0000 7fb08bace640 1 --2- 172.21.15.98:0/637997637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb084105a70 0x7fb084105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:52.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.998+0000 7fb08bace640 1 -- 172.21.15.98:0/637997637 >> 172.21.15.98:0/637997637 conn(0x7fb0840fbee0 msgr2=0x7fb0840fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:52.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.998+0000 7fb08bace640 1 -- 172.21.15.98:0/637997637 shutdown_connections 2024-09-19T07:21:52.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.998+0000 7fb08bace640 1 -- 172.21.15.98:0/637997637 wait complete. 2024-09-19T07:21:52.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb08bace640 1 Processor -- start 2024-09-19T07:21:52.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb08bace640 1 -- start start 2024-09-19T07:21:52.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb08bace640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb084101220 0x7fb084197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:52.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb08bace640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb084101ba0 0x7fb084197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:52.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb08bace640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb084105a70 0x7fb08419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:52.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb08bace640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb084110f90 con 0x7fb084101ba0 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb08bace640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb084110e10 con 0x7fb084101220 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb08bace640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb084111110 con 0x7fb084105a70 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb089069640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb084101ba0 0x7fb084197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb089069640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb084101ba0 0x7fb084197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33130/0 (socket says 172.21.15.98:33130) 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb089069640 1 -- 172.21.15.98:0/3861688615 learned_addr learned my addr 172.21.15.98:0/3861688615 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb08986a640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb084101220 0x7fb084197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb08a06b640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb084105a70 0x7fb08419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb089069640 1 -- 172.21.15.98:0/3861688615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb084105a70 msgr2=0x7fb08419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb089069640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb084105a70 0x7fb08419bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb089069640 1 -- 172.21.15.98:0/3861688615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb084101220 msgr2=0x7fb084197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb089069640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb084101220 0x7fb084197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb089069640 1 -- 172.21.15.98:0/3861688615 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08419c400 con 0x7fb084101ba0 2024-09-19T07:21:52.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb089069640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb084101ba0 0x7fb084197990 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb074006010 tx=0x7fb074003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:52.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:51.999+0000 7fb07affd640 1 -- 172.21.15.98:0/3861688615 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07403f070 con 0x7fb084101ba0 2024-09-19T07:21:52.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.000+0000 7fb07affd640 1 -- 172.21.15.98:0/3861688615 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb074031e30 con 0x7fb084101ba0 2024-09-19T07:21:52.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.000+0000 7fb08bace640 1 -- 172.21.15.98:0/3861688615 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08419c690 con 0x7fb084101ba0 2024-09-19T07:21:52.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.000+0000 7fb07affd640 1 -- 172.21.15.98:0/3861688615 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb074035030 con 0x7fb084101ba0 2024-09-19T07:21:52.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.000+0000 7fb08bace640 1 -- 172.21.15.98:0/3861688615 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb084100110 con 0x7fb084101ba0 2024-09-19T07:21:52.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.000+0000 7fb08bace640 1 -- 172.21.15.98:0/3861688615 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb084102230 con 0x7fb084101ba0 2024-09-19T07:21:52.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.002+0000 7fb07affd640 1 -- 172.21.15.98:0/3861688615 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb074042070 con 0x7fb084101ba0 2024-09-19T07:21:52.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.002+0000 7fb07affd640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb0700a3350 0x7fb0700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:52.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.002+0000 7fb08986a640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb0700a3350 0x7fb0700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:52.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.002+0000 7fb07affd640 1 -- 172.21.15.98:0/3861688615 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fb0740f09f0 con 0x7fb084101ba0 2024-09-19T07:21:52.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.003+0000 7fb08986a640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb0700a3350 0x7fb0700a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb080009890 tx=0x7fb080008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:52.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.005+0000 7fb07affd640 1 -- 172.21.15.98:0/3861688615 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0740bd620 con 0x7fb084101ba0 2024-09-19T07:21:52.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.171+0000 7fb08bace640 1 -- 172.21.15.98:0/3861688615 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb084101660 con 0x7fb084101ba0 2024-09-19T07:21:52.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.173+0000 7fb07affd640 1 -- 172.21.15.98:0/3861688615 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22762 (secure 0 0 0) 0x7fb0740bcf20 con 0x7fb084101ba0 2024-09-19T07:21:52.174 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:21:52.174 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":80,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:20:37.783934+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:20:16.391879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:20:18.243837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:21:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.175+0000 7fb08bace640 1 -- 172.21.15.98:0/3861688615 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb0700a3350 msgr2=0x7fb0700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.175+0000 7fb08bace640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb0700a3350 0x7fb0700a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb080009890 tx=0x7fb080008040 comp rx=0 tx=0).stop 2024-09-19T07:21:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.175+0000 7fb08bace640 1 -- 172.21.15.98:0/3861688615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb084101ba0 msgr2=0x7fb084197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.175+0000 7fb08bace640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb084101ba0 0x7fb084197990 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb074006010 tx=0x7fb074003c80 comp rx=0 tx=0).stop 2024-09-19T07:21:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.175+0000 7fb08bace640 1 -- 172.21.15.98:0/3861688615 shutdown_connections 2024-09-19T07:21:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.175+0000 7fb08bace640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fb0700a3350 0x7fb0700a5810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.175+0000 7fb08bace640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb084105a70 0x7fb08419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.175+0000 7fb08bace640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb084101ba0 0x7fb084197990 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.175+0000 7fb08bace640 1 --2- 172.21.15.98:0/3861688615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb084101220 0x7fb084197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.175+0000 7fb08bace640 1 -- 172.21.15.98:0/3861688615 >> 172.21.15.98:0/3861688615 conn(0x7fb0840fbee0 msgr2=0x7fb0840fc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.175+0000 7fb08bace640 1 -- 172.21.15.98:0/3861688615 shutdown_connections 2024-09-19T07:21:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:52.175+0000 7fb08bace640 1 -- 172.21.15.98:0/3861688615 wait complete. 2024-09-19T07:21:52.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:52 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3861688615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:21:52.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:52 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3861688615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:21:52.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:52 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3861688615' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:21:52.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T07:20:20.077021+0000', 'modified': '2024-09-19T07:20:31.309254+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24479, 'mds_1': 24458, 'mds_2': 24442}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24425': {'gid': 24425, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6833/587476912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6832', 'nonce': 587476912}, {'type': 'v1', 'addr': '172.21.15.139:6833', 'nonce': 587476912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6837/2810820400', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 2810820400}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 2810820400}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6835/4113105598', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6834', 'nonce': 4113105598}, {'type': 'v1', 'addr': '172.21.15.139:6835', 'nonce': 4113105598}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.162:6839/609705447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 609705447}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 609705447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.139:6837/3386684827', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6836', 'nonce': 3386684827}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 3386684827}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24479': {'gid': 24479, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.139:6839/2420704228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6838', 'nonce': 2420704228}, {'type': 'v1', 'addr': '172.21.15.139:6839', 'nonce': 2420704228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24479, 'qdb_cluster': [24442, 24458, 24479]} 2024-09-19T07:21:52.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T07:21:52.899 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T07:21:53.143 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:53.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:53 smithi098 ceph-mon[30950]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:53.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:53 smithi139 ceph-mon[35039]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:53.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:53 smithi162 ceph-mon[35726]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T07:21:53.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.644+0000 7f0f59467640 1 -- 172.21.15.98:0/4021169522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f54102d90 msgr2=0x7f0f54103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:53.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.644+0000 7f0f59467640 1 --2- 172.21.15.98:0/4021169522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f54102d90 0x7f0f54103170 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009900 tx=0x7f0f4402a480 comp rx=0 tx=0).stop 2024-09-19T07:21:53.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.644+0000 7f0f59467640 1 -- 172.21.15.98:0/4021169522 shutdown_connections 2024-09-19T07:21:53.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.644+0000 7f0f59467640 1 --2- 172.21.15.98:0/4021169522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f5410c170 0x7f0f5410e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.644+0000 7f0f59467640 1 --2- 172.21.15.98:0/4021169522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f541036b0 0x7f0f5410bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.644+0000 7f0f59467640 1 --2- 172.21.15.98:0/4021169522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f54102d90 0x7f0f54103170 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.644+0000 7f0f59467640 1 -- 172.21.15.98:0/4021169522 >> 172.21.15.98:0/4021169522 conn(0x7f0f540fc790 msgr2=0x7f0f540febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:53.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.644+0000 7f0f59467640 1 -- 172.21.15.98:0/4021169522 shutdown_connections 2024-09-19T07:21:53.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.644+0000 7f0f59467640 1 -- 172.21.15.98:0/4021169522 wait complete. 2024-09-19T07:21:53.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.644+0000 7f0f59467640 1 Processor -- start 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f59467640 1 -- start start 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f59467640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f54102d90 0x7f0f541985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f59467640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f541036b0 0x7f0f54198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f59467640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f5410c170 0x7f0f5419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f59467640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0f54112010 con 0x7f0f541036b0 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f59467640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0f54111e90 con 0x7f0f5410c170 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f59467640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f54112190 con 0x7f0f54102d90 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f4a7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f541036b0 0x7f0f54198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f4a7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f541036b0 0x7f0f54198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35370/0 (socket says 172.21.15.98:35370) 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f4a7fc640 1 -- 172.21.15.98:0/2682714893 learned_addr learned my addr 172.21.15.98:0/2682714893 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f4a7fc640 1 -- 172.21.15.98:0/2682714893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f54102d90 msgr2=0x7f0f541985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f4a7fc640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f54102d90 0x7f0f541985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f4a7fc640 1 -- 172.21.15.98:0/2682714893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f5410c170 msgr2=0x7f0f5419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f537fe640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f5410c170 0x7f0f5419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f4a7fc640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f5410c170 0x7f0f5419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f4a7fc640 1 -- 172.21.15.98:0/2682714893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5419d560 con 0x7f0f541036b0 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f4a7fc640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f541036b0 0x7f0f54198af0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00b4a0 tx=0x7f0f3c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.645+0000 7f0f50ff9640 1 -- 172.21.15.98:0/2682714893 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c014070 con 0x7f0f541036b0 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.646+0000 7f0f50ff9640 1 -- 172.21.15.98:0/2682714893 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f3c010af0 con 0x7f0f541036b0 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.646+0000 7f0f50ff9640 1 -- 172.21.15.98:0/2682714893 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c017d10 con 0x7f0f541036b0 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.646+0000 7f0f59467640 1 -- 172.21.15.98:0/2682714893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5419d850 con 0x7f0f541036b0 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.646+0000 7f0f59467640 1 -- 172.21.15.98:0/2682714893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f541a5130 con 0x7f0f541036b0 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.648+0000 7f0f50ff9640 1 -- 172.21.15.98:0/2682714893 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0f3c017070 con 0x7f0f541036b0 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.648+0000 7f0f5b840740 1 Processor -- start 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.648+0000 7f0f5b840740 1 -- start start 2024-09-19T07:21:53.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.648+0000 7f0f50ff9640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0f400a32d0 0x7f0f400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.648+0000 7f0f537fe640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0f400a32d0 0x7f0f400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.648+0000 7f0f50ff9640 1 -- 172.21.15.98:0/2682714893 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0f3c0cef00 con 0x7f0f541036b0 2024-09-19T07:21:53.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f5b840740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fb9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f5b840740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f5b840740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fcb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f5b840740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1f20090 con 0x55b3c1fb98b0 2024-09-19T07:21:53.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f5b840740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1ec7a70 con 0x55b3c1fba1d0 2024-09-19T07:21:53.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f5b840740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1f1c050 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f52ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fb9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f52ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fb9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35372/0 (socket says 172.21.15.98:35372) 2024-09-19T07:21:53.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f52ffd640 1 -- 172.21.15.98:0/1465567419 learned_addr learned my addr 172.21.15.98:0/1465567419 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:53.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f537fe640 1 --2- 172.21.15.98:0/1465567419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fcb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f4a7fc640 1 --2- 172.21.15.98:0/1465567419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f537fe640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0f400a32d0 0x7f0f400a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c007d90 tx=0x7f0f4c007270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:53.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f52ffd640 1 -- 172.21.15.98:0/1465567419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fc8fc0 msgr2=0x55b3c1fcb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:53.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f52ffd640 1 --2- 172.21.15.98:0/1465567419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fcb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f52ffd640 1 -- 172.21.15.98:0/1465567419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 msgr2=0x55b3c1fc8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f52ffd640 1 --2- 172.21.15.98:0/1465567419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f52ffd640 1 -- 172.21.15.98:0/1465567419 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c1ed4130 con 0x55b3c1fb98b0 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f4a7fc640 1 --2- 172.21.15.98:0/1465567419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f537fe640 1 --2- 172.21.15.98:0/1465567419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fcb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f52ffd640 1 --2- 172.21.15.98:0/1465567419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fb9c90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0f44005e80 tx=0x7f0f44031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e920546aeeef14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f497fa640 1 -- 172.21.15.98:0/1465567419 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4403e030 con 0x55b3c1fb98b0 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f497fa640 1 -- 172.21.15.98:0/1465567419 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f44004050 con 0x55b3c1fb98b0 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.649+0000 7f0f497fa640 1 -- 172.21.15.98:0/1465567419 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44035040 con 0x55b3c1fb98b0 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.650+0000 7f0f5b840740 1 -- 172.21.15.98:0/1465567419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fb98b0 msgr2=0x55b3c1fb9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.650+0000 7f0f5b840740 1 --2- 172.21.15.98:0/1465567419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fb9c90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0f44005e80 tx=0x7f0f44031510 comp rx=0 tx=0).stop 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.650+0000 7f0f5b840740 1 -- 172.21.15.98:0/1465567419 shutdown_connections 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.650+0000 7f0f5b840740 1 --2- 172.21.15.98:0/1465567419 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fcb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.650+0000 7f0f5b840740 1 --2- 172.21.15.98:0/1465567419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.650+0000 7f0f5b840740 1 --2- 172.21.15.98:0/1465567419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fb9c90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.650+0000 7f0f5b840740 1 -- 172.21.15.98:0/1465567419 >> 172.21.15.98:0/1465567419 conn(0x55b3c1fb5f60 msgr2=0x55b3c1fb6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.650+0000 7f0f5b840740 1 -- 172.21.15.98:0/1465567419 shutdown_connections 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.650+0000 7f0f5b840740 1 -- 172.21.15.98:0/1465567419 wait complete. 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.650+0000 7f0f5b840740 1 -- start start 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f5b840740 1 Processor -- start 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f5b840740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fc8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f5b840740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f5b840740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f5b840740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1fcbb90 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f5b840740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1edaf20 con 0x55b3c1fba1d0 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f5b840740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1fcbd10 con 0x55b3c1fb98b0 2024-09-19T07:21:53.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f5b840740 10 client.0 _ll_register_callbacks cb 0x55b3c1ea4030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:53.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f537fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f537fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35386/0 (socket says 172.21.15.98:35386) 2024-09-19T07:21:53.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f537fe640 1 -- 172.21.15.98:0/2263472798 learned_addr learned my addr 172.21.15.98:0/2263472798 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:53.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f52ffd640 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fc8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f4a7fc640 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f537fe640 1 -- 172.21.15.98:0/2263472798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fb98b0 msgr2=0x55b3c1fc8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:53.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f537fe640 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fc8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f537fe640 1 -- 172.21.15.98:0/2263472798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 msgr2=0x55b3c1fc5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:53.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f537fe640 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f537fe640 1 -- 172.21.15.98:0/2263472798 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c1c912b0 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f537fe640 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc6010 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00d010 tx=0x7f0f4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9babfe0c02f6c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:53.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.651+0000 7f0f3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:21:53.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f3a7fc640 1 -- 172.21.15.98:0/2263472798 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c01e410 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f3a7fc640 1 -- 172.21.15.98:0/2263472798 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0f4c01e5b0 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f5b840740 1 -- 172.21.15.98:0/2263472798 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f44004050 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f3a7fc640 1 -- 172.21.15.98:0/2263472798 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0f4c01e7b0 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f5b840740 10 client.15066 fetch_fsmap learned FSMap version 23 2024-09-19T07:21:53.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f5b840740 1 -- 172.21.15.98:0/2263472798 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55b3c1fd7400 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f3a7fc640 1 -- 172.21.15.98:0/2263472798 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f44004050 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f3a7fc640 1 -- 172.21.15.98:0/2263472798 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0f4c0279d0 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f5b840740 10 client.15066 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f5b840740 10 client.15066 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f5b840740 20 client.15066 populate_metadata read hostname 'smithi098' 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f5b840740 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55b3c1fd9ac0 0x55b3c1fdaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f5b840740 4 client.15066 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.652+0000 7f0f5b840740 1 -- 172.21.15.98:0/2263472798 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3c1f2d600 con 0x55b3c1fd9ac0 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.653+0000 7f0f52ffd640 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55b3c1fd9ac0 0x55b3c1fdaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.653+0000 7f0f52ffd640 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55b3c1fd9ac0 0x55b3c1fdaf30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3707b1eb5845ac52 server_cookie=9983e361dd7d4957 in_seq=0 out_seq=0 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.653+0000 7f0f3a7fc640 10 client.15066 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f3a7fc640 1 -- 172.21.15.98:0/2263472798 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3c1f2d600 con 0x55b3c1fd9ac0 2024-09-19T07:21:53.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f3a7fc640 10 client.15066 handle_command_reply: tid=0 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f5b840740 1 client.15066 shutdown 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f5b840740 1 -- 172.21.15.98:0/2263472798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 msgr2=0x55b3c1fc6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f5b840740 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc6010 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00d010 tx=0x7f0f4c004a40 comp rx=0 tx=0).stop 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f5b840740 1 -- 172.21.15.98:0/2263472798 shutdown_connections 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f5b840740 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc6010 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f5b840740 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f5b840740 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55b3c1fd9ac0 0x55b3c1fdaf30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f5b840740 1 --2- 172.21.15.98:0/2263472798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fc8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f5b840740 1 -- 172.21.15.98:0/2263472798 >> 172.21.15.98:0/2263472798 conn(0x55b3c1fb5f60 msgr2=0x55b3c1fbbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f3a7fc640 0 client.15066 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f5b840740 1 -- 172.21.15.98:0/2263472798 shutdown_connections 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f5b840740 1 -- 172.21.15.98:0/2263472798 wait complete. 2024-09-19T07:21:53.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.654+0000 7f0f5b840740 20 client.15066 trim_cache size 0 max 16384 2024-09-19T07:21:53.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.671+0000 7f0f5b840740 1 Processor -- start 2024-09-19T07:21:53.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f5b840740 1 -- start start 2024-09-19T07:21:53.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f5b840740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fd93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f5b840740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fda860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f5b840740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f5b840740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1fd9270 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f5b840740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1fd9940 con 0x55b3c1fba1d0 2024-09-19T07:21:53.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f5b840740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1fda010 con 0x55b3c1fb98b0 2024-09-19T07:21:53.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f537fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f537fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35398/0 (socket says 172.21.15.98:35398) 2024-09-19T07:21:53.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f537fe640 1 -- 172.21.15.98:0/1027363754 learned_addr learned my addr 172.21.15.98:0/1027363754 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:53.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f4a7fc640 1 --2- 172.21.15.98:0/1027363754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fda860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f537fe640 1 -- 172.21.15.98:0/1027363754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fb98b0 msgr2=0x55b3c1fd93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:53.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f537fe640 1 --2- 172.21.15.98:0/1027363754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fd93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f537fe640 1 -- 172.21.15.98:0/1027363754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 msgr2=0x55b3c1fda860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:53.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f537fe640 1 --2- 172.21.15.98:0/1027363754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fda860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f537fe640 1 -- 172.21.15.98:0/1027363754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3c1fb59c0 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.672+0000 7f0f537fe640 1 --2- 172.21.15.98:0/1027363754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc67a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c008010 tx=0x7f0f4c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d656ea7c6f2024f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:53.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.673+0000 7f0f48ff9640 1 -- 172.21.15.98:0/1027363754 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c011d20 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.673+0000 7f0f48ff9640 1 -- 172.21.15.98:0/1027363754 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f4c023070 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.673+0000 7f0f48ff9640 1 -- 172.21.15.98:0/1027363754 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c027660 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.673+0000 7f0f5b840740 1 -- 172.21.15.98:0/1027363754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 msgr2=0x55b3c1fc67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:53.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.673+0000 7f0f5b840740 1 --2- 172.21.15.98:0/1027363754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc67a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c008010 tx=0x7f0f4c011920 comp rx=0 tx=0).stop 2024-09-19T07:21:53.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.673+0000 7f0f5b840740 1 -- 172.21.15.98:0/1027363754 shutdown_connections 2024-09-19T07:21:53.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.673+0000 7f0f5b840740 1 --2- 172.21.15.98:0/1027363754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc67a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.673+0000 7f0f5b840740 1 --2- 172.21.15.98:0/1027363754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fda860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.673+0000 7f0f5b840740 1 --2- 172.21.15.98:0/1027363754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fd93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.673+0000 7f0f5b840740 1 -- 172.21.15.98:0/1027363754 >> 172.21.15.98:0/1027363754 conn(0x55b3c1fb5f60 msgr2=0x55b3c1fb6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:53.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.673+0000 7f0f5b840740 1 -- 172.21.15.98:0/1027363754 shutdown_connections 2024-09-19T07:21:53.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f5b840740 1 -- 172.21.15.98:0/1027363754 wait complete. 2024-09-19T07:21:53.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f5b840740 1 -- start start 2024-09-19T07:21:53.687 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f5b840740 1 Processor -- start 2024-09-19T07:21:53.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f5b840740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fc3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f5b840740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f5b840740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f5b840740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1fdadb0 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f5b840740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1fda6e0 con 0x55b3c1fb98b0 2024-09-19T07:21:53.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f5b840740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b3c1fdb480 con 0x55b3c1fba1d0 2024-09-19T07:21:53.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f5b840740 10 client.0 _ll_register_callbacks cb 0x7f0f4c008040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:53.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f537fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f537fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35408/0 (socket says 172.21.15.98:35408) 2024-09-19T07:21:53.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f537fe640 1 -- 172.21.15.98:0/3954501413 learned_addr learned my addr 172.21.15.98:0/3954501413 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:53.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.674+0000 7f0f52ffd640 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fc3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f4a7fc640 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f537fe640 1 -- 172.21.15.98:0/3954501413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fba1d0 msgr2=0x55b3c1fc1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f537fe640 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f537fe640 1 -- 172.21.15.98:0/3954501413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fb98b0 msgr2=0x55b3c1fc3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f537fe640 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fc3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f537fe640 1 -- 172.21.15.98:0/3954501413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3c1fc2b60 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f52ffd640 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fc3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f537fe640 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc2330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00d010 tx=0x7f0f4c007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92586b170c5e1b4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f3a7fc640 1 -- 172.21.15.98:0/3954501413 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c01ebe0 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f3a7fc640 1 -- 172.21.15.98:0/3954501413 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f0f4c01ed80 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f5b840740 1 -- 172.21.15.98:0/3954501413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f4c023070 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f3a7fc640 1 -- 172.21.15.98:0/3954501413 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0f4c027400 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f5b840740 10 client.15072 fetch_fsmap learned FSMap version 23 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f5b840740 1 -- 172.21.15.98:0/3954501413 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55b3c1fe32b0 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f3a7fc640 1 -- 172.21.15.98:0/3954501413 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f4c023070 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f3a7fc640 1 -- 172.21.15.98:0/3954501413 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f0f4c03d860 con 0x55b3c1fc8fc0 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f5b840740 10 client.15072 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.675+0000 7f0f5b840740 10 client.15072 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.676+0000 7f0f5b840740 20 client.15072 populate_metadata read hostname 'smithi098' 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.676+0000 7f0f5b840740 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55b3c2047b80 0x55b3c2046890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.676+0000 7f0f5b840740 4 client.15072 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.676+0000 7f0f5b840740 1 -- 172.21.15.98:0/3954501413 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "status"}) -- 0x55b3c1f27b10 con 0x55b3c2047b80 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.676+0000 7f0f52ffd640 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55b3c2047b80 0x55b3c2046890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.676+0000 7f0f52ffd640 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55b3c2047b80 0x55b3c2046890 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ab4f4375148622f server_cookie=cf21a76c986a4fd1 in_seq=0 out_seq=0 2024-09-19T07:21:53.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.676+0000 7f0f3a7fc640 10 client.15072 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:21:53.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.676+0000 7f0f3a7fc640 1 -- 172.21.15.98:0/3954501413 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b3c1f27b10 con 0x55b3c2047b80 2024-09-19T07:21:53.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.676+0000 7f0f3a7fc640 10 client.15072 handle_command_reply: tid=0 2024-09-19T07:21:53.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.676+0000 7f0f5b840740 1 client.15072 shutdown 2024-09-19T07:21:53.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.676+0000 7f0f5b840740 1 -- 172.21.15.98:0/3954501413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 msgr2=0x55b3c1fc2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:53.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.676+0000 7f0f5b840740 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc2330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00d010 tx=0x7f0f4c007be0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f5b840740 1 -- 172.21.15.98:0/3954501413 shutdown_connections 2024-09-19T07:21:53.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f5b840740 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b3c1fc8fc0 0x55b3c1fc2330 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f5b840740 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55b3c2047b80 0x55b3c2046890 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f5b840740 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b3c1fba1d0 0x55b3c1fc1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f5b840740 1 --2- 172.21.15.98:0/3954501413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b3c1fb98b0 0x55b3c1fc3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f5b840740 1 -- 172.21.15.98:0/3954501413 >> 172.21.15.98:0/3954501413 conn(0x55b3c1fb5f60 msgr2=0x55b3c1fb0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:53.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f3a7fc640 0 client.15072 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:21:53.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f5b840740 1 -- 172.21.15.98:0/3954501413 shutdown_connections 2024-09-19T07:21:53.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f5b840740 1 -- 172.21.15.98:0/3954501413 wait complete. 2024-09-19T07:21:53.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f5b840740 20 client.15072 trim_cache size 0 max 16384 2024-09-19T07:21:53.692 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:21:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "73438718-7656-11ef-bceb-c7b262605968", 2024-09-19T07:21:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 2, 2024-09-19T07:21:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 24442, 2024-09-19T07:21:53.692 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-19T07:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-19T07:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-19T07:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 84.932650773999995, 2024-09-19T07:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 23, 2024-09-19T07:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 80, 2024-09-19T07:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T07:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 111.710455493 2024-09-19T07:21:53.693 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:21:53.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f59467640 1 -- 172.21.15.98:0/2682714893 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0f400a32d0 msgr2=0x7f0f400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:53.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f59467640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0f400a32d0 0x7f0f400a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c007d90 tx=0x7f0f4c007270 comp rx=0 tx=0).stop 2024-09-19T07:21:53.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f59467640 1 -- 172.21.15.98:0/2682714893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f541036b0 msgr2=0x7f0f54198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:53.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f59467640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f541036b0 0x7f0f54198af0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00b4a0 tx=0x7f0f3c00b960 comp rx=0 tx=0).stop 2024-09-19T07:21:53.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f59467640 1 -- 172.21.15.98:0/2682714893 shutdown_connections 2024-09-19T07:21:53.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f59467640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f0f400a32d0 0x7f0f400a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f59467640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f5410c170 0x7f0f5419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f59467640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f541036b0 0x7f0f54198af0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f59467640 1 --2- 172.21.15.98:0/2682714893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f54102d90 0x7f0f541985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:53.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f59467640 1 -- 172.21.15.98:0/2682714893 >> 172.21.15.98:0/2682714893 conn(0x7f0f540fc790 msgr2=0x7f0f540fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:53.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f59467640 1 -- 172.21.15.98:0/2682714893 shutdown_connections 2024-09-19T07:21:53.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:53.677+0000 7f0f59467640 1 -- 172.21.15.98:0/2682714893 wait complete. 2024-09-19T07:21:54.467 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T07:21:54.715 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:55.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/3169570994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc54101420 msgr2=0x7fdc5410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:55.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 --2- 172.21.15.98:0/3169570994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc54101420 0x7fdc5410d950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009cd0 tx=0x7fdc4c02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/3169570994 shutdown_connections 2024-09-19T07:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 --2- 172.21.15.98:0/3169570994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc54101420 0x7fdc5410d950 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 --2- 172.21.15.98:0/3169570994 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc54100a80 0x7fdc54100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 --2- 172.21.15.98:0/3169570994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc54106a80 0x7fdc54106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/3169570994 >> 172.21.15.98:0/3169570994 conn(0x7fdc540fc7a0 msgr2=0x7fdc540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/3169570994 shutdown_connections 2024-09-19T07:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/3169570994 wait complete. 2024-09-19T07:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 Processor -- start 2024-09-19T07:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 -- start start 2024-09-19T07:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc54100a80 0x7fdc54198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc54101420 0x7fdc541988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc54106a80 0x7fdc5419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc54110e80 con 0x7fdc54101420 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdc54110d00 con 0x7fdc54106a80 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.202+0000 7fdc5b0bb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc54111000 con 0x7fdc54100a80 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc54101420 0x7fdc541988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc54101420 0x7fdc541988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35426/0 (socket says 172.21.15.98:35426) 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc53fff640 1 -- 172.21.15.98:0/2354842854 learned_addr learned my addr 172.21.15.98:0/2354842854 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc58e57640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc54100a80 0x7fdc54198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc59658640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc54106a80 0x7fdc5419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc53fff640 1 -- 172.21.15.98:0/2354842854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc54100a80 msgr2=0x7fdc54198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc53fff640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc54100a80 0x7fdc54198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc53fff640 1 -- 172.21.15.98:0/2354842854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc54106a80 msgr2=0x7fdc5419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc53fff640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc54106a80 0x7fdc5419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc53fff640 1 -- 172.21.15.98:0/2354842854 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5419d320 con 0x7fdc54101420 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc53fff640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc54101420 0x7fdc541988b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800d950 tx=0x7fdc4800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:55.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc51ffb640 1 -- 172.21.15.98:0/2354842854 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48017070 con 0x7fdc54101420 2024-09-19T07:21:55.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/2354842854 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5419d610 con 0x7fdc54101420 2024-09-19T07:21:55.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc51ffb640 1 -- 172.21.15.98:0/2354842854 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc4800de80 con 0x7fdc54101420 2024-09-19T07:21:55.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.203+0000 7fdc51ffb640 1 -- 172.21.15.98:0/2354842854 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800f620 con 0x7fdc54101420 2024-09-19T07:21:55.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.204+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/2354842854 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc541a4ef0 con 0x7fdc54101420 2024-09-19T07:21:55.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.205+0000 7fdc51ffb640 1 -- 172.21.15.98:0/2354842854 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdc48009c30 con 0x7fdc54101420 2024-09-19T07:21:55.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc5d494740 1 Processor -- start 2024-09-19T07:21:55.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc5d494740 1 -- start start 2024-09-19T07:21:55.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc51ffb640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fdc3c0a32d0 0x7fdc3c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc5d494740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e1bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc5d494740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1c2f0 0x5608f3e26670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc5d494740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 0x5608f3e28fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc5d494740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5608f3d82090 con 0x5608f3e26bb0 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc5d494740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5608f3d29a70 con 0x5608f3e1b9d0 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc5d494740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5608f3d7e050 con 0x5608f3e1c2f0 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc59658640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fdc3c0a32d0 0x7fdc3c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc59658640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 0x5608f3e28fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc51ffb640 1 -- 172.21.15.98:0/2354842854 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fdc480cf7d0 con 0x7fdc54101420 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc59658640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 0x5608f3e28fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35430/0 (socket says 172.21.15.98:35430) 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc59658640 1 -- 172.21.15.98:0/312719762 learned_addr learned my addr 172.21.15.98:0/312719762 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.206+0000 7fdc58e57640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e1bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.207+0000 7fdc53fff640 1 --2- 172.21.15.98:0/312719762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1c2f0 0x5608f3e26670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.207+0000 7fdc59658640 1 -- 172.21.15.98:0/312719762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1c2f0 msgr2=0x5608f3e26670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.207+0000 7fdc59658640 1 --2- 172.21.15.98:0/312719762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1c2f0 0x5608f3e26670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.207+0000 7fdc59658640 1 -- 172.21.15.98:0/312719762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 msgr2=0x5608f3e1bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.207+0000 7fdc59658640 1 --2- 172.21.15.98:0/312719762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e1bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.207+0000 7fdc59658640 1 -- 172.21.15.98:0/312719762 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608f3d36130 con 0x5608f3e26bb0 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.207+0000 7fdc59658640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fdc3c0a32d0 0x7fdc3c0a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c033040 tx=0x7fdc4c009880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.207+0000 7fdc59658640 1 --2- 172.21.15.98:0/312719762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 0x5608f3e28fa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009a60 tx=0x7fdc4c047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcd9cdb88b564e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.207+0000 7fdc3affd640 1 -- 172.21.15.98:0/312719762 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c003d70 con 0x5608f3e26bb0 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.207+0000 7fdc3affd640 1 -- 172.21.15.98:0/312719762 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc4c036040 con 0x5608f3e26bb0 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.207+0000 7fdc3affd640 1 -- 172.21.15.98:0/312719762 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c030800 con 0x5608f3e26bb0 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.208+0000 7fdc5d494740 1 -- 172.21.15.98:0/312719762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 msgr2=0x5608f3e28fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.208+0000 7fdc5d494740 1 --2- 172.21.15.98:0/312719762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 0x5608f3e28fa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009a60 tx=0x7fdc4c047000 comp rx=0 tx=0).stop 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.208+0000 7fdc5d494740 1 -- 172.21.15.98:0/312719762 shutdown_connections 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.208+0000 7fdc5d494740 1 --2- 172.21.15.98:0/312719762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 0x5608f3e28fa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.208+0000 7fdc5d494740 1 --2- 172.21.15.98:0/312719762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1c2f0 0x5608f3e26670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.208+0000 7fdc5d494740 1 --2- 172.21.15.98:0/312719762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e1bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.208+0000 7fdc5d494740 1 -- 172.21.15.98:0/312719762 >> 172.21.15.98:0/312719762 conn(0x5608f3e17f60 msgr2=0x5608f3e18340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:55.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.208+0000 7fdc5d494740 1 -- 172.21.15.98:0/312719762 shutdown_connections 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.208+0000 7fdc5d494740 1 -- 172.21.15.98:0/312719762 wait complete. 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.208+0000 7fdc5d494740 1 -- start start 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.208+0000 7fdc5d494740 1 Processor -- start 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc5d494740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1b9d0 0x5608f3e26400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc5d494740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 0x5608f3e23750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc5d494740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e26bb0 0x5608f3e23c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc5d494740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5608f3e29780 con 0x5608f3e1c2f0 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc5d494740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5608f3d3cf20 con 0x5608f3e26bb0 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc5d494740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5608f3e29900 con 0x5608f3e1b9d0 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc5d494740 10 client.0 _ll_register_callbacks cb 0x5608f3d06030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 0x5608f3e23750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 0x5608f3e23750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35440/0 (socket says 172.21.15.98:35440) 2024-09-19T07:21:55.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc53fff640 1 -- 172.21.15.98:0/3746795252 learned_addr learned my addr 172.21.15.98:0/3746795252 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc58e57640 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1b9d0 0x5608f3e26400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc53fff640 1 -- 172.21.15.98:0/3746795252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1b9d0 msgr2=0x5608f3e26400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc53fff640 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1b9d0 0x5608f3e26400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc53fff640 1 -- 172.21.15.98:0/3746795252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e26bb0 msgr2=0x5608f3e23c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc53fff640 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e26bb0 0x5608f3e23c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc53fff640 1 -- 172.21.15.98:0/3746795252 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608f3af32b0 con 0x5608f3e1c2f0 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc58e57640 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1b9d0 0x5608f3e26400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc53fff640 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 0x5608f3e23750 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdc48000c00 tx=0x7fdc4809b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ef7bc68b93caea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc33fff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc33fff640 1 -- 172.21.15.98:0/3746795252 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48020070 con 0x5608f3e1c2f0 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc33fff640 1 -- 172.21.15.98:0/3746795252 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fdc48098280 con 0x5608f3e1c2f0 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.209+0000 7fdc5d494740 1 -- 172.21.15.98:0/3746795252 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc4c036040 con 0x5608f3e1c2f0 2024-09-19T07:21:55.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.210+0000 7fdc33fff640 1 -- 172.21.15.98:0/3746795252 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdc480cd350 con 0x5608f3e1c2f0 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.210+0000 7fdc5d494740 10 client.15084 fetch_fsmap learned FSMap version 23 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.210+0000 7fdc5d494740 1 -- 172.21.15.98:0/3746795252 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5608f3e35100 con 0x5608f3e1c2f0 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.210+0000 7fdc33fff640 1 -- 172.21.15.98:0/3746795252 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc4c036040 con 0x5608f3e1c2f0 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.210+0000 7fdc33fff640 1 -- 172.21.15.98:0/3746795252 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fdc480c0420 con 0x5608f3e1c2f0 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.210+0000 7fdc5d494740 10 client.15084 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.210+0000 7fdc5d494740 10 client.15084 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.210+0000 7fdc5d494740 20 client.15084 populate_metadata read hostname 'smithi098' 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.210+0000 7fdc5d494740 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5608f3e37720 0x5608f3e38b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.210+0000 7fdc5d494740 4 client.15084 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.210+0000 7fdc5d494740 1 -- 172.21.15.98:0/3746795252 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608f3d8f600 con 0x5608f3e37720 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.210+0000 7fdc58e57640 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5608f3e37720 0x5608f3e38b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.211+0000 7fdc58e57640 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5608f3e37720 0x5608f3e38b90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2228ffa4daabb963 server_cookie=a0c6c72c3163c8e in_seq=0 out_seq=0 2024-09-19T07:21:55.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.211+0000 7fdc33fff640 10 client.15084 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc33fff640 1 -- 172.21.15.98:0/3746795252 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608f3d8f600 con 0x5608f3e37720 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc33fff640 10 client.15084 handle_command_reply: tid=0 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc5d494740 1 client.15084 shutdown 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc5d494740 1 -- 172.21.15.98:0/3746795252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 msgr2=0x5608f3e23750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc5d494740 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 0x5608f3e23750 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdc48000c00 tx=0x7fdc4809b670 comp rx=0 tx=0).stop 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc5d494740 1 -- 172.21.15.98:0/3746795252 shutdown_connections 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc5d494740 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5608f3e37720 0x5608f3e38b90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc5d494740 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e26bb0 0x5608f3e23c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc33fff640 0 client.15084 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc5d494740 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 0x5608f3e23750 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc5d494740 1 --2- 172.21.15.98:0/3746795252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1b9d0 0x5608f3e26400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc5d494740 1 -- 172.21.15.98:0/3746795252 >> 172.21.15.98:0/3746795252 conn(0x5608f3e17f60 msgr2=0x5608f3e1dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:55.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc5d494740 1 -- 172.21.15.98:0/3746795252 shutdown_connections 2024-09-19T07:21:55.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc5d494740 1 -- 172.21.15.98:0/3746795252 wait complete. 2024-09-19T07:21:55.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.212+0000 7fdc5d494740 20 client.15084 trim_cache size 0 max 16384 2024-09-19T07:21:55.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.229+0000 7fdc5d494740 1 Processor -- start 2024-09-19T07:21:55.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.229+0000 7fdc5d494740 1 -- start start 2024-09-19T07:21:55.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.229+0000 7fdc5d494740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e38b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.229+0000 7fdc5d494740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1c2f0 0x5608f3e12ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.229+0000 7fdc5d494740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 0x5608f3e41260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.229+0000 7fdc5d494740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5608f3e36ed0 con 0x5608f3e26bb0 2024-09-19T07:21:55.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.229+0000 7fdc5d494740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5608f3e375a0 con 0x5608f3e1b9d0 2024-09-19T07:21:55.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.229+0000 7fdc5d494740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5608f3e37c70 con 0x5608f3e1c2f0 2024-09-19T07:21:55.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.229+0000 7fdc59658640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 0x5608f3e41260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.230+0000 7fdc59658640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 0x5608f3e41260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35444/0 (socket says 172.21.15.98:35444) 2024-09-19T07:21:55.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.230+0000 7fdc59658640 1 -- 172.21.15.98:0/1162729554 learned_addr learned my addr 172.21.15.98:0/1162729554 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:55.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.230+0000 7fdc59658640 1 -- 172.21.15.98:0/1162729554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1c2f0 msgr2=0x5608f3e12ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:55.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.230+0000 7fdc58e57640 1 --2- 172.21.15.98:0/1162729554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e38b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.230+0000 7fdc59658640 1 --2- 172.21.15.98:0/1162729554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1c2f0 0x5608f3e12ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.230+0000 7fdc59658640 1 -- 172.21.15.98:0/1162729554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 msgr2=0x5608f3e38b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:55.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.230+0000 7fdc59658640 1 --2- 172.21.15.98:0/1162729554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e38b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.230+0000 7fdc59658640 1 -- 172.21.15.98:0/1162729554 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608f3e1b7e0 con 0x5608f3e26bb0 2024-09-19T07:21:55.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.230+0000 7fdc59658640 1 --2- 172.21.15.98:0/1162729554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 0x5608f3e41260 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c006010 tx=0x7fdc4c0098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db01a637a68c2553 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:55.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.230+0000 7fdc3a7fc640 1 -- 172.21.15.98:0/1162729554 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c058020 con 0x5608f3e26bb0 2024-09-19T07:21:55.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.230+0000 7fdc3a7fc640 1 -- 172.21.15.98:0/1162729554 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc4c036040 con 0x5608f3e26bb0 2024-09-19T07:21:55.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.230+0000 7fdc3a7fc640 1 -- 172.21.15.98:0/1162729554 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c030800 con 0x5608f3e26bb0 2024-09-19T07:21:55.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 -- 172.21.15.98:0/1162729554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 msgr2=0x5608f3e41260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:55.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 --2- 172.21.15.98:0/1162729554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 0x5608f3e41260 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c006010 tx=0x7fdc4c0098f0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 -- 172.21.15.98:0/1162729554 shutdown_connections 2024-09-19T07:21:55.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 --2- 172.21.15.98:0/1162729554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e26bb0 0x5608f3e41260 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 --2- 172.21.15.98:0/1162729554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e1c2f0 0x5608f3e12ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 --2- 172.21.15.98:0/1162729554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e38b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 -- 172.21.15.98:0/1162729554 >> 172.21.15.98:0/1162729554 conn(0x5608f3e17f60 msgr2=0x5608f3e18340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:55.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 -- 172.21.15.98:0/1162729554 shutdown_connections 2024-09-19T07:21:55.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 -- 172.21.15.98:0/1162729554 wait complete. 2024-09-19T07:21:55.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 -- start start 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 Processor -- start 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e41240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.231+0000 7fdc5d494740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 0x5608f3e41780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc5d494740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e26bb0 0x5608f3e3e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc5d494740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5608f3e38a10 con 0x5608f3e1c2f0 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc5d494740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5608f3e38340 con 0x5608f3e1b9d0 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc5d494740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5608f3e390e0 con 0x5608f3e26bb0 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc5d494740 10 client.0 _ll_register_callbacks cb 0x7fdc4809b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 0x5608f3e41780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 0x5608f3e41780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35460/0 (socket says 172.21.15.98:35460) 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc53fff640 1 -- 172.21.15.98:0/3181763363 learned_addr learned my addr 172.21.15.98:0/3181763363 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc58e57640 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e41240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc53fff640 1 -- 172.21.15.98:0/3181763363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e26bb0 msgr2=0x5608f3e3e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:55.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc53fff640 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e26bb0 0x5608f3e3e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc53fff640 1 -- 172.21.15.98:0/3181763363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 msgr2=0x5608f3e41240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc53fff640 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e41240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc53fff640 1 -- 172.21.15.98:0/3181763363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608f3e3f010 con 0x5608f3e1c2f0 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc58e57640 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e41240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc53fff640 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 0x5608f3e41780 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdc4809b060 tx=0x7fdc48097fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f35a07156d05f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc33fff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc33fff640 1 -- 172.21.15.98:0/3181763363 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48020070 con 0x5608f3e1c2f0 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc33fff640 1 -- 172.21.15.98:0/3181763363 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7fdc480979b0 con 0x5608f3e1c2f0 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc5d494740 1 -- 172.21.15.98:0/3181763363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc4c036040 con 0x5608f3e1c2f0 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc33fff640 1 -- 172.21.15.98:0/3181763363 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdc480cd4f0 con 0x5608f3e1c2f0 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc5d494740 10 client.15090 fetch_fsmap learned FSMap version 23 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc5d494740 1 -- 172.21.15.98:0/3181763363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5608f3ea5b30 con 0x5608f3e1c2f0 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.232+0000 7fdc33fff640 1 -- 172.21.15.98:0/3181763363 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc4c036040 con 0x5608f3e1c2f0 2024-09-19T07:21:55.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.233+0000 7fdc33fff640 1 -- 172.21.15.98:0/3181763363 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fdc4809abf0 con 0x5608f3e1c2f0 2024-09-19T07:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.233+0000 7fdc5d494740 10 client.15090 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T07:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.233+0000 7fdc5d494740 10 client.15090 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T07:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.233+0000 7fdc5d494740 20 client.15090 populate_metadata read hostname 'smithi098' 2024-09-19T07:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.233+0000 7fdc5d494740 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5608f3eaa530 0x5608f3ea9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.233+0000 7fdc5d494740 4 client.15090 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.233+0000 7fdc5d494740 1 -- 172.21.15.98:0/3181763363 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "status"}) -- 0x5608f3d89b10 con 0x5608f3eaa530 2024-09-19T07:21:55.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.233+0000 7fdc58e57640 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5608f3eaa530 0x5608f3ea9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.233+0000 7fdc58e57640 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5608f3eaa530 0x5608f3ea9240 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29a229c3043f895f server_cookie=8b31ee21c94c5481 in_seq=0 out_seq=0 2024-09-19T07:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.233+0000 7fdc33fff640 10 client.15090 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc33fff640 1 -- 172.21.15.98:0/3181763363 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5608f3d89b10 con 0x5608f3eaa530 2024-09-19T07:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc33fff640 10 client.15090 handle_command_reply: tid=0 2024-09-19T07:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc5d494740 1 client.15090 shutdown 2024-09-19T07:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc5d494740 1 -- 172.21.15.98:0/3181763363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 msgr2=0x5608f3e41780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc5d494740 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 0x5608f3e41780 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdc4809b060 tx=0x7fdc48097fe0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc5d494740 1 -- 172.21.15.98:0/3181763363 shutdown_connections 2024-09-19T07:21:55.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc5d494740 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5608f3eaa530 0x5608f3ea9240 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc33fff640 0 client.15090 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:21:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc5d494740 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5608f3e26bb0 0x5608f3e3e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc5d494740 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608f3e1c2f0 0x5608f3e41780 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc5d494740 1 --2- 172.21.15.98:0/3181763363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5608f3e1b9d0 0x5608f3e41240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc5d494740 1 -- 172.21.15.98:0/3181763363 >> 172.21.15.98:0/3181763363 conn(0x5608f3e17f60 msgr2=0x5608f3e1e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc5d494740 1 -- 172.21.15.98:0/3181763363 shutdown_connections 2024-09-19T07:21:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc5d494740 1 -- 172.21.15.98:0/3181763363 wait complete. 2024-09-19T07:21:55.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.234+0000 7fdc5d494740 20 client.15090 trim_cache size 0 max 16384 2024-09-19T07:21:55.242 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:21:55.242 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "73438718-7656-11ef-bceb-c7b262605968", 2024-09-19T07:21:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 1, 2024-09-19T07:21:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 24458, 2024-09-19T07:21:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-19T07:21:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-19T07:21:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-19T07:21:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 87.501560006999995, 2024-09-19T07:21:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 23, 2024-09-19T07:21:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 80, 2024-09-19T07:21:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T07:21:55.243 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 115.737496041 2024-09-19T07:21:55.243 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:21:55.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.235+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/2354842854 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fdc3c0a32d0 msgr2=0x7fdc3c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:55.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.235+0000 7fdc5b0bb640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fdc3c0a32d0 0x7fdc3c0a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c033040 tx=0x7fdc4c009880 comp rx=0 tx=0).stop 2024-09-19T07:21:55.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.235+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/2354842854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc54101420 msgr2=0x7fdc541988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:55.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.235+0000 7fdc5b0bb640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc54101420 0x7fdc541988b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800d950 tx=0x7fdc4800dd50 comp rx=0 tx=0).stop 2024-09-19T07:21:55.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.235+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/2354842854 shutdown_connections 2024-09-19T07:21:55.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.235+0000 7fdc5b0bb640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7fdc3c0a32d0 0x7fdc3c0a5790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.235+0000 7fdc5b0bb640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc54106a80 0x7fdc5419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.235+0000 7fdc5b0bb640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc54101420 0x7fdc541988b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.235+0000 7fdc5b0bb640 1 --2- 172.21.15.98:0/2354842854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc54100a80 0x7fdc54198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:55.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.235+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/2354842854 >> 172.21.15.98:0/2354842854 conn(0x7fdc540fc7a0 msgr2=0x7fdc5406a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:55.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.235+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/2354842854 shutdown_connections 2024-09-19T07:21:55.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:55.235+0000 7fdc5b0bb640 1 -- 172.21.15.98:0/2354842854 wait complete. 2024-09-19T07:21:56.021 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:55 smithi098 ceph-mon[30950]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:56.049 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T07:21:56.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:55 smithi139 ceph-mon[35039]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:56.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:55 smithi162 ceph-mon[35726]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T07:21:56.294 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:56.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.799+0000 7f265890c640 1 -- 172.21.15.98:0/1351222877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654102ef0 msgr2=0x7f265410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:56.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.799+0000 7f265890c640 1 --2- 172.21.15.98:0/1351222877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654102ef0 0x7f265410da40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f264c009ca0 tx=0x7f264c02a950 comp rx=0 tx=0).stop 2024-09-19T07:21:56.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.799+0000 7f265890c640 1 -- 172.21.15.98:0/1351222877 shutdown_connections 2024-09-19T07:21:56.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.799+0000 7f265890c640 1 --2- 172.21.15.98:0/1351222877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654102ef0 0x7f265410da40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.799+0000 7f265890c640 1 --2- 172.21.15.98:0/1351222877 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2654102570 0x7f26541029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.799+0000 7f265890c640 1 --2- 172.21.15.98:0/1351222877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2654100e20 0x7f2654101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.799+0000 7f265890c640 1 -- 172.21.15.98:0/1351222877 >> 172.21.15.98:0/1351222877 conn(0x7f26540fc7d0 msgr2=0x7f26540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:56.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.799+0000 7f265890c640 1 -- 172.21.15.98:0/1351222877 shutdown_connections 2024-09-19T07:21:56.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.799+0000 7f265890c640 1 -- 172.21.15.98:0/1351222877 wait complete. 2024-09-19T07:21:56.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f265890c640 1 Processor -- start 2024-09-19T07:21:56.834 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f265890c640 1 -- start start 2024-09-19T07:21:56.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f265890c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2654100e20 0x7f2654197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f265890c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2654102570 0x7f2654197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f265890c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654102ef0 0x7f265419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f265890c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2654110fc0 con 0x7f2654102ef0 2024-09-19T07:21:56.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f265890c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2654110e40 con 0x7f2654102570 2024-09-19T07:21:56.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f265890c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2654111140 con 0x7f2654100e20 2024-09-19T07:21:56.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f2652d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654102ef0 0x7f265419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f2652d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654102ef0 0x7f265419bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35488/0 (socket says 172.21.15.98:35488) 2024-09-19T07:21:56.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f2652d9d640 1 -- 172.21.15.98:0/4292400885 learned_addr learned my addr 172.21.15.98:0/4292400885 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:56.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f265259c640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2654100e20 0x7f2654197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f2652d9d640 1 -- 172.21.15.98:0/4292400885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2654100e20 msgr2=0x7f2654197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:56.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f2652d9d640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2654100e20 0x7f2654197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f264bfff640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2654102570 0x7f2654197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f2652d9d640 1 -- 172.21.15.98:0/4292400885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2654102570 msgr2=0x7f2654197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f2652d9d640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2654102570 0x7f2654197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.800+0000 7f2652d9d640 1 -- 172.21.15.98:0/4292400885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f265419c3b0 con 0x7f2654102ef0 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.801+0000 7f2652d9d640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654102ef0 0x7f265419bcd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f264c006010 tx=0x7f264c02f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.801+0000 7f264b7fe640 1 -- 172.21.15.98:0/4292400885 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c034040 con 0x7f2654102ef0 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.801+0000 7f264b7fe640 1 -- 172.21.15.98:0/4292400885 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f264c003e00 con 0x7f2654102ef0 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.801+0000 7f265890c640 1 -- 172.21.15.98:0/4292400885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f265419c640 con 0x7f2654102ef0 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.801+0000 7f264b7fe640 1 -- 172.21.15.98:0/4292400885 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c045480 con 0x7f2654102ef0 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.801+0000 7f265890c640 1 -- 172.21.15.98:0/4292400885 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26541a3f80 con 0x7f2654102ef0 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.803+0000 7f264b7fe640 1 -- 172.21.15.98:0/4292400885 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f264c037020 con 0x7f2654102ef0 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.803+0000 7f265ace5740 1 Processor -- start 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f265ace5740 1 -- start start 2024-09-19T07:21:56.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f264b7fe640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f26400a32d0 0x7f26400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f265ace5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e42db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f265ace5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e432f0 0x55bc99e4d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f265ace5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 0x55bc99e4ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f265ace5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bc99da9090 con 0x55bc99e4dbb0 2024-09-19T07:21:56.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f265ace5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bc99d50a70 con 0x55bc99e432f0 2024-09-19T07:21:56.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f265ace5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bc99da5050 con 0x55bc99e429d0 2024-09-19T07:21:56.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f264bfff640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f26400a32d0 0x7f26400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f264b7fe640 1 -- 172.21.15.98:0/4292400885 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f264c0f0af0 con 0x7f2654102ef0 2024-09-19T07:21:56.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f2652d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 0x55bc99e4ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f2652d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 0x55bc99e4ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35504/0 (socket says 172.21.15.98:35504) 2024-09-19T07:21:56.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f2652d9d640 1 -- 172.21.15.98:0/2853243255 learned_addr learned my addr 172.21.15.98:0/2853243255 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:56.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f264bfff640 1 --2- 172.21.15.98:0/2853243255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e432f0 0x55bc99e4d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f265259c640 1 --2- 172.21.15.98:0/2853243255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e42db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f2652d9d640 1 -- 172.21.15.98:0/2853243255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 msgr2=0x55bc99e42db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f2652d9d640 1 --2- 172.21.15.98:0/2853243255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e42db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f2652d9d640 1 -- 172.21.15.98:0/2853243255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e432f0 msgr2=0x55bc99e4d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f2652d9d640 1 --2- 172.21.15.98:0/2853243255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e432f0 0x55bc99e4d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f2652d9d640 1 -- 172.21.15.98:0/2853243255 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc99d5d130 con 0x55bc99e4dbb0 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f264bfff640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f26400a32d0 0x7f26400a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f26540fec10 tx=0x7f263c014840 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.804+0000 7f2652d9d640 1 --2- 172.21.15.98:0/2853243255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 0x55bc99e4ffa0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f264c0b9a10 tx=0x7f264c0bcb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f25f987efe6996 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.805+0000 7f2648ff9640 1 -- 172.21.15.98:0/2853243255 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c02c040 con 0x55bc99e4dbb0 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.805+0000 7f2648ff9640 1 -- 172.21.15.98:0/2853243255 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f264c0bd040 con 0x55bc99e4dbb0 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.805+0000 7f2648ff9640 1 -- 172.21.15.98:0/2853243255 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c0b96b0 con 0x55bc99e4dbb0 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.805+0000 7f265ace5740 1 -- 172.21.15.98:0/2853243255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 msgr2=0x55bc99e4ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:56.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.805+0000 7f265ace5740 1 --2- 172.21.15.98:0/2853243255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 0x55bc99e4ffa0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f264c0b9a10 tx=0x7f264c0bcb80 comp rx=0 tx=0).stop 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.805+0000 7f265ace5740 1 -- 172.21.15.98:0/2853243255 shutdown_connections 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.805+0000 7f265ace5740 1 --2- 172.21.15.98:0/2853243255 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 0x55bc99e4ffa0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.805+0000 7f265ace5740 1 --2- 172.21.15.98:0/2853243255 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e432f0 0x55bc99e4d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.805+0000 7f265ace5740 1 --2- 172.21.15.98:0/2853243255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e42db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.805+0000 7f265ace5740 1 -- 172.21.15.98:0/2853243255 >> 172.21.15.98:0/2853243255 conn(0x55bc99e3ef60 msgr2=0x55bc99e3f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f265ace5740 1 -- 172.21.15.98:0/2853243255 shutdown_connections 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f265ace5740 1 -- 172.21.15.98:0/2853243255 wait complete. 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f265ace5740 1 -- start start 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f265ace5740 1 Processor -- start 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f265ace5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e4d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f265ace5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e432f0 0x55bc99e4a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f265ace5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 0x55bc99e4abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f265ace5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bc99e50540 con 0x55bc99e4dbb0 2024-09-19T07:21:56.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f265ace5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bc99d63f20 con 0x55bc99e432f0 2024-09-19T07:21:56.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f265ace5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bc99e506c0 con 0x55bc99e429d0 2024-09-19T07:21:56.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f265ace5740 10 client.0 _ll_register_callbacks cb 0x55bc99d2d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:56.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f2652d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 0x55bc99e4abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f2652d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 0x55bc99e4abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35506/0 (socket says 172.21.15.98:35506) 2024-09-19T07:21:56.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.806+0000 7f2652d9d640 1 -- 172.21.15.98:0/3615120802 learned_addr learned my addr 172.21.15.98:0/3615120802 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:56.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f265259c640 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e4d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f264bfff640 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e432f0 0x55bc99e4a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f2652d9d640 1 -- 172.21.15.98:0/3615120802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 msgr2=0x55bc99e4d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:56.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f2652d9d640 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e4d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f2652d9d640 1 -- 172.21.15.98:0/3615120802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e432f0 msgr2=0x55bc99e4a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:56.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f2652d9d640 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e432f0 0x55bc99e4a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f2652d9d640 1 -- 172.21.15.98:0/3615120802 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc99b1a2b0 con 0x55bc99e4dbb0 2024-09-19T07:21:56.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f265259c640 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e4d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:56.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f264bfff640 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e432f0 0x55bc99e4a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:56.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f2652d9d640 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 0x55bc99e4abb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f264c009a60 tx=0x7f264c02a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d494bf199100c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:56.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f2639ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:21:56.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f2639ffb640 1 -- 172.21.15.98:0/3615120802 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f264c0ab070 con 0x55bc99e4dbb0 2024-09-19T07:21:56.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f2639ffb640 1 -- 172.21.15.98:0/3615120802 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f264c0c5820 con 0x55bc99e4dbb0 2024-09-19T07:21:56.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f265ace5740 1 -- 172.21.15.98:0/3615120802 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f264c0bd040 con 0x55bc99e4dbb0 2024-09-19T07:21:56.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f2639ffb640 1 -- 172.21.15.98:0/3615120802 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f264c02c040 con 0x55bc99e4dbb0 2024-09-19T07:21:56.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f265ace5740 10 client.15102 fetch_fsmap learned FSMap version 23 2024-09-19T07:21:56.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f265ace5740 1 -- 172.21.15.98:0/3615120802 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55bc99e50540 con 0x55bc99e4dbb0 2024-09-19T07:21:56.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f2639ffb640 1 -- 172.21.15.98:0/3615120802 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f264c0bd040 con 0x55bc99e4dbb0 2024-09-19T07:21:56.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.807+0000 7f2639ffb640 1 -- 172.21.15.98:0/3615120802 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f264c04d030 con 0x55bc99e4dbb0 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.808+0000 7f265ace5740 10 client.15102 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.808+0000 7f265ace5740 10 client.15102 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.808+0000 7f265ace5740 20 client.15102 populate_metadata read hostname 'smithi098' 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.808+0000 7f265ace5740 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bc99e5e1b0 0x55bc99e5f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.808+0000 7f265ace5740 4 client.15102 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.808+0000 7f265ace5740 1 -- 172.21.15.98:0/3615120802 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc99db6600 con 0x55bc99e5e1b0 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.808+0000 7f265259c640 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bc99e5e1b0 0x55bc99e5f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.808+0000 7f265259c640 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bc99e5e1b0 0x55bc99e5f620 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68b16351891b1db1 server_cookie=ad77b368656b14d5 in_seq=0 out_seq=0 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.808+0000 7f2639ffb640 10 client.15102 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f2639ffb640 1 -- 172.21.15.98:0/3615120802 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bc99db6600 con 0x55bc99e5e1b0 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f2639ffb640 10 client.15102 handle_command_reply: tid=0 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f265ace5740 1 client.15102 shutdown 2024-09-19T07:21:56.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f265ace5740 1 -- 172.21.15.98:0/3615120802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 msgr2=0x55bc99e4abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f265ace5740 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 0x55bc99e4abb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f264c009a60 tx=0x7f264c02a950 comp rx=0 tx=0).stop 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f265ace5740 1 -- 172.21.15.98:0/3615120802 shutdown_connections 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f265ace5740 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bc99e5e1b0 0x55bc99e5f620 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f265ace5740 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e4dbb0 0x55bc99e4abb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f265ace5740 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e432f0 0x55bc99e4a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f2639ffb640 0 client.15102 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f265ace5740 1 --2- 172.21.15.98:0/3615120802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e4d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f265ace5740 1 -- 172.21.15.98:0/3615120802 >> 172.21.15.98:0/3615120802 conn(0x55bc99e3ef60 msgr2=0x55bc99e44c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f265ace5740 1 -- 172.21.15.98:0/3615120802 shutdown_connections 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.809+0000 7f265ace5740 1 -- 172.21.15.98:0/3615120802 wait complete. 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.810+0000 7f265ace5740 20 client.15102 trim_cache size 0 max 16384 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.827+0000 7f265ace5740 1 Processor -- start 2024-09-19T07:21:56.843 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.827+0000 7f265ace5740 1 -- start start 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.827+0000 7f265ace5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e5f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.827+0000 7f265ace5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 0x55bc99e455c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.827+0000 7f265ace5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e4dbb0 0x55bc99e45b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.827+0000 7f265ace5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bc99e5d960 con 0x55bc99e432f0 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.827+0000 7f265ace5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bc99e5e030 con 0x55bc99e4dbb0 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.827+0000 7f265ace5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bc99e5e700 con 0x55bc99e429d0 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.828+0000 7f264bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 0x55bc99e455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.828+0000 7f264bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 0x55bc99e455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35512/0 (socket says 172.21.15.98:35512) 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.828+0000 7f264bfff640 1 -- 172.21.15.98:0/4283164489 learned_addr learned my addr 172.21.15.98:0/4283164489 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.828+0000 7f264bfff640 1 -- 172.21.15.98:0/4283164489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 msgr2=0x55bc99e5f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.828+0000 7f264bfff640 1 --2- 172.21.15.98:0/4283164489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e5f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.828+0000 7f264bfff640 1 -- 172.21.15.98:0/4283164489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e4dbb0 msgr2=0x55bc99e45b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:56.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.828+0000 7f264bfff640 1 --2- 172.21.15.98:0/4283164489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e4dbb0 0x55bc99e45b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.828+0000 7f264bfff640 1 -- 172.21.15.98:0/4283164489 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc99e43120 con 0x55bc99e432f0 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.828+0000 7f264bfff640 1 --2- 172.21.15.98:0/4283164489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 0x55bc99e455c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f263c015fd0 tx=0x7f263c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc40378c87006686 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.828+0000 7f263bfff640 1 -- 172.21.15.98:0/4283164489 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c026070 con 0x55bc99e432f0 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.828+0000 7f263bfff640 1 -- 172.21.15.98:0/4283164489 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f263c012e30 con 0x55bc99e432f0 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.828+0000 7f263bfff640 1 -- 172.21.15.98:0/4283164489 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c011a60 con 0x55bc99e432f0 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 -- 172.21.15.98:0/4283164489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 msgr2=0x55bc99e455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 --2- 172.21.15.98:0/4283164489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 0x55bc99e455c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f263c015fd0 tx=0x7f263c017000 comp rx=0 tx=0).stop 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 -- 172.21.15.98:0/4283164489 shutdown_connections 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 --2- 172.21.15.98:0/4283164489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e4dbb0 0x55bc99e45b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 --2- 172.21.15.98:0/4283164489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 0x55bc99e455c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 --2- 172.21.15.98:0/4283164489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e5f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 -- 172.21.15.98:0/4283164489 >> 172.21.15.98:0/4283164489 conn(0x55bc99e3ef60 msgr2=0x55bc99e48f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 -- 172.21.15.98:0/4283164489 shutdown_connections 2024-09-19T07:21:56.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 -- 172.21.15.98:0/4283164489 wait complete. 2024-09-19T07:21:56.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 -- start start 2024-09-19T07:21:56.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 Processor -- start 2024-09-19T07:21:56.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e60f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 0x55bc99e614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e4dbb0 0x55bc99ec68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bc99e5f4a0 con 0x55bc99e432f0 2024-09-19T07:21:56.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bc99e5edd0 con 0x55bc99e4dbb0 2024-09-19T07:21:56.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.829+0000 7f265ace5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bc99e5fb70 con 0x55bc99e429d0 2024-09-19T07:21:56.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f265ace5740 10 client.0 _ll_register_callbacks cb 0x7f264c0b8bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:21:56.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f264bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 0x55bc99e614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f264bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 0x55bc99e614b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35524/0 (socket says 172.21.15.98:35524) 2024-09-19T07:21:56.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f264bfff640 1 -- 172.21.15.98:0/3850929133 learned_addr learned my addr 172.21.15.98:0/3850929133 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f265259c640 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e60f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f2652d9d640 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e4dbb0 0x55bc99ec68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f264bfff640 1 -- 172.21.15.98:0/3850929133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 msgr2=0x55bc99e60f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f264bfff640 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e60f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f264bfff640 1 -- 172.21.15.98:0/3850929133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e4dbb0 msgr2=0x55bc99ec68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f264bfff640 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e4dbb0 0x55bc99ec68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f264bfff640 1 -- 172.21.15.98:0/3850929133 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc99ec6df0 con 0x55bc99e432f0 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f265259c640 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e60f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f2652d9d640 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e4dbb0 0x55bc99ec68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f264bfff640 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 0x55bc99e614b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f263c00b970 tx=0x7f263c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c2ea1790240a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f2639ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f2639ffb640 1 -- 172.21.15.98:0/3850929133 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c026040 con 0x55bc99e432f0 2024-09-19T07:21:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f2639ffb640 1 -- 172.21.15.98:0/3850929133 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f263c021640 con 0x55bc99e432f0 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f265ace5740 1 -- 172.21.15.98:0/3850929133 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f263c012e30 con 0x55bc99e432f0 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f2639ffb640 1 -- 172.21.15.98:0/3850929133 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f263c021840 con 0x55bc99e432f0 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f265ace5740 10 client.15108 fetch_fsmap learned FSMap version 23 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.830+0000 7f265ace5740 1 -- 172.21.15.98:0/3850929133 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55bc99ec80c0 con 0x55bc99e432f0 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.831+0000 7f2639ffb640 1 -- 172.21.15.98:0/3850929133 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f263c012e30 con 0x55bc99e432f0 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.831+0000 7f2639ffb640 1 -- 172.21.15.98:0/3850929133 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f263c01e070 con 0x55bc99e432f0 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.831+0000 7f265ace5740 10 client.15108 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.831+0000 7f265ace5740 10 client.15108 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.831+0000 7f265ace5740 20 client.15108 populate_metadata read hostname 'smithi098' 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.831+0000 7f265ace5740 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bc99ecc930 0x55bc99ecb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.831+0000 7f265ace5740 4 client.15108 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.831+0000 7f265ace5740 1 -- 172.21.15.98:0/3850929133 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "status"}) -- 0x55bc99db0b10 con 0x55bc99ecc930 2024-09-19T07:21:56.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.831+0000 7f265259c640 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bc99ecc930 0x55bc99ecb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f2639ffb640 10 client.15108 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265259c640 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bc99ecc930 0x55bc99ecb640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d40e7abeb51c471 server_cookie=2ca62eeaf20c8207 in_seq=0 out_seq=0 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f2639ffb640 1 -- 172.21.15.98:0/3850929133 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bc99db0b10 con 0x55bc99ecc930 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f2639ffb640 10 client.15108 handle_command_reply: tid=0 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265ace5740 1 client.15108 shutdown 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265ace5740 1 -- 172.21.15.98:0/3850929133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 msgr2=0x55bc99e614b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265ace5740 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 0x55bc99e614b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f263c00b970 tx=0x7f263c011ed0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265ace5740 1 -- 172.21.15.98:0/3850929133 shutdown_connections 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265ace5740 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bc99e4dbb0 0x55bc99ec68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265ace5740 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bc99ecc930 0x55bc99ecb640 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265ace5740 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bc99e432f0 0x55bc99e614b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265ace5740 1 --2- 172.21.15.98:0/3850929133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bc99e429d0 0x55bc99e60f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.849 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f2639ffb640 0 client.15108 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:21:56.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265ace5740 1 -- 172.21.15.98:0/3850929133 >> 172.21.15.98:0/3850929133 conn(0x55bc99e3ef60 msgr2=0x55bc99e3d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:56.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265ace5740 1 -- 172.21.15.98:0/3850929133 shutdown_connections 2024-09-19T07:21:56.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265ace5740 1 -- 172.21.15.98:0/3850929133 wait complete. 2024-09-19T07:21:56.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.832+0000 7f265ace5740 20 client.15108 trim_cache size 0 max 16384 2024-09-19T07:21:56.850 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:21:56.850 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "73438718-7656-11ef-bceb-c7b262605968", 2024-09-19T07:21:56.850 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2024-09-19T07:21:56.850 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 24479, 2024-09-19T07:21:56.850 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-19T07:21:56.851 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-19T07:21:56.851 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-19T07:21:56.851 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 96.314767770000003, 2024-09-19T07:21:56.851 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 23, 2024-09-19T07:21:56.851 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 80, 2024-09-19T07:21:56.851 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 78, 2024-09-19T07:21:56.851 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 105.950644387 2024-09-19T07:21:56.851 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:21:56.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.833+0000 7f265890c640 1 -- 172.21.15.98:0/4292400885 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f26400a32d0 msgr2=0x7f26400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.833+0000 7f265890c640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f26400a32d0 0x7f26400a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f26540fec10 tx=0x7f263c014840 comp rx=0 tx=0).stop 2024-09-19T07:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.833+0000 7f265890c640 1 -- 172.21.15.98:0/4292400885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654102ef0 msgr2=0x7f265419bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.833+0000 7f265890c640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654102ef0 0x7f265419bcd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f264c006010 tx=0x7f264c02f6f0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.833+0000 7f265890c640 1 -- 172.21.15.98:0/4292400885 shutdown_connections 2024-09-19T07:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.833+0000 7f265890c640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f26400a32d0 0x7f26400a5790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.833+0000 7f265890c640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654102ef0 0x7f265419bcd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.833+0000 7f265890c640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2654102570 0x7f2654197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.833+0000 7f265890c640 1 --2- 172.21.15.98:0/4292400885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2654100e20 0x7f2654197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.833+0000 7f265890c640 1 -- 172.21.15.98:0/4292400885 >> 172.21.15.98:0/4292400885 conn(0x7f26540fc7d0 msgr2=0x7f2654106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.833+0000 7f265890c640 1 -- 172.21.15.98:0/4292400885 shutdown_connections 2024-09-19T07:21:56.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:56.833+0000 7f265890c640 1 -- 172.21.15.98:0/4292400885 wait complete. 2024-09-19T07:21:57.475 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T07:21:57.486 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T07:21:57.486 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T07:21:57.486 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T07:21:57.486 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T07:21:57.487 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:21:57.487 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-19T07:21:57.487 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T07:21:57.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.586+0000 7f53225a8640 1 -- 172.21.15.98:0/1586528632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f531c102d50 msgr2=0x7f531c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:57.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.586+0000 7f53225a8640 1 --2- 172.21.15.98:0/1586528632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f531c102d50 0x7f531c1031d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5310009900 tx=0x7f531002a410 comp rx=0 tx=0).stop 2024-09-19T07:21:57.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.586+0000 7f53225a8640 1 -- 172.21.15.98:0/1586528632 shutdown_connections 2024-09-19T07:21:57.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.586+0000 7f53225a8640 1 --2- 172.21.15.98:0/1586528632 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f531c103710 0x7f531c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.586+0000 7f53225a8640 1 --2- 172.21.15.98:0/1586528632 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f531c102d50 0x7f531c1031d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.586+0000 7f53225a8640 1 --2- 172.21.15.98:0/1586528632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f531c101b60 0x7f531c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.586+0000 7f53225a8640 1 -- 172.21.15.98:0/1586528632 >> 172.21.15.98:0/1586528632 conn(0x7f531c0fd2e0 msgr2=0x7f531c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:57.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.586+0000 7f53225a8640 1 -- 172.21.15.98:0/1586528632 shutdown_connections 2024-09-19T07:21:57.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.586+0000 7f53225a8640 1 -- 172.21.15.98:0/1586528632 wait complete. 2024-09-19T07:21:57.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f53225a8640 1 Processor -- start 2024-09-19T07:21:57.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f53225a8640 1 -- start start 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f53225a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f531c101b60 0x7f531c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f53225a8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f531c102d50 0x7f531c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f53225a8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f531c103710 0x7f531c19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f53225a8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f531c10d8e0 con 0x7f531c102d50 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f53225a8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f531c10d760 con 0x7f531c103710 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f53225a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f531c10da60 con 0x7f531c101b60 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f531b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f531c102d50 0x7f531c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f531b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f531c102d50 0x7f531c198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35534/0 (socket says 172.21.15.98:35534) 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f531b7fe640 1 -- 172.21.15.98:0/4004558891 learned_addr learned my addr 172.21.15.98:0/4004558891 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f531b7fe640 1 -- 172.21.15.98:0/4004558891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f531c101b60 msgr2=0x7f531c197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f531b7fe640 1 --2- 172.21.15.98:0/4004558891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f531c101b60 0x7f531c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f531b7fe640 1 -- 172.21.15.98:0/4004558891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f531c103710 msgr2=0x7f531c19f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:57.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f531b7fe640 1 --2- 172.21.15.98:0/4004558891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f531c103710 0x7f531c19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:57.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f531b7fe640 1 -- 172.21.15.98:0/4004558891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531c19fb60 con 0x7f531c102d50 2024-09-19T07:21:57.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.587+0000 7f531b7fe640 1 --2- 172.21.15.98:0/4004558891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f531c102d50 0x7f531c198480 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5310009230 tx=0x7f5310004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:57.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.588+0000 7f53197fa640 1 -- 172.21.15.98:0/4004558891 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531003f030 con 0x7f531c102d50 2024-09-19T07:21:57.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.588+0000 7f53225a8640 1 -- 172.21.15.98:0/4004558891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531c19fdf0 con 0x7f531c102d50 2024-09-19T07:21:57.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.588+0000 7f53197fa640 1 -- 172.21.15.98:0/4004558891 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5310003ce0 con 0x7f531c102d50 2024-09-19T07:21:57.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.588+0000 7f53197fa640 1 -- 172.21.15.98:0/4004558891 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5310035070 con 0x7f531c102d50 2024-09-19T07:21:57.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.588+0000 7f53225a8640 1 -- 172.21.15.98:0/4004558891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531c1a0300 con 0x7f531c102d50 2024-09-19T07:21:57.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.589+0000 7f53225a8640 1 -- 172.21.15.98:0/4004558891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531c108f70 con 0x7f531c102d50 2024-09-19T07:21:57.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.590+0000 7f53197fa640 1 -- 172.21.15.98:0/4004558891 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5310042030 con 0x7f531c102d50 2024-09-19T07:21:57.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.591+0000 7f53197fa640 1 --2- 172.21.15.98:0/4004558891 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f53040a3390 0x7f53040a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:57.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.591+0000 7f531bfff640 1 --2- 172.21.15.98:0/4004558891 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f53040a3390 0x7f53040a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:57.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.591+0000 7f53197fa640 1 -- 172.21.15.98:0/4004558891 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f53100f06c0 con 0x7f531c102d50 2024-09-19T07:21:57.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.592+0000 7f531bfff640 1 --2- 172.21.15.98:0/4004558891 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f53040a3390 0x7f53040a5850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f531c102bb0 tx=0x7f530c006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:57.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.595+0000 7f53197fa640 1 -- 172.21.15.98:0/4004558891 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f53100bd260 con 0x7f531c102d50 2024-09-19T07:21:57.728 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:57 smithi098 ceph-mon[30950]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:57.810 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:57.809+0000 7f53225a8640 1 -- 172.21.15.98:0/4004558891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f531c02d7c0 con 0x7f531c102d50 2024-09-19T07:21:58.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:57 smithi139 ceph-mon[35039]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:58.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:57 smithi162 ceph-mon[35726]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 345 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T07:21:58.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.735+0000 7f53197fa640 1 -- 172.21.15.98:0/4004558891 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7f53100bcb60 con 0x7f531c102d50 2024-09-19T07:21:58.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.738+0000 7f53225a8640 1 -- 172.21.15.98:0/4004558891 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f53040a3390 msgr2=0x7f53040a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:58.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.738+0000 7f53225a8640 1 --2- 172.21.15.98:0/4004558891 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f53040a3390 0x7f53040a5850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f531c102bb0 tx=0x7f530c006c90 comp rx=0 tx=0).stop 2024-09-19T07:21:58.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.738+0000 7f53225a8640 1 -- 172.21.15.98:0/4004558891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f531c102d50 msgr2=0x7f531c198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:58.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.738+0000 7f53225a8640 1 --2- 172.21.15.98:0/4004558891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f531c102d50 0x7f531c198480 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5310009230 tx=0x7f5310004430 comp rx=0 tx=0).stop 2024-09-19T07:21:58.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.738+0000 7f53225a8640 1 -- 172.21.15.98:0/4004558891 shutdown_connections 2024-09-19T07:21:58.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.738+0000 7f53225a8640 1 --2- 172.21.15.98:0/4004558891 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f53040a3390 0x7f53040a5850 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:58.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.738+0000 7f53225a8640 1 --2- 172.21.15.98:0/4004558891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f531c103710 0x7f531c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:58.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.738+0000 7f53225a8640 1 --2- 172.21.15.98:0/4004558891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f531c102d50 0x7f531c198480 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:58.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.738+0000 7f53225a8640 1 --2- 172.21.15.98:0/4004558891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f531c101b60 0x7f531c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:58.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.738+0000 7f53225a8640 1 -- 172.21.15.98:0/4004558891 >> 172.21.15.98:0/4004558891 conn(0x7f531c0fd2e0 msgr2=0x7f531c106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:58.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.738+0000 7f53225a8640 1 -- 172.21.15.98:0/4004558891 shutdown_connections 2024-09-19T07:21:58.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:58.738+0000 7f53225a8640 1 -- 172.21.15.98:0/4004558891 wait complete. 2024-09-19T07:21:58.759 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T07:21:58.792 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T07:21:58.793 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T07:21:58.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:21:58.793 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-19T07:21:58.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:21:58.812 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-19T07:21:58.880 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2024-09-19T07:21:58.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:21:58.882 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-19T07:21:58.882 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T07:21:58.882 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T07:21:58.883 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T07:21:59.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:58 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4004558891' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T07:21:59.023 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:21:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: ignoring --setuser ceph since I am not root 2024-09-19T07:21:59.023 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:21:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: ignoring --setgroup ceph since I am not root 2024-09-19T07:21:59.023 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:21:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:21:58.893+0000 7fb0131e2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:21:59.023 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:21:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:21:58.952+0000 7fb0131e2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:21:59.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:58 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4004558891' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T07:21:59.067 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:21:58 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: ignoring --setuser ceph since I am not root 2024-09-19T07:21:59.067 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:21:58 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: ignoring --setgroup ceph since I am not root 2024-09-19T07:21:59.067 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:21:58 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:21:58.889+0000 7fa97a7d4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:21:59.067 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:21:58 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:21:58.946+0000 7fa97a7d4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:21:59.099 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:58 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4004558891' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T07:21:59.099 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:21:58 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: ignoring --setuser ceph since I am not root 2024-09-19T07:21:59.099 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:21:58 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: ignoring --setgroup ceph since I am not root 2024-09-19T07:21:59.100 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:21:58 smithi162 ceph-mgr[37545]: -- 172.21.15.162:0/1969578996 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55601238b0e0 con 0x556012369400 2024-09-19T07:21:59.100 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:21:58 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:21:58.892+0000 7f39b6805040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T07:21:59.100 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:21:58 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:21:58.949+0000 7f39b6805040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T07:21:59.100 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:21:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:21:59.099+0000 7f39b6805040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:21:59.177 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:21:59.381 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:21:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:21:59.166+0000 7f39b6805040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:21:59.382 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:21:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:21:59.312+0000 7f39b6805040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:21:59.448 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:21:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:21:59.094+0000 7fa97a7d4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:21:59.448 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:21:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:21:59.159+0000 7fa97a7d4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:21:59.449 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:21:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:21:59.307+0000 7fa97a7d4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:21:59.449 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:21:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:21:59.447+0000 7fa97a7d4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:21:59.462 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:21:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:21:59.107+0000 7fb0131e2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T07:21:59.462 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:21:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:21:59.183+0000 7fb0131e2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T07:21:59.462 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:21:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:21:59.334+0000 7fb0131e2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:21:59.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.693+0000 7f105a816640 1 -- 172.21.15.98:0/1047633027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1054102570 msgr2=0x7f10541029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:59.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.693+0000 7f105a816640 1 --2- 172.21.15.98:0/1047633027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1054102570 0x7f10541029b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f103c009900 tx=0x7f103c02a480 comp rx=0 tx=0).stop 2024-09-19T07:21:59.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.693+0000 7f105a816640 1 -- 172.21.15.98:0/1047633027 shutdown_connections 2024-09-19T07:21:59.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.693+0000 7f105a816640 1 --2- 172.21.15.98:0/1047633027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1054102ef0 0x7f105410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:59.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.693+0000 7f105a816640 1 --2- 172.21.15.98:0/1047633027 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1054102570 0x7f10541029b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:59.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.693+0000 7f105a816640 1 --2- 172.21.15.98:0/1047633027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1054100e20 0x7f1054101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:59.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.693+0000 7f105a816640 1 -- 172.21.15.98:0/1047633027 >> 172.21.15.98:0/1047633027 conn(0x7f10540fc7d0 msgr2=0x7f10540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:59.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.693+0000 7f105a816640 1 -- 172.21.15.98:0/1047633027 shutdown_connections 2024-09-19T07:21:59.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.693+0000 7f105a816640 1 -- 172.21.15.98:0/1047633027 wait complete. 2024-09-19T07:21:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.693+0000 7f105a816640 1 Processor -- start 2024-09-19T07:21:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.693+0000 7f105a816640 1 -- start start 2024-09-19T07:21:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.693+0000 7f105a816640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1054100e20 0x7f1054199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f105a816640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1054102570 0x7f1054199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f105a816640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1054102ef0 0x7f10541a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f105a816640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1054110fd0 con 0x7f1054102570 2024-09-19T07:21:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f105a816640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1054110e50 con 0x7f1054100e20 2024-09-19T07:21:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f105a816640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1054111150 con 0x7f1054102ef0 2024-09-19T07:21:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f1053fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1054100e20 0x7f1054199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f104bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1054102570 0x7f1054199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f1053fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1054100e20 0x7f1054199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:40074/0 (socket says 172.21.15.98:40074) 2024-09-19T07:21:59.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f1053fff640 1 -- 172.21.15.98:0/708709191 learned_addr learned my addr 172.21.15.98:0/708709191 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:21:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f1058db3640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1054102ef0 0x7f10541a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:21:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f104bfff640 1 -- 172.21.15.98:0/708709191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1054102ef0 msgr2=0x7f10541a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f104bfff640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1054102ef0 0x7f10541a43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f104bfff640 1 -- 172.21.15.98:0/708709191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1054100e20 msgr2=0x7f1054199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f104bfff640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1054100e20 0x7f1054199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f104bfff640 1 -- 172.21.15.98:0/708709191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10541a4900 con 0x7f1054102570 2024-09-19T07:21:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f1053fff640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1054100e20 0x7f1054199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:21:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f104bfff640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1054102570 0x7f1054199880 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f103c02a9a0 tx=0x7f103c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:21:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f1051ffb640 1 -- 172.21.15.98:0/708709191 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c03f070 con 0x7f1054102570 2024-09-19T07:21:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f1051ffb640 1 -- 172.21.15.98:0/708709191 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f103c031c20 con 0x7f1054102570 2024-09-19T07:21:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f105a816640 1 -- 172.21.15.98:0/708709191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10541a4ad0 con 0x7f1054102570 2024-09-19T07:21:59.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.694+0000 7f1051ffb640 1 -- 172.21.15.98:0/708709191 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c035030 con 0x7f1054102570 2024-09-19T07:21:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.695+0000 7f105a816640 1 -- 172.21.15.98:0/708709191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10541a4f80 con 0x7f1054102570 2024-09-19T07:21:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.695+0000 7f105a816640 1 -- 172.21.15.98:0/708709191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1054101200 con 0x7f1054102570 2024-09-19T07:21:59.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.697+0000 7f1051ffb640 1 -- 172.21.15.98:0/708709191 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 18) ==== 138423+0+0 (secure 0 0 0) 0x7f103c042070 con 0x7f1054102570 2024-09-19T07:21:59.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.697+0000 7f1051ffb640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a33a0 0x7f10400a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:21:59.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.697+0000 7f1053fff640 1 -- 172.21.15.98:0/708709191 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a33a0 msgr2=0x7f10400a5860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2172632890 2024-09-19T07:21:59.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.697+0000 7f1051ffb640 1 -- 172.21.15.98:0/708709191 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8269+0+0 (secure 0 0 0) 0x7f103c0f0610 con 0x7f1054102570 2024-09-19T07:21:59.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.697+0000 7f1053fff640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a33a0 0x7f10400a5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T07:21:59.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.701+0000 7f1051ffb640 1 -- 172.21.15.98:0/708709191 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f103c0bcb60 con 0x7f1054102570 2024-09-19T07:21:59.738 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:21:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:21:59.481+0000 7fb0131e2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:21:59.738 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:21:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:21:59.454+0000 7f39b6805040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T07:21:59.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.898+0000 7f1053fff640 1 -- 172.21.15.98:0/708709191 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a33a0 msgr2=0x7f10400a5860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.98:6800/2172632890 2024-09-19T07:21:59.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.898+0000 7f1053fff640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a33a0 0x7f10400a5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T07:21:59.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.908+0000 7f105a816640 1 -- 172.21.15.98:0/708709191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1054109090 con 0x7f1054102570 2024-09-19T07:21:59.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.909+0000 7f1051ffb640 1 -- 172.21.15.98:0/708709191 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7f103c0c0e60 con 0x7f1054102570 2024-09-19T07:21:59.910 INFO:teuthology.orchestra.run.smithi098.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T07:21:59.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.911+0000 7f105a816640 1 -- 172.21.15.98:0/708709191 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a33a0 msgr2=0x7f10400a5860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:21:59.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.911+0000 7f105a816640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a33a0 0x7f10400a5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:59.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.911+0000 7f105a816640 1 -- 172.21.15.98:0/708709191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1054102570 msgr2=0x7f1054199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:21:59.912 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.911+0000 7f105a816640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1054102570 0x7f1054199880 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f103c02a9a0 tx=0x7f103c003b90 comp rx=0 tx=0).stop 2024-09-19T07:21:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.911+0000 7f105a816640 1 -- 172.21.15.98:0/708709191 shutdown_connections 2024-09-19T07:21:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.911+0000 7f105a816640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.98:6800/2172632890,v1:172.21.15.98:6801/2172632890] conn(0x7f10400a33a0 0x7f10400a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.911+0000 7f105a816640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1054102ef0 0x7f10541a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.911+0000 7f105a816640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1054102570 0x7f1054199880 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.911+0000 7f105a816640 1 --2- 172.21.15.98:0/708709191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1054100e20 0x7f1054199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:21:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.911+0000 7f105a816640 1 -- 172.21.15.98:0/708709191 >> 172.21.15.98:0/708709191 conn(0x7f10540fc7d0 msgr2=0x7f1054105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:21:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.911+0000 7f105a816640 1 -- 172.21.15.98:0/708709191 shutdown_connections 2024-09-19T07:21:59.913 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:21:59.911+0000 7f105a816640 1 -- 172.21.15.98:0/708709191 wait complete. 2024-09-19T07:22:00.008 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:59 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4004558891' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T07:22:00.008 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:21:59 smithi139 ceph-mon[35039]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T07:22:00.008 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:21:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:21:59.762+0000 7fa97a7d4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:22:00.008 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:21:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:21:59.823+0000 7fa97a7d4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:22:00.009 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:00 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:00.007+0000 7fa97a7d4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:22:00.014 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:59 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4004558891' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T07:22:00.014 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:21:59 smithi162 ceph-mon[35726]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T07:22:00.014 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:21:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:21:59.770+0000 7f39b6805040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:22:00.014 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:21:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:21:59.831+0000 7f39b6805040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:22:00.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:59 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4004558891' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T07:22:00.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:21:59 smithi098 ceph-mon[30950]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T07:22:00.023 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:21:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:21:59.809+0000 7fb0131e2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T07:22:00.023 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:21:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:21:59.870+0000 7fb0131e2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T07:22:00.381 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:00 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:00.013+0000 7f39b6805040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:22:00.382 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:00.061+0000 7fb0131e2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T07:22:00.697 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T07:22:00.697 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T07:22:00.697 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi098.front.sepia.ceph.com 2024-09-19T07:22:00.697 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T07:22:00.697 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T07:22:00.697 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T07:22:00.697 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T07:22:00.697 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T07:22:00.697 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T07:22:00.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:22:00.698 DEBUG:teuthology.orchestra.run.smithi098:> ip addr 2024-09-19T07:22:00.714 INFO:teuthology.orchestra.run.smithi098.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T07:22:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T07:22:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T07:22:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:22:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 ::1/128 scope host 2024-09-19T07:22:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:22:00.714 INFO:teuthology.orchestra.run.smithi098.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:22:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b8 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:22:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f0 2024-09-19T07:22:00.715 INFO:teuthology.orchestra.run.smithi098.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:22:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:d8:d9:b9 brd ff:ff:ff:ff:ff:ff 2024-09-19T07:22:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: altname enp7s0f1 2024-09-19T07:22:00.715 INFO:teuthology.orchestra.run.smithi098.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T07:22:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6a brd ff:ff:ff:ff:ff:ff 2024-09-19T07:22:00.715 INFO:teuthology.orchestra.run.smithi098.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T07:22:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: link/ether 0c:c4:7a:8f:d2:6b brd ff:ff:ff:ff:ff:ff 2024-09-19T07:22:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: inet 172.21.15.98/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T07:22:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft 42238sec preferred_lft 42238sec 2024-09-19T07:22:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: inet6 fe80::ec4:7aff:fe8f:d26b/64 scope link noprefixroute 2024-09-19T07:22:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: valid_lft forever preferred_lft forever 2024-09-19T07:22:00.716 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T07:22:00.716 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:22:00.716 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-19T07:22:00.716 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add name ceph-brx type bridge 2024-09-19T07:22:00.716 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr flush dev ceph-brx 2024-09-19T07:22:00.716 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set ceph-brx up 2024-09-19T07:22:00.716 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T07:22:00.716 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-19T07:22:00.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:22:00.917 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:00 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/708709191' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:22:00.952 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:22:00.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:22:00.958 DEBUG:teuthology.orchestra.run.smithi098:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T07:22:00.983 INFO:teuthology.orchestra.run.smithi098.stdout:1 2024-09-19T07:22:00.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:22:00.985 DEBUG:teuthology.orchestra.run.smithi098:> route 2024-09-19T07:22:01.054 INFO:teuthology.orchestra.run.smithi098.stdout:Kernel IP routing table 2024-09-19T07:22:01.054 INFO:teuthology.orchestra.run.smithi098.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T07:22:01.054 INFO:teuthology.orchestra.run.smithi098.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T07:22:01.054 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T07:22:01.054 INFO:teuthology.orchestra.run.smithi098.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T07:22:01.055 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:22:01.055 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-19T07:22:01.055 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T07:22:01.055 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T07:22:01.055 DEBUG:teuthology.orchestra.run.smithi098:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T07:22:01.055 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-19T07:22:01.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:00 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/708709191' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:22:01.066 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:00 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:00.894+0000 7fa97a7d4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:22:01.066 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:00 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:00.961+0000 7fa97a7d4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:22:01.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:00 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/708709191' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T07:22:01.132 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:00 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:00.897+0000 7f39b6805040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:22:01.132 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:00 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:00.965+0000 7f39b6805040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:22:01.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:22:01.273 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:00.977+0000 7fb0131e2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T07:22:01.273 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:01.049+0000 7fb0131e2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T07:22:01.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:22:01.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:22:01.406 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-19T07:22:01.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:22:01.422 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list-id 2024-09-19T07:22:01.478 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:22:01.478 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-19T07:22:01.478 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T07:22:01.478 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T07:22:01.478 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-19T07:22:01.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:22:01.592 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:22:01.598 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T07:22:01.598 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:22:01.599 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-19T07:22:01.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T07:22:01.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T07:22:01.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T07:22:01.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T07:22:01.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T07:22:01.599 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-19T07:22:01.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:22:01.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:22:01.727 DEBUG:teuthology.orchestra.run.smithi098:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T07:22:01.728 DEBUG:teuthology.orchestra.run.smithi098:> set -e 2024-09-19T07:22:01.728 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set brx.0 up 2024-09-19T07:22:01.728 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T07:22:01.728 DEBUG:teuthology.orchestra.run.smithi098:> ') 2024-09-19T07:22:01.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:22:01.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:22:01.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T07:22:01.808 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T07:22:01.836 INFO:teuthology.orchestra.run.smithi098.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T07:22:01.837 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T07:22:01.837 DEBUG:teuthology.orchestra.run.smithi098:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T07:22:01.893 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T07:22:01.893 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T07:22:01.893 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 2024-09-19T07:22:01.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:22:01.894 DEBUG:teuthology.orchestra.run.smithi098:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T07:22:01.933 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:01 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:01.673+0000 7fa97a7d4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:22:01.933 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:01 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:01.789+0000 7fa97a7d4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:22:01.942 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:01 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:01.684+0000 7f39b6805040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:22:01.942 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:01 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:01.800+0000 7f39b6805040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:22:01.995 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T07:22:01.995 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-19T07:22:02.119 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:01.844+0000 7fb0131e2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T07:22:02.119 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:01.966+0000 7fb0131e2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T07:22:02.131 INFO:teuthology.orchestra.run.smithi098.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-19T07:22:02.131 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-19T07:22:02.131 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: resolved to: "172.21.15.98:3300,172.21.15.139:3300,172.21.15.162:3300" 2024-09-19T07:22:02.131 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: trying mount with new device syntax: 0@73438718-7656-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 2024-09-19T07:22:02.131 INFO:teuthology.orchestra.run.smithi098.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.98:3300/172.21.15.139:3300/172.21.15.162:3300" will pass to kernel 2024-09-19T07:22:02.132 INFO:teuthology.orchestra.run.smithi098.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T07:22:02.132 INFO:teuthology.orchestra.run.smithi098.stdout: You just mounted a file system that supports labels which does not 2024-09-19T07:22:02.133 INFO:teuthology.orchestra.run.smithi098.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T07:22:02.133 INFO:teuthology.orchestra.run.smithi098.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T07:22:02.133 INFO:teuthology.orchestra.run.smithi098.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T07:22:02.135 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T07:22:02.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:22:02.135 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T07:22:02.213 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:01 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:01.932+0000 7fa97a7d4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:22:02.213 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:01 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:01.993+0000 7fa97a7d4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:22:02.213 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:02.143+0000 7fa97a7d4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:22:02.213 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:02.212+0000 7fa97a7d4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:22:02.223 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:01 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:01.942+0000 7f39b6805040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:22:02.223 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:02.004+0000 7f39b6805040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:22:02.223 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:02.154+0000 7f39b6805040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:22:02.223 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:02.222+0000 7f39b6805040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:22:02.415 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:02.124+0000 7fb0131e2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T07:22:02.416 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:02.191+0000 7fb0131e2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T07:22:02.416 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:02.347+0000 7fb0131e2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T07:22:02.496 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:02.271+0000 7fa97a7d4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:22:02.496 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:02.431+0000 7fa97a7d4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:22:02.510 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:02.283+0000 7f39b6805040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:22:02.510 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:02.444+0000 7f39b6805040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:22:02.510 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:02.510+0000 7f39b6805040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:22:02.698 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:02.415+0000 7fb0131e2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T07:22:02.698 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:02.475+0000 7fb0131e2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T07:22:02.698 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:02.632+0000 7fb0131e2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T07:22:02.698 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:02.697+0000 7fb0131e2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:22:02.763 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:02.496+0000 7fa97a7d4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T07:22:02.763 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:02.562+0000 7fa97a7d4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:22:02.763 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:02.645+0000 7fa97a7d4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:22:02.764 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:02.704+0000 7fa97a7d4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:22:02.764 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:02.762+0000 7fa97a7d4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:22:02.778 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:02.576+0000 7f39b6805040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:22:02.778 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:02.659+0000 7f39b6805040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:22:02.778 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:02.718+0000 7f39b6805040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:22:02.778 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:02.777+0000 7f39b6805040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:22:02.963 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:02.764+0000 7fb0131e2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T07:22:02.964 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:02.846+0000 7fb0131e2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T07:22:02.964 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:02.904+0000 7fb0131e2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T07:22:02.964 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:02.963+0000 7fb0131e2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T07:22:03.790 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T07:22:03.816 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y[36402]: 2024-09-19T07:22:03.552+0000 7fa97a7d4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:22:03.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-mon[35039]: Standby manager daemon y restarted 2024-09-19T07:22:03.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-mon[35039]: Standby manager daemon y started 2024-09-19T07:22:03.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.139:0/3062088803' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:22:03.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.139:0/3062088803' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:22:03.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.139:0/3062088803' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:22:03.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.139:0/3062088803' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:22:03.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-mon[35039]: Standby manager daemon z restarted 2024-09-19T07:22:03.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-mon[35039]: Standby manager daemon z started 2024-09-19T07:22:03.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.162:0/3423806396' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:22:03.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.162:0/3423806396' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:22:03.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.162:0/3423806396' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:22:03.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:03 smithi139 ceph-mon[35039]: from='mgr.? 172.21.15.162:0/3423806396' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:22:03.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T07:22:03.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:22:03.875 INFO:teuthology.orchestra.run.smithi098.stdout:client24761 2024-09-19T07:22:03.875 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:22:03.875 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:22:03.881 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z[37541]: 2024-09-19T07:22:03.576+0000 7f39b6805040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:22:03.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-mon[35726]: Standby manager daemon y restarted 2024-09-19T07:22:03.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-mon[35726]: Standby manager daemon y started 2024-09-19T07:22:03.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.139:0/3062088803' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:22:03.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.139:0/3062088803' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:22:03.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.139:0/3062088803' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:22:03.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.139:0/3062088803' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:22:03.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-mon[35726]: Standby manager daemon z restarted 2024-09-19T07:22:03.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-mon[35726]: Standby manager daemon z started 2024-09-19T07:22:03.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.162:0/3423806396' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:22:03.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.162:0/3423806396' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:22:03.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.162:0/3423806396' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:22:03.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:03 smithi162 ceph-mon[35726]: from='mgr.? 172.21.15.162:0/3423806396' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:22:03.897 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T07:22:04.008 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T07:22:04.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:22:04.019 INFO:teuthology.orchestra.run.smithi098.stdout:client24761 2024-09-19T07:22:04.019 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T07:22:04.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-mon[30950]: Standby manager daemon y restarted 2024-09-19T07:22:04.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-mon[30950]: Standby manager daemon y started 2024-09-19T07:22:04.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.139:0/3062088803' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T07:22:04.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.139:0/3062088803' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:22:04.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.139:0/3062088803' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T07:22:04.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.139:0/3062088803' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:22:04.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-mon[30950]: Standby manager daemon z restarted 2024-09-19T07:22:04.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-mon[30950]: Standby manager daemon z started 2024-09-19T07:22:04.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.162:0/3423806396' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T07:22:04.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.162:0/3423806396' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T07:22:04.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.162:0/3423806396' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T07:22:04.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-mon[30950]: from='mgr.? 172.21.15.162:0/3423806396' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T07:22:04.025 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:03 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:03.755+0000 7fb0131e2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T07:22:04.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T07:22:04.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:22:04.088 INFO:teuthology.orchestra.run.smithi098.stdout:client24761 2024-09-19T07:22:04.088 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/73438718-7656-11ef-bceb-c7b262605968.client24761/status') 2024-09-19T07:22:04.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T07:22:04.188 INFO:teuthology.orchestra.run.smithi098.stdout:instance: client.24761 (3)172.21.15.98:0/1228722133 2024-09-19T07:22:04.188 INFO:teuthology.orchestra.run.smithi098.stdout:blocklisted: false 2024-09-19T07:22:04.189 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records in 2024-09-19T07:22:04.189 INFO:teuthology.orchestra.run.smithi098.stderr:0+1 records out 2024-09-19T07:22:04.189 INFO:teuthology.orchestra.run.smithi098.stderr:71 bytes copied, 2.2174e-05 s, 3.2 MB/s 2024-09-19T07:22:04.189 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T07:22:04.196 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T07:22:04.205 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:22:04.205 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-19T07:22:04.205 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-19T07:22:04.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.316+0000 7f2fce16d640 1 -- 172.21.15.98:0/1322456520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fc8101b60 msgr2=0x7f2fc8101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.316+0000 7f2fce16d640 1 --2- 172.21.15.98:0/1322456520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fc8101b60 0x7f2fc8101f60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2fb8009900 tx=0x7f2fb802a410 comp rx=0 tx=0).stop 2024-09-19T07:22:04.318 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.316+0000 7f2fce16d640 1 -- 172.21.15.98:0/1322456520 shutdown_connections 2024-09-19T07:22:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.316+0000 7f2fce16d640 1 --2- 172.21.15.98:0/1322456520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc8103710 0x7f2fc8109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.316+0000 7f2fce16d640 1 --2- 172.21.15.98:0/1322456520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fc8102d50 0x7f2fc81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.316+0000 7f2fce16d640 1 --2- 172.21.15.98:0/1322456520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fc8101b60 0x7f2fc8101f60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.316+0000 7f2fce16d640 1 -- 172.21.15.98:0/1322456520 >> 172.21.15.98:0/1322456520 conn(0x7f2fc80fd2e0 msgr2=0x7f2fc80ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.316+0000 7f2fce16d640 1 -- 172.21.15.98:0/1322456520 shutdown_connections 2024-09-19T07:22:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.316+0000 7f2fce16d640 1 -- 172.21.15.98:0/1322456520 wait complete. 2024-09-19T07:22:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.316+0000 7f2fce16d640 1 Processor -- start 2024-09-19T07:22:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.316+0000 7f2fce16d640 1 -- start start 2024-09-19T07:22:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fce16d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fc8101b60 0x7f2fc8075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fce16d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fc8102d50 0x7f2fc80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.319 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fce16d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc8103710 0x7f2fc8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fce16d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc810d810 con 0x7f2fc8102d50 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fce16d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc810d690 con 0x7f2fc8101b60 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fce16d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc810d990 con 0x7f2fc8103710 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc6ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fc8102d50 0x7f2fc80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc6ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fc8102d50 0x7f2fc80745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59764/0 (socket says 172.21.15.98:59764) 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc6ffd640 1 -- 172.21.15.98:0/2631405946 learned_addr learned my addr 172.21.15.98:0/2631405946 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc77fe640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fc8101b60 0x7f2fc8075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc7fff640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc8103710 0x7f2fc8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc6ffd640 1 -- 172.21.15.98:0/2631405946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc8103710 msgr2=0x7f2fc8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc6ffd640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc8103710 0x7f2fc8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc6ffd640 1 -- 172.21.15.98:0/2631405946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fc8101b60 msgr2=0x7f2fc8075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc6ffd640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fc8101b60 0x7f2fc8075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc6ffd640 1 -- 172.21.15.98:0/2631405946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc80753b0 con 0x7f2fc8102d50 2024-09-19T07:22:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc77fe640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fc8101b60 0x7f2fc8075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc7fff640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc8103710 0x7f2fc8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc6ffd640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fc8102d50 0x7f2fc80745e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00e9f0 tx=0x7f2fbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.317+0000 7f2fc4ff9640 1 -- 172.21.15.98:0/2631405946 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00cd80 con 0x7f2fc8102d50 2024-09-19T07:22:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.318+0000 7f2fce16d640 1 -- 172.21.15.98:0/2631405946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc81a1f00 con 0x7f2fc8102d50 2024-09-19T07:22:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.318+0000 7f2fc4ff9640 1 -- 172.21.15.98:0/2631405946 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fbc010910 con 0x7f2fc8102d50 2024-09-19T07:22:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.318+0000 7f2fc4ff9640 1 -- 172.21.15.98:0/2631405946 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc018950 con 0x7f2fc8102d50 2024-09-19T07:22:04.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.318+0000 7f2fce16d640 1 -- 172.21.15.98:0/2631405946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc81a2370 con 0x7f2fc8102d50 2024-09-19T07:22:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.319+0000 7f2fce16d640 1 -- 172.21.15.98:0/2631405946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc8108e80 con 0x7f2fc8102d50 2024-09-19T07:22:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.320+0000 7f2fc4ff9640 1 -- 172.21.15.98:0/2631405946 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 138040+0+0 (secure 0 0 0) 0x7f2fbc010ac0 con 0x7f2fc8102d50 2024-09-19T07:22:04.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.321+0000 7f2fc4ff9640 1 -- 172.21.15.98:0/2631405946 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f2fbc0cf920 con 0x7f2fc8102d50 2024-09-19T07:22:04.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.325+0000 7f2fc4ff9640 1 -- 172.21.15.98:0/2631405946 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2fbc09c8f0 con 0x7f2fc8102d50 2024-09-19T07:22:04.524 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:04.074+0000 7faf7cf79640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:04.524 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:04.074+0000 7faf7cf79640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:04.524 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:04.074+0000 7faf7cf79640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:04.524 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:04.074+0000 7faf7cf79640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:04.524 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:04.074+0000 7faf7cf79640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:04.525 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:04.074+0000 7faf7a774640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:04.525 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:04.074+0000 7faf7a774640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:04.525 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:04.074+0000 7faf7a774640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:04.525 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:04.074+0000 7faf7a774640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:04.525 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:04.074+0000 7faf7a774640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:04.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.560+0000 7f2fce16d640 1 -- 172.21.15.98:0/2631405946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f2fc8062e90 con 0x7f2fc8102d50 2024-09-19T07:22:04.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.776+0000 7f2fc4ff9640 1 -- 172.21.15.98:0/2631405946 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f2fbc097f40 con 0x7f2fc8102d50 2024-09-19T07:22:04.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.776+0000 7f2fc4ff9640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f2fb00aa140 0x7f2fb00ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.778+0000 7f2fc4ff9640 1 -- 172.21.15.98:0/2631405946 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f2fbc04f4d0 con 0x7f2fc8102d50 2024-09-19T07:22:04.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.779+0000 7f2fc77fe640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f2fb00aa140 0x7f2fb00ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fc77fe640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f2fb00aa140 0x7f2fb00ac530 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2fb802aa00 tx=0x7f2fb8000bc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:04.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fce16d640 1 -- 172.21.15.98:0/2631405946 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f2fb00aa140 msgr2=0x7f2fb00ac530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fce16d640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f2fb00aa140 0x7f2fb00ac530 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2fb802aa00 tx=0x7f2fb8000bc0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fce16d640 1 -- 172.21.15.98:0/2631405946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fc8102d50 msgr2=0x7f2fc80745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fce16d640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fc8102d50 0x7f2fc80745e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00e9f0 tx=0x7f2fbc00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fce16d640 1 -- 172.21.15.98:0/2631405946 shutdown_connections 2024-09-19T07:22:04.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fce16d640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f2fb00aa140 0x7f2fb00ac530 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fce16d640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fc8103710 0x7f2fc8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fce16d640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2fc8102d50 0x7f2fc80745e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fce16d640 1 --2- 172.21.15.98:0/2631405946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2fc8101b60 0x7f2fc8075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fce16d640 1 -- 172.21.15.98:0/2631405946 >> 172.21.15.98:0/2631405946 conn(0x7f2fc80fd2e0 msgr2=0x7f2fc8106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:04.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fce16d640 1 -- 172.21.15.98:0/2631405946 shutdown_connections 2024-09-19T07:22:04.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.782+0000 7f2fce16d640 1 -- 172.21.15.98:0/2631405946 wait complete. 2024-09-19T07:22:04.793 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-19T07:22:04.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T07:22:04.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: Active manager daemon x restarted 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: Activating manager daemon x 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: mgrmap e20: x(active, starting, since 0.0110456s), standbys: z, y 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:22:04.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:22:04.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:22:04.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:22:04.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:22:04.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:22:04.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:22:04.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:22:04.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:22:04.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:22:04.884 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:22:04.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:22:04.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:22:04.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:22:04.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:22:04.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:22:04.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:22:04.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:22:04.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:22:04.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:22:04.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:22:04.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:22:04.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:22:04.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:22:04.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:22:04.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: Manager daemon x is now available 2024-09-19T07:22:04.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:04.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:22:04.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:22:04.886 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:04 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2631405946' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T07:22:04.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.897+0000 7f0f98fbd640 1 -- 172.21.15.98:0/2594432297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f941078c0 msgr2=0x7f0f94109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.897+0000 7f0f98fbd640 1 --2- 172.21.15.98:0/2594432297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f941078c0 0x7f0f94109cb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009ca0 tx=0x7f0f8c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.897+0000 7f0f98fbd640 1 -- 172.21.15.98:0/2594432297 shutdown_connections 2024-09-19T07:22:04.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.897+0000 7f0f98fbd640 1 --2- 172.21.15.98:0/2594432297 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f941078c0 0x7f0f94109cb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.897+0000 7f0f98fbd640 1 --2- 172.21.15.98:0/2594432297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f94104f90 0x7f0f94107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.897+0000 7f0f98fbd640 1 --2- 172.21.15.98:0/2594432297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f94102660 0x7f0f94104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.897+0000 7f0f98fbd640 1 -- 172.21.15.98:0/2594432297 >> 172.21.15.98:0/2594432297 conn(0x7f0f940fc1e0 msgr2=0x7f0f940fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:04.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.897+0000 7f0f98fbd640 1 -- 172.21.15.98:0/2594432297 shutdown_connections 2024-09-19T07:22:04.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.897+0000 7f0f98fbd640 1 -- 172.21.15.98:0/2594432297 wait complete. 2024-09-19T07:22:04.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f98fbd640 1 Processor -- start 2024-09-19T07:22:04.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f98fbd640 1 -- start start 2024-09-19T07:22:04.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f98fbd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f94102660 0x7f0f94197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f98fbd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f94104f90 0x7f0f94198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f98fbd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f941078c0 0x7f0f9419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f98fbd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9410d800 con 0x7f0f94102660 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f98fbd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9410d680 con 0x7f0f941078c0 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f98fbd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9410d980 con 0x7f0f94104f90 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f9259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f94102660 0x7f0f94197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f9259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f94102660 0x7f0f94197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59782/0 (socket says 172.21.15.98:59782) 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f9259c640 1 -- 172.21.15.98:0/3432108334 learned_addr learned my addr 172.21.15.98:0/3432108334 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f91d9b640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f94104f90 0x7f0f94198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.898+0000 7f0f92d9d640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f941078c0 0x7f0f9419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.899+0000 7f0f9259c640 1 -- 172.21.15.98:0/3432108334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f94104f90 msgr2=0x7f0f94198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.899+0000 7f0f9259c640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f94104f90 0x7f0f94198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.899+0000 7f0f9259c640 1 -- 172.21.15.98:0/3432108334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f941078c0 msgr2=0x7f0f9419f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.899+0000 7f0f9259c640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f941078c0 0x7f0f9419f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:04.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.899+0000 7f0f9259c640 1 -- 172.21.15.98:0/3432108334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9419fa20 con 0x7f0f94102660 2024-09-19T07:22:04.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.899+0000 7f0f9259c640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f94102660 0x7f0f94197e00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400c970 tx=0x7f0f8400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:04.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.899+0000 7f0f837fe640 1 -- 172.21.15.98:0/3432108334 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84007bb0 con 0x7f0f94102660 2024-09-19T07:22:04.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.899+0000 7f0f837fe640 1 -- 172.21.15.98:0/3432108334 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f84007d50 con 0x7f0f94102660 2024-09-19T07:22:04.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.899+0000 7f0f98fbd640 1 -- 172.21.15.98:0/3432108334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9419fd10 con 0x7f0f94102660 2024-09-19T07:22:04.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.899+0000 7f0f837fe640 1 -- 172.21.15.98:0/3432108334 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8400f450 con 0x7f0f94102660 2024-09-19T07:22:04.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.899+0000 7f0f98fbd640 1 -- 172.21.15.98:0/3432108334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f941a01b0 con 0x7f0f94102660 2024-09-19T07:22:04.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.900+0000 7f0f98fbd640 1 -- 172.21.15.98:0/3432108334 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f940fdcd0 con 0x7f0f94102660 2024-09-19T07:22:04.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.901+0000 7f0f837fe640 1 -- 172.21.15.98:0/3432108334 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f0f84005020 con 0x7f0f94102660 2024-09-19T07:22:04.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.902+0000 7f0f837fe640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0f7c0a3100 0x7f0f7c0a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:04.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.902+0000 7f0f91d9b640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0f7c0a3100 0x7f0f7c0a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:04.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.902+0000 7f0f837fe640 1 -- 172.21.15.98:0/3432108334 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0f840cf390 con 0x7f0f94102660 2024-09-19T07:22:04.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.902+0000 7f0f91d9b640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0f7c0a3100 0x7f0f7c0a55c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0f94199310 tx=0x7f0f8800b410 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:04.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:04.906+0000 7f0f837fe640 1 -- 172.21.15.98:0/3432108334 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0f84014030 con 0x7f0f94102660 2024-09-19T07:22:04.926 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T07:22:04.926 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: Active manager daemon x restarted 2024-09-19T07:22:04.926 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: Activating manager daemon x 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: mgrmap e20: x(active, starting, since 0.0110456s), standbys: z, y 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:22:04.927 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:22:04.928 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:22:04.928 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:22:04.928 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:22:04.928 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:22:04.928 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:22:04.928 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:22:04.928 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:22:04.928 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:22:04.928 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:22:04.928 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:22:04.928 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:22:04.928 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: Manager daemon x is now available 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:22:04.929 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:04 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2631405946' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T07:22:04.988 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T07:22:04.988 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: Active manager daemon x restarted 2024-09-19T07:22:04.988 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: Activating manager daemon x 2024-09-19T07:22:04.988 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T07:22:04.988 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: mgrmap e20: x(active, starting, since 0.0110456s), standbys: z, y 2024-09-19T07:22:04.988 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T07:22:04.988 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T07:22:04.988 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T07:22:04.988 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T07:22:04.988 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T07:22:04.988 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T07:22:04.988 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T07:22:04.989 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: Manager daemon x is now available 2024-09-19T07:22:04.990 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:04.991 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T07:22:04.991 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T07:22:04.991 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:04 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2631405946' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T07:22:05.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.108+0000 7f0f98fbd640 1 -- 172.21.15.98:0/3432108334 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f0f940626d0 con 0x7f0f7c0a3100 2024-09-19T07:22:05.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.123+0000 7f0f837fe640 1 -- 172.21.15.98:0/3432108334 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f0f940626d0 con 0x7f0f7c0a3100 2024-09-19T07:22:05.123 INFO:teuthology.orchestra.run.smithi098.stdout:{} 2024-09-19T07:22:05.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.125+0000 7f0f98fbd640 1 -- 172.21.15.98:0/3432108334 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0f7c0a3100 msgr2=0x7f0f7c0a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:05.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.125+0000 7f0f98fbd640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0f7c0a3100 0x7f0f7c0a55c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0f94199310 tx=0x7f0f8800b410 comp rx=0 tx=0).stop 2024-09-19T07:22:05.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.125+0000 7f0f98fbd640 1 -- 172.21.15.98:0/3432108334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f94102660 msgr2=0x7f0f94197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:05.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.125+0000 7f0f98fbd640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f94102660 0x7f0f94197e00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400c970 tx=0x7f0f8400ce30 comp rx=0 tx=0).stop 2024-09-19T07:22:05.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.125+0000 7f0f98fbd640 1 -- 172.21.15.98:0/3432108334 shutdown_connections 2024-09-19T07:22:05.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.125+0000 7f0f98fbd640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0f7c0a3100 0x7f0f7c0a55c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.125+0000 7f0f98fbd640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f941078c0 0x7f0f9419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.125+0000 7f0f98fbd640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f94104f90 0x7f0f94198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.125+0000 7f0f98fbd640 1 --2- 172.21.15.98:0/3432108334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f94102660 0x7f0f94197e00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.125+0000 7f0f98fbd640 1 -- 172.21.15.98:0/3432108334 >> 172.21.15.98:0/3432108334 conn(0x7f0f940fc1e0 msgr2=0x7f0f94102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:05.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.125+0000 7f0f98fbd640 1 -- 172.21.15.98:0/3432108334 shutdown_connections 2024-09-19T07:22:05.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.125+0000 7f0f98fbd640 1 -- 172.21.15.98:0/3432108334 wait complete. 2024-09-19T07:22:05.135 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T07:22:05.147 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T07:22:05.226 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T07:22:05.250 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:05.086+0000 7faf66a0d640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:07:22:05] ENGINE Error in HTTPServer.serve 2024-09-19T07:22:05.250 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: Traceback (most recent call last): 2024-09-19T07:22:05.250 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:22:05.251 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: self._connections.run(self.expiration_interval) 2024-09-19T07:22:05.251 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:22:05.251 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: self._run(expiration_interval) 2024-09-19T07:22:05.251 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:22:05.251 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:22:05.251 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:22:05.251 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:22:05.251 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:22:05.251 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: s = self.context.wrap_socket( 2024-09-19T07:22:05.251 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:22:05.251 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: return self.sslsocket_class._create( 2024-09-19T07:22:05.252 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:22:05.252 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: self.do_handshake() 2024-09-19T07:22:05.252 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:22:05.252 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: self._sslobj.do_handshake() 2024-09-19T07:22:05.252 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:22:05.252 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:05.252 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:05.112+0000 7faf7776e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:05.252 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:05.112+0000 7faf7776e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:05.252 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:05.112+0000 7faf7776e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:05.252 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:05.112+0000 7faf7776e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:05.252 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:22:05.112+0000 7faf7776e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:22:05.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.328+0000 7faab2798640 1 -- 172.21.15.98:0/173001601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaac104ee0 msgr2=0x7faaac1072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:05.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.328+0000 7faab2798640 1 --2- 172.21.15.98:0/173001601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaac104ee0 0x7faaac1072d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009900 tx=0x7faaa002a410 comp rx=0 tx=0).stop 2024-09-19T07:22:05.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.328+0000 7faab2798640 1 -- 172.21.15.98:0/173001601 shutdown_connections 2024-09-19T07:22:05.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.328+0000 7faab2798640 1 --2- 172.21.15.98:0/173001601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac107810 0x7faaac109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.328+0000 7faab2798640 1 --2- 172.21.15.98:0/173001601 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaac104ee0 0x7faaac1072d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.328+0000 7faab2798640 1 --2- 172.21.15.98:0/173001601 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaac1025b0 0x7faaac1049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.328+0000 7faab2798640 1 -- 172.21.15.98:0/173001601 >> 172.21.15.98:0/173001601 conn(0x7faaac0fc190 msgr2=0x7faaac0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:05.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.328+0000 7faab2798640 1 -- 172.21.15.98:0/173001601 shutdown_connections 2024-09-19T07:22:05.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.328+0000 7faab2798640 1 -- 172.21.15.98:0/173001601 wait complete. 2024-09-19T07:22:05.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab2798640 1 Processor -- start 2024-09-19T07:22:05.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab2798640 1 -- start start 2024-09-19T07:22:05.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab2798640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaac1025b0 0x7faaac197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:05.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab2798640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac104ee0 0x7faaac198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:05.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab2798640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaac107810 0x7faaac19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:05.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab2798640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faaac10d7f0 con 0x7faaac107810 2024-09-19T07:22:05.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab2798640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faaac10d670 con 0x7faaac1025b0 2024-09-19T07:22:05.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab2798640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faaac10d970 con 0x7faaac104ee0 2024-09-19T07:22:05.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab0d35640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaac107810 0x7faaac19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:05.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab0d35640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaac107810 0x7faaac19f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59798/0 (socket says 172.21.15.98:59798) 2024-09-19T07:22:05.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab0d35640 1 -- 172.21.15.98:0/1472819396 learned_addr learned my addr 172.21.15.98:0/1472819396 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:05.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faaabfff640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaac1025b0 0x7faaac197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:05.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faaab7fe640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac104ee0 0x7faaac198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab0d35640 1 -- 172.21.15.98:0/1472819396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac104ee0 msgr2=0x7faaac198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab0d35640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac104ee0 0x7faaac198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab0d35640 1 -- 172.21.15.98:0/1472819396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaac1025b0 msgr2=0x7faaac197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab0d35640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaac1025b0 0x7faaac197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab0d35640 1 -- 172.21.15.98:0/1472819396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac19fb60 con 0x7faaac107810 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faaabfff640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaac1025b0 0x7faaac197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.329+0000 7faab0d35640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaac107810 0x7faaac19f4f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faaa400eb40 tx=0x7faaa400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.330+0000 7faaa97fa640 1 -- 172.21.15.98:0/1472819396 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4004b20 con 0x7faaac107810 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.330+0000 7faaa97fa640 1 -- 172.21.15.98:0/1472819396 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaa4004cc0 con 0x7faaac107810 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.330+0000 7faab2798640 1 -- 172.21.15.98:0/1472819396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaac19fe50 con 0x7faaac107810 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.330+0000 7faaa97fa640 1 -- 172.21.15.98:0/1472819396 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4010850 con 0x7faaac107810 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.330+0000 7faab2798640 1 -- 172.21.15.98:0/1472819396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaac1a0310 con 0x7faaac107810 2024-09-19T07:22:05.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.331+0000 7faab2798640 1 -- 172.21.15.98:0/1472819396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaac0fdc80 con 0x7faaac107810 2024-09-19T07:22:05.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.332+0000 7faaa97fa640 1 -- 172.21.15.98:0/1472819396 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7faaa4005000 con 0x7faaac107810 2024-09-19T07:22:05.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.332+0000 7faaa97fa640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa940a3050 0x7faa940a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:05.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.333+0000 7faaa97fa640 1 -- 172.21.15.98:0/1472819396 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7faaa40cfee0 con 0x7faaac107810 2024-09-19T07:22:05.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.333+0000 7faaabfff640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa940a3050 0x7faa940a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:05.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.333+0000 7faaabfff640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa940a3050 0x7faa940a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009c20 tx=0x7faa9c005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:05.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.336+0000 7faaa97fa640 1 -- 172.21.15.98:0/1472819396 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faaa409cda0 con 0x7faaac107810 2024-09-19T07:22:05.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.531+0000 7faab2798640 1 -- 172.21.15.98:0/1472819396 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faaac02da10 con 0x7faaac107810 2024-09-19T07:22:05.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.533+0000 7faaa97fa640 1 -- 172.21.15.98:0/1472819396 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+23201 (secure 0 0 0) 0x7faaa409c6a0 con 0x7faaac107810 2024-09-19T07:22:05.534 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:05.534 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":81,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:22:03.757463+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:20:16.391879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:20:18.243837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/3732813400":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6801/2172632890":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/2271200719":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/617371908":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1543222160":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1123383068":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6800/2172632890":"2024-09-20T07:22:03.757428+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:22:05.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.536+0000 7faab2798640 1 -- 172.21.15.98:0/1472819396 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa940a3050 msgr2=0x7faa940a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:05.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.536+0000 7faab2798640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa940a3050 0x7faa940a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009c20 tx=0x7faa9c005f90 comp rx=0 tx=0).stop 2024-09-19T07:22:05.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.536+0000 7faab2798640 1 -- 172.21.15.98:0/1472819396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaac107810 msgr2=0x7faaac19f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:05.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.536+0000 7faab2798640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaac107810 0x7faaac19f4f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faaa400eb40 tx=0x7faaa400c2d0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.536+0000 7faab2798640 1 -- 172.21.15.98:0/1472819396 shutdown_connections 2024-09-19T07:22:05.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.536+0000 7faab2798640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa940a3050 0x7faa940a5510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.536+0000 7faab2798640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faaac107810 0x7faaac19f4f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.536+0000 7faab2798640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac104ee0 0x7faaac198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.536+0000 7faab2798640 1 --2- 172.21.15.98:0/1472819396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaac1025b0 0x7faaac197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.536+0000 7faab2798640 1 -- 172.21.15.98:0/1472819396 >> 172.21.15.98:0/1472819396 conn(0x7faaac0fc190 msgr2=0x7faaac102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:05.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.536+0000 7faab2798640 1 -- 172.21.15.98:0/1472819396 shutdown_connections 2024-09-19T07:22:05.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.536+0000 7faab2798640 1 -- 172.21.15.98:0/1472819396 wait complete. 2024-09-19T07:22:05.548 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T07:15:50.874894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T07:20:16.391879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T07:20:18.243837+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T07:22:05.549 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T07:22:05.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.700+0000 7fc5104f1640 1 -- 172.21.15.98:0/2133394194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5081077f0 msgr2=0x7fc508109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:05.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.700+0000 7fc5104f1640 1 --2- 172.21.15.98:0/2133394194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5081077f0 0x7fc508109c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc500009be0 tx=0x7fc50002a6c0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.700+0000 7fc5104f1640 1 -- 172.21.15.98:0/2133394194 shutdown_connections 2024-09-19T07:22:05.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.700+0000 7fc5104f1640 1 --2- 172.21.15.98:0/2133394194 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc5081077f0 0x7fc508109c60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.700+0000 7fc5104f1640 1 --2- 172.21.15.98:0/2133394194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc508104ec0 0x7fc5081072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.703 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.700+0000 7fc5104f1640 1 --2- 172.21.15.98:0/2133394194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc508102590 0x7fc508104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.700+0000 7fc5104f1640 1 -- 172.21.15.98:0/2133394194 >> 172.21.15.98:0/2133394194 conn(0x7fc5080fc1b0 msgr2=0x7fc5080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.700+0000 7fc5104f1640 1 -- 172.21.15.98:0/2133394194 shutdown_connections 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.700+0000 7fc5104f1640 1 -- 172.21.15.98:0/2133394194 wait complete. 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc5104f1640 1 Processor -- start 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc5104f1640 1 -- start start 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc5104f1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc508102590 0x7fc508101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc5104f1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508104ec0 0x7fc508100540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc5104f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5081077f0 0x7fc508100a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc5104f1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc50810d780 con 0x7fc508102590 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc5104f1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc50810d600 con 0x7fc508104ec0 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc5104f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc50810d900 con 0x7fc5081077f0 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc50e28d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc508102590 0x7fc508101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:05.704 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc50e28d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc508102590 0x7fc508101f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59818/0 (socket says 172.21.15.98:59818) 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc50e28d640 1 -- 172.21.15.98:0/3801754741 learned_addr learned my addr 172.21.15.98:0/3801754741 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc50da8c640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508104ec0 0x7fc508100540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc50ea8e640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5081077f0 0x7fc508100a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc50e28d640 1 -- 172.21.15.98:0/3801754741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5081077f0 msgr2=0x7fc508100a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc50e28d640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5081077f0 0x7fc508100a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc50e28d640 1 -- 172.21.15.98:0/3801754741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508104ec0 msgr2=0x7fc508100540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc50e28d640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508104ec0 0x7fc508100540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc50e28d640 1 -- 172.21.15.98:0/3801754741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc508101310 con 0x7fc508102590 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.701+0000 7fc50da8c640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508104ec0 0x7fc508100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.702+0000 7fc50e28d640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc508102590 0x7fc508101f00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e9f0 tx=0x7fc50400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.702+0000 7fc4fb7fe640 1 -- 172.21.15.98:0/3801754741 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50400ccc0 con 0x7fc508102590 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.702+0000 7fc4fb7fe640 1 -- 172.21.15.98:0/3801754741 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc50400ce60 con 0x7fc508102590 2024-09-19T07:22:05.705 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.702+0000 7fc5104f1640 1 -- 172.21.15.98:0/3801754741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5081a1fe0 con 0x7fc508102590 2024-09-19T07:22:05.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.702+0000 7fc4fb7fe640 1 -- 172.21.15.98:0/3801754741 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504010690 con 0x7fc508102590 2024-09-19T07:22:05.706 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.702+0000 7fc5104f1640 1 -- 172.21.15.98:0/3801754741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5081a23f0 con 0x7fc508102590 2024-09-19T07:22:05.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.703+0000 7fc5104f1640 1 -- 172.21.15.98:0/3801754741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5080fdca0 con 0x7fc508102590 2024-09-19T07:22:05.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.705+0000 7fc4fb7fe640 1 -- 172.21.15.98:0/3801754741 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7fc5040046c0 con 0x7fc508102590 2024-09-19T07:22:05.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.706+0000 7fc4fb7fe640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc4f40a3050 0x7fc4f40a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:05.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.706+0000 7fc4fb7fe640 1 -- 172.21.15.98:0/3801754741 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc5040cfa30 con 0x7fc508102590 2024-09-19T07:22:05.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.706+0000 7fc50da8c640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc4f40a3050 0x7fc4f40a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:05.707 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.706+0000 7fc50da8c640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc4f40a3050 0x7fc4f40a5510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc508101c70 tx=0x7fc4fc009260 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:05.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.713+0000 7fc4fb7fe640 1 -- 172.21.15.98:0/3801754741 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc50409c8f0 con 0x7fc508102590 2024-09-19T07:22:05.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.795+0000 7fc4fb7fe640 1 -- 172.21.15.98:0/3801754741 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 22) ==== 138526+0+0 (secure 0 0 0) 0x7fc504098860 con 0x7fc508102590 2024-09-19T07:22:05.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.935+0000 7fc5104f1640 1 -- 172.21.15.98:0/3801754741 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc508062e60 con 0x7fc508102590 2024-09-19T07:22:05.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.935+0000 7fc4fb7fe640 1 -- 172.21.15.98:0/3801754741 <== mon.0 v2:172.21.15.98:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fc50405cc00 con 0x7fc508102590 2024-09-19T07:22:05.936 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2024-09-19T07:22:05.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.937+0000 7fc5104f1640 1 -- 172.21.15.98:0/3801754741 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc4f40a3050 msgr2=0x7fc4f40a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:05.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.937+0000 7fc5104f1640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc4f40a3050 0x7fc4f40a5510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc508101c70 tx=0x7fc4fc009260 comp rx=0 tx=0).stop 2024-09-19T07:22:05.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.937+0000 7fc5104f1640 1 -- 172.21.15.98:0/3801754741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc508102590 msgr2=0x7fc508101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:05.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.937+0000 7fc5104f1640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc508102590 0x7fc508101f00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e9f0 tx=0x7fc50400edf0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.937+0000 7fc5104f1640 1 -- 172.21.15.98:0/3801754741 shutdown_connections 2024-09-19T07:22:05.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.937+0000 7fc5104f1640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc4f40a3050 0x7fc4f40a5510 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.937+0000 7fc5104f1640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5081077f0 0x7fc508100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.937+0000 7fc5104f1640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508104ec0 0x7fc508100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.937+0000 7fc5104f1640 1 --2- 172.21.15.98:0/3801754741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc508102590 0x7fc508101f00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:05.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.937+0000 7fc5104f1640 1 -- 172.21.15.98:0/3801754741 >> 172.21.15.98:0/3801754741 conn(0x7fc5080fc1b0 msgr2=0x7fc508103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:05.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.937+0000 7fc5104f1640 1 -- 172.21.15.98:0/3801754741 shutdown_connections 2024-09-19T07:22:05.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:05.937+0000 7fc5104f1640 1 -- 172.21.15.98:0/3801754741 wait complete. 2024-09-19T07:22:05.948 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-mon[30950]: mgrmap e21: x(active, since 1.0204s), standbys: z, y 2024-09-19T07:22:05.948 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2631405946' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T07:22:05.948 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:22:05.948 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-mon[30950]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:22:05.948 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:05 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1472819396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:22:05.949 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T07:22:06.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.051+0000 7fa2cf95b640 1 -- 172.21.15.98:0/3358842617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c8102580 msgr2=0x7fa2c8104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:06.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.051+0000 7fa2cf95b640 1 --2- 172.21.15.98:0/3358842617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c8102580 0x7fa2c8104970 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009900 tx=0x7fa2bc02a410 comp rx=0 tx=0).stop 2024-09-19T07:22:06.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.051+0000 7fa2cf95b640 1 -- 172.21.15.98:0/3358842617 shutdown_connections 2024-09-19T07:22:06.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.051+0000 7fa2cf95b640 1 --2- 172.21.15.98:0/3358842617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2c81077e0 0x7fa2c8109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.051+0000 7fa2cf95b640 1 --2- 172.21.15.98:0/3358842617 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2c8104eb0 0x7fa2c81072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.051+0000 7fa2cf95b640 1 --2- 172.21.15.98:0/3358842617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c8102580 0x7fa2c8104970 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.054 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.051+0000 7fa2cf95b640 1 -- 172.21.15.98:0/3358842617 >> 172.21.15.98:0/3358842617 conn(0x7fa2c80fc140 msgr2=0x7fa2c80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cf95b640 1 -- 172.21.15.98:0/3358842617 shutdown_connections 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cf95b640 1 -- 172.21.15.98:0/3358842617 wait complete. 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cf95b640 1 Processor -- start 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cf95b640 1 -- start start 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cf95b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c8102580 0x7fa2c8197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cf95b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2c8104eb0 0x7fa2c81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cf95b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2c81077e0 0x7fa2c819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cf95b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c810d7f0 con 0x7fa2c8102580 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cf95b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c810d670 con 0x7fa2c81077e0 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cf95b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c810d970 con 0x7fa2c8104eb0 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cd6f7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c8102580 0x7fa2c8197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cd6f7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c8102580 0x7fa2c8197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59838/0 (socket says 172.21.15.98:59838) 2024-09-19T07:22:06.055 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2cd6f7640 1 -- 172.21.15.98:0/1044995089 learned_addr learned my addr 172.21.15.98:0/1044995089 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:06.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.052+0000 7fa2ccef6640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2c8104eb0 0x7fa2c81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:06.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.053+0000 7fa2cdef8640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2c81077e0 0x7fa2c819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:06.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.053+0000 7fa2cd6f7640 1 -- 172.21.15.98:0/1044995089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2c8104eb0 msgr2=0x7fa2c81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:06.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.053+0000 7fa2cd6f7640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2c8104eb0 0x7fa2c81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.053+0000 7fa2cd6f7640 1 -- 172.21.15.98:0/1044995089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2c81077e0 msgr2=0x7fa2c819f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:06.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.053+0000 7fa2cd6f7640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2c81077e0 0x7fa2c819f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.053+0000 7fa2cd6f7640 1 -- 172.21.15.98:0/1044995089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c819fad0 con 0x7fa2c8102580 2024-09-19T07:22:06.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.053+0000 7fa2cd6f7640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c8102580 0x7fa2c8197eb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009230 tx=0x7fa2bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:06.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.053+0000 7fa2ba7fc640 1 -- 172.21.15.98:0/1044995089 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc03f030 con 0x7fa2c8102580 2024-09-19T07:22:06.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.053+0000 7fa2cf95b640 1 -- 172.21.15.98:0/1044995089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c819fd60 con 0x7fa2c8102580 2024-09-19T07:22:06.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.053+0000 7fa2ba7fc640 1 -- 172.21.15.98:0/1044995089 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2bc003ce0 con 0x7fa2c8102580 2024-09-19T07:22:06.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.053+0000 7fa2ba7fc640 1 -- 172.21.15.98:0/1044995089 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc035070 con 0x7fa2c8102580 2024-09-19T07:22:06.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.053+0000 7fa2cf95b640 1 -- 172.21.15.98:0/1044995089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c81a01e0 con 0x7fa2c8102580 2024-09-19T07:22:06.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.054+0000 7fa2cf95b640 1 -- 172.21.15.98:0/1044995089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2c80fdc30 con 0x7fa2c8102580 2024-09-19T07:22:06.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.055+0000 7fa2ba7fc640 1 -- 172.21.15.98:0/1044995089 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 22) ==== 138526+0+0 (secure 0 0 0) 0x7fa2bc042030 con 0x7fa2c8102580 2024-09-19T07:22:06.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.056+0000 7fa2ba7fc640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fa2b40a3450 0x7fa2b40a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:06.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.056+0000 7fa2ba7fc640 1 -- 172.21.15.98:0/1044995089 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fa2bc0f0350 con 0x7fa2c8102580 2024-09-19T07:22:06.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.056+0000 7fa2ccef6640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fa2b40a3450 0x7fa2b40a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:06.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.056+0000 7fa2ccef6640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fa2b40a3450 0x7fa2b40a5910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa2c81993c0 tx=0x7fa2c4005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:06.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.060+0000 7fa2ba7fc640 1 -- 172.21.15.98:0/1044995089 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa2bc0bc540 con 0x7fa2c8102580 2024-09-19T07:22:06.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:05 smithi139 ceph-mon[35039]: mgrmap e21: x(active, since 1.0204s), standbys: z, y 2024-09-19T07:22:06.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:05 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2631405946' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T07:22:06.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:05 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:22:06.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:05 smithi139 ceph-mon[35039]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:22:06.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:05 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1472819396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:22:06.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:05 smithi162 ceph-mon[35726]: mgrmap e21: x(active, since 1.0204s), standbys: z, y 2024-09-19T07:22:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:05 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2631405946' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T07:22:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:05 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:22:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:05 smithi162 ceph-mon[35726]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:22:06.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:05 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1472819396' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:22:06.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.236+0000 7fa2cf95b640 1 -- 172.21.15.98:0/1044995089 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa2c802d970 con 0x7fa2c8102580 2024-09-19T07:22:06.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.237+0000 7fa2ba7fc640 1 -- 172.21.15.98:0/1044995089 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7fa2bc0c0840 con 0x7fa2c8102580 2024-09-19T07:22:06.237 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 32 2024-09-19T07:22:06.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.239+0000 7fa2cf95b640 1 -- 172.21.15.98:0/1044995089 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fa2b40a3450 msgr2=0x7fa2b40a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:06.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.239+0000 7fa2cf95b640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fa2b40a3450 0x7fa2b40a5910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa2c81993c0 tx=0x7fa2c4005f90 comp rx=0 tx=0).stop 2024-09-19T07:22:06.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.239+0000 7fa2cf95b640 1 -- 172.21.15.98:0/1044995089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c8102580 msgr2=0x7fa2c8197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:06.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.239+0000 7fa2cf95b640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c8102580 0x7fa2c8197eb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc009230 tx=0x7fa2bc0042f0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.239+0000 7fa2cf95b640 1 -- 172.21.15.98:0/1044995089 shutdown_connections 2024-09-19T07:22:06.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.239+0000 7fa2cf95b640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fa2b40a3450 0x7fa2b40a5910 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.239+0000 7fa2cf95b640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2c81077e0 0x7fa2c819f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.239+0000 7fa2cf95b640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2c8104eb0 0x7fa2c81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.239+0000 7fa2cf95b640 1 --2- 172.21.15.98:0/1044995089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c8102580 0x7fa2c8197eb0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.239+0000 7fa2cf95b640 1 -- 172.21.15.98:0/1044995089 >> 172.21.15.98:0/1044995089 conn(0x7fa2c80fc140 msgr2=0x7fa2c8103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:06.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.239+0000 7fa2cf95b640 1 -- 172.21.15.98:0/1044995089 shutdown_connections 2024-09-19T07:22:06.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.239+0000 7fa2cf95b640 1 -- 172.21.15.98:0/1044995089 wait complete. 2024-09-19T07:22:06.251 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T07:22:06.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.356+0000 7f9118bfd640 1 -- 172.21.15.98:0/3180591330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141025b0 msgr2=0x7f9114108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:06.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.356+0000 7f9118bfd640 1 --2- 172.21.15.98:0/3180591330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141025b0 0x7f9114108e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f910c009ca0 tx=0x7f910c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.357+0000 7f9118bfd640 1 -- 172.21.15.98:0/3180591330 shutdown_connections 2024-09-19T07:22:06.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.357+0000 7f9118bfd640 1 --2- 172.21.15.98:0/3180591330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141025b0 0x7f9114108e40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.357+0000 7f9118bfd640 1 --2- 172.21.15.98:0/3180591330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9114101bf0 0x7f9114102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.357+0000 7f9118bfd640 1 --2- 172.21.15.98:0/3180591330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9114100a00 0x7f9114100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.357+0000 7f9118bfd640 1 -- 172.21.15.98:0/3180591330 >> 172.21.15.98:0/3180591330 conn(0x7f91140fc140 msgr2=0x7f91140fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:06.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.357+0000 7f9118bfd640 1 -- 172.21.15.98:0/3180591330 shutdown_connections 2024-09-19T07:22:06.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.357+0000 7f9118bfd640 1 -- 172.21.15.98:0/3180591330 wait complete. 2024-09-19T07:22:06.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.357+0000 7f9118bfd640 1 Processor -- start 2024-09-19T07:22:06.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9118bfd640 1 -- start start 2024-09-19T07:22:06.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9118bfd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9114100a00 0x7f9114069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:06.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9118bfd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9114101bf0 0x7f911419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:06.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9118bfd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141025b0 0x7f911419f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:06.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9118bfd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f911410c660 con 0x7f91141025b0 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9118bfd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f911410c4e0 con 0x7f9114101bf0 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9118bfd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f911410c7e0 con 0x7f9114100a00 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9112d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141025b0 0x7f911419f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9112d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141025b0 0x7f911419f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59856/0 (socket says 172.21.15.98:59856) 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f911259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9114100a00 0x7f9114069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9112d9d640 1 -- 172.21.15.98:0/3549700209 learned_addr learned my addr 172.21.15.98:0/3549700209 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f910bfff640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9114101bf0 0x7f911419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9112d9d640 1 -- 172.21.15.98:0/3549700209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9114100a00 msgr2=0x7f9114069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9112d9d640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9114100a00 0x7f9114069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9112d9d640 1 -- 172.21.15.98:0/3549700209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9114101bf0 msgr2=0x7f911419cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9112d9d640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9114101bf0 0x7f911419cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9112d9d640 1 -- 172.21.15.98:0/3549700209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911419fa90 con 0x7f91141025b0 2024-09-19T07:22:06.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f911259c640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9114100a00 0x7f9114069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:06.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.358+0000 7f9112d9d640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141025b0 0x7f911419f180 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f910c031ae0 tx=0x7f910c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:06.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.359+0000 7f910b7fe640 1 -- 172.21.15.98:0/3549700209 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c003c30 con 0x7f91141025b0 2024-09-19T07:22:06.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.359+0000 7f910b7fe640 1 -- 172.21.15.98:0/3549700209 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f910c003dd0 con 0x7f91141025b0 2024-09-19T07:22:06.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.359+0000 7f9118bfd640 1 -- 172.21.15.98:0/3549700209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f911419fcc0 con 0x7f91141025b0 2024-09-19T07:22:06.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.359+0000 7f910b7fe640 1 -- 172.21.15.98:0/3549700209 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c02fcb0 con 0x7f91141025b0 2024-09-19T07:22:06.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.359+0000 7f9118bfd640 1 -- 172.21.15.98:0/3549700209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91141a01c0 con 0x7f91141025b0 2024-09-19T07:22:06.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.360+0000 7f9118bfd640 1 -- 172.21.15.98:0/3549700209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9114107df0 con 0x7f91141025b0 2024-09-19T07:22:06.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.361+0000 7f910b7fe640 1 -- 172.21.15.98:0/3549700209 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 22) ==== 138526+0+0 (secure 0 0 0) 0x7f910c004050 con 0x7f91141025b0 2024-09-19T07:22:06.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.362+0000 7f910b7fe640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f91000a3450 0x7f91000a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:06.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.362+0000 7f911259c640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f91000a3450 0x7f91000a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:06.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.362+0000 7f910b7fe640 1 -- 172.21.15.98:0/3549700209 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f910c0f0ff0 con 0x7f91141025b0 2024-09-19T07:22:06.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.362+0000 7f911259c640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f91000a3450 0x7f91000a5910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9114101a50 tx=0x7f9104005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:06.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.366+0000 7f910b7fe640 1 -- 172.21.15.98:0/3549700209 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f910c0bd940 con 0x7f91141025b0 2024-09-19T07:22:06.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.553+0000 7f9118bfd640 1 -- 172.21.15.98:0/3549700209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f911402da10 con 0x7f91141025b0 2024-09-19T07:22:06.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.553+0000 7f910b7fe640 1 -- 172.21.15.98:0/3549700209 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7f910c0bd240 con 0x7f91141025b0 2024-09-19T07:22:06.554 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2024-09-19T07:22:06.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.555+0000 7f9118bfd640 1 -- 172.21.15.98:0/3549700209 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f91000a3450 msgr2=0x7f91000a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:06.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.555+0000 7f9118bfd640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f91000a3450 0x7f91000a5910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9114101a50 tx=0x7f9104005f90 comp rx=0 tx=0).stop 2024-09-19T07:22:06.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.555+0000 7f9118bfd640 1 -- 172.21.15.98:0/3549700209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141025b0 msgr2=0x7f911419f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:06.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.555+0000 7f9118bfd640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141025b0 0x7f911419f180 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f910c031ae0 tx=0x7f910c031ee0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.555+0000 7f9118bfd640 1 -- 172.21.15.98:0/3549700209 shutdown_connections 2024-09-19T07:22:06.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.555+0000 7f9118bfd640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f91000a3450 0x7f91000a5910 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.555+0000 7f9118bfd640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91141025b0 0x7f911419f180 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.555+0000 7f9118bfd640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9114101bf0 0x7f911419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.555+0000 7f9118bfd640 1 --2- 172.21.15.98:0/3549700209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9114100a00 0x7f9114069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:06.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.555+0000 7f9118bfd640 1 -- 172.21.15.98:0/3549700209 >> 172.21.15.98:0/3549700209 conn(0x7f91140fc140 msgr2=0x7f9114104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:06.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.555+0000 7f9118bfd640 1 -- 172.21.15.98:0/3549700209 shutdown_connections 2024-09-19T07:22:06.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:06.555+0000 7f9118bfd640 1 -- 172.21.15.98:0/3549700209 wait complete. 2024-09-19T07:22:06.567 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T07:22:06.567 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:22:06.859 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:06.981 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: [19/Sep/2024:07:22:04] ENGINE Bus STARTING 2024-09-19T07:22:06.981 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: [19/Sep/2024:07:22:05] ENGINE Serving on https://172.21.15.98:7150 2024-09-19T07:22:06.981 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: [19/Sep/2024:07:22:05] ENGINE Error in HTTPServer.serve 2024-09-19T07:22:06.981 INFO:journalctl@ceph.mon.a.smithi098.stdout: Traceback (most recent call last): 2024-09-19T07:22:06.981 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:22:06.981 INFO:journalctl@ceph.mon.a.smithi098.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:22:06.981 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:22:06.981 INFO:journalctl@ceph.mon.a.smithi098.stdout: self._run(expiration_interval) 2024-09-19T07:22:06.981 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:22:06.981 INFO:journalctl@ceph.mon.a.smithi098.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout: s = self.context.wrap_socket( 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout: return self.sslsocket_class._create( 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout: self.do_handshake() 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout: self._sslobj.do_handshake() 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: [19/Sep/2024:07:22:05] ENGINE Serving on http://172.21.15.98:8765 2024-09-19T07:22:06.982 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: [19/Sep/2024:07:22:05] ENGINE Bus STARTED 2024-09-19T07:22:06.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:22:06.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-19T07:22:06.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:06.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:06.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:06.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:06.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:06.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:06.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3801754741' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:22:06.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1044995089' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:22:06.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:06.983 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:06.984 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:06.985 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:06.985 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:06.985 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:06.985 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:06.985 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:06.985 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:06 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3549700209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:22:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: [19/Sep/2024:07:22:04] ENGINE Bus STARTING 2024-09-19T07:22:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: [19/Sep/2024:07:22:05] ENGINE Serving on https://172.21.15.98:7150 2024-09-19T07:22:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: [19/Sep/2024:07:22:05] ENGINE Error in HTTPServer.serve 2024-09-19T07:22:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout: Traceback (most recent call last): 2024-09-19T07:22:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:22:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:22:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:22:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout: self._run(expiration_interval) 2024-09-19T07:22:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:22:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:22:07.067 INFO:journalctl@ceph.mon.b.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:22:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:22:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:22:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout: s = self.context.wrap_socket( 2024-09-19T07:22:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:22:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout: return self.sslsocket_class._create( 2024-09-19T07:22:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:22:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout: self.do_handshake() 2024-09-19T07:22:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:22:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout: self._sslobj.do_handshake() 2024-09-19T07:22:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:22:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:07.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: [19/Sep/2024:07:22:05] ENGINE Serving on http://172.21.15.98:8765 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: [19/Sep/2024:07:22:05] ENGINE Bus STARTED 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3801754741' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1044995089' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:07.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:07.071 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:06 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3549700209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:22:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: [19/Sep/2024:07:22:04] ENGINE Bus STARTING 2024-09-19T07:22:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: [19/Sep/2024:07:22:05] ENGINE Serving on https://172.21.15.98:7150 2024-09-19T07:22:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: [19/Sep/2024:07:22:05] ENGINE Error in HTTPServer.serve 2024-09-19T07:22:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout: Traceback (most recent call last): 2024-09-19T07:22:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T07:22:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout: self._connections.run(self.expiration_interval) 2024-09-19T07:22:07.132 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T07:22:07.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: self._run(expiration_interval) 2024-09-19T07:22:07.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T07:22:07.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T07:22:07.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T07:22:07.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T07:22:07.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T07:22:07.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: s = self.context.wrap_socket( 2024-09-19T07:22:07.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T07:22:07.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: return self.sslsocket_class._create( 2024-09-19T07:22:07.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T07:22:07.133 INFO:journalctl@ceph.mon.c.smithi162.stdout: self.do_handshake() 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: self._sslobj.do_handshake() 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: [19/Sep/2024:07:22:05] ENGINE Serving on http://172.21.15.98:8765 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: [19/Sep/2024:07:22:05] ENGINE Bus STARTED 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3801754741' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1044995089' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:07.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:22:07.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:07.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:07.136 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:06 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3549700209' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.449+0000 7fceca9d1640 1 -- 172.21.15.98:0/3339301611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec4102d40 msgr2=0x7fcec4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.449+0000 7fceca9d1640 1 --2- 172.21.15.98:0/3339301611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec4102d40 0x7fcec4103120 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009900 tx=0x7fceb402a480 comp rx=0 tx=0).stop 2024-09-19T07:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.449+0000 7fceca9d1640 1 -- 172.21.15.98:0/3339301611 shutdown_connections 2024-09-19T07:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.449+0000 7fceca9d1640 1 --2- 172.21.15.98:0/3339301611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcec410c170 0x7fcec410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.449+0000 7fceca9d1640 1 --2- 172.21.15.98:0/3339301611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcec4103660 0x7fcec410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.449+0000 7fceca9d1640 1 --2- 172.21.15.98:0/3339301611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec4102d40 0x7fcec4103120 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:07.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.449+0000 7fceca9d1640 1 -- 172.21.15.98:0/3339301611 >> 172.21.15.98:0/3339301611 conn(0x7fcec40fc7a0 msgr2=0x7fcec40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.449+0000 7fceca9d1640 1 -- 172.21.15.98:0/3339301611 shutdown_connections 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.449+0000 7fceca9d1640 1 -- 172.21.15.98:0/3339301611 wait complete. 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fceca9d1640 1 Processor -- start 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fceca9d1640 1 -- start start 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fceca9d1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcec4102d40 0x7fcec4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fceca9d1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec4103660 0x7fcec4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fceca9d1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcec410c170 0x7fcec419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fceca9d1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4111f70 con 0x7fcec4103660 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fceca9d1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4111df0 con 0x7fcec4102d40 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fceca9d1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcec41120f0 con 0x7fcec410c170 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fcec37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec4103660 0x7fcec4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fcec37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec4103660 0x7fcec4198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59866/0 (socket says 172.21.15.98:59866) 2024-09-19T07:22:07.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fcec37fe640 1 -- 172.21.15.98:0/3047778698 learned_addr learned my addr 172.21.15.98:0/3047778698 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fcec3fff640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcec4102d40 0x7fcec4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.450+0000 7fcec8f6e640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcec410c170 0x7fcec419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.451+0000 7fcec37fe640 1 -- 172.21.15.98:0/3047778698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcec410c170 msgr2=0x7fcec419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.451+0000 7fcec37fe640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcec410c170 0x7fcec419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.451+0000 7fcec37fe640 1 -- 172.21.15.98:0/3047778698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcec4102d40 msgr2=0x7fcec4198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.451+0000 7fcec37fe640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcec4102d40 0x7fcec4198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.451+0000 7fcec37fe640 1 -- 172.21.15.98:0/3047778698 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec419d3e0 con 0x7fcec4103660 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.451+0000 7fcec37fe640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec4103660 0x7fcec4198970 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fceb800d740 tx=0x7fceb800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.451+0000 7fcec17fa640 1 -- 172.21.15.98:0/3047778698 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8017070 con 0x7fcec4103660 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.451+0000 7fceca9d1640 1 -- 172.21.15.98:0/3047778698 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec419d6d0 con 0x7fcec4103660 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.451+0000 7fcec17fa640 1 -- 172.21.15.98:0/3047778698 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fceb800de50 con 0x7fcec4103660 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.451+0000 7fcec17fa640 1 -- 172.21.15.98:0/3047778698 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb800f620 con 0x7fcec4103660 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.451+0000 7fceca9d1640 1 -- 172.21.15.98:0/3047778698 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec41a4fb0 con 0x7fcec4103660 2024-09-19T07:22:07.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.452+0000 7fceca9d1640 1 -- 172.21.15.98:0/3047778698 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec4103120 con 0x7fcec4103660 2024-09-19T07:22:07.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.454+0000 7fcec17fa640 1 -- 172.21.15.98:0/3047778698 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 22) ==== 138526+0+0 (secure 0 0 0) 0x7fceb8009c30 con 0x7fcec4103660 2024-09-19T07:22:07.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.455+0000 7fcec17fa640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fceac0a3440 0x7fceac0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:07.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.455+0000 7fcec3fff640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fceac0a3440 0x7fceac0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:07.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.455+0000 7fcec17fa640 1 -- 172.21.15.98:0/3047778698 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fceb80cfa30 con 0x7fcec4103660 2024-09-19T07:22:07.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.455+0000 7fcec3fff640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fceac0a3440 0x7fceac0a5900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009230 tx=0x7fceb40058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:07.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.463+0000 7fcec17fa640 1 -- 172.21.15.98:0/3047778698 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fceb809bc20 con 0x7fcec4103660 2024-09-19T07:22:07.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.676+0000 7fceca9d1640 1 -- 172.21.15.98:0/3047778698 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcec4107270 con 0x7fcec4103660 2024-09-19T07:22:07.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.676+0000 7fcec17fa640 1 -- 172.21.15.98:0/3047778698 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7fceb809ff20 con 0x7fcec4103660 2024-09-19T07:22:07.677 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:07.678 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:22:07.678 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:22:07.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.678+0000 7fceca9d1640 1 -- 172.21.15.98:0/3047778698 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fceac0a3440 msgr2=0x7fceac0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:07.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.678+0000 7fceca9d1640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fceac0a3440 0x7fceac0a5900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009230 tx=0x7fceb40058d0 comp rx=0 tx=0).stop 2024-09-19T07:22:07.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.678+0000 7fceca9d1640 1 -- 172.21.15.98:0/3047778698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec4103660 msgr2=0x7fcec4198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:07.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.678+0000 7fceca9d1640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec4103660 0x7fcec4198970 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fceb800d740 tx=0x7fceb800dc00 comp rx=0 tx=0).stop 2024-09-19T07:22:07.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.679+0000 7fceca9d1640 1 -- 172.21.15.98:0/3047778698 shutdown_connections 2024-09-19T07:22:07.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.679+0000 7fceca9d1640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fceac0a3440 0x7fceac0a5900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:07.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.679+0000 7fceca9d1640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcec410c170 0x7fcec419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:07.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.679+0000 7fceca9d1640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcec4103660 0x7fcec4198970 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:07.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.679+0000 7fceca9d1640 1 --2- 172.21.15.98:0/3047778698 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcec4102d40 0x7fcec4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:07.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.679+0000 7fceca9d1640 1 -- 172.21.15.98:0/3047778698 >> 172.21.15.98:0/3047778698 conn(0x7fcec40fc7a0 msgr2=0x7fcec40fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:07.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.679+0000 7fceca9d1640 1 -- 172.21.15.98:0/3047778698 shutdown_connections 2024-09-19T07:22:07.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:07.679+0000 7fceca9d1640 1 -- 172.21.15.98:0/3047778698 wait complete. 2024-09-19T07:22:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi139 to 176.0M 2024-09-19T07:22:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: Unable to set osd_memory_target on smithi139 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-19T07:22:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-19T07:22:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: Unable to set osd_memory_target on smithi162 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-19T07:22:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi098 to 176.0M 2024-09-19T07:22:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: Unable to set osd_memory_target on smithi098 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3047778698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:08.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:08.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:07 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi139 to 176.0M 2024-09-19T07:22:08.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: Unable to set osd_memory_target on smithi139 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: Unable to set osd_memory_target on smithi162 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi098 to 176.0M 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: Unable to set osd_memory_target on smithi098 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3047778698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:08.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:08.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:08.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:08.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:07 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi139 to 176.0M 2024-09-19T07:22:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: Unable to set osd_memory_target on smithi139 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-19T07:22:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-19T07:22:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: Unable to set osd_memory_target on smithi162 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-19T07:22:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi098 to 176.0M 2024-09-19T07:22:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: Unable to set osd_memory_target on smithi098 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-19T07:22:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-19T07:22:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: Updating smithi139:/etc/ceph/ceph.conf 2024-09-19T07:22:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: Updating smithi162:/etc/ceph/ceph.conf 2024-09-19T07:22:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3047778698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:08.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:08.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:08.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:08.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:07 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:08.442 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T07:22:08.442 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T07:22:08.442 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T07:22:08.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.543+0000 7f3b2d95f640 1 -- 172.21.15.98:0/608645222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28101aa0 msgr2=0x7f3b28101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:08.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.543+0000 7f3b2d95f640 1 --2- 172.21.15.98:0/608645222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28101aa0 0x7f3b28101f00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009930 tx=0x7f3b1002a420 comp rx=0 tx=0).stop 2024-09-19T07:22:08.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.543+0000 7f3b2d95f640 1 -- 172.21.15.98:0/608645222 shutdown_connections 2024-09-19T07:22:08.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.543+0000 7f3b2d95f640 1 --2- 172.21.15.98:0/608645222 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b28102440 0x7f3b2810e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.543+0000 7f3b2d95f640 1 --2- 172.21.15.98:0/608645222 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28101aa0 0x7f3b28101f00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.543+0000 7f3b2d95f640 1 --2- 172.21.15.98:0/608645222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b28107ab0 0x7f3b28107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.543+0000 7f3b2d95f640 1 -- 172.21.15.98:0/608645222 >> 172.21.15.98:0/608645222 conn(0x7f3b280fd7c0 msgr2=0x7f3b280ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:08.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.543+0000 7f3b2d95f640 1 -- 172.21.15.98:0/608645222 shutdown_connections 2024-09-19T07:22:08.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.543+0000 7f3b2d95f640 1 -- 172.21.15.98:0/608645222 wait complete. 2024-09-19T07:22:08.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.544+0000 7f3b2d95f640 1 Processor -- start 2024-09-19T07:22:08.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.544+0000 7f3b2d95f640 1 -- start start 2024-09-19T07:22:08.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.544+0000 7f3b2d95f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b28101aa0 0x7f3b28198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:08.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.544+0000 7f3b2d95f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b28102440 0x7f3b281989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:08.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.544+0000 7f3b2d95f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28107ab0 0x7f3b2819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:08.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.544+0000 7f3b2d95f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3b28111eb0 con 0x7f3b28107ab0 2024-09-19T07:22:08.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.544+0000 7f3b2d95f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3b28111d30 con 0x7f3b28101aa0 2024-09-19T07:22:08.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.544+0000 7f3b2d95f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b28112030 con 0x7f3b28102440 2024-09-19T07:22:08.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.544+0000 7f3b277fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28107ab0 0x7f3b2819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:08.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.544+0000 7f3b277fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28107ab0 0x7f3b2819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59884/0 (socket says 172.21.15.98:59884) 2024-09-19T07:22:08.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.544+0000 7f3b277fe640 1 -- 172.21.15.98:0/2826458287 learned_addr learned my addr 172.21.15.98:0/2826458287 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:08.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.544+0000 7f3b267fc640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b28102440 0x7f3b281989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:08.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b26ffd640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b28101aa0 0x7f3b28198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:08.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b277fe640 1 -- 172.21.15.98:0/2826458287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b28102440 msgr2=0x7f3b281989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:08.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b277fe640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b28102440 0x7f3b281989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b277fe640 1 -- 172.21.15.98:0/2826458287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b28101aa0 msgr2=0x7f3b28198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:08.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b277fe640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b28101aa0 0x7f3b28198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b277fe640 1 -- 172.21.15.98:0/2826458287 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2819d450 con 0x7f3b28107ab0 2024-09-19T07:22:08.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b267fc640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b28102440 0x7f3b281989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:08.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b277fe640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28107ab0 0x7f3b2819cd20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000cad0 tx=0x7f3b2000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:08.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b2c95d640 1 -- 172.21.15.98:0/2826458287 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2000ae20 con 0x7f3b28107ab0 2024-09-19T07:22:08.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b2d95f640 1 -- 172.21.15.98:0/2826458287 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2819d740 con 0x7f3b28107ab0 2024-09-19T07:22:08.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b2c95d640 1 -- 172.21.15.98:0/2826458287 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b20005020 con 0x7f3b28107ab0 2024-09-19T07:22:08.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b2c95d640 1 -- 172.21.15.98:0/2826458287 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2000f6f0 con 0x7f3b28107ab0 2024-09-19T07:22:08.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.545+0000 7f3b2d95f640 1 -- 172.21.15.98:0/2826458287 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b281a4fd0 con 0x7f3b28107ab0 2024-09-19T07:22:08.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.546+0000 7f3b2d95f640 1 -- 172.21.15.98:0/2826458287 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b28101f00 con 0x7f3b28107ab0 2024-09-19T07:22:08.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.547+0000 7f3b2c95d640 1 -- 172.21.15.98:0/2826458287 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 22) ==== 138526+0+0 (secure 0 0 0) 0x7f3b200051d0 con 0x7f3b28107ab0 2024-09-19T07:22:08.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.548+0000 7f3b2c95d640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3b140a3450 0x7f3b140a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:08.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.548+0000 7f3b26ffd640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3b140a3450 0x7f3b140a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:08.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.548+0000 7f3b2c95d640 1 -- 172.21.15.98:0/2826458287 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f3b200d0050 con 0x7f3b28107ab0 2024-09-19T07:22:08.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.548+0000 7f3b26ffd640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3b140a3450 0x7f3b140a5910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3b18005fd0 tx=0x7f3b18005850 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:08.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.552+0000 7f3b2c95d640 1 -- 172.21.15.98:0/2826458287 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3b20014030 con 0x7f3b28107ab0 2024-09-19T07:22:08.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.718+0000 7f3b2c95d640 1 -- 172.21.15.98:0/2826458287 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f3b20098800 con 0x7f3b28107ab0 2024-09-19T07:22:08.719 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.719+0000 7f3b2d95f640 1 -- 172.21.15.98:0/2826458287 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b28062630 con 0x7f3b140a3450 2024-09-19T07:22:08.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.725+0000 7f3b2c95d640 1 -- 172.21.15.98:0/2826458287 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257863 (secure 0 0 0) 0x7f3b28062630 con 0x7f3b140a3450 2024-09-19T07:22:08.729 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:08.730 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-19T07:22:08.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.728+0000 7f3b2d95f640 1 -- 172.21.15.98:0/2826458287 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3b140a3450 msgr2=0x7f3b140a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:08.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.728+0000 7f3b2d95f640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3b140a3450 0x7f3b140a5910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3b18005fd0 tx=0x7f3b18005850 comp rx=0 tx=0).stop 2024-09-19T07:22:08.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.728+0000 7f3b2d95f640 1 -- 172.21.15.98:0/2826458287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28107ab0 msgr2=0x7f3b2819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:08.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.728+0000 7f3b2d95f640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28107ab0 0x7f3b2819cd20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000cad0 tx=0x7f3b2000cf90 comp rx=0 tx=0).stop 2024-09-19T07:22:08.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.728+0000 7f3b2d95f640 1 -- 172.21.15.98:0/2826458287 shutdown_connections 2024-09-19T07:22:08.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.728+0000 7f3b2d95f640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3b140a3450 0x7f3b140a5910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.728+0000 7f3b2d95f640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3b28107ab0 0x7f3b2819cd20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.728+0000 7f3b2d95f640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b28102440 0x7f3b281989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.728+0000 7f3b2d95f640 1 --2- 172.21.15.98:0/2826458287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3b28101aa0 0x7f3b28198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.728+0000 7f3b2d95f640 1 -- 172.21.15.98:0/2826458287 >> 172.21.15.98:0/2826458287 conn(0x7f3b280fd7c0 msgr2=0x7f3b280fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:08.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.728+0000 7f3b2d95f640 1 -- 172.21.15.98:0/2826458287 shutdown_connections 2024-09-19T07:22:08.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.729+0000 7f3b2d95f640 1 -- 172.21.15.98:0/2826458287 wait complete. 2024-09-19T07:22:08.740 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T07:22:07.774281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1186602,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":825,"num_read_kb":565,"num_write":470,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1208265,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":354840,"kb_used_data":13816,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124586984,"statfs":{"total":1151940427776,"available":1151577071616,"internally_reserved":0,"allocated":14147584,"data_stored":8405601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.990567"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816102+0000","last_change":"2024-09-19T07:20:19.535372+0000","last_active":"2024-09-19T07:22:03.816102+0000","last_peered":"2024-09-19T07:22:03.816102+0000","last_clean":"2024-09-19T07:22:03.816102+0000","last_became_active":"2024-09-19T07:20:19.535079+0000","last_became_peered":"2024-09-19T07:20:19.535079+0000","last_unstale":"2024-09-19T07:22:03.816102+0000","last_undegraded":"2024-09-19T07:22:03.816102+0000","last_fullsized":"2024-09-19T07:22:03.816102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:56.856451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815671+0000","last_change":"2024-09-19T07:20:19.528531+0000","last_active":"2024-09-19T07:22:03.815671+0000","last_peered":"2024-09-19T07:22:03.815671+0000","last_clean":"2024-09-19T07:22:03.815671+0000","last_became_active":"2024-09-19T07:20:19.528218+0000","last_became_peered":"2024-09-19T07:20:19.528218+0000","last_unstale":"2024-09-19T07:22:03.815671+0000","last_undegraded":"2024-09-19T07:22:03.815671+0000","last_fullsized":"2024-09-19T07:22:03.815671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:44.730220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818254+0000","last_change":"2024-09-19T07:20:19.533516+0000","last_active":"2024-09-19T07:22:03.818254+0000","last_peered":"2024-09-19T07:22:03.818254+0000","last_clean":"2024-09-19T07:22:03.818254+0000","last_became_active":"2024-09-19T07:20:19.533247+0000","last_became_peered":"2024-09-19T07:20:19.533247+0000","last_unstale":"2024-09-19T07:22:03.818254+0000","last_undegraded":"2024-09-19T07:22:03.818254+0000","last_fullsized":"2024-09-19T07:22:03.818254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:29.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810373+0000","last_change":"2024-09-19T07:20:19.543245+0000","last_active":"2024-09-19T07:22:03.810373+0000","last_peered":"2024-09-19T07:22:03.810373+0000","last_clean":"2024-09-19T07:22:03.810373+0000","last_became_active":"2024-09-19T07:20:19.542840+0000","last_became_peered":"2024-09-19T07:20:19.542840+0000","last_unstale":"2024-09-19T07:22:03.810373+0000","last_undegraded":"2024-09-19T07:22:03.810373+0000","last_fullsized":"2024-09-19T07:22:03.810373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:21.780027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.794220+0000","last_change":"2024-09-19T07:20:19.528880+0000","last_active":"2024-09-19T07:22:03.794220+0000","last_peered":"2024-09-19T07:22:03.794220+0000","last_clean":"2024-09-19T07:22:03.794220+0000","last_became_active":"2024-09-19T07:20:19.528592+0000","last_became_peered":"2024-09-19T07:20:19.528592+0000","last_unstale":"2024-09-19T07:22:03.794220+0000","last_undegraded":"2024-09-19T07:22:03.794220+0000","last_fullsized":"2024-09-19T07:22:03.794220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:59.718929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805549+0000","last_change":"2024-09-19T07:20:19.538480+0000","last_active":"2024-09-19T07:22:03.805549+0000","last_peered":"2024-09-19T07:22:03.805549+0000","last_clean":"2024-09-19T07:22:03.805549+0000","last_became_active":"2024-09-19T07:20:19.538189+0000","last_became_peered":"2024-09-19T07:20:19.538189+0000","last_unstale":"2024-09-19T07:22:03.805549+0000","last_undegraded":"2024-09-19T07:22:03.805549+0000","last_fullsized":"2024-09-19T07:22:03.805549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:29.607974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813603+0000","last_change":"2024-09-19T07:20:19.538877+0000","last_active":"2024-09-19T07:22:03.813603+0000","last_peered":"2024-09-19T07:22:03.813603+0000","last_clean":"2024-09-19T07:22:03.813603+0000","last_became_active":"2024-09-19T07:20:19.538551+0000","last_became_peered":"2024-09-19T07:20:19.538551+0000","last_unstale":"2024-09-19T07:22:03.813603+0000","last_undegraded":"2024-09-19T07:22:03.813603+0000","last_fullsized":"2024-09-19T07:22:03.813603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:52.114115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.819590+0000","last_change":"2024-09-19T07:20:19.538135+0000","last_active":"2024-09-19T07:22:03.819590+0000","last_peered":"2024-09-19T07:22:03.819590+0000","last_clean":"2024-09-19T07:22:03.819590+0000","last_became_active":"2024-09-19T07:20:19.537769+0000","last_became_peered":"2024-09-19T07:20:19.537769+0000","last_unstale":"2024-09-19T07:22:03.819590+0000","last_undegraded":"2024-09-19T07:22:03.819590+0000","last_fullsized":"2024-09-19T07:22:03.819590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:21.304262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814166+0000","last_change":"2024-09-19T07:20:19.531569+0000","last_active":"2024-09-19T07:22:03.814166+0000","last_peered":"2024-09-19T07:22:03.814166+0000","last_clean":"2024-09-19T07:22:03.814166+0000","last_became_active":"2024-09-19T07:20:19.529455+0000","last_became_peered":"2024-09-19T07:20:19.529455+0000","last_unstale":"2024-09-19T07:22:03.814166+0000","last_undegraded":"2024-09-19T07:22:03.814166+0000","last_fullsized":"2024-09-19T07:22:03.814166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:22.187968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807215+0000","last_change":"2024-09-19T07:20:19.540342+0000","last_active":"2024-09-19T07:22:03.807215+0000","last_peered":"2024-09-19T07:22:03.807215+0000","last_clean":"2024-09-19T07:22:03.807215+0000","last_became_active":"2024-09-19T07:20:19.539870+0000","last_became_peered":"2024-09-19T07:20:19.539870+0000","last_unstale":"2024-09-19T07:22:03.807215+0000","last_undegraded":"2024-09-19T07:22:03.807215+0000","last_fullsized":"2024-09-19T07:22:03.807215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:39.930671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803048+0000","last_change":"2024-09-19T07:20:19.536004+0000","last_active":"2024-09-19T07:22:03.803048+0000","last_peered":"2024-09-19T07:22:03.803048+0000","last_clean":"2024-09-19T07:22:03.803048+0000","last_became_active":"2024-09-19T07:20:19.535640+0000","last_became_peered":"2024-09-19T07:20:19.535640+0000","last_unstale":"2024-09-19T07:22:03.803048+0000","last_undegraded":"2024-09-19T07:22:03.803048+0000","last_fullsized":"2024-09-19T07:22:03.803048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:47.853411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.806987+0000","last_change":"2024-09-19T07:20:19.539374+0000","last_active":"2024-09-19T07:22:03.806987+0000","last_peered":"2024-09-19T07:22:03.806987+0000","last_clean":"2024-09-19T07:22:03.806987+0000","last_became_active":"2024-09-19T07:20:19.538880+0000","last_became_peered":"2024-09-19T07:20:19.538880+0000","last_unstale":"2024-09-19T07:22:03.806987+0000","last_undegraded":"2024-09-19T07:22:03.806987+0000","last_fullsized":"2024-09-19T07:22:03.806987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:55.484232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.806269+0000","last_change":"2024-09-19T07:20:37.792753+0000","last_active":"2024-09-19T07:22:03.806269+0000","last_peered":"2024-09-19T07:22:03.806269+0000","last_clean":"2024-09-19T07:22:03.806269+0000","last_became_active":"2024-09-19T07:20:37.792417+0000","last_became_peered":"2024-09-19T07:20:37.792417+0000","last_unstale":"2024-09-19T07:22:03.806269+0000","last_undegraded":"2024-09-19T07:22:03.806269+0000","last_fullsized":"2024-09-19T07:22:03.806269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:10.417367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816028+0000","last_change":"2024-09-19T07:20:19.528842+0000","last_active":"2024-09-19T07:22:03.816028+0000","last_peered":"2024-09-19T07:22:03.816028+0000","last_clean":"2024-09-19T07:22:03.816028+0000","last_became_active":"2024-09-19T07:20:19.528042+0000","last_became_peered":"2024-09-19T07:20:19.528042+0000","last_unstale":"2024-09-19T07:22:03.816028+0000","last_undegraded":"2024-09-19T07:22:03.816028+0000","last_fullsized":"2024-09-19T07:22:03.816028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:34.970509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817953+0000","last_change":"2024-09-19T07:20:19.535013+0000","last_active":"2024-09-19T07:22:03.817953+0000","last_peered":"2024-09-19T07:22:03.817953+0000","last_clean":"2024-09-19T07:22:03.817953+0000","last_became_active":"2024-09-19T07:20:19.534302+0000","last_became_peered":"2024-09-19T07:20:19.534302+0000","last_unstale":"2024-09-19T07:22:03.817953+0000","last_undegraded":"2024-09-19T07:22:03.817953+0000","last_fullsized":"2024-09-19T07:22:03.817953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:52.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812766+0000","last_change":"2024-09-19T07:20:19.534930+0000","last_active":"2024-09-19T07:22:03.812766+0000","last_peered":"2024-09-19T07:22:03.812766+0000","last_clean":"2024-09-19T07:22:03.812766+0000","last_became_active":"2024-09-19T07:20:19.534640+0000","last_became_peered":"2024-09-19T07:20:19.534640+0000","last_unstale":"2024-09-19T07:22:03.812766+0000","last_undegraded":"2024-09-19T07:22:03.812766+0000","last_fullsized":"2024-09-19T07:22:03.812766+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:23.055097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818341+0000","last_change":"2024-09-19T07:20:19.535856+0000","last_active":"2024-09-19T07:22:03.818341+0000","last_peered":"2024-09-19T07:22:03.818341+0000","last_clean":"2024-09-19T07:22:03.818341+0000","last_became_active":"2024-09-19T07:20:19.535561+0000","last_became_peered":"2024-09-19T07:20:19.535561+0000","last_unstale":"2024-09-19T07:22:03.818341+0000","last_undegraded":"2024-09-19T07:22:03.818341+0000","last_fullsized":"2024-09-19T07:22:03.818341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:03.943339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812865+0000","last_change":"2024-09-19T07:20:19.528429+0000","last_active":"2024-09-19T07:22:03.812865+0000","last_peered":"2024-09-19T07:22:03.812865+0000","last_clean":"2024-09-19T07:22:03.812865+0000","last_became_active":"2024-09-19T07:20:19.528107+0000","last_became_peered":"2024-09-19T07:20:19.528107+0000","last_unstale":"2024-09-19T07:22:03.812865+0000","last_undegraded":"2024-09-19T07:22:03.812865+0000","last_fullsized":"2024-09-19T07:22:03.812865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:49.520514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818269+0000","last_change":"2024-09-19T07:20:19.532966+0000","last_active":"2024-09-19T07:22:03.818269+0000","last_peered":"2024-09-19T07:22:03.818269+0000","last_clean":"2024-09-19T07:22:03.818269+0000","last_became_active":"2024-09-19T07:20:19.532412+0000","last_became_peered":"2024-09-19T07:20:19.532412+0000","last_unstale":"2024-09-19T07:22:03.818269+0000","last_undegraded":"2024-09-19T07:22:03.818269+0000","last_fullsized":"2024-09-19T07:22:03.818269+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:42.900136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.800966+0000","last_change":"2024-09-19T07:20:37.797952+0000","last_active":"2024-09-19T07:22:03.800966+0000","last_peered":"2024-09-19T07:22:03.800966+0000","last_clean":"2024-09-19T07:22:03.800966+0000","last_became_active":"2024-09-19T07:20:37.797459+0000","last_became_peered":"2024-09-19T07:20:37.797459+0000","last_unstale":"2024-09-19T07:22:03.800966+0000","last_undegraded":"2024-09-19T07:22:03.800966+0000","last_fullsized":"2024-09-19T07:22:03.800966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:44.132477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818884+0000","last_change":"2024-09-19T07:20:19.532193+0000","last_active":"2024-09-19T07:22:03.818884+0000","last_peered":"2024-09-19T07:22:03.818884+0000","last_clean":"2024-09-19T07:22:03.818884+0000","last_became_active":"2024-09-19T07:20:19.531890+0000","last_became_peered":"2024-09-19T07:20:19.531890+0000","last_unstale":"2024-09-19T07:22:03.818884+0000","last_undegraded":"2024-09-19T07:22:03.818884+0000","last_fullsized":"2024-09-19T07:22:03.818884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:21.168993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815073+0000","last_change":"2024-09-19T07:20:19.535034+0000","last_active":"2024-09-19T07:22:03.815073+0000","last_peered":"2024-09-19T07:22:03.815073+0000","last_clean":"2024-09-19T07:22:03.815073+0000","last_became_active":"2024-09-19T07:20:19.534732+0000","last_became_peered":"2024-09-19T07:20:19.534732+0000","last_unstale":"2024-09-19T07:22:03.815073+0000","last_undegraded":"2024-09-19T07:22:03.815073+0000","last_fullsized":"2024-09-19T07:22:03.815073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:13.726672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817072+0000","last_change":"2024-09-19T07:20:19.532644+0000","last_active":"2024-09-19T07:22:03.817072+0000","last_peered":"2024-09-19T07:22:03.817072+0000","last_clean":"2024-09-19T07:22:03.817072+0000","last_became_active":"2024-09-19T07:20:19.532364+0000","last_became_peered":"2024-09-19T07:20:19.532364+0000","last_unstale":"2024-09-19T07:22:03.817072+0000","last_undegraded":"2024-09-19T07:22:03.817072+0000","last_fullsized":"2024-09-19T07:22:03.817072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:17.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814164+0000","last_change":"2024-09-19T07:20:19.533500+0000","last_active":"2024-09-19T07:22:03.814164+0000","last_peered":"2024-09-19T07:22:03.814164+0000","last_clean":"2024-09-19T07:22:03.814164+0000","last_became_active":"2024-09-19T07:20:19.532759+0000","last_became_peered":"2024-09-19T07:20:19.532759+0000","last_unstale":"2024-09-19T07:22:03.814164+0000","last_undegraded":"2024-09-19T07:22:03.814164+0000","last_fullsized":"2024-09-19T07:22:03.814164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:35.549776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815771+0000","last_change":"2024-09-19T07:20:37.793776+0000","last_active":"2024-09-19T07:22:03.815771+0000","last_peered":"2024-09-19T07:22:03.815771+0000","last_clean":"2024-09-19T07:22:03.815771+0000","last_became_active":"2024-09-19T07:20:37.793382+0000","last_became_peered":"2024-09-19T07:20:37.793382+0000","last_unstale":"2024-09-19T07:22:03.815771+0000","last_undegraded":"2024-09-19T07:22:03.815771+0000","last_fullsized":"2024-09-19T07:22:03.815771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:00.422534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803532+0000","last_change":"2024-09-19T07:20:19.532840+0000","last_active":"2024-09-19T07:22:03.803532+0000","last_peered":"2024-09-19T07:22:03.803532+0000","last_clean":"2024-09-19T07:22:03.803532+0000","last_became_active":"2024-09-19T07:20:19.532059+0000","last_became_peered":"2024-09-19T07:20:19.532059+0000","last_unstale":"2024-09-19T07:22:03.803532+0000","last_undegraded":"2024-09-19T07:22:03.803532+0000","last_fullsized":"2024-09-19T07:22:03.803532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:49.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.802328+0000","last_change":"2024-09-19T07:20:19.528150+0000","last_active":"2024-09-19T07:22:03.802328+0000","last_peered":"2024-09-19T07:22:03.802328+0000","last_clean":"2024-09-19T07:22:03.802328+0000","last_became_active":"2024-09-19T07:20:19.527873+0000","last_became_peered":"2024-09-19T07:20:19.527873+0000","last_unstale":"2024-09-19T07:22:03.802328+0000","last_undegraded":"2024-09-19T07:22:03.802328+0000","last_fullsized":"2024-09-19T07:22:03.802328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.561937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808779+0000","last_change":"2024-09-19T07:20:19.540160+0000","last_active":"2024-09-19T07:22:03.808779+0000","last_peered":"2024-09-19T07:22:03.808779+0000","last_clean":"2024-09-19T07:22:03.808779+0000","last_became_active":"2024-09-19T07:20:19.539862+0000","last_became_peered":"2024-09-19T07:20:19.539862+0000","last_unstale":"2024-09-19T07:22:03.808779+0000","last_undegraded":"2024-09-19T07:22:03.808779+0000","last_fullsized":"2024-09-19T07:22:03.808779+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:22.229785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.820657+0000","last_change":"2024-09-19T07:20:19.540363+0000","last_active":"2024-09-19T07:22:03.820657+0000","last_peered":"2024-09-19T07:22:03.820657+0000","last_clean":"2024-09-19T07:22:03.820657+0000","last_became_active":"2024-09-19T07:20:19.540068+0000","last_became_peered":"2024-09-19T07:20:19.540068+0000","last_unstale":"2024-09-19T07:22:03.820657+0000","last_undegraded":"2024-09-19T07:22:03.820657+0000","last_fullsized":"2024-09-19T07:22:03.820657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:07.955849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818258+0000","last_change":"2024-09-19T07:20:19.533546+0000","last_active":"2024-09-19T07:22:03.818258+0000","last_peered":"2024-09-19T07:22:03.818258+0000","last_clean":"2024-09-19T07:22:03.818258+0000","last_became_active":"2024-09-19T07:20:19.533232+0000","last_became_peered":"2024-09-19T07:20:19.533232+0000","last_unstale":"2024-09-19T07:22:03.818258+0000","last_undegraded":"2024-09-19T07:22:03.818258+0000","last_fullsized":"2024-09-19T07:22:03.818258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:29.674866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807595+0000","last_change":"2024-09-19T07:20:19.542842+0000","last_active":"2024-09-19T07:22:03.807595+0000","last_peered":"2024-09-19T07:22:03.807595+0000","last_clean":"2024-09-19T07:22:03.807595+0000","last_became_active":"2024-09-19T07:20:19.542477+0000","last_became_peered":"2024-09-19T07:20:19.542477+0000","last_unstale":"2024-09-19T07:22:03.807595+0000","last_undegraded":"2024-09-19T07:22:03.807595+0000","last_fullsized":"2024-09-19T07:22:03.807595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:30.921099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803673+0000","last_change":"2024-09-19T07:20:19.530472+0000","last_active":"2024-09-19T07:22:03.803673+0000","last_peered":"2024-09-19T07:22:03.803673+0000","last_clean":"2024-09-19T07:22:03.803673+0000","last_became_active":"2024-09-19T07:20:19.529457+0000","last_became_peered":"2024-09-19T07:20:19.529457+0000","last_unstale":"2024-09-19T07:22:03.803673+0000","last_undegraded":"2024-09-19T07:22:03.803673+0000","last_fullsized":"2024-09-19T07:22:03.803673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:16.410723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803010+0000","last_change":"2024-09-19T07:20:37.801168+0000","last_active":"2024-09-19T07:22:03.803010+0000","last_peered":"2024-09-19T07:22:03.803010+0000","last_clean":"2024-09-19T07:22:03.803010+0000","last_became_active":"2024-09-19T07:20:37.800613+0000","last_became_peered":"2024-09-19T07:20:37.800613+0000","last_unstale":"2024-09-19T07:22:03.803010+0000","last_undegraded":"2024-09-19T07:22:03.803010+0000","last_fullsized":"2024-09-19T07:22:03.803010+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:27.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'7","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.898326+0000","last_change":"2024-09-19T07:20:17.524656+0000","last_active":"2024-09-19T07:22:03.898326+0000","last_peered":"2024-09-19T07:22:03.898326+0000","last_clean":"2024-09-19T07:22:03.898326+0000","last_became_active":"2024-09-19T07:20:17.524350+0000","last_became_peered":"2024-09-19T07:20:17.524350+0000","last_unstale":"2024-09-19T07:22:03.898326+0000","last_undegraded":"2024-09-19T07:22:03.898326+0000","last_fullsized":"2024-09-19T07:22:03.898326+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:00.459283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810877+0000","last_change":"2024-09-19T07:20:19.536895+0000","last_active":"2024-09-19T07:22:03.810877+0000","last_peered":"2024-09-19T07:22:03.810877+0000","last_clean":"2024-09-19T07:22:03.810877+0000","last_became_active":"2024-09-19T07:20:19.536569+0000","last_became_peered":"2024-09-19T07:20:19.536569+0000","last_unstale":"2024-09-19T07:22:03.810877+0000","last_undegraded":"2024-09-19T07:22:03.810877+0000","last_fullsized":"2024-09-19T07:22:03.810877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:56.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.770907+0000","last_change":"2024-09-19T07:20:17.519800+0000","last_active":"2024-09-19T07:22:03.770907+0000","last_peered":"2024-09-19T07:22:03.770907+0000","last_clean":"2024-09-19T07:22:03.770907+0000","last_became_active":"2024-09-19T07:20:17.519384+0000","last_became_peered":"2024-09-19T07:20:17.519384+0000","last_unstale":"2024-09-19T07:22:03.770907+0000","last_undegraded":"2024-09-19T07:22:03.770907+0000","last_fullsized":"2024-09-19T07:22:03.770907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:17.346946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.761997+0000","last_change":"2024-09-19T07:20:17.511178+0000","last_active":"2024-09-19T07:22:03.761997+0000","last_peered":"2024-09-19T07:22:03.761997+0000","last_clean":"2024-09-19T07:22:03.761997+0000","last_became_active":"2024-09-19T07:20:17.510646+0000","last_became_peered":"2024-09-19T07:20:17.510646+0000","last_unstale":"2024-09-19T07:22:03.761997+0000","last_undegraded":"2024-09-19T07:22:03.761997+0000","last_fullsized":"2024-09-19T07:22:03.761997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:58.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.804119+0000","last_change":"2024-09-19T07:20:19.532979+0000","last_active":"2024-09-19T07:22:03.804119+0000","last_peered":"2024-09-19T07:22:03.804119+0000","last_clean":"2024-09-19T07:22:03.804119+0000","last_became_active":"2024-09-19T07:20:19.532396+0000","last_became_peered":"2024-09-19T07:20:19.532396+0000","last_unstale":"2024-09-19T07:22:03.804119+0000","last_undegraded":"2024-09-19T07:22:03.804119+0000","last_fullsized":"2024-09-19T07:22:03.804119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:24.313572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.781655+0000","last_change":"2024-09-19T07:20:17.519327+0000","last_active":"2024-09-19T07:22:03.781655+0000","last_peered":"2024-09-19T07:22:03.781655+0000","last_clean":"2024-09-19T07:22:03.781655+0000","last_became_active":"2024-09-19T07:20:17.518916+0000","last_became_peered":"2024-09-19T07:20:17.518916+0000","last_unstale":"2024-09-19T07:22:03.781655+0000","last_undegraded":"2024-09-19T07:22:03.781655+0000","last_fullsized":"2024-09-19T07:22:03.781655+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:52.672016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814641+0000","last_change":"2024-09-19T07:20:19.528642+0000","last_active":"2024-09-19T07:22:03.814641+0000","last_peered":"2024-09-19T07:22:03.814641+0000","last_clean":"2024-09-19T07:22:03.814641+0000","last_became_active":"2024-09-19T07:20:19.528302+0000","last_became_peered":"2024-09-19T07:20:19.528302+0000","last_unstale":"2024-09-19T07:22:03.814641+0000","last_undegraded":"2024-09-19T07:22:03.814641+0000","last_fullsized":"2024-09-19T07:22:03.814641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:22.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.770981+0000","last_change":"2024-09-19T07:20:17.519144+0000","last_active":"2024-09-19T07:22:03.770981+0000","last_peered":"2024-09-19T07:22:03.770981+0000","last_clean":"2024-09-19T07:22:03.770981+0000","last_became_active":"2024-09-19T07:20:17.518714+0000","last_became_peered":"2024-09-19T07:20:17.518714+0000","last_unstale":"2024-09-19T07:22:03.770981+0000","last_undegraded":"2024-09-19T07:22:03.770981+0000","last_fullsized":"2024-09-19T07:22:03.770981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:09.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808858+0000","last_change":"2024-09-19T07:20:19.532293+0000","last_active":"2024-09-19T07:22:03.808858+0000","last_peered":"2024-09-19T07:22:03.808858+0000","last_clean":"2024-09-19T07:22:03.808858+0000","last_became_active":"2024-09-19T07:20:19.531427+0000","last_became_peered":"2024-09-19T07:20:19.531427+0000","last_unstale":"2024-09-19T07:22:03.808858+0000","last_undegraded":"2024-09-19T07:22:03.808858+0000","last_fullsized":"2024-09-19T07:22:03.808858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:31.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776705+0000","last_change":"2024-09-19T07:20:17.521743+0000","last_active":"2024-09-19T07:22:03.776705+0000","last_peered":"2024-09-19T07:22:03.776705+0000","last_clean":"2024-09-19T07:22:03.776705+0000","last_became_active":"2024-09-19T07:20:17.521321+0000","last_became_peered":"2024-09-19T07:20:17.521321+0000","last_unstale":"2024-09-19T07:22:03.776705+0000","last_undegraded":"2024-09-19T07:22:03.776705+0000","last_fullsized":"2024-09-19T07:22:03.776705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:21.107210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.821636+0000","last_change":"2024-09-19T07:20:19.532879+0000","last_active":"2024-09-19T07:22:03.821636+0000","last_peered":"2024-09-19T07:22:03.821636+0000","last_clean":"2024-09-19T07:22:03.821636+0000","last_became_active":"2024-09-19T07:20:19.532490+0000","last_became_peered":"2024-09-19T07:20:19.532490+0000","last_unstale":"2024-09-19T07:22:03.821636+0000","last_undegraded":"2024-09-19T07:22:03.821636+0000","last_fullsized":"2024-09-19T07:22:03.821636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:06.534849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.782814+0000","last_change":"2024-09-19T07:20:17.565759+0000","last_active":"2024-09-19T07:22:03.782814+0000","last_peered":"2024-09-19T07:22:03.782814+0000","last_clean":"2024-09-19T07:22:03.782814+0000","last_became_active":"2024-09-19T07:20:17.565334+0000","last_became_peered":"2024-09-19T07:20:17.565334+0000","last_unstale":"2024-09-19T07:22:03.782814+0000","last_undegraded":"2024-09-19T07:22:03.782814+0000","last_fullsized":"2024-09-19T07:22:03.782814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.588515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812382+0000","last_change":"2024-09-19T07:20:19.537397+0000","last_active":"2024-09-19T07:22:03.812382+0000","last_peered":"2024-09-19T07:22:03.812382+0000","last_clean":"2024-09-19T07:22:03.812382+0000","last_became_active":"2024-09-19T07:20:19.537059+0000","last_became_peered":"2024-09-19T07:20:19.537059+0000","last_unstale":"2024-09-19T07:22:03.812382+0000","last_undegraded":"2024-09-19T07:22:03.812382+0000","last_fullsized":"2024-09-19T07:22:03.812382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:30.146934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'34","reported_seq":277,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:04.080426+0000","last_change":"2024-09-19T07:20:37.956721+0000","last_active":"2024-09-19T07:22:04.080426+0000","last_peered":"2024-09-19T07:22:04.080426+0000","last_clean":"2024-09-19T07:22:04.080426+0000","last_became_active":"2024-09-19T07:20:37.944159+0000","last_became_peered":"2024-09-19T07:20:37.944159+0000","last_unstale":"2024-09-19T07:22:04.080426+0000","last_undegraded":"2024-09-19T07:22:04.080426+0000","last_fullsized":"2024-09-19T07:22:04.080426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:52.944073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":158,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.797438+0000","last_change":"2024-09-19T07:20:19.531533+0000","last_active":"2024-09-19T07:22:03.797438+0000","last_peered":"2024-09-19T07:22:03.797438+0000","last_clean":"2024-09-19T07:22:03.797438+0000","last_became_active":"2024-09-19T07:20:19.531228+0000","last_became_peered":"2024-09-19T07:20:19.531228+0000","last_unstale":"2024-09-19T07:22:03.797438+0000","last_undegraded":"2024-09-19T07:22:03.797438+0000","last_fullsized":"2024-09-19T07:22:03.797438+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:34.606957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775177+0000","last_change":"2024-09-19T07:20:17.522411+0000","last_active":"2024-09-19T07:22:03.775177+0000","last_peered":"2024-09-19T07:22:03.775177+0000","last_clean":"2024-09-19T07:22:03.775177+0000","last_became_active":"2024-09-19T07:20:17.522086+0000","last_became_peered":"2024-09-19T07:20:17.522086+0000","last_unstale":"2024-09-19T07:22:03.775177+0000","last_undegraded":"2024-09-19T07:22:03.775177+0000","last_fullsized":"2024-09-19T07:22:03.775177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.299624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814726+0000","last_change":"2024-09-19T07:20:19.532527+0000","last_active":"2024-09-19T07:22:03.814726+0000","last_peered":"2024-09-19T07:22:03.814726+0000","last_clean":"2024-09-19T07:22:03.814726+0000","last_became_active":"2024-09-19T07:20:19.532219+0000","last_became_peered":"2024-09-19T07:20:19.532219+0000","last_unstale":"2024-09-19T07:22:03.814726+0000","last_undegraded":"2024-09-19T07:22:03.814726+0000","last_fullsized":"2024-09-19T07:22:03.814726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:05.878229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.781583+0000","last_change":"2024-09-19T07:20:17.518014+0000","last_active":"2024-09-19T07:22:03.781583+0000","last_peered":"2024-09-19T07:22:03.781583+0000","last_clean":"2024-09-19T07:22:03.781583+0000","last_became_active":"2024-09-19T07:20:17.517077+0000","last_became_peered":"2024-09-19T07:20:17.517077+0000","last_unstale":"2024-09-19T07:22:03.781583+0000","last_undegraded":"2024-09-19T07:22:03.781583+0000","last_fullsized":"2024-09-19T07:22:03.781583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:45.893365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816520+0000","last_change":"2024-09-19T07:20:19.539347+0000","last_active":"2024-09-19T07:22:03.816520+0000","last_peered":"2024-09-19T07:22:03.816520+0000","last_clean":"2024-09-19T07:22:03.816520+0000","last_became_active":"2024-09-19T07:20:19.538884+0000","last_became_peered":"2024-09-19T07:20:19.538884+0000","last_unstale":"2024-09-19T07:22:03.816520+0000","last_undegraded":"2024-09-19T07:22:03.816520+0000","last_fullsized":"2024-09-19T07:22:03.816520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:23.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.897819+0000","last_change":"2024-09-19T07:20:17.513756+0000","last_active":"2024-09-19T07:22:03.897819+0000","last_peered":"2024-09-19T07:22:03.897819+0000","last_clean":"2024-09-19T07:22:03.897819+0000","last_became_active":"2024-09-19T07:20:17.513433+0000","last_became_peered":"2024-09-19T07:20:17.513433+0000","last_unstale":"2024-09-19T07:22:03.897819+0000","last_undegraded":"2024-09-19T07:22:03.897819+0000","last_fullsized":"2024-09-19T07:22:03.897819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:27.681161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.809812+0000","last_change":"2024-09-19T07:20:19.539873+0000","last_active":"2024-09-19T07:22:03.809812+0000","last_peered":"2024-09-19T07:22:03.809812+0000","last_clean":"2024-09-19T07:22:03.809812+0000","last_became_active":"2024-09-19T07:20:19.539581+0000","last_became_peered":"2024-09-19T07:20:19.539581+0000","last_unstale":"2024-09-19T07:22:03.809812+0000","last_undegraded":"2024-09-19T07:22:03.809812+0000","last_fullsized":"2024-09-19T07:22:03.809812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:31.164179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775476+0000","last_change":"2024-09-19T07:20:17.565864+0000","last_active":"2024-09-19T07:22:03.775476+0000","last_peered":"2024-09-19T07:22:03.775476+0000","last_clean":"2024-09-19T07:22:03.775476+0000","last_became_active":"2024-09-19T07:20:17.565459+0000","last_became_peered":"2024-09-19T07:20:17.565459+0000","last_unstale":"2024-09-19T07:22:03.775476+0000","last_undegraded":"2024-09-19T07:22:03.775476+0000","last_fullsized":"2024-09-19T07:22:03.775476+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:15.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814439+0000","last_change":"2024-09-19T07:20:37.800857+0000","last_active":"2024-09-19T07:22:03.814439+0000","last_peered":"2024-09-19T07:22:03.814439+0000","last_clean":"2024-09-19T07:22:03.814439+0000","last_became_active":"2024-09-19T07:20:37.800347+0000","last_became_peered":"2024-09-19T07:20:37.800347+0000","last_unstale":"2024-09-19T07:22:03.814439+0000","last_undegraded":"2024-09-19T07:22:03.814439+0000","last_fullsized":"2024-09-19T07:22:03.814439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:48.678208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775894+0000","last_change":"2024-09-19T07:20:17.521439+0000","last_active":"2024-09-19T07:22:03.775894+0000","last_peered":"2024-09-19T07:22:03.775894+0000","last_clean":"2024-09-19T07:22:03.775894+0000","last_became_active":"2024-09-19T07:20:17.521021+0000","last_became_peered":"2024-09-19T07:20:17.521021+0000","last_unstale":"2024-09-19T07:22:03.775894+0000","last_undegraded":"2024-09-19T07:22:03.775894+0000","last_fullsized":"2024-09-19T07:22:03.775894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.322352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.802889+0000","last_change":"2024-09-19T07:20:19.531234+0000","last_active":"2024-09-19T07:22:03.802889+0000","last_peered":"2024-09-19T07:22:03.802889+0000","last_clean":"2024-09-19T07:22:03.802889+0000","last_became_active":"2024-09-19T07:20:19.530422+0000","last_became_peered":"2024-09-19T07:20:19.530422+0000","last_unstale":"2024-09-19T07:22:03.802889+0000","last_undegraded":"2024-09-19T07:22:03.802889+0000","last_fullsized":"2024-09-19T07:22:03.802889+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:57.325415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.762228+0000","last_change":"2024-09-19T07:20:17.522426+0000","last_active":"2024-09-19T07:22:03.762228+0000","last_peered":"2024-09-19T07:22:03.762228+0000","last_clean":"2024-09-19T07:22:03.762228+0000","last_became_active":"2024-09-19T07:20:17.522061+0000","last_became_peered":"2024-09-19T07:20:17.522061+0000","last_unstale":"2024-09-19T07:22:03.762228+0000","last_undegraded":"2024-09-19T07:22:03.762228+0000","last_fullsized":"2024-09-19T07:22:03.762228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:04.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805167+0000","last_change":"2024-09-19T07:20:19.543420+0000","last_active":"2024-09-19T07:22:03.805167+0000","last_peered":"2024-09-19T07:22:03.805167+0000","last_clean":"2024-09-19T07:22:03.805167+0000","last_became_active":"2024-09-19T07:20:19.542294+0000","last_became_peered":"2024-09-19T07:20:19.542294+0000","last_unstale":"2024-09-19T07:22:03.805167+0000","last_undegraded":"2024-09-19T07:22:03.805167+0000","last_fullsized":"2024-09-19T07:22:03.805167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:32.119366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'39","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:04.032255+0000","last_change":"2024-09-19T07:20:17.518402+0000","last_active":"2024-09-19T07:22:04.032255+0000","last_peered":"2024-09-19T07:22:04.032255+0000","last_clean":"2024-09-19T07:22:04.032255+0000","last_became_active":"2024-09-19T07:20:17.517524+0000","last_became_peered":"2024-09-19T07:20:17.517524+0000","last_unstale":"2024-09-19T07:22:04.032255+0000","last_undegraded":"2024-09-19T07:22:04.032255+0000","last_fullsized":"2024-09-19T07:22:04.032255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:49.843442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.809548+0000","last_change":"2024-09-19T07:20:19.540945+0000","last_active":"2024-09-19T07:22:03.809548+0000","last_peered":"2024-09-19T07:22:03.809548+0000","last_clean":"2024-09-19T07:22:03.809548+0000","last_became_active":"2024-09-19T07:20:19.540641+0000","last_became_peered":"2024-09-19T07:20:19.540641+0000","last_unstale":"2024-09-19T07:22:03.809548+0000","last_undegraded":"2024-09-19T07:22:03.809548+0000","last_fullsized":"2024-09-19T07:22:03.809548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.487418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.774962+0000","last_change":"2024-09-19T07:20:17.567010+0000","last_active":"2024-09-19T07:22:03.774962+0000","last_peered":"2024-09-19T07:22:03.774962+0000","last_clean":"2024-09-19T07:22:03.774962+0000","last_became_active":"2024-09-19T07:20:17.566560+0000","last_became_peered":"2024-09-19T07:20:17.566560+0000","last_unstale":"2024-09-19T07:22:03.774962+0000","last_undegraded":"2024-09-19T07:22:03.774962+0000","last_fullsized":"2024-09-19T07:22:03.774962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.349568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813860+0000","last_change":"2024-09-19T07:20:19.541808+0000","last_active":"2024-09-19T07:22:03.813860+0000","last_peered":"2024-09-19T07:22:03.813860+0000","last_clean":"2024-09-19T07:22:03.813860+0000","last_became_active":"2024-09-19T07:20:19.541510+0000","last_became_peered":"2024-09-19T07:20:19.541510+0000","last_unstale":"2024-09-19T07:22:03.813860+0000","last_undegraded":"2024-09-19T07:22:03.813860+0000","last_fullsized":"2024-09-19T07:22:03.813860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:04.156121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":344,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776640+0000","last_change":"2024-09-19T07:19:11.632651+0000","last_active":"2024-09-19T07:22:03.776640+0000","last_peered":"2024-09-19T07:22:03.776640+0000","last_clean":"2024-09-19T07:22:03.776640+0000","last_became_active":"2024-09-19T07:19:11.632229+0000","last_became_peered":"2024-09-19T07:19:11.632229+0000","last_unstale":"2024-09-19T07:22:03.776640+0000","last_undegraded":"2024-09-19T07:22:03.776640+0000","last_fullsized":"2024-09-19T07:22:03.776640+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_clean_scrub_stamp":"2024-09-19T07:15:50.875302+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:32.716049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.763366+0000","last_change":"2024-09-19T07:20:17.512387+0000","last_active":"2024-09-19T07:22:03.763366+0000","last_peered":"2024-09-19T07:22:03.763366+0000","last_clean":"2024-09-19T07:22:03.763366+0000","last_became_active":"2024-09-19T07:20:17.511956+0000","last_became_peered":"2024-09-19T07:20:17.511956+0000","last_unstale":"2024-09-19T07:22:03.763366+0000","last_undegraded":"2024-09-19T07:22:03.763366+0000","last_fullsized":"2024-09-19T07:22:03.763366+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:13.098347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813504+0000","last_change":"2024-09-19T07:20:19.536280+0000","last_active":"2024-09-19T07:22:03.813504+0000","last_peered":"2024-09-19T07:22:03.813504+0000","last_clean":"2024-09-19T07:22:03.813504+0000","last_became_active":"2024-09-19T07:20:19.535809+0000","last_became_peered":"2024-09-19T07:20:19.535809+0000","last_unstale":"2024-09-19T07:22:03.813504+0000","last_undegraded":"2024-09-19T07:22:03.813504+0000","last_fullsized":"2024-09-19T07:22:03.813504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:07.645476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.765247+0000","last_change":"2024-09-19T07:20:37.800603+0000","last_active":"2024-09-19T07:22:03.765247+0000","last_peered":"2024-09-19T07:22:03.765247+0000","last_clean":"2024-09-19T07:22:03.765247+0000","last_became_active":"2024-09-19T07:20:37.794728+0000","last_became_peered":"2024-09-19T07:20:37.794728+0000","last_unstale":"2024-09-19T07:22:03.765247+0000","last_undegraded":"2024-09-19T07:22:03.765247+0000","last_fullsized":"2024-09-19T07:22:03.765247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:46.606645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808940+0000","last_change":"2024-09-19T07:20:19.540203+0000","last_active":"2024-09-19T07:22:03.808940+0000","last_peered":"2024-09-19T07:22:03.808940+0000","last_clean":"2024-09-19T07:22:03.808940+0000","last_became_active":"2024-09-19T07:20:19.539813+0000","last_became_peered":"2024-09-19T07:20:19.539813+0000","last_unstale":"2024-09-19T07:22:03.808940+0000","last_undegraded":"2024-09-19T07:22:03.808940+0000","last_fullsized":"2024-09-19T07:22:03.808940+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:52.164881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.897290+0000","last_change":"2024-09-19T07:20:17.565449+0000","last_active":"2024-09-19T07:22:03.897290+0000","last_peered":"2024-09-19T07:22:03.897290+0000","last_clean":"2024-09-19T07:22:03.897290+0000","last_became_active":"2024-09-19T07:20:17.565079+0000","last_became_peered":"2024-09-19T07:20:17.565079+0000","last_unstale":"2024-09-19T07:22:03.897290+0000","last_undegraded":"2024-09-19T07:22:03.897290+0000","last_fullsized":"2024-09-19T07:22:03.897290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:50.791388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808040+0000","last_change":"2024-09-19T07:20:19.533817+0000","last_active":"2024-09-19T07:22:03.808040+0000","last_peered":"2024-09-19T07:22:03.808040+0000","last_clean":"2024-09-19T07:22:03.808040+0000","last_became_active":"2024-09-19T07:20:19.532144+0000","last_became_peered":"2024-09-19T07:20:19.532144+0000","last_unstale":"2024-09-19T07:22:03.808040+0000","last_undegraded":"2024-09-19T07:22:03.808040+0000","last_fullsized":"2024-09-19T07:22:03.808040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:18.928739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.779225+0000","last_change":"2024-09-19T07:20:17.514063+0000","last_active":"2024-09-19T07:22:03.779225+0000","last_peered":"2024-09-19T07:22:03.779225+0000","last_clean":"2024-09-19T07:22:03.779225+0000","last_became_active":"2024-09-19T07:20:17.513633+0000","last_became_peered":"2024-09-19T07:20:17.513633+0000","last_unstale":"2024-09-19T07:22:03.779225+0000","last_undegraded":"2024-09-19T07:22:03.779225+0000","last_fullsized":"2024-09-19T07:22:03.779225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:24.113053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815734+0000","last_change":"2024-09-19T07:20:19.540209+0000","last_active":"2024-09-19T07:22:03.815734+0000","last_peered":"2024-09-19T07:22:03.815734+0000","last_clean":"2024-09-19T07:22:03.815734+0000","last_became_active":"2024-09-19T07:20:19.539855+0000","last_became_peered":"2024-09-19T07:20:19.539855+0000","last_unstale":"2024-09-19T07:22:03.815734+0000","last_undegraded":"2024-09-19T07:22:03.815734+0000","last_fullsized":"2024-09-19T07:22:03.815734+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:40.878905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776263+0000","last_change":"2024-09-19T07:20:17.565627+0000","last_active":"2024-09-19T07:22:03.776263+0000","last_peered":"2024-09-19T07:22:03.776263+0000","last_clean":"2024-09-19T07:22:03.776263+0000","last_became_active":"2024-09-19T07:20:17.565231+0000","last_became_peered":"2024-09-19T07:20:17.565231+0000","last_unstale":"2024-09-19T07:22:03.776263+0000","last_undegraded":"2024-09-19T07:22:03.776263+0000","last_fullsized":"2024-09-19T07:22:03.776263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:53.105336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817750+0000","last_change":"2024-09-19T07:20:19.532418+0000","last_active":"2024-09-19T07:22:03.817750+0000","last_peered":"2024-09-19T07:22:03.817750+0000","last_clean":"2024-09-19T07:22:03.817750+0000","last_became_active":"2024-09-19T07:20:19.532113+0000","last_became_peered":"2024-09-19T07:20:19.532113+0000","last_unstale":"2024-09-19T07:22:03.817750+0000","last_undegraded":"2024-09-19T07:22:03.817750+0000","last_fullsized":"2024-09-19T07:22:03.817750+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:24.953720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775943+0000","last_change":"2024-09-19T07:20:17.565984+0000","last_active":"2024-09-19T07:22:03.775943+0000","last_peered":"2024-09-19T07:22:03.775943+0000","last_clean":"2024-09-19T07:22:03.775943+0000","last_became_active":"2024-09-19T07:20:17.565240+0000","last_became_peered":"2024-09-19T07:20:17.565240+0000","last_unstale":"2024-09-19T07:22:03.775943+0000","last_undegraded":"2024-09-19T07:22:03.775943+0000","last_fullsized":"2024-09-19T07:22:03.775943+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:07.906716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807964+0000","last_change":"2024-09-19T07:20:19.534400+0000","last_active":"2024-09-19T07:22:03.807964+0000","last_peered":"2024-09-19T07:22:03.807964+0000","last_clean":"2024-09-19T07:22:03.807964+0000","last_became_active":"2024-09-19T07:20:19.534130+0000","last_became_peered":"2024-09-19T07:20:19.534130+0000","last_unstale":"2024-09-19T07:22:03.807964+0000","last_undegraded":"2024-09-19T07:22:03.807964+0000","last_fullsized":"2024-09-19T07:22:03.807964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:09.398112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'47","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:04.038605+0000","last_change":"2024-09-19T07:20:17.519628+0000","last_active":"2024-09-19T07:22:04.038605+0000","last_peered":"2024-09-19T07:22:04.038605+0000","last_clean":"2024-09-19T07:22:04.038605+0000","last_became_active":"2024-09-19T07:20:17.519276+0000","last_became_peered":"2024-09-19T07:20:17.519276+0000","last_unstale":"2024-09-19T07:22:04.038605+0000","last_undegraded":"2024-09-19T07:22:04.038605+0000","last_fullsized":"2024-09-19T07:22:04.038605+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.193091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":85,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805204+0000","last_change":"2024-09-19T07:20:19.533425+0000","last_active":"2024-09-19T07:22:03.805204+0000","last_peered":"2024-09-19T07:22:03.805204+0000","last_clean":"2024-09-19T07:22:03.805204+0000","last_became_active":"2024-09-19T07:20:19.533142+0000","last_became_peered":"2024-09-19T07:20:19.533142+0000","last_unstale":"2024-09-19T07:22:03.805204+0000","last_undegraded":"2024-09-19T07:22:03.805204+0000","last_fullsized":"2024-09-19T07:22:03.805204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:07.048006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.763685+0000","last_change":"2024-09-19T07:20:17.512776+0000","last_active":"2024-09-19T07:22:03.763685+0000","last_peered":"2024-09-19T07:22:03.763685+0000","last_clean":"2024-09-19T07:22:03.763685+0000","last_became_active":"2024-09-19T07:20:17.511862+0000","last_became_peered":"2024-09-19T07:20:17.511862+0000","last_unstale":"2024-09-19T07:22:03.763685+0000","last_undegraded":"2024-09-19T07:22:03.763685+0000","last_fullsized":"2024-09-19T07:22:03.763685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:08.211654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817223+0000","last_change":"2024-09-19T07:20:19.539260+0000","last_active":"2024-09-19T07:22:03.817223+0000","last_peered":"2024-09-19T07:22:03.817223+0000","last_clean":"2024-09-19T07:22:03.817223+0000","last_became_active":"2024-09-19T07:20:19.538868+0000","last_became_peered":"2024-09-19T07:20:19.538868+0000","last_unstale":"2024-09-19T07:22:03.817223+0000","last_undegraded":"2024-09-19T07:22:03.817223+0000","last_fullsized":"2024-09-19T07:22:03.817223+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:44.198084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.772518+0000","last_change":"2024-09-19T07:20:17.565544+0000","last_active":"2024-09-19T07:22:03.772518+0000","last_peered":"2024-09-19T07:22:03.772518+0000","last_clean":"2024-09-19T07:22:03.772518+0000","last_became_active":"2024-09-19T07:20:17.565250+0000","last_became_peered":"2024-09-19T07:20:17.565250+0000","last_unstale":"2024-09-19T07:22:03.772518+0000","last_undegraded":"2024-09-19T07:22:03.772518+0000","last_fullsized":"2024-09-19T07:22:03.772518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:25.523136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.788564+0000","last_change":"2024-09-19T07:20:19.531467+0000","last_active":"2024-09-19T07:22:03.788564+0000","last_peered":"2024-09-19T07:22:03.788564+0000","last_clean":"2024-09-19T07:22:03.788564+0000","last_became_active":"2024-09-19T07:20:19.531170+0000","last_became_peered":"2024-09-19T07:20:19.531170+0000","last_unstale":"2024-09-19T07:22:03.788564+0000","last_undegraded":"2024-09-19T07:22:03.788564+0000","last_fullsized":"2024-09-19T07:22:03.788564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:23.113097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775823+0000","last_change":"2024-09-19T07:20:17.511400+0000","last_active":"2024-09-19T07:22:03.775823+0000","last_peered":"2024-09-19T07:22:03.775823+0000","last_clean":"2024-09-19T07:22:03.775823+0000","last_became_active":"2024-09-19T07:20:17.511126+0000","last_became_peered":"2024-09-19T07:20:17.511126+0000","last_unstale":"2024-09-19T07:22:03.775823+0000","last_undegraded":"2024-09-19T07:22:03.775823+0000","last_fullsized":"2024-09-19T07:22:03.775823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.485406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818052+0000","last_change":"2024-09-19T07:20:19.529171+0000","last_active":"2024-09-19T07:22:03.818052+0000","last_peered":"2024-09-19T07:22:03.818052+0000","last_clean":"2024-09-19T07:22:03.818052+0000","last_became_active":"2024-09-19T07:20:19.528489+0000","last_became_peered":"2024-09-19T07:20:19.528489+0000","last_unstale":"2024-09-19T07:22:03.818052+0000","last_undegraded":"2024-09-19T07:22:03.818052+0000","last_fullsized":"2024-09-19T07:22:03.818052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:10.842619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.765334+0000","last_change":"2024-09-19T07:20:37.803560+0000","last_active":"2024-09-19T07:22:03.765334+0000","last_peered":"2024-09-19T07:22:03.765334+0000","last_clean":"2024-09-19T07:22:03.765334+0000","last_became_active":"2024-09-19T07:20:37.797396+0000","last_became_peered":"2024-09-19T07:20:37.797396+0000","last_unstale":"2024-09-19T07:22:03.765334+0000","last_undegraded":"2024-09-19T07:22:03.765334+0000","last_fullsized":"2024-09-19T07:22:03.765334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:41.944179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818481+0000","last_change":"2024-09-19T07:20:19.532698+0000","last_active":"2024-09-19T07:22:03.818481+0000","last_peered":"2024-09-19T07:22:03.818481+0000","last_clean":"2024-09-19T07:22:03.818481+0000","last_became_active":"2024-09-19T07:20:19.531978+0000","last_became_peered":"2024-09-19T07:20:19.531978+0000","last_unstale":"2024-09-19T07:22:03.818481+0000","last_undegraded":"2024-09-19T07:22:03.818481+0000","last_fullsized":"2024-09-19T07:22:03.818481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:44.257024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775088+0000","last_change":"2024-09-19T07:20:17.525240+0000","last_active":"2024-09-19T07:22:03.775088+0000","last_peered":"2024-09-19T07:22:03.775088+0000","last_clean":"2024-09-19T07:22:03.775088+0000","last_became_active":"2024-09-19T07:20:17.524880+0000","last_became_peered":"2024-09-19T07:20:17.524880+0000","last_unstale":"2024-09-19T07:22:03.775088+0000","last_undegraded":"2024-09-19T07:22:03.775088+0000","last_fullsized":"2024-09-19T07:22:03.775088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:41.380246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815849+0000","last_change":"2024-09-19T07:20:19.537116+0000","last_active":"2024-09-19T07:22:03.815849+0000","last_peered":"2024-09-19T07:22:03.815849+0000","last_clean":"2024-09-19T07:22:03.815849+0000","last_became_active":"2024-09-19T07:20:19.536799+0000","last_became_peered":"2024-09-19T07:20:19.536799+0000","last_unstale":"2024-09-19T07:22:03.815849+0000","last_undegraded":"2024-09-19T07:22:03.815849+0000","last_fullsized":"2024-09-19T07:22:03.815849+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:48.401159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815875+0000","last_change":"2024-09-19T07:20:19.527965+0000","last_active":"2024-09-19T07:22:03.815875+0000","last_peered":"2024-09-19T07:22:03.815875+0000","last_clean":"2024-09-19T07:22:03.815875+0000","last_became_active":"2024-09-19T07:20:19.527522+0000","last_became_peered":"2024-09-19T07:20:19.527522+0000","last_unstale":"2024-09-19T07:22:03.815875+0000","last_undegraded":"2024-09-19T07:22:03.815875+0000","last_fullsized":"2024-09-19T07:22:03.815875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:16.034153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775281+0000","last_change":"2024-09-19T07:20:17.519400+0000","last_active":"2024-09-19T07:22:03.775281+0000","last_peered":"2024-09-19T07:22:03.775281+0000","last_clean":"2024-09-19T07:22:03.775281+0000","last_became_active":"2024-09-19T07:20:17.518993+0000","last_became_peered":"2024-09-19T07:20:17.518993+0000","last_unstale":"2024-09-19T07:22:03.775281+0000","last_undegraded":"2024-09-19T07:22:03.775281+0000","last_fullsized":"2024-09-19T07:22:03.775281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:37.086763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815623+0000","last_change":"2024-09-19T07:20:19.531016+0000","last_active":"2024-09-19T07:22:03.815623+0000","last_peered":"2024-09-19T07:22:03.815623+0000","last_clean":"2024-09-19T07:22:03.815623+0000","last_became_active":"2024-09-19T07:20:19.530706+0000","last_became_peered":"2024-09-19T07:20:19.530706+0000","last_unstale":"2024-09-19T07:22:03.815623+0000","last_undegraded":"2024-09-19T07:22:03.815623+0000","last_fullsized":"2024-09-19T07:22:03.815623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:36.566185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775906+0000","last_change":"2024-09-19T07:20:17.524215+0000","last_active":"2024-09-19T07:22:03.775906+0000","last_peered":"2024-09-19T07:22:03.775906+0000","last_clean":"2024-09-19T07:22:03.775906+0000","last_became_active":"2024-09-19T07:20:17.523813+0000","last_became_peered":"2024-09-19T07:20:17.523813+0000","last_unstale":"2024-09-19T07:22:03.775906+0000","last_undegraded":"2024-09-19T07:22:03.775906+0000","last_fullsized":"2024-09-19T07:22:03.775906+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:58.803225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.821404+0000","last_change":"2024-09-19T07:20:19.540994+0000","last_active":"2024-09-19T07:22:03.821404+0000","last_peered":"2024-09-19T07:22:03.821404+0000","last_clean":"2024-09-19T07:22:03.821404+0000","last_became_active":"2024-09-19T07:20:19.540703+0000","last_became_peered":"2024-09-19T07:20:19.540703+0000","last_unstale":"2024-09-19T07:22:03.821404+0000","last_undegraded":"2024-09-19T07:22:03.821404+0000","last_fullsized":"2024-09-19T07:22:03.821404+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:37.065187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775249+0000","last_change":"2024-09-19T07:20:17.565438+0000","last_active":"2024-09-19T07:22:03.775249+0000","last_peered":"2024-09-19T07:22:03.775249+0000","last_clean":"2024-09-19T07:22:03.775249+0000","last_became_active":"2024-09-19T07:20:17.565128+0000","last_became_peered":"2024-09-19T07:20:17.565128+0000","last_unstale":"2024-09-19T07:22:03.775249+0000","last_undegraded":"2024-09-19T07:22:03.775249+0000","last_fullsized":"2024-09-19T07:22:03.775249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:02.048971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810388+0000","last_change":"2024-09-19T07:20:37.794369+0000","last_active":"2024-09-19T07:22:03.810388+0000","last_peered":"2024-09-19T07:22:03.810388+0000","last_clean":"2024-09-19T07:22:03.810388+0000","last_became_active":"2024-09-19T07:20:37.794036+0000","last_became_peered":"2024-09-19T07:20:37.794036+0000","last_unstale":"2024-09-19T07:22:03.810388+0000","last_undegraded":"2024-09-19T07:22:03.810388+0000","last_fullsized":"2024-09-19T07:22:03.810388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:02.684191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.777038+0000","last_change":"2024-09-19T07:20:37.950846+0000","last_active":"2024-09-19T07:22:03.777038+0000","last_peered":"2024-09-19T07:22:03.777038+0000","last_clean":"2024-09-19T07:22:03.777038+0000","last_became_active":"2024-09-19T07:20:37.944266+0000","last_became_peered":"2024-09-19T07:20:37.944266+0000","last_unstale":"2024-09-19T07:22:03.777038+0000","last_undegraded":"2024-09-19T07:22:03.777038+0000","last_fullsized":"2024-09-19T07:22:03.777038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:12.952833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":596000,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":689,"num_read_kb":446,"num_write":287,"num_write_kb":1432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27529,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1788000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645346,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":437330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874278,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28776,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716376,"statfs":{"total":95995035648,"available":95965569024,"internally_reserved":0,"allocated":1732608,"data_stored":1226105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037802,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":437566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1302528,"data_stored":830120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1507328,"data_stored":1030119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659193,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":436955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888127,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1654784,"data_stored":1161010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":504847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247880,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1445888,"data_stored":962082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":438799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607634,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":966656,"data_stored":502442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":438226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":133777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:22:08.744 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T07:22:08.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.879+0000 7fc78a9cf640 1 -- 172.21.15.98:0/1993568076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc784107ac0 msgr2=0x7fc784107ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:08.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.879+0000 7fc78a9cf640 1 --2- 172.21.15.98:0/1993568076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc784107ac0 0x7fc784107ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc774009930 tx=0x7fc77402a420 comp rx=0 tx=0).stop 2024-09-19T07:22:08.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.879+0000 7fc78a9cf640 1 -- 172.21.15.98:0/1993568076 shutdown_connections 2024-09-19T07:22:08.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.879+0000 7fc78a9cf640 1 --2- 172.21.15.98:0/1993568076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc784102450 0x7fc78410e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.879+0000 7fc78a9cf640 1 --2- 172.21.15.98:0/1993568076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc784101ab0 0x7fc784101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.880 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.879+0000 7fc78a9cf640 1 --2- 172.21.15.98:0/1993568076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc784107ac0 0x7fc784107ea0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.879+0000 7fc78a9cf640 1 -- 172.21.15.98:0/1993568076 >> 172.21.15.98:0/1993568076 conn(0x7fc7840fd7d0 msgr2=0x7fc7840ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:08.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.879+0000 7fc78a9cf640 1 -- 172.21.15.98:0/1993568076 shutdown_connections 2024-09-19T07:22:08.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.879+0000 7fc78a9cf640 1 -- 172.21.15.98:0/1993568076 wait complete. 2024-09-19T07:22:08.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc78a9cf640 1 Processor -- start 2024-09-19T07:22:08.881 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc78a9cf640 1 -- start start 2024-09-19T07:22:08.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc78a9cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc784101ab0 0x7fc784198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:08.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc78a9cf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc784102450 0x7fc7841988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:08.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc78a9cf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc784107ac0 0x7fc78419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:08.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc78a9cf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc784111ec0 con 0x7fc784107ac0 2024-09-19T07:22:08.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc78a9cf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc784111d40 con 0x7fc784102450 2024-09-19T07:22:08.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc78a9cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc784112040 con 0x7fc784101ab0 2024-09-19T07:22:08.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc788f6c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc784107ac0 0x7fc78419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:08.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc788f6c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc784107ac0 0x7fc78419cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59892/0 (socket says 172.21.15.98:59892) 2024-09-19T07:22:08.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc788f6c640 1 -- 172.21.15.98:0/3924868387 learned_addr learned my addr 172.21.15.98:0/3924868387 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc783fff640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc784101ab0 0x7fc784198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc7837fe640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc784102450 0x7fc7841988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc788f6c640 1 -- 172.21.15.98:0/3924868387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc784101ab0 msgr2=0x7fc784198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc788f6c640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc784101ab0 0x7fc784198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc788f6c640 1 -- 172.21.15.98:0/3924868387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc784102450 msgr2=0x7fc7841988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc788f6c640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc784102450 0x7fc7841988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc788f6c640 1 -- 172.21.15.98:0/3924868387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78419d380 con 0x7fc784107ac0 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc7837fe640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc784102450 0x7fc7841988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.880+0000 7fc783fff640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc784101ab0 0x7fc784198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.881+0000 7fc788f6c640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc784107ac0 0x7fc78419cc50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00eaa0 tx=0x7fc77c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.881+0000 7fc7817fa640 1 -- 172.21.15.98:0/3924868387 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c00cdb0 con 0x7fc784107ac0 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.881+0000 7fc7817fa640 1 -- 172.21.15.98:0/3924868387 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc77c005020 con 0x7fc784107ac0 2024-09-19T07:22:08.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.881+0000 7fc78a9cf640 1 -- 172.21.15.98:0/3924868387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc78419d670 con 0x7fc784107ac0 2024-09-19T07:22:08.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.881+0000 7fc7817fa640 1 -- 172.21.15.98:0/3924868387 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77c0116b0 con 0x7fc784107ac0 2024-09-19T07:22:08.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.881+0000 7fc78a9cf640 1 -- 172.21.15.98:0/3924868387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7841a4f00 con 0x7fc784107ac0 2024-09-19T07:22:08.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.882+0000 7fc78a9cf640 1 -- 172.21.15.98:0/3924868387 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc784101f10 con 0x7fc784107ac0 2024-09-19T07:22:08.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.883+0000 7fc7817fa640 1 -- 172.21.15.98:0/3924868387 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fc77c005560 con 0x7fc784107ac0 2024-09-19T07:22:08.885 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.884+0000 7fc7817fa640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc76c0a34e0 0x7fc76c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:08.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.884+0000 7fc783fff640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc76c0a34e0 0x7fc76c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:08.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.884+0000 7fc7817fa640 1 -- 172.21.15.98:0/3924868387 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc77c0d02c0 con 0x7fc784107ac0 2024-09-19T07:22:08.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.884+0000 7fc783fff640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc76c0a34e0 0x7fc76c0a59a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc774000c00 tx=0x7fc774005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:08.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:08.888+0000 7fc7817fa640 1 -- 172.21.15.98:0/3924868387 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc77c016030 con 0x7fc784107ac0 2024-09-19T07:22:09.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:08 smithi098 ceph-mon[30950]: Updating smithi139:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:22:09.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:08 smithi098 ceph-mon[30950]: Updating smithi098:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:22:09.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:08 smithi098 ceph-mon[30950]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:22:09.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:08 smithi098 ceph-mon[30950]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:22:09.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:08 smithi098 ceph-mon[30950]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:22:09.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:08 smithi098 ceph-mon[30950]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:22:09.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:08 smithi098 ceph-mon[30950]: Updating smithi098:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:22:09.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:08 smithi098 ceph-mon[30950]: Updating smithi139:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:22:09.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:08 smithi098 ceph-mon[30950]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:22:09.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:08 smithi098 ceph-mon[30950]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:22:09.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:08 smithi098 ceph-mon[30950]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-19T07:22:09.052 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.052+0000 7fc78a9cf640 1 -- 172.21.15.98:0/3924868387 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc784062630 con 0x7fc76c0a34e0 2024-09-19T07:22:09.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.058+0000 7fc7817fa640 1 -- 172.21.15.98:0/3924868387 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257863 (secure 0 0 0) 0x7fc784062630 con 0x7fc76c0a34e0 2024-09-19T07:22:09.061 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:09.062 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-19T07:22:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.061+0000 7fc78a9cf640 1 -- 172.21.15.98:0/3924868387 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc76c0a34e0 msgr2=0x7fc76c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.061+0000 7fc78a9cf640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc76c0a34e0 0x7fc76c0a59a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc774000c00 tx=0x7fc774005a20 comp rx=0 tx=0).stop 2024-09-19T07:22:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.061+0000 7fc78a9cf640 1 -- 172.21.15.98:0/3924868387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc784107ac0 msgr2=0x7fc78419cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.061+0000 7fc78a9cf640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc784107ac0 0x7fc78419cc50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00eaa0 tx=0x7fc77c00ef60 comp rx=0 tx=0).stop 2024-09-19T07:22:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.061+0000 7fc78a9cf640 1 -- 172.21.15.98:0/3924868387 shutdown_connections 2024-09-19T07:22:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.061+0000 7fc78a9cf640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc76c0a34e0 0x7fc76c0a59a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.061+0000 7fc78a9cf640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc784107ac0 0x7fc78419cc50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.061+0000 7fc78a9cf640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc784102450 0x7fc7841988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.061+0000 7fc78a9cf640 1 --2- 172.21.15.98:0/3924868387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc784101ab0 0x7fc784198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.061+0000 7fc78a9cf640 1 -- 172.21.15.98:0/3924868387 >> 172.21.15.98:0/3924868387 conn(0x7fc7840fd7d0 msgr2=0x7fc7840fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:09.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.061+0000 7fc78a9cf640 1 -- 172.21.15.98:0/3924868387 shutdown_connections 2024-09-19T07:22:09.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.061+0000 7fc78a9cf640 1 -- 172.21.15.98:0/3924868387 wait complete. 2024-09-19T07:22:09.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:08 smithi139 ceph-mon[35039]: Updating smithi139:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:22:09.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:08 smithi139 ceph-mon[35039]: Updating smithi098:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:22:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:08 smithi139 ceph-mon[35039]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:22:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:08 smithi139 ceph-mon[35039]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:22:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:08 smithi139 ceph-mon[35039]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:22:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:08 smithi139 ceph-mon[35039]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:22:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:08 smithi139 ceph-mon[35039]: Updating smithi098:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:22:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:08 smithi139 ceph-mon[35039]: Updating smithi139:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:22:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:08 smithi139 ceph-mon[35039]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:22:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:08 smithi139 ceph-mon[35039]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:22:09.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:08 smithi139 ceph-mon[35039]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-19T07:22:09.072 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T07:22:07.774281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1186602,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":825,"num_read_kb":565,"num_write":470,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1208265,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":354840,"kb_used_data":13816,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124586984,"statfs":{"total":1151940427776,"available":1151577071616,"internally_reserved":0,"allocated":14147584,"data_stored":8405601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.990567"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816102+0000","last_change":"2024-09-19T07:20:19.535372+0000","last_active":"2024-09-19T07:22:03.816102+0000","last_peered":"2024-09-19T07:22:03.816102+0000","last_clean":"2024-09-19T07:22:03.816102+0000","last_became_active":"2024-09-19T07:20:19.535079+0000","last_became_peered":"2024-09-19T07:20:19.535079+0000","last_unstale":"2024-09-19T07:22:03.816102+0000","last_undegraded":"2024-09-19T07:22:03.816102+0000","last_fullsized":"2024-09-19T07:22:03.816102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:56.856451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815671+0000","last_change":"2024-09-19T07:20:19.528531+0000","last_active":"2024-09-19T07:22:03.815671+0000","last_peered":"2024-09-19T07:22:03.815671+0000","last_clean":"2024-09-19T07:22:03.815671+0000","last_became_active":"2024-09-19T07:20:19.528218+0000","last_became_peered":"2024-09-19T07:20:19.528218+0000","last_unstale":"2024-09-19T07:22:03.815671+0000","last_undegraded":"2024-09-19T07:22:03.815671+0000","last_fullsized":"2024-09-19T07:22:03.815671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:44.730220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818254+0000","last_change":"2024-09-19T07:20:19.533516+0000","last_active":"2024-09-19T07:22:03.818254+0000","last_peered":"2024-09-19T07:22:03.818254+0000","last_clean":"2024-09-19T07:22:03.818254+0000","last_became_active":"2024-09-19T07:20:19.533247+0000","last_became_peered":"2024-09-19T07:20:19.533247+0000","last_unstale":"2024-09-19T07:22:03.818254+0000","last_undegraded":"2024-09-19T07:22:03.818254+0000","last_fullsized":"2024-09-19T07:22:03.818254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:29.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810373+0000","last_change":"2024-09-19T07:20:19.543245+0000","last_active":"2024-09-19T07:22:03.810373+0000","last_peered":"2024-09-19T07:22:03.810373+0000","last_clean":"2024-09-19T07:22:03.810373+0000","last_became_active":"2024-09-19T07:20:19.542840+0000","last_became_peered":"2024-09-19T07:20:19.542840+0000","last_unstale":"2024-09-19T07:22:03.810373+0000","last_undegraded":"2024-09-19T07:22:03.810373+0000","last_fullsized":"2024-09-19T07:22:03.810373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:21.780027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.794220+0000","last_change":"2024-09-19T07:20:19.528880+0000","last_active":"2024-09-19T07:22:03.794220+0000","last_peered":"2024-09-19T07:22:03.794220+0000","last_clean":"2024-09-19T07:22:03.794220+0000","last_became_active":"2024-09-19T07:20:19.528592+0000","last_became_peered":"2024-09-19T07:20:19.528592+0000","last_unstale":"2024-09-19T07:22:03.794220+0000","last_undegraded":"2024-09-19T07:22:03.794220+0000","last_fullsized":"2024-09-19T07:22:03.794220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:59.718929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805549+0000","last_change":"2024-09-19T07:20:19.538480+0000","last_active":"2024-09-19T07:22:03.805549+0000","last_peered":"2024-09-19T07:22:03.805549+0000","last_clean":"2024-09-19T07:22:03.805549+0000","last_became_active":"2024-09-19T07:20:19.538189+0000","last_became_peered":"2024-09-19T07:20:19.538189+0000","last_unstale":"2024-09-19T07:22:03.805549+0000","last_undegraded":"2024-09-19T07:22:03.805549+0000","last_fullsized":"2024-09-19T07:22:03.805549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:29.607974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813603+0000","last_change":"2024-09-19T07:20:19.538877+0000","last_active":"2024-09-19T07:22:03.813603+0000","last_peered":"2024-09-19T07:22:03.813603+0000","last_clean":"2024-09-19T07:22:03.813603+0000","last_became_active":"2024-09-19T07:20:19.538551+0000","last_became_peered":"2024-09-19T07:20:19.538551+0000","last_unstale":"2024-09-19T07:22:03.813603+0000","last_undegraded":"2024-09-19T07:22:03.813603+0000","last_fullsized":"2024-09-19T07:22:03.813603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:52.114115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.819590+0000","last_change":"2024-09-19T07:20:19.538135+0000","last_active":"2024-09-19T07:22:03.819590+0000","last_peered":"2024-09-19T07:22:03.819590+0000","last_clean":"2024-09-19T07:22:03.819590+0000","last_became_active":"2024-09-19T07:20:19.537769+0000","last_became_peered":"2024-09-19T07:20:19.537769+0000","last_unstale":"2024-09-19T07:22:03.819590+0000","last_undegraded":"2024-09-19T07:22:03.819590+0000","last_fullsized":"2024-09-19T07:22:03.819590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:21.304262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814166+0000","last_change":"2024-09-19T07:20:19.531569+0000","last_active":"2024-09-19T07:22:03.814166+0000","last_peered":"2024-09-19T07:22:03.814166+0000","last_clean":"2024-09-19T07:22:03.814166+0000","last_became_active":"2024-09-19T07:20:19.529455+0000","last_became_peered":"2024-09-19T07:20:19.529455+0000","last_unstale":"2024-09-19T07:22:03.814166+0000","last_undegraded":"2024-09-19T07:22:03.814166+0000","last_fullsized":"2024-09-19T07:22:03.814166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:22.187968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807215+0000","last_change":"2024-09-19T07:20:19.540342+0000","last_active":"2024-09-19T07:22:03.807215+0000","last_peered":"2024-09-19T07:22:03.807215+0000","last_clean":"2024-09-19T07:22:03.807215+0000","last_became_active":"2024-09-19T07:20:19.539870+0000","last_became_peered":"2024-09-19T07:20:19.539870+0000","last_unstale":"2024-09-19T07:22:03.807215+0000","last_undegraded":"2024-09-19T07:22:03.807215+0000","last_fullsized":"2024-09-19T07:22:03.807215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:39.930671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803048+0000","last_change":"2024-09-19T07:20:19.536004+0000","last_active":"2024-09-19T07:22:03.803048+0000","last_peered":"2024-09-19T07:22:03.803048+0000","last_clean":"2024-09-19T07:22:03.803048+0000","last_became_active":"2024-09-19T07:20:19.535640+0000","last_became_peered":"2024-09-19T07:20:19.535640+0000","last_unstale":"2024-09-19T07:22:03.803048+0000","last_undegraded":"2024-09-19T07:22:03.803048+0000","last_fullsized":"2024-09-19T07:22:03.803048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:47.853411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.806987+0000","last_change":"2024-09-19T07:20:19.539374+0000","last_active":"2024-09-19T07:22:03.806987+0000","last_peered":"2024-09-19T07:22:03.806987+0000","last_clean":"2024-09-19T07:22:03.806987+0000","last_became_active":"2024-09-19T07:20:19.538880+0000","last_became_peered":"2024-09-19T07:20:19.538880+0000","last_unstale":"2024-09-19T07:22:03.806987+0000","last_undegraded":"2024-09-19T07:22:03.806987+0000","last_fullsized":"2024-09-19T07:22:03.806987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:55.484232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.806269+0000","last_change":"2024-09-19T07:20:37.792753+0000","last_active":"2024-09-19T07:22:03.806269+0000","last_peered":"2024-09-19T07:22:03.806269+0000","last_clean":"2024-09-19T07:22:03.806269+0000","last_became_active":"2024-09-19T07:20:37.792417+0000","last_became_peered":"2024-09-19T07:20:37.792417+0000","last_unstale":"2024-09-19T07:22:03.806269+0000","last_undegraded":"2024-09-19T07:22:03.806269+0000","last_fullsized":"2024-09-19T07:22:03.806269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:10.417367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816028+0000","last_change":"2024-09-19T07:20:19.528842+0000","last_active":"2024-09-19T07:22:03.816028+0000","last_peered":"2024-09-19T07:22:03.816028+0000","last_clean":"2024-09-19T07:22:03.816028+0000","last_became_active":"2024-09-19T07:20:19.528042+0000","last_became_peered":"2024-09-19T07:20:19.528042+0000","last_unstale":"2024-09-19T07:22:03.816028+0000","last_undegraded":"2024-09-19T07:22:03.816028+0000","last_fullsized":"2024-09-19T07:22:03.816028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:34.970509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817953+0000","last_change":"2024-09-19T07:20:19.535013+0000","last_active":"2024-09-19T07:22:03.817953+0000","last_peered":"2024-09-19T07:22:03.817953+0000","last_clean":"2024-09-19T07:22:03.817953+0000","last_became_active":"2024-09-19T07:20:19.534302+0000","last_became_peered":"2024-09-19T07:20:19.534302+0000","last_unstale":"2024-09-19T07:22:03.817953+0000","last_undegraded":"2024-09-19T07:22:03.817953+0000","last_fullsized":"2024-09-19T07:22:03.817953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:52.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812766+0000","last_change":"2024-09-19T07:20:19.534930+0000","last_active":"2024-09-19T07:22:03.812766+0000","last_peered":"2024-09-19T07:22:03.812766+0000","last_clean":"2024-09-19T07:22:03.812766+0000","last_became_active":"2024-09-19T07:20:19.534640+0000","last_became_peered":"2024-09-19T07:20:19.534640+0000","last_unstale":"2024-09-19T07:22:03.812766+0000","last_undegraded":"2024-09-19T07:22:03.812766+0000","last_fullsized":"2024-09-19T07:22:03.812766+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:23.055097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818341+0000","last_change":"2024-09-19T07:20:19.535856+0000","last_active":"2024-09-19T07:22:03.818341+0000","last_peered":"2024-09-19T07:22:03.818341+0000","last_clean":"2024-09-19T07:22:03.818341+0000","last_became_active":"2024-09-19T07:20:19.535561+0000","last_became_peered":"2024-09-19T07:20:19.535561+0000","last_unstale":"2024-09-19T07:22:03.818341+0000","last_undegraded":"2024-09-19T07:22:03.818341+0000","last_fullsized":"2024-09-19T07:22:03.818341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:03.943339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812865+0000","last_change":"2024-09-19T07:20:19.528429+0000","last_active":"2024-09-19T07:22:03.812865+0000","last_peered":"2024-09-19T07:22:03.812865+0000","last_clean":"2024-09-19T07:22:03.812865+0000","last_became_active":"2024-09-19T07:20:19.528107+0000","last_became_peered":"2024-09-19T07:20:19.528107+0000","last_unstale":"2024-09-19T07:22:03.812865+0000","last_undegraded":"2024-09-19T07:22:03.812865+0000","last_fullsized":"2024-09-19T07:22:03.812865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:49.520514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818269+0000","last_change":"2024-09-19T07:20:19.532966+0000","last_active":"2024-09-19T07:22:03.818269+0000","last_peered":"2024-09-19T07:22:03.818269+0000","last_clean":"2024-09-19T07:22:03.818269+0000","last_became_active":"2024-09-19T07:20:19.532412+0000","last_became_peered":"2024-09-19T07:20:19.532412+0000","last_unstale":"2024-09-19T07:22:03.818269+0000","last_undegraded":"2024-09-19T07:22:03.818269+0000","last_fullsized":"2024-09-19T07:22:03.818269+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:42.900136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.800966+0000","last_change":"2024-09-19T07:20:37.797952+0000","last_active":"2024-09-19T07:22:03.800966+0000","last_peered":"2024-09-19T07:22:03.800966+0000","last_clean":"2024-09-19T07:22:03.800966+0000","last_became_active":"2024-09-19T07:20:37.797459+0000","last_became_peered":"2024-09-19T07:20:37.797459+0000","last_unstale":"2024-09-19T07:22:03.800966+0000","last_undegraded":"2024-09-19T07:22:03.800966+0000","last_fullsized":"2024-09-19T07:22:03.800966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:44.132477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818884+0000","last_change":"2024-09-19T07:20:19.532193+0000","last_active":"2024-09-19T07:22:03.818884+0000","last_peered":"2024-09-19T07:22:03.818884+0000","last_clean":"2024-09-19T07:22:03.818884+0000","last_became_active":"2024-09-19T07:20:19.531890+0000","last_became_peered":"2024-09-19T07:20:19.531890+0000","last_unstale":"2024-09-19T07:22:03.818884+0000","last_undegraded":"2024-09-19T07:22:03.818884+0000","last_fullsized":"2024-09-19T07:22:03.818884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:21.168993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815073+0000","last_change":"2024-09-19T07:20:19.535034+0000","last_active":"2024-09-19T07:22:03.815073+0000","last_peered":"2024-09-19T07:22:03.815073+0000","last_clean":"2024-09-19T07:22:03.815073+0000","last_became_active":"2024-09-19T07:20:19.534732+0000","last_became_peered":"2024-09-19T07:20:19.534732+0000","last_unstale":"2024-09-19T07:22:03.815073+0000","last_undegraded":"2024-09-19T07:22:03.815073+0000","last_fullsized":"2024-09-19T07:22:03.815073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:13.726672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817072+0000","last_change":"2024-09-19T07:20:19.532644+0000","last_active":"2024-09-19T07:22:03.817072+0000","last_peered":"2024-09-19T07:22:03.817072+0000","last_clean":"2024-09-19T07:22:03.817072+0000","last_became_active":"2024-09-19T07:20:19.532364+0000","last_became_peered":"2024-09-19T07:20:19.532364+0000","last_unstale":"2024-09-19T07:22:03.817072+0000","last_undegraded":"2024-09-19T07:22:03.817072+0000","last_fullsized":"2024-09-19T07:22:03.817072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:17.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814164+0000","last_change":"2024-09-19T07:20:19.533500+0000","last_active":"2024-09-19T07:22:03.814164+0000","last_peered":"2024-09-19T07:22:03.814164+0000","last_clean":"2024-09-19T07:22:03.814164+0000","last_became_active":"2024-09-19T07:20:19.532759+0000","last_became_peered":"2024-09-19T07:20:19.532759+0000","last_unstale":"2024-09-19T07:22:03.814164+0000","last_undegraded":"2024-09-19T07:22:03.814164+0000","last_fullsized":"2024-09-19T07:22:03.814164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:35.549776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815771+0000","last_change":"2024-09-19T07:20:37.793776+0000","last_active":"2024-09-19T07:22:03.815771+0000","last_peered":"2024-09-19T07:22:03.815771+0000","last_clean":"2024-09-19T07:22:03.815771+0000","last_became_active":"2024-09-19T07:20:37.793382+0000","last_became_peered":"2024-09-19T07:20:37.793382+0000","last_unstale":"2024-09-19T07:22:03.815771+0000","last_undegraded":"2024-09-19T07:22:03.815771+0000","last_fullsized":"2024-09-19T07:22:03.815771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:00.422534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803532+0000","last_change":"2024-09-19T07:20:19.532840+0000","last_active":"2024-09-19T07:22:03.803532+0000","last_peered":"2024-09-19T07:22:03.803532+0000","last_clean":"2024-09-19T07:22:03.803532+0000","last_became_active":"2024-09-19T07:20:19.532059+0000","last_became_peered":"2024-09-19T07:20:19.532059+0000","last_unstale":"2024-09-19T07:22:03.803532+0000","last_undegraded":"2024-09-19T07:22:03.803532+0000","last_fullsized":"2024-09-19T07:22:03.803532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:49.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.802328+0000","last_change":"2024-09-19T07:20:19.528150+0000","last_active":"2024-09-19T07:22:03.802328+0000","last_peered":"2024-09-19T07:22:03.802328+0000","last_clean":"2024-09-19T07:22:03.802328+0000","last_became_active":"2024-09-19T07:20:19.527873+0000","last_became_peered":"2024-09-19T07:20:19.527873+0000","last_unstale":"2024-09-19T07:22:03.802328+0000","last_undegraded":"2024-09-19T07:22:03.802328+0000","last_fullsized":"2024-09-19T07:22:03.802328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.561937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808779+0000","last_change":"2024-09-19T07:20:19.540160+0000","last_active":"2024-09-19T07:22:03.808779+0000","last_peered":"2024-09-19T07:22:03.808779+0000","last_clean":"2024-09-19T07:22:03.808779+0000","last_became_active":"2024-09-19T07:20:19.539862+0000","last_became_peered":"2024-09-19T07:20:19.539862+0000","last_unstale":"2024-09-19T07:22:03.808779+0000","last_undegraded":"2024-09-19T07:22:03.808779+0000","last_fullsized":"2024-09-19T07:22:03.808779+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:22.229785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.820657+0000","last_change":"2024-09-19T07:20:19.540363+0000","last_active":"2024-09-19T07:22:03.820657+0000","last_peered":"2024-09-19T07:22:03.820657+0000","last_clean":"2024-09-19T07:22:03.820657+0000","last_became_active":"2024-09-19T07:20:19.540068+0000","last_became_peered":"2024-09-19T07:20:19.540068+0000","last_unstale":"2024-09-19T07:22:03.820657+0000","last_undegraded":"2024-09-19T07:22:03.820657+0000","last_fullsized":"2024-09-19T07:22:03.820657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:07.955849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818258+0000","last_change":"2024-09-19T07:20:19.533546+0000","last_active":"2024-09-19T07:22:03.818258+0000","last_peered":"2024-09-19T07:22:03.818258+0000","last_clean":"2024-09-19T07:22:03.818258+0000","last_became_active":"2024-09-19T07:20:19.533232+0000","last_became_peered":"2024-09-19T07:20:19.533232+0000","last_unstale":"2024-09-19T07:22:03.818258+0000","last_undegraded":"2024-09-19T07:22:03.818258+0000","last_fullsized":"2024-09-19T07:22:03.818258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:29.674866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807595+0000","last_change":"2024-09-19T07:20:19.542842+0000","last_active":"2024-09-19T07:22:03.807595+0000","last_peered":"2024-09-19T07:22:03.807595+0000","last_clean":"2024-09-19T07:22:03.807595+0000","last_became_active":"2024-09-19T07:20:19.542477+0000","last_became_peered":"2024-09-19T07:20:19.542477+0000","last_unstale":"2024-09-19T07:22:03.807595+0000","last_undegraded":"2024-09-19T07:22:03.807595+0000","last_fullsized":"2024-09-19T07:22:03.807595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:30.921099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803673+0000","last_change":"2024-09-19T07:20:19.530472+0000","last_active":"2024-09-19T07:22:03.803673+0000","last_peered":"2024-09-19T07:22:03.803673+0000","last_clean":"2024-09-19T07:22:03.803673+0000","last_became_active":"2024-09-19T07:20:19.529457+0000","last_became_peered":"2024-09-19T07:20:19.529457+0000","last_unstale":"2024-09-19T07:22:03.803673+0000","last_undegraded":"2024-09-19T07:22:03.803673+0000","last_fullsized":"2024-09-19T07:22:03.803673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:16.410723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803010+0000","last_change":"2024-09-19T07:20:37.801168+0000","last_active":"2024-09-19T07:22:03.803010+0000","last_peered":"2024-09-19T07:22:03.803010+0000","last_clean":"2024-09-19T07:22:03.803010+0000","last_became_active":"2024-09-19T07:20:37.800613+0000","last_became_peered":"2024-09-19T07:20:37.800613+0000","last_unstale":"2024-09-19T07:22:03.803010+0000","last_undegraded":"2024-09-19T07:22:03.803010+0000","last_fullsized":"2024-09-19T07:22:03.803010+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:27.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'7","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.898326+0000","last_change":"2024-09-19T07:20:17.524656+0000","last_active":"2024-09-19T07:22:03.898326+0000","last_peered":"2024-09-19T07:22:03.898326+0000","last_clean":"2024-09-19T07:22:03.898326+0000","last_became_active":"2024-09-19T07:20:17.524350+0000","last_became_peered":"2024-09-19T07:20:17.524350+0000","last_unstale":"2024-09-19T07:22:03.898326+0000","last_undegraded":"2024-09-19T07:22:03.898326+0000","last_fullsized":"2024-09-19T07:22:03.898326+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:00.459283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810877+0000","last_change":"2024-09-19T07:20:19.536895+0000","last_active":"2024-09-19T07:22:03.810877+0000","last_peered":"2024-09-19T07:22:03.810877+0000","last_clean":"2024-09-19T07:22:03.810877+0000","last_became_active":"2024-09-19T07:20:19.536569+0000","last_became_peered":"2024-09-19T07:20:19.536569+0000","last_unstale":"2024-09-19T07:22:03.810877+0000","last_undegraded":"2024-09-19T07:22:03.810877+0000","last_fullsized":"2024-09-19T07:22:03.810877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:56.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.770907+0000","last_change":"2024-09-19T07:20:17.519800+0000","last_active":"2024-09-19T07:22:03.770907+0000","last_peered":"2024-09-19T07:22:03.770907+0000","last_clean":"2024-09-19T07:22:03.770907+0000","last_became_active":"2024-09-19T07:20:17.519384+0000","last_became_peered":"2024-09-19T07:20:17.519384+0000","last_unstale":"2024-09-19T07:22:03.770907+0000","last_undegraded":"2024-09-19T07:22:03.770907+0000","last_fullsized":"2024-09-19T07:22:03.770907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:17.346946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.761997+0000","last_change":"2024-09-19T07:20:17.511178+0000","last_active":"2024-09-19T07:22:03.761997+0000","last_peered":"2024-09-19T07:22:03.761997+0000","last_clean":"2024-09-19T07:22:03.761997+0000","last_became_active":"2024-09-19T07:20:17.510646+0000","last_became_peered":"2024-09-19T07:20:17.510646+0000","last_unstale":"2024-09-19T07:22:03.761997+0000","last_undegraded":"2024-09-19T07:22:03.761997+0000","last_fullsized":"2024-09-19T07:22:03.761997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:58.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.804119+0000","last_change":"2024-09-19T07:20:19.532979+0000","last_active":"2024-09-19T07:22:03.804119+0000","last_peered":"2024-09-19T07:22:03.804119+0000","last_clean":"2024-09-19T07:22:03.804119+0000","last_became_active":"2024-09-19T07:20:19.532396+0000","last_became_peered":"2024-09-19T07:20:19.532396+0000","last_unstale":"2024-09-19T07:22:03.804119+0000","last_undegraded":"2024-09-19T07:22:03.804119+0000","last_fullsized":"2024-09-19T07:22:03.804119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:24.313572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.781655+0000","last_change":"2024-09-19T07:20:17.519327+0000","last_active":"2024-09-19T07:22:03.781655+0000","last_peered":"2024-09-19T07:22:03.781655+0000","last_clean":"2024-09-19T07:22:03.781655+0000","last_became_active":"2024-09-19T07:20:17.518916+0000","last_became_peered":"2024-09-19T07:20:17.518916+0000","last_unstale":"2024-09-19T07:22:03.781655+0000","last_undegraded":"2024-09-19T07:22:03.781655+0000","last_fullsized":"2024-09-19T07:22:03.781655+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:52.672016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814641+0000","last_change":"2024-09-19T07:20:19.528642+0000","last_active":"2024-09-19T07:22:03.814641+0000","last_peered":"2024-09-19T07:22:03.814641+0000","last_clean":"2024-09-19T07:22:03.814641+0000","last_became_active":"2024-09-19T07:20:19.528302+0000","last_became_peered":"2024-09-19T07:20:19.528302+0000","last_unstale":"2024-09-19T07:22:03.814641+0000","last_undegraded":"2024-09-19T07:22:03.814641+0000","last_fullsized":"2024-09-19T07:22:03.814641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:22.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.770981+0000","last_change":"2024-09-19T07:20:17.519144+0000","last_active":"2024-09-19T07:22:03.770981+0000","last_peered":"2024-09-19T07:22:03.770981+0000","last_clean":"2024-09-19T07:22:03.770981+0000","last_became_active":"2024-09-19T07:20:17.518714+0000","last_became_peered":"2024-09-19T07:20:17.518714+0000","last_unstale":"2024-09-19T07:22:03.770981+0000","last_undegraded":"2024-09-19T07:22:03.770981+0000","last_fullsized":"2024-09-19T07:22:03.770981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:09.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808858+0000","last_change":"2024-09-19T07:20:19.532293+0000","last_active":"2024-09-19T07:22:03.808858+0000","last_peered":"2024-09-19T07:22:03.808858+0000","last_clean":"2024-09-19T07:22:03.808858+0000","last_became_active":"2024-09-19T07:20:19.531427+0000","last_became_peered":"2024-09-19T07:20:19.531427+0000","last_unstale":"2024-09-19T07:22:03.808858+0000","last_undegraded":"2024-09-19T07:22:03.808858+0000","last_fullsized":"2024-09-19T07:22:03.808858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:31.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776705+0000","last_change":"2024-09-19T07:20:17.521743+0000","last_active":"2024-09-19T07:22:03.776705+0000","last_peered":"2024-09-19T07:22:03.776705+0000","last_clean":"2024-09-19T07:22:03.776705+0000","last_became_active":"2024-09-19T07:20:17.521321+0000","last_became_peered":"2024-09-19T07:20:17.521321+0000","last_unstale":"2024-09-19T07:22:03.776705+0000","last_undegraded":"2024-09-19T07:22:03.776705+0000","last_fullsized":"2024-09-19T07:22:03.776705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:21.107210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.821636+0000","last_change":"2024-09-19T07:20:19.532879+0000","last_active":"2024-09-19T07:22:03.821636+0000","last_peered":"2024-09-19T07:22:03.821636+0000","last_clean":"2024-09-19T07:22:03.821636+0000","last_became_active":"2024-09-19T07:20:19.532490+0000","last_became_peered":"2024-09-19T07:20:19.532490+0000","last_unstale":"2024-09-19T07:22:03.821636+0000","last_undegraded":"2024-09-19T07:22:03.821636+0000","last_fullsized":"2024-09-19T07:22:03.821636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:06.534849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.782814+0000","last_change":"2024-09-19T07:20:17.565759+0000","last_active":"2024-09-19T07:22:03.782814+0000","last_peered":"2024-09-19T07:22:03.782814+0000","last_clean":"2024-09-19T07:22:03.782814+0000","last_became_active":"2024-09-19T07:20:17.565334+0000","last_became_peered":"2024-09-19T07:20:17.565334+0000","last_unstale":"2024-09-19T07:22:03.782814+0000","last_undegraded":"2024-09-19T07:22:03.782814+0000","last_fullsized":"2024-09-19T07:22:03.782814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.588515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812382+0000","last_change":"2024-09-19T07:20:19.537397+0000","last_active":"2024-09-19T07:22:03.812382+0000","last_peered":"2024-09-19T07:22:03.812382+0000","last_clean":"2024-09-19T07:22:03.812382+0000","last_became_active":"2024-09-19T07:20:19.537059+0000","last_became_peered":"2024-09-19T07:20:19.537059+0000","last_unstale":"2024-09-19T07:22:03.812382+0000","last_undegraded":"2024-09-19T07:22:03.812382+0000","last_fullsized":"2024-09-19T07:22:03.812382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:30.146934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'34","reported_seq":277,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:04.080426+0000","last_change":"2024-09-19T07:20:37.956721+0000","last_active":"2024-09-19T07:22:04.080426+0000","last_peered":"2024-09-19T07:22:04.080426+0000","last_clean":"2024-09-19T07:22:04.080426+0000","last_became_active":"2024-09-19T07:20:37.944159+0000","last_became_peered":"2024-09-19T07:20:37.944159+0000","last_unstale":"2024-09-19T07:22:04.080426+0000","last_undegraded":"2024-09-19T07:22:04.080426+0000","last_fullsized":"2024-09-19T07:22:04.080426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:52.944073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":158,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.797438+0000","last_change":"2024-09-19T07:20:19.531533+0000","last_active":"2024-09-19T07:22:03.797438+0000","last_peered":"2024-09-19T07:22:03.797438+0000","last_clean":"2024-09-19T07:22:03.797438+0000","last_became_active":"2024-09-19T07:20:19.531228+0000","last_became_peered":"2024-09-19T07:20:19.531228+0000","last_unstale":"2024-09-19T07:22:03.797438+0000","last_undegraded":"2024-09-19T07:22:03.797438+0000","last_fullsized":"2024-09-19T07:22:03.797438+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:34.606957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775177+0000","last_change":"2024-09-19T07:20:17.522411+0000","last_active":"2024-09-19T07:22:03.775177+0000","last_peered":"2024-09-19T07:22:03.775177+0000","last_clean":"2024-09-19T07:22:03.775177+0000","last_became_active":"2024-09-19T07:20:17.522086+0000","last_became_peered":"2024-09-19T07:20:17.522086+0000","last_unstale":"2024-09-19T07:22:03.775177+0000","last_undegraded":"2024-09-19T07:22:03.775177+0000","last_fullsized":"2024-09-19T07:22:03.775177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.299624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814726+0000","last_change":"2024-09-19T07:20:19.532527+0000","last_active":"2024-09-19T07:22:03.814726+0000","last_peered":"2024-09-19T07:22:03.814726+0000","last_clean":"2024-09-19T07:22:03.814726+0000","last_became_active":"2024-09-19T07:20:19.532219+0000","last_became_peered":"2024-09-19T07:20:19.532219+0000","last_unstale":"2024-09-19T07:22:03.814726+0000","last_undegraded":"2024-09-19T07:22:03.814726+0000","last_fullsized":"2024-09-19T07:22:03.814726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:05.878229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.781583+0000","last_change":"2024-09-19T07:20:17.518014+0000","last_active":"2024-09-19T07:22:03.781583+0000","last_peered":"2024-09-19T07:22:03.781583+0000","last_clean":"2024-09-19T07:22:03.781583+0000","last_became_active":"2024-09-19T07:20:17.517077+0000","last_became_peered":"2024-09-19T07:20:17.517077+0000","last_unstale":"2024-09-19T07:22:03.781583+0000","last_undegraded":"2024-09-19T07:22:03.781583+0000","last_fullsized":"2024-09-19T07:22:03.781583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:45.893365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816520+0000","last_change":"2024-09-19T07:20:19.539347+0000","last_active":"2024-09-19T07:22:03.816520+0000","last_peered":"2024-09-19T07:22:03.816520+0000","last_clean":"2024-09-19T07:22:03.816520+0000","last_became_active":"2024-09-19T07:20:19.538884+0000","last_became_peered":"2024-09-19T07:20:19.538884+0000","last_unstale":"2024-09-19T07:22:03.816520+0000","last_undegraded":"2024-09-19T07:22:03.816520+0000","last_fullsized":"2024-09-19T07:22:03.816520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:23.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.897819+0000","last_change":"2024-09-19T07:20:17.513756+0000","last_active":"2024-09-19T07:22:03.897819+0000","last_peered":"2024-09-19T07:22:03.897819+0000","last_clean":"2024-09-19T07:22:03.897819+0000","last_became_active":"2024-09-19T07:20:17.513433+0000","last_became_peered":"2024-09-19T07:20:17.513433+0000","last_unstale":"2024-09-19T07:22:03.897819+0000","last_undegraded":"2024-09-19T07:22:03.897819+0000","last_fullsized":"2024-09-19T07:22:03.897819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:27.681161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.809812+0000","last_change":"2024-09-19T07:20:19.539873+0000","last_active":"2024-09-19T07:22:03.809812+0000","last_peered":"2024-09-19T07:22:03.809812+0000","last_clean":"2024-09-19T07:22:03.809812+0000","last_became_active":"2024-09-19T07:20:19.539581+0000","last_became_peered":"2024-09-19T07:20:19.539581+0000","last_unstale":"2024-09-19T07:22:03.809812+0000","last_undegraded":"2024-09-19T07:22:03.809812+0000","last_fullsized":"2024-09-19T07:22:03.809812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:31.164179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775476+0000","last_change":"2024-09-19T07:20:17.565864+0000","last_active":"2024-09-19T07:22:03.775476+0000","last_peered":"2024-09-19T07:22:03.775476+0000","last_clean":"2024-09-19T07:22:03.775476+0000","last_became_active":"2024-09-19T07:20:17.565459+0000","last_became_peered":"2024-09-19T07:20:17.565459+0000","last_unstale":"2024-09-19T07:22:03.775476+0000","last_undegraded":"2024-09-19T07:22:03.775476+0000","last_fullsized":"2024-09-19T07:22:03.775476+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:15.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814439+0000","last_change":"2024-09-19T07:20:37.800857+0000","last_active":"2024-09-19T07:22:03.814439+0000","last_peered":"2024-09-19T07:22:03.814439+0000","last_clean":"2024-09-19T07:22:03.814439+0000","last_became_active":"2024-09-19T07:20:37.800347+0000","last_became_peered":"2024-09-19T07:20:37.800347+0000","last_unstale":"2024-09-19T07:22:03.814439+0000","last_undegraded":"2024-09-19T07:22:03.814439+0000","last_fullsized":"2024-09-19T07:22:03.814439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:48.678208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775894+0000","last_change":"2024-09-19T07:20:17.521439+0000","last_active":"2024-09-19T07:22:03.775894+0000","last_peered":"2024-09-19T07:22:03.775894+0000","last_clean":"2024-09-19T07:22:03.775894+0000","last_became_active":"2024-09-19T07:20:17.521021+0000","last_became_peered":"2024-09-19T07:20:17.521021+0000","last_unstale":"2024-09-19T07:22:03.775894+0000","last_undegraded":"2024-09-19T07:22:03.775894+0000","last_fullsized":"2024-09-19T07:22:03.775894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.322352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.802889+0000","last_change":"2024-09-19T07:20:19.531234+0000","last_active":"2024-09-19T07:22:03.802889+0000","last_peered":"2024-09-19T07:22:03.802889+0000","last_clean":"2024-09-19T07:22:03.802889+0000","last_became_active":"2024-09-19T07:20:19.530422+0000","last_became_peered":"2024-09-19T07:20:19.530422+0000","last_unstale":"2024-09-19T07:22:03.802889+0000","last_undegraded":"2024-09-19T07:22:03.802889+0000","last_fullsized":"2024-09-19T07:22:03.802889+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:57.325415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.762228+0000","last_change":"2024-09-19T07:20:17.522426+0000","last_active":"2024-09-19T07:22:03.762228+0000","last_peered":"2024-09-19T07:22:03.762228+0000","last_clean":"2024-09-19T07:22:03.762228+0000","last_became_active":"2024-09-19T07:20:17.522061+0000","last_became_peered":"2024-09-19T07:20:17.522061+0000","last_unstale":"2024-09-19T07:22:03.762228+0000","last_undegraded":"2024-09-19T07:22:03.762228+0000","last_fullsized":"2024-09-19T07:22:03.762228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:04.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805167+0000","last_change":"2024-09-19T07:20:19.543420+0000","last_active":"2024-09-19T07:22:03.805167+0000","last_peered":"2024-09-19T07:22:03.805167+0000","last_clean":"2024-09-19T07:22:03.805167+0000","last_became_active":"2024-09-19T07:20:19.542294+0000","last_became_peered":"2024-09-19T07:20:19.542294+0000","last_unstale":"2024-09-19T07:22:03.805167+0000","last_undegraded":"2024-09-19T07:22:03.805167+0000","last_fullsized":"2024-09-19T07:22:03.805167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:32.119366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'39","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:04.032255+0000","last_change":"2024-09-19T07:20:17.518402+0000","last_active":"2024-09-19T07:22:04.032255+0000","last_peered":"2024-09-19T07:22:04.032255+0000","last_clean":"2024-09-19T07:22:04.032255+0000","last_became_active":"2024-09-19T07:20:17.517524+0000","last_became_peered":"2024-09-19T07:20:17.517524+0000","last_unstale":"2024-09-19T07:22:04.032255+0000","last_undegraded":"2024-09-19T07:22:04.032255+0000","last_fullsized":"2024-09-19T07:22:04.032255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:49.843442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.809548+0000","last_change":"2024-09-19T07:20:19.540945+0000","last_active":"2024-09-19T07:22:03.809548+0000","last_peered":"2024-09-19T07:22:03.809548+0000","last_clean":"2024-09-19T07:22:03.809548+0000","last_became_active":"2024-09-19T07:20:19.540641+0000","last_became_peered":"2024-09-19T07:20:19.540641+0000","last_unstale":"2024-09-19T07:22:03.809548+0000","last_undegraded":"2024-09-19T07:22:03.809548+0000","last_fullsized":"2024-09-19T07:22:03.809548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.487418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.774962+0000","last_change":"2024-09-19T07:20:17.567010+0000","last_active":"2024-09-19T07:22:03.774962+0000","last_peered":"2024-09-19T07:22:03.774962+0000","last_clean":"2024-09-19T07:22:03.774962+0000","last_became_active":"2024-09-19T07:20:17.566560+0000","last_became_peered":"2024-09-19T07:20:17.566560+0000","last_unstale":"2024-09-19T07:22:03.774962+0000","last_undegraded":"2024-09-19T07:22:03.774962+0000","last_fullsized":"2024-09-19T07:22:03.774962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.349568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813860+0000","last_change":"2024-09-19T07:20:19.541808+0000","last_active":"2024-09-19T07:22:03.813860+0000","last_peered":"2024-09-19T07:22:03.813860+0000","last_clean":"2024-09-19T07:22:03.813860+0000","last_became_active":"2024-09-19T07:20:19.541510+0000","last_became_peered":"2024-09-19T07:20:19.541510+0000","last_unstale":"2024-09-19T07:22:03.813860+0000","last_undegraded":"2024-09-19T07:22:03.813860+0000","last_fullsized":"2024-09-19T07:22:03.813860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:04.156121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":344,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776640+0000","last_change":"2024-09-19T07:19:11.632651+0000","last_active":"2024-09-19T07:22:03.776640+0000","last_peered":"2024-09-19T07:22:03.776640+0000","last_clean":"2024-09-19T07:22:03.776640+0000","last_became_active":"2024-09-19T07:19:11.632229+0000","last_became_peered":"2024-09-19T07:19:11.632229+0000","last_unstale":"2024-09-19T07:22:03.776640+0000","last_undegraded":"2024-09-19T07:22:03.776640+0000","last_fullsized":"2024-09-19T07:22:03.776640+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_clean_scrub_stamp":"2024-09-19T07:15:50.875302+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:32.716049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.763366+0000","last_change":"2024-09-19T07:20:17.512387+0000","last_active":"2024-09-19T07:22:03.763366+0000","last_peered":"2024-09-19T07:22:03.763366+0000","last_clean":"2024-09-19T07:22:03.763366+0000","last_became_active":"2024-09-19T07:20:17.511956+0000","last_became_peered":"2024-09-19T07:20:17.511956+0000","last_unstale":"2024-09-19T07:22:03.763366+0000","last_undegraded":"2024-09-19T07:22:03.763366+0000","last_fullsized":"2024-09-19T07:22:03.763366+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:13.098347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813504+0000","last_change":"2024-09-19T07:20:19.536280+0000","last_active":"2024-09-19T07:22:03.813504+0000","last_peered":"2024-09-19T07:22:03.813504+0000","last_clean":"2024-09-19T07:22:03.813504+0000","last_became_active":"2024-09-19T07:20:19.535809+0000","last_became_peered":"2024-09-19T07:20:19.535809+0000","last_unstale":"2024-09-19T07:22:03.813504+0000","last_undegraded":"2024-09-19T07:22:03.813504+0000","last_fullsized":"2024-09-19T07:22:03.813504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:07.645476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.765247+0000","last_change":"2024-09-19T07:20:37.800603+0000","last_active":"2024-09-19T07:22:03.765247+0000","last_peered":"2024-09-19T07:22:03.765247+0000","last_clean":"2024-09-19T07:22:03.765247+0000","last_became_active":"2024-09-19T07:20:37.794728+0000","last_became_peered":"2024-09-19T07:20:37.794728+0000","last_unstale":"2024-09-19T07:22:03.765247+0000","last_undegraded":"2024-09-19T07:22:03.765247+0000","last_fullsized":"2024-09-19T07:22:03.765247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:46.606645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808940+0000","last_change":"2024-09-19T07:20:19.540203+0000","last_active":"2024-09-19T07:22:03.808940+0000","last_peered":"2024-09-19T07:22:03.808940+0000","last_clean":"2024-09-19T07:22:03.808940+0000","last_became_active":"2024-09-19T07:20:19.539813+0000","last_became_peered":"2024-09-19T07:20:19.539813+0000","last_unstale":"2024-09-19T07:22:03.808940+0000","last_undegraded":"2024-09-19T07:22:03.808940+0000","last_fullsized":"2024-09-19T07:22:03.808940+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:52.164881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.897290+0000","last_change":"2024-09-19T07:20:17.565449+0000","last_active":"2024-09-19T07:22:03.897290+0000","last_peered":"2024-09-19T07:22:03.897290+0000","last_clean":"2024-09-19T07:22:03.897290+0000","last_became_active":"2024-09-19T07:20:17.565079+0000","last_became_peered":"2024-09-19T07:20:17.565079+0000","last_unstale":"2024-09-19T07:22:03.897290+0000","last_undegraded":"2024-09-19T07:22:03.897290+0000","last_fullsized":"2024-09-19T07:22:03.897290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:50.791388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808040+0000","last_change":"2024-09-19T07:20:19.533817+0000","last_active":"2024-09-19T07:22:03.808040+0000","last_peered":"2024-09-19T07:22:03.808040+0000","last_clean":"2024-09-19T07:22:03.808040+0000","last_became_active":"2024-09-19T07:20:19.532144+0000","last_became_peered":"2024-09-19T07:20:19.532144+0000","last_unstale":"2024-09-19T07:22:03.808040+0000","last_undegraded":"2024-09-19T07:22:03.808040+0000","last_fullsized":"2024-09-19T07:22:03.808040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:18.928739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.779225+0000","last_change":"2024-09-19T07:20:17.514063+0000","last_active":"2024-09-19T07:22:03.779225+0000","last_peered":"2024-09-19T07:22:03.779225+0000","last_clean":"2024-09-19T07:22:03.779225+0000","last_became_active":"2024-09-19T07:20:17.513633+0000","last_became_peered":"2024-09-19T07:20:17.513633+0000","last_unstale":"2024-09-19T07:22:03.779225+0000","last_undegraded":"2024-09-19T07:22:03.779225+0000","last_fullsized":"2024-09-19T07:22:03.779225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:24.113053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815734+0000","last_change":"2024-09-19T07:20:19.540209+0000","last_active":"2024-09-19T07:22:03.815734+0000","last_peered":"2024-09-19T07:22:03.815734+0000","last_clean":"2024-09-19T07:22:03.815734+0000","last_became_active":"2024-09-19T07:20:19.539855+0000","last_became_peered":"2024-09-19T07:20:19.539855+0000","last_unstale":"2024-09-19T07:22:03.815734+0000","last_undegraded":"2024-09-19T07:22:03.815734+0000","last_fullsized":"2024-09-19T07:22:03.815734+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:40.878905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776263+0000","last_change":"2024-09-19T07:20:17.565627+0000","last_active":"2024-09-19T07:22:03.776263+0000","last_peered":"2024-09-19T07:22:03.776263+0000","last_clean":"2024-09-19T07:22:03.776263+0000","last_became_active":"2024-09-19T07:20:17.565231+0000","last_became_peered":"2024-09-19T07:20:17.565231+0000","last_unstale":"2024-09-19T07:22:03.776263+0000","last_undegraded":"2024-09-19T07:22:03.776263+0000","last_fullsized":"2024-09-19T07:22:03.776263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:53.105336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817750+0000","last_change":"2024-09-19T07:20:19.532418+0000","last_active":"2024-09-19T07:22:03.817750+0000","last_peered":"2024-09-19T07:22:03.817750+0000","last_clean":"2024-09-19T07:22:03.817750+0000","last_became_active":"2024-09-19T07:20:19.532113+0000","last_became_peered":"2024-09-19T07:20:19.532113+0000","last_unstale":"2024-09-19T07:22:03.817750+0000","last_undegraded":"2024-09-19T07:22:03.817750+0000","last_fullsized":"2024-09-19T07:22:03.817750+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:24.953720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775943+0000","last_change":"2024-09-19T07:20:17.565984+0000","last_active":"2024-09-19T07:22:03.775943+0000","last_peered":"2024-09-19T07:22:03.775943+0000","last_clean":"2024-09-19T07:22:03.775943+0000","last_became_active":"2024-09-19T07:20:17.565240+0000","last_became_peered":"2024-09-19T07:20:17.565240+0000","last_unstale":"2024-09-19T07:22:03.775943+0000","last_undegraded":"2024-09-19T07:22:03.775943+0000","last_fullsized":"2024-09-19T07:22:03.775943+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:07.906716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807964+0000","last_change":"2024-09-19T07:20:19.534400+0000","last_active":"2024-09-19T07:22:03.807964+0000","last_peered":"2024-09-19T07:22:03.807964+0000","last_clean":"2024-09-19T07:22:03.807964+0000","last_became_active":"2024-09-19T07:20:19.534130+0000","last_became_peered":"2024-09-19T07:20:19.534130+0000","last_unstale":"2024-09-19T07:22:03.807964+0000","last_undegraded":"2024-09-19T07:22:03.807964+0000","last_fullsized":"2024-09-19T07:22:03.807964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:09.398112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'47","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:04.038605+0000","last_change":"2024-09-19T07:20:17.519628+0000","last_active":"2024-09-19T07:22:04.038605+0000","last_peered":"2024-09-19T07:22:04.038605+0000","last_clean":"2024-09-19T07:22:04.038605+0000","last_became_active":"2024-09-19T07:20:17.519276+0000","last_became_peered":"2024-09-19T07:20:17.519276+0000","last_unstale":"2024-09-19T07:22:04.038605+0000","last_undegraded":"2024-09-19T07:22:04.038605+0000","last_fullsized":"2024-09-19T07:22:04.038605+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.193091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":85,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805204+0000","last_change":"2024-09-19T07:20:19.533425+0000","last_active":"2024-09-19T07:22:03.805204+0000","last_peered":"2024-09-19T07:22:03.805204+0000","last_clean":"2024-09-19T07:22:03.805204+0000","last_became_active":"2024-09-19T07:20:19.533142+0000","last_became_peered":"2024-09-19T07:20:19.533142+0000","last_unstale":"2024-09-19T07:22:03.805204+0000","last_undegraded":"2024-09-19T07:22:03.805204+0000","last_fullsized":"2024-09-19T07:22:03.805204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:07.048006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.763685+0000","last_change":"2024-09-19T07:20:17.512776+0000","last_active":"2024-09-19T07:22:03.763685+0000","last_peered":"2024-09-19T07:22:03.763685+0000","last_clean":"2024-09-19T07:22:03.763685+0000","last_became_active":"2024-09-19T07:20:17.511862+0000","last_became_peered":"2024-09-19T07:20:17.511862+0000","last_unstale":"2024-09-19T07:22:03.763685+0000","last_undegraded":"2024-09-19T07:22:03.763685+0000","last_fullsized":"2024-09-19T07:22:03.763685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:08.211654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817223+0000","last_change":"2024-09-19T07:20:19.539260+0000","last_active":"2024-09-19T07:22:03.817223+0000","last_peered":"2024-09-19T07:22:03.817223+0000","last_clean":"2024-09-19T07:22:03.817223+0000","last_became_active":"2024-09-19T07:20:19.538868+0000","last_became_peered":"2024-09-19T07:20:19.538868+0000","last_unstale":"2024-09-19T07:22:03.817223+0000","last_undegraded":"2024-09-19T07:22:03.817223+0000","last_fullsized":"2024-09-19T07:22:03.817223+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:44.198084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.772518+0000","last_change":"2024-09-19T07:20:17.565544+0000","last_active":"2024-09-19T07:22:03.772518+0000","last_peered":"2024-09-19T07:22:03.772518+0000","last_clean":"2024-09-19T07:22:03.772518+0000","last_became_active":"2024-09-19T07:20:17.565250+0000","last_became_peered":"2024-09-19T07:20:17.565250+0000","last_unstale":"2024-09-19T07:22:03.772518+0000","last_undegraded":"2024-09-19T07:22:03.772518+0000","last_fullsized":"2024-09-19T07:22:03.772518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:25.523136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.788564+0000","last_change":"2024-09-19T07:20:19.531467+0000","last_active":"2024-09-19T07:22:03.788564+0000","last_peered":"2024-09-19T07:22:03.788564+0000","last_clean":"2024-09-19T07:22:03.788564+0000","last_became_active":"2024-09-19T07:20:19.531170+0000","last_became_peered":"2024-09-19T07:20:19.531170+0000","last_unstale":"2024-09-19T07:22:03.788564+0000","last_undegraded":"2024-09-19T07:22:03.788564+0000","last_fullsized":"2024-09-19T07:22:03.788564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:23.113097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775823+0000","last_change":"2024-09-19T07:20:17.511400+0000","last_active":"2024-09-19T07:22:03.775823+0000","last_peered":"2024-09-19T07:22:03.775823+0000","last_clean":"2024-09-19T07:22:03.775823+0000","last_became_active":"2024-09-19T07:20:17.511126+0000","last_became_peered":"2024-09-19T07:20:17.511126+0000","last_unstale":"2024-09-19T07:22:03.775823+0000","last_undegraded":"2024-09-19T07:22:03.775823+0000","last_fullsized":"2024-09-19T07:22:03.775823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.485406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818052+0000","last_change":"2024-09-19T07:20:19.529171+0000","last_active":"2024-09-19T07:22:03.818052+0000","last_peered":"2024-09-19T07:22:03.818052+0000","last_clean":"2024-09-19T07:22:03.818052+0000","last_became_active":"2024-09-19T07:20:19.528489+0000","last_became_peered":"2024-09-19T07:20:19.528489+0000","last_unstale":"2024-09-19T07:22:03.818052+0000","last_undegraded":"2024-09-19T07:22:03.818052+0000","last_fullsized":"2024-09-19T07:22:03.818052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:10.842619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.765334+0000","last_change":"2024-09-19T07:20:37.803560+0000","last_active":"2024-09-19T07:22:03.765334+0000","last_peered":"2024-09-19T07:22:03.765334+0000","last_clean":"2024-09-19T07:22:03.765334+0000","last_became_active":"2024-09-19T07:20:37.797396+0000","last_became_peered":"2024-09-19T07:20:37.797396+0000","last_unstale":"2024-09-19T07:22:03.765334+0000","last_undegraded":"2024-09-19T07:22:03.765334+0000","last_fullsized":"2024-09-19T07:22:03.765334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:41.944179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818481+0000","last_change":"2024-09-19T07:20:19.532698+0000","last_active":"2024-09-19T07:22:03.818481+0000","last_peered":"2024-09-19T07:22:03.818481+0000","last_clean":"2024-09-19T07:22:03.818481+0000","last_became_active":"2024-09-19T07:20:19.531978+0000","last_became_peered":"2024-09-19T07:20:19.531978+0000","last_unstale":"2024-09-19T07:22:03.818481+0000","last_undegraded":"2024-09-19T07:22:03.818481+0000","last_fullsized":"2024-09-19T07:22:03.818481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:44.257024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775088+0000","last_change":"2024-09-19T07:20:17.525240+0000","last_active":"2024-09-19T07:22:03.775088+0000","last_peered":"2024-09-19T07:22:03.775088+0000","last_clean":"2024-09-19T07:22:03.775088+0000","last_became_active":"2024-09-19T07:20:17.524880+0000","last_became_peered":"2024-09-19T07:20:17.524880+0000","last_unstale":"2024-09-19T07:22:03.775088+0000","last_undegraded":"2024-09-19T07:22:03.775088+0000","last_fullsized":"2024-09-19T07:22:03.775088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:41.380246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815849+0000","last_change":"2024-09-19T07:20:19.537116+0000","last_active":"2024-09-19T07:22:03.815849+0000","last_peered":"2024-09-19T07:22:03.815849+0000","last_clean":"2024-09-19T07:22:03.815849+0000","last_became_active":"2024-09-19T07:20:19.536799+0000","last_became_peered":"2024-09-19T07:20:19.536799+0000","last_unstale":"2024-09-19T07:22:03.815849+0000","last_undegraded":"2024-09-19T07:22:03.815849+0000","last_fullsized":"2024-09-19T07:22:03.815849+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:48.401159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815875+0000","last_change":"2024-09-19T07:20:19.527965+0000","last_active":"2024-09-19T07:22:03.815875+0000","last_peered":"2024-09-19T07:22:03.815875+0000","last_clean":"2024-09-19T07:22:03.815875+0000","last_became_active":"2024-09-19T07:20:19.527522+0000","last_became_peered":"2024-09-19T07:20:19.527522+0000","last_unstale":"2024-09-19T07:22:03.815875+0000","last_undegraded":"2024-09-19T07:22:03.815875+0000","last_fullsized":"2024-09-19T07:22:03.815875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:16.034153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775281+0000","last_change":"2024-09-19T07:20:17.519400+0000","last_active":"2024-09-19T07:22:03.775281+0000","last_peered":"2024-09-19T07:22:03.775281+0000","last_clean":"2024-09-19T07:22:03.775281+0000","last_became_active":"2024-09-19T07:20:17.518993+0000","last_became_peered":"2024-09-19T07:20:17.518993+0000","last_unstale":"2024-09-19T07:22:03.775281+0000","last_undegraded":"2024-09-19T07:22:03.775281+0000","last_fullsized":"2024-09-19T07:22:03.775281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:37.086763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815623+0000","last_change":"2024-09-19T07:20:19.531016+0000","last_active":"2024-09-19T07:22:03.815623+0000","last_peered":"2024-09-19T07:22:03.815623+0000","last_clean":"2024-09-19T07:22:03.815623+0000","last_became_active":"2024-09-19T07:20:19.530706+0000","last_became_peered":"2024-09-19T07:20:19.530706+0000","last_unstale":"2024-09-19T07:22:03.815623+0000","last_undegraded":"2024-09-19T07:22:03.815623+0000","last_fullsized":"2024-09-19T07:22:03.815623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:36.566185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775906+0000","last_change":"2024-09-19T07:20:17.524215+0000","last_active":"2024-09-19T07:22:03.775906+0000","last_peered":"2024-09-19T07:22:03.775906+0000","last_clean":"2024-09-19T07:22:03.775906+0000","last_became_active":"2024-09-19T07:20:17.523813+0000","last_became_peered":"2024-09-19T07:20:17.523813+0000","last_unstale":"2024-09-19T07:22:03.775906+0000","last_undegraded":"2024-09-19T07:22:03.775906+0000","last_fullsized":"2024-09-19T07:22:03.775906+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:58.803225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.821404+0000","last_change":"2024-09-19T07:20:19.540994+0000","last_active":"2024-09-19T07:22:03.821404+0000","last_peered":"2024-09-19T07:22:03.821404+0000","last_clean":"2024-09-19T07:22:03.821404+0000","last_became_active":"2024-09-19T07:20:19.540703+0000","last_became_peered":"2024-09-19T07:20:19.540703+0000","last_unstale":"2024-09-19T07:22:03.821404+0000","last_undegraded":"2024-09-19T07:22:03.821404+0000","last_fullsized":"2024-09-19T07:22:03.821404+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:37.065187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775249+0000","last_change":"2024-09-19T07:20:17.565438+0000","last_active":"2024-09-19T07:22:03.775249+0000","last_peered":"2024-09-19T07:22:03.775249+0000","last_clean":"2024-09-19T07:22:03.775249+0000","last_became_active":"2024-09-19T07:20:17.565128+0000","last_became_peered":"2024-09-19T07:20:17.565128+0000","last_unstale":"2024-09-19T07:22:03.775249+0000","last_undegraded":"2024-09-19T07:22:03.775249+0000","last_fullsized":"2024-09-19T07:22:03.775249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:02.048971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810388+0000","last_change":"2024-09-19T07:20:37.794369+0000","last_active":"2024-09-19T07:22:03.810388+0000","last_peered":"2024-09-19T07:22:03.810388+0000","last_clean":"2024-09-19T07:22:03.810388+0000","last_became_active":"2024-09-19T07:20:37.794036+0000","last_became_peered":"2024-09-19T07:20:37.794036+0000","last_unstale":"2024-09-19T07:22:03.810388+0000","last_undegraded":"2024-09-19T07:22:03.810388+0000","last_fullsized":"2024-09-19T07:22:03.810388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:02.684191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.777038+0000","last_change":"2024-09-19T07:20:37.950846+0000","last_active":"2024-09-19T07:22:03.777038+0000","last_peered":"2024-09-19T07:22:03.777038+0000","last_clean":"2024-09-19T07:22:03.777038+0000","last_became_active":"2024-09-19T07:20:37.944266+0000","last_became_peered":"2024-09-19T07:20:37.944266+0000","last_unstale":"2024-09-19T07:22:03.777038+0000","last_undegraded":"2024-09-19T07:22:03.777038+0000","last_fullsized":"2024-09-19T07:22:03.777038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:12.952833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":596000,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":689,"num_read_kb":446,"num_write":287,"num_write_kb":1432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27529,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1788000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645346,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":437330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874278,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28776,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716376,"statfs":{"total":95995035648,"available":95965569024,"internally_reserved":0,"allocated":1732608,"data_stored":1226105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037802,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":437566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1302528,"data_stored":830120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1507328,"data_stored":1030119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659193,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":436955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888127,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1654784,"data_stored":1161010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":504847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247880,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1445888,"data_stored":962082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":438799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607634,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":966656,"data_stored":502442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":438226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":133777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:22:09.076 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T07:22:09.076 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T07:22:09.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:08 smithi162 ceph-mon[35726]: Updating smithi139:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:22:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:08 smithi162 ceph-mon[35726]: Updating smithi098:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:22:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:08 smithi162 ceph-mon[35726]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T07:22:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:08 smithi162 ceph-mon[35726]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:22:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:08 smithi162 ceph-mon[35726]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:22:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:08 smithi162 ceph-mon[35726]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-09-19T07:22:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:08 smithi162 ceph-mon[35726]: Updating smithi098:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:22:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:08 smithi162 ceph-mon[35726]: Updating smithi139:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:22:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:08 smithi162 ceph-mon[35726]: Updating smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T07:22:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:08 smithi162 ceph-mon[35726]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:22:09.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:08 smithi162 ceph-mon[35726]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-19T07:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.212+0000 7faf4d2d0640 1 -- 172.21.15.98:0/1321892610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf48101360 msgr2=0x7faf4810d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.212+0000 7faf4d2d0640 1 --2- 172.21.15.98:0/1321892610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf48101360 0x7faf4810d890 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faf40009cd0 tx=0x7faf4002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.212+0000 7faf4d2d0640 1 -- 172.21.15.98:0/1321892610 shutdown_connections 2024-09-19T07:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.212+0000 7faf4d2d0640 1 --2- 172.21.15.98:0/1321892610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf48101360 0x7faf4810d890 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.212+0000 7faf4d2d0640 1 --2- 172.21.15.98:0/1321892610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf481009c0 0x7faf48100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.212+0000 7faf4d2d0640 1 --2- 172.21.15.98:0/1321892610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf481069d0 0x7faf48106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.212+0000 7faf4d2d0640 1 -- 172.21.15.98:0/1321892610 >> 172.21.15.98:0/1321892610 conn(0x7faf480fc6a0 msgr2=0x7faf480feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.212+0000 7faf4d2d0640 1 -- 172.21.15.98:0/1321892610 shutdown_connections 2024-09-19T07:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.212+0000 7faf4d2d0640 1 -- 172.21.15.98:0/1321892610 wait complete. 2024-09-19T07:22:09.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf4d2d0640 1 Processor -- start 2024-09-19T07:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf4d2d0640 1 -- start start 2024-09-19T07:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf4d2d0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf481009c0 0x7faf48198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf4d2d0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf48101360 0x7faf48198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf4d2d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf481069d0 0x7faf4819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf4d2d0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faf48110e10 con 0x7faf48101360 2024-09-19T07:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf4d2d0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faf48110c90 con 0x7faf481009c0 2024-09-19T07:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf4d2d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf48110f90 con 0x7faf481069d0 2024-09-19T07:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf3ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf48101360 0x7faf48198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf3ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf48101360 0x7faf48198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59920/0 (socket says 172.21.15.98:59920) 2024-09-19T07:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf3ffff640 1 -- 172.21.15.98:0/4096988406 learned_addr learned my addr 172.21.15.98:0/4096988406 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf46ffd640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf481009c0 0x7faf48198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:09.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf3ffff640 1 -- 172.21.15.98:0/4096988406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf481069d0 msgr2=0x7faf4819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf3ffff640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf481069d0 0x7faf4819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf3ffff640 1 -- 172.21.15.98:0/4096988406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf481009c0 msgr2=0x7faf48198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf3ffff640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf481009c0 0x7faf48198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf3ffff640 1 -- 172.21.15.98:0/4096988406 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf4819d410 con 0x7faf48101360 2024-09-19T07:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.213+0000 7faf46ffd640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf481009c0 0x7faf48198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.214+0000 7faf3ffff640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf48101360 0x7faf48198960 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf3000b4a0 tx=0x7faf3000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.214+0000 7faf44ff9640 1 -- 172.21.15.98:0/4096988406 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf30014070 con 0x7faf48101360 2024-09-19T07:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.214+0000 7faf44ff9640 1 -- 172.21.15.98:0/4096988406 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf30010af0 con 0x7faf48101360 2024-09-19T07:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.214+0000 7faf4d2d0640 1 -- 172.21.15.98:0/4096988406 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf4819d700 con 0x7faf48101360 2024-09-19T07:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.214+0000 7faf44ff9640 1 -- 172.21.15.98:0/4096988406 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf30017d10 con 0x7faf48101360 2024-09-19T07:22:09.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.214+0000 7faf4d2d0640 1 -- 172.21.15.98:0/4096988406 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf481a4f90 con 0x7faf48101360 2024-09-19T07:22:09.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.215+0000 7faf4d2d0640 1 -- 172.21.15.98:0/4096988406 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf48100e20 con 0x7faf48101360 2024-09-19T07:22:09.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.216+0000 7faf44ff9640 1 -- 172.21.15.98:0/4096988406 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7faf30017070 con 0x7faf48101360 2024-09-19T07:22:09.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.217+0000 7faf44ff9640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faf340a34e0 0x7faf340a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:09.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.217+0000 7faf46ffd640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faf340a34e0 0x7faf340a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:09.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.217+0000 7faf44ff9640 1 -- 172.21.15.98:0/4096988406 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7faf300cf370 con 0x7faf48101360 2024-09-19T07:22:09.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.217+0000 7faf46ffd640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faf340a34e0 0x7faf340a59a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faf380058c0 tx=0x7faf38005d30 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:09.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.221+0000 7faf44ff9640 1 -- 172.21.15.98:0/4096988406 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faf3009bbe0 con 0x7faf48101360 2024-09-19T07:22:09.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.383+0000 7faf4d2d0640 1 -- 172.21.15.98:0/4096988406 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf48062630 con 0x7faf340a34e0 2024-09-19T07:22:09.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.389+0000 7faf44ff9640 1 -- 172.21.15.98:0/4096988406 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257863 (secure 0 0 0) 0x7faf48062630 con 0x7faf340a34e0 2024-09-19T07:22:09.392 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:09.394 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-19T07:22:09.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.392+0000 7faf4d2d0640 1 -- 172.21.15.98:0/4096988406 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faf340a34e0 msgr2=0x7faf340a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:09.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.392+0000 7faf4d2d0640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faf340a34e0 0x7faf340a59a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faf380058c0 tx=0x7faf38005d30 comp rx=0 tx=0).stop 2024-09-19T07:22:09.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.392+0000 7faf4d2d0640 1 -- 172.21.15.98:0/4096988406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf48101360 msgr2=0x7faf48198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:09.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.392+0000 7faf4d2d0640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf48101360 0x7faf48198960 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf3000b4a0 tx=0x7faf3000b960 comp rx=0 tx=0).stop 2024-09-19T07:22:09.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.392+0000 7faf4d2d0640 1 -- 172.21.15.98:0/4096988406 shutdown_connections 2024-09-19T07:22:09.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.392+0000 7faf4d2d0640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faf340a34e0 0x7faf340a59a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.392+0000 7faf4d2d0640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf481069d0 0x7faf4819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.392+0000 7faf4d2d0640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faf48101360 0x7faf48198960 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.392+0000 7faf4d2d0640 1 --2- 172.21.15.98:0/4096988406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faf481009c0 0x7faf48198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:09.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.392+0000 7faf4d2d0640 1 -- 172.21.15.98:0/4096988406 >> 172.21.15.98:0/4096988406 conn(0x7faf480fc6a0 msgr2=0x7faf4806a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:09.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.392+0000 7faf4d2d0640 1 -- 172.21.15.98:0/4096988406 shutdown_connections 2024-09-19T07:22:09.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:09.392+0000 7faf4d2d0640 1 -- 172.21.15.98:0/4096988406 wait complete. 2024-09-19T07:22:09.404 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T07:22:07.774281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1186602,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":825,"num_read_kb":565,"num_write":470,"num_write_kb":4372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1208265,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":862,"ondisk_log_size":862,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":354840,"kb_used_data":13816,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124586984,"statfs":{"total":1151940427776,"available":1151577071616,"internally_reserved":0,"allocated":14147584,"data_stored":8405601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.990567"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816102+0000","last_change":"2024-09-19T07:20:19.535372+0000","last_active":"2024-09-19T07:22:03.816102+0000","last_peered":"2024-09-19T07:22:03.816102+0000","last_clean":"2024-09-19T07:22:03.816102+0000","last_became_active":"2024-09-19T07:20:19.535079+0000","last_became_peered":"2024-09-19T07:20:19.535079+0000","last_unstale":"2024-09-19T07:22:03.816102+0000","last_undegraded":"2024-09-19T07:22:03.816102+0000","last_fullsized":"2024-09-19T07:22:03.816102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:56.856451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815671+0000","last_change":"2024-09-19T07:20:19.528531+0000","last_active":"2024-09-19T07:22:03.815671+0000","last_peered":"2024-09-19T07:22:03.815671+0000","last_clean":"2024-09-19T07:22:03.815671+0000","last_became_active":"2024-09-19T07:20:19.528218+0000","last_became_peered":"2024-09-19T07:20:19.528218+0000","last_unstale":"2024-09-19T07:22:03.815671+0000","last_undegraded":"2024-09-19T07:22:03.815671+0000","last_fullsized":"2024-09-19T07:22:03.815671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:44.730220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818254+0000","last_change":"2024-09-19T07:20:19.533516+0000","last_active":"2024-09-19T07:22:03.818254+0000","last_peered":"2024-09-19T07:22:03.818254+0000","last_clean":"2024-09-19T07:22:03.818254+0000","last_became_active":"2024-09-19T07:20:19.533247+0000","last_became_peered":"2024-09-19T07:20:19.533247+0000","last_unstale":"2024-09-19T07:22:03.818254+0000","last_undegraded":"2024-09-19T07:22:03.818254+0000","last_fullsized":"2024-09-19T07:22:03.818254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:29.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810373+0000","last_change":"2024-09-19T07:20:19.543245+0000","last_active":"2024-09-19T07:22:03.810373+0000","last_peered":"2024-09-19T07:22:03.810373+0000","last_clean":"2024-09-19T07:22:03.810373+0000","last_became_active":"2024-09-19T07:20:19.542840+0000","last_became_peered":"2024-09-19T07:20:19.542840+0000","last_unstale":"2024-09-19T07:22:03.810373+0000","last_undegraded":"2024-09-19T07:22:03.810373+0000","last_fullsized":"2024-09-19T07:22:03.810373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:21.780027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.794220+0000","last_change":"2024-09-19T07:20:19.528880+0000","last_active":"2024-09-19T07:22:03.794220+0000","last_peered":"2024-09-19T07:22:03.794220+0000","last_clean":"2024-09-19T07:22:03.794220+0000","last_became_active":"2024-09-19T07:20:19.528592+0000","last_became_peered":"2024-09-19T07:20:19.528592+0000","last_unstale":"2024-09-19T07:22:03.794220+0000","last_undegraded":"2024-09-19T07:22:03.794220+0000","last_fullsized":"2024-09-19T07:22:03.794220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:59.718929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805549+0000","last_change":"2024-09-19T07:20:19.538480+0000","last_active":"2024-09-19T07:22:03.805549+0000","last_peered":"2024-09-19T07:22:03.805549+0000","last_clean":"2024-09-19T07:22:03.805549+0000","last_became_active":"2024-09-19T07:20:19.538189+0000","last_became_peered":"2024-09-19T07:20:19.538189+0000","last_unstale":"2024-09-19T07:22:03.805549+0000","last_undegraded":"2024-09-19T07:22:03.805549+0000","last_fullsized":"2024-09-19T07:22:03.805549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:29.607974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813603+0000","last_change":"2024-09-19T07:20:19.538877+0000","last_active":"2024-09-19T07:22:03.813603+0000","last_peered":"2024-09-19T07:22:03.813603+0000","last_clean":"2024-09-19T07:22:03.813603+0000","last_became_active":"2024-09-19T07:20:19.538551+0000","last_became_peered":"2024-09-19T07:20:19.538551+0000","last_unstale":"2024-09-19T07:22:03.813603+0000","last_undegraded":"2024-09-19T07:22:03.813603+0000","last_fullsized":"2024-09-19T07:22:03.813603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:52.114115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.819590+0000","last_change":"2024-09-19T07:20:19.538135+0000","last_active":"2024-09-19T07:22:03.819590+0000","last_peered":"2024-09-19T07:22:03.819590+0000","last_clean":"2024-09-19T07:22:03.819590+0000","last_became_active":"2024-09-19T07:20:19.537769+0000","last_became_peered":"2024-09-19T07:20:19.537769+0000","last_unstale":"2024-09-19T07:22:03.819590+0000","last_undegraded":"2024-09-19T07:22:03.819590+0000","last_fullsized":"2024-09-19T07:22:03.819590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:21.304262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814166+0000","last_change":"2024-09-19T07:20:19.531569+0000","last_active":"2024-09-19T07:22:03.814166+0000","last_peered":"2024-09-19T07:22:03.814166+0000","last_clean":"2024-09-19T07:22:03.814166+0000","last_became_active":"2024-09-19T07:20:19.529455+0000","last_became_peered":"2024-09-19T07:20:19.529455+0000","last_unstale":"2024-09-19T07:22:03.814166+0000","last_undegraded":"2024-09-19T07:22:03.814166+0000","last_fullsized":"2024-09-19T07:22:03.814166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:22.187968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807215+0000","last_change":"2024-09-19T07:20:19.540342+0000","last_active":"2024-09-19T07:22:03.807215+0000","last_peered":"2024-09-19T07:22:03.807215+0000","last_clean":"2024-09-19T07:22:03.807215+0000","last_became_active":"2024-09-19T07:20:19.539870+0000","last_became_peered":"2024-09-19T07:20:19.539870+0000","last_unstale":"2024-09-19T07:22:03.807215+0000","last_undegraded":"2024-09-19T07:22:03.807215+0000","last_fullsized":"2024-09-19T07:22:03.807215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:39.930671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803048+0000","last_change":"2024-09-19T07:20:19.536004+0000","last_active":"2024-09-19T07:22:03.803048+0000","last_peered":"2024-09-19T07:22:03.803048+0000","last_clean":"2024-09-19T07:22:03.803048+0000","last_became_active":"2024-09-19T07:20:19.535640+0000","last_became_peered":"2024-09-19T07:20:19.535640+0000","last_unstale":"2024-09-19T07:22:03.803048+0000","last_undegraded":"2024-09-19T07:22:03.803048+0000","last_fullsized":"2024-09-19T07:22:03.803048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:47.853411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.806987+0000","last_change":"2024-09-19T07:20:19.539374+0000","last_active":"2024-09-19T07:22:03.806987+0000","last_peered":"2024-09-19T07:22:03.806987+0000","last_clean":"2024-09-19T07:22:03.806987+0000","last_became_active":"2024-09-19T07:20:19.538880+0000","last_became_peered":"2024-09-19T07:20:19.538880+0000","last_unstale":"2024-09-19T07:22:03.806987+0000","last_undegraded":"2024-09-19T07:22:03.806987+0000","last_fullsized":"2024-09-19T07:22:03.806987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:55.484232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.806269+0000","last_change":"2024-09-19T07:20:37.792753+0000","last_active":"2024-09-19T07:22:03.806269+0000","last_peered":"2024-09-19T07:22:03.806269+0000","last_clean":"2024-09-19T07:22:03.806269+0000","last_became_active":"2024-09-19T07:20:37.792417+0000","last_became_peered":"2024-09-19T07:20:37.792417+0000","last_unstale":"2024-09-19T07:22:03.806269+0000","last_undegraded":"2024-09-19T07:22:03.806269+0000","last_fullsized":"2024-09-19T07:22:03.806269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:10.417367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816028+0000","last_change":"2024-09-19T07:20:19.528842+0000","last_active":"2024-09-19T07:22:03.816028+0000","last_peered":"2024-09-19T07:22:03.816028+0000","last_clean":"2024-09-19T07:22:03.816028+0000","last_became_active":"2024-09-19T07:20:19.528042+0000","last_became_peered":"2024-09-19T07:20:19.528042+0000","last_unstale":"2024-09-19T07:22:03.816028+0000","last_undegraded":"2024-09-19T07:22:03.816028+0000","last_fullsized":"2024-09-19T07:22:03.816028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:34.970509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817953+0000","last_change":"2024-09-19T07:20:19.535013+0000","last_active":"2024-09-19T07:22:03.817953+0000","last_peered":"2024-09-19T07:22:03.817953+0000","last_clean":"2024-09-19T07:22:03.817953+0000","last_became_active":"2024-09-19T07:20:19.534302+0000","last_became_peered":"2024-09-19T07:20:19.534302+0000","last_unstale":"2024-09-19T07:22:03.817953+0000","last_undegraded":"2024-09-19T07:22:03.817953+0000","last_fullsized":"2024-09-19T07:22:03.817953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:52.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812766+0000","last_change":"2024-09-19T07:20:19.534930+0000","last_active":"2024-09-19T07:22:03.812766+0000","last_peered":"2024-09-19T07:22:03.812766+0000","last_clean":"2024-09-19T07:22:03.812766+0000","last_became_active":"2024-09-19T07:20:19.534640+0000","last_became_peered":"2024-09-19T07:20:19.534640+0000","last_unstale":"2024-09-19T07:22:03.812766+0000","last_undegraded":"2024-09-19T07:22:03.812766+0000","last_fullsized":"2024-09-19T07:22:03.812766+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:23.055097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818341+0000","last_change":"2024-09-19T07:20:19.535856+0000","last_active":"2024-09-19T07:22:03.818341+0000","last_peered":"2024-09-19T07:22:03.818341+0000","last_clean":"2024-09-19T07:22:03.818341+0000","last_became_active":"2024-09-19T07:20:19.535561+0000","last_became_peered":"2024-09-19T07:20:19.535561+0000","last_unstale":"2024-09-19T07:22:03.818341+0000","last_undegraded":"2024-09-19T07:22:03.818341+0000","last_fullsized":"2024-09-19T07:22:03.818341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:03.943339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812865+0000","last_change":"2024-09-19T07:20:19.528429+0000","last_active":"2024-09-19T07:22:03.812865+0000","last_peered":"2024-09-19T07:22:03.812865+0000","last_clean":"2024-09-19T07:22:03.812865+0000","last_became_active":"2024-09-19T07:20:19.528107+0000","last_became_peered":"2024-09-19T07:20:19.528107+0000","last_unstale":"2024-09-19T07:22:03.812865+0000","last_undegraded":"2024-09-19T07:22:03.812865+0000","last_fullsized":"2024-09-19T07:22:03.812865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:49.520514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818269+0000","last_change":"2024-09-19T07:20:19.532966+0000","last_active":"2024-09-19T07:22:03.818269+0000","last_peered":"2024-09-19T07:22:03.818269+0000","last_clean":"2024-09-19T07:22:03.818269+0000","last_became_active":"2024-09-19T07:20:19.532412+0000","last_became_peered":"2024-09-19T07:20:19.532412+0000","last_unstale":"2024-09-19T07:22:03.818269+0000","last_undegraded":"2024-09-19T07:22:03.818269+0000","last_fullsized":"2024-09-19T07:22:03.818269+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:42.900136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.800966+0000","last_change":"2024-09-19T07:20:37.797952+0000","last_active":"2024-09-19T07:22:03.800966+0000","last_peered":"2024-09-19T07:22:03.800966+0000","last_clean":"2024-09-19T07:22:03.800966+0000","last_became_active":"2024-09-19T07:20:37.797459+0000","last_became_peered":"2024-09-19T07:20:37.797459+0000","last_unstale":"2024-09-19T07:22:03.800966+0000","last_undegraded":"2024-09-19T07:22:03.800966+0000","last_fullsized":"2024-09-19T07:22:03.800966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:44.132477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818884+0000","last_change":"2024-09-19T07:20:19.532193+0000","last_active":"2024-09-19T07:22:03.818884+0000","last_peered":"2024-09-19T07:22:03.818884+0000","last_clean":"2024-09-19T07:22:03.818884+0000","last_became_active":"2024-09-19T07:20:19.531890+0000","last_became_peered":"2024-09-19T07:20:19.531890+0000","last_unstale":"2024-09-19T07:22:03.818884+0000","last_undegraded":"2024-09-19T07:22:03.818884+0000","last_fullsized":"2024-09-19T07:22:03.818884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:21.168993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815073+0000","last_change":"2024-09-19T07:20:19.535034+0000","last_active":"2024-09-19T07:22:03.815073+0000","last_peered":"2024-09-19T07:22:03.815073+0000","last_clean":"2024-09-19T07:22:03.815073+0000","last_became_active":"2024-09-19T07:20:19.534732+0000","last_became_peered":"2024-09-19T07:20:19.534732+0000","last_unstale":"2024-09-19T07:22:03.815073+0000","last_undegraded":"2024-09-19T07:22:03.815073+0000","last_fullsized":"2024-09-19T07:22:03.815073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:13.726672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817072+0000","last_change":"2024-09-19T07:20:19.532644+0000","last_active":"2024-09-19T07:22:03.817072+0000","last_peered":"2024-09-19T07:22:03.817072+0000","last_clean":"2024-09-19T07:22:03.817072+0000","last_became_active":"2024-09-19T07:20:19.532364+0000","last_became_peered":"2024-09-19T07:20:19.532364+0000","last_unstale":"2024-09-19T07:22:03.817072+0000","last_undegraded":"2024-09-19T07:22:03.817072+0000","last_fullsized":"2024-09-19T07:22:03.817072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:17.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814164+0000","last_change":"2024-09-19T07:20:19.533500+0000","last_active":"2024-09-19T07:22:03.814164+0000","last_peered":"2024-09-19T07:22:03.814164+0000","last_clean":"2024-09-19T07:22:03.814164+0000","last_became_active":"2024-09-19T07:20:19.532759+0000","last_became_peered":"2024-09-19T07:20:19.532759+0000","last_unstale":"2024-09-19T07:22:03.814164+0000","last_undegraded":"2024-09-19T07:22:03.814164+0000","last_fullsized":"2024-09-19T07:22:03.814164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:35.549776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815771+0000","last_change":"2024-09-19T07:20:37.793776+0000","last_active":"2024-09-19T07:22:03.815771+0000","last_peered":"2024-09-19T07:22:03.815771+0000","last_clean":"2024-09-19T07:22:03.815771+0000","last_became_active":"2024-09-19T07:20:37.793382+0000","last_became_peered":"2024-09-19T07:20:37.793382+0000","last_unstale":"2024-09-19T07:22:03.815771+0000","last_undegraded":"2024-09-19T07:22:03.815771+0000","last_fullsized":"2024-09-19T07:22:03.815771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:00.422534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803532+0000","last_change":"2024-09-19T07:20:19.532840+0000","last_active":"2024-09-19T07:22:03.803532+0000","last_peered":"2024-09-19T07:22:03.803532+0000","last_clean":"2024-09-19T07:22:03.803532+0000","last_became_active":"2024-09-19T07:20:19.532059+0000","last_became_peered":"2024-09-19T07:20:19.532059+0000","last_unstale":"2024-09-19T07:22:03.803532+0000","last_undegraded":"2024-09-19T07:22:03.803532+0000","last_fullsized":"2024-09-19T07:22:03.803532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:49.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.802328+0000","last_change":"2024-09-19T07:20:19.528150+0000","last_active":"2024-09-19T07:22:03.802328+0000","last_peered":"2024-09-19T07:22:03.802328+0000","last_clean":"2024-09-19T07:22:03.802328+0000","last_became_active":"2024-09-19T07:20:19.527873+0000","last_became_peered":"2024-09-19T07:20:19.527873+0000","last_unstale":"2024-09-19T07:22:03.802328+0000","last_undegraded":"2024-09-19T07:22:03.802328+0000","last_fullsized":"2024-09-19T07:22:03.802328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.561937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808779+0000","last_change":"2024-09-19T07:20:19.540160+0000","last_active":"2024-09-19T07:22:03.808779+0000","last_peered":"2024-09-19T07:22:03.808779+0000","last_clean":"2024-09-19T07:22:03.808779+0000","last_became_active":"2024-09-19T07:20:19.539862+0000","last_became_peered":"2024-09-19T07:20:19.539862+0000","last_unstale":"2024-09-19T07:22:03.808779+0000","last_undegraded":"2024-09-19T07:22:03.808779+0000","last_fullsized":"2024-09-19T07:22:03.808779+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:22.229785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.820657+0000","last_change":"2024-09-19T07:20:19.540363+0000","last_active":"2024-09-19T07:22:03.820657+0000","last_peered":"2024-09-19T07:22:03.820657+0000","last_clean":"2024-09-19T07:22:03.820657+0000","last_became_active":"2024-09-19T07:20:19.540068+0000","last_became_peered":"2024-09-19T07:20:19.540068+0000","last_unstale":"2024-09-19T07:22:03.820657+0000","last_undegraded":"2024-09-19T07:22:03.820657+0000","last_fullsized":"2024-09-19T07:22:03.820657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:07.955849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818258+0000","last_change":"2024-09-19T07:20:19.533546+0000","last_active":"2024-09-19T07:22:03.818258+0000","last_peered":"2024-09-19T07:22:03.818258+0000","last_clean":"2024-09-19T07:22:03.818258+0000","last_became_active":"2024-09-19T07:20:19.533232+0000","last_became_peered":"2024-09-19T07:20:19.533232+0000","last_unstale":"2024-09-19T07:22:03.818258+0000","last_undegraded":"2024-09-19T07:22:03.818258+0000","last_fullsized":"2024-09-19T07:22:03.818258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:29.674866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807595+0000","last_change":"2024-09-19T07:20:19.542842+0000","last_active":"2024-09-19T07:22:03.807595+0000","last_peered":"2024-09-19T07:22:03.807595+0000","last_clean":"2024-09-19T07:22:03.807595+0000","last_became_active":"2024-09-19T07:20:19.542477+0000","last_became_peered":"2024-09-19T07:20:19.542477+0000","last_unstale":"2024-09-19T07:22:03.807595+0000","last_undegraded":"2024-09-19T07:22:03.807595+0000","last_fullsized":"2024-09-19T07:22:03.807595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:30.921099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803673+0000","last_change":"2024-09-19T07:20:19.530472+0000","last_active":"2024-09-19T07:22:03.803673+0000","last_peered":"2024-09-19T07:22:03.803673+0000","last_clean":"2024-09-19T07:22:03.803673+0000","last_became_active":"2024-09-19T07:20:19.529457+0000","last_became_peered":"2024-09-19T07:20:19.529457+0000","last_unstale":"2024-09-19T07:22:03.803673+0000","last_undegraded":"2024-09-19T07:22:03.803673+0000","last_fullsized":"2024-09-19T07:22:03.803673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:16.410723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803010+0000","last_change":"2024-09-19T07:20:37.801168+0000","last_active":"2024-09-19T07:22:03.803010+0000","last_peered":"2024-09-19T07:22:03.803010+0000","last_clean":"2024-09-19T07:22:03.803010+0000","last_became_active":"2024-09-19T07:20:37.800613+0000","last_became_peered":"2024-09-19T07:20:37.800613+0000","last_unstale":"2024-09-19T07:22:03.803010+0000","last_undegraded":"2024-09-19T07:22:03.803010+0000","last_fullsized":"2024-09-19T07:22:03.803010+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:27.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'7","reported_seq":129,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.898326+0000","last_change":"2024-09-19T07:20:17.524656+0000","last_active":"2024-09-19T07:22:03.898326+0000","last_peered":"2024-09-19T07:22:03.898326+0000","last_clean":"2024-09-19T07:22:03.898326+0000","last_became_active":"2024-09-19T07:20:17.524350+0000","last_became_peered":"2024-09-19T07:20:17.524350+0000","last_unstale":"2024-09-19T07:22:03.898326+0000","last_undegraded":"2024-09-19T07:22:03.898326+0000","last_fullsized":"2024-09-19T07:22:03.898326+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:00.459283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810877+0000","last_change":"2024-09-19T07:20:19.536895+0000","last_active":"2024-09-19T07:22:03.810877+0000","last_peered":"2024-09-19T07:22:03.810877+0000","last_clean":"2024-09-19T07:22:03.810877+0000","last_became_active":"2024-09-19T07:20:19.536569+0000","last_became_peered":"2024-09-19T07:20:19.536569+0000","last_unstale":"2024-09-19T07:22:03.810877+0000","last_undegraded":"2024-09-19T07:22:03.810877+0000","last_fullsized":"2024-09-19T07:22:03.810877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:56.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.770907+0000","last_change":"2024-09-19T07:20:17.519800+0000","last_active":"2024-09-19T07:22:03.770907+0000","last_peered":"2024-09-19T07:22:03.770907+0000","last_clean":"2024-09-19T07:22:03.770907+0000","last_became_active":"2024-09-19T07:20:17.519384+0000","last_became_peered":"2024-09-19T07:20:17.519384+0000","last_unstale":"2024-09-19T07:22:03.770907+0000","last_undegraded":"2024-09-19T07:22:03.770907+0000","last_fullsized":"2024-09-19T07:22:03.770907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:17.346946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.761997+0000","last_change":"2024-09-19T07:20:17.511178+0000","last_active":"2024-09-19T07:22:03.761997+0000","last_peered":"2024-09-19T07:22:03.761997+0000","last_clean":"2024-09-19T07:22:03.761997+0000","last_became_active":"2024-09-19T07:20:17.510646+0000","last_became_peered":"2024-09-19T07:20:17.510646+0000","last_unstale":"2024-09-19T07:22:03.761997+0000","last_undegraded":"2024-09-19T07:22:03.761997+0000","last_fullsized":"2024-09-19T07:22:03.761997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:58.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.804119+0000","last_change":"2024-09-19T07:20:19.532979+0000","last_active":"2024-09-19T07:22:03.804119+0000","last_peered":"2024-09-19T07:22:03.804119+0000","last_clean":"2024-09-19T07:22:03.804119+0000","last_became_active":"2024-09-19T07:20:19.532396+0000","last_became_peered":"2024-09-19T07:20:19.532396+0000","last_unstale":"2024-09-19T07:22:03.804119+0000","last_undegraded":"2024-09-19T07:22:03.804119+0000","last_fullsized":"2024-09-19T07:22:03.804119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:24.313572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.781655+0000","last_change":"2024-09-19T07:20:17.519327+0000","last_active":"2024-09-19T07:22:03.781655+0000","last_peered":"2024-09-19T07:22:03.781655+0000","last_clean":"2024-09-19T07:22:03.781655+0000","last_became_active":"2024-09-19T07:20:17.518916+0000","last_became_peered":"2024-09-19T07:20:17.518916+0000","last_unstale":"2024-09-19T07:22:03.781655+0000","last_undegraded":"2024-09-19T07:22:03.781655+0000","last_fullsized":"2024-09-19T07:22:03.781655+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:52.672016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814641+0000","last_change":"2024-09-19T07:20:19.528642+0000","last_active":"2024-09-19T07:22:03.814641+0000","last_peered":"2024-09-19T07:22:03.814641+0000","last_clean":"2024-09-19T07:22:03.814641+0000","last_became_active":"2024-09-19T07:20:19.528302+0000","last_became_peered":"2024-09-19T07:20:19.528302+0000","last_unstale":"2024-09-19T07:22:03.814641+0000","last_undegraded":"2024-09-19T07:22:03.814641+0000","last_fullsized":"2024-09-19T07:22:03.814641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:22.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":123,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.770981+0000","last_change":"2024-09-19T07:20:17.519144+0000","last_active":"2024-09-19T07:22:03.770981+0000","last_peered":"2024-09-19T07:22:03.770981+0000","last_clean":"2024-09-19T07:22:03.770981+0000","last_became_active":"2024-09-19T07:20:17.518714+0000","last_became_peered":"2024-09-19T07:20:17.518714+0000","last_unstale":"2024-09-19T07:22:03.770981+0000","last_undegraded":"2024-09-19T07:22:03.770981+0000","last_fullsized":"2024-09-19T07:22:03.770981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:09.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808858+0000","last_change":"2024-09-19T07:20:19.532293+0000","last_active":"2024-09-19T07:22:03.808858+0000","last_peered":"2024-09-19T07:22:03.808858+0000","last_clean":"2024-09-19T07:22:03.808858+0000","last_became_active":"2024-09-19T07:20:19.531427+0000","last_became_peered":"2024-09-19T07:20:19.531427+0000","last_unstale":"2024-09-19T07:22:03.808858+0000","last_undegraded":"2024-09-19T07:22:03.808858+0000","last_fullsized":"2024-09-19T07:22:03.808858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:31.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776705+0000","last_change":"2024-09-19T07:20:17.521743+0000","last_active":"2024-09-19T07:22:03.776705+0000","last_peered":"2024-09-19T07:22:03.776705+0000","last_clean":"2024-09-19T07:22:03.776705+0000","last_became_active":"2024-09-19T07:20:17.521321+0000","last_became_peered":"2024-09-19T07:20:17.521321+0000","last_unstale":"2024-09-19T07:22:03.776705+0000","last_undegraded":"2024-09-19T07:22:03.776705+0000","last_fullsized":"2024-09-19T07:22:03.776705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:21.107210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.821636+0000","last_change":"2024-09-19T07:20:19.532879+0000","last_active":"2024-09-19T07:22:03.821636+0000","last_peered":"2024-09-19T07:22:03.821636+0000","last_clean":"2024-09-19T07:22:03.821636+0000","last_became_active":"2024-09-19T07:20:19.532490+0000","last_became_peered":"2024-09-19T07:20:19.532490+0000","last_unstale":"2024-09-19T07:22:03.821636+0000","last_undegraded":"2024-09-19T07:22:03.821636+0000","last_fullsized":"2024-09-19T07:22:03.821636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:06.534849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.782814+0000","last_change":"2024-09-19T07:20:17.565759+0000","last_active":"2024-09-19T07:22:03.782814+0000","last_peered":"2024-09-19T07:22:03.782814+0000","last_clean":"2024-09-19T07:22:03.782814+0000","last_became_active":"2024-09-19T07:20:17.565334+0000","last_became_peered":"2024-09-19T07:20:17.565334+0000","last_unstale":"2024-09-19T07:22:03.782814+0000","last_undegraded":"2024-09-19T07:22:03.782814+0000","last_fullsized":"2024-09-19T07:22:03.782814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.588515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812382+0000","last_change":"2024-09-19T07:20:19.537397+0000","last_active":"2024-09-19T07:22:03.812382+0000","last_peered":"2024-09-19T07:22:03.812382+0000","last_clean":"2024-09-19T07:22:03.812382+0000","last_became_active":"2024-09-19T07:20:19.537059+0000","last_became_peered":"2024-09-19T07:20:19.537059+0000","last_unstale":"2024-09-19T07:22:03.812382+0000","last_undegraded":"2024-09-19T07:22:03.812382+0000","last_fullsized":"2024-09-19T07:22:03.812382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:30.146934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'34","reported_seq":277,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:04.080426+0000","last_change":"2024-09-19T07:20:37.956721+0000","last_active":"2024-09-19T07:22:04.080426+0000","last_peered":"2024-09-19T07:22:04.080426+0000","last_clean":"2024-09-19T07:22:04.080426+0000","last_became_active":"2024-09-19T07:20:37.944159+0000","last_became_peered":"2024-09-19T07:20:37.944159+0000","last_unstale":"2024-09-19T07:22:04.080426+0000","last_undegraded":"2024-09-19T07:22:04.080426+0000","last_fullsized":"2024-09-19T07:22:04.080426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:52.944073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66480,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":158,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.797438+0000","last_change":"2024-09-19T07:20:19.531533+0000","last_active":"2024-09-19T07:22:03.797438+0000","last_peered":"2024-09-19T07:22:03.797438+0000","last_clean":"2024-09-19T07:22:03.797438+0000","last_became_active":"2024-09-19T07:20:19.531228+0000","last_became_peered":"2024-09-19T07:20:19.531228+0000","last_unstale":"2024-09-19T07:22:03.797438+0000","last_undegraded":"2024-09-19T07:22:03.797438+0000","last_fullsized":"2024-09-19T07:22:03.797438+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:34.606957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775177+0000","last_change":"2024-09-19T07:20:17.522411+0000","last_active":"2024-09-19T07:22:03.775177+0000","last_peered":"2024-09-19T07:22:03.775177+0000","last_clean":"2024-09-19T07:22:03.775177+0000","last_became_active":"2024-09-19T07:20:17.522086+0000","last_became_peered":"2024-09-19T07:20:17.522086+0000","last_unstale":"2024-09-19T07:22:03.775177+0000","last_undegraded":"2024-09-19T07:22:03.775177+0000","last_fullsized":"2024-09-19T07:22:03.775177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.299624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814726+0000","last_change":"2024-09-19T07:20:19.532527+0000","last_active":"2024-09-19T07:22:03.814726+0000","last_peered":"2024-09-19T07:22:03.814726+0000","last_clean":"2024-09-19T07:22:03.814726+0000","last_became_active":"2024-09-19T07:20:19.532219+0000","last_became_peered":"2024-09-19T07:20:19.532219+0000","last_unstale":"2024-09-19T07:22:03.814726+0000","last_undegraded":"2024-09-19T07:22:03.814726+0000","last_fullsized":"2024-09-19T07:22:03.814726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:05.878229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.781583+0000","last_change":"2024-09-19T07:20:17.518014+0000","last_active":"2024-09-19T07:22:03.781583+0000","last_peered":"2024-09-19T07:22:03.781583+0000","last_clean":"2024-09-19T07:22:03.781583+0000","last_became_active":"2024-09-19T07:20:17.517077+0000","last_became_peered":"2024-09-19T07:20:17.517077+0000","last_unstale":"2024-09-19T07:22:03.781583+0000","last_undegraded":"2024-09-19T07:22:03.781583+0000","last_fullsized":"2024-09-19T07:22:03.781583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:45.893365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816520+0000","last_change":"2024-09-19T07:20:19.539347+0000","last_active":"2024-09-19T07:22:03.816520+0000","last_peered":"2024-09-19T07:22:03.816520+0000","last_clean":"2024-09-19T07:22:03.816520+0000","last_became_active":"2024-09-19T07:20:19.538884+0000","last_became_peered":"2024-09-19T07:20:19.538884+0000","last_unstale":"2024-09-19T07:22:03.816520+0000","last_undegraded":"2024-09-19T07:22:03.816520+0000","last_fullsized":"2024-09-19T07:22:03.816520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:23.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":125,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.897819+0000","last_change":"2024-09-19T07:20:17.513756+0000","last_active":"2024-09-19T07:22:03.897819+0000","last_peered":"2024-09-19T07:22:03.897819+0000","last_clean":"2024-09-19T07:22:03.897819+0000","last_became_active":"2024-09-19T07:20:17.513433+0000","last_became_peered":"2024-09-19T07:20:17.513433+0000","last_unstale":"2024-09-19T07:22:03.897819+0000","last_undegraded":"2024-09-19T07:22:03.897819+0000","last_fullsized":"2024-09-19T07:22:03.897819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:27.681161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.809812+0000","last_change":"2024-09-19T07:20:19.539873+0000","last_active":"2024-09-19T07:22:03.809812+0000","last_peered":"2024-09-19T07:22:03.809812+0000","last_clean":"2024-09-19T07:22:03.809812+0000","last_became_active":"2024-09-19T07:20:19.539581+0000","last_became_peered":"2024-09-19T07:20:19.539581+0000","last_unstale":"2024-09-19T07:22:03.809812+0000","last_undegraded":"2024-09-19T07:22:03.809812+0000","last_fullsized":"2024-09-19T07:22:03.809812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:31.164179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775476+0000","last_change":"2024-09-19T07:20:17.565864+0000","last_active":"2024-09-19T07:22:03.775476+0000","last_peered":"2024-09-19T07:22:03.775476+0000","last_clean":"2024-09-19T07:22:03.775476+0000","last_became_active":"2024-09-19T07:20:17.565459+0000","last_became_peered":"2024-09-19T07:20:17.565459+0000","last_unstale":"2024-09-19T07:22:03.775476+0000","last_undegraded":"2024-09-19T07:22:03.775476+0000","last_fullsized":"2024-09-19T07:22:03.775476+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:15.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814439+0000","last_change":"2024-09-19T07:20:37.800857+0000","last_active":"2024-09-19T07:22:03.814439+0000","last_peered":"2024-09-19T07:22:03.814439+0000","last_clean":"2024-09-19T07:22:03.814439+0000","last_became_active":"2024-09-19T07:20:37.800347+0000","last_became_peered":"2024-09-19T07:20:37.800347+0000","last_unstale":"2024-09-19T07:22:03.814439+0000","last_undegraded":"2024-09-19T07:22:03.814439+0000","last_fullsized":"2024-09-19T07:22:03.814439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:48.678208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775894+0000","last_change":"2024-09-19T07:20:17.521439+0000","last_active":"2024-09-19T07:22:03.775894+0000","last_peered":"2024-09-19T07:22:03.775894+0000","last_clean":"2024-09-19T07:22:03.775894+0000","last_became_active":"2024-09-19T07:20:17.521021+0000","last_became_peered":"2024-09-19T07:20:17.521021+0000","last_unstale":"2024-09-19T07:22:03.775894+0000","last_undegraded":"2024-09-19T07:22:03.775894+0000","last_fullsized":"2024-09-19T07:22:03.775894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.322352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.802889+0000","last_change":"2024-09-19T07:20:19.531234+0000","last_active":"2024-09-19T07:22:03.802889+0000","last_peered":"2024-09-19T07:22:03.802889+0000","last_clean":"2024-09-19T07:22:03.802889+0000","last_became_active":"2024-09-19T07:20:19.530422+0000","last_became_peered":"2024-09-19T07:20:19.530422+0000","last_unstale":"2024-09-19T07:22:03.802889+0000","last_undegraded":"2024-09-19T07:22:03.802889+0000","last_fullsized":"2024-09-19T07:22:03.802889+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:57.325415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.762228+0000","last_change":"2024-09-19T07:20:17.522426+0000","last_active":"2024-09-19T07:22:03.762228+0000","last_peered":"2024-09-19T07:22:03.762228+0000","last_clean":"2024-09-19T07:22:03.762228+0000","last_became_active":"2024-09-19T07:20:17.522061+0000","last_became_peered":"2024-09-19T07:20:17.522061+0000","last_unstale":"2024-09-19T07:22:03.762228+0000","last_undegraded":"2024-09-19T07:22:03.762228+0000","last_fullsized":"2024-09-19T07:22:03.762228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:04.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805167+0000","last_change":"2024-09-19T07:20:19.543420+0000","last_active":"2024-09-19T07:22:03.805167+0000","last_peered":"2024-09-19T07:22:03.805167+0000","last_clean":"2024-09-19T07:22:03.805167+0000","last_became_active":"2024-09-19T07:20:19.542294+0000","last_became_peered":"2024-09-19T07:20:19.542294+0000","last_unstale":"2024-09-19T07:22:03.805167+0000","last_undegraded":"2024-09-19T07:22:03.805167+0000","last_fullsized":"2024-09-19T07:22:03.805167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:32.119366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'39","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:04.032255+0000","last_change":"2024-09-19T07:20:17.518402+0000","last_active":"2024-09-19T07:22:04.032255+0000","last_peered":"2024-09-19T07:22:04.032255+0000","last_clean":"2024-09-19T07:22:04.032255+0000","last_became_active":"2024-09-19T07:20:17.517524+0000","last_became_peered":"2024-09-19T07:20:17.517524+0000","last_unstale":"2024-09-19T07:22:04.032255+0000","last_undegraded":"2024-09-19T07:22:04.032255+0000","last_fullsized":"2024-09-19T07:22:04.032255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:49.843442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.809548+0000","last_change":"2024-09-19T07:20:19.540945+0000","last_active":"2024-09-19T07:22:03.809548+0000","last_peered":"2024-09-19T07:22:03.809548+0000","last_clean":"2024-09-19T07:22:03.809548+0000","last_became_active":"2024-09-19T07:20:19.540641+0000","last_became_peered":"2024-09-19T07:20:19.540641+0000","last_unstale":"2024-09-19T07:22:03.809548+0000","last_undegraded":"2024-09-19T07:22:03.809548+0000","last_fullsized":"2024-09-19T07:22:03.809548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.487418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.774962+0000","last_change":"2024-09-19T07:20:17.567010+0000","last_active":"2024-09-19T07:22:03.774962+0000","last_peered":"2024-09-19T07:22:03.774962+0000","last_clean":"2024-09-19T07:22:03.774962+0000","last_became_active":"2024-09-19T07:20:17.566560+0000","last_became_peered":"2024-09-19T07:20:17.566560+0000","last_unstale":"2024-09-19T07:22:03.774962+0000","last_undegraded":"2024-09-19T07:22:03.774962+0000","last_fullsized":"2024-09-19T07:22:03.774962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.349568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813860+0000","last_change":"2024-09-19T07:20:19.541808+0000","last_active":"2024-09-19T07:22:03.813860+0000","last_peered":"2024-09-19T07:22:03.813860+0000","last_clean":"2024-09-19T07:22:03.813860+0000","last_became_active":"2024-09-19T07:20:19.541510+0000","last_became_peered":"2024-09-19T07:20:19.541510+0000","last_unstale":"2024-09-19T07:22:03.813860+0000","last_undegraded":"2024-09-19T07:22:03.813860+0000","last_fullsized":"2024-09-19T07:22:03.813860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:04.156121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":344,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776640+0000","last_change":"2024-09-19T07:19:11.632651+0000","last_active":"2024-09-19T07:22:03.776640+0000","last_peered":"2024-09-19T07:22:03.776640+0000","last_clean":"2024-09-19T07:22:03.776640+0000","last_became_active":"2024-09-19T07:19:11.632229+0000","last_became_peered":"2024-09-19T07:19:11.632229+0000","last_unstale":"2024-09-19T07:22:03.776640+0000","last_undegraded":"2024-09-19T07:22:03.776640+0000","last_fullsized":"2024-09-19T07:22:03.776640+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_clean_scrub_stamp":"2024-09-19T07:15:50.875302+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:32.716049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.763366+0000","last_change":"2024-09-19T07:20:17.512387+0000","last_active":"2024-09-19T07:22:03.763366+0000","last_peered":"2024-09-19T07:22:03.763366+0000","last_clean":"2024-09-19T07:22:03.763366+0000","last_became_active":"2024-09-19T07:20:17.511956+0000","last_became_peered":"2024-09-19T07:20:17.511956+0000","last_unstale":"2024-09-19T07:22:03.763366+0000","last_undegraded":"2024-09-19T07:22:03.763366+0000","last_fullsized":"2024-09-19T07:22:03.763366+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:13.098347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813504+0000","last_change":"2024-09-19T07:20:19.536280+0000","last_active":"2024-09-19T07:22:03.813504+0000","last_peered":"2024-09-19T07:22:03.813504+0000","last_clean":"2024-09-19T07:22:03.813504+0000","last_became_active":"2024-09-19T07:20:19.535809+0000","last_became_peered":"2024-09-19T07:20:19.535809+0000","last_unstale":"2024-09-19T07:22:03.813504+0000","last_undegraded":"2024-09-19T07:22:03.813504+0000","last_fullsized":"2024-09-19T07:22:03.813504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:07.645476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.765247+0000","last_change":"2024-09-19T07:20:37.800603+0000","last_active":"2024-09-19T07:22:03.765247+0000","last_peered":"2024-09-19T07:22:03.765247+0000","last_clean":"2024-09-19T07:22:03.765247+0000","last_became_active":"2024-09-19T07:20:37.794728+0000","last_became_peered":"2024-09-19T07:20:37.794728+0000","last_unstale":"2024-09-19T07:22:03.765247+0000","last_undegraded":"2024-09-19T07:22:03.765247+0000","last_fullsized":"2024-09-19T07:22:03.765247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:46.606645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808940+0000","last_change":"2024-09-19T07:20:19.540203+0000","last_active":"2024-09-19T07:22:03.808940+0000","last_peered":"2024-09-19T07:22:03.808940+0000","last_clean":"2024-09-19T07:22:03.808940+0000","last_became_active":"2024-09-19T07:20:19.539813+0000","last_became_peered":"2024-09-19T07:20:19.539813+0000","last_unstale":"2024-09-19T07:22:03.808940+0000","last_undegraded":"2024-09-19T07:22:03.808940+0000","last_fullsized":"2024-09-19T07:22:03.808940+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:52.164881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":124,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.897290+0000","last_change":"2024-09-19T07:20:17.565449+0000","last_active":"2024-09-19T07:22:03.897290+0000","last_peered":"2024-09-19T07:22:03.897290+0000","last_clean":"2024-09-19T07:22:03.897290+0000","last_became_active":"2024-09-19T07:20:17.565079+0000","last_became_peered":"2024-09-19T07:20:17.565079+0000","last_unstale":"2024-09-19T07:22:03.897290+0000","last_undegraded":"2024-09-19T07:22:03.897290+0000","last_fullsized":"2024-09-19T07:22:03.897290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:50.791388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808040+0000","last_change":"2024-09-19T07:20:19.533817+0000","last_active":"2024-09-19T07:22:03.808040+0000","last_peered":"2024-09-19T07:22:03.808040+0000","last_clean":"2024-09-19T07:22:03.808040+0000","last_became_active":"2024-09-19T07:20:19.532144+0000","last_became_peered":"2024-09-19T07:20:19.532144+0000","last_unstale":"2024-09-19T07:22:03.808040+0000","last_undegraded":"2024-09-19T07:22:03.808040+0000","last_fullsized":"2024-09-19T07:22:03.808040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:18.928739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.779225+0000","last_change":"2024-09-19T07:20:17.514063+0000","last_active":"2024-09-19T07:22:03.779225+0000","last_peered":"2024-09-19T07:22:03.779225+0000","last_clean":"2024-09-19T07:22:03.779225+0000","last_became_active":"2024-09-19T07:20:17.513633+0000","last_became_peered":"2024-09-19T07:20:17.513633+0000","last_unstale":"2024-09-19T07:22:03.779225+0000","last_undegraded":"2024-09-19T07:22:03.779225+0000","last_fullsized":"2024-09-19T07:22:03.779225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:24.113053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815734+0000","last_change":"2024-09-19T07:20:19.540209+0000","last_active":"2024-09-19T07:22:03.815734+0000","last_peered":"2024-09-19T07:22:03.815734+0000","last_clean":"2024-09-19T07:22:03.815734+0000","last_became_active":"2024-09-19T07:20:19.539855+0000","last_became_peered":"2024-09-19T07:20:19.539855+0000","last_unstale":"2024-09-19T07:22:03.815734+0000","last_undegraded":"2024-09-19T07:22:03.815734+0000","last_fullsized":"2024-09-19T07:22:03.815734+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:40.878905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776263+0000","last_change":"2024-09-19T07:20:17.565627+0000","last_active":"2024-09-19T07:22:03.776263+0000","last_peered":"2024-09-19T07:22:03.776263+0000","last_clean":"2024-09-19T07:22:03.776263+0000","last_became_active":"2024-09-19T07:20:17.565231+0000","last_became_peered":"2024-09-19T07:20:17.565231+0000","last_unstale":"2024-09-19T07:22:03.776263+0000","last_undegraded":"2024-09-19T07:22:03.776263+0000","last_fullsized":"2024-09-19T07:22:03.776263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:53.105336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817750+0000","last_change":"2024-09-19T07:20:19.532418+0000","last_active":"2024-09-19T07:22:03.817750+0000","last_peered":"2024-09-19T07:22:03.817750+0000","last_clean":"2024-09-19T07:22:03.817750+0000","last_became_active":"2024-09-19T07:20:19.532113+0000","last_became_peered":"2024-09-19T07:20:19.532113+0000","last_unstale":"2024-09-19T07:22:03.817750+0000","last_undegraded":"2024-09-19T07:22:03.817750+0000","last_fullsized":"2024-09-19T07:22:03.817750+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:24.953720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775943+0000","last_change":"2024-09-19T07:20:17.565984+0000","last_active":"2024-09-19T07:22:03.775943+0000","last_peered":"2024-09-19T07:22:03.775943+0000","last_clean":"2024-09-19T07:22:03.775943+0000","last_became_active":"2024-09-19T07:20:17.565240+0000","last_became_peered":"2024-09-19T07:20:17.565240+0000","last_unstale":"2024-09-19T07:22:03.775943+0000","last_undegraded":"2024-09-19T07:22:03.775943+0000","last_fullsized":"2024-09-19T07:22:03.775943+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:07.906716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807964+0000","last_change":"2024-09-19T07:20:19.534400+0000","last_active":"2024-09-19T07:22:03.807964+0000","last_peered":"2024-09-19T07:22:03.807964+0000","last_clean":"2024-09-19T07:22:03.807964+0000","last_became_active":"2024-09-19T07:20:19.534130+0000","last_became_peered":"2024-09-19T07:20:19.534130+0000","last_unstale":"2024-09-19T07:22:03.807964+0000","last_undegraded":"2024-09-19T07:22:03.807964+0000","last_fullsized":"2024-09-19T07:22:03.807964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:09.398112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'47","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:04.038605+0000","last_change":"2024-09-19T07:20:17.519628+0000","last_active":"2024-09-19T07:22:04.038605+0000","last_peered":"2024-09-19T07:22:04.038605+0000","last_clean":"2024-09-19T07:22:04.038605+0000","last_became_active":"2024-09-19T07:20:17.519276+0000","last_became_peered":"2024-09-19T07:20:17.519276+0000","last_unstale":"2024-09-19T07:22:04.038605+0000","last_undegraded":"2024-09-19T07:22:04.038605+0000","last_fullsized":"2024-09-19T07:22:04.038605+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.193091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":85,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805204+0000","last_change":"2024-09-19T07:20:19.533425+0000","last_active":"2024-09-19T07:22:03.805204+0000","last_peered":"2024-09-19T07:22:03.805204+0000","last_clean":"2024-09-19T07:22:03.805204+0000","last_became_active":"2024-09-19T07:20:19.533142+0000","last_became_peered":"2024-09-19T07:20:19.533142+0000","last_unstale":"2024-09-19T07:22:03.805204+0000","last_undegraded":"2024-09-19T07:22:03.805204+0000","last_fullsized":"2024-09-19T07:22:03.805204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:07.048006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.763685+0000","last_change":"2024-09-19T07:20:17.512776+0000","last_active":"2024-09-19T07:22:03.763685+0000","last_peered":"2024-09-19T07:22:03.763685+0000","last_clean":"2024-09-19T07:22:03.763685+0000","last_became_active":"2024-09-19T07:20:17.511862+0000","last_became_peered":"2024-09-19T07:20:17.511862+0000","last_unstale":"2024-09-19T07:22:03.763685+0000","last_undegraded":"2024-09-19T07:22:03.763685+0000","last_fullsized":"2024-09-19T07:22:03.763685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:08.211654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817223+0000","last_change":"2024-09-19T07:20:19.539260+0000","last_active":"2024-09-19T07:22:03.817223+0000","last_peered":"2024-09-19T07:22:03.817223+0000","last_clean":"2024-09-19T07:22:03.817223+0000","last_became_active":"2024-09-19T07:20:19.538868+0000","last_became_peered":"2024-09-19T07:20:19.538868+0000","last_unstale":"2024-09-19T07:22:03.817223+0000","last_undegraded":"2024-09-19T07:22:03.817223+0000","last_fullsized":"2024-09-19T07:22:03.817223+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:44.198084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.772518+0000","last_change":"2024-09-19T07:20:17.565544+0000","last_active":"2024-09-19T07:22:03.772518+0000","last_peered":"2024-09-19T07:22:03.772518+0000","last_clean":"2024-09-19T07:22:03.772518+0000","last_became_active":"2024-09-19T07:20:17.565250+0000","last_became_peered":"2024-09-19T07:20:17.565250+0000","last_unstale":"2024-09-19T07:22:03.772518+0000","last_undegraded":"2024-09-19T07:22:03.772518+0000","last_fullsized":"2024-09-19T07:22:03.772518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:25.523136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.788564+0000","last_change":"2024-09-19T07:20:19.531467+0000","last_active":"2024-09-19T07:22:03.788564+0000","last_peered":"2024-09-19T07:22:03.788564+0000","last_clean":"2024-09-19T07:22:03.788564+0000","last_became_active":"2024-09-19T07:20:19.531170+0000","last_became_peered":"2024-09-19T07:20:19.531170+0000","last_unstale":"2024-09-19T07:22:03.788564+0000","last_undegraded":"2024-09-19T07:22:03.788564+0000","last_fullsized":"2024-09-19T07:22:03.788564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:23.113097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775823+0000","last_change":"2024-09-19T07:20:17.511400+0000","last_active":"2024-09-19T07:22:03.775823+0000","last_peered":"2024-09-19T07:22:03.775823+0000","last_clean":"2024-09-19T07:22:03.775823+0000","last_became_active":"2024-09-19T07:20:17.511126+0000","last_became_peered":"2024-09-19T07:20:17.511126+0000","last_unstale":"2024-09-19T07:22:03.775823+0000","last_undegraded":"2024-09-19T07:22:03.775823+0000","last_fullsized":"2024-09-19T07:22:03.775823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.485406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818052+0000","last_change":"2024-09-19T07:20:19.529171+0000","last_active":"2024-09-19T07:22:03.818052+0000","last_peered":"2024-09-19T07:22:03.818052+0000","last_clean":"2024-09-19T07:22:03.818052+0000","last_became_active":"2024-09-19T07:20:19.528489+0000","last_became_peered":"2024-09-19T07:20:19.528489+0000","last_unstale":"2024-09-19T07:22:03.818052+0000","last_undegraded":"2024-09-19T07:22:03.818052+0000","last_fullsized":"2024-09-19T07:22:03.818052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:10.842619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.765334+0000","last_change":"2024-09-19T07:20:37.803560+0000","last_active":"2024-09-19T07:22:03.765334+0000","last_peered":"2024-09-19T07:22:03.765334+0000","last_clean":"2024-09-19T07:22:03.765334+0000","last_became_active":"2024-09-19T07:20:37.797396+0000","last_became_peered":"2024-09-19T07:20:37.797396+0000","last_unstale":"2024-09-19T07:22:03.765334+0000","last_undegraded":"2024-09-19T07:22:03.765334+0000","last_fullsized":"2024-09-19T07:22:03.765334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:41.944179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818481+0000","last_change":"2024-09-19T07:20:19.532698+0000","last_active":"2024-09-19T07:22:03.818481+0000","last_peered":"2024-09-19T07:22:03.818481+0000","last_clean":"2024-09-19T07:22:03.818481+0000","last_became_active":"2024-09-19T07:20:19.531978+0000","last_became_peered":"2024-09-19T07:20:19.531978+0000","last_unstale":"2024-09-19T07:22:03.818481+0000","last_undegraded":"2024-09-19T07:22:03.818481+0000","last_fullsized":"2024-09-19T07:22:03.818481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:44.257024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775088+0000","last_change":"2024-09-19T07:20:17.525240+0000","last_active":"2024-09-19T07:22:03.775088+0000","last_peered":"2024-09-19T07:22:03.775088+0000","last_clean":"2024-09-19T07:22:03.775088+0000","last_became_active":"2024-09-19T07:20:17.524880+0000","last_became_peered":"2024-09-19T07:20:17.524880+0000","last_unstale":"2024-09-19T07:22:03.775088+0000","last_undegraded":"2024-09-19T07:22:03.775088+0000","last_fullsized":"2024-09-19T07:22:03.775088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:41.380246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815849+0000","last_change":"2024-09-19T07:20:19.537116+0000","last_active":"2024-09-19T07:22:03.815849+0000","last_peered":"2024-09-19T07:22:03.815849+0000","last_clean":"2024-09-19T07:22:03.815849+0000","last_became_active":"2024-09-19T07:20:19.536799+0000","last_became_peered":"2024-09-19T07:20:19.536799+0000","last_unstale":"2024-09-19T07:22:03.815849+0000","last_undegraded":"2024-09-19T07:22:03.815849+0000","last_fullsized":"2024-09-19T07:22:03.815849+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:48.401159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815875+0000","last_change":"2024-09-19T07:20:19.527965+0000","last_active":"2024-09-19T07:22:03.815875+0000","last_peered":"2024-09-19T07:22:03.815875+0000","last_clean":"2024-09-19T07:22:03.815875+0000","last_became_active":"2024-09-19T07:20:19.527522+0000","last_became_peered":"2024-09-19T07:20:19.527522+0000","last_unstale":"2024-09-19T07:22:03.815875+0000","last_undegraded":"2024-09-19T07:22:03.815875+0000","last_fullsized":"2024-09-19T07:22:03.815875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:16.034153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775281+0000","last_change":"2024-09-19T07:20:17.519400+0000","last_active":"2024-09-19T07:22:03.775281+0000","last_peered":"2024-09-19T07:22:03.775281+0000","last_clean":"2024-09-19T07:22:03.775281+0000","last_became_active":"2024-09-19T07:20:17.518993+0000","last_became_peered":"2024-09-19T07:20:17.518993+0000","last_unstale":"2024-09-19T07:22:03.775281+0000","last_undegraded":"2024-09-19T07:22:03.775281+0000","last_fullsized":"2024-09-19T07:22:03.775281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:37.086763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815623+0000","last_change":"2024-09-19T07:20:19.531016+0000","last_active":"2024-09-19T07:22:03.815623+0000","last_peered":"2024-09-19T07:22:03.815623+0000","last_clean":"2024-09-19T07:22:03.815623+0000","last_became_active":"2024-09-19T07:20:19.530706+0000","last_became_peered":"2024-09-19T07:20:19.530706+0000","last_unstale":"2024-09-19T07:22:03.815623+0000","last_undegraded":"2024-09-19T07:22:03.815623+0000","last_fullsized":"2024-09-19T07:22:03.815623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:36.566185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775906+0000","last_change":"2024-09-19T07:20:17.524215+0000","last_active":"2024-09-19T07:22:03.775906+0000","last_peered":"2024-09-19T07:22:03.775906+0000","last_clean":"2024-09-19T07:22:03.775906+0000","last_became_active":"2024-09-19T07:20:17.523813+0000","last_became_peered":"2024-09-19T07:20:17.523813+0000","last_unstale":"2024-09-19T07:22:03.775906+0000","last_undegraded":"2024-09-19T07:22:03.775906+0000","last_fullsized":"2024-09-19T07:22:03.775906+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:58.803225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.821404+0000","last_change":"2024-09-19T07:20:19.540994+0000","last_active":"2024-09-19T07:22:03.821404+0000","last_peered":"2024-09-19T07:22:03.821404+0000","last_clean":"2024-09-19T07:22:03.821404+0000","last_became_active":"2024-09-19T07:20:19.540703+0000","last_became_peered":"2024-09-19T07:20:19.540703+0000","last_unstale":"2024-09-19T07:22:03.821404+0000","last_undegraded":"2024-09-19T07:22:03.821404+0000","last_fullsized":"2024-09-19T07:22:03.821404+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:37.065187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775249+0000","last_change":"2024-09-19T07:20:17.565438+0000","last_active":"2024-09-19T07:22:03.775249+0000","last_peered":"2024-09-19T07:22:03.775249+0000","last_clean":"2024-09-19T07:22:03.775249+0000","last_became_active":"2024-09-19T07:20:17.565128+0000","last_became_peered":"2024-09-19T07:20:17.565128+0000","last_unstale":"2024-09-19T07:22:03.775249+0000","last_undegraded":"2024-09-19T07:22:03.775249+0000","last_fullsized":"2024-09-19T07:22:03.775249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:02.048971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810388+0000","last_change":"2024-09-19T07:20:37.794369+0000","last_active":"2024-09-19T07:22:03.810388+0000","last_peered":"2024-09-19T07:22:03.810388+0000","last_clean":"2024-09-19T07:22:03.810388+0000","last_became_active":"2024-09-19T07:20:37.794036+0000","last_became_peered":"2024-09-19T07:20:37.794036+0000","last_unstale":"2024-09-19T07:22:03.810388+0000","last_undegraded":"2024-09-19T07:22:03.810388+0000","last_fullsized":"2024-09-19T07:22:03.810388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:02.684191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":50,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.777038+0000","last_change":"2024-09-19T07:20:37.950846+0000","last_active":"2024-09-19T07:22:03.777038+0000","last_peered":"2024-09-19T07:22:03.777038+0000","last_clean":"2024-09-19T07:22:03.777038+0000","last_became_active":"2024-09-19T07:20:37.944266+0000","last_became_peered":"2024-09-19T07:20:37.944266+0000","last_unstale":"2024-09-19T07:22:03.777038+0000","last_undegraded":"2024-09-19T07:22:03.777038+0000","last_fullsized":"2024-09-19T07:22:03.777038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:12.952833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":596000,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":689,"num_read_kb":446,"num_write":287,"num_write_kb":1432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27529,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1788000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645346,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":437330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874278,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28776,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716376,"statfs":{"total":95995035648,"available":95965569024,"internally_reserved":0,"allocated":1732608,"data_stored":1226105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037802,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":437566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1302528,"data_stored":830120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495669,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1507328,"data_stored":1030119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659193,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":436955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888127,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1654784,"data_stored":1161010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":504847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247880,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1445888,"data_stored":962082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444109,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":438799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607634,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":966656,"data_stored":502442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":438226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":133777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":200051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:22:09.408 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:22:09.691 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:10.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:09 smithi139 ceph-mon[35039]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:10.102 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:09 smithi098 ceph-mon[30950]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:10.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:09 smithi162 ceph-mon[35726]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:10.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.180+0000 7fae90ee9640 1 -- 172.21.15.98:0/286135122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae8c10c170 msgr2=0x7fae8c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:10.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.180+0000 7fae90ee9640 1 --2- 172.21.15.98:0/286135122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae8c10c170 0x7fae8c10e610 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fae84009ca0 tx=0x7fae8402a950 comp rx=0 tx=0).stop 2024-09-19T07:22:10.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.180+0000 7fae90ee9640 1 -- 172.21.15.98:0/286135122 shutdown_connections 2024-09-19T07:22:10.202 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.180+0000 7fae90ee9640 1 --2- 172.21.15.98:0/286135122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae8c10c170 0x7fae8c10e610 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:10.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.180+0000 7fae90ee9640 1 --2- 172.21.15.98:0/286135122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8c103660 0x7fae8c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:10.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.180+0000 7fae90ee9640 1 --2- 172.21.15.98:0/286135122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae8c102d40 0x7fae8c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:10.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.180+0000 7fae90ee9640 1 -- 172.21.15.98:0/286135122 >> 172.21.15.98:0/286135122 conn(0x7fae8c0fc7a0 msgr2=0x7fae8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:10.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.180+0000 7fae90ee9640 1 -- 172.21.15.98:0/286135122 shutdown_connections 2024-09-19T07:22:10.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.181+0000 7fae90ee9640 1 -- 172.21.15.98:0/286135122 wait complete. 2024-09-19T07:22:10.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.181+0000 7fae90ee9640 1 Processor -- start 2024-09-19T07:22:10.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.181+0000 7fae90ee9640 1 -- start start 2024-09-19T07:22:10.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.181+0000 7fae90ee9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8c102d40 0x7fae8c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:10.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.181+0000 7fae90ee9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae8c103660 0x7fae8c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:10.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.181+0000 7fae90ee9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae8c10c170 0x7fae8c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:10.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.181+0000 7fae90ee9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c111fc0 con 0x7fae8c10c170 2024-09-19T07:22:10.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.181+0000 7fae90ee9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c111e40 con 0x7fae8c102d40 2024-09-19T07:22:10.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.181+0000 7fae90ee9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c112140 con 0x7fae8c103660 2024-09-19T07:22:10.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae8ad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae8c10c170 0x7fae8c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:10.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae8ad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae8c10c170 0x7fae8c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59946/0 (socket says 172.21.15.98:59946) 2024-09-19T07:22:10.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae8ad9d640 1 -- 172.21.15.98:0/2683661449 learned_addr learned my addr 172.21.15.98:0/2683661449 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:10.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae8a59c640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8c102d40 0x7fae8c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:10.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae89d9b640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae8c103660 0x7fae8c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:10.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae8ad9d640 1 -- 172.21.15.98:0/2683661449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae8c103660 msgr2=0x7fae8c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:10.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae8ad9d640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae8c103660 0x7fae8c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:10.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae8ad9d640 1 -- 172.21.15.98:0/2683661449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8c102d40 msgr2=0x7fae8c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:10.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae8ad9d640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8c102d40 0x7fae8c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:10.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae8ad9d640 1 -- 172.21.15.98:0/2683661449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8c1a6860 con 0x7fae8c10c170 2024-09-19T07:22:10.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae8a59c640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8c102d40 0x7fae8c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:10.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae8ad9d640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae8c10c170 0x7fae8c101420 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fae84009dc0 tx=0x7fae84003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:10.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae7b7fe640 1 -- 172.21.15.98:0/2683661449 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae84034040 con 0x7fae8c10c170 2024-09-19T07:22:10.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae90ee9640 1 -- 172.21.15.98:0/2683661449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8c1a6af0 con 0x7fae8c10c170 2024-09-19T07:22:10.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae7b7fe640 1 -- 172.21.15.98:0/2683661449 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae8402fe20 con 0x7fae8c10c170 2024-09-19T07:22:10.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae7b7fe640 1 -- 172.21.15.98:0/2683661449 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae840047f0 con 0x7fae8c10c170 2024-09-19T07:22:10.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.182+0000 7fae90ee9640 1 -- 172.21.15.98:0/2683661449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae8c1a6fd0 con 0x7fae8c10c170 2024-09-19T07:22:10.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.183+0000 7fae90ee9640 1 -- 172.21.15.98:0/2683661449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae8c103120 con 0x7fae8c10c170 2024-09-19T07:22:10.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.184+0000 7fae7b7fe640 1 -- 172.21.15.98:0/2683661449 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fae84037020 con 0x7fae8c10c170 2024-09-19T07:22:10.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.185+0000 7fae7b7fe640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fae740a34d0 0x7fae740a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:10.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.185+0000 7fae8a59c640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fae740a34d0 0x7fae740a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:10.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.185+0000 7fae7b7fe640 1 -- 172.21.15.98:0/2683661449 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fae840f0eb0 con 0x7fae8c10c170 2024-09-19T07:22:10.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.185+0000 7fae8a59c640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fae740a34d0 0x7fae740a5990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0058c0 tx=0x7fae7c005850 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:10.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.189+0000 7fae7b7fe640 1 -- 172.21.15.98:0/2683661449 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fae840bd720 con 0x7fae8c10c170 2024-09-19T07:22:10.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.391+0000 7fae90ee9640 1 -- 172.21.15.98:0/2683661449 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae8c1a7200 con 0x7fae8c10c170 2024-09-19T07:22:10.392 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.392+0000 7fae7b7fe640 1 -- 172.21.15.98:0/2683661449 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7fae840bd020 con 0x7fae8c10c170 2024-09-19T07:22:10.393 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:10.393 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:22:10.395 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:22:10.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.394+0000 7fae90ee9640 1 -- 172.21.15.98:0/2683661449 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fae740a34d0 msgr2=0x7fae740a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:10.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.394+0000 7fae90ee9640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fae740a34d0 0x7fae740a5990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0058c0 tx=0x7fae7c005850 comp rx=0 tx=0).stop 2024-09-19T07:22:10.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.394+0000 7fae90ee9640 1 -- 172.21.15.98:0/2683661449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae8c10c170 msgr2=0x7fae8c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:10.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.394+0000 7fae90ee9640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae8c10c170 0x7fae8c101420 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fae84009dc0 tx=0x7fae84003f10 comp rx=0 tx=0).stop 2024-09-19T07:22:10.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.394+0000 7fae90ee9640 1 -- 172.21.15.98:0/2683661449 shutdown_connections 2024-09-19T07:22:10.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.394+0000 7fae90ee9640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fae740a34d0 0x7fae740a5990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:10.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.394+0000 7fae90ee9640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae8c10c170 0x7fae8c101420 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:10.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.394+0000 7fae90ee9640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae8c103660 0x7fae8c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:10.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.394+0000 7fae90ee9640 1 --2- 172.21.15.98:0/2683661449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae8c102d40 0x7fae8c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:10.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.394+0000 7fae90ee9640 1 -- 172.21.15.98:0/2683661449 >> 172.21.15.98:0/2683661449 conn(0x7fae8c0fc7a0 msgr2=0x7fae8c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:10.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.394+0000 7fae90ee9640 1 -- 172.21.15.98:0/2683661449 shutdown_connections 2024-09-19T07:22:10.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:10.394+0000 7fae90ee9640 1 -- 172.21.15.98:0/2683661449 wait complete. 2024-09-19T07:22:11.012 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:22:11.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:10 smithi139 ceph-mon[35039]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:11.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:10 smithi139 ceph-mon[35039]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:11.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:10 smithi139 ceph-mon[35039]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-19T07:22:11.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:10 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2683661449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:11.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:10 smithi162 ceph-mon[35726]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:11.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:10 smithi162 ceph-mon[35726]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:11.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:10 smithi162 ceph-mon[35726]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-19T07:22:11.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:10 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2683661449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:11.268 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:11.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:10 smithi098 ceph-mon[30950]: from='client.15231 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:11.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:10 smithi098 ceph-mon[30950]: from='client.15237 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:11.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:10 smithi098 ceph-mon[30950]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-19T07:22:11.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:10 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2683661449' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:11.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.782+0000 7f28bcb74640 1 -- 172.21.15.98:0/3971729391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b8106a80 msgr2=0x7f28b8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:11.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.782+0000 7f28bcb74640 1 --2- 172.21.15.98:0/3971729391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b8106a80 0x7f28b8106e60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009930 tx=0x7f28a802a420 comp rx=0 tx=0).stop 2024-09-19T07:22:11.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.782+0000 7f28bcb74640 1 -- 172.21.15.98:0/3971729391 shutdown_connections 2024-09-19T07:22:11.811 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.782+0000 7f28bcb74640 1 --2- 172.21.15.98:0/3971729391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28b8101420 0x7f28b810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:11.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.782+0000 7f28bcb74640 1 --2- 172.21.15.98:0/3971729391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b8100a80 0x7f28b8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:11.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.782+0000 7f28bcb74640 1 --2- 172.21.15.98:0/3971729391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b8106a80 0x7f28b8106e60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:11.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.782+0000 7f28bcb74640 1 -- 172.21.15.98:0/3971729391 >> 172.21.15.98:0/3971729391 conn(0x7f28b80fc7a0 msgr2=0x7f28b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:11.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.782+0000 7f28bcb74640 1 -- 172.21.15.98:0/3971729391 shutdown_connections 2024-09-19T07:22:11.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.782+0000 7f28bcb74640 1 -- 172.21.15.98:0/3971729391 wait complete. 2024-09-19T07:22:11.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.783+0000 7f28bcb74640 1 Processor -- start 2024-09-19T07:22:11.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28bcb74640 1 -- start start 2024-09-19T07:22:11.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28bcb74640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28b8100a80 0x7f28b8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:11.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28bcb74640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b8101420 0x7f28b8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:11.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28bcb74640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b8106a80 0x7f28b819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:11.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28bcb74640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f28b8111fa0 con 0x7f28b8106a80 2024-09-19T07:22:11.812 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28bcb74640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f28b8111e20 con 0x7f28b8100a80 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28bcb74640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28b8112120 con 0x7f28b8101420 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28b6d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b8106a80 0x7f28b819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28b6d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b8106a80 0x7f28b819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59958/0 (socket says 172.21.15.98:59958) 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28b6d9d640 1 -- 172.21.15.98:0/419154128 learned_addr learned my addr 172.21.15.98:0/419154128 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28b659c640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28b8100a80 0x7f28b8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28b5d9b640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b8101420 0x7f28b8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28b6d9d640 1 -- 172.21.15.98:0/419154128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b8101420 msgr2=0x7f28b8198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28b6d9d640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b8101420 0x7f28b8198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28b6d9d640 1 -- 172.21.15.98:0/419154128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28b8100a80 msgr2=0x7f28b8198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28b6d9d640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28b8100a80 0x7f28b8198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28b6d9d640 1 -- 172.21.15.98:0/419154128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b819d4b0 con 0x7f28b8106a80 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.784+0000 7f28b6d9d640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b8106a80 0x7f28b819cdd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f28b000cad0 tx=0x7f28b000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:11.813 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.785+0000 7f28af7fe640 1 -- 172.21.15.98:0/419154128 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b000ae20 con 0x7f28b8106a80 2024-09-19T07:22:11.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.785+0000 7f28af7fe640 1 -- 172.21.15.98:0/419154128 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28b0005020 con 0x7f28b8106a80 2024-09-19T07:22:11.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.785+0000 7f28af7fe640 1 -- 172.21.15.98:0/419154128 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b000f6f0 con 0x7f28b8106a80 2024-09-19T07:22:11.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.785+0000 7f28bcb74640 1 -- 172.21.15.98:0/419154128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b819d7a0 con 0x7f28b8106a80 2024-09-19T07:22:11.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.785+0000 7f28bcb74640 1 -- 172.21.15.98:0/419154128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b81a5080 con 0x7f28b8106a80 2024-09-19T07:22:11.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.786+0000 7f28bcb74640 1 -- 172.21.15.98:0/419154128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b8100ee0 con 0x7f28b8106a80 2024-09-19T07:22:11.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.787+0000 7f28af7fe640 1 -- 172.21.15.98:0/419154128 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f28b00051d0 con 0x7f28b8106a80 2024-09-19T07:22:11.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.788+0000 7f28af7fe640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f28a40a34d0 0x7f28a40a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:11.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.788+0000 7f28b659c640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f28a40a34d0 0x7f28a40a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:11.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.788+0000 7f28af7fe640 1 -- 172.21.15.98:0/419154128 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f28b00d0100 con 0x7f28b8106a80 2024-09-19T07:22:11.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.788+0000 7f28b659c640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f28a40a34d0 0x7f28a40a5990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009900 tx=0x7f28a80058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:11.814 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.792+0000 7f28af7fe640 1 -- 172.21.15.98:0/419154128 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f28b0014030 con 0x7f28b8106a80 2024-09-19T07:22:11.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.962+0000 7f28bcb74640 1 -- 172.21.15.98:0/419154128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28b8108a60 con 0x7f28b8106a80 2024-09-19T07:22:11.962 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:11 smithi098 ceph-mon[30950]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.1 KiB/s wr, 23 op/s 2024-09-19T07:22:11.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.963+0000 7f28af7fe640 1 -- 172.21.15.98:0/419154128 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+23201 (secure 0 0 0) 0x7f28b009c800 con 0x7f28b8106a80 2024-09-19T07:22:11.964 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:11.964 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":81,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:22:03.757463+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:20:16.391879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:20:18.243837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/3732813400":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6801/2172632890":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/2271200719":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/617371908":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1543222160":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1123383068":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6800/2172632890":"2024-09-20T07:22:03.757428+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:22:11.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.966+0000 7f28bcb74640 1 -- 172.21.15.98:0/419154128 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f28a40a34d0 msgr2=0x7f28a40a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:11.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.966+0000 7f28bcb74640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f28a40a34d0 0x7f28a40a5990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009900 tx=0x7f28a80058d0 comp rx=0 tx=0).stop 2024-09-19T07:22:11.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.966+0000 7f28bcb74640 1 -- 172.21.15.98:0/419154128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b8106a80 msgr2=0x7f28b819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:11.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.966+0000 7f28bcb74640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b8106a80 0x7f28b819cdd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f28b000cad0 tx=0x7f28b000cf90 comp rx=0 tx=0).stop 2024-09-19T07:22:11.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.966+0000 7f28bcb74640 1 -- 172.21.15.98:0/419154128 shutdown_connections 2024-09-19T07:22:11.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.966+0000 7f28bcb74640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f28a40a34d0 0x7f28a40a5990 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:11.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.966+0000 7f28bcb74640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b8106a80 0x7f28b819cdd0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:11.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.966+0000 7f28bcb74640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28b8101420 0x7f28b8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:11.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.966+0000 7f28bcb74640 1 --2- 172.21.15.98:0/419154128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f28b8100a80 0x7f28b8198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:11.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.966+0000 7f28bcb74640 1 -- 172.21.15.98:0/419154128 >> 172.21.15.98:0/419154128 conn(0x7f28b80fc7a0 msgr2=0x7f28b80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:11.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.966+0000 7f28bcb74640 1 -- 172.21.15.98:0/419154128 shutdown_connections 2024-09-19T07:22:11.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:11.966+0000 7f28bcb74640 1 -- 172.21.15.98:0/419154128 wait complete. 2024-09-19T07:22:12.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:11 smithi139 ceph-mon[35039]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.1 KiB/s wr, 23 op/s 2024-09-19T07:22:12.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:11 smithi162 ceph-mon[35726]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.1 KiB/s wr, 23 op/s 2024-09-19T07:22:12.705 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T07:22:12.706 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T07:22:12.715 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:22:12.715 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-19T07:22:12.715 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T07:22:12.715 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T07:22:12.716 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:22:12.716 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:22:12.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.824+0000 7f25cfd49640 1 -- 172.21.15.98:0/1488995276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c8101230 msgr2=0x7f25c810def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:12.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.824+0000 7f25cfd49640 1 --2- 172.21.15.98:0/1488995276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c8101230 0x7f25c810def0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009900 tx=0x7f25b802a410 comp rx=0 tx=0).stop 2024-09-19T07:22:12.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.824+0000 7f25cfd49640 1 -- 172.21.15.98:0/1488995276 shutdown_connections 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.824+0000 7f25cfd49640 1 --2- 172.21.15.98:0/1488995276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25c810e430 0x7f25c8110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.824+0000 7f25cfd49640 1 --2- 172.21.15.98:0/1488995276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c8101230 0x7f25c810def0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.824+0000 7f25cfd49640 1 --2- 172.21.15.98:0/1488995276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25c8100880 0x7f25c8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.824+0000 7f25cfd49640 1 -- 172.21.15.98:0/1488995276 >> 172.21.15.98:0/1488995276 conn(0x7f25c8077990 msgr2=0x7f25c80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.824+0000 7f25cfd49640 1 -- 172.21.15.98:0/1488995276 shutdown_connections 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.824+0000 7f25cfd49640 1 -- 172.21.15.98:0/1488995276 wait complete. 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cfd49640 1 Processor -- start 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cfd49640 1 -- start start 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cfd49640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c8100880 0x7f25c819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cfd49640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25c8101230 0x7f25c819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cfd49640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25c810e430 0x7f25c819ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cfd49640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f25c81140e0 con 0x7f25c8100880 2024-09-19T07:22:12.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cfd49640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8113f60 con 0x7f25c8101230 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cfd49640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8114260 con 0x7f25c810e430 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cdae5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c8100880 0x7f25c819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cdae5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c8100880 0x7f25c819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59950/0 (socket says 172.21.15.98:59950) 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cdae5640 1 -- 172.21.15.98:0/1530746115 learned_addr learned my addr 172.21.15.98:0/1530746115 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cd2e4640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25c8101230 0x7f25c819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cdae5640 1 -- 172.21.15.98:0/1530746115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25c810e430 msgr2=0x7f25c819ee50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cdae5640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25c810e430 0x7f25c819ee50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cdae5640 1 -- 172.21.15.98:0/1530746115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25c8101230 msgr2=0x7f25c819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cdae5640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25c8101230 0x7f25c819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cdae5640 1 -- 172.21.15.98:0/1530746115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c819f580 con 0x7f25c8100880 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cdae5640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c8100880 0x7f25c819a590 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f25c400d950 tx=0x7f25c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25beffd640 1 -- 172.21.15.98:0/1530746115 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c4017070 con 0x7f25c8100880 2024-09-19T07:22:12.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25beffd640 1 -- 172.21.15.98:0/1530746115 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25c4009c30 con 0x7f25c8100880 2024-09-19T07:22:12.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.825+0000 7f25cfd49640 1 -- 172.21.15.98:0/1530746115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c819f870 con 0x7f25c8100880 2024-09-19T07:22:12.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.826+0000 7f25beffd640 1 -- 172.21.15.98:0/1530746115 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c400f6b0 con 0x7f25c8100880 2024-09-19T07:22:12.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.826+0000 7f25cfd49640 1 -- 172.21.15.98:0/1530746115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c81a7100 con 0x7f25c8100880 2024-09-19T07:22:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.826+0000 7f25cfd49640 1 -- 172.21.15.98:0/1530746115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c8100c60 con 0x7f25c8100880 2024-09-19T07:22:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.828+0000 7f25beffd640 1 -- 172.21.15.98:0/1530746115 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f25c40109d0 con 0x7f25c8100880 2024-09-19T07:22:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.829+0000 7f25beffd640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f25b40a3600 0x7f25b40a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.829+0000 7f25cd2e4640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f25b40a3600 0x7f25b40a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.829+0000 7f25beffd640 1 -- 172.21.15.98:0/1530746115 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f25c40cfc20 con 0x7f25c8100880 2024-09-19T07:22:12.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.829+0000 7f25cd2e4640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f25b40a3600 0x7f25b40a5ac0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f25c81026f0 tx=0x7f25b8005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:12.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:12.832+0000 7f25beffd640 1 -- 172.21.15.98:0/1530746115 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25c4009de0 con 0x7f25c8100880 2024-09-19T07:22:12.976 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:13.022 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.021+0000 7f25cfd49640 1 -- 172.21.15.98:0/1530746115 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f25c819b8e0 con 0x7f25c8100880 2024-09-19T07:22:13.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:12 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/419154128' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:22:13.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.025+0000 7f25beffd640 1 -- 172.21.15.98:0/1530746115 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v27)=0 v27) ==== 129+0+0 (secure 0 0 0) 0x7f25c409c400 con 0x7f25c8100880 2024-09-19T07:22:13.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.028+0000 7f25cfd49640 1 -- 172.21.15.98:0/1530746115 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f25b40a3600 msgr2=0x7f25b40a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.028+0000 7f25cfd49640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f25b40a3600 0x7f25b40a5ac0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f25c81026f0 tx=0x7f25b8005a20 comp rx=0 tx=0).stop 2024-09-19T07:22:13.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.028+0000 7f25cfd49640 1 -- 172.21.15.98:0/1530746115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c8100880 msgr2=0x7f25c819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.028+0000 7f25cfd49640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c8100880 0x7f25c819a590 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f25c400d950 tx=0x7f25c400de10 comp rx=0 tx=0).stop 2024-09-19T07:22:13.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.028+0000 7f25cfd49640 1 -- 172.21.15.98:0/1530746115 shutdown_connections 2024-09-19T07:22:13.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.028+0000 7f25cfd49640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f25b40a3600 0x7f25b40a5ac0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.028+0000 7f25cfd49640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25c810e430 0x7f25c819ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.028+0000 7f25cfd49640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25c8101230 0x7f25c819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.028+0000 7f25cfd49640 1 --2- 172.21.15.98:0/1530746115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25c8100880 0x7f25c819a590 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.028+0000 7f25cfd49640 1 -- 172.21.15.98:0/1530746115 >> 172.21.15.98:0/1530746115 conn(0x7f25c8077990 msgr2=0x7f25c80ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:13.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.028+0000 7f25cfd49640 1 -- 172.21.15.98:0/1530746115 shutdown_connections 2024-09-19T07:22:13.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.028+0000 7f25cfd49640 1 -- 172.21.15.98:0/1530746115 wait complete. 2024-09-19T07:22:13.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T07:22:13.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:12 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/419154128' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:22:13.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:12 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/419154128' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:22:13.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.143+0000 7f0af48ba640 1 -- 172.21.15.98:0/368668180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0af0102d50 msgr2=0x7f0af0103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.143+0000 7f0af48ba640 1 --2- 172.21.15.98:0/368668180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0af0102d50 0x7f0af0103130 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009900 tx=0x7f0ae002a480 comp rx=0 tx=0).stop 2024-09-19T07:22:13.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.143+0000 7f0af48ba640 1 -- 172.21.15.98:0/368668180 shutdown_connections 2024-09-19T07:22:13.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.143+0000 7f0af48ba640 1 --2- 172.21.15.98:0/368668180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af010c0e0 0x7f0af010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.143+0000 7f0af48ba640 1 --2- 172.21.15.98:0/368668180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0af0103670 0x7f0af010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.143+0000 7f0af48ba640 1 --2- 172.21.15.98:0/368668180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0af0102d50 0x7f0af0103130 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.143+0000 7f0af48ba640 1 -- 172.21.15.98:0/368668180 >> 172.21.15.98:0/368668180 conn(0x7f0af00fc6e0 msgr2=0x7f0af00feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:13.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.143+0000 7f0af48ba640 1 -- 172.21.15.98:0/368668180 shutdown_connections 2024-09-19T07:22:13.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.143+0000 7f0af48ba640 1 -- 172.21.15.98:0/368668180 wait complete. 2024-09-19T07:22:13.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0af48ba640 1 Processor -- start 2024-09-19T07:22:13.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0af48ba640 1 -- start start 2024-09-19T07:22:13.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0af48ba640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0af0102d50 0x7f0af01982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0af48ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0af0103670 0x7f0af0198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0af48ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af010c0e0 0x7f0af019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0af48ba640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0af0111f20 con 0x7f0af0102d50 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0af48ba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0af0111da0 con 0x7f0af0103670 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0af48ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0af01120a0 con 0x7f0af010c0e0 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0aee59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0af0102d50 0x7f0af01982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0aee59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0af0102d50 0x7f0af01982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59968/0 (socket says 172.21.15.98:59968) 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0aee59c640 1 -- 172.21.15.98:0/2906580456 learned_addr learned my addr 172.21.15.98:0/2906580456 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0aedd9b640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0af0103670 0x7f0af0198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0aee59c640 1 -- 172.21.15.98:0/2906580456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af010c0e0 msgr2=0x7f0af019cbb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0aee59c640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af010c0e0 0x7f0af019cbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0aee59c640 1 -- 172.21.15.98:0/2906580456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0af0103670 msgr2=0x7f0af0198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0aee59c640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0af0103670 0x7f0af0198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.144+0000 7f0aee59c640 1 -- 172.21.15.98:0/2906580456 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af019d2e0 con 0x7f0af0102d50 2024-09-19T07:22:13.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.145+0000 7f0aee59c640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0af0102d50 0x7f0af01982f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0004770 tx=0x7f0ae0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:13.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.145+0000 7f0adf7fe640 1 -- 172.21.15.98:0/2906580456 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae003f070 con 0x7f0af0102d50 2024-09-19T07:22:13.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.145+0000 7f0adf7fe640 1 -- 172.21.15.98:0/2906580456 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ae0031ca0 con 0x7f0af0102d50 2024-09-19T07:22:13.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.145+0000 7f0af48ba640 1 -- 172.21.15.98:0/2906580456 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af019d570 con 0x7f0af0102d50 2024-09-19T07:22:13.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.145+0000 7f0adf7fe640 1 -- 172.21.15.98:0/2906580456 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae0035030 con 0x7f0af0102d50 2024-09-19T07:22:13.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.145+0000 7f0af48ba640 1 -- 172.21.15.98:0/2906580456 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af01a4e60 con 0x7f0af0102d50 2024-09-19T07:22:13.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.146+0000 7f0af48ba640 1 -- 172.21.15.98:0/2906580456 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af006ab80 con 0x7f0af0102d50 2024-09-19T07:22:13.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.147+0000 7f0adf7fe640 1 -- 172.21.15.98:0/2906580456 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f0ae0042070 con 0x7f0af0102d50 2024-09-19T07:22:13.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.147+0000 7f0adf7fe640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0ad80a3580 0x7f0ad80a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.148+0000 7f0aedd9b640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0ad80a3580 0x7f0ad80a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.148+0000 7f0adf7fe640 1 -- 172.21.15.98:0/2906580456 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0ae00f07b0 con 0x7f0af0102d50 2024-09-19T07:22:13.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.148+0000 7f0aedd9b640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0ad80a3580 0x7f0ad80a5a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0af010e990 tx=0x7f0ae400b590 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:13.152 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.152+0000 7f0adf7fe640 1 -- 172.21.15.98:0/2906580456 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ae00bcfe0 con 0x7f0af0102d50 2024-09-19T07:22:13.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.327+0000 7f0af48ba640 1 -- 172.21.15.98:0/2906580456 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f0af01a5060 con 0x7f0af0102d50 2024-09-19T07:22:13.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.331+0000 7f0adf7fe640 1 -- 172.21.15.98:0/2906580456 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) ==== 138+0+0 (secure 0 0 0) 0x7f0ae00bc8e0 con 0x7f0af0102d50 2024-09-19T07:22:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.334+0000 7f0af48ba640 1 -- 172.21.15.98:0/2906580456 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0ad80a3580 msgr2=0x7f0ad80a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.334+0000 7f0af48ba640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0ad80a3580 0x7f0ad80a5a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0af010e990 tx=0x7f0ae400b590 comp rx=0 tx=0).stop 2024-09-19T07:22:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.334+0000 7f0af48ba640 1 -- 172.21.15.98:0/2906580456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0af0102d50 msgr2=0x7f0af01982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.334+0000 7f0af48ba640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0af0102d50 0x7f0af01982f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0004770 tx=0x7f0ae0003c10 comp rx=0 tx=0).stop 2024-09-19T07:22:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.334+0000 7f0af48ba640 1 -- 172.21.15.98:0/2906580456 shutdown_connections 2024-09-19T07:22:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.334+0000 7f0af48ba640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0ad80a3580 0x7f0ad80a5a40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.334+0000 7f0af48ba640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0af010c0e0 0x7f0af019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.334+0000 7f0af48ba640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0af0103670 0x7f0af0198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.334+0000 7f0af48ba640 1 --2- 172.21.15.98:0/2906580456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0af0102d50 0x7f0af01982f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.334+0000 7f0af48ba640 1 -- 172.21.15.98:0/2906580456 >> 172.21.15.98:0/2906580456 conn(0x7f0af00fc6e0 msgr2=0x7f0af00fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:13.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.334+0000 7f0af48ba640 1 -- 172.21.15.98:0/2906580456 shutdown_connections 2024-09-19T07:22:13.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.334+0000 7f0af48ba640 1 -- 172.21.15.98:0/2906580456 wait complete. 2024-09-19T07:22:13.345 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T07:22:13.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.454+0000 7f3e4972c640 1 -- 172.21.15.98:0/4262556364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e44102ca0 msgr2=0x7f3e44103080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.454+0000 7f3e4972c640 1 --2- 172.21.15.98:0/4262556364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e44102ca0 0x7f3e44103080 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009900 tx=0x7f3e3402a410 comp rx=0 tx=0).stop 2024-09-19T07:22:13.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.455+0000 7f3e4972c640 1 -- 172.21.15.98:0/4262556364 shutdown_connections 2024-09-19T07:22:13.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.455+0000 7f3e4972c640 1 --2- 172.21.15.98:0/4262556364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e4410c0d0 0x7f3e4410e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.455+0000 7f3e4972c640 1 --2- 172.21.15.98:0/4262556364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e441035c0 0x7f3e4410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.455+0000 7f3e4972c640 1 --2- 172.21.15.98:0/4262556364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e44102ca0 0x7f3e44103080 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.455+0000 7f3e4972c640 1 -- 172.21.15.98:0/4262556364 >> 172.21.15.98:0/4262556364 conn(0x7f3e440fc6b0 msgr2=0x7f3e440fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:13.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.455+0000 7f3e4972c640 1 -- 172.21.15.98:0/4262556364 shutdown_connections 2024-09-19T07:22:13.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.455+0000 7f3e4972c640 1 -- 172.21.15.98:0/4262556364 wait complete. 2024-09-19T07:22:13.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.455+0000 7f3e4972c640 1 Processor -- start 2024-09-19T07:22:13.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.455+0000 7f3e4972c640 1 -- start start 2024-09-19T07:22:13.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e4972c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e44102ca0 0x7f3e44198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e4972c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e441035c0 0x7f3e44198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e4972c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e4410c0d0 0x7f3e4419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e4972c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3e44111ed0 con 0x7f3e4410c0d0 2024-09-19T07:22:13.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e4972c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3e44111d50 con 0x7f3e441035c0 2024-09-19T07:22:13.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e4972c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e44112050 con 0x7f3e44102ca0 2024-09-19T07:22:13.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e437fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e4410c0d0 0x7f3e4419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e437fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e4410c0d0 0x7f3e4419cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60030/0 (socket says 172.21.15.98:60030) 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e437fe640 1 -- 172.21.15.98:0/3805959606 learned_addr learned my addr 172.21.15.98:0/3805959606 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e42ffd640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e44102ca0 0x7f3e44198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e427fc640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e441035c0 0x7f3e44198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e437fe640 1 -- 172.21.15.98:0/3805959606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e44102ca0 msgr2=0x7f3e44198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e437fe640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e44102ca0 0x7f3e44198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e437fe640 1 -- 172.21.15.98:0/3805959606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e441035c0 msgr2=0x7f3e44198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e437fe640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e441035c0 0x7f3e44198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e437fe640 1 -- 172.21.15.98:0/3805959606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4419d320 con 0x7f3e4410c0d0 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e437fe640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e4410c0d0 0x7f3e4419cbf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00eb10 tx=0x7f3e3c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e2bfff640 1 -- 172.21.15.98:0/3805959606 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c004b20 con 0x7f3e4410c0d0 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e2bfff640 1 -- 172.21.15.98:0/3805959606 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e3c004cc0 con 0x7f3e4410c0d0 2024-09-19T07:22:13.459 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e4972c640 1 -- 172.21.15.98:0/3805959606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4419d610 con 0x7f3e4410c0d0 2024-09-19T07:22:13.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e2bfff640 1 -- 172.21.15.98:0/3805959606 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c010760 con 0x7f3e4410c0d0 2024-09-19T07:22:13.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.456+0000 7f3e4972c640 1 -- 172.21.15.98:0/3805959606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e441a4ea0 con 0x7f3e4410c0d0 2024-09-19T07:22:13.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.458+0000 7f3e4972c640 1 -- 172.21.15.98:0/3805959606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e44103080 con 0x7f3e4410c0d0 2024-09-19T07:22:13.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.459+0000 7f3e2bfff640 1 -- 172.21.15.98:0/3805959606 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f3e3c005020 con 0x7f3e4410c0d0 2024-09-19T07:22:13.460 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.459+0000 7f3e2bfff640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3e2c0a3580 0x7f3e2c0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.460+0000 7f3e42ffd640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3e2c0a3580 0x7f3e2c0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.460+0000 7f3e2bfff640 1 -- 172.21.15.98:0/3805959606 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f3e3c0d04f0 con 0x7f3e4410c0d0 2024-09-19T07:22:13.461 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.460+0000 7f3e42ffd640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3e2c0a3580 0x7f3e2c0a5a40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009230 tx=0x7f3e340058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:13.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.439+0000 7f4a1d73b640 1 -- 172.21.15.98:0/2750663353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a18103740 msgr2=0x7f4a18107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.439+0000 7f4a1d73b640 1 --2- 172.21.15.98:0/2750663353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a18103740 0x7f4a18107b80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009930 tx=0x7f4a0c02a420 comp rx=0 tx=0).stop 2024-09-19T07:22:13.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.439+0000 7f4a1d73b640 1 -- 172.21.15.98:0/2750663353 shutdown_connections 2024-09-19T07:22:13.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.439+0000 7f4a1d73b640 1 --2- 172.21.15.98:0/2750663353 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a18108290 0x7f4a1810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.439+0000 7f4a1d73b640 1 --2- 172.21.15.98:0/2750663353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a18103740 0x7f4a18107b80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.439+0000 7f4a1d73b640 1 --2- 172.21.15.98:0/2750663353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a18102d90 0x7f4a18103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.439+0000 7f4a1d73b640 1 -- 172.21.15.98:0/2750663353 >> 172.21.15.98:0/2750663353 conn(0x7f4a180fc7d0 msgr2=0x7f4a180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:13.462 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.439+0000 7f4a1d73b640 1 -- 172.21.15.98:0/2750663353 shutdown_connections 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.439+0000 7f4a1d73b640 1 -- 172.21.15.98:0/2750663353 wait complete. 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.440+0000 7f4a1d73b640 1 Processor -- start 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.440+0000 7f4a1d73b640 1 -- start start 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.440+0000 7f4a1d73b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a18102d90 0x7f4a181985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.440+0000 7f4a1d73b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a18103740 0x7f4a18198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.440+0000 7f4a1d73b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a18108290 0x7f4a1819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.440+0000 7f4a1d73b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4a18112090 con 0x7f4a18102d90 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.440+0000 7f4a1d73b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4a18111f10 con 0x7f4a18103740 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.440+0000 7f4a1d73b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a18112210 con 0x7f4a18108290 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.440+0000 7f4a16ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a18102d90 0x7f4a181985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.440+0000 7f4a16ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a18102d90 0x7f4a181985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59986/0 (socket says 172.21.15.98:59986) 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.440+0000 7f4a16ffd640 1 -- 172.21.15.98:0/3253783275 learned_addr learned my addr 172.21.15.98:0/3253783275 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:13.463 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f4a177fe640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a18108290 0x7f4a1819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f4a167fc640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a18103740 0x7f4a18198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f4a16ffd640 1 -- 172.21.15.98:0/3253783275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a18108290 msgr2=0x7f4a1819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a18108290 0x7f4a1819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f4a16ffd640 1 -- 172.21.15.98:0/3253783275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a18103740 msgr2=0x7f4a18198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a18103740 0x7f4a18198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f4a16ffd640 1 -- 172.21.15.98:0/3253783275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1819d570 con 0x7f4a18102d90 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f4a177fe640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a18108290 0x7f4a1819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f4a167fc640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a18103740 0x7f4a18198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a18102d90 0x7f4a181985c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800e9f0 tx=0x7f4a0800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f49fffff640 1 -- 172.21.15.98:0/3253783275 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800cd80 con 0x7f4a18102d90 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f4a1d73b640 1 -- 172.21.15.98:0/3253783275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1819d860 con 0x7f4a18102d90 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f49fffff640 1 -- 172.21.15.98:0/3253783275 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a08005500 con 0x7f4a18102d90 2024-09-19T07:22:13.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f4a1d73b640 1 -- 172.21.15.98:0/3253783275 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a181a5140 con 0x7f4a18102d90 2024-09-19T07:22:13.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.441+0000 7f49fffff640 1 -- 172.21.15.98:0/3253783275 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08010690 con 0x7f4a18102d90 2024-09-19T07:22:13.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a1fb14740 1 Processor -- start 2024-09-19T07:22:13.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a1fb14740 1 -- start start 2024-09-19T07:22:13.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f49fffff640 1 -- 172.21.15.98:0/3253783275 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f4a080046c0 con 0x7f4a18102d90 2024-09-19T07:22:13.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a1fb14740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233e0a40 0x561a233e0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a1fb14740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 0x561a233efc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a1fb14740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233f0150 0x561a233f2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a1fb14740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561a23346280 con 0x561a233e1360 2024-09-19T07:22:13.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a1fb14740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561a232edb10 con 0x561a233f0150 2024-09-19T07:22:13.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a1fb14740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561a23342240 con 0x561a233e0a40 2024-09-19T07:22:13.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a16ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 0x561a233efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a16ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 0x561a233efc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59994/0 (socket says 172.21.15.98:59994) 2024-09-19T07:22:13.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a16ffd640 1 -- 172.21.15.98:0/214575917 learned_addr learned my addr 172.21.15.98:0/214575917 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:13.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a177fe640 1 --2- 172.21.15.98:0/214575917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233e0a40 0x561a233e0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a167fc640 1 --2- 172.21.15.98:0/214575917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233f0150 0x561a233f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a16ffd640 1 -- 172.21.15.98:0/214575917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233e0a40 msgr2=0x561a233e0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:13.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/214575917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233e0a40 0x561a233e0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a16ffd640 1 -- 172.21.15.98:0/214575917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233f0150 msgr2=0x561a233f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/214575917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233f0150 0x561a233f2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a16ffd640 1 -- 172.21.15.98:0/214575917 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a232fa1f0 con 0x561a233e1360 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.444+0000 7f4a167fc640 1 --2- 172.21.15.98:0/214575917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233f0150 0x561a233f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.445+0000 7f49fffff640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f4a000a34d0 0x7f4a000a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.445+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/214575917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 0x561a233efc10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4a080cdc10 tx=0x7f4a080d6680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eddae127c2982d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.445+0000 7f4a177fe640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f4a000a34d0 0x7f4a000a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.445+0000 7f49fd7fa640 1 -- 172.21.15.98:0/214575917 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a080e4070 con 0x561a233e1360 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.445+0000 7f49fffff640 1 -- 172.21.15.98:0/3253783275 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f4a080d0560 con 0x7f4a18102d90 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.445+0000 7f49fd7fa640 1 -- 172.21.15.98:0/214575917 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a0809ccc0 con 0x561a233e1360 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.445+0000 7f49fd7fa640 1 -- 172.21.15.98:0/214575917 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a080e4070 con 0x561a233e1360 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 -- 172.21.15.98:0/214575917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 msgr2=0x561a233efc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a177fe640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f4a000a34d0 0x7f4a000a5990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4a10005fd0 tx=0x7f4a10009780 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/214575917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 0x561a233efc10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4a080cdc10 tx=0x7f4a080d6680 comp rx=0 tx=0).stop 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 -- 172.21.15.98:0/214575917 shutdown_connections 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/214575917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233f0150 0x561a233f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/214575917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 0x561a233efc10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/214575917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233e0a40 0x561a233e0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 -- 172.21.15.98:0/214575917 >> 172.21.15.98:0/214575917 conn(0x561a233dd0f0 msgr2=0x561a233dd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 -- 172.21.15.98:0/214575917 shutdown_connections 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 -- 172.21.15.98:0/214575917 wait complete. 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 -- start start 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 Processor -- start 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 0x561a233ed030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.446+0000 7f4a1fb14740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233e1360 0x561a233ed570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.470 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a1fb14740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233f0150 0x561a233edab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a1fb14740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561a233f2d20 con 0x561a233e0a40 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a1fb14740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561a23300f10 con 0x561a233e1360 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a1fb14740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561a233f2ea0 con 0x561a233f0150 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a16ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 0x561a233ed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a1fb14740 10 client.0 _ll_register_callbacks cb 0x561a232c9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a16ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 0x561a233ed030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60002/0 (socket says 172.21.15.98:60002) 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a16ffd640 1 -- 172.21.15.98:0/2268884328 learned_addr learned my addr 172.21.15.98:0/2268884328 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a177fe640 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233f0150 0x561a233edab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a167fc640 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233e1360 0x561a233ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a16ffd640 1 -- 172.21.15.98:0/2268884328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233f0150 msgr2=0x561a233edab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233f0150 0x561a233edab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a16ffd640 1 -- 172.21.15.98:0/2268884328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233e1360 msgr2=0x561a233ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:13.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233e1360 0x561a233ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a16ffd640 1 -- 172.21.15.98:0/2268884328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a230b76a0 con 0x561a233e0a40 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a167fc640 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233e1360 0x561a233ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 0x561a233ed030 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4a08098a20 tx=0x7f4a08005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1dc806a7fada53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f49faff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f49faff5640 1 -- 172.21.15.98:0/2268884328 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a08098860 con 0x561a233e0a40 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f49faff5640 1 -- 172.21.15.98:0/2268884328 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f4a0809c820 con 0x561a233e0a40 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a1fb14740 1 -- 172.21.15.98:0/2268884328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a0809ccc0 con 0x561a233e0a40 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f49faff5640 1 -- 172.21.15.98:0/2268884328 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4a0809bf20 con 0x561a233e0a40 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.447+0000 7f4a1fb14740 10 client.15273 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.448+0000 7f4a1fb14740 1 -- 172.21.15.98:0/2268884328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561a233f2d20 con 0x561a233e0a40 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.448+0000 7f49faff5640 1 -- 172.21.15.98:0/2268884328 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a0809ccc0 con 0x561a233e0a40 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.448+0000 7f49faff5640 1 -- 172.21.15.98:0/2268884328 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4a080d3bc0 con 0x561a233e0a40 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.448+0000 7f4a1fb14740 10 client.15273 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:13.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.448+0000 7f4a1fb14740 10 client.15273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.448+0000 7f4a1fb14740 20 client.15273 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.448+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561a233ffa50 0x561a23401e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.448+0000 7f4a1fb14740 4 client.15273 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.448+0000 7f4a1fb14740 1 -- 172.21.15.98:0/2268884328 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a233537f0 con 0x561a233ffa50 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.448+0000 7f4a167fc640 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561a233ffa50 0x561a23401e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.449+0000 7f49faff5640 10 client.15273 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.449+0000 7f4a167fc640 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561a233ffa50 0x561a23401e40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e50cb46cb60369f2 server_cookie=4d6c94457143c29b in_seq=0 out_seq=0 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f49faff5640 1 -- 172.21.15.98:0/2268884328 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a233537f0 con 0x561a233ffa50 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f49faff5640 10 client.15273 handle_command_reply: tid=0 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f4a1fb14740 1 client.15273 shutdown 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f4a1fb14740 1 -- 172.21.15.98:0/2268884328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 msgr2=0x561a233ed030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 0x561a233ed030 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4a08098a20 tx=0x7f4a08005720 comp rx=0 tx=0).stop 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f4a1fb14740 1 -- 172.21.15.98:0/2268884328 shutdown_connections 2024-09-19T07:22:13.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233f0150 0x561a233edab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233e1360 0x561a233ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561a233ffa50 0x561a23401e40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/2268884328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 0x561a233ed030 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f49faff5640 0 client.15273 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:13.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f4a1fb14740 1 -- 172.21.15.98:0/2268884328 >> 172.21.15.98:0/2268884328 conn(0x561a233dd0f0 msgr2=0x561a233e2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:13.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f4a1fb14740 1 -- 172.21.15.98:0/2268884328 shutdown_connections 2024-09-19T07:22:13.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f4a1fb14740 1 -- 172.21.15.98:0/2268884328 wait complete. 2024-09-19T07:22:13.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.450+0000 7f4a1fb14740 20 client.15273 trim_cache size 0 max 16384 2024-09-19T07:22:13.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.464+0000 7f3e2bfff640 1 -- 172.21.15.98:0/3805959606 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3e3c09cc50 con 0x7f3e4410c0d0 2024-09-19T07:22:13.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a1fb14740 1 Processor -- start 2024-09-19T07:22:13.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a1fb14740 1 -- start start 2024-09-19T07:22:13.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a1fb14740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233e0a40 0x561a23407440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a1fb14740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 0x561a23407980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a1fb14740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233f0150 0x561a233ea290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a1fb14740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181ae0a0 con 0x561a233e1360 2024-09-19T07:22:13.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a1fb14740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181ab970 con 0x561a233f0150 2024-09-19T07:22:13.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a1fb14740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181a97c0 con 0x561a233e0a40 2024-09-19T07:22:13.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a167fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 0x561a23407980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a167fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 0x561a23407980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60042/0 (socket says 172.21.15.98:60042) 2024-09-19T07:22:13.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a167fc640 1 -- 172.21.15.98:0/3515127661 learned_addr learned my addr 172.21.15.98:0/3515127661 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:13.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/3515127661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233e0a40 0x561a23407440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.475+0000 7f4a177fe640 1 --2- 172.21.15.98:0/3515127661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233f0150 0x561a233ea290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.476+0000 7f4a167fc640 1 -- 172.21.15.98:0/3515127661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233e0a40 msgr2=0x561a23407440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:13.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.476+0000 7f4a167fc640 1 --2- 172.21.15.98:0/3515127661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233e0a40 0x561a23407440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.476+0000 7f4a167fc640 1 -- 172.21.15.98:0/3515127661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233f0150 msgr2=0x561a233ea290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:13.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.476+0000 7f4a167fc640 1 --2- 172.21.15.98:0/3515127661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233f0150 0x561a233ea290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.476+0000 7f4a167fc640 1 -- 172.21.15.98:0/3515127661 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a233e1fd0 con 0x561a233e1360 2024-09-19T07:22:13.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.476+0000 7f4a167fc640 1 --2- 172.21.15.98:0/3515127661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 0x561a23407980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c005ab0 tx=0x7f4a0c009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8691899f5fbab0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:13.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.476+0000 7f49fcff9640 1 -- 172.21.15.98:0/3515127661 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c035040 con 0x561a233e1360 2024-09-19T07:22:13.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.476+0000 7f49fcff9640 1 -- 172.21.15.98:0/3515127661 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a0c047070 con 0x561a233e1360 2024-09-19T07:22:13.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.476+0000 7f49fcff9640 1 -- 172.21.15.98:0/3515127661 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c004c20 con 0x561a233e1360 2024-09-19T07:22:13.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.477+0000 7f4a1fb14740 1 -- 172.21.15.98:0/3515127661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 msgr2=0x561a23407980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.477+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/3515127661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 0x561a23407980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c005ab0 tx=0x7f4a0c009610 comp rx=0 tx=0).stop 2024-09-19T07:22:13.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.477+0000 7f4a1fb14740 1 -- 172.21.15.98:0/3515127661 shutdown_connections 2024-09-19T07:22:13.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.477+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/3515127661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233f0150 0x561a233ea290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.477+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/3515127661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e1360 0x561a23407980 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.477+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/3515127661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233e0a40 0x561a23407440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.477+0000 7f4a1fb14740 1 -- 172.21.15.98:0/3515127661 >> 172.21.15.98:0/3515127661 conn(0x561a233dd0f0 msgr2=0x561a233dc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:13.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.477+0000 7f4a1fb14740 1 -- 172.21.15.98:0/3515127661 shutdown_connections 2024-09-19T07:22:13.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.477+0000 7f4a1fb14740 1 -- 172.21.15.98:0/3515127661 wait complete. 2024-09-19T07:22:13.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.478+0000 7f4a1fb14740 1 -- start start 2024-09-19T07:22:13.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.478+0000 7f4a1fb14740 1 Processor -- start 2024-09-19T07:22:13.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.478+0000 7f4a1fb14740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 0x561a233f4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.478+0000 7f4a1fb14740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233e1360 0x561a233f4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.478+0000 7f4a1fb14740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233f0150 0x561a233f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.478+0000 7f4a1fb14740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181a9e30 con 0x561a233e0a40 2024-09-19T07:22:13.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.478+0000 7f4a1fb14740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181ab2a0 con 0x561a233e1360 2024-09-19T07:22:13.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.478+0000 7f4a1fb14740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181aa500 con 0x561a233f0150 2024-09-19T07:22:13.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.478+0000 7f4a1fb14740 10 client.0 _ll_register_callbacks cb 0x7f4a080d6440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:13.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.478+0000 7f4a16ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 0x561a233f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.478+0000 7f4a16ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 0x561a233f4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60046/0 (socket says 172.21.15.98:60046) 2024-09-19T07:22:13.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f4a16ffd640 1 -- 172.21.15.98:0/1245030639 learned_addr learned my addr 172.21.15.98:0/1245030639 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:13.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f4a16ffd640 1 -- 172.21.15.98:0/1245030639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233f0150 msgr2=0x561a233f4aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/1245030639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233f0150 0x561a233f4aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f4a16ffd640 1 -- 172.21.15.98:0/1245030639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233e1360 msgr2=0x561a233f4560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/1245030639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233e1360 0x561a233f4560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f4a16ffd640 1 -- 172.21.15.98:0/1245030639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a23469570 con 0x561a233e0a40 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f4a16ffd640 1 --2- 172.21.15.98:0/1245030639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 0x561a233f4020 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4a0809c550 tx=0x7f4a080056b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6073afe59474f405 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f49faff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f49faff5640 1 -- 172.21.15.98:0/1245030639 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0809c100 con 0x561a233e0a40 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f4a1fb14740 1 -- 172.21.15.98:0/1245030639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a0c047070 con 0x561a233e0a40 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f49faff5640 1 -- 172.21.15.98:0/1245030639 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f4a080cdfe0 con 0x561a233e0a40 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f49faff5640 1 -- 172.21.15.98:0/1245030639 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4a0809c390 con 0x561a233e0a40 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f4a1fb14740 10 client.15285 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.479+0000 7f4a1fb14740 1 -- 172.21.15.98:0/1245030639 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561a2346a870 con 0x561a233e0a40 2024-09-19T07:22:13.482 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.480+0000 7f49faff5640 1 -- 172.21.15.98:0/1245030639 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a0809ccc0 con 0x561a233e0a40 2024-09-19T07:22:13.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.480+0000 7f49faff5640 1 -- 172.21.15.98:0/1245030639 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4a0809ba10 con 0x561a233e0a40 2024-09-19T07:22:13.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.480+0000 7f4a1fb14740 10 client.15285 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:13.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.480+0000 7f4a1fb14740 10 client.15285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:13.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.480+0000 7f4a1fb14740 20 client.15285 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:13.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.480+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/1245030639 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561a2346ae60 0x561a2346d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.480+0000 7f4a1fb14740 4 client.15285 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:22:13.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.480+0000 7f4a1fb14740 1 -- 172.21.15.98:0/1245030639 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f4a0c047070 con 0x561a2346ae60 2024-09-19T07:22:13.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.481+0000 7f4a167fc640 1 --2- 172.21.15.98:0/1245030639 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561a2346ae60 0x561a2346d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.481+0000 7f49faff5640 10 client.15285 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:13.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.481+0000 7f4a167fc640 1 --2- 172.21.15.98:0/1245030639 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561a2346ae60 0x561a2346d2c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3741dbc32c7f4cfe server_cookie=de46c393f68cb945 in_seq=0 out_seq=0 2024-09-19T07:22:13.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f49faff5640 1 -- 172.21.15.98:0/1245030639 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f4a0c047070 con 0x561a2346ae60 2024-09-19T07:22:13.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f49faff5640 10 client.15285 handle_command_reply: tid=0 2024-09-19T07:22:13.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f4a1fb14740 1 client.15285 shutdown 2024-09-19T07:22:13.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f4a1fb14740 1 -- 172.21.15.98:0/1245030639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 msgr2=0x561a233f4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/1245030639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 0x561a233f4020 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4a0809c550 tx=0x7f4a080056b0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f4a1fb14740 1 -- 172.21.15.98:0/1245030639 shutdown_connections 2024-09-19T07:22:13.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/1245030639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561a233f0150 0x561a233f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/1245030639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a233e1360 0x561a233f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/1245030639 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561a2346ae60 0x561a2346d2c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f4a1fb14740 1 --2- 172.21.15.98:0/1245030639 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561a233e0a40 0x561a233f4020 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f49faff5640 0 client.15285 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:13.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f4a1fb14740 1 -- 172.21.15.98:0/1245030639 >> 172.21.15.98:0/1245030639 conn(0x561a233dd0f0 msgr2=0x561a233fafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:13.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f4a1fb14740 1 -- 172.21.15.98:0/1245030639 shutdown_connections 2024-09-19T07:22:13.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f4a1fb14740 1 -- 172.21.15.98:0/1245030639 wait complete. 2024-09-19T07:22:13.485 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.483+0000 7f4a1fb14740 20 client.15285 trim_cache size 0 max 16384 2024-09-19T07:22:13.485 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:22:13.486 INFO:teuthology.orchestra.run.smithi098.stdout: "return_code": 0, 2024-09-19T07:22:13.486 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_tag": "1c706333-bfc2-454b-adf9-c5cbc99f7d7c", 2024-09-19T07:22:13.486 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": "asynchronous" 2024-09-19T07:22:13.486 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:22:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.484+0000 7f4a1d73b640 1 -- 172.21.15.98:0/3253783275 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f4a000a34d0 msgr2=0x7f4a000a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.484+0000 7f4a1d73b640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f4a000a34d0 0x7f4a000a5990 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4a10005fd0 tx=0x7f4a10009780 comp rx=0 tx=0).stop 2024-09-19T07:22:13.486 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.484+0000 7f4a1d73b640 1 -- 172.21.15.98:0/3253783275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a18102d90 msgr2=0x7f4a181985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.484+0000 7f4a1d73b640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a18102d90 0x7f4a181985c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800e9f0 tx=0x7f4a0800edf0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.484+0000 7f4a1d73b640 1 -- 172.21.15.98:0/3253783275 shutdown_connections 2024-09-19T07:22:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.484+0000 7f4a1d73b640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f4a000a34d0 0x7f4a000a5990 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.484+0000 7f4a1d73b640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a18108290 0x7f4a1819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.484+0000 7f4a1d73b640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a18103740 0x7f4a18198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.484+0000 7f4a1d73b640 1 --2- 172.21.15.98:0/3253783275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4a18102d90 0x7f4a181985c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.484+0000 7f4a1d73b640 1 -- 172.21.15.98:0/3253783275 >> 172.21.15.98:0/3253783275 conn(0x7f4a180fc7d0 msgr2=0x7f4a18105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.484+0000 7f4a1d73b640 1 -- 172.21.15.98:0/3253783275 shutdown_connections 2024-09-19T07:22:13.487 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.484+0000 7f4a1d73b640 1 -- 172.21.15.98:0/3253783275 wait complete. 2024-09-19T07:22:13.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.649+0000 7f3e4972c640 1 -- 172.21.15.98:0/3805959606 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f3e44106b90 con 0x7f3e4410c0d0 2024-09-19T07:22:13.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.653+0000 7f3e2bfff640 1 -- 172.21.15.98:0/3805959606 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v29)=0 v29) ==== 133+0+0 (secure 0 0 0) 0x7f3e3c09c550 con 0x7f3e4410c0d0 2024-09-19T07:22:13.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.655+0000 7f3e4972c640 1 -- 172.21.15.98:0/3805959606 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3e2c0a3580 msgr2=0x7f3e2c0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.655+0000 7f3e4972c640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3e2c0a3580 0x7f3e2c0a5a40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009230 tx=0x7f3e340058d0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.655+0000 7f3e4972c640 1 -- 172.21.15.98:0/3805959606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e4410c0d0 msgr2=0x7f3e4419cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.655+0000 7f3e4972c640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e4410c0d0 0x7f3e4419cbf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00eb10 tx=0x7f3e3c00c2d0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.655+0000 7f3e4972c640 1 -- 172.21.15.98:0/3805959606 shutdown_connections 2024-09-19T07:22:13.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.655+0000 7f3e4972c640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3e2c0a3580 0x7f3e2c0a5a40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.655+0000 7f3e4972c640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3e4410c0d0 0x7f3e4419cbf0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.655+0000 7f3e4972c640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e441035c0 0x7f3e44198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.655+0000 7f3e4972c640 1 --2- 172.21.15.98:0/3805959606 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e44102ca0 0x7f3e44198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.655+0000 7f3e4972c640 1 -- 172.21.15.98:0/3805959606 >> 172.21.15.98:0/3805959606 conn(0x7f3e440fc6b0 msgr2=0x7f3e440fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:13.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.656+0000 7f3e4972c640 1 -- 172.21.15.98:0/3805959606 shutdown_connections 2024-09-19T07:22:13.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.656+0000 7f3e4972c640 1 -- 172.21.15.98:0/3805959606 wait complete. 2024-09-19T07:22:13.668 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T07:22:13.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.780+0000 7fea67cc9640 1 -- 172.21.15.98:0/3124829885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea601009b0 msgr2=0x7fea60100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.780+0000 7fea67cc9640 1 --2- 172.21.15.98:0/3124829885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea601009b0 0x7fea60100e10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fea50009930 tx=0x7fea5002a420 comp rx=0 tx=0).stop 2024-09-19T07:22:13.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.780+0000 7fea67cc9640 1 -- 172.21.15.98:0/3124829885 shutdown_connections 2024-09-19T07:22:13.783 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.780+0000 7fea67cc9640 1 --2- 172.21.15.98:0/3124829885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea60101350 0x7fea6010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.780+0000 7fea67cc9640 1 --2- 172.21.15.98:0/3124829885 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea601009b0 0x7fea60100e10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.780+0000 7fea67cc9640 1 --2- 172.21.15.98:0/3124829885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea601069c0 0x7fea60106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.780+0000 7fea67cc9640 1 -- 172.21.15.98:0/3124829885 >> 172.21.15.98:0/3124829885 conn(0x7fea60077990 msgr2=0x7fea600fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:13.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.780+0000 7fea67cc9640 1 -- 172.21.15.98:0/3124829885 shutdown_connections 2024-09-19T07:22:13.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.780+0000 7fea67cc9640 1 -- 172.21.15.98:0/3124829885 wait complete. 2024-09-19T07:22:13.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea67cc9640 1 Processor -- start 2024-09-19T07:22:13.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea67cc9640 1 -- start start 2024-09-19T07:22:13.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea67cc9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea601009b0 0x7fea60199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea67cc9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea60101350 0x7fea60199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea67cc9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea601069c0 0x7fea601a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.784 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea67cc9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fea60110e00 con 0x7fea60101350 2024-09-19T07:22:13.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea67cc9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fea60110c80 con 0x7fea601069c0 2024-09-19T07:22:13.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea67cc9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fea60110f80 con 0x7fea601009b0 2024-09-19T07:22:13.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea65264640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea60101350 0x7fea60199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea65264640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea60101350 0x7fea60199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60070/0 (socket says 172.21.15.98:60070) 2024-09-19T07:22:13.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea65264640 1 -- 172.21.15.98:0/2626217630 learned_addr learned my addr 172.21.15.98:0/2626217630 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:13.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea65a65640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea601009b0 0x7fea60199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea66266640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea601069c0 0x7fea601a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea65264640 1 -- 172.21.15.98:0/2626217630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea601009b0 msgr2=0x7fea60199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.785 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea65264640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea601009b0 0x7fea60199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea65264640 1 -- 172.21.15.98:0/2626217630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea601069c0 msgr2=0x7fea601a4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:13.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea65264640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea601069c0 0x7fea601a4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:13.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.781+0000 7fea65264640 1 -- 172.21.15.98:0/2626217630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea601a47d0 con 0x7fea60101350 2024-09-19T07:22:13.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.782+0000 7fea65264640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea60101350 0x7fea60199750 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fea50009230 tx=0x7fea50004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:13.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.782+0000 7fea56ffd640 1 -- 172.21.15.98:0/2626217630 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5003f030 con 0x7fea60101350 2024-09-19T07:22:13.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.782+0000 7fea67cc9640 1 -- 172.21.15.98:0/2626217630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea601a49a0 con 0x7fea60101350 2024-09-19T07:22:13.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.782+0000 7fea56ffd640 1 -- 172.21.15.98:0/2626217630 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea50003ad0 con 0x7fea60101350 2024-09-19T07:22:13.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.782+0000 7fea56ffd640 1 -- 172.21.15.98:0/2626217630 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea50035070 con 0x7fea60101350 2024-09-19T07:22:13.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.782+0000 7fea67cc9640 1 -- 172.21.15.98:0/2626217630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea601a4e00 con 0x7fea60101350 2024-09-19T07:22:13.786 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.783+0000 7fea67cc9640 1 -- 172.21.15.98:0/2626217630 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea60100e10 con 0x7fea60101350 2024-09-19T07:22:13.787 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.784+0000 7fea56ffd640 1 -- 172.21.15.98:0/2626217630 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fea50042030 con 0x7fea60101350 2024-09-19T07:22:13.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.785+0000 7fea56ffd640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fea4c0a3580 0x7fea4c0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:13.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.785+0000 7fea65a65640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fea4c0a3580 0x7fea4c0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:13.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.785+0000 7fea56ffd640 1 -- 172.21.15.98:0/2626217630 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fea500f0730 con 0x7fea60101350 2024-09-19T07:22:13.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.785+0000 7fea65a65640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fea4c0a3580 0x7fea4c0a5a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fea5c005fd0 tx=0x7fea5c00b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:13.788 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.788+0000 7fea56ffd640 1 -- 172.21.15.98:0/2626217630 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea500bc910 con 0x7fea60101350 2024-09-19T07:22:13.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:13.978+0000 7fea67cc9640 1 -- 172.21.15.98:0/2626217630 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fea60108fb0 con 0x7fea4c0a3580 2024-09-19T07:22:14.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.045+0000 7fea56ffd640 1 -- 172.21.15.98:0/2626217630 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fea5c004220 con 0x7fea4c0a3580 2024-09-19T07:22:14.046 INFO:teuthology.orchestra.run.smithi098.stdout:Schedule set for path / 2024-09-19T07:22:14.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.048+0000 7fea67cc9640 1 -- 172.21.15.98:0/2626217630 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fea4c0a3580 msgr2=0x7fea4c0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.048+0000 7fea67cc9640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fea4c0a3580 0x7fea4c0a5a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fea5c005fd0 tx=0x7fea5c00b390 comp rx=0 tx=0).stop 2024-09-19T07:22:14.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.048+0000 7fea67cc9640 1 -- 172.21.15.98:0/2626217630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea60101350 msgr2=0x7fea60199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.048+0000 7fea67cc9640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea60101350 0x7fea60199750 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fea50009230 tx=0x7fea50004270 comp rx=0 tx=0).stop 2024-09-19T07:22:14.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.048+0000 7fea67cc9640 1 -- 172.21.15.98:0/2626217630 shutdown_connections 2024-09-19T07:22:14.048 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.048+0000 7fea67cc9640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fea4c0a3580 0x7fea4c0a5a40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.048+0000 7fea67cc9640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fea601069c0 0x7fea601a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.048+0000 7fea67cc9640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea60101350 0x7fea60199750 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.048+0000 7fea67cc9640 1 --2- 172.21.15.98:0/2626217630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea601009b0 0x7fea60199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.048+0000 7fea67cc9640 1 -- 172.21.15.98:0/2626217630 >> 172.21.15.98:0/2626217630 conn(0x7fea60077990 msgr2=0x7fea60103860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:14.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.048+0000 7fea67cc9640 1 -- 172.21.15.98:0/2626217630 shutdown_connections 2024-09-19T07:22:14.049 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.048+0000 7fea67cc9640 1 -- 172.21.15.98:0/2626217630 wait complete. 2024-09-19T07:22:14.059 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T07:22:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.163+0000 7fc226d18640 1 -- 172.21.15.98:0/1941658092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc22010e440 msgr2=0x7fc220110830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.163+0000 7fc226d18640 1 --2- 172.21.15.98:0/1941658092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc22010e440 0x7fc220110830 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc218009ca0 tx=0x7fc21802a8c0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.169 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.163+0000 7fc226d18640 1 -- 172.21.15.98:0/1941658092 shutdown_connections 2024-09-19T07:22:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.163+0000 7fc226d18640 1 --2- 172.21.15.98:0/1941658092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc22010e440 0x7fc220110830 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.163+0000 7fc226d18640 1 --2- 172.21.15.98:0/1941658092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc220101240 0x7fc22010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.163+0000 7fc226d18640 1 --2- 172.21.15.98:0/1941658092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc220100890 0x7fc220100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.163+0000 7fc226d18640 1 -- 172.21.15.98:0/1941658092 >> 172.21.15.98:0/1941658092 conn(0x7fc220077990 msgr2=0x7fc2200fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:14.170 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.163+0000 7fc226d18640 1 -- 172.21.15.98:0/1941658092 shutdown_connections 2024-09-19T07:22:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.163+0000 7fc226d18640 1 -- 172.21.15.98:0/1941658092 wait complete. 2024-09-19T07:22:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc226d18640 1 Processor -- start 2024-09-19T07:22:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc226d18640 1 -- start start 2024-09-19T07:22:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc226d18640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc220100890 0x7fc22019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.171 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc226d18640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc220101240 0x7fc22019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc226d18640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc22010e440 0x7fc22019edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc226d18640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc220114100 con 0x7fc22010e440 2024-09-19T07:22:14.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc226d18640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc220113f80 con 0x7fc220101240 2024-09-19T07:22:14.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc226d18640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc220114280 con 0x7fc220100890 2024-09-19T07:22:14.172 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc2252b5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc22010e440 0x7fc22019edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc2252b5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc22010e440 0x7fc22019edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60092/0 (socket says 172.21.15.98:60092) 2024-09-19T07:22:14.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc2252b5640 1 -- 172.21.15.98:0/4147730465 learned_addr learned my addr 172.21.15.98:0/4147730465 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:14.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc21ffff640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc220101240 0x7fc22019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.164+0000 7fc224ab4640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc220100890 0x7fc22019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.165+0000 7fc2252b5640 1 -- 172.21.15.98:0/4147730465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc220100890 msgr2=0x7fc22019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.173 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.165+0000 7fc2252b5640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc220100890 0x7fc22019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.165+0000 7fc2252b5640 1 -- 172.21.15.98:0/4147730465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc220101240 msgr2=0x7fc22019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.165+0000 7fc2252b5640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc220101240 0x7fc22019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.165+0000 7fc2252b5640 1 -- 172.21.15.98:0/4147730465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22019f500 con 0x7fc22010e440 2024-09-19T07:22:14.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.165+0000 7fc224ab4640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc220100890 0x7fc22019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:14.174 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.165+0000 7fc2252b5640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc22010e440 0x7fc22019edd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc218031f80 tx=0x7fc218031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.165+0000 7fc21dffb640 1 -- 172.21.15.98:0/4147730465 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218003b70 con 0x7fc22010e440 2024-09-19T07:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.165+0000 7fc226d18640 1 -- 172.21.15.98:0/4147730465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22019f790 con 0x7fc22010e440 2024-09-19T07:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.165+0000 7fc21dffb640 1 -- 172.21.15.98:0/4147730465 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc218003d10 con 0x7fc22010e440 2024-09-19T07:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.165+0000 7fc21dffb640 1 -- 172.21.15.98:0/4147730465 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218004760 con 0x7fc22010e440 2024-09-19T07:22:14.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.165+0000 7fc226d18640 1 -- 172.21.15.98:0/4147730465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2201a7080 con 0x7fc22010e440 2024-09-19T07:22:14.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.166+0000 7fc226d18640 1 -- 172.21.15.98:0/4147730465 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc220100c70 con 0x7fc22010e440 2024-09-19T07:22:14.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.168+0000 7fc21dffb640 1 -- 172.21.15.98:0/4147730465 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fc21802f710 con 0x7fc22010e440 2024-09-19T07:22:14.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.168+0000 7fc21dffb640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc2100a3580 0x7fc2100a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.168+0000 7fc21dffb640 1 -- 172.21.15.98:0/4147730465 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc2180f1120 con 0x7fc22010e440 2024-09-19T07:22:14.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.168+0000 7fc224ab4640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc2100a3580 0x7fc2100a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.169+0000 7fc224ab4640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc2100a3580 0x7fc2100a5a40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc214009930 tx=0x7fc214008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:14.178 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:22:14.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.172+0000 7fc21dffb640 1 -- 172.21.15.98:0/4147730465 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc2180bdb50 con 0x7fc22010e440 2024-09-19T07:22:14.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1530746115' entity='client.admin' 2024-09-19T07:22:14.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:14.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:14.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:14.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:14.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2906580456' entity='client.admin' 2024-09-19T07:22:14.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:14.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:14.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:14.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:14.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: scrub queued for path: / 2024-09-19T07:22:14.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:22:14.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:22:14.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:22:14.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3805959606' entity='client.admin' 2024-09-19T07:22:14.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:14.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:14.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:14.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:14.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:14 smithi139 ceph-mon[35039]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 911 B/s wr, 18 op/s 2024-09-19T07:22:14.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.370+0000 7fc226d18640 1 -- 172.21.15.98:0/4147730465 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fc2200ffc50 con 0x7fc2100a3580 2024-09-19T07:22:14.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1530746115' entity='client.admin' 2024-09-19T07:22:14.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:14.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:14.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:14.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:14.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2906580456' entity='client.admin' 2024-09-19T07:22:14.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:14.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:14.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:14.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:14.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: scrub queued for path: / 2024-09-19T07:22:14.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:22:14.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:22:14.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:22:14.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3805959606' entity='client.admin' 2024-09-19T07:22:14.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:14.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:14.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:14.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:14.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:14 smithi162 ceph-mon[35726]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 911 B/s wr, 18 op/s 2024-09-19T07:22:14.434 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:14.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.445+0000 7fc21dffb640 1 -- 172.21.15.98:0/4147730465 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fc2200ffc50 con 0x7fc2100a3580 2024-09-19T07:22:14.445 INFO:teuthology.orchestra.run.smithi098.stdout:Retention added to path / 2024-09-19T07:22:14.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.447+0000 7fc226d18640 1 -- 172.21.15.98:0/4147730465 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc2100a3580 msgr2=0x7fc2100a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.447+0000 7fc226d18640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc2100a3580 0x7fc2100a5a40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc214009930 tx=0x7fc214008040 comp rx=0 tx=0).stop 2024-09-19T07:22:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.447+0000 7fc226d18640 1 -- 172.21.15.98:0/4147730465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc22010e440 msgr2=0x7fc22019edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.447+0000 7fc226d18640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc22010e440 0x7fc22019edd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc218031f80 tx=0x7fc218031a60 comp rx=0 tx=0).stop 2024-09-19T07:22:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.447+0000 7fc226d18640 1 -- 172.21.15.98:0/4147730465 shutdown_connections 2024-09-19T07:22:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.447+0000 7fc226d18640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc2100a3580 0x7fc2100a5a40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.447+0000 7fc226d18640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc22010e440 0x7fc22019edd0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.447+0000 7fc226d18640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc220101240 0x7fc22019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.447+0000 7fc226d18640 1 --2- 172.21.15.98:0/4147730465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc220100890 0x7fc22019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.447+0000 7fc226d18640 1 -- 172.21.15.98:0/4147730465 >> 172.21.15.98:0/4147730465 conn(0x7fc220077990 msgr2=0x7fc2200ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.447+0000 7fc226d18640 1 -- 172.21.15.98:0/4147730465 shutdown_connections 2024-09-19T07:22:14.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.447+0000 7fc226d18640 1 -- 172.21.15.98:0/4147730465 wait complete. 2024-09-19T07:22:14.459 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1530746115' entity='client.admin' 2024-09-19T07:22:14.459 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:14.459 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:14.459 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:14.459 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:14.459 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2906580456' entity='client.admin' 2024-09-19T07:22:14.459 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:14.459 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:14.459 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:14.459 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:14.459 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: scrub queued for path: / 2024-09-19T07:22:14.459 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:22:14.460 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:22:14.460 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:22:14.460 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3805959606' entity='client.admin' 2024-09-19T07:22:14.460 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:22:14.460 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:22:14.460 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:22:14.460 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:22:14.460 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:14 smithi098 ceph-mon[30950]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 911 B/s wr, 18 op/s 2024-09-19T07:22:14.461 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T07:22:14.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.560+0000 7fd608c47640 1 -- 172.21.15.98:0/954486628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd604107b80 msgr2=0x7fd604107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.560+0000 7fd608c47640 1 --2- 172.21.15.98:0/954486628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd604107b80 0x7fd604107f60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009930 tx=0x7fd5f402a420 comp rx=0 tx=0).stop 2024-09-19T07:22:14.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.560+0000 7fd608c47640 1 -- 172.21.15.98:0/954486628 shutdown_connections 2024-09-19T07:22:14.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.560+0000 7fd608c47640 1 --2- 172.21.15.98:0/954486628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd604102480 0x7fd60410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.560+0000 7fd608c47640 1 --2- 172.21.15.98:0/954486628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd604101ae0 0x7fd604101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.560+0000 7fd608c47640 1 --2- 172.21.15.98:0/954486628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd604107b80 0x7fd604107f60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.560+0000 7fd608c47640 1 -- 172.21.15.98:0/954486628 >> 172.21.15.98:0/954486628 conn(0x7fd6040fd7e0 msgr2=0x7fd6040ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:14.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.560+0000 7fd608c47640 1 -- 172.21.15.98:0/954486628 shutdown_connections 2024-09-19T07:22:14.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.560+0000 7fd608c47640 1 -- 172.21.15.98:0/954486628 wait complete. 2024-09-19T07:22:14.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd608c47640 1 Processor -- start 2024-09-19T07:22:14.563 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd608c47640 1 -- start start 2024-09-19T07:22:14.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd608c47640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd604101ae0 0x7fd6040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd608c47640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd604102480 0x7fd604074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd608c47640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd604107b80 0x7fd604074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd608c47640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd604111f30 con 0x7fd604101ae0 2024-09-19T07:22:14.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd608c47640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd604111db0 con 0x7fd604107b80 2024-09-19T07:22:14.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd608c47640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6041120b0 con 0x7fd604102480 2024-09-19T07:22:14.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd60259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd604101ae0 0x7fd6040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd60259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd604101ae0 0x7fd6040744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60098/0 (socket says 172.21.15.98:60098) 2024-09-19T07:22:14.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd60259c640 1 -- 172.21.15.98:0/2895055214 learned_addr learned my addr 172.21.15.98:0/2895055214 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:14.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd5fbfff640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd604102480 0x7fd604074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd60259c640 1 -- 172.21.15.98:0/2895055214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd604102480 msgr2=0x7fd604074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.564 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd60259c640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd604102480 0x7fd604074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd60259c640 1 -- 172.21.15.98:0/2895055214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd604107b80 msgr2=0x7fd604074f70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:22:14.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd60259c640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd604107b80 0x7fd604074f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.561+0000 7fd60259c640 1 -- 172.21.15.98:0/2895055214 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6041a6880 con 0x7fd604101ae0 2024-09-19T07:22:14.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.562+0000 7fd60259c640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd604101ae0 0x7fd6040744f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009a50 tx=0x7fd5f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:14.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.562+0000 7fd5fb7fe640 1 -- 172.21.15.98:0/2895055214 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f403f030 con 0x7fd604101ae0 2024-09-19T07:22:14.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.562+0000 7fd5fb7fe640 1 -- 172.21.15.98:0/2895055214 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5f4003ad0 con 0x7fd604101ae0 2024-09-19T07:22:14.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.562+0000 7fd608c47640 1 -- 172.21.15.98:0/2895055214 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6041a6b10 con 0x7fd604101ae0 2024-09-19T07:22:14.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.562+0000 7fd5fb7fe640 1 -- 172.21.15.98:0/2895055214 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4035070 con 0x7fd604101ae0 2024-09-19T07:22:14.565 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.562+0000 7fd608c47640 1 -- 172.21.15.98:0/2895055214 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6041a7000 con 0x7fd604101ae0 2024-09-19T07:22:14.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.563+0000 7fd608c47640 1 -- 172.21.15.98:0/2895055214 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd604101f40 con 0x7fd604101ae0 2024-09-19T07:22:14.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.564+0000 7fd5fb7fe640 1 -- 172.21.15.98:0/2895055214 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fd5f4042030 con 0x7fd604101ae0 2024-09-19T07:22:14.566 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.564+0000 7fd5fb7fe640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd5f00a3580 0x7fd5f00a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.565+0000 7fd5fbfff640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd5f00a3580 0x7fd5f00a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.565+0000 7fd5fb7fe640 1 -- 172.21.15.98:0/2895055214 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fd5f40f06f0 con 0x7fd604101ae0 2024-09-19T07:22:14.567 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.565+0000 7fd5fbfff640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd5f00a3580 0x7fd5f00a5a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd604075f80 tx=0x7fd5ec00a2d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:14.569 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.569+0000 7fd5fb7fe640 1 -- 172.21.15.98:0/2895055214 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5f40bcf20 con 0x7fd604101ae0 2024-09-19T07:22:14.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.762+0000 7fd608c47640 1 -- 172.21.15.98:0/2895055214 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fd6040fe3f0 con 0x7fd5f00a3580 2024-09-19T07:22:14.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.768+0000 7fd5fb7fe640 1 -- 172.21.15.98:0/2895055214 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fd6040fe3f0 con 0x7fd5f00a3580 2024-09-19T07:22:14.769 INFO:teuthology.orchestra.run.smithi098.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T07:22:13", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T07:22:14.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.770+0000 7fd608c47640 1 -- 172.21.15.98:0/2895055214 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd5f00a3580 msgr2=0x7fd5f00a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.770+0000 7fd608c47640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd5f00a3580 0x7fd5f00a5a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd604075f80 tx=0x7fd5ec00a2d0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.770+0000 7fd608c47640 1 -- 172.21.15.98:0/2895055214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd604101ae0 msgr2=0x7fd6040744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.770+0000 7fd608c47640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd604101ae0 0x7fd6040744f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009a50 tx=0x7fd5f4004270 comp rx=0 tx=0).stop 2024-09-19T07:22:14.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.770+0000 7fd608c47640 1 -- 172.21.15.98:0/2895055214 shutdown_connections 2024-09-19T07:22:14.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.770+0000 7fd608c47640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd5f00a3580 0x7fd5f00a5a40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.770+0000 7fd608c47640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd604107b80 0x7fd604074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.770+0000 7fd608c47640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd604102480 0x7fd604074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.770+0000 7fd608c47640 1 --2- 172.21.15.98:0/2895055214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd604101ae0 0x7fd6040744f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.770+0000 7fd608c47640 1 -- 172.21.15.98:0/2895055214 >> 172.21.15.98:0/2895055214 conn(0x7fd6040fd7e0 msgr2=0x7fd6040fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:14.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.771+0000 7fd608c47640 1 -- 172.21.15.98:0/2895055214 shutdown_connections 2024-09-19T07:22:14.772 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.771+0000 7fd608c47640 1 -- 172.21.15.98:0/2895055214 wait complete. 2024-09-19T07:22:14.782 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T07:22:14.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.886+0000 7ff2d747b640 1 -- 172.21.15.98:0/1038585363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d01069e0 msgr2=0x7ff2d0106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.886+0000 7ff2d747b640 1 --2- 172.21.15.98:0/1038585363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d01069e0 0x7ff2d0106dc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009930 tx=0x7ff2cc02a440 comp rx=0 tx=0).stop 2024-09-19T07:22:14.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.886+0000 7ff2d747b640 1 -- 172.21.15.98:0/1038585363 shutdown_connections 2024-09-19T07:22:14.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.886+0000 7ff2d747b640 1 --2- 172.21.15.98:0/1038585363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2d0101370 0x7ff2d010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.886+0000 7ff2d747b640 1 --2- 172.21.15.98:0/1038585363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2d01009d0 0x7ff2d0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.886+0000 7ff2d747b640 1 --2- 172.21.15.98:0/1038585363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d01069e0 0x7ff2d0106dc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.886+0000 7ff2d747b640 1 -- 172.21.15.98:0/1038585363 >> 172.21.15.98:0/1038585363 conn(0x7ff2d00fc6f0 msgr2=0x7ff2d00feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:14.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.886+0000 7ff2d747b640 1 -- 172.21.15.98:0/1038585363 shutdown_connections 2024-09-19T07:22:14.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.887+0000 7ff2d747b640 1 -- 172.21.15.98:0/1038585363 wait complete. 2024-09-19T07:22:14.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.887+0000 7ff2d747b640 1 Processor -- start 2024-09-19T07:22:14.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.887+0000 7ff2d747b640 1 -- start start 2024-09-19T07:22:14.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d747b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d01009d0 0x7ff2d01972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d747b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2d0101370 0x7ff2d0197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d747b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2d01069e0 0x7ff2d019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d747b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0110e20 con 0x7ff2d01009d0 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d747b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0110ca0 con 0x7ff2d0101370 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d747b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0110fa0 con 0x7ff2d01069e0 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d5217640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d01009d0 0x7ff2d01972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d5217640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d01009d0 0x7ff2d01972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60108/0 (socket says 172.21.15.98:60108) 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d5217640 1 -- 172.21.15.98:0/2750083283 learned_addr learned my addr 172.21.15.98:0/2750083283 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d4a16640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2d0101370 0x7ff2d0197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d5a18640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2d01069e0 0x7ff2d019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d5217640 1 -- 172.21.15.98:0/2750083283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2d01069e0 msgr2=0x7ff2d019bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d5217640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2d01069e0 0x7ff2d019bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d5217640 1 -- 172.21.15.98:0/2750083283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2d0101370 msgr2=0x7ff2d0197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d5217640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2d0101370 0x7ff2d0197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d5217640 1 -- 172.21.15.98:0/2750083283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d019c2e0 con 0x7ff2d01009d0 2024-09-19T07:22:14.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d5217640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d01009d0 0x7ff2d01972f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009230 tx=0x7ff2cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:14.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2c67fc640 1 -- 172.21.15.98:0/2750083283 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc03f030 con 0x7ff2d01009d0 2024-09-19T07:22:14.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2c67fc640 1 -- 172.21.15.98:0/2750083283 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2cc003ad0 con 0x7ff2d01009d0 2024-09-19T07:22:14.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2d747b640 1 -- 172.21.15.98:0/2750083283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d019c570 con 0x7ff2d01009d0 2024-09-19T07:22:14.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.888+0000 7ff2c67fc640 1 -- 172.21.15.98:0/2750083283 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc035070 con 0x7ff2d01009d0 2024-09-19T07:22:14.892 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.889+0000 7ff2d747b640 1 -- 172.21.15.98:0/2750083283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d01a3e60 con 0x7ff2d01009d0 2024-09-19T07:22:14.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.890+0000 7ff2d747b640 1 -- 172.21.15.98:0/2750083283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d0102110 con 0x7ff2d01009d0 2024-09-19T07:22:14.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.891+0000 7ff2c67fc640 1 -- 172.21.15.98:0/2750083283 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7ff2cc042030 con 0x7ff2d01009d0 2024-09-19T07:22:14.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.892+0000 7ff2c67fc640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff2bc0a3580 0x7ff2bc0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.892+0000 7ff2d4a16640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff2bc0a3580 0x7ff2bc0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.892+0000 7ff2c67fc640 1 -- 172.21.15.98:0/2750083283 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7ff2cc0f0800 con 0x7ff2d01009d0 2024-09-19T07:22:14.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.892+0000 7ff2d4a16640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff2bc0a3580 0x7ff2bc0a5a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00fec50 tx=0x7ff2c00090e0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:14.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.895+0000 7ff2c67fc640 1 -- 172.21.15.98:0/2750083283 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2cc0bd030 con 0x7ff2d01009d0 2024-09-19T07:22:14.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.922+0000 7efc47fa7640 1 -- 172.21.15.98:0/4136751044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc40102570 msgr2=0x7efc401029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.922+0000 7efc47fa7640 1 --2- 172.21.15.98:0/4136751044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc40102570 0x7efc401029b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efc30009900 tx=0x7efc3002a480 comp rx=0 tx=0).stop 2024-09-19T07:22:14.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.922+0000 7efc47fa7640 1 -- 172.21.15.98:0/4136751044 shutdown_connections 2024-09-19T07:22:14.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.922+0000 7efc47fa7640 1 --2- 172.21.15.98:0/4136751044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc40102ef0 0x7efc4010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.922+0000 7efc47fa7640 1 --2- 172.21.15.98:0/4136751044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc40102570 0x7efc401029b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.922+0000 7efc47fa7640 1 --2- 172.21.15.98:0/4136751044 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc40100e20 0x7efc40101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.922+0000 7efc47fa7640 1 -- 172.21.15.98:0/4136751044 >> 172.21.15.98:0/4136751044 conn(0x7efc400fc7d0 msgr2=0x7efc400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:14.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.922+0000 7efc47fa7640 1 -- 172.21.15.98:0/4136751044 shutdown_connections 2024-09-19T07:22:14.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.922+0000 7efc47fa7640 1 -- 172.21.15.98:0/4136751044 wait complete. 2024-09-19T07:22:14.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.923+0000 7efc47fa7640 1 Processor -- start 2024-09-19T07:22:14.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.923+0000 7efc47fa7640 1 -- start start 2024-09-19T07:22:14.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.923+0000 7efc47fa7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc40100e20 0x7efc40199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.923+0000 7efc47fa7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc40102570 0x7efc40199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.923+0000 7efc47fa7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc40102ef0 0x7efc401a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.923+0000 7efc47fa7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc40110f80 con 0x7efc40102570 2024-09-19T07:22:14.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.923+0000 7efc47fa7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efc40110e00 con 0x7efc40102ef0 2024-09-19T07:22:14.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.923+0000 7efc47fa7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc40111100 con 0x7efc40100e20 2024-09-19T07:22:14.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.923+0000 7efc45542640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc40102570 0x7efc40199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.923+0000 7efc45542640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc40102570 0x7efc40199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60132/0 (socket says 172.21.15.98:60132) 2024-09-19T07:22:14.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.923+0000 7efc45542640 1 -- 172.21.15.98:0/2904632531 learned_addr learned my addr 172.21.15.98:0/2904632531 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:14.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc45d43640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc40100e20 0x7efc40199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc46544640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc40102ef0 0x7efc401a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc45542640 1 -- 172.21.15.98:0/2904632531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc40100e20 msgr2=0x7efc40199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc45542640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc40100e20 0x7efc40199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc45542640 1 -- 172.21.15.98:0/2904632531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc40102ef0 msgr2=0x7efc401a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc45542640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc40102ef0 0x7efc401a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc45542640 1 -- 172.21.15.98:0/2904632531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc401a48f0 con 0x7efc40102570 2024-09-19T07:22:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc45542640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc40102570 0x7efc40199870 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efc30006010 tx=0x7efc30003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc36ffd640 1 -- 172.21.15.98:0/2904632531 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3003f070 con 0x7efc40102570 2024-09-19T07:22:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc47fa7640 1 -- 172.21.15.98:0/2904632531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc401a4ac0 con 0x7efc40102570 2024-09-19T07:22:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc36ffd640 1 -- 172.21.15.98:0/2904632531 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc30031c30 con 0x7efc40102570 2024-09-19T07:22:14.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc36ffd640 1 -- 172.21.15.98:0/2904632531 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30035030 con 0x7efc40102570 2024-09-19T07:22:14.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.924+0000 7efc47fa7640 1 -- 172.21.15.98:0/2904632531 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc401a4f70 con 0x7efc40102570 2024-09-19T07:22:14.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.926+0000 7efc36ffd640 1 -- 172.21.15.98:0/2904632531 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7efc30042070 con 0x7efc40102570 2024-09-19T07:22:14.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.927+0000 7efc4a380740 1 Processor -- start 2024-09-19T07:22:14.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.927+0000 7efc4a380740 1 -- start start 2024-09-19T07:22:14.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.927+0000 7efc4a380740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690c4a0 0x5573b690c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.927+0000 7efc4a380740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b690cdc0 0x5573b6917140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc4a380740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b6917680 0x5573b6919a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc36ffd640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7efc2c0a34d0 0x7efc2c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc4a380740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5573b68722e0 con 0x5573b690c4a0 2024-09-19T07:22:14.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc4a380740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5573b6819ce0 con 0x5573b690cdc0 2024-09-19T07:22:14.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc4a380740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5573b686e2a0 con 0x5573b6917680 2024-09-19T07:22:14.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc46544640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690c4a0 0x5573b690c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc46544640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690c4a0 0x5573b690c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60146/0 (socket says 172.21.15.98:60146) 2024-09-19T07:22:14.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc46544640 1 -- 172.21.15.98:0/2323965296 learned_addr learned my addr 172.21.15.98:0/2323965296 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:14.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc36ffd640 1 -- 172.21.15.98:0/2904632531 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7efc300f0640 con 0x7efc40102570 2024-09-19T07:22:14.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc46544640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7efc2c0a34d0 0x7efc2c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc45d43640 1 --2- 172.21.15.98:0/2323965296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b690cdc0 0x5573b6917140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc45542640 1 --2- 172.21.15.98:0/2323965296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b6917680 0x5573b6919a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc46544640 1 -- 172.21.15.98:0/2323965296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b6917680 msgr2=0x5573b6919a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:14.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc46544640 1 --2- 172.21.15.98:0/2323965296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b6917680 0x5573b6919a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc46544640 1 -- 172.21.15.98:0/2323965296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b690cdc0 msgr2=0x5573b6917140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:14.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc46544640 1 --2- 172.21.15.98:0/2323965296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b690cdc0 0x5573b6917140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc46544640 1 -- 172.21.15.98:0/2323965296 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b67fe440 con 0x5573b690c4a0 2024-09-19T07:22:14.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc46544640 1 --2- 172.21.15.98:0/2323965296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690c4a0 0x5573b690c880 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efc38012c50 tx=0x7efc38010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa14c581cb26c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc46544640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7efc2c0a34d0 0x7efc2c0a5990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc38010c40 tx=0x7efc38017000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.928+0000 7efc2bfff640 1 -- 172.21.15.98:0/2323965296 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38012e00 con 0x5573b690c4a0 2024-09-19T07:22:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.929+0000 7efc2bfff640 1 -- 172.21.15.98:0/2323965296 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc38009c00 con 0x5573b690c4a0 2024-09-19T07:22:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.929+0000 7efc2bfff640 1 -- 172.21.15.98:0/2323965296 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38005420 con 0x5573b690c4a0 2024-09-19T07:22:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.929+0000 7efc4a380740 1 -- 172.21.15.98:0/2323965296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690c4a0 msgr2=0x5573b690c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.929+0000 7efc4a380740 1 --2- 172.21.15.98:0/2323965296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690c4a0 0x5573b690c880 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7efc38012c50 tx=0x7efc38010740 comp rx=0 tx=0).stop 2024-09-19T07:22:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.929+0000 7efc4a380740 1 -- 172.21.15.98:0/2323965296 shutdown_connections 2024-09-19T07:22:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.929+0000 7efc4a380740 1 --2- 172.21.15.98:0/2323965296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b6917680 0x5573b6919a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.929+0000 7efc4a380740 1 --2- 172.21.15.98:0/2323965296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b690cdc0 0x5573b6917140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.929+0000 7efc4a380740 1 --2- 172.21.15.98:0/2323965296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690c4a0 0x5573b690c880 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.929+0000 7efc4a380740 1 -- 172.21.15.98:0/2323965296 >> 172.21.15.98:0/2323965296 conn(0x5573b6908a30 msgr2=0x5573b6908e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:14.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.929+0000 7efc4a380740 1 -- 172.21.15.98:0/2323965296 shutdown_connections 2024-09-19T07:22:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.929+0000 7efc4a380740 1 -- 172.21.15.98:0/2323965296 wait complete. 2024-09-19T07:22:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc4a380740 1 -- start start 2024-09-19T07:22:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc4a380740 1 Processor -- start 2024-09-19T07:22:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc4a380740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b690c4a0 0x5573b6917050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc4a380740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b6914300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc4a380740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b6917680 0x5573b69148f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc4a380740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5573b691a250 con 0x5573b690cdc0 2024-09-19T07:22:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc4a380740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5573b682d050 con 0x5573b6917680 2024-09-19T07:22:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc4a380740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5573b691a3d0 con 0x5573b690c4a0 2024-09-19T07:22:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc4a380740 10 client.0 _ll_register_callbacks cb 0x5573b686d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:14.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc45542640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b6914300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc45542640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b6914300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60154/0 (socket says 172.21.15.98:60154) 2024-09-19T07:22:14.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc45542640 1 -- 172.21.15.98:0/1595462496 learned_addr learned my addr 172.21.15.98:0/1595462496 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:14.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.930+0000 7efc45d43640 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b690c4a0 0x5573b6917050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc46544640 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b6917680 0x5573b69148f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc45542640 1 -- 172.21.15.98:0/1595462496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b690c4a0 msgr2=0x5573b6917050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:14.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc45542640 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b690c4a0 0x5573b6917050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc45542640 1 -- 172.21.15.98:0/1595462496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b6917680 msgr2=0x5573b69148f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:14.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc45542640 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b6917680 0x5573b69148f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc45542640 1 -- 172.21.15.98:0/1595462496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573b65e33c0 con 0x5573b690cdc0 2024-09-19T07:22:14.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc45542640 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b6914300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efc300edcf0 tx=0x7efc300bc370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb7cdadb961e07c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:14.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc297fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc297fa640 1 -- 172.21.15.98:0/1595462496 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30049040 con 0x5573b690cdc0 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc297fa640 1 -- 172.21.15.98:0/1595462496 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7efc30096ca0 con 0x5573b690cdc0 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc4a380740 1 -- 172.21.15.98:0/1595462496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5573b687f850 con 0x5573b690cdc0 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc297fa640 1 -- 172.21.15.98:0/1595462496 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efc300bce70 con 0x5573b690cdc0 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc4a380740 10 client.15321 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc4a380740 1 -- 172.21.15.98:0/1595462496 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5573b692a090 con 0x5573b690cdc0 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.931+0000 7efc297fa640 1 -- 172.21.15.98:0/1595462496 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5573b687f850 con 0x5573b690cdc0 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.932+0000 7efc297fa640 1 -- 172.21.15.98:0/1595462496 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efc300940d0 con 0x5573b690cdc0 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.932+0000 7efc4a380740 10 client.15321 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.932+0000 7efc4a380740 10 client.15321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.932+0000 7efc4a380740 20 client.15321 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.932+0000 7efc4a380740 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5573b692b430 0x5573b692d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.932+0000 7efc4a380740 4 client.15321 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:14.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.932+0000 7efc4a380740 1 -- 172.21.15.98:0/1595462496 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573b6879d60 con 0x5573b692b430 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.932+0000 7efc45d43640 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5573b692b430 0x5573b692d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.932+0000 7efc45d43640 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5573b692b430 0x5573b692d820 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a45c1faea6da29b9 server_cookie=8076a059d65a75af in_seq=0 out_seq=0 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.932+0000 7efc297fa640 10 client.15321 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc297fa640 1 -- 172.21.15.98:0/1595462496 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573b6879d60 con 0x5573b692b430 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc297fa640 10 client.15321 handle_command_reply: tid=0 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc4a380740 1 client.15321 shutdown 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc4a380740 1 -- 172.21.15.98:0/1595462496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 msgr2=0x5573b6914300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc4a380740 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b6914300 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efc300edcf0 tx=0x7efc300bc370 comp rx=0 tx=0).stop 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc4a380740 1 -- 172.21.15.98:0/1595462496 shutdown_connections 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc4a380740 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b6917680 0x5573b69148f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc4a380740 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5573b692b430 0x5573b692d820 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc4a380740 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b6914300 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc4a380740 1 --2- 172.21.15.98:0/1595462496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b690c4a0 0x5573b6917050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc297fa640 0 client.15321 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc4a380740 1 -- 172.21.15.98:0/1595462496 >> 172.21.15.98:0/1595462496 conn(0x5573b6908a30 msgr2=0x5573b6907b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc4a380740 1 -- 172.21.15.98:0/1595462496 shutdown_connections 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc4a380740 1 -- 172.21.15.98:0/1595462496 wait complete. 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.933+0000 7efc4a380740 20 client.15321 trim_cache size 0 max 16384 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.950+0000 7efc4a380740 1 Processor -- start 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.950+0000 7efc4a380740 1 -- start start 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.950+0000 7efc4a380740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b690c4a0 0x5573b69234b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.950+0000 7efc4a380740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b69330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.950+0000 7efc4a380740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b6917680 0x5573b6933630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.950+0000 7efc4a380740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc401ae050 con 0x5573b690cdc0 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.950+0000 7efc4a380740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efc401ab920 con 0x5573b6917680 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.950+0000 7efc4a380740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc401a9770 con 0x5573b690c4a0 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.950+0000 7efc45542640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b69330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.951+0000 7efc45542640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b69330f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60158/0 (socket says 172.21.15.98:60158) 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.951+0000 7efc45542640 1 -- 172.21.15.98:0/1780180775 learned_addr learned my addr 172.21.15.98:0/1780180775 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.951+0000 7efc45542640 1 -- 172.21.15.98:0/1780180775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b690c4a0 msgr2=0x5573b69234b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.951+0000 7efc45542640 1 --2- 172.21.15.98:0/1780180775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b690c4a0 0x5573b69234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.951+0000 7efc45542640 1 -- 172.21.15.98:0/1780180775 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b6917680 msgr2=0x5573b6933630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.951+0000 7efc45542640 1 --2- 172.21.15.98:0/1780180775 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b6917680 0x5573b6933630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.951+0000 7efc45542640 1 -- 172.21.15.98:0/1780180775 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573b6914c60 con 0x5573b690cdc0 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.951+0000 7efc45542640 1 --2- 172.21.15.98:0/1780180775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b69330f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efc300baca0 tx=0x7efc300bc3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc83124b904e451 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.951+0000 7efc2b7fe640 1 -- 172.21.15.98:0/1780180775 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3009b030 con 0x5573b690cdc0 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.951+0000 7efc2b7fe640 1 -- 172.21.15.98:0/1780180775 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc300bc770 con 0x5573b690cdc0 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.951+0000 7efc2b7fe640 1 -- 172.21.15.98:0/1780180775 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30049070 con 0x5573b690cdc0 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.952+0000 7efc4a380740 1 -- 172.21.15.98:0/1780180775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 msgr2=0x5573b69330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.952+0000 7efc4a380740 1 --2- 172.21.15.98:0/1780180775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b69330f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7efc300baca0 tx=0x7efc300bc3e0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.952+0000 7efc4a380740 1 -- 172.21.15.98:0/1780180775 shutdown_connections 2024-09-19T07:22:14.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.952+0000 7efc4a380740 1 --2- 172.21.15.98:0/1780180775 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b6917680 0x5573b6933630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.952+0000 7efc4a380740 1 --2- 172.21.15.98:0/1780180775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b69330f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.952+0000 7efc4a380740 1 --2- 172.21.15.98:0/1780180775 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b690c4a0 0x5573b69234b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.952+0000 7efc4a380740 1 -- 172.21.15.98:0/1780180775 >> 172.21.15.98:0/1780180775 conn(0x5573b6908a30 msgr2=0x5573b69133f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:14.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.952+0000 7efc4a380740 1 -- 172.21.15.98:0/1780180775 shutdown_connections 2024-09-19T07:22:14.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.952+0000 7efc4a380740 1 -- 172.21.15.98:0/1780180775 wait complete. 2024-09-19T07:22:14.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.952+0000 7efc4a380740 1 -- start start 2024-09-19T07:22:14.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.952+0000 7efc4a380740 1 Processor -- start 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc4a380740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b690c4a0 0x5573b691fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc4a380740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b691af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc4a380740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b6917680 0x5573b691b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc4a380740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efc401a9de0 con 0x5573b690cdc0 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc4a380740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efc401ab250 con 0x5573b690c4a0 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc4a380740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efc401aa4b0 con 0x5573b6917680 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc4a380740 10 client.0 _ll_register_callbacks cb 0x7efc300b82f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc45542640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b691af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc45542640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b691af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60162/0 (socket says 172.21.15.98:60162) 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc45542640 1 -- 172.21.15.98:0/3228152675 learned_addr learned my addr 172.21.15.98:0/3228152675 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc45542640 1 -- 172.21.15.98:0/3228152675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b6917680 msgr2=0x5573b691b470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc45542640 1 --2- 172.21.15.98:0/3228152675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b6917680 0x5573b691b470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc45542640 1 -- 172.21.15.98:0/3228152675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b690c4a0 msgr2=0x5573b691fc00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:22:14.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc45542640 1 --2- 172.21.15.98:0/3228152675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b690c4a0 0x5573b691fc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.978 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:22:14.978 INFO:teuthology.orchestra.run.smithi098.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:22:14.978 INFO:teuthology.orchestra.run.smithi098.stdout: "scrubs": { 2024-09-19T07:22:14.978 INFO:teuthology.orchestra.run.smithi098.stdout: "1c706333-bfc2-454b-adf9-c5cbc99f7d7c": { 2024-09-19T07:22:14.978 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-19T07:22:14.979 INFO:teuthology.orchestra.run.smithi098.stdout: "tag": "1c706333-bfc2-454b-adf9-c5cbc99f7d7c", 2024-09-19T07:22:14.979 INFO:teuthology.orchestra.run.smithi098.stdout: "options": "recursive,force" 2024-09-19T07:22:14.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:22:14.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:22:14.979 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:22:14.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc45542640 1 -- 172.21.15.98:0/3228152675 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573b692db90 con 0x5573b690cdc0 2024-09-19T07:22:14.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc45542640 1 --2- 172.21.15.98:0/3228152675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b691af30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efc300c4eb0 tx=0x7efc300bc370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3bbffe88860dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:14.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc297fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:14.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc297fa640 1 -- 172.21.15.98:0/3228152675 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30049070 con 0x5573b690cdc0 2024-09-19T07:22:14.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc297fa640 1 -- 172.21.15.98:0/3228152675 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7efc300edec0 con 0x5573b690cdc0 2024-09-19T07:22:14.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.953+0000 7efc4a380740 1 -- 172.21.15.98:0/3228152675 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc300bc770 con 0x5573b690cdc0 2024-09-19T07:22:14.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.954+0000 7efc297fa640 1 -- 172.21.15.98:0/3228152675 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efc3009b040 con 0x5573b690cdc0 2024-09-19T07:22:14.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.954+0000 7efc4a380740 10 client.15327 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:14.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.954+0000 7efc4a380740 1 -- 172.21.15.98:0/3228152675 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5573b692db90 con 0x5573b690cdc0 2024-09-19T07:22:14.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.954+0000 7efc297fa640 1 -- 172.21.15.98:0/3228152675 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc300bc770 con 0x5573b690cdc0 2024-09-19T07:22:14.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.954+0000 7efc297fa640 1 -- 172.21.15.98:0/3228152675 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efc300bbbc0 con 0x5573b690cdc0 2024-09-19T07:22:14.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.954+0000 7efc4a380740 10 client.15327 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:14.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.954+0000 7efc4a380740 10 client.15327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:14.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.954+0000 7efc4a380740 20 client.15327 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:14.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.954+0000 7efc4a380740 1 --2- 172.21.15.98:0/3228152675 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5573b6996040 0x5573b6998430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:14.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.954+0000 7efc4a380740 4 client.15327 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:22:14.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.954+0000 7efc4a380740 1 -- 172.21.15.98:0/3228152675 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5573b67f6210 con 0x5573b6996040 2024-09-19T07:22:14.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.954+0000 7efc45d43640 1 --2- 172.21.15.98:0/3228152675 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5573b6996040 0x5573b6998430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:14.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc45d43640 1 --2- 172.21.15.98:0/3228152675 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5573b6996040 0x5573b6998430 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c2d3dbaabab9c25 server_cookie=731dd4fe0a9f49bf in_seq=0 out_seq=0 2024-09-19T07:22:14.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc297fa640 10 client.15327 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:14.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc297fa640 1 -- 172.21.15.98:0/3228152675 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5573b67f6210 con 0x5573b6996040 2024-09-19T07:22:14.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc297fa640 10 client.15327 handle_command_reply: tid=0 2024-09-19T07:22:14.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc4a380740 1 client.15327 shutdown 2024-09-19T07:22:14.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc4a380740 1 -- 172.21.15.98:0/3228152675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 msgr2=0x5573b691af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc4a380740 1 --2- 172.21.15.98:0/3228152675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b691af30 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efc300c4eb0 tx=0x7efc300bc370 comp rx=0 tx=0).stop 2024-09-19T07:22:14.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc4a380740 1 -- 172.21.15.98:0/3228152675 shutdown_connections 2024-09-19T07:22:14.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc4a380740 1 --2- 172.21.15.98:0/3228152675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5573b6917680 0x5573b691b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc4a380740 1 --2- 172.21.15.98:0/3228152675 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5573b6996040 0x5573b6998430 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc4a380740 1 --2- 172.21.15.98:0/3228152675 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5573b690cdc0 0x5573b691af30 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc297fa640 0 client.15327 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:14.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc4a380740 1 --2- 172.21.15.98:0/3228152675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5573b690c4a0 0x5573b691fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc4a380740 1 -- 172.21.15.98:0/3228152675 >> 172.21.15.98:0/3228152675 conn(0x5573b6908a30 msgr2=0x5573b6907370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:14.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc4a380740 1 -- 172.21.15.98:0/3228152675 shutdown_connections 2024-09-19T07:22:14.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc4a380740 1 -- 172.21.15.98:0/3228152675 wait complete. 2024-09-19T07:22:14.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.955+0000 7efc4a380740 20 client.15327 trim_cache size 0 max 16384 2024-09-19T07:22:14.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.956+0000 7efc47fa7640 1 -- 172.21.15.98:0/2904632531 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7efc2c0a34d0 msgr2=0x7efc2c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.956+0000 7efc47fa7640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7efc2c0a34d0 0x7efc2c0a5990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc38010c40 tx=0x7efc38017000 comp rx=0 tx=0).stop 2024-09-19T07:22:14.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.956+0000 7efc47fa7640 1 -- 172.21.15.98:0/2904632531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc40102570 msgr2=0x7efc40199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:14.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.956+0000 7efc47fa7640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc40102570 0x7efc40199870 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efc30006010 tx=0x7efc30003c10 comp rx=0 tx=0).stop 2024-09-19T07:22:14.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.956+0000 7efc47fa7640 1 -- 172.21.15.98:0/2904632531 shutdown_connections 2024-09-19T07:22:14.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.956+0000 7efc47fa7640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7efc2c0a34d0 0x7efc2c0a5990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.956+0000 7efc47fa7640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efc40102ef0 0x7efc401a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.956+0000 7efc47fa7640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efc40102570 0x7efc40199870 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.956+0000 7efc47fa7640 1 --2- 172.21.15.98:0/2904632531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc40100e20 0x7efc40199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:14.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.956+0000 7efc47fa7640 1 -- 172.21.15.98:0/2904632531 >> 172.21.15.98:0/2904632531 conn(0x7efc400fc7d0 msgr2=0x7efc400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:14.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.956+0000 7efc47fa7640 1 -- 172.21.15.98:0/2904632531 shutdown_connections 2024-09-19T07:22:14.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:14.956+0000 7efc47fa7640 1 -- 172.21.15.98:0/2904632531 wait complete. 2024-09-19T07:22:15.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.103+0000 7ff2d747b640 1 -- 172.21.15.98:0/2750083283 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7ff2d00fd520 con 0x7ff2bc0a3580 2024-09-19T07:22:15.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.110+0000 7ff2c67fc640 1 -- 172.21.15.98:0/2750083283 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7ff2d00fd520 con 0x7ff2bc0a3580 2024-09-19T07:22:15.111 INFO:teuthology.orchestra.run.smithi098.stdout:/ 1m 6m3h 2024-09-19T07:22:15.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.112+0000 7ff2d747b640 1 -- 172.21.15.98:0/2750083283 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff2bc0a3580 msgr2=0x7ff2bc0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:15.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.112+0000 7ff2d747b640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff2bc0a3580 0x7ff2bc0a5a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00fec50 tx=0x7ff2c00090e0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.112+0000 7ff2d747b640 1 -- 172.21.15.98:0/2750083283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d01009d0 msgr2=0x7ff2d01972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:15.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.112+0000 7ff2d747b640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d01009d0 0x7ff2d01972f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009230 tx=0x7ff2cc004270 comp rx=0 tx=0).stop 2024-09-19T07:22:15.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.112+0000 7ff2d747b640 1 -- 172.21.15.98:0/2750083283 shutdown_connections 2024-09-19T07:22:15.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.112+0000 7ff2d747b640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff2bc0a3580 0x7ff2bc0a5a40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.112+0000 7ff2d747b640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2d01069e0 0x7ff2d019bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.112+0000 7ff2d747b640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff2d0101370 0x7ff2d0197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.112+0000 7ff2d747b640 1 --2- 172.21.15.98:0/2750083283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2d01009d0 0x7ff2d01972f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:15.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.112+0000 7ff2d747b640 1 -- 172.21.15.98:0/2750083283 >> 172.21.15.98:0/2750083283 conn(0x7ff2d00fc6f0 msgr2=0x7ff2d00fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:15.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.112+0000 7ff2d747b640 1 -- 172.21.15.98:0/2750083283 shutdown_connections 2024-09-19T07:22:15.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:15.113+0000 7ff2d747b640 1 -- 172.21.15.98:0/2750083283 wait complete. 2024-09-19T07:22:15.123 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T07:22:15.149 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T07:22:15.161 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T07:22:15.256 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-19T07:22:15.256 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T07:22:15.259 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T07:22:15.373 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T07:22:15.374 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:22:15.820 INFO:tasks.cephfs.filesystem:scrub status for tag:1c706333-bfc2-454b-adf9-c5cbc99f7d7c - {'path': '/', 'tag': '1c706333-bfc2-454b-adf9-c5cbc99f7d7c', 'options': 'recursive,force'} 2024-09-19T07:22:15.948 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:16.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:15 smithi098 ceph-mon[30950]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:16.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:15 smithi098 ceph-mon[30950]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:16.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:15 smithi098 ceph-mon[30950]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:16.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:15 smithi139 ceph-mon[35039]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:16.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:15 smithi139 ceph-mon[35039]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:16.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:15 smithi139 ceph-mon[35039]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:16.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:15 smithi162 ceph-mon[35726]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:16.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:15 smithi162 ceph-mon[35726]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:16.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:15 smithi162 ceph-mon[35726]: from='client.15303 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:16.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.468+0000 7fafba542640 1 -- 172.21.15.98:0/4029371332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb4101de0 msgr2=0x7fafb41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:16.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.468+0000 7fafba542640 1 --2- 172.21.15.98:0/4029371332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb4101de0 0x7fafb41021c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009900 tx=0x7fafa402a410 comp rx=0 tx=0).stop 2024-09-19T07:22:16.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.468+0000 7fafba542640 1 -- 172.21.15.98:0/4029371332 shutdown_connections 2024-09-19T07:22:16.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.468+0000 7fafba542640 1 --2- 172.21.15.98:0/4029371332 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4106f10 0x7fafb410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.468+0000 7fafba542640 1 --2- 172.21.15.98:0/4029371332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb4102790 0x7fafb41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.468+0000 7fafba542640 1 --2- 172.21.15.98:0/4029371332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb4101de0 0x7fafb41021c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.468+0000 7fafba542640 1 -- 172.21.15.98:0/4029371332 >> 172.21.15.98:0/4029371332 conn(0x7fafb40fd8c0 msgr2=0x7fafb40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:16.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.468+0000 7fafba542640 1 -- 172.21.15.98:0/4029371332 shutdown_connections 2024-09-19T07:22:16.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.468+0000 7fafba542640 1 -- 172.21.15.98:0/4029371332 wait complete. 2024-09-19T07:22:16.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.468+0000 7fafba542640 1 Processor -- start 2024-09-19T07:22:16.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafba542640 1 -- start start 2024-09-19T07:22:16.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafba542640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4101de0 0x7fafb41985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafba542640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb4102790 0x7fafb4198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafba542640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb4106f10 0x7fafb419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafba542640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4112010 con 0x7fafb4106f10 2024-09-19T07:22:16.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafba542640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4111e90 con 0x7fafb4101de0 2024-09-19T07:22:16.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafba542640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4112190 con 0x7fafb4102790 2024-09-19T07:22:16.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafb8adf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb4106f10 0x7fafb419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafb8adf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb4106f10 0x7fafb419ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60192/0 (socket says 172.21.15.98:60192) 2024-09-19T07:22:16.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafb8adf640 1 -- 172.21.15.98:0/1152917213 learned_addr learned my addr 172.21.15.98:0/1152917213 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafb37fe640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb4102790 0x7fafb4198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafb3fff640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4101de0 0x7fafb41985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafb8adf640 1 -- 172.21.15.98:0/1152917213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb4102790 msgr2=0x7fafb4198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafb8adf640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb4102790 0x7fafb4198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafb8adf640 1 -- 172.21.15.98:0/1152917213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4101de0 msgr2=0x7fafb41985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.469+0000 7fafb8adf640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4101de0 0x7fafb41985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.470+0000 7fafb8adf640 1 -- 172.21.15.98:0/1152917213 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb419d560 con 0x7fafb4106f10 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.470+0000 7fafb3fff640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4101de0 0x7fafb41985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.470+0000 7fafb8adf640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb4106f10 0x7fafb419ce80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fafac00b970 tx=0x7fafac00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.470+0000 7fafb17fa640 1 -- 172.21.15.98:0/1152917213 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac019070 con 0x7fafb4106f10 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.470+0000 7fafba542640 1 -- 172.21.15.98:0/1152917213 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb419d850 con 0x7fafb4106f10 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.470+0000 7fafb17fa640 1 -- 172.21.15.98:0/1152917213 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafac014440 con 0x7fafb4106f10 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.470+0000 7fafb17fa640 1 -- 172.21.15.98:0/1152917213 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac0075d0 con 0x7fafb4106f10 2024-09-19T07:22:16.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.470+0000 7fafba542640 1 -- 172.21.15.98:0/1152917213 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb41a5130 con 0x7fafb4106f10 2024-09-19T07:22:16.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.471+0000 7fafba542640 1 -- 172.21.15.98:0/1152917213 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb4102240 con 0x7fafb4106f10 2024-09-19T07:22:16.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.472+0000 7fafb17fa640 1 -- 172.21.15.98:0/1152917213 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fafac01c070 con 0x7fafb4106f10 2024-09-19T07:22:16.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.473+0000 7fafb17fa640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faf9c0a3550 0x7faf9c0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:16.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.473+0000 7fafb17fa640 1 -- 172.21.15.98:0/1152917213 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fafac0cfa50 con 0x7fafb4106f10 2024-09-19T07:22:16.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.473+0000 7fafb3fff640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faf9c0a3550 0x7faf9c0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:16.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.474+0000 7fafb3fff640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faf9c0a3550 0x7faf9c0a5a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fafa4005ab0 tx=0x7fafa4005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:16.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.477+0000 7fafb17fa640 1 -- 172.21.15.98:0/1152917213 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fafac09c260 con 0x7fafb4106f10 2024-09-19T07:22:16.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.640+0000 7fafba542640 1 -- 172.21.15.98:0/1152917213 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafb4062630 con 0x7faf9c0a3550 2024-09-19T07:22:16.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.646+0000 7fafb17fa640 1 -- 172.21.15.98:0/1152917213 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257759 (secure 0 0 0) 0x7fafb4062630 con 0x7faf9c0a3550 2024-09-19T07:22:16.649 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:16.650 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-19T07:22:16.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.649+0000 7fafba542640 1 -- 172.21.15.98:0/1152917213 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faf9c0a3550 msgr2=0x7faf9c0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:16.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.649+0000 7fafba542640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faf9c0a3550 0x7faf9c0a5a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fafa4005ab0 tx=0x7fafa4005a20 comp rx=0 tx=0).stop 2024-09-19T07:22:16.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.649+0000 7fafba542640 1 -- 172.21.15.98:0/1152917213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb4106f10 msgr2=0x7fafb419ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:16.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.649+0000 7fafba542640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb4106f10 0x7fafb419ce80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fafac00b970 tx=0x7fafac00bd70 comp rx=0 tx=0).stop 2024-09-19T07:22:16.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.649+0000 7fafba542640 1 -- 172.21.15.98:0/1152917213 shutdown_connections 2024-09-19T07:22:16.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.649+0000 7fafba542640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faf9c0a3550 0x7faf9c0a5a10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.649+0000 7fafba542640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb4106f10 0x7fafb419ce80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.649+0000 7fafba542640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb4102790 0x7fafb4198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.649+0000 7fafba542640 1 --2- 172.21.15.98:0/1152917213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4101de0 0x7fafb41985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:16.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.649+0000 7fafba542640 1 -- 172.21.15.98:0/1152917213 >> 172.21.15.98:0/1152917213 conn(0x7fafb40fd8c0 msgr2=0x7fafb40fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:16.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.649+0000 7fafba542640 1 -- 172.21.15.98:0/1152917213 shutdown_connections 2024-09-19T07:22:16.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:16.649+0000 7fafba542640 1 -- 172.21.15.98:0/1152917213 wait complete. 2024-09-19T07:22:16.943 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:16 smithi098 ceph-mon[30950]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:16.943 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:16 smithi098 ceph-mon[30950]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-09-19T07:22:17.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:16 smithi162 ceph-mon[35726]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:17.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:16 smithi162 ceph-mon[35726]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-09-19T07:22:17.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:16 smithi139 ceph-mon[35039]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:22:17.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:16 smithi139 ceph-mon[35039]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-09-19T07:22:17.415 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-19T07:22:15.775788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1386933,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1236,"num_read_kb":1036,"num_write":620,"num_write_kb":5294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1208265,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":956,"ondisk_log_size":956,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355852,"kb_used_data":14784,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124585972,"statfs":{"total":1151940427776,"available":1151576035328,"internally_reserved":0,"allocated":15138816,"data_stored":9401775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":200331,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":411,"num_read_kb":471,"num_write":150,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.992075"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816102+0000","last_change":"2024-09-19T07:20:19.535372+0000","last_active":"2024-09-19T07:22:03.816102+0000","last_peered":"2024-09-19T07:22:03.816102+0000","last_clean":"2024-09-19T07:22:03.816102+0000","last_became_active":"2024-09-19T07:20:19.535079+0000","last_became_peered":"2024-09-19T07:20:19.535079+0000","last_unstale":"2024-09-19T07:22:03.816102+0000","last_undegraded":"2024-09-19T07:22:03.816102+0000","last_fullsized":"2024-09-19T07:22:03.816102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:56.856451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815671+0000","last_change":"2024-09-19T07:20:19.528531+0000","last_active":"2024-09-19T07:22:03.815671+0000","last_peered":"2024-09-19T07:22:03.815671+0000","last_clean":"2024-09-19T07:22:03.815671+0000","last_became_active":"2024-09-19T07:20:19.528218+0000","last_became_peered":"2024-09-19T07:20:19.528218+0000","last_unstale":"2024-09-19T07:22:03.815671+0000","last_undegraded":"2024-09-19T07:22:03.815671+0000","last_fullsized":"2024-09-19T07:22:03.815671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:44.730220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818254+0000","last_change":"2024-09-19T07:20:19.533516+0000","last_active":"2024-09-19T07:22:03.818254+0000","last_peered":"2024-09-19T07:22:03.818254+0000","last_clean":"2024-09-19T07:22:03.818254+0000","last_became_active":"2024-09-19T07:20:19.533247+0000","last_became_peered":"2024-09-19T07:20:19.533247+0000","last_unstale":"2024-09-19T07:22:03.818254+0000","last_undegraded":"2024-09-19T07:22:03.818254+0000","last_fullsized":"2024-09-19T07:22:03.818254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:29.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810373+0000","last_change":"2024-09-19T07:20:19.543245+0000","last_active":"2024-09-19T07:22:03.810373+0000","last_peered":"2024-09-19T07:22:03.810373+0000","last_clean":"2024-09-19T07:22:03.810373+0000","last_became_active":"2024-09-19T07:20:19.542840+0000","last_became_peered":"2024-09-19T07:20:19.542840+0000","last_unstale":"2024-09-19T07:22:03.810373+0000","last_undegraded":"2024-09-19T07:22:03.810373+0000","last_fullsized":"2024-09-19T07:22:03.810373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:21.780027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.794220+0000","last_change":"2024-09-19T07:20:19.528880+0000","last_active":"2024-09-19T07:22:03.794220+0000","last_peered":"2024-09-19T07:22:03.794220+0000","last_clean":"2024-09-19T07:22:03.794220+0000","last_became_active":"2024-09-19T07:20:19.528592+0000","last_became_peered":"2024-09-19T07:20:19.528592+0000","last_unstale":"2024-09-19T07:22:03.794220+0000","last_undegraded":"2024-09-19T07:22:03.794220+0000","last_fullsized":"2024-09-19T07:22:03.794220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:59.718929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805549+0000","last_change":"2024-09-19T07:20:19.538480+0000","last_active":"2024-09-19T07:22:03.805549+0000","last_peered":"2024-09-19T07:22:03.805549+0000","last_clean":"2024-09-19T07:22:03.805549+0000","last_became_active":"2024-09-19T07:20:19.538189+0000","last_became_peered":"2024-09-19T07:20:19.538189+0000","last_unstale":"2024-09-19T07:22:03.805549+0000","last_undegraded":"2024-09-19T07:22:03.805549+0000","last_fullsized":"2024-09-19T07:22:03.805549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:29.607974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813603+0000","last_change":"2024-09-19T07:20:19.538877+0000","last_active":"2024-09-19T07:22:03.813603+0000","last_peered":"2024-09-19T07:22:03.813603+0000","last_clean":"2024-09-19T07:22:03.813603+0000","last_became_active":"2024-09-19T07:20:19.538551+0000","last_became_peered":"2024-09-19T07:20:19.538551+0000","last_unstale":"2024-09-19T07:22:03.813603+0000","last_undegraded":"2024-09-19T07:22:03.813603+0000","last_fullsized":"2024-09-19T07:22:03.813603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:52.114115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.819590+0000","last_change":"2024-09-19T07:20:19.538135+0000","last_active":"2024-09-19T07:22:03.819590+0000","last_peered":"2024-09-19T07:22:03.819590+0000","last_clean":"2024-09-19T07:22:03.819590+0000","last_became_active":"2024-09-19T07:20:19.537769+0000","last_became_peered":"2024-09-19T07:20:19.537769+0000","last_unstale":"2024-09-19T07:22:03.819590+0000","last_undegraded":"2024-09-19T07:22:03.819590+0000","last_fullsized":"2024-09-19T07:22:03.819590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:21.304262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814166+0000","last_change":"2024-09-19T07:20:19.531569+0000","last_active":"2024-09-19T07:22:03.814166+0000","last_peered":"2024-09-19T07:22:03.814166+0000","last_clean":"2024-09-19T07:22:03.814166+0000","last_became_active":"2024-09-19T07:20:19.529455+0000","last_became_peered":"2024-09-19T07:20:19.529455+0000","last_unstale":"2024-09-19T07:22:03.814166+0000","last_undegraded":"2024-09-19T07:22:03.814166+0000","last_fullsized":"2024-09-19T07:22:03.814166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:22.187968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807215+0000","last_change":"2024-09-19T07:20:19.540342+0000","last_active":"2024-09-19T07:22:03.807215+0000","last_peered":"2024-09-19T07:22:03.807215+0000","last_clean":"2024-09-19T07:22:03.807215+0000","last_became_active":"2024-09-19T07:20:19.539870+0000","last_became_peered":"2024-09-19T07:20:19.539870+0000","last_unstale":"2024-09-19T07:22:03.807215+0000","last_undegraded":"2024-09-19T07:22:03.807215+0000","last_fullsized":"2024-09-19T07:22:03.807215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:39.930671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803048+0000","last_change":"2024-09-19T07:20:19.536004+0000","last_active":"2024-09-19T07:22:03.803048+0000","last_peered":"2024-09-19T07:22:03.803048+0000","last_clean":"2024-09-19T07:22:03.803048+0000","last_became_active":"2024-09-19T07:20:19.535640+0000","last_became_peered":"2024-09-19T07:20:19.535640+0000","last_unstale":"2024-09-19T07:22:03.803048+0000","last_undegraded":"2024-09-19T07:22:03.803048+0000","last_fullsized":"2024-09-19T07:22:03.803048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:47.853411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.806987+0000","last_change":"2024-09-19T07:20:19.539374+0000","last_active":"2024-09-19T07:22:03.806987+0000","last_peered":"2024-09-19T07:22:03.806987+0000","last_clean":"2024-09-19T07:22:03.806987+0000","last_became_active":"2024-09-19T07:20:19.538880+0000","last_became_peered":"2024-09-19T07:20:19.538880+0000","last_unstale":"2024-09-19T07:22:03.806987+0000","last_undegraded":"2024-09-19T07:22:03.806987+0000","last_fullsized":"2024-09-19T07:22:03.806987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:55.484232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.806269+0000","last_change":"2024-09-19T07:20:37.792753+0000","last_active":"2024-09-19T07:22:03.806269+0000","last_peered":"2024-09-19T07:22:03.806269+0000","last_clean":"2024-09-19T07:22:03.806269+0000","last_became_active":"2024-09-19T07:20:37.792417+0000","last_became_peered":"2024-09-19T07:20:37.792417+0000","last_unstale":"2024-09-19T07:22:03.806269+0000","last_undegraded":"2024-09-19T07:22:03.806269+0000","last_fullsized":"2024-09-19T07:22:03.806269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:10.417367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816028+0000","last_change":"2024-09-19T07:20:19.528842+0000","last_active":"2024-09-19T07:22:03.816028+0000","last_peered":"2024-09-19T07:22:03.816028+0000","last_clean":"2024-09-19T07:22:03.816028+0000","last_became_active":"2024-09-19T07:20:19.528042+0000","last_became_peered":"2024-09-19T07:20:19.528042+0000","last_unstale":"2024-09-19T07:22:03.816028+0000","last_undegraded":"2024-09-19T07:22:03.816028+0000","last_fullsized":"2024-09-19T07:22:03.816028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:34.970509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817953+0000","last_change":"2024-09-19T07:20:19.535013+0000","last_active":"2024-09-19T07:22:03.817953+0000","last_peered":"2024-09-19T07:22:03.817953+0000","last_clean":"2024-09-19T07:22:03.817953+0000","last_became_active":"2024-09-19T07:20:19.534302+0000","last_became_peered":"2024-09-19T07:20:19.534302+0000","last_unstale":"2024-09-19T07:22:03.817953+0000","last_undegraded":"2024-09-19T07:22:03.817953+0000","last_fullsized":"2024-09-19T07:22:03.817953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:52.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812766+0000","last_change":"2024-09-19T07:20:19.534930+0000","last_active":"2024-09-19T07:22:03.812766+0000","last_peered":"2024-09-19T07:22:03.812766+0000","last_clean":"2024-09-19T07:22:03.812766+0000","last_became_active":"2024-09-19T07:20:19.534640+0000","last_became_peered":"2024-09-19T07:20:19.534640+0000","last_unstale":"2024-09-19T07:22:03.812766+0000","last_undegraded":"2024-09-19T07:22:03.812766+0000","last_fullsized":"2024-09-19T07:22:03.812766+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:23.055097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818341+0000","last_change":"2024-09-19T07:20:19.535856+0000","last_active":"2024-09-19T07:22:03.818341+0000","last_peered":"2024-09-19T07:22:03.818341+0000","last_clean":"2024-09-19T07:22:03.818341+0000","last_became_active":"2024-09-19T07:20:19.535561+0000","last_became_peered":"2024-09-19T07:20:19.535561+0000","last_unstale":"2024-09-19T07:22:03.818341+0000","last_undegraded":"2024-09-19T07:22:03.818341+0000","last_fullsized":"2024-09-19T07:22:03.818341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:03.943339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812865+0000","last_change":"2024-09-19T07:20:19.528429+0000","last_active":"2024-09-19T07:22:03.812865+0000","last_peered":"2024-09-19T07:22:03.812865+0000","last_clean":"2024-09-19T07:22:03.812865+0000","last_became_active":"2024-09-19T07:20:19.528107+0000","last_became_peered":"2024-09-19T07:20:19.528107+0000","last_unstale":"2024-09-19T07:22:03.812865+0000","last_undegraded":"2024-09-19T07:22:03.812865+0000","last_fullsized":"2024-09-19T07:22:03.812865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:49.520514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818269+0000","last_change":"2024-09-19T07:20:19.532966+0000","last_active":"2024-09-19T07:22:03.818269+0000","last_peered":"2024-09-19T07:22:03.818269+0000","last_clean":"2024-09-19T07:22:03.818269+0000","last_became_active":"2024-09-19T07:20:19.532412+0000","last_became_peered":"2024-09-19T07:20:19.532412+0000","last_unstale":"2024-09-19T07:22:03.818269+0000","last_undegraded":"2024-09-19T07:22:03.818269+0000","last_fullsized":"2024-09-19T07:22:03.818269+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:42.900136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.800966+0000","last_change":"2024-09-19T07:20:37.797952+0000","last_active":"2024-09-19T07:22:03.800966+0000","last_peered":"2024-09-19T07:22:03.800966+0000","last_clean":"2024-09-19T07:22:03.800966+0000","last_became_active":"2024-09-19T07:20:37.797459+0000","last_became_peered":"2024-09-19T07:20:37.797459+0000","last_unstale":"2024-09-19T07:22:03.800966+0000","last_undegraded":"2024-09-19T07:22:03.800966+0000","last_fullsized":"2024-09-19T07:22:03.800966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:44.132477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818884+0000","last_change":"2024-09-19T07:20:19.532193+0000","last_active":"2024-09-19T07:22:03.818884+0000","last_peered":"2024-09-19T07:22:03.818884+0000","last_clean":"2024-09-19T07:22:03.818884+0000","last_became_active":"2024-09-19T07:20:19.531890+0000","last_became_peered":"2024-09-19T07:20:19.531890+0000","last_unstale":"2024-09-19T07:22:03.818884+0000","last_undegraded":"2024-09-19T07:22:03.818884+0000","last_fullsized":"2024-09-19T07:22:03.818884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:21.168993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815073+0000","last_change":"2024-09-19T07:20:19.535034+0000","last_active":"2024-09-19T07:22:03.815073+0000","last_peered":"2024-09-19T07:22:03.815073+0000","last_clean":"2024-09-19T07:22:03.815073+0000","last_became_active":"2024-09-19T07:20:19.534732+0000","last_became_peered":"2024-09-19T07:20:19.534732+0000","last_unstale":"2024-09-19T07:22:03.815073+0000","last_undegraded":"2024-09-19T07:22:03.815073+0000","last_fullsized":"2024-09-19T07:22:03.815073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:13.726672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817072+0000","last_change":"2024-09-19T07:20:19.532644+0000","last_active":"2024-09-19T07:22:03.817072+0000","last_peered":"2024-09-19T07:22:03.817072+0000","last_clean":"2024-09-19T07:22:03.817072+0000","last_became_active":"2024-09-19T07:20:19.532364+0000","last_became_peered":"2024-09-19T07:20:19.532364+0000","last_unstale":"2024-09-19T07:22:03.817072+0000","last_undegraded":"2024-09-19T07:22:03.817072+0000","last_fullsized":"2024-09-19T07:22:03.817072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:17.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814164+0000","last_change":"2024-09-19T07:20:19.533500+0000","last_active":"2024-09-19T07:22:03.814164+0000","last_peered":"2024-09-19T07:22:03.814164+0000","last_clean":"2024-09-19T07:22:03.814164+0000","last_became_active":"2024-09-19T07:20:19.532759+0000","last_became_peered":"2024-09-19T07:20:19.532759+0000","last_unstale":"2024-09-19T07:22:03.814164+0000","last_undegraded":"2024-09-19T07:22:03.814164+0000","last_fullsized":"2024-09-19T07:22:03.814164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:35.549776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815771+0000","last_change":"2024-09-19T07:20:37.793776+0000","last_active":"2024-09-19T07:22:03.815771+0000","last_peered":"2024-09-19T07:22:03.815771+0000","last_clean":"2024-09-19T07:22:03.815771+0000","last_became_active":"2024-09-19T07:20:37.793382+0000","last_became_peered":"2024-09-19T07:20:37.793382+0000","last_unstale":"2024-09-19T07:22:03.815771+0000","last_undegraded":"2024-09-19T07:22:03.815771+0000","last_fullsized":"2024-09-19T07:22:03.815771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:00.422534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803532+0000","last_change":"2024-09-19T07:20:19.532840+0000","last_active":"2024-09-19T07:22:03.803532+0000","last_peered":"2024-09-19T07:22:03.803532+0000","last_clean":"2024-09-19T07:22:03.803532+0000","last_became_active":"2024-09-19T07:20:19.532059+0000","last_became_peered":"2024-09-19T07:20:19.532059+0000","last_unstale":"2024-09-19T07:22:03.803532+0000","last_undegraded":"2024-09-19T07:22:03.803532+0000","last_fullsized":"2024-09-19T07:22:03.803532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:49.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.802328+0000","last_change":"2024-09-19T07:20:19.528150+0000","last_active":"2024-09-19T07:22:03.802328+0000","last_peered":"2024-09-19T07:22:03.802328+0000","last_clean":"2024-09-19T07:22:03.802328+0000","last_became_active":"2024-09-19T07:20:19.527873+0000","last_became_peered":"2024-09-19T07:20:19.527873+0000","last_unstale":"2024-09-19T07:22:03.802328+0000","last_undegraded":"2024-09-19T07:22:03.802328+0000","last_fullsized":"2024-09-19T07:22:03.802328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.561937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808779+0000","last_change":"2024-09-19T07:20:19.540160+0000","last_active":"2024-09-19T07:22:03.808779+0000","last_peered":"2024-09-19T07:22:03.808779+0000","last_clean":"2024-09-19T07:22:03.808779+0000","last_became_active":"2024-09-19T07:20:19.539862+0000","last_became_peered":"2024-09-19T07:20:19.539862+0000","last_unstale":"2024-09-19T07:22:03.808779+0000","last_undegraded":"2024-09-19T07:22:03.808779+0000","last_fullsized":"2024-09-19T07:22:03.808779+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:22.229785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.820657+0000","last_change":"2024-09-19T07:20:19.540363+0000","last_active":"2024-09-19T07:22:03.820657+0000","last_peered":"2024-09-19T07:22:03.820657+0000","last_clean":"2024-09-19T07:22:03.820657+0000","last_became_active":"2024-09-19T07:20:19.540068+0000","last_became_peered":"2024-09-19T07:20:19.540068+0000","last_unstale":"2024-09-19T07:22:03.820657+0000","last_undegraded":"2024-09-19T07:22:03.820657+0000","last_fullsized":"2024-09-19T07:22:03.820657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:07.955849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818258+0000","last_change":"2024-09-19T07:20:19.533546+0000","last_active":"2024-09-19T07:22:03.818258+0000","last_peered":"2024-09-19T07:22:03.818258+0000","last_clean":"2024-09-19T07:22:03.818258+0000","last_became_active":"2024-09-19T07:20:19.533232+0000","last_became_peered":"2024-09-19T07:20:19.533232+0000","last_unstale":"2024-09-19T07:22:03.818258+0000","last_undegraded":"2024-09-19T07:22:03.818258+0000","last_fullsized":"2024-09-19T07:22:03.818258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:29.674866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807595+0000","last_change":"2024-09-19T07:20:19.542842+0000","last_active":"2024-09-19T07:22:03.807595+0000","last_peered":"2024-09-19T07:22:03.807595+0000","last_clean":"2024-09-19T07:22:03.807595+0000","last_became_active":"2024-09-19T07:20:19.542477+0000","last_became_peered":"2024-09-19T07:20:19.542477+0000","last_unstale":"2024-09-19T07:22:03.807595+0000","last_undegraded":"2024-09-19T07:22:03.807595+0000","last_fullsized":"2024-09-19T07:22:03.807595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:30.921099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803673+0000","last_change":"2024-09-19T07:20:19.530472+0000","last_active":"2024-09-19T07:22:03.803673+0000","last_peered":"2024-09-19T07:22:03.803673+0000","last_clean":"2024-09-19T07:22:03.803673+0000","last_became_active":"2024-09-19T07:20:19.529457+0000","last_became_peered":"2024-09-19T07:20:19.529457+0000","last_unstale":"2024-09-19T07:22:03.803673+0000","last_undegraded":"2024-09-19T07:22:03.803673+0000","last_fullsized":"2024-09-19T07:22:03.803673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:16.410723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803010+0000","last_change":"2024-09-19T07:20:37.801168+0000","last_active":"2024-09-19T07:22:03.803010+0000","last_peered":"2024-09-19T07:22:03.803010+0000","last_clean":"2024-09-19T07:22:03.803010+0000","last_became_active":"2024-09-19T07:20:37.800613+0000","last_became_peered":"2024-09-19T07:20:37.800613+0000","last_unstale":"2024-09-19T07:22:03.803010+0000","last_undegraded":"2024-09-19T07:22:03.803010+0000","last_fullsized":"2024-09-19T07:22:03.803010+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:27.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'8","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:12.911995+0000","last_change":"2024-09-19T07:20:17.524656+0000","last_active":"2024-09-19T07:22:12.911995+0000","last_peered":"2024-09-19T07:22:12.911995+0000","last_clean":"2024-09-19T07:22:12.911995+0000","last_became_active":"2024-09-19T07:20:17.524350+0000","last_became_peered":"2024-09-19T07:20:17.524350+0000","last_unstale":"2024-09-19T07:22:12.911995+0000","last_undegraded":"2024-09-19T07:22:12.911995+0000","last_fullsized":"2024-09-19T07:22:12.911995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:00.459283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1716,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810877+0000","last_change":"2024-09-19T07:20:19.536895+0000","last_active":"2024-09-19T07:22:03.810877+0000","last_peered":"2024-09-19T07:22:03.810877+0000","last_clean":"2024-09-19T07:22:03.810877+0000","last_became_active":"2024-09-19T07:20:19.536569+0000","last_became_peered":"2024-09-19T07:20:19.536569+0000","last_unstale":"2024-09-19T07:22:03.810877+0000","last_undegraded":"2024-09-19T07:22:03.810877+0000","last_fullsized":"2024-09-19T07:22:03.810877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:56.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.770907+0000","last_change":"2024-09-19T07:20:17.519800+0000","last_active":"2024-09-19T07:22:03.770907+0000","last_peered":"2024-09-19T07:22:03.770907+0000","last_clean":"2024-09-19T07:22:03.770907+0000","last_became_active":"2024-09-19T07:20:17.519384+0000","last_became_peered":"2024-09-19T07:20:17.519384+0000","last_unstale":"2024-09-19T07:22:03.770907+0000","last_undegraded":"2024-09-19T07:22:03.770907+0000","last_fullsized":"2024-09-19T07:22:03.770907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:17.346946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.761997+0000","last_change":"2024-09-19T07:20:17.511178+0000","last_active":"2024-09-19T07:22:03.761997+0000","last_peered":"2024-09-19T07:22:03.761997+0000","last_clean":"2024-09-19T07:22:03.761997+0000","last_became_active":"2024-09-19T07:20:17.510646+0000","last_became_peered":"2024-09-19T07:20:17.510646+0000","last_unstale":"2024-09-19T07:22:03.761997+0000","last_undegraded":"2024-09-19T07:22:03.761997+0000","last_fullsized":"2024-09-19T07:22:03.761997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:58.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.804119+0000","last_change":"2024-09-19T07:20:19.532979+0000","last_active":"2024-09-19T07:22:03.804119+0000","last_peered":"2024-09-19T07:22:03.804119+0000","last_clean":"2024-09-19T07:22:03.804119+0000","last_became_active":"2024-09-19T07:20:19.532396+0000","last_became_peered":"2024-09-19T07:20:19.532396+0000","last_unstale":"2024-09-19T07:22:03.804119+0000","last_undegraded":"2024-09-19T07:22:03.804119+0000","last_fullsized":"2024-09-19T07:22:03.804119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:24.313572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.781655+0000","last_change":"2024-09-19T07:20:17.519327+0000","last_active":"2024-09-19T07:22:03.781655+0000","last_peered":"2024-09-19T07:22:03.781655+0000","last_clean":"2024-09-19T07:22:03.781655+0000","last_became_active":"2024-09-19T07:20:17.518916+0000","last_became_peered":"2024-09-19T07:20:17.518916+0000","last_unstale":"2024-09-19T07:22:03.781655+0000","last_undegraded":"2024-09-19T07:22:03.781655+0000","last_fullsized":"2024-09-19T07:22:03.781655+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:52.672016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814641+0000","last_change":"2024-09-19T07:20:19.528642+0000","last_active":"2024-09-19T07:22:03.814641+0000","last_peered":"2024-09-19T07:22:03.814641+0000","last_clean":"2024-09-19T07:22:03.814641+0000","last_became_active":"2024-09-19T07:20:19.528302+0000","last_became_peered":"2024-09-19T07:20:19.528302+0000","last_unstale":"2024-09-19T07:22:03.814641+0000","last_undegraded":"2024-09-19T07:22:03.814641+0000","last_fullsized":"2024-09-19T07:22:03.814641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:22.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:12.911209+0000","last_change":"2024-09-19T07:20:17.519144+0000","last_active":"2024-09-19T07:22:12.911209+0000","last_peered":"2024-09-19T07:22:12.911209+0000","last_clean":"2024-09-19T07:22:12.911209+0000","last_became_active":"2024-09-19T07:20:17.518714+0000","last_became_peered":"2024-09-19T07:20:17.518714+0000","last_unstale":"2024-09-19T07:22:12.911209+0000","last_undegraded":"2024-09-19T07:22:12.911209+0000","last_fullsized":"2024-09-19T07:22:12.911209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:09.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808858+0000","last_change":"2024-09-19T07:20:19.532293+0000","last_active":"2024-09-19T07:22:03.808858+0000","last_peered":"2024-09-19T07:22:03.808858+0000","last_clean":"2024-09-19T07:22:03.808858+0000","last_became_active":"2024-09-19T07:20:19.531427+0000","last_became_peered":"2024-09-19T07:20:19.531427+0000","last_unstale":"2024-09-19T07:22:03.808858+0000","last_undegraded":"2024-09-19T07:22:03.808858+0000","last_fullsized":"2024-09-19T07:22:03.808858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:31.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776705+0000","last_change":"2024-09-19T07:20:17.521743+0000","last_active":"2024-09-19T07:22:03.776705+0000","last_peered":"2024-09-19T07:22:03.776705+0000","last_clean":"2024-09-19T07:22:03.776705+0000","last_became_active":"2024-09-19T07:20:17.521321+0000","last_became_peered":"2024-09-19T07:20:17.521321+0000","last_unstale":"2024-09-19T07:22:03.776705+0000","last_undegraded":"2024-09-19T07:22:03.776705+0000","last_fullsized":"2024-09-19T07:22:03.776705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:21.107210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.821636+0000","last_change":"2024-09-19T07:20:19.532879+0000","last_active":"2024-09-19T07:22:03.821636+0000","last_peered":"2024-09-19T07:22:03.821636+0000","last_clean":"2024-09-19T07:22:03.821636+0000","last_became_active":"2024-09-19T07:20:19.532490+0000","last_became_peered":"2024-09-19T07:20:19.532490+0000","last_unstale":"2024-09-19T07:22:03.821636+0000","last_undegraded":"2024-09-19T07:22:03.821636+0000","last_fullsized":"2024-09-19T07:22:03.821636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:06.534849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.782814+0000","last_change":"2024-09-19T07:20:17.565759+0000","last_active":"2024-09-19T07:22:03.782814+0000","last_peered":"2024-09-19T07:22:03.782814+0000","last_clean":"2024-09-19T07:22:03.782814+0000","last_became_active":"2024-09-19T07:20:17.565334+0000","last_became_peered":"2024-09-19T07:20:17.565334+0000","last_unstale":"2024-09-19T07:22:03.782814+0000","last_undegraded":"2024-09-19T07:22:03.782814+0000","last_fullsized":"2024-09-19T07:22:03.782814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.588515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812382+0000","last_change":"2024-09-19T07:20:19.537397+0000","last_active":"2024-09-19T07:22:03.812382+0000","last_peered":"2024-09-19T07:22:03.812382+0000","last_clean":"2024-09-19T07:22:03.812382+0000","last_became_active":"2024-09-19T07:20:19.537059+0000","last_became_peered":"2024-09-19T07:20:19.537059+0000","last_unstale":"2024-09-19T07:22:03.812382+0000","last_undegraded":"2024-09-19T07:22:03.812382+0000","last_fullsized":"2024-09-19T07:22:03.812382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:30.146934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'36","reported_seq":302,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:14.080697+0000","last_change":"2024-09-19T07:20:37.956721+0000","last_active":"2024-09-19T07:22:14.080697+0000","last_peered":"2024-09-19T07:22:14.080697+0000","last_clean":"2024-09-19T07:22:14.080697+0000","last_became_active":"2024-09-19T07:20:37.944159+0000","last_became_peered":"2024-09-19T07:20:37.944159+0000","last_unstale":"2024-09-19T07:22:14.080697+0000","last_undegraded":"2024-09-19T07:22:14.080697+0000","last_fullsized":"2024-09-19T07:22:14.080697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:52.944073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69393,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":173,"num_write":37,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.797438+0000","last_change":"2024-09-19T07:20:19.531533+0000","last_active":"2024-09-19T07:22:03.797438+0000","last_peered":"2024-09-19T07:22:03.797438+0000","last_clean":"2024-09-19T07:22:03.797438+0000","last_became_active":"2024-09-19T07:20:19.531228+0000","last_became_peered":"2024-09-19T07:20:19.531228+0000","last_unstale":"2024-09-19T07:22:03.797438+0000","last_undegraded":"2024-09-19T07:22:03.797438+0000","last_fullsized":"2024-09-19T07:22:03.797438+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:34.606957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775177+0000","last_change":"2024-09-19T07:20:17.522411+0000","last_active":"2024-09-19T07:22:03.775177+0000","last_peered":"2024-09-19T07:22:03.775177+0000","last_clean":"2024-09-19T07:22:03.775177+0000","last_became_active":"2024-09-19T07:20:17.522086+0000","last_became_peered":"2024-09-19T07:20:17.522086+0000","last_unstale":"2024-09-19T07:22:03.775177+0000","last_undegraded":"2024-09-19T07:22:03.775177+0000","last_fullsized":"2024-09-19T07:22:03.775177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.299624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814726+0000","last_change":"2024-09-19T07:20:19.532527+0000","last_active":"2024-09-19T07:22:03.814726+0000","last_peered":"2024-09-19T07:22:03.814726+0000","last_clean":"2024-09-19T07:22:03.814726+0000","last_became_active":"2024-09-19T07:20:19.532219+0000","last_became_peered":"2024-09-19T07:20:19.532219+0000","last_unstale":"2024-09-19T07:22:03.814726+0000","last_undegraded":"2024-09-19T07:22:03.814726+0000","last_fullsized":"2024-09-19T07:22:03.814726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:05.878229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.781583+0000","last_change":"2024-09-19T07:20:17.518014+0000","last_active":"2024-09-19T07:22:03.781583+0000","last_peered":"2024-09-19T07:22:03.781583+0000","last_clean":"2024-09-19T07:22:03.781583+0000","last_became_active":"2024-09-19T07:20:17.517077+0000","last_became_peered":"2024-09-19T07:20:17.517077+0000","last_unstale":"2024-09-19T07:22:03.781583+0000","last_undegraded":"2024-09-19T07:22:03.781583+0000","last_fullsized":"2024-09-19T07:22:03.781583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:45.893365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816520+0000","last_change":"2024-09-19T07:20:19.539347+0000","last_active":"2024-09-19T07:22:03.816520+0000","last_peered":"2024-09-19T07:22:03.816520+0000","last_clean":"2024-09-19T07:22:03.816520+0000","last_became_active":"2024-09-19T07:20:19.538884+0000","last_became_peered":"2024-09-19T07:20:19.538884+0000","last_unstale":"2024-09-19T07:22:03.816520+0000","last_undegraded":"2024-09-19T07:22:03.816520+0000","last_fullsized":"2024-09-19T07:22:03.816520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:23.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:12.911428+0000","last_change":"2024-09-19T07:20:17.513756+0000","last_active":"2024-09-19T07:22:12.911428+0000","last_peered":"2024-09-19T07:22:12.911428+0000","last_clean":"2024-09-19T07:22:12.911428+0000","last_became_active":"2024-09-19T07:20:17.513433+0000","last_became_peered":"2024-09-19T07:20:17.513433+0000","last_unstale":"2024-09-19T07:22:12.911428+0000","last_undegraded":"2024-09-19T07:22:12.911428+0000","last_fullsized":"2024-09-19T07:22:12.911428+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:27.681161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1374,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.809812+0000","last_change":"2024-09-19T07:20:19.539873+0000","last_active":"2024-09-19T07:22:03.809812+0000","last_peered":"2024-09-19T07:22:03.809812+0000","last_clean":"2024-09-19T07:22:03.809812+0000","last_became_active":"2024-09-19T07:20:19.539581+0000","last_became_peered":"2024-09-19T07:20:19.539581+0000","last_unstale":"2024-09-19T07:22:03.809812+0000","last_undegraded":"2024-09-19T07:22:03.809812+0000","last_fullsized":"2024-09-19T07:22:03.809812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:31.164179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775476+0000","last_change":"2024-09-19T07:20:17.565864+0000","last_active":"2024-09-19T07:22:03.775476+0000","last_peered":"2024-09-19T07:22:03.775476+0000","last_clean":"2024-09-19T07:22:03.775476+0000","last_became_active":"2024-09-19T07:20:17.565459+0000","last_became_peered":"2024-09-19T07:20:17.565459+0000","last_unstale":"2024-09-19T07:22:03.775476+0000","last_undegraded":"2024-09-19T07:22:03.775476+0000","last_fullsized":"2024-09-19T07:22:03.775476+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:15.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814439+0000","last_change":"2024-09-19T07:20:37.800857+0000","last_active":"2024-09-19T07:22:03.814439+0000","last_peered":"2024-09-19T07:22:03.814439+0000","last_clean":"2024-09-19T07:22:03.814439+0000","last_became_active":"2024-09-19T07:20:37.800347+0000","last_became_peered":"2024-09-19T07:20:37.800347+0000","last_unstale":"2024-09-19T07:22:03.814439+0000","last_undegraded":"2024-09-19T07:22:03.814439+0000","last_fullsized":"2024-09-19T07:22:03.814439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:48.678208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:04.762836+0000","last_change":"2024-09-19T07:20:17.521439+0000","last_active":"2024-09-19T07:22:04.762836+0000","last_peered":"2024-09-19T07:22:04.762836+0000","last_clean":"2024-09-19T07:22:04.762836+0000","last_became_active":"2024-09-19T07:20:17.521021+0000","last_became_peered":"2024-09-19T07:20:17.521021+0000","last_unstale":"2024-09-19T07:22:04.762836+0000","last_undegraded":"2024-09-19T07:22:04.762836+0000","last_fullsized":"2024-09-19T07:22:04.762836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.322352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.802889+0000","last_change":"2024-09-19T07:20:19.531234+0000","last_active":"2024-09-19T07:22:03.802889+0000","last_peered":"2024-09-19T07:22:03.802889+0000","last_clean":"2024-09-19T07:22:03.802889+0000","last_became_active":"2024-09-19T07:20:19.530422+0000","last_became_peered":"2024-09-19T07:20:19.530422+0000","last_unstale":"2024-09-19T07:22:03.802889+0000","last_undegraded":"2024-09-19T07:22:03.802889+0000","last_fullsized":"2024-09-19T07:22:03.802889+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:57.325415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.762228+0000","last_change":"2024-09-19T07:20:17.522426+0000","last_active":"2024-09-19T07:22:03.762228+0000","last_peered":"2024-09-19T07:22:03.762228+0000","last_clean":"2024-09-19T07:22:03.762228+0000","last_became_active":"2024-09-19T07:20:17.522061+0000","last_became_peered":"2024-09-19T07:20:17.522061+0000","last_unstale":"2024-09-19T07:22:03.762228+0000","last_undegraded":"2024-09-19T07:22:03.762228+0000","last_fullsized":"2024-09-19T07:22:03.762228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:04.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805167+0000","last_change":"2024-09-19T07:20:19.543420+0000","last_active":"2024-09-19T07:22:03.805167+0000","last_peered":"2024-09-19T07:22:03.805167+0000","last_clean":"2024-09-19T07:22:03.805167+0000","last_became_active":"2024-09-19T07:20:19.542294+0000","last_became_peered":"2024-09-19T07:20:19.542294+0000","last_unstale":"2024-09-19T07:22:03.805167+0000","last_undegraded":"2024-09-19T07:22:03.805167+0000","last_fullsized":"2024-09-19T07:22:03.805167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:32.119366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'65","reported_seq":119,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:14.443512+0000","last_change":"2024-09-19T07:20:17.518402+0000","last_active":"2024-09-19T07:22:14.443512+0000","last_peered":"2024-09-19T07:22:14.443512+0000","last_clean":"2024-09-19T07:22:14.443512+0000","last_became_active":"2024-09-19T07:20:17.517524+0000","last_became_peered":"2024-09-19T07:20:17.517524+0000","last_unstale":"2024-09-19T07:22:14.443512+0000","last_undegraded":"2024-09-19T07:22:14.443512+0000","last_fullsized":"2024-09-19T07:22:14.443512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:49.843442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.809548+0000","last_change":"2024-09-19T07:20:19.540945+0000","last_active":"2024-09-19T07:22:03.809548+0000","last_peered":"2024-09-19T07:22:03.809548+0000","last_clean":"2024-09-19T07:22:03.809548+0000","last_became_active":"2024-09-19T07:20:19.540641+0000","last_became_peered":"2024-09-19T07:20:19.540641+0000","last_unstale":"2024-09-19T07:22:03.809548+0000","last_undegraded":"2024-09-19T07:22:03.809548+0000","last_fullsized":"2024-09-19T07:22:03.809548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.487418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.774962+0000","last_change":"2024-09-19T07:20:17.567010+0000","last_active":"2024-09-19T07:22:03.774962+0000","last_peered":"2024-09-19T07:22:03.774962+0000","last_clean":"2024-09-19T07:22:03.774962+0000","last_became_active":"2024-09-19T07:20:17.566560+0000","last_became_peered":"2024-09-19T07:20:17.566560+0000","last_unstale":"2024-09-19T07:22:03.774962+0000","last_undegraded":"2024-09-19T07:22:03.774962+0000","last_fullsized":"2024-09-19T07:22:03.774962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.349568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813860+0000","last_change":"2024-09-19T07:20:19.541808+0000","last_active":"2024-09-19T07:22:03.813860+0000","last_peered":"2024-09-19T07:22:03.813860+0000","last_clean":"2024-09-19T07:22:03.813860+0000","last_became_active":"2024-09-19T07:20:19.541510+0000","last_became_peered":"2024-09-19T07:20:19.541510+0000","last_unstale":"2024-09-19T07:22:03.813860+0000","last_undegraded":"2024-09-19T07:22:03.813860+0000","last_fullsized":"2024-09-19T07:22:03.813860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:04.156121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"81'148","reported_seq":388,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:05.912019+0000","last_change":"2024-09-19T07:19:11.632651+0000","last_active":"2024-09-19T07:22:05.912019+0000","last_peered":"2024-09-19T07:22:05.912019+0000","last_clean":"2024-09-19T07:22:05.912019+0000","last_became_active":"2024-09-19T07:19:11.632229+0000","last_became_peered":"2024-09-19T07:19:11.632229+0000","last_unstale":"2024-09-19T07:22:05.912019+0000","last_undegraded":"2024-09-19T07:22:05.912019+0000","last_fullsized":"2024-09-19T07:22:05.912019+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_clean_scrub_stamp":"2024-09-19T07:15:50.875302+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:32.716049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.763366+0000","last_change":"2024-09-19T07:20:17.512387+0000","last_active":"2024-09-19T07:22:03.763366+0000","last_peered":"2024-09-19T07:22:03.763366+0000","last_clean":"2024-09-19T07:22:03.763366+0000","last_became_active":"2024-09-19T07:20:17.511956+0000","last_became_peered":"2024-09-19T07:20:17.511956+0000","last_unstale":"2024-09-19T07:22:03.763366+0000","last_undegraded":"2024-09-19T07:22:03.763366+0000","last_fullsized":"2024-09-19T07:22:03.763366+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:13.098347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813504+0000","last_change":"2024-09-19T07:20:19.536280+0000","last_active":"2024-09-19T07:22:03.813504+0000","last_peered":"2024-09-19T07:22:03.813504+0000","last_clean":"2024-09-19T07:22:03.813504+0000","last_became_active":"2024-09-19T07:20:19.535809+0000","last_became_peered":"2024-09-19T07:20:19.535809+0000","last_unstale":"2024-09-19T07:22:03.813504+0000","last_undegraded":"2024-09-19T07:22:03.813504+0000","last_fullsized":"2024-09-19T07:22:03.813504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:07.645476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.765247+0000","last_change":"2024-09-19T07:20:37.800603+0000","last_active":"2024-09-19T07:22:03.765247+0000","last_peered":"2024-09-19T07:22:03.765247+0000","last_clean":"2024-09-19T07:22:03.765247+0000","last_became_active":"2024-09-19T07:20:37.794728+0000","last_became_peered":"2024-09-19T07:20:37.794728+0000","last_unstale":"2024-09-19T07:22:03.765247+0000","last_undegraded":"2024-09-19T07:22:03.765247+0000","last_fullsized":"2024-09-19T07:22:03.765247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:46.606645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808940+0000","last_change":"2024-09-19T07:20:19.540203+0000","last_active":"2024-09-19T07:22:03.808940+0000","last_peered":"2024-09-19T07:22:03.808940+0000","last_clean":"2024-09-19T07:22:03.808940+0000","last_became_active":"2024-09-19T07:20:19.539813+0000","last_became_peered":"2024-09-19T07:20:19.539813+0000","last_unstale":"2024-09-19T07:22:03.808940+0000","last_undegraded":"2024-09-19T07:22:03.808940+0000","last_fullsized":"2024-09-19T07:22:03.808940+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:52.164881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:12.910352+0000","last_change":"2024-09-19T07:20:17.565449+0000","last_active":"2024-09-19T07:22:12.910352+0000","last_peered":"2024-09-19T07:22:12.910352+0000","last_clean":"2024-09-19T07:22:12.910352+0000","last_became_active":"2024-09-19T07:20:17.565079+0000","last_became_peered":"2024-09-19T07:20:17.565079+0000","last_unstale":"2024-09-19T07:22:12.910352+0000","last_undegraded":"2024-09-19T07:22:12.910352+0000","last_fullsized":"2024-09-19T07:22:12.910352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:50.791388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808040+0000","last_change":"2024-09-19T07:20:19.533817+0000","last_active":"2024-09-19T07:22:03.808040+0000","last_peered":"2024-09-19T07:22:03.808040+0000","last_clean":"2024-09-19T07:22:03.808040+0000","last_became_active":"2024-09-19T07:20:19.532144+0000","last_became_peered":"2024-09-19T07:20:19.532144+0000","last_unstale":"2024-09-19T07:22:03.808040+0000","last_undegraded":"2024-09-19T07:22:03.808040+0000","last_fullsized":"2024-09-19T07:22:03.808040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:18.928739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.779225+0000","last_change":"2024-09-19T07:20:17.514063+0000","last_active":"2024-09-19T07:22:03.779225+0000","last_peered":"2024-09-19T07:22:03.779225+0000","last_clean":"2024-09-19T07:22:03.779225+0000","last_became_active":"2024-09-19T07:20:17.513633+0000","last_became_peered":"2024-09-19T07:20:17.513633+0000","last_unstale":"2024-09-19T07:22:03.779225+0000","last_undegraded":"2024-09-19T07:22:03.779225+0000","last_fullsized":"2024-09-19T07:22:03.779225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:24.113053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815734+0000","last_change":"2024-09-19T07:20:19.540209+0000","last_active":"2024-09-19T07:22:03.815734+0000","last_peered":"2024-09-19T07:22:03.815734+0000","last_clean":"2024-09-19T07:22:03.815734+0000","last_became_active":"2024-09-19T07:20:19.539855+0000","last_became_peered":"2024-09-19T07:20:19.539855+0000","last_unstale":"2024-09-19T07:22:03.815734+0000","last_undegraded":"2024-09-19T07:22:03.815734+0000","last_fullsized":"2024-09-19T07:22:03.815734+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:40.878905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776263+0000","last_change":"2024-09-19T07:20:17.565627+0000","last_active":"2024-09-19T07:22:03.776263+0000","last_peered":"2024-09-19T07:22:03.776263+0000","last_clean":"2024-09-19T07:22:03.776263+0000","last_became_active":"2024-09-19T07:20:17.565231+0000","last_became_peered":"2024-09-19T07:20:17.565231+0000","last_unstale":"2024-09-19T07:22:03.776263+0000","last_undegraded":"2024-09-19T07:22:03.776263+0000","last_fullsized":"2024-09-19T07:22:03.776263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:53.105336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817750+0000","last_change":"2024-09-19T07:20:19.532418+0000","last_active":"2024-09-19T07:22:03.817750+0000","last_peered":"2024-09-19T07:22:03.817750+0000","last_clean":"2024-09-19T07:22:03.817750+0000","last_became_active":"2024-09-19T07:20:19.532113+0000","last_became_peered":"2024-09-19T07:20:19.532113+0000","last_unstale":"2024-09-19T07:22:03.817750+0000","last_undegraded":"2024-09-19T07:22:03.817750+0000","last_fullsized":"2024-09-19T07:22:03.817750+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:24.953720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775943+0000","last_change":"2024-09-19T07:20:17.565984+0000","last_active":"2024-09-19T07:22:03.775943+0000","last_peered":"2024-09-19T07:22:03.775943+0000","last_clean":"2024-09-19T07:22:03.775943+0000","last_became_active":"2024-09-19T07:20:17.565240+0000","last_became_peered":"2024-09-19T07:20:17.565240+0000","last_unstale":"2024-09-19T07:22:03.775943+0000","last_undegraded":"2024-09-19T07:22:03.775943+0000","last_fullsized":"2024-09-19T07:22:03.775943+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:07.906716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807964+0000","last_change":"2024-09-19T07:20:19.534400+0000","last_active":"2024-09-19T07:22:03.807964+0000","last_peered":"2024-09-19T07:22:03.807964+0000","last_clean":"2024-09-19T07:22:03.807964+0000","last_became_active":"2024-09-19T07:20:19.534130+0000","last_became_peered":"2024-09-19T07:20:19.534130+0000","last_unstale":"2024-09-19T07:22:03.807964+0000","last_undegraded":"2024-09-19T07:22:03.807964+0000","last_fullsized":"2024-09-19T07:22:03.807964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:09.398112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'99","reported_seq":212,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:14.767588+0000","last_change":"2024-09-19T07:20:17.519628+0000","last_active":"2024-09-19T07:22:14.767588+0000","last_peered":"2024-09-19T07:22:14.767588+0000","last_clean":"2024-09-19T07:22:14.767588+0000","last_became_active":"2024-09-19T07:20:17.519276+0000","last_became_peered":"2024-09-19T07:20:17.519276+0000","last_unstale":"2024-09-19T07:22:14.767588+0000","last_undegraded":"2024-09-19T07:22:14.767588+0000","last_fullsized":"2024-09-19T07:22:14.767588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.193091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":182,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805204+0000","last_change":"2024-09-19T07:20:19.533425+0000","last_active":"2024-09-19T07:22:03.805204+0000","last_peered":"2024-09-19T07:22:03.805204+0000","last_clean":"2024-09-19T07:22:03.805204+0000","last_became_active":"2024-09-19T07:20:19.533142+0000","last_became_peered":"2024-09-19T07:20:19.533142+0000","last_unstale":"2024-09-19T07:22:03.805204+0000","last_undegraded":"2024-09-19T07:22:03.805204+0000","last_fullsized":"2024-09-19T07:22:03.805204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:07.048006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.763685+0000","last_change":"2024-09-19T07:20:17.512776+0000","last_active":"2024-09-19T07:22:03.763685+0000","last_peered":"2024-09-19T07:22:03.763685+0000","last_clean":"2024-09-19T07:22:03.763685+0000","last_became_active":"2024-09-19T07:20:17.511862+0000","last_became_peered":"2024-09-19T07:20:17.511862+0000","last_unstale":"2024-09-19T07:22:03.763685+0000","last_undegraded":"2024-09-19T07:22:03.763685+0000","last_fullsized":"2024-09-19T07:22:03.763685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:08.211654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817223+0000","last_change":"2024-09-19T07:20:19.539260+0000","last_active":"2024-09-19T07:22:03.817223+0000","last_peered":"2024-09-19T07:22:03.817223+0000","last_clean":"2024-09-19T07:22:03.817223+0000","last_became_active":"2024-09-19T07:20:19.538868+0000","last_became_peered":"2024-09-19T07:20:19.538868+0000","last_unstale":"2024-09-19T07:22:03.817223+0000","last_undegraded":"2024-09-19T07:22:03.817223+0000","last_fullsized":"2024-09-19T07:22:03.817223+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:44.198084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.772518+0000","last_change":"2024-09-19T07:20:17.565544+0000","last_active":"2024-09-19T07:22:03.772518+0000","last_peered":"2024-09-19T07:22:03.772518+0000","last_clean":"2024-09-19T07:22:03.772518+0000","last_became_active":"2024-09-19T07:20:17.565250+0000","last_became_peered":"2024-09-19T07:20:17.565250+0000","last_unstale":"2024-09-19T07:22:03.772518+0000","last_undegraded":"2024-09-19T07:22:03.772518+0000","last_fullsized":"2024-09-19T07:22:03.772518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:25.523136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.788564+0000","last_change":"2024-09-19T07:20:19.531467+0000","last_active":"2024-09-19T07:22:03.788564+0000","last_peered":"2024-09-19T07:22:03.788564+0000","last_clean":"2024-09-19T07:22:03.788564+0000","last_became_active":"2024-09-19T07:20:19.531170+0000","last_became_peered":"2024-09-19T07:20:19.531170+0000","last_unstale":"2024-09-19T07:22:03.788564+0000","last_undegraded":"2024-09-19T07:22:03.788564+0000","last_fullsized":"2024-09-19T07:22:03.788564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:23.113097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775823+0000","last_change":"2024-09-19T07:20:17.511400+0000","last_active":"2024-09-19T07:22:03.775823+0000","last_peered":"2024-09-19T07:22:03.775823+0000","last_clean":"2024-09-19T07:22:03.775823+0000","last_became_active":"2024-09-19T07:20:17.511126+0000","last_became_peered":"2024-09-19T07:20:17.511126+0000","last_unstale":"2024-09-19T07:22:03.775823+0000","last_undegraded":"2024-09-19T07:22:03.775823+0000","last_fullsized":"2024-09-19T07:22:03.775823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.485406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818052+0000","last_change":"2024-09-19T07:20:19.529171+0000","last_active":"2024-09-19T07:22:03.818052+0000","last_peered":"2024-09-19T07:22:03.818052+0000","last_clean":"2024-09-19T07:22:03.818052+0000","last_became_active":"2024-09-19T07:20:19.528489+0000","last_became_peered":"2024-09-19T07:20:19.528489+0000","last_unstale":"2024-09-19T07:22:03.818052+0000","last_undegraded":"2024-09-19T07:22:03.818052+0000","last_fullsized":"2024-09-19T07:22:03.818052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:10.842619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.765334+0000","last_change":"2024-09-19T07:20:37.803560+0000","last_active":"2024-09-19T07:22:03.765334+0000","last_peered":"2024-09-19T07:22:03.765334+0000","last_clean":"2024-09-19T07:22:03.765334+0000","last_became_active":"2024-09-19T07:20:37.797396+0000","last_became_peered":"2024-09-19T07:20:37.797396+0000","last_unstale":"2024-09-19T07:22:03.765334+0000","last_undegraded":"2024-09-19T07:22:03.765334+0000","last_fullsized":"2024-09-19T07:22:03.765334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:41.944179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818481+0000","last_change":"2024-09-19T07:20:19.532698+0000","last_active":"2024-09-19T07:22:03.818481+0000","last_peered":"2024-09-19T07:22:03.818481+0000","last_clean":"2024-09-19T07:22:03.818481+0000","last_became_active":"2024-09-19T07:20:19.531978+0000","last_became_peered":"2024-09-19T07:20:19.531978+0000","last_unstale":"2024-09-19T07:22:03.818481+0000","last_undegraded":"2024-09-19T07:22:03.818481+0000","last_fullsized":"2024-09-19T07:22:03.818481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:44.257024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775088+0000","last_change":"2024-09-19T07:20:17.525240+0000","last_active":"2024-09-19T07:22:03.775088+0000","last_peered":"2024-09-19T07:22:03.775088+0000","last_clean":"2024-09-19T07:22:03.775088+0000","last_became_active":"2024-09-19T07:20:17.524880+0000","last_became_peered":"2024-09-19T07:20:17.524880+0000","last_unstale":"2024-09-19T07:22:03.775088+0000","last_undegraded":"2024-09-19T07:22:03.775088+0000","last_fullsized":"2024-09-19T07:22:03.775088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:41.380246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815849+0000","last_change":"2024-09-19T07:20:19.537116+0000","last_active":"2024-09-19T07:22:03.815849+0000","last_peered":"2024-09-19T07:22:03.815849+0000","last_clean":"2024-09-19T07:22:03.815849+0000","last_became_active":"2024-09-19T07:20:19.536799+0000","last_became_peered":"2024-09-19T07:20:19.536799+0000","last_unstale":"2024-09-19T07:22:03.815849+0000","last_undegraded":"2024-09-19T07:22:03.815849+0000","last_fullsized":"2024-09-19T07:22:03.815849+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:48.401159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815875+0000","last_change":"2024-09-19T07:20:19.527965+0000","last_active":"2024-09-19T07:22:03.815875+0000","last_peered":"2024-09-19T07:22:03.815875+0000","last_clean":"2024-09-19T07:22:03.815875+0000","last_became_active":"2024-09-19T07:20:19.527522+0000","last_became_peered":"2024-09-19T07:20:19.527522+0000","last_unstale":"2024-09-19T07:22:03.815875+0000","last_undegraded":"2024-09-19T07:22:03.815875+0000","last_fullsized":"2024-09-19T07:22:03.815875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:16.034153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775281+0000","last_change":"2024-09-19T07:20:17.519400+0000","last_active":"2024-09-19T07:22:03.775281+0000","last_peered":"2024-09-19T07:22:03.775281+0000","last_clean":"2024-09-19T07:22:03.775281+0000","last_became_active":"2024-09-19T07:20:17.518993+0000","last_became_peered":"2024-09-19T07:20:17.518993+0000","last_unstale":"2024-09-19T07:22:03.775281+0000","last_undegraded":"2024-09-19T07:22:03.775281+0000","last_fullsized":"2024-09-19T07:22:03.775281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:37.086763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815623+0000","last_change":"2024-09-19T07:20:19.531016+0000","last_active":"2024-09-19T07:22:03.815623+0000","last_peered":"2024-09-19T07:22:03.815623+0000","last_clean":"2024-09-19T07:22:03.815623+0000","last_became_active":"2024-09-19T07:20:19.530706+0000","last_became_peered":"2024-09-19T07:20:19.530706+0000","last_unstale":"2024-09-19T07:22:03.815623+0000","last_undegraded":"2024-09-19T07:22:03.815623+0000","last_fullsized":"2024-09-19T07:22:03.815623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:36.566185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775906+0000","last_change":"2024-09-19T07:20:17.524215+0000","last_active":"2024-09-19T07:22:03.775906+0000","last_peered":"2024-09-19T07:22:03.775906+0000","last_clean":"2024-09-19T07:22:03.775906+0000","last_became_active":"2024-09-19T07:20:17.523813+0000","last_became_peered":"2024-09-19T07:20:17.523813+0000","last_unstale":"2024-09-19T07:22:03.775906+0000","last_undegraded":"2024-09-19T07:22:03.775906+0000","last_fullsized":"2024-09-19T07:22:03.775906+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:58.803225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.821404+0000","last_change":"2024-09-19T07:20:19.540994+0000","last_active":"2024-09-19T07:22:03.821404+0000","last_peered":"2024-09-19T07:22:03.821404+0000","last_clean":"2024-09-19T07:22:03.821404+0000","last_became_active":"2024-09-19T07:20:19.540703+0000","last_became_peered":"2024-09-19T07:20:19.540703+0000","last_unstale":"2024-09-19T07:22:03.821404+0000","last_undegraded":"2024-09-19T07:22:03.821404+0000","last_fullsized":"2024-09-19T07:22:03.821404+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:37.065187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775249+0000","last_change":"2024-09-19T07:20:17.565438+0000","last_active":"2024-09-19T07:22:03.775249+0000","last_peered":"2024-09-19T07:22:03.775249+0000","last_clean":"2024-09-19T07:22:03.775249+0000","last_became_active":"2024-09-19T07:20:17.565128+0000","last_became_peered":"2024-09-19T07:20:17.565128+0000","last_unstale":"2024-09-19T07:22:03.775249+0000","last_undegraded":"2024-09-19T07:22:03.775249+0000","last_fullsized":"2024-09-19T07:22:03.775249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:02.048971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810388+0000","last_change":"2024-09-19T07:20:37.794369+0000","last_active":"2024-09-19T07:22:03.810388+0000","last_peered":"2024-09-19T07:22:03.810388+0000","last_clean":"2024-09-19T07:22:03.810388+0000","last_became_active":"2024-09-19T07:20:37.794036+0000","last_became_peered":"2024-09-19T07:20:37.794036+0000","last_unstale":"2024-09-19T07:22:03.810388+0000","last_undegraded":"2024-09-19T07:22:03.810388+0000","last_fullsized":"2024-09-19T07:22:03.810388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:02.684191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.777114+0000","last_change":"2024-09-19T07:20:37.950846+0000","last_active":"2024-09-19T07:22:03.777114+0000","last_peered":"2024-09-19T07:22:03.777114+0000","last_clean":"2024-09-19T07:22:03.777114+0000","last_became_active":"2024-09-19T07:20:37.944266+0000","last_became_peered":"2024-09-19T07:20:37.944266+0000","last_unstale":"2024-09-19T07:22:03.777114+0000","last_undegraded":"2024-09-19T07:22:03.777114+0000","last_fullsized":"2024-09-19T07:22:03.777114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:12.952833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":796331,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":999,"num_read_kb":706,"num_write":417,"num_write_kb":2354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27529,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2388993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":437330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874280,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28912,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716240,"statfs":{"total":95995035648,"available":95965429760,"internally_reserved":0,"allocated":1933312,"data_stored":1427222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037804,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1306624,"data_stored":830782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28296,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716856,"statfs":{"total":95995035648,"available":95966060544,"internally_reserved":0,"allocated":1302528,"data_stored":830120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1507328,"data_stored":1030905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659195,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":436955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28952,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716200,"statfs":{"total":95995035648,"available":95965388800,"internally_reserved":0,"allocated":1851392,"data_stored":1358035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":508153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1642496,"data_stored":1158714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":439192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":970752,"data_stored":506141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":438226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":71405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":330802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":399989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:22:17.420 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:22:17.672 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:17.946 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:17 smithi098 ceph-mon[30950]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:18.045 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:17 smithi162 ceph-mon[35726]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:18.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:17 smithi139 ceph-mon[35039]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:18.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.127+0000 7f392e9c9640 1 -- 172.21.15.98:0/420278600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928101240 msgr2=0x7f3928101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:18.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.127+0000 7f392e9c9640 1 --2- 172.21.15.98:0/420278600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928101240 0x7f3928101680 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3910009900 tx=0x7f391002a410 comp rx=0 tx=0).stop 2024-09-19T07:22:18.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.127+0000 7f392e9c9640 1 -- 172.21.15.98:0/420278600 shutdown_connections 2024-09-19T07:22:18.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.127+0000 7f392e9c9640 1 --2- 172.21.15.98:0/420278600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3928101bc0 0x7f392810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.127+0000 7f392e9c9640 1 --2- 172.21.15.98:0/420278600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928101240 0x7f3928101680 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.127+0000 7f392e9c9640 1 --2- 172.21.15.98:0/420278600 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3928105a90 0x7f3928105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.127+0000 7f392e9c9640 1 -- 172.21.15.98:0/420278600 >> 172.21.15.98:0/420278600 conn(0x7f3928077210 msgr2=0x7f39280fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:18.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.127+0000 7f392e9c9640 1 -- 172.21.15.98:0/420278600 shutdown_connections 2024-09-19T07:22:18.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.127+0000 7f392e9c9640 1 -- 172.21.15.98:0/420278600 wait complete. 2024-09-19T07:22:18.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.128+0000 7f392e9c9640 1 Processor -- start 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.128+0000 7f392e9c9640 1 -- start start 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.128+0000 7f392e9c9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928101240 0x7f39281974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.128+0000 7f392e9c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3928101bc0 0x7f3928197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.128+0000 7f392e9c9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3928105a90 0x7f392819bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.128+0000 7f392e9c9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3928111030 con 0x7f3928101240 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.128+0000 7f392e9c9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3928110eb0 con 0x7f3928101bc0 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.128+0000 7f392e9c9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39281111b0 con 0x7f3928105a90 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.128+0000 7f3927fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928101240 0x7f39281974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.128+0000 7f3927fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928101240 0x7f39281974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60202/0 (socket says 172.21.15.98:60202) 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.128+0000 7f3927fff640 1 -- 172.21.15.98:0/877513946 learned_addr learned my addr 172.21.15.98:0/877513946 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f39277fe640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3928101bc0 0x7f3928197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f3927fff640 1 -- 172.21.15.98:0/877513946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3928105a90 msgr2=0x7f392819bdc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:22:18.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f3927fff640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3928105a90 0x7f392819bdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f3927fff640 1 -- 172.21.15.98:0/877513946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3928101bc0 msgr2=0x7f3928197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:18.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f3927fff640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3928101bc0 0x7f3928197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f3927fff640 1 -- 172.21.15.98:0/877513946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392819c4a0 con 0x7f3928101240 2024-09-19T07:22:18.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f39277fe640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3928101bc0 0x7f3928197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:18.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f3927fff640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928101240 0x7f39281974f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f391800b4a0 tx=0x7f391800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:18.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f39257fa640 1 -- 172.21.15.98:0/877513946 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918014070 con 0x7f3928101240 2024-09-19T07:22:18.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f39257fa640 1 -- 172.21.15.98:0/877513946 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3918010af0 con 0x7f3928101240 2024-09-19T07:22:18.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f39257fa640 1 -- 172.21.15.98:0/877513946 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918017d10 con 0x7f3928101240 2024-09-19T07:22:18.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f392e9c9640 1 -- 172.21.15.98:0/877513946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392819c790 con 0x7f3928101240 2024-09-19T07:22:18.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.129+0000 7f392e9c9640 1 -- 172.21.15.98:0/877513946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39281a4070 con 0x7f3928101240 2024-09-19T07:22:18.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.130+0000 7f392e9c9640 1 -- 172.21.15.98:0/877513946 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3928101680 con 0x7f3928101240 2024-09-19T07:22:18.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.132+0000 7f39257fa640 1 -- 172.21.15.98:0/877513946 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f3918017070 con 0x7f3928101240 2024-09-19T07:22:18.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.133+0000 7f39257fa640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f39140a3550 0x7f39140a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:18.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.133+0000 7f39277fe640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f39140a3550 0x7f39140a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:18.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.133+0000 7f39257fa640 1 -- 172.21.15.98:0/877513946 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f39180cf6a0 con 0x7f3928101240 2024-09-19T07:22:18.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.133+0000 7f39277fe640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f39140a3550 0x7f39140a5a10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3910000c00 tx=0x7f39100041e0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:18.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.136+0000 7f39257fa640 1 -- 172.21.15.98:0/877513946 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f391809bf10 con 0x7f3928101240 2024-09-19T07:22:18.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.298+0000 7f392e9c9640 1 -- 172.21.15.98:0/877513946 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39281041b0 con 0x7f39140a3550 2024-09-19T07:22:18.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.304+0000 7f39257fa640 1 -- 172.21.15.98:0/877513946 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257760 (secure 0 0 0) 0x7f39281041b0 con 0x7f39140a3550 2024-09-19T07:22:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:18.308 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-19T07:22:18.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.307+0000 7f392e9c9640 1 -- 172.21.15.98:0/877513946 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f39140a3550 msgr2=0x7f39140a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:18.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.307+0000 7f392e9c9640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f39140a3550 0x7f39140a5a10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3910000c00 tx=0x7f39100041e0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.307+0000 7f392e9c9640 1 -- 172.21.15.98:0/877513946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928101240 msgr2=0x7f39281974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:18.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.307+0000 7f392e9c9640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928101240 0x7f39281974f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f391800b4a0 tx=0x7f391800b960 comp rx=0 tx=0).stop 2024-09-19T07:22:18.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.307+0000 7f392e9c9640 1 -- 172.21.15.98:0/877513946 shutdown_connections 2024-09-19T07:22:18.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.307+0000 7f392e9c9640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f39140a3550 0x7f39140a5a10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.307+0000 7f392e9c9640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3928105a90 0x7f392819bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.307+0000 7f392e9c9640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3928101bc0 0x7f3928197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.307+0000 7f392e9c9640 1 --2- 172.21.15.98:0/877513946 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3928101240 0x7f39281974f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:18.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.307+0000 7f392e9c9640 1 -- 172.21.15.98:0/877513946 >> 172.21.15.98:0/877513946 conn(0x7f3928077210 msgr2=0x7f3928103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:18.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.307+0000 7f392e9c9640 1 -- 172.21.15.98:0/877513946 shutdown_connections 2024-09-19T07:22:18.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:18.307+0000 7f392e9c9640 1 -- 172.21.15.98:0/877513946 wait complete. 2024-09-19T07:22:18.944 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:18 smithi098 ceph-mon[30950]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2024-09-19T07:22:18.971 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-19T07:22:17.776564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1386933,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1236,"num_read_kb":1036,"num_write":620,"num_write_kb":5294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1208265,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":956,"ondisk_log_size":956,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355852,"kb_used_data":14784,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124585972,"statfs":{"total":1151940427776,"available":1151576035328,"internally_reserved":0,"allocated":15138816,"data_stored":9401775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":200331,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":411,"num_read_kb":471,"num_write":150,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002633"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816102+0000","last_change":"2024-09-19T07:20:19.535372+0000","last_active":"2024-09-19T07:22:03.816102+0000","last_peered":"2024-09-19T07:22:03.816102+0000","last_clean":"2024-09-19T07:22:03.816102+0000","last_became_active":"2024-09-19T07:20:19.535079+0000","last_became_peered":"2024-09-19T07:20:19.535079+0000","last_unstale":"2024-09-19T07:22:03.816102+0000","last_undegraded":"2024-09-19T07:22:03.816102+0000","last_fullsized":"2024-09-19T07:22:03.816102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:56.856451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815671+0000","last_change":"2024-09-19T07:20:19.528531+0000","last_active":"2024-09-19T07:22:03.815671+0000","last_peered":"2024-09-19T07:22:03.815671+0000","last_clean":"2024-09-19T07:22:03.815671+0000","last_became_active":"2024-09-19T07:20:19.528218+0000","last_became_peered":"2024-09-19T07:20:19.528218+0000","last_unstale":"2024-09-19T07:22:03.815671+0000","last_undegraded":"2024-09-19T07:22:03.815671+0000","last_fullsized":"2024-09-19T07:22:03.815671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:44.730220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818254+0000","last_change":"2024-09-19T07:20:19.533516+0000","last_active":"2024-09-19T07:22:03.818254+0000","last_peered":"2024-09-19T07:22:03.818254+0000","last_clean":"2024-09-19T07:22:03.818254+0000","last_became_active":"2024-09-19T07:20:19.533247+0000","last_became_peered":"2024-09-19T07:20:19.533247+0000","last_unstale":"2024-09-19T07:22:03.818254+0000","last_undegraded":"2024-09-19T07:22:03.818254+0000","last_fullsized":"2024-09-19T07:22:03.818254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:29.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810373+0000","last_change":"2024-09-19T07:20:19.543245+0000","last_active":"2024-09-19T07:22:03.810373+0000","last_peered":"2024-09-19T07:22:03.810373+0000","last_clean":"2024-09-19T07:22:03.810373+0000","last_became_active":"2024-09-19T07:20:19.542840+0000","last_became_peered":"2024-09-19T07:20:19.542840+0000","last_unstale":"2024-09-19T07:22:03.810373+0000","last_undegraded":"2024-09-19T07:22:03.810373+0000","last_fullsized":"2024-09-19T07:22:03.810373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:21.780027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.794220+0000","last_change":"2024-09-19T07:20:19.528880+0000","last_active":"2024-09-19T07:22:03.794220+0000","last_peered":"2024-09-19T07:22:03.794220+0000","last_clean":"2024-09-19T07:22:03.794220+0000","last_became_active":"2024-09-19T07:20:19.528592+0000","last_became_peered":"2024-09-19T07:20:19.528592+0000","last_unstale":"2024-09-19T07:22:03.794220+0000","last_undegraded":"2024-09-19T07:22:03.794220+0000","last_fullsized":"2024-09-19T07:22:03.794220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:59.718929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805549+0000","last_change":"2024-09-19T07:20:19.538480+0000","last_active":"2024-09-19T07:22:03.805549+0000","last_peered":"2024-09-19T07:22:03.805549+0000","last_clean":"2024-09-19T07:22:03.805549+0000","last_became_active":"2024-09-19T07:20:19.538189+0000","last_became_peered":"2024-09-19T07:20:19.538189+0000","last_unstale":"2024-09-19T07:22:03.805549+0000","last_undegraded":"2024-09-19T07:22:03.805549+0000","last_fullsized":"2024-09-19T07:22:03.805549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:29.607974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813603+0000","last_change":"2024-09-19T07:20:19.538877+0000","last_active":"2024-09-19T07:22:03.813603+0000","last_peered":"2024-09-19T07:22:03.813603+0000","last_clean":"2024-09-19T07:22:03.813603+0000","last_became_active":"2024-09-19T07:20:19.538551+0000","last_became_peered":"2024-09-19T07:20:19.538551+0000","last_unstale":"2024-09-19T07:22:03.813603+0000","last_undegraded":"2024-09-19T07:22:03.813603+0000","last_fullsized":"2024-09-19T07:22:03.813603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:52.114115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.819590+0000","last_change":"2024-09-19T07:20:19.538135+0000","last_active":"2024-09-19T07:22:03.819590+0000","last_peered":"2024-09-19T07:22:03.819590+0000","last_clean":"2024-09-19T07:22:03.819590+0000","last_became_active":"2024-09-19T07:20:19.537769+0000","last_became_peered":"2024-09-19T07:20:19.537769+0000","last_unstale":"2024-09-19T07:22:03.819590+0000","last_undegraded":"2024-09-19T07:22:03.819590+0000","last_fullsized":"2024-09-19T07:22:03.819590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:21.304262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814166+0000","last_change":"2024-09-19T07:20:19.531569+0000","last_active":"2024-09-19T07:22:03.814166+0000","last_peered":"2024-09-19T07:22:03.814166+0000","last_clean":"2024-09-19T07:22:03.814166+0000","last_became_active":"2024-09-19T07:20:19.529455+0000","last_became_peered":"2024-09-19T07:20:19.529455+0000","last_unstale":"2024-09-19T07:22:03.814166+0000","last_undegraded":"2024-09-19T07:22:03.814166+0000","last_fullsized":"2024-09-19T07:22:03.814166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:22.187968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807215+0000","last_change":"2024-09-19T07:20:19.540342+0000","last_active":"2024-09-19T07:22:03.807215+0000","last_peered":"2024-09-19T07:22:03.807215+0000","last_clean":"2024-09-19T07:22:03.807215+0000","last_became_active":"2024-09-19T07:20:19.539870+0000","last_became_peered":"2024-09-19T07:20:19.539870+0000","last_unstale":"2024-09-19T07:22:03.807215+0000","last_undegraded":"2024-09-19T07:22:03.807215+0000","last_fullsized":"2024-09-19T07:22:03.807215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:39.930671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803048+0000","last_change":"2024-09-19T07:20:19.536004+0000","last_active":"2024-09-19T07:22:03.803048+0000","last_peered":"2024-09-19T07:22:03.803048+0000","last_clean":"2024-09-19T07:22:03.803048+0000","last_became_active":"2024-09-19T07:20:19.535640+0000","last_became_peered":"2024-09-19T07:20:19.535640+0000","last_unstale":"2024-09-19T07:22:03.803048+0000","last_undegraded":"2024-09-19T07:22:03.803048+0000","last_fullsized":"2024-09-19T07:22:03.803048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:47.853411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.806987+0000","last_change":"2024-09-19T07:20:19.539374+0000","last_active":"2024-09-19T07:22:03.806987+0000","last_peered":"2024-09-19T07:22:03.806987+0000","last_clean":"2024-09-19T07:22:03.806987+0000","last_became_active":"2024-09-19T07:20:19.538880+0000","last_became_peered":"2024-09-19T07:20:19.538880+0000","last_unstale":"2024-09-19T07:22:03.806987+0000","last_undegraded":"2024-09-19T07:22:03.806987+0000","last_fullsized":"2024-09-19T07:22:03.806987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:55.484232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.806269+0000","last_change":"2024-09-19T07:20:37.792753+0000","last_active":"2024-09-19T07:22:03.806269+0000","last_peered":"2024-09-19T07:22:03.806269+0000","last_clean":"2024-09-19T07:22:03.806269+0000","last_became_active":"2024-09-19T07:20:37.792417+0000","last_became_peered":"2024-09-19T07:20:37.792417+0000","last_unstale":"2024-09-19T07:22:03.806269+0000","last_undegraded":"2024-09-19T07:22:03.806269+0000","last_fullsized":"2024-09-19T07:22:03.806269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:10.417367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816028+0000","last_change":"2024-09-19T07:20:19.528842+0000","last_active":"2024-09-19T07:22:03.816028+0000","last_peered":"2024-09-19T07:22:03.816028+0000","last_clean":"2024-09-19T07:22:03.816028+0000","last_became_active":"2024-09-19T07:20:19.528042+0000","last_became_peered":"2024-09-19T07:20:19.528042+0000","last_unstale":"2024-09-19T07:22:03.816028+0000","last_undegraded":"2024-09-19T07:22:03.816028+0000","last_fullsized":"2024-09-19T07:22:03.816028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:34.970509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817953+0000","last_change":"2024-09-19T07:20:19.535013+0000","last_active":"2024-09-19T07:22:03.817953+0000","last_peered":"2024-09-19T07:22:03.817953+0000","last_clean":"2024-09-19T07:22:03.817953+0000","last_became_active":"2024-09-19T07:20:19.534302+0000","last_became_peered":"2024-09-19T07:20:19.534302+0000","last_unstale":"2024-09-19T07:22:03.817953+0000","last_undegraded":"2024-09-19T07:22:03.817953+0000","last_fullsized":"2024-09-19T07:22:03.817953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:52.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812766+0000","last_change":"2024-09-19T07:20:19.534930+0000","last_active":"2024-09-19T07:22:03.812766+0000","last_peered":"2024-09-19T07:22:03.812766+0000","last_clean":"2024-09-19T07:22:03.812766+0000","last_became_active":"2024-09-19T07:20:19.534640+0000","last_became_peered":"2024-09-19T07:20:19.534640+0000","last_unstale":"2024-09-19T07:22:03.812766+0000","last_undegraded":"2024-09-19T07:22:03.812766+0000","last_fullsized":"2024-09-19T07:22:03.812766+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:23.055097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818341+0000","last_change":"2024-09-19T07:20:19.535856+0000","last_active":"2024-09-19T07:22:03.818341+0000","last_peered":"2024-09-19T07:22:03.818341+0000","last_clean":"2024-09-19T07:22:03.818341+0000","last_became_active":"2024-09-19T07:20:19.535561+0000","last_became_peered":"2024-09-19T07:20:19.535561+0000","last_unstale":"2024-09-19T07:22:03.818341+0000","last_undegraded":"2024-09-19T07:22:03.818341+0000","last_fullsized":"2024-09-19T07:22:03.818341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:03.943339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812865+0000","last_change":"2024-09-19T07:20:19.528429+0000","last_active":"2024-09-19T07:22:03.812865+0000","last_peered":"2024-09-19T07:22:03.812865+0000","last_clean":"2024-09-19T07:22:03.812865+0000","last_became_active":"2024-09-19T07:20:19.528107+0000","last_became_peered":"2024-09-19T07:20:19.528107+0000","last_unstale":"2024-09-19T07:22:03.812865+0000","last_undegraded":"2024-09-19T07:22:03.812865+0000","last_fullsized":"2024-09-19T07:22:03.812865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:49.520514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818269+0000","last_change":"2024-09-19T07:20:19.532966+0000","last_active":"2024-09-19T07:22:03.818269+0000","last_peered":"2024-09-19T07:22:03.818269+0000","last_clean":"2024-09-19T07:22:03.818269+0000","last_became_active":"2024-09-19T07:20:19.532412+0000","last_became_peered":"2024-09-19T07:20:19.532412+0000","last_unstale":"2024-09-19T07:22:03.818269+0000","last_undegraded":"2024-09-19T07:22:03.818269+0000","last_fullsized":"2024-09-19T07:22:03.818269+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:42.900136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.800966+0000","last_change":"2024-09-19T07:20:37.797952+0000","last_active":"2024-09-19T07:22:03.800966+0000","last_peered":"2024-09-19T07:22:03.800966+0000","last_clean":"2024-09-19T07:22:03.800966+0000","last_became_active":"2024-09-19T07:20:37.797459+0000","last_became_peered":"2024-09-19T07:20:37.797459+0000","last_unstale":"2024-09-19T07:22:03.800966+0000","last_undegraded":"2024-09-19T07:22:03.800966+0000","last_fullsized":"2024-09-19T07:22:03.800966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:44.132477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818884+0000","last_change":"2024-09-19T07:20:19.532193+0000","last_active":"2024-09-19T07:22:03.818884+0000","last_peered":"2024-09-19T07:22:03.818884+0000","last_clean":"2024-09-19T07:22:03.818884+0000","last_became_active":"2024-09-19T07:20:19.531890+0000","last_became_peered":"2024-09-19T07:20:19.531890+0000","last_unstale":"2024-09-19T07:22:03.818884+0000","last_undegraded":"2024-09-19T07:22:03.818884+0000","last_fullsized":"2024-09-19T07:22:03.818884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:21.168993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815073+0000","last_change":"2024-09-19T07:20:19.535034+0000","last_active":"2024-09-19T07:22:03.815073+0000","last_peered":"2024-09-19T07:22:03.815073+0000","last_clean":"2024-09-19T07:22:03.815073+0000","last_became_active":"2024-09-19T07:20:19.534732+0000","last_became_peered":"2024-09-19T07:20:19.534732+0000","last_unstale":"2024-09-19T07:22:03.815073+0000","last_undegraded":"2024-09-19T07:22:03.815073+0000","last_fullsized":"2024-09-19T07:22:03.815073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:13.726672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817072+0000","last_change":"2024-09-19T07:20:19.532644+0000","last_active":"2024-09-19T07:22:03.817072+0000","last_peered":"2024-09-19T07:22:03.817072+0000","last_clean":"2024-09-19T07:22:03.817072+0000","last_became_active":"2024-09-19T07:20:19.532364+0000","last_became_peered":"2024-09-19T07:20:19.532364+0000","last_unstale":"2024-09-19T07:22:03.817072+0000","last_undegraded":"2024-09-19T07:22:03.817072+0000","last_fullsized":"2024-09-19T07:22:03.817072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:17.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814164+0000","last_change":"2024-09-19T07:20:19.533500+0000","last_active":"2024-09-19T07:22:03.814164+0000","last_peered":"2024-09-19T07:22:03.814164+0000","last_clean":"2024-09-19T07:22:03.814164+0000","last_became_active":"2024-09-19T07:20:19.532759+0000","last_became_peered":"2024-09-19T07:20:19.532759+0000","last_unstale":"2024-09-19T07:22:03.814164+0000","last_undegraded":"2024-09-19T07:22:03.814164+0000","last_fullsized":"2024-09-19T07:22:03.814164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:35.549776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815771+0000","last_change":"2024-09-19T07:20:37.793776+0000","last_active":"2024-09-19T07:22:03.815771+0000","last_peered":"2024-09-19T07:22:03.815771+0000","last_clean":"2024-09-19T07:22:03.815771+0000","last_became_active":"2024-09-19T07:20:37.793382+0000","last_became_peered":"2024-09-19T07:20:37.793382+0000","last_unstale":"2024-09-19T07:22:03.815771+0000","last_undegraded":"2024-09-19T07:22:03.815771+0000","last_fullsized":"2024-09-19T07:22:03.815771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:00.422534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803532+0000","last_change":"2024-09-19T07:20:19.532840+0000","last_active":"2024-09-19T07:22:03.803532+0000","last_peered":"2024-09-19T07:22:03.803532+0000","last_clean":"2024-09-19T07:22:03.803532+0000","last_became_active":"2024-09-19T07:20:19.532059+0000","last_became_peered":"2024-09-19T07:20:19.532059+0000","last_unstale":"2024-09-19T07:22:03.803532+0000","last_undegraded":"2024-09-19T07:22:03.803532+0000","last_fullsized":"2024-09-19T07:22:03.803532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:49.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.802328+0000","last_change":"2024-09-19T07:20:19.528150+0000","last_active":"2024-09-19T07:22:03.802328+0000","last_peered":"2024-09-19T07:22:03.802328+0000","last_clean":"2024-09-19T07:22:03.802328+0000","last_became_active":"2024-09-19T07:20:19.527873+0000","last_became_peered":"2024-09-19T07:20:19.527873+0000","last_unstale":"2024-09-19T07:22:03.802328+0000","last_undegraded":"2024-09-19T07:22:03.802328+0000","last_fullsized":"2024-09-19T07:22:03.802328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.561937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808779+0000","last_change":"2024-09-19T07:20:19.540160+0000","last_active":"2024-09-19T07:22:03.808779+0000","last_peered":"2024-09-19T07:22:03.808779+0000","last_clean":"2024-09-19T07:22:03.808779+0000","last_became_active":"2024-09-19T07:20:19.539862+0000","last_became_peered":"2024-09-19T07:20:19.539862+0000","last_unstale":"2024-09-19T07:22:03.808779+0000","last_undegraded":"2024-09-19T07:22:03.808779+0000","last_fullsized":"2024-09-19T07:22:03.808779+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:22.229785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.820657+0000","last_change":"2024-09-19T07:20:19.540363+0000","last_active":"2024-09-19T07:22:03.820657+0000","last_peered":"2024-09-19T07:22:03.820657+0000","last_clean":"2024-09-19T07:22:03.820657+0000","last_became_active":"2024-09-19T07:20:19.540068+0000","last_became_peered":"2024-09-19T07:20:19.540068+0000","last_unstale":"2024-09-19T07:22:03.820657+0000","last_undegraded":"2024-09-19T07:22:03.820657+0000","last_fullsized":"2024-09-19T07:22:03.820657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:07.955849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818258+0000","last_change":"2024-09-19T07:20:19.533546+0000","last_active":"2024-09-19T07:22:03.818258+0000","last_peered":"2024-09-19T07:22:03.818258+0000","last_clean":"2024-09-19T07:22:03.818258+0000","last_became_active":"2024-09-19T07:20:19.533232+0000","last_became_peered":"2024-09-19T07:20:19.533232+0000","last_unstale":"2024-09-19T07:22:03.818258+0000","last_undegraded":"2024-09-19T07:22:03.818258+0000","last_fullsized":"2024-09-19T07:22:03.818258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:29.674866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807595+0000","last_change":"2024-09-19T07:20:19.542842+0000","last_active":"2024-09-19T07:22:03.807595+0000","last_peered":"2024-09-19T07:22:03.807595+0000","last_clean":"2024-09-19T07:22:03.807595+0000","last_became_active":"2024-09-19T07:20:19.542477+0000","last_became_peered":"2024-09-19T07:20:19.542477+0000","last_unstale":"2024-09-19T07:22:03.807595+0000","last_undegraded":"2024-09-19T07:22:03.807595+0000","last_fullsized":"2024-09-19T07:22:03.807595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:30.921099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803673+0000","last_change":"2024-09-19T07:20:19.530472+0000","last_active":"2024-09-19T07:22:03.803673+0000","last_peered":"2024-09-19T07:22:03.803673+0000","last_clean":"2024-09-19T07:22:03.803673+0000","last_became_active":"2024-09-19T07:20:19.529457+0000","last_became_peered":"2024-09-19T07:20:19.529457+0000","last_unstale":"2024-09-19T07:22:03.803673+0000","last_undegraded":"2024-09-19T07:22:03.803673+0000","last_fullsized":"2024-09-19T07:22:03.803673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:16.410723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803010+0000","last_change":"2024-09-19T07:20:37.801168+0000","last_active":"2024-09-19T07:22:03.803010+0000","last_peered":"2024-09-19T07:22:03.803010+0000","last_clean":"2024-09-19T07:22:03.803010+0000","last_became_active":"2024-09-19T07:20:37.800613+0000","last_became_peered":"2024-09-19T07:20:37.800613+0000","last_unstale":"2024-09-19T07:22:03.803010+0000","last_undegraded":"2024-09-19T07:22:03.803010+0000","last_fullsized":"2024-09-19T07:22:03.803010+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:27.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'8","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:12.911995+0000","last_change":"2024-09-19T07:20:17.524656+0000","last_active":"2024-09-19T07:22:12.911995+0000","last_peered":"2024-09-19T07:22:12.911995+0000","last_clean":"2024-09-19T07:22:12.911995+0000","last_became_active":"2024-09-19T07:20:17.524350+0000","last_became_peered":"2024-09-19T07:20:17.524350+0000","last_unstale":"2024-09-19T07:22:12.911995+0000","last_undegraded":"2024-09-19T07:22:12.911995+0000","last_fullsized":"2024-09-19T07:22:12.911995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:00.459283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1716,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810877+0000","last_change":"2024-09-19T07:20:19.536895+0000","last_active":"2024-09-19T07:22:03.810877+0000","last_peered":"2024-09-19T07:22:03.810877+0000","last_clean":"2024-09-19T07:22:03.810877+0000","last_became_active":"2024-09-19T07:20:19.536569+0000","last_became_peered":"2024-09-19T07:20:19.536569+0000","last_unstale":"2024-09-19T07:22:03.810877+0000","last_undegraded":"2024-09-19T07:22:03.810877+0000","last_fullsized":"2024-09-19T07:22:03.810877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:56.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.770907+0000","last_change":"2024-09-19T07:20:17.519800+0000","last_active":"2024-09-19T07:22:03.770907+0000","last_peered":"2024-09-19T07:22:03.770907+0000","last_clean":"2024-09-19T07:22:03.770907+0000","last_became_active":"2024-09-19T07:20:17.519384+0000","last_became_peered":"2024-09-19T07:20:17.519384+0000","last_unstale":"2024-09-19T07:22:03.770907+0000","last_undegraded":"2024-09-19T07:22:03.770907+0000","last_fullsized":"2024-09-19T07:22:03.770907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:17.346946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.761997+0000","last_change":"2024-09-19T07:20:17.511178+0000","last_active":"2024-09-19T07:22:03.761997+0000","last_peered":"2024-09-19T07:22:03.761997+0000","last_clean":"2024-09-19T07:22:03.761997+0000","last_became_active":"2024-09-19T07:20:17.510646+0000","last_became_peered":"2024-09-19T07:20:17.510646+0000","last_unstale":"2024-09-19T07:22:03.761997+0000","last_undegraded":"2024-09-19T07:22:03.761997+0000","last_fullsized":"2024-09-19T07:22:03.761997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:58.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.804119+0000","last_change":"2024-09-19T07:20:19.532979+0000","last_active":"2024-09-19T07:22:03.804119+0000","last_peered":"2024-09-19T07:22:03.804119+0000","last_clean":"2024-09-19T07:22:03.804119+0000","last_became_active":"2024-09-19T07:20:19.532396+0000","last_became_peered":"2024-09-19T07:20:19.532396+0000","last_unstale":"2024-09-19T07:22:03.804119+0000","last_undegraded":"2024-09-19T07:22:03.804119+0000","last_fullsized":"2024-09-19T07:22:03.804119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:24.313572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.781655+0000","last_change":"2024-09-19T07:20:17.519327+0000","last_active":"2024-09-19T07:22:03.781655+0000","last_peered":"2024-09-19T07:22:03.781655+0000","last_clean":"2024-09-19T07:22:03.781655+0000","last_became_active":"2024-09-19T07:20:17.518916+0000","last_became_peered":"2024-09-19T07:20:17.518916+0000","last_unstale":"2024-09-19T07:22:03.781655+0000","last_undegraded":"2024-09-19T07:22:03.781655+0000","last_fullsized":"2024-09-19T07:22:03.781655+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:52.672016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814641+0000","last_change":"2024-09-19T07:20:19.528642+0000","last_active":"2024-09-19T07:22:03.814641+0000","last_peered":"2024-09-19T07:22:03.814641+0000","last_clean":"2024-09-19T07:22:03.814641+0000","last_became_active":"2024-09-19T07:20:19.528302+0000","last_became_peered":"2024-09-19T07:20:19.528302+0000","last_unstale":"2024-09-19T07:22:03.814641+0000","last_undegraded":"2024-09-19T07:22:03.814641+0000","last_fullsized":"2024-09-19T07:22:03.814641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:22.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:12.911209+0000","last_change":"2024-09-19T07:20:17.519144+0000","last_active":"2024-09-19T07:22:12.911209+0000","last_peered":"2024-09-19T07:22:12.911209+0000","last_clean":"2024-09-19T07:22:12.911209+0000","last_became_active":"2024-09-19T07:20:17.518714+0000","last_became_peered":"2024-09-19T07:20:17.518714+0000","last_unstale":"2024-09-19T07:22:12.911209+0000","last_undegraded":"2024-09-19T07:22:12.911209+0000","last_fullsized":"2024-09-19T07:22:12.911209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:09.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808858+0000","last_change":"2024-09-19T07:20:19.532293+0000","last_active":"2024-09-19T07:22:03.808858+0000","last_peered":"2024-09-19T07:22:03.808858+0000","last_clean":"2024-09-19T07:22:03.808858+0000","last_became_active":"2024-09-19T07:20:19.531427+0000","last_became_peered":"2024-09-19T07:20:19.531427+0000","last_unstale":"2024-09-19T07:22:03.808858+0000","last_undegraded":"2024-09-19T07:22:03.808858+0000","last_fullsized":"2024-09-19T07:22:03.808858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:31.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776705+0000","last_change":"2024-09-19T07:20:17.521743+0000","last_active":"2024-09-19T07:22:03.776705+0000","last_peered":"2024-09-19T07:22:03.776705+0000","last_clean":"2024-09-19T07:22:03.776705+0000","last_became_active":"2024-09-19T07:20:17.521321+0000","last_became_peered":"2024-09-19T07:20:17.521321+0000","last_unstale":"2024-09-19T07:22:03.776705+0000","last_undegraded":"2024-09-19T07:22:03.776705+0000","last_fullsized":"2024-09-19T07:22:03.776705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:21.107210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.821636+0000","last_change":"2024-09-19T07:20:19.532879+0000","last_active":"2024-09-19T07:22:03.821636+0000","last_peered":"2024-09-19T07:22:03.821636+0000","last_clean":"2024-09-19T07:22:03.821636+0000","last_became_active":"2024-09-19T07:20:19.532490+0000","last_became_peered":"2024-09-19T07:20:19.532490+0000","last_unstale":"2024-09-19T07:22:03.821636+0000","last_undegraded":"2024-09-19T07:22:03.821636+0000","last_fullsized":"2024-09-19T07:22:03.821636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:06.534849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.782814+0000","last_change":"2024-09-19T07:20:17.565759+0000","last_active":"2024-09-19T07:22:03.782814+0000","last_peered":"2024-09-19T07:22:03.782814+0000","last_clean":"2024-09-19T07:22:03.782814+0000","last_became_active":"2024-09-19T07:20:17.565334+0000","last_became_peered":"2024-09-19T07:20:17.565334+0000","last_unstale":"2024-09-19T07:22:03.782814+0000","last_undegraded":"2024-09-19T07:22:03.782814+0000","last_fullsized":"2024-09-19T07:22:03.782814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.588515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812382+0000","last_change":"2024-09-19T07:20:19.537397+0000","last_active":"2024-09-19T07:22:03.812382+0000","last_peered":"2024-09-19T07:22:03.812382+0000","last_clean":"2024-09-19T07:22:03.812382+0000","last_became_active":"2024-09-19T07:20:19.537059+0000","last_became_peered":"2024-09-19T07:20:19.537059+0000","last_unstale":"2024-09-19T07:22:03.812382+0000","last_undegraded":"2024-09-19T07:22:03.812382+0000","last_fullsized":"2024-09-19T07:22:03.812382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:30.146934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'36","reported_seq":302,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:14.080697+0000","last_change":"2024-09-19T07:20:37.956721+0000","last_active":"2024-09-19T07:22:14.080697+0000","last_peered":"2024-09-19T07:22:14.080697+0000","last_clean":"2024-09-19T07:22:14.080697+0000","last_became_active":"2024-09-19T07:20:37.944159+0000","last_became_peered":"2024-09-19T07:20:37.944159+0000","last_unstale":"2024-09-19T07:22:14.080697+0000","last_undegraded":"2024-09-19T07:22:14.080697+0000","last_fullsized":"2024-09-19T07:22:14.080697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:52.944073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69393,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":173,"num_write":37,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.797438+0000","last_change":"2024-09-19T07:20:19.531533+0000","last_active":"2024-09-19T07:22:03.797438+0000","last_peered":"2024-09-19T07:22:03.797438+0000","last_clean":"2024-09-19T07:22:03.797438+0000","last_became_active":"2024-09-19T07:20:19.531228+0000","last_became_peered":"2024-09-19T07:20:19.531228+0000","last_unstale":"2024-09-19T07:22:03.797438+0000","last_undegraded":"2024-09-19T07:22:03.797438+0000","last_fullsized":"2024-09-19T07:22:03.797438+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:34.606957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775177+0000","last_change":"2024-09-19T07:20:17.522411+0000","last_active":"2024-09-19T07:22:03.775177+0000","last_peered":"2024-09-19T07:22:03.775177+0000","last_clean":"2024-09-19T07:22:03.775177+0000","last_became_active":"2024-09-19T07:20:17.522086+0000","last_became_peered":"2024-09-19T07:20:17.522086+0000","last_unstale":"2024-09-19T07:22:03.775177+0000","last_undegraded":"2024-09-19T07:22:03.775177+0000","last_fullsized":"2024-09-19T07:22:03.775177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.299624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814726+0000","last_change":"2024-09-19T07:20:19.532527+0000","last_active":"2024-09-19T07:22:03.814726+0000","last_peered":"2024-09-19T07:22:03.814726+0000","last_clean":"2024-09-19T07:22:03.814726+0000","last_became_active":"2024-09-19T07:20:19.532219+0000","last_became_peered":"2024-09-19T07:20:19.532219+0000","last_unstale":"2024-09-19T07:22:03.814726+0000","last_undegraded":"2024-09-19T07:22:03.814726+0000","last_fullsized":"2024-09-19T07:22:03.814726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:05.878229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.781583+0000","last_change":"2024-09-19T07:20:17.518014+0000","last_active":"2024-09-19T07:22:03.781583+0000","last_peered":"2024-09-19T07:22:03.781583+0000","last_clean":"2024-09-19T07:22:03.781583+0000","last_became_active":"2024-09-19T07:20:17.517077+0000","last_became_peered":"2024-09-19T07:20:17.517077+0000","last_unstale":"2024-09-19T07:22:03.781583+0000","last_undegraded":"2024-09-19T07:22:03.781583+0000","last_fullsized":"2024-09-19T07:22:03.781583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:45.893365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816520+0000","last_change":"2024-09-19T07:20:19.539347+0000","last_active":"2024-09-19T07:22:03.816520+0000","last_peered":"2024-09-19T07:22:03.816520+0000","last_clean":"2024-09-19T07:22:03.816520+0000","last_became_active":"2024-09-19T07:20:19.538884+0000","last_became_peered":"2024-09-19T07:20:19.538884+0000","last_unstale":"2024-09-19T07:22:03.816520+0000","last_undegraded":"2024-09-19T07:22:03.816520+0000","last_fullsized":"2024-09-19T07:22:03.816520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:23.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":138,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:12.911428+0000","last_change":"2024-09-19T07:20:17.513756+0000","last_active":"2024-09-19T07:22:12.911428+0000","last_peered":"2024-09-19T07:22:12.911428+0000","last_clean":"2024-09-19T07:22:12.911428+0000","last_became_active":"2024-09-19T07:20:17.513433+0000","last_became_peered":"2024-09-19T07:20:17.513433+0000","last_unstale":"2024-09-19T07:22:12.911428+0000","last_undegraded":"2024-09-19T07:22:12.911428+0000","last_fullsized":"2024-09-19T07:22:12.911428+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:27.681161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1374,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.809812+0000","last_change":"2024-09-19T07:20:19.539873+0000","last_active":"2024-09-19T07:22:03.809812+0000","last_peered":"2024-09-19T07:22:03.809812+0000","last_clean":"2024-09-19T07:22:03.809812+0000","last_became_active":"2024-09-19T07:20:19.539581+0000","last_became_peered":"2024-09-19T07:20:19.539581+0000","last_unstale":"2024-09-19T07:22:03.809812+0000","last_undegraded":"2024-09-19T07:22:03.809812+0000","last_fullsized":"2024-09-19T07:22:03.809812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:31.164179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775476+0000","last_change":"2024-09-19T07:20:17.565864+0000","last_active":"2024-09-19T07:22:03.775476+0000","last_peered":"2024-09-19T07:22:03.775476+0000","last_clean":"2024-09-19T07:22:03.775476+0000","last_became_active":"2024-09-19T07:20:17.565459+0000","last_became_peered":"2024-09-19T07:20:17.565459+0000","last_unstale":"2024-09-19T07:22:03.775476+0000","last_undegraded":"2024-09-19T07:22:03.775476+0000","last_fullsized":"2024-09-19T07:22:03.775476+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:15.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814439+0000","last_change":"2024-09-19T07:20:37.800857+0000","last_active":"2024-09-19T07:22:03.814439+0000","last_peered":"2024-09-19T07:22:03.814439+0000","last_clean":"2024-09-19T07:22:03.814439+0000","last_became_active":"2024-09-19T07:20:37.800347+0000","last_became_peered":"2024-09-19T07:20:37.800347+0000","last_unstale":"2024-09-19T07:22:03.814439+0000","last_undegraded":"2024-09-19T07:22:03.814439+0000","last_fullsized":"2024-09-19T07:22:03.814439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:48.678208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:04.762836+0000","last_change":"2024-09-19T07:20:17.521439+0000","last_active":"2024-09-19T07:22:04.762836+0000","last_peered":"2024-09-19T07:22:04.762836+0000","last_clean":"2024-09-19T07:22:04.762836+0000","last_became_active":"2024-09-19T07:20:17.521021+0000","last_became_peered":"2024-09-19T07:20:17.521021+0000","last_unstale":"2024-09-19T07:22:04.762836+0000","last_undegraded":"2024-09-19T07:22:04.762836+0000","last_fullsized":"2024-09-19T07:22:04.762836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.322352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.802889+0000","last_change":"2024-09-19T07:20:19.531234+0000","last_active":"2024-09-19T07:22:03.802889+0000","last_peered":"2024-09-19T07:22:03.802889+0000","last_clean":"2024-09-19T07:22:03.802889+0000","last_became_active":"2024-09-19T07:20:19.530422+0000","last_became_peered":"2024-09-19T07:20:19.530422+0000","last_unstale":"2024-09-19T07:22:03.802889+0000","last_undegraded":"2024-09-19T07:22:03.802889+0000","last_fullsized":"2024-09-19T07:22:03.802889+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:57.325415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.762228+0000","last_change":"2024-09-19T07:20:17.522426+0000","last_active":"2024-09-19T07:22:03.762228+0000","last_peered":"2024-09-19T07:22:03.762228+0000","last_clean":"2024-09-19T07:22:03.762228+0000","last_became_active":"2024-09-19T07:20:17.522061+0000","last_became_peered":"2024-09-19T07:20:17.522061+0000","last_unstale":"2024-09-19T07:22:03.762228+0000","last_undegraded":"2024-09-19T07:22:03.762228+0000","last_fullsized":"2024-09-19T07:22:03.762228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:04.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805167+0000","last_change":"2024-09-19T07:20:19.543420+0000","last_active":"2024-09-19T07:22:03.805167+0000","last_peered":"2024-09-19T07:22:03.805167+0000","last_clean":"2024-09-19T07:22:03.805167+0000","last_became_active":"2024-09-19T07:20:19.542294+0000","last_became_peered":"2024-09-19T07:20:19.542294+0000","last_unstale":"2024-09-19T07:22:03.805167+0000","last_undegraded":"2024-09-19T07:22:03.805167+0000","last_fullsized":"2024-09-19T07:22:03.805167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:32.119366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'65","reported_seq":119,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:14.443512+0000","last_change":"2024-09-19T07:20:17.518402+0000","last_active":"2024-09-19T07:22:14.443512+0000","last_peered":"2024-09-19T07:22:14.443512+0000","last_clean":"2024-09-19T07:22:14.443512+0000","last_became_active":"2024-09-19T07:20:17.517524+0000","last_became_peered":"2024-09-19T07:20:17.517524+0000","last_unstale":"2024-09-19T07:22:14.443512+0000","last_undegraded":"2024-09-19T07:22:14.443512+0000","last_fullsized":"2024-09-19T07:22:14.443512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:49.843442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.809548+0000","last_change":"2024-09-19T07:20:19.540945+0000","last_active":"2024-09-19T07:22:03.809548+0000","last_peered":"2024-09-19T07:22:03.809548+0000","last_clean":"2024-09-19T07:22:03.809548+0000","last_became_active":"2024-09-19T07:20:19.540641+0000","last_became_peered":"2024-09-19T07:20:19.540641+0000","last_unstale":"2024-09-19T07:22:03.809548+0000","last_undegraded":"2024-09-19T07:22:03.809548+0000","last_fullsized":"2024-09-19T07:22:03.809548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.487418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.774962+0000","last_change":"2024-09-19T07:20:17.567010+0000","last_active":"2024-09-19T07:22:03.774962+0000","last_peered":"2024-09-19T07:22:03.774962+0000","last_clean":"2024-09-19T07:22:03.774962+0000","last_became_active":"2024-09-19T07:20:17.566560+0000","last_became_peered":"2024-09-19T07:20:17.566560+0000","last_unstale":"2024-09-19T07:22:03.774962+0000","last_undegraded":"2024-09-19T07:22:03.774962+0000","last_fullsized":"2024-09-19T07:22:03.774962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.349568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813860+0000","last_change":"2024-09-19T07:20:19.541808+0000","last_active":"2024-09-19T07:22:03.813860+0000","last_peered":"2024-09-19T07:22:03.813860+0000","last_clean":"2024-09-19T07:22:03.813860+0000","last_became_active":"2024-09-19T07:20:19.541510+0000","last_became_peered":"2024-09-19T07:20:19.541510+0000","last_unstale":"2024-09-19T07:22:03.813860+0000","last_undegraded":"2024-09-19T07:22:03.813860+0000","last_fullsized":"2024-09-19T07:22:03.813860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:04.156121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"81'148","reported_seq":388,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:05.912019+0000","last_change":"2024-09-19T07:19:11.632651+0000","last_active":"2024-09-19T07:22:05.912019+0000","last_peered":"2024-09-19T07:22:05.912019+0000","last_clean":"2024-09-19T07:22:05.912019+0000","last_became_active":"2024-09-19T07:19:11.632229+0000","last_became_peered":"2024-09-19T07:19:11.632229+0000","last_unstale":"2024-09-19T07:22:05.912019+0000","last_undegraded":"2024-09-19T07:22:05.912019+0000","last_fullsized":"2024-09-19T07:22:05.912019+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_clean_scrub_stamp":"2024-09-19T07:15:50.875302+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:32.716049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.763366+0000","last_change":"2024-09-19T07:20:17.512387+0000","last_active":"2024-09-19T07:22:03.763366+0000","last_peered":"2024-09-19T07:22:03.763366+0000","last_clean":"2024-09-19T07:22:03.763366+0000","last_became_active":"2024-09-19T07:20:17.511956+0000","last_became_peered":"2024-09-19T07:20:17.511956+0000","last_unstale":"2024-09-19T07:22:03.763366+0000","last_undegraded":"2024-09-19T07:22:03.763366+0000","last_fullsized":"2024-09-19T07:22:03.763366+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:13.098347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813504+0000","last_change":"2024-09-19T07:20:19.536280+0000","last_active":"2024-09-19T07:22:03.813504+0000","last_peered":"2024-09-19T07:22:03.813504+0000","last_clean":"2024-09-19T07:22:03.813504+0000","last_became_active":"2024-09-19T07:20:19.535809+0000","last_became_peered":"2024-09-19T07:20:19.535809+0000","last_unstale":"2024-09-19T07:22:03.813504+0000","last_undegraded":"2024-09-19T07:22:03.813504+0000","last_fullsized":"2024-09-19T07:22:03.813504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:07.645476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.765247+0000","last_change":"2024-09-19T07:20:37.800603+0000","last_active":"2024-09-19T07:22:03.765247+0000","last_peered":"2024-09-19T07:22:03.765247+0000","last_clean":"2024-09-19T07:22:03.765247+0000","last_became_active":"2024-09-19T07:20:37.794728+0000","last_became_peered":"2024-09-19T07:20:37.794728+0000","last_unstale":"2024-09-19T07:22:03.765247+0000","last_undegraded":"2024-09-19T07:22:03.765247+0000","last_fullsized":"2024-09-19T07:22:03.765247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:46.606645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808940+0000","last_change":"2024-09-19T07:20:19.540203+0000","last_active":"2024-09-19T07:22:03.808940+0000","last_peered":"2024-09-19T07:22:03.808940+0000","last_clean":"2024-09-19T07:22:03.808940+0000","last_became_active":"2024-09-19T07:20:19.539813+0000","last_became_peered":"2024-09-19T07:20:19.539813+0000","last_unstale":"2024-09-19T07:22:03.808940+0000","last_undegraded":"2024-09-19T07:22:03.808940+0000","last_fullsized":"2024-09-19T07:22:03.808940+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:52.164881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":134,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:12.910352+0000","last_change":"2024-09-19T07:20:17.565449+0000","last_active":"2024-09-19T07:22:12.910352+0000","last_peered":"2024-09-19T07:22:12.910352+0000","last_clean":"2024-09-19T07:22:12.910352+0000","last_became_active":"2024-09-19T07:20:17.565079+0000","last_became_peered":"2024-09-19T07:20:17.565079+0000","last_unstale":"2024-09-19T07:22:12.910352+0000","last_undegraded":"2024-09-19T07:22:12.910352+0000","last_fullsized":"2024-09-19T07:22:12.910352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:50.791388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808040+0000","last_change":"2024-09-19T07:20:19.533817+0000","last_active":"2024-09-19T07:22:03.808040+0000","last_peered":"2024-09-19T07:22:03.808040+0000","last_clean":"2024-09-19T07:22:03.808040+0000","last_became_active":"2024-09-19T07:20:19.532144+0000","last_became_peered":"2024-09-19T07:20:19.532144+0000","last_unstale":"2024-09-19T07:22:03.808040+0000","last_undegraded":"2024-09-19T07:22:03.808040+0000","last_fullsized":"2024-09-19T07:22:03.808040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:18.928739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.779225+0000","last_change":"2024-09-19T07:20:17.514063+0000","last_active":"2024-09-19T07:22:03.779225+0000","last_peered":"2024-09-19T07:22:03.779225+0000","last_clean":"2024-09-19T07:22:03.779225+0000","last_became_active":"2024-09-19T07:20:17.513633+0000","last_became_peered":"2024-09-19T07:20:17.513633+0000","last_unstale":"2024-09-19T07:22:03.779225+0000","last_undegraded":"2024-09-19T07:22:03.779225+0000","last_fullsized":"2024-09-19T07:22:03.779225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:24.113053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815734+0000","last_change":"2024-09-19T07:20:19.540209+0000","last_active":"2024-09-19T07:22:03.815734+0000","last_peered":"2024-09-19T07:22:03.815734+0000","last_clean":"2024-09-19T07:22:03.815734+0000","last_became_active":"2024-09-19T07:20:19.539855+0000","last_became_peered":"2024-09-19T07:20:19.539855+0000","last_unstale":"2024-09-19T07:22:03.815734+0000","last_undegraded":"2024-09-19T07:22:03.815734+0000","last_fullsized":"2024-09-19T07:22:03.815734+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:40.878905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776263+0000","last_change":"2024-09-19T07:20:17.565627+0000","last_active":"2024-09-19T07:22:03.776263+0000","last_peered":"2024-09-19T07:22:03.776263+0000","last_clean":"2024-09-19T07:22:03.776263+0000","last_became_active":"2024-09-19T07:20:17.565231+0000","last_became_peered":"2024-09-19T07:20:17.565231+0000","last_unstale":"2024-09-19T07:22:03.776263+0000","last_undegraded":"2024-09-19T07:22:03.776263+0000","last_fullsized":"2024-09-19T07:22:03.776263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:53.105336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817750+0000","last_change":"2024-09-19T07:20:19.532418+0000","last_active":"2024-09-19T07:22:03.817750+0000","last_peered":"2024-09-19T07:22:03.817750+0000","last_clean":"2024-09-19T07:22:03.817750+0000","last_became_active":"2024-09-19T07:20:19.532113+0000","last_became_peered":"2024-09-19T07:20:19.532113+0000","last_unstale":"2024-09-19T07:22:03.817750+0000","last_undegraded":"2024-09-19T07:22:03.817750+0000","last_fullsized":"2024-09-19T07:22:03.817750+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:24.953720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775943+0000","last_change":"2024-09-19T07:20:17.565984+0000","last_active":"2024-09-19T07:22:03.775943+0000","last_peered":"2024-09-19T07:22:03.775943+0000","last_clean":"2024-09-19T07:22:03.775943+0000","last_became_active":"2024-09-19T07:20:17.565240+0000","last_became_peered":"2024-09-19T07:20:17.565240+0000","last_unstale":"2024-09-19T07:22:03.775943+0000","last_undegraded":"2024-09-19T07:22:03.775943+0000","last_fullsized":"2024-09-19T07:22:03.775943+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:07.906716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807964+0000","last_change":"2024-09-19T07:20:19.534400+0000","last_active":"2024-09-19T07:22:03.807964+0000","last_peered":"2024-09-19T07:22:03.807964+0000","last_clean":"2024-09-19T07:22:03.807964+0000","last_became_active":"2024-09-19T07:20:19.534130+0000","last_became_peered":"2024-09-19T07:20:19.534130+0000","last_unstale":"2024-09-19T07:22:03.807964+0000","last_undegraded":"2024-09-19T07:22:03.807964+0000","last_fullsized":"2024-09-19T07:22:03.807964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:09.398112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'99","reported_seq":212,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:14.767588+0000","last_change":"2024-09-19T07:20:17.519628+0000","last_active":"2024-09-19T07:22:14.767588+0000","last_peered":"2024-09-19T07:22:14.767588+0000","last_clean":"2024-09-19T07:22:14.767588+0000","last_became_active":"2024-09-19T07:20:17.519276+0000","last_became_peered":"2024-09-19T07:20:17.519276+0000","last_unstale":"2024-09-19T07:22:14.767588+0000","last_undegraded":"2024-09-19T07:22:14.767588+0000","last_fullsized":"2024-09-19T07:22:14.767588+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.193091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":182,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805204+0000","last_change":"2024-09-19T07:20:19.533425+0000","last_active":"2024-09-19T07:22:03.805204+0000","last_peered":"2024-09-19T07:22:03.805204+0000","last_clean":"2024-09-19T07:22:03.805204+0000","last_became_active":"2024-09-19T07:20:19.533142+0000","last_became_peered":"2024-09-19T07:20:19.533142+0000","last_unstale":"2024-09-19T07:22:03.805204+0000","last_undegraded":"2024-09-19T07:22:03.805204+0000","last_fullsized":"2024-09-19T07:22:03.805204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:07.048006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.763685+0000","last_change":"2024-09-19T07:20:17.512776+0000","last_active":"2024-09-19T07:22:03.763685+0000","last_peered":"2024-09-19T07:22:03.763685+0000","last_clean":"2024-09-19T07:22:03.763685+0000","last_became_active":"2024-09-19T07:20:17.511862+0000","last_became_peered":"2024-09-19T07:20:17.511862+0000","last_unstale":"2024-09-19T07:22:03.763685+0000","last_undegraded":"2024-09-19T07:22:03.763685+0000","last_fullsized":"2024-09-19T07:22:03.763685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:08.211654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817223+0000","last_change":"2024-09-19T07:20:19.539260+0000","last_active":"2024-09-19T07:22:03.817223+0000","last_peered":"2024-09-19T07:22:03.817223+0000","last_clean":"2024-09-19T07:22:03.817223+0000","last_became_active":"2024-09-19T07:20:19.538868+0000","last_became_peered":"2024-09-19T07:20:19.538868+0000","last_unstale":"2024-09-19T07:22:03.817223+0000","last_undegraded":"2024-09-19T07:22:03.817223+0000","last_fullsized":"2024-09-19T07:22:03.817223+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:44.198084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.772518+0000","last_change":"2024-09-19T07:20:17.565544+0000","last_active":"2024-09-19T07:22:03.772518+0000","last_peered":"2024-09-19T07:22:03.772518+0000","last_clean":"2024-09-19T07:22:03.772518+0000","last_became_active":"2024-09-19T07:20:17.565250+0000","last_became_peered":"2024-09-19T07:20:17.565250+0000","last_unstale":"2024-09-19T07:22:03.772518+0000","last_undegraded":"2024-09-19T07:22:03.772518+0000","last_fullsized":"2024-09-19T07:22:03.772518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:25.523136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.788564+0000","last_change":"2024-09-19T07:20:19.531467+0000","last_active":"2024-09-19T07:22:03.788564+0000","last_peered":"2024-09-19T07:22:03.788564+0000","last_clean":"2024-09-19T07:22:03.788564+0000","last_became_active":"2024-09-19T07:20:19.531170+0000","last_became_peered":"2024-09-19T07:20:19.531170+0000","last_unstale":"2024-09-19T07:22:03.788564+0000","last_undegraded":"2024-09-19T07:22:03.788564+0000","last_fullsized":"2024-09-19T07:22:03.788564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:23.113097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775823+0000","last_change":"2024-09-19T07:20:17.511400+0000","last_active":"2024-09-19T07:22:03.775823+0000","last_peered":"2024-09-19T07:22:03.775823+0000","last_clean":"2024-09-19T07:22:03.775823+0000","last_became_active":"2024-09-19T07:20:17.511126+0000","last_became_peered":"2024-09-19T07:20:17.511126+0000","last_unstale":"2024-09-19T07:22:03.775823+0000","last_undegraded":"2024-09-19T07:22:03.775823+0000","last_fullsized":"2024-09-19T07:22:03.775823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.485406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818052+0000","last_change":"2024-09-19T07:20:19.529171+0000","last_active":"2024-09-19T07:22:03.818052+0000","last_peered":"2024-09-19T07:22:03.818052+0000","last_clean":"2024-09-19T07:22:03.818052+0000","last_became_active":"2024-09-19T07:20:19.528489+0000","last_became_peered":"2024-09-19T07:20:19.528489+0000","last_unstale":"2024-09-19T07:22:03.818052+0000","last_undegraded":"2024-09-19T07:22:03.818052+0000","last_fullsized":"2024-09-19T07:22:03.818052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:10.842619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.765334+0000","last_change":"2024-09-19T07:20:37.803560+0000","last_active":"2024-09-19T07:22:03.765334+0000","last_peered":"2024-09-19T07:22:03.765334+0000","last_clean":"2024-09-19T07:22:03.765334+0000","last_became_active":"2024-09-19T07:20:37.797396+0000","last_became_peered":"2024-09-19T07:20:37.797396+0000","last_unstale":"2024-09-19T07:22:03.765334+0000","last_undegraded":"2024-09-19T07:22:03.765334+0000","last_fullsized":"2024-09-19T07:22:03.765334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:41.944179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818481+0000","last_change":"2024-09-19T07:20:19.532698+0000","last_active":"2024-09-19T07:22:03.818481+0000","last_peered":"2024-09-19T07:22:03.818481+0000","last_clean":"2024-09-19T07:22:03.818481+0000","last_became_active":"2024-09-19T07:20:19.531978+0000","last_became_peered":"2024-09-19T07:20:19.531978+0000","last_unstale":"2024-09-19T07:22:03.818481+0000","last_undegraded":"2024-09-19T07:22:03.818481+0000","last_fullsized":"2024-09-19T07:22:03.818481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:44.257024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775088+0000","last_change":"2024-09-19T07:20:17.525240+0000","last_active":"2024-09-19T07:22:03.775088+0000","last_peered":"2024-09-19T07:22:03.775088+0000","last_clean":"2024-09-19T07:22:03.775088+0000","last_became_active":"2024-09-19T07:20:17.524880+0000","last_became_peered":"2024-09-19T07:20:17.524880+0000","last_unstale":"2024-09-19T07:22:03.775088+0000","last_undegraded":"2024-09-19T07:22:03.775088+0000","last_fullsized":"2024-09-19T07:22:03.775088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:41.380246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815849+0000","last_change":"2024-09-19T07:20:19.537116+0000","last_active":"2024-09-19T07:22:03.815849+0000","last_peered":"2024-09-19T07:22:03.815849+0000","last_clean":"2024-09-19T07:22:03.815849+0000","last_became_active":"2024-09-19T07:20:19.536799+0000","last_became_peered":"2024-09-19T07:20:19.536799+0000","last_unstale":"2024-09-19T07:22:03.815849+0000","last_undegraded":"2024-09-19T07:22:03.815849+0000","last_fullsized":"2024-09-19T07:22:03.815849+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:48.401159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815875+0000","last_change":"2024-09-19T07:20:19.527965+0000","last_active":"2024-09-19T07:22:03.815875+0000","last_peered":"2024-09-19T07:22:03.815875+0000","last_clean":"2024-09-19T07:22:03.815875+0000","last_became_active":"2024-09-19T07:20:19.527522+0000","last_became_peered":"2024-09-19T07:20:19.527522+0000","last_unstale":"2024-09-19T07:22:03.815875+0000","last_undegraded":"2024-09-19T07:22:03.815875+0000","last_fullsized":"2024-09-19T07:22:03.815875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:16.034153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775281+0000","last_change":"2024-09-19T07:20:17.519400+0000","last_active":"2024-09-19T07:22:03.775281+0000","last_peered":"2024-09-19T07:22:03.775281+0000","last_clean":"2024-09-19T07:22:03.775281+0000","last_became_active":"2024-09-19T07:20:17.518993+0000","last_became_peered":"2024-09-19T07:20:17.518993+0000","last_unstale":"2024-09-19T07:22:03.775281+0000","last_undegraded":"2024-09-19T07:22:03.775281+0000","last_fullsized":"2024-09-19T07:22:03.775281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:37.086763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815623+0000","last_change":"2024-09-19T07:20:19.531016+0000","last_active":"2024-09-19T07:22:03.815623+0000","last_peered":"2024-09-19T07:22:03.815623+0000","last_clean":"2024-09-19T07:22:03.815623+0000","last_became_active":"2024-09-19T07:20:19.530706+0000","last_became_peered":"2024-09-19T07:20:19.530706+0000","last_unstale":"2024-09-19T07:22:03.815623+0000","last_undegraded":"2024-09-19T07:22:03.815623+0000","last_fullsized":"2024-09-19T07:22:03.815623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:36.566185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775906+0000","last_change":"2024-09-19T07:20:17.524215+0000","last_active":"2024-09-19T07:22:03.775906+0000","last_peered":"2024-09-19T07:22:03.775906+0000","last_clean":"2024-09-19T07:22:03.775906+0000","last_became_active":"2024-09-19T07:20:17.523813+0000","last_became_peered":"2024-09-19T07:20:17.523813+0000","last_unstale":"2024-09-19T07:22:03.775906+0000","last_undegraded":"2024-09-19T07:22:03.775906+0000","last_fullsized":"2024-09-19T07:22:03.775906+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:58.803225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.821404+0000","last_change":"2024-09-19T07:20:19.540994+0000","last_active":"2024-09-19T07:22:03.821404+0000","last_peered":"2024-09-19T07:22:03.821404+0000","last_clean":"2024-09-19T07:22:03.821404+0000","last_became_active":"2024-09-19T07:20:19.540703+0000","last_became_peered":"2024-09-19T07:20:19.540703+0000","last_unstale":"2024-09-19T07:22:03.821404+0000","last_undegraded":"2024-09-19T07:22:03.821404+0000","last_fullsized":"2024-09-19T07:22:03.821404+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:37.065187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775249+0000","last_change":"2024-09-19T07:20:17.565438+0000","last_active":"2024-09-19T07:22:03.775249+0000","last_peered":"2024-09-19T07:22:03.775249+0000","last_clean":"2024-09-19T07:22:03.775249+0000","last_became_active":"2024-09-19T07:20:17.565128+0000","last_became_peered":"2024-09-19T07:20:17.565128+0000","last_unstale":"2024-09-19T07:22:03.775249+0000","last_undegraded":"2024-09-19T07:22:03.775249+0000","last_fullsized":"2024-09-19T07:22:03.775249+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:02.048971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810388+0000","last_change":"2024-09-19T07:20:37.794369+0000","last_active":"2024-09-19T07:22:03.810388+0000","last_peered":"2024-09-19T07:22:03.810388+0000","last_clean":"2024-09-19T07:22:03.810388+0000","last_became_active":"2024-09-19T07:20:37.794036+0000","last_became_peered":"2024-09-19T07:20:37.794036+0000","last_unstale":"2024-09-19T07:22:03.810388+0000","last_undegraded":"2024-09-19T07:22:03.810388+0000","last_fullsized":"2024-09-19T07:22:03.810388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:02.684191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.777114+0000","last_change":"2024-09-19T07:20:37.950846+0000","last_active":"2024-09-19T07:22:03.777114+0000","last_peered":"2024-09-19T07:22:03.777114+0000","last_clean":"2024-09-19T07:22:03.777114+0000","last_became_active":"2024-09-19T07:20:37.944266+0000","last_became_peered":"2024-09-19T07:20:37.944266+0000","last_unstale":"2024-09-19T07:22:03.777114+0000","last_undegraded":"2024-09-19T07:22:03.777114+0000","last_fullsized":"2024-09-19T07:22:03.777114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:12.952833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":796331,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":999,"num_read_kb":706,"num_write":417,"num_write_kb":2354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27529,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2388993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":437330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874280,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28912,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716240,"statfs":{"total":95995035648,"available":95965429760,"internally_reserved":0,"allocated":1933312,"data_stored":1427222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037804,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1306624,"data_stored":830782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28296,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716856,"statfs":{"total":95995035648,"available":95966060544,"internally_reserved":0,"allocated":1302528,"data_stored":830120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1507328,"data_stored":1030905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659195,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":436955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28952,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716200,"statfs":{"total":95995035648,"available":95965388800,"internally_reserved":0,"allocated":1851392,"data_stored":1358035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":508153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1642496,"data_stored":1158714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":439192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607636,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":970752,"data_stored":506141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":438226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":71405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":330802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":399989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:22:18.976 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T07:22:18.976 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T07:22:19.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:18 smithi139 ceph-mon[35039]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2024-09-19T07:22:19.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:18 smithi162 ceph-mon[35726]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 46 op/s 2024-09-19T07:22:19.220 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:19.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.743+0000 7fecf0f29640 1 -- 172.21.15.98:0/2874491641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecec1082a0 msgr2=0x7fecec10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:19.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.743+0000 7fecf0f29640 1 --2- 172.21.15.98:0/2874491641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecec1082a0 0x7fecec10ec40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fece4009930 tx=0x7fece402a420 comp rx=0 tx=0).stop 2024-09-19T07:22:19.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.744+0000 7fecf0f29640 1 -- 172.21.15.98:0/2874491641 shutdown_connections 2024-09-19T07:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.744+0000 7fecf0f29640 1 --2- 172.21.15.98:0/2874491641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecec1082a0 0x7fecec10ec40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.744+0000 7fecf0f29640 1 --2- 172.21.15.98:0/2874491641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecec1036e0 0x7fecec107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.744+0000 7fecf0f29640 1 --2- 172.21.15.98:0/2874491641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecec102d30 0x7fecec103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.744+0000 7fecf0f29640 1 -- 172.21.15.98:0/2874491641 >> 172.21.15.98:0/2874491641 conn(0x7fecec0fc7d0 msgr2=0x7fecec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.744+0000 7fecf0f29640 1 -- 172.21.15.98:0/2874491641 shutdown_connections 2024-09-19T07:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.744+0000 7fecf0f29640 1 -- 172.21.15.98:0/2874491641 wait complete. 2024-09-19T07:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.744+0000 7fecf0f29640 1 Processor -- start 2024-09-19T07:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.744+0000 7fecf0f29640 1 -- start start 2024-09-19T07:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecf0f29640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecec102d30 0x7fecec100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecf0f29640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecec1036e0 0x7fecec100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:19.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecf0f29640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecec1082a0 0x7fecec101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecf0f29640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fecec1120a0 con 0x7fecec102d30 2024-09-19T07:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecf0f29640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fecec111f20 con 0x7fecec1082a0 2024-09-19T07:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecf0f29640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fecec112220 con 0x7fecec1036e0 2024-09-19T07:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecea59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecec102d30 0x7fecec100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecea59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecec102d30 0x7fecec100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60230/0 (socket says 172.21.15.98:60230) 2024-09-19T07:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecea59c640 1 -- 172.21.15.98:0/2744309776 learned_addr learned my addr 172.21.15.98:0/2744309776 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecead9d640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecec1082a0 0x7fecec101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecea59c640 1 -- 172.21.15.98:0/2744309776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecec1036e0 msgr2=0x7fecec100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecea59c640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecec1036e0 0x7fecec100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecea59c640 1 -- 172.21.15.98:0/2744309776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecec1082a0 msgr2=0x7fecec101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecea59c640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecec1082a0 0x7fecec101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:19.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecea59c640 1 -- 172.21.15.98:0/2744309776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecec1a6990 con 0x7fecec102d30 2024-09-19T07:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecead9d640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecec1082a0 0x7fecec101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecea59c640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecec102d30 0x7fecec100990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00cce0 tx=0x7fecdc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecdb7fe640 1 -- 172.21.15.98:0/2744309776 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00f650 con 0x7fecec102d30 2024-09-19T07:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecf0f29640 1 -- 172.21.15.98:0/2744309776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecec1a6c80 con 0x7fecec102d30 2024-09-19T07:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecdb7fe640 1 -- 172.21.15.98:0/2744309776 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecdc00fcd0 con 0x7fecec102d30 2024-09-19T07:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecdb7fe640 1 -- 172.21.15.98:0/2744309776 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc018c70 con 0x7fecec102d30 2024-09-19T07:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.745+0000 7fecf0f29640 1 -- 172.21.15.98:0/2744309776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecec1a71c0 con 0x7fecec102d30 2024-09-19T07:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.747+0000 7fecf0f29640 1 -- 172.21.15.98:0/2744309776 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecec103110 con 0x7fecec102d30 2024-09-19T07:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.748+0000 7fecdb7fe640 1 -- 172.21.15.98:0/2744309776 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fecdc00f7f0 con 0x7fecec102d30 2024-09-19T07:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.748+0000 7fecdb7fe640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fecd40a34d0 0x7fecd40a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.748+0000 7fece9d9b640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fecd40a34d0 0x7fecd40a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:19.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.748+0000 7fecdb7fe640 1 -- 172.21.15.98:0/2744309776 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fecdc0d0540 con 0x7fecec102d30 2024-09-19T07:22:19.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.749+0000 7fece9d9b640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fecd40a34d0 0x7fecd40a5990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fece0005d80 tx=0x7fece0005c90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:19.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.752+0000 7fecdb7fe640 1 -- 172.21.15.98:0/2744309776 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fecdc014030 con 0x7fecec102d30 2024-09-19T07:22:19.918 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.918+0000 7fecf0f29640 1 -- 172.21.15.98:0/2744309776 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fecec062630 con 0x7fecd40a34d0 2024-09-19T07:22:19.918 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:19 smithi098 ceph-mon[30950]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:19.924 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.924+0000 7fecdb7fe640 1 -- 172.21.15.98:0/2744309776 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257764 (secure 0 0 0) 0x7fecec062630 con 0x7fecd40a34d0 2024-09-19T07:22:19.927 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:19.928 INFO:teuthology.orchestra.run.smithi098.stderr:dumped all 2024-09-19T07:22:19.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.927+0000 7fecf0f29640 1 -- 172.21.15.98:0/2744309776 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fecd40a34d0 msgr2=0x7fecd40a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:19.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.927+0000 7fecf0f29640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fecd40a34d0 0x7fecd40a5990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fece0005d80 tx=0x7fece0005c90 comp rx=0 tx=0).stop 2024-09-19T07:22:19.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.927+0000 7fecf0f29640 1 -- 172.21.15.98:0/2744309776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecec102d30 msgr2=0x7fecec100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:19.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.927+0000 7fecf0f29640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecec102d30 0x7fecec100990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00cce0 tx=0x7fecdc00a620 comp rx=0 tx=0).stop 2024-09-19T07:22:19.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.927+0000 7fecf0f29640 1 -- 172.21.15.98:0/2744309776 shutdown_connections 2024-09-19T07:22:19.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.927+0000 7fecf0f29640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fecd40a34d0 0x7fecd40a5990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:19.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.927+0000 7fecf0f29640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fecec1082a0 0x7fecec101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:19.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.927+0000 7fecf0f29640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecec1036e0 0x7fecec100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:19.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.927+0000 7fecf0f29640 1 --2- 172.21.15.98:0/2744309776 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fecec102d30 0x7fecec100990 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:19.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.927+0000 7fecf0f29640 1 -- 172.21.15.98:0/2744309776 >> 172.21.15.98:0/2744309776 conn(0x7fecec0fc7d0 msgr2=0x7fecec106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:19.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.927+0000 7fecf0f29640 1 -- 172.21.15.98:0/2744309776 shutdown_connections 2024-09-19T07:22:19.931 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:19.927+0000 7fecf0f29640 1 -- 172.21.15.98:0/2744309776 wait complete. 2024-09-19T07:22:19.968 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:19 smithi139 ceph-mon[35039]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:20.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:19 smithi162 ceph-mon[35726]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:20.681 INFO:teuthology.orchestra.run.smithi098.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-19T07:22:19.776857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1386933,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1256,"num_read_kb":1050,"num_write":624,"num_write_kb":5294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1208265,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":958,"ondisk_log_size":958,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355972,"kb_used_data":14784,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124585852,"statfs":{"total":1151940427776,"available":1151575912448,"internally_reserved":0,"allocated":15138816,"data_stored":9401775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":348894521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":200331,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":431,"num_read_kb":485,"num_write":154,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002576"},"pg_stats":[{"pgid":"3.3f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816102+0000","last_change":"2024-09-19T07:20:19.535372+0000","last_active":"2024-09-19T07:22:03.816102+0000","last_peered":"2024-09-19T07:22:03.816102+0000","last_clean":"2024-09-19T07:22:03.816102+0000","last_became_active":"2024-09-19T07:20:19.535079+0000","last_became_peered":"2024-09-19T07:20:19.535079+0000","last_unstale":"2024-09-19T07:22:03.816102+0000","last_undegraded":"2024-09-19T07:22:03.816102+0000","last_fullsized":"2024-09-19T07:22:03.816102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:56.856451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815671+0000","last_change":"2024-09-19T07:20:19.528531+0000","last_active":"2024-09-19T07:22:03.815671+0000","last_peered":"2024-09-19T07:22:03.815671+0000","last_clean":"2024-09-19T07:22:03.815671+0000","last_became_active":"2024-09-19T07:20:19.528218+0000","last_became_peered":"2024-09-19T07:20:19.528218+0000","last_unstale":"2024-09-19T07:22:03.815671+0000","last_undegraded":"2024-09-19T07:22:03.815671+0000","last_fullsized":"2024-09-19T07:22:03.815671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:44.730220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818254+0000","last_change":"2024-09-19T07:20:19.533516+0000","last_active":"2024-09-19T07:22:03.818254+0000","last_peered":"2024-09-19T07:22:03.818254+0000","last_clean":"2024-09-19T07:22:03.818254+0000","last_became_active":"2024-09-19T07:20:19.533247+0000","last_became_peered":"2024-09-19T07:20:19.533247+0000","last_unstale":"2024-09-19T07:22:03.818254+0000","last_undegraded":"2024-09-19T07:22:03.818254+0000","last_fullsized":"2024-09-19T07:22:03.818254+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:29.650577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810373+0000","last_change":"2024-09-19T07:20:19.543245+0000","last_active":"2024-09-19T07:22:03.810373+0000","last_peered":"2024-09-19T07:22:03.810373+0000","last_clean":"2024-09-19T07:22:03.810373+0000","last_became_active":"2024-09-19T07:20:19.542840+0000","last_became_peered":"2024-09-19T07:20:19.542840+0000","last_unstale":"2024-09-19T07:22:03.810373+0000","last_undegraded":"2024-09-19T07:22:03.810373+0000","last_fullsized":"2024-09-19T07:22:03.810373+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:21.780027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.794220+0000","last_change":"2024-09-19T07:20:19.528880+0000","last_active":"2024-09-19T07:22:03.794220+0000","last_peered":"2024-09-19T07:22:03.794220+0000","last_clean":"2024-09-19T07:22:03.794220+0000","last_became_active":"2024-09-19T07:20:19.528592+0000","last_became_peered":"2024-09-19T07:20:19.528592+0000","last_unstale":"2024-09-19T07:22:03.794220+0000","last_undegraded":"2024-09-19T07:22:03.794220+0000","last_fullsized":"2024-09-19T07:22:03.794220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:20:59.718929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805549+0000","last_change":"2024-09-19T07:20:19.538480+0000","last_active":"2024-09-19T07:22:03.805549+0000","last_peered":"2024-09-19T07:22:03.805549+0000","last_clean":"2024-09-19T07:22:03.805549+0000","last_became_active":"2024-09-19T07:20:19.538189+0000","last_became_peered":"2024-09-19T07:20:19.538189+0000","last_unstale":"2024-09-19T07:22:03.805549+0000","last_undegraded":"2024-09-19T07:22:03.805549+0000","last_fullsized":"2024-09-19T07:22:03.805549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:29.607974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813603+0000","last_change":"2024-09-19T07:20:19.538877+0000","last_active":"2024-09-19T07:22:03.813603+0000","last_peered":"2024-09-19T07:22:03.813603+0000","last_clean":"2024-09-19T07:22:03.813603+0000","last_became_active":"2024-09-19T07:20:19.538551+0000","last_became_peered":"2024-09-19T07:20:19.538551+0000","last_unstale":"2024-09-19T07:22:03.813603+0000","last_undegraded":"2024-09-19T07:22:03.813603+0000","last_fullsized":"2024-09-19T07:22:03.813603+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:04:52.114115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.819590+0000","last_change":"2024-09-19T07:20:19.538135+0000","last_active":"2024-09-19T07:22:03.819590+0000","last_peered":"2024-09-19T07:22:03.819590+0000","last_clean":"2024-09-19T07:22:03.819590+0000","last_became_active":"2024-09-19T07:20:19.537769+0000","last_became_peered":"2024-09-19T07:20:19.537769+0000","last_unstale":"2024-09-19T07:22:03.819590+0000","last_undegraded":"2024-09-19T07:22:03.819590+0000","last_fullsized":"2024-09-19T07:22:03.819590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:21.304262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814166+0000","last_change":"2024-09-19T07:20:19.531569+0000","last_active":"2024-09-19T07:22:03.814166+0000","last_peered":"2024-09-19T07:22:03.814166+0000","last_clean":"2024-09-19T07:22:03.814166+0000","last_became_active":"2024-09-19T07:20:19.529455+0000","last_became_peered":"2024-09-19T07:20:19.529455+0000","last_unstale":"2024-09-19T07:22:03.814166+0000","last_undegraded":"2024-09-19T07:22:03.814166+0000","last_fullsized":"2024-09-19T07:22:03.814166+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:22.187968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"81'16","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807215+0000","last_change":"2024-09-19T07:20:19.540342+0000","last_active":"2024-09-19T07:22:03.807215+0000","last_peered":"2024-09-19T07:22:03.807215+0000","last_clean":"2024-09-19T07:22:03.807215+0000","last_became_active":"2024-09-19T07:20:19.539870+0000","last_became_peered":"2024-09-19T07:20:19.539870+0000","last_unstale":"2024-09-19T07:22:03.807215+0000","last_undegraded":"2024-09-19T07:22:03.807215+0000","last_fullsized":"2024-09-19T07:22:03.807215+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:39.930671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803048+0000","last_change":"2024-09-19T07:20:19.536004+0000","last_active":"2024-09-19T07:22:03.803048+0000","last_peered":"2024-09-19T07:22:03.803048+0000","last_clean":"2024-09-19T07:22:03.803048+0000","last_became_active":"2024-09-19T07:20:19.535640+0000","last_became_peered":"2024-09-19T07:20:19.535640+0000","last_unstale":"2024-09-19T07:22:03.803048+0000","last_undegraded":"2024-09-19T07:22:03.803048+0000","last_fullsized":"2024-09-19T07:22:03.803048+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:47.853411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.806987+0000","last_change":"2024-09-19T07:20:19.539374+0000","last_active":"2024-09-19T07:22:03.806987+0000","last_peered":"2024-09-19T07:22:03.806987+0000","last_clean":"2024-09-19T07:22:03.806987+0000","last_became_active":"2024-09-19T07:20:19.538880+0000","last_became_peered":"2024-09-19T07:20:19.538880+0000","last_unstale":"2024-09-19T07:22:03.806987+0000","last_undegraded":"2024-09-19T07:22:03.806987+0000","last_fullsized":"2024-09-19T07:22:03.806987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:55.484232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"81'10","reported_seq":35,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.806269+0000","last_change":"2024-09-19T07:20:37.792753+0000","last_active":"2024-09-19T07:22:03.806269+0000","last_peered":"2024-09-19T07:22:03.806269+0000","last_clean":"2024-09-19T07:22:03.806269+0000","last_became_active":"2024-09-19T07:20:37.792417+0000","last_became_peered":"2024-09-19T07:20:37.792417+0000","last_unstale":"2024-09-19T07:22:03.806269+0000","last_undegraded":"2024-09-19T07:22:03.806269+0000","last_fullsized":"2024-09-19T07:22:03.806269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:10.417367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816028+0000","last_change":"2024-09-19T07:20:19.528842+0000","last_active":"2024-09-19T07:22:03.816028+0000","last_peered":"2024-09-19T07:22:03.816028+0000","last_clean":"2024-09-19T07:22:03.816028+0000","last_became_active":"2024-09-19T07:20:19.528042+0000","last_became_peered":"2024-09-19T07:20:19.528042+0000","last_unstale":"2024-09-19T07:22:03.816028+0000","last_undegraded":"2024-09-19T07:22:03.816028+0000","last_fullsized":"2024-09-19T07:22:03.816028+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:34:34.970509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817953+0000","last_change":"2024-09-19T07:20:19.535013+0000","last_active":"2024-09-19T07:22:03.817953+0000","last_peered":"2024-09-19T07:22:03.817953+0000","last_clean":"2024-09-19T07:22:03.817953+0000","last_became_active":"2024-09-19T07:20:19.534302+0000","last_became_peered":"2024-09-19T07:20:19.534302+0000","last_unstale":"2024-09-19T07:22:03.817953+0000","last_undegraded":"2024-09-19T07:22:03.817953+0000","last_fullsized":"2024-09-19T07:22:03.817953+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:52.801362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812766+0000","last_change":"2024-09-19T07:20:19.534930+0000","last_active":"2024-09-19T07:22:03.812766+0000","last_peered":"2024-09-19T07:22:03.812766+0000","last_clean":"2024-09-19T07:22:03.812766+0000","last_became_active":"2024-09-19T07:20:19.534640+0000","last_became_peered":"2024-09-19T07:20:19.534640+0000","last_unstale":"2024-09-19T07:22:03.812766+0000","last_undegraded":"2024-09-19T07:22:03.812766+0000","last_fullsized":"2024-09-19T07:22:03.812766+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:23.055097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818341+0000","last_change":"2024-09-19T07:20:19.535856+0000","last_active":"2024-09-19T07:22:03.818341+0000","last_peered":"2024-09-19T07:22:03.818341+0000","last_clean":"2024-09-19T07:22:03.818341+0000","last_became_active":"2024-09-19T07:20:19.535561+0000","last_became_peered":"2024-09-19T07:20:19.535561+0000","last_unstale":"2024-09-19T07:22:03.818341+0000","last_undegraded":"2024-09-19T07:22:03.818341+0000","last_fullsized":"2024-09-19T07:22:03.818341+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:03.943339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812865+0000","last_change":"2024-09-19T07:20:19.528429+0000","last_active":"2024-09-19T07:22:03.812865+0000","last_peered":"2024-09-19T07:22:03.812865+0000","last_clean":"2024-09-19T07:22:03.812865+0000","last_became_active":"2024-09-19T07:20:19.528107+0000","last_became_peered":"2024-09-19T07:20:19.528107+0000","last_unstale":"2024-09-19T07:22:03.812865+0000","last_undegraded":"2024-09-19T07:22:03.812865+0000","last_fullsized":"2024-09-19T07:22:03.812865+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:49.520514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818269+0000","last_change":"2024-09-19T07:20:19.532966+0000","last_active":"2024-09-19T07:22:03.818269+0000","last_peered":"2024-09-19T07:22:03.818269+0000","last_clean":"2024-09-19T07:22:03.818269+0000","last_became_active":"2024-09-19T07:20:19.532412+0000","last_became_peered":"2024-09-19T07:20:19.532412+0000","last_unstale":"2024-09-19T07:22:03.818269+0000","last_undegraded":"2024-09-19T07:22:03.818269+0000","last_fullsized":"2024-09-19T07:22:03.818269+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:53:42.900136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"81'8","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.800966+0000","last_change":"2024-09-19T07:20:37.797952+0000","last_active":"2024-09-19T07:22:03.800966+0000","last_peered":"2024-09-19T07:22:03.800966+0000","last_clean":"2024-09-19T07:22:03.800966+0000","last_became_active":"2024-09-19T07:20:37.797459+0000","last_became_peered":"2024-09-19T07:20:37.797459+0000","last_unstale":"2024-09-19T07:22:03.800966+0000","last_undegraded":"2024-09-19T07:22:03.800966+0000","last_fullsized":"2024-09-19T07:22:03.800966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:19:44.132477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818884+0000","last_change":"2024-09-19T07:20:19.532193+0000","last_active":"2024-09-19T07:22:03.818884+0000","last_peered":"2024-09-19T07:22:03.818884+0000","last_clean":"2024-09-19T07:22:03.818884+0000","last_became_active":"2024-09-19T07:20:19.531890+0000","last_became_peered":"2024-09-19T07:20:19.531890+0000","last_unstale":"2024-09-19T07:22:03.818884+0000","last_undegraded":"2024-09-19T07:22:03.818884+0000","last_fullsized":"2024-09-19T07:22:03.818884+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:16:21.168993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815073+0000","last_change":"2024-09-19T07:20:19.535034+0000","last_active":"2024-09-19T07:22:03.815073+0000","last_peered":"2024-09-19T07:22:03.815073+0000","last_clean":"2024-09-19T07:22:03.815073+0000","last_became_active":"2024-09-19T07:20:19.534732+0000","last_became_peered":"2024-09-19T07:20:19.534732+0000","last_unstale":"2024-09-19T07:22:03.815073+0000","last_undegraded":"2024-09-19T07:22:03.815073+0000","last_fullsized":"2024-09-19T07:22:03.815073+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:13.726672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817072+0000","last_change":"2024-09-19T07:20:19.532644+0000","last_active":"2024-09-19T07:22:03.817072+0000","last_peered":"2024-09-19T07:22:03.817072+0000","last_clean":"2024-09-19T07:22:03.817072+0000","last_became_active":"2024-09-19T07:20:19.532364+0000","last_became_peered":"2024-09-19T07:20:19.532364+0000","last_unstale":"2024-09-19T07:22:03.817072+0000","last_undegraded":"2024-09-19T07:22:03.817072+0000","last_fullsized":"2024-09-19T07:22:03.817072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:09:17.118694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814164+0000","last_change":"2024-09-19T07:20:19.533500+0000","last_active":"2024-09-19T07:22:03.814164+0000","last_peered":"2024-09-19T07:22:03.814164+0000","last_clean":"2024-09-19T07:22:03.814164+0000","last_became_active":"2024-09-19T07:20:19.532759+0000","last_became_peered":"2024-09-19T07:20:19.532759+0000","last_unstale":"2024-09-19T07:22:03.814164+0000","last_undegraded":"2024-09-19T07:22:03.814164+0000","last_fullsized":"2024-09-19T07:22:03.814164+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:35.549776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"81'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815771+0000","last_change":"2024-09-19T07:20:37.793776+0000","last_active":"2024-09-19T07:22:03.815771+0000","last_peered":"2024-09-19T07:22:03.815771+0000","last_clean":"2024-09-19T07:22:03.815771+0000","last_became_active":"2024-09-19T07:20:37.793382+0000","last_became_peered":"2024-09-19T07:20:37.793382+0000","last_unstale":"2024-09-19T07:22:03.815771+0000","last_undegraded":"2024-09-19T07:22:03.815771+0000","last_fullsized":"2024-09-19T07:22:03.815771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:21:00.422534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803532+0000","last_change":"2024-09-19T07:20:19.532840+0000","last_active":"2024-09-19T07:22:03.803532+0000","last_peered":"2024-09-19T07:22:03.803532+0000","last_clean":"2024-09-19T07:22:03.803532+0000","last_became_active":"2024-09-19T07:20:19.532059+0000","last_became_peered":"2024-09-19T07:20:19.532059+0000","last_unstale":"2024-09-19T07:22:03.803532+0000","last_undegraded":"2024-09-19T07:22:03.803532+0000","last_fullsized":"2024-09-19T07:22:03.803532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:49.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.802328+0000","last_change":"2024-09-19T07:20:19.528150+0000","last_active":"2024-09-19T07:22:03.802328+0000","last_peered":"2024-09-19T07:22:03.802328+0000","last_clean":"2024-09-19T07:22:03.802328+0000","last_became_active":"2024-09-19T07:20:19.527873+0000","last_became_peered":"2024-09-19T07:20:19.527873+0000","last_unstale":"2024-09-19T07:22:03.802328+0000","last_undegraded":"2024-09-19T07:22:03.802328+0000","last_fullsized":"2024-09-19T07:22:03.802328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:11.561937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808779+0000","last_change":"2024-09-19T07:20:19.540160+0000","last_active":"2024-09-19T07:22:03.808779+0000","last_peered":"2024-09-19T07:22:03.808779+0000","last_clean":"2024-09-19T07:22:03.808779+0000","last_became_active":"2024-09-19T07:20:19.539862+0000","last_became_peered":"2024-09-19T07:20:19.539862+0000","last_unstale":"2024-09-19T07:22:03.808779+0000","last_undegraded":"2024-09-19T07:22:03.808779+0000","last_fullsized":"2024-09-19T07:22:03.808779+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:22.229785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.820657+0000","last_change":"2024-09-19T07:20:19.540363+0000","last_active":"2024-09-19T07:22:03.820657+0000","last_peered":"2024-09-19T07:22:03.820657+0000","last_clean":"2024-09-19T07:22:03.820657+0000","last_became_active":"2024-09-19T07:20:19.540068+0000","last_became_peered":"2024-09-19T07:20:19.540068+0000","last_unstale":"2024-09-19T07:22:03.820657+0000","last_undegraded":"2024-09-19T07:22:03.820657+0000","last_fullsized":"2024-09-19T07:22:03.820657+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:07.955849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818258+0000","last_change":"2024-09-19T07:20:19.533546+0000","last_active":"2024-09-19T07:22:03.818258+0000","last_peered":"2024-09-19T07:22:03.818258+0000","last_clean":"2024-09-19T07:22:03.818258+0000","last_became_active":"2024-09-19T07:20:19.533232+0000","last_became_peered":"2024-09-19T07:20:19.533232+0000","last_unstale":"2024-09-19T07:22:03.818258+0000","last_undegraded":"2024-09-19T07:22:03.818258+0000","last_fullsized":"2024-09-19T07:22:03.818258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:29.674866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807595+0000","last_change":"2024-09-19T07:20:19.542842+0000","last_active":"2024-09-19T07:22:03.807595+0000","last_peered":"2024-09-19T07:22:03.807595+0000","last_clean":"2024-09-19T07:22:03.807595+0000","last_became_active":"2024-09-19T07:20:19.542477+0000","last_became_peered":"2024-09-19T07:20:19.542477+0000","last_unstale":"2024-09-19T07:22:03.807595+0000","last_undegraded":"2024-09-19T07:22:03.807595+0000","last_fullsized":"2024-09-19T07:22:03.807595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:30.921099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803673+0000","last_change":"2024-09-19T07:20:19.530472+0000","last_active":"2024-09-19T07:22:03.803673+0000","last_peered":"2024-09-19T07:22:03.803673+0000","last_clean":"2024-09-19T07:22:03.803673+0000","last_became_active":"2024-09-19T07:20:19.529457+0000","last_became_peered":"2024-09-19T07:20:19.529457+0000","last_unstale":"2024-09-19T07:22:03.803673+0000","last_undegraded":"2024-09-19T07:22:03.803673+0000","last_fullsized":"2024-09-19T07:22:03.803673+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:16.410723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"81'7","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.803010+0000","last_change":"2024-09-19T07:20:37.801168+0000","last_active":"2024-09-19T07:22:03.803010+0000","last_peered":"2024-09-19T07:22:03.803010+0000","last_clean":"2024-09-19T07:22:03.803010+0000","last_became_active":"2024-09-19T07:20:37.800613+0000","last_became_peered":"2024-09-19T07:20:37.800613+0000","last_unstale":"2024-09-19T07:22:03.803010+0000","last_undegraded":"2024-09-19T07:22:03.803010+0000","last_fullsized":"2024-09-19T07:22:03.803010+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:27.892254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'8","reported_seq":142,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:12.911995+0000","last_change":"2024-09-19T07:20:17.524656+0000","last_active":"2024-09-19T07:22:12.911995+0000","last_peered":"2024-09-19T07:22:12.911995+0000","last_clean":"2024-09-19T07:22:12.911995+0000","last_became_active":"2024-09-19T07:20:17.524350+0000","last_became_peered":"2024-09-19T07:20:17.524350+0000","last_unstale":"2024-09-19T07:22:12.911995+0000","last_undegraded":"2024-09-19T07:22:12.911995+0000","last_fullsized":"2024-09-19T07:22:12.911995+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:00.459283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1716,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810877+0000","last_change":"2024-09-19T07:20:19.536895+0000","last_active":"2024-09-19T07:22:03.810877+0000","last_peered":"2024-09-19T07:22:03.810877+0000","last_clean":"2024-09-19T07:22:03.810877+0000","last_became_active":"2024-09-19T07:20:19.536569+0000","last_became_peered":"2024-09-19T07:20:19.536569+0000","last_unstale":"2024-09-19T07:22:03.810877+0000","last_undegraded":"2024-09-19T07:22:03.810877+0000","last_fullsized":"2024-09-19T07:22:03.810877+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:56.462407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.770907+0000","last_change":"2024-09-19T07:20:17.519800+0000","last_active":"2024-09-19T07:22:03.770907+0000","last_peered":"2024-09-19T07:22:03.770907+0000","last_clean":"2024-09-19T07:22:03.770907+0000","last_became_active":"2024-09-19T07:20:17.519384+0000","last_became_peered":"2024-09-19T07:20:17.519384+0000","last_unstale":"2024-09-19T07:22:03.770907+0000","last_undegraded":"2024-09-19T07:22:03.770907+0000","last_fullsized":"2024-09-19T07:22:03.770907+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:17.346946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.761997+0000","last_change":"2024-09-19T07:20:17.511178+0000","last_active":"2024-09-19T07:22:03.761997+0000","last_peered":"2024-09-19T07:22:03.761997+0000","last_clean":"2024-09-19T07:22:03.761997+0000","last_became_active":"2024-09-19T07:20:17.510646+0000","last_became_peered":"2024-09-19T07:20:17.510646+0000","last_unstale":"2024-09-19T07:22:03.761997+0000","last_undegraded":"2024-09-19T07:22:03.761997+0000","last_fullsized":"2024-09-19T07:22:03.761997+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:58.326536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.804119+0000","last_change":"2024-09-19T07:20:19.532979+0000","last_active":"2024-09-19T07:22:03.804119+0000","last_peered":"2024-09-19T07:22:03.804119+0000","last_clean":"2024-09-19T07:22:03.804119+0000","last_became_active":"2024-09-19T07:20:19.532396+0000","last_became_peered":"2024-09-19T07:20:19.532396+0000","last_unstale":"2024-09-19T07:22:03.804119+0000","last_undegraded":"2024-09-19T07:22:03.804119+0000","last_fullsized":"2024-09-19T07:22:03.804119+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:24.313572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.781655+0000","last_change":"2024-09-19T07:20:17.519327+0000","last_active":"2024-09-19T07:22:03.781655+0000","last_peered":"2024-09-19T07:22:03.781655+0000","last_clean":"2024-09-19T07:22:03.781655+0000","last_became_active":"2024-09-19T07:20:17.518916+0000","last_became_peered":"2024-09-19T07:20:17.518916+0000","last_unstale":"2024-09-19T07:22:03.781655+0000","last_undegraded":"2024-09-19T07:22:03.781655+0000","last_fullsized":"2024-09-19T07:22:03.781655+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:52.672016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814641+0000","last_change":"2024-09-19T07:20:19.528642+0000","last_active":"2024-09-19T07:22:03.814641+0000","last_peered":"2024-09-19T07:22:03.814641+0000","last_clean":"2024-09-19T07:22:03.814641+0000","last_became_active":"2024-09-19T07:20:19.528302+0000","last_became_peered":"2024-09-19T07:20:19.528302+0000","last_unstale":"2024-09-19T07:22:03.814641+0000","last_undegraded":"2024-09-19T07:22:03.814641+0000","last_fullsized":"2024-09-19T07:22:03.814641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:22.477001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":133,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:12.911209+0000","last_change":"2024-09-19T07:20:17.519144+0000","last_active":"2024-09-19T07:22:12.911209+0000","last_peered":"2024-09-19T07:22:12.911209+0000","last_clean":"2024-09-19T07:22:12.911209+0000","last_became_active":"2024-09-19T07:20:17.518714+0000","last_became_peered":"2024-09-19T07:20:17.518714+0000","last_unstale":"2024-09-19T07:22:12.911209+0000","last_undegraded":"2024-09-19T07:22:12.911209+0000","last_fullsized":"2024-09-19T07:22:12.911209+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:09.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"81'10","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808858+0000","last_change":"2024-09-19T07:20:19.532293+0000","last_active":"2024-09-19T07:22:03.808858+0000","last_peered":"2024-09-19T07:22:03.808858+0000","last_clean":"2024-09-19T07:22:03.808858+0000","last_became_active":"2024-09-19T07:20:19.531427+0000","last_became_peered":"2024-09-19T07:20:19.531427+0000","last_unstale":"2024-09-19T07:22:03.808858+0000","last_undegraded":"2024-09-19T07:22:03.808858+0000","last_fullsized":"2024-09-19T07:22:03.808858+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:31.800402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776705+0000","last_change":"2024-09-19T07:20:17.521743+0000","last_active":"2024-09-19T07:22:03.776705+0000","last_peered":"2024-09-19T07:22:03.776705+0000","last_clean":"2024-09-19T07:22:03.776705+0000","last_became_active":"2024-09-19T07:20:17.521321+0000","last_became_peered":"2024-09-19T07:20:17.521321+0000","last_unstale":"2024-09-19T07:22:03.776705+0000","last_undegraded":"2024-09-19T07:22:03.776705+0000","last_fullsized":"2024-09-19T07:22:03.776705+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:21.107210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.821636+0000","last_change":"2024-09-19T07:20:19.532879+0000","last_active":"2024-09-19T07:22:03.821636+0000","last_peered":"2024-09-19T07:22:03.821636+0000","last_clean":"2024-09-19T07:22:03.821636+0000","last_became_active":"2024-09-19T07:20:19.532490+0000","last_became_peered":"2024-09-19T07:20:19.532490+0000","last_unstale":"2024-09-19T07:22:03.821636+0000","last_undegraded":"2024-09-19T07:22:03.821636+0000","last_fullsized":"2024-09-19T07:22:03.821636+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:06.534849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.782814+0000","last_change":"2024-09-19T07:20:17.565759+0000","last_active":"2024-09-19T07:22:03.782814+0000","last_peered":"2024-09-19T07:22:03.782814+0000","last_clean":"2024-09-19T07:22:03.782814+0000","last_became_active":"2024-09-19T07:20:17.565334+0000","last_became_peered":"2024-09-19T07:20:17.565334+0000","last_unstale":"2024-09-19T07:22:03.782814+0000","last_undegraded":"2024-09-19T07:22:03.782814+0000","last_fullsized":"2024-09-19T07:22:03.782814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.588515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"81'11","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.812382+0000","last_change":"2024-09-19T07:20:19.537397+0000","last_active":"2024-09-19T07:22:03.812382+0000","last_peered":"2024-09-19T07:22:03.812382+0000","last_clean":"2024-09-19T07:22:03.812382+0000","last_became_active":"2024-09-19T07:20:19.537059+0000","last_became_peered":"2024-09-19T07:20:19.537059+0000","last_unstale":"2024-09-19T07:22:03.812382+0000","last_undegraded":"2024-09-19T07:22:03.812382+0000","last_fullsized":"2024-09-19T07:22:03.812382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:30.146934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'36","reported_seq":302,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:14.080697+0000","last_change":"2024-09-19T07:20:37.956721+0000","last_active":"2024-09-19T07:22:14.080697+0000","last_peered":"2024-09-19T07:22:14.080697+0000","last_clean":"2024-09-19T07:22:14.080697+0000","last_became_active":"2024-09-19T07:20:37.944159+0000","last_became_peered":"2024-09-19T07:20:37.944159+0000","last_unstale":"2024-09-19T07:22:14.080697+0000","last_undegraded":"2024-09-19T07:22:14.080697+0000","last_fullsized":"2024-09-19T07:22:14.080697+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:52.944073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69393,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":221,"num_read_kb":173,"num_write":37,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":26947,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.797438+0000","last_change":"2024-09-19T07:20:19.531533+0000","last_active":"2024-09-19T07:22:03.797438+0000","last_peered":"2024-09-19T07:22:03.797438+0000","last_clean":"2024-09-19T07:22:03.797438+0000","last_became_active":"2024-09-19T07:20:19.531228+0000","last_became_peered":"2024-09-19T07:20:19.531228+0000","last_unstale":"2024-09-19T07:22:03.797438+0000","last_undegraded":"2024-09-19T07:22:03.797438+0000","last_fullsized":"2024-09-19T07:22:03.797438+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:34.606957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"78'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775177+0000","last_change":"2024-09-19T07:20:17.522411+0000","last_active":"2024-09-19T07:22:03.775177+0000","last_peered":"2024-09-19T07:22:03.775177+0000","last_clean":"2024-09-19T07:22:03.775177+0000","last_became_active":"2024-09-19T07:20:17.522086+0000","last_became_peered":"2024-09-19T07:20:17.522086+0000","last_unstale":"2024-09-19T07:22:03.775177+0000","last_undegraded":"2024-09-19T07:22:03.775177+0000","last_fullsized":"2024-09-19T07:22:03.775177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:09.299624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814726+0000","last_change":"2024-09-19T07:20:19.532527+0000","last_active":"2024-09-19T07:22:03.814726+0000","last_peered":"2024-09-19T07:22:03.814726+0000","last_clean":"2024-09-19T07:22:03.814726+0000","last_became_active":"2024-09-19T07:20:19.532219+0000","last_became_peered":"2024-09-19T07:20:19.532219+0000","last_unstale":"2024-09-19T07:22:03.814726+0000","last_undegraded":"2024-09-19T07:22:03.814726+0000","last_fullsized":"2024-09-19T07:22:03.814726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:05.878229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.781583+0000","last_change":"2024-09-19T07:20:17.518014+0000","last_active":"2024-09-19T07:22:03.781583+0000","last_peered":"2024-09-19T07:22:03.781583+0000","last_clean":"2024-09-19T07:22:03.781583+0000","last_became_active":"2024-09-19T07:20:17.517077+0000","last_became_peered":"2024-09-19T07:20:17.517077+0000","last_unstale":"2024-09-19T07:22:03.781583+0000","last_undegraded":"2024-09-19T07:22:03.781583+0000","last_fullsized":"2024-09-19T07:22:03.781583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:45.893365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.816520+0000","last_change":"2024-09-19T07:20:19.539347+0000","last_active":"2024-09-19T07:22:03.816520+0000","last_peered":"2024-09-19T07:22:03.816520+0000","last_clean":"2024-09-19T07:22:03.816520+0000","last_became_active":"2024-09-19T07:20:19.538884+0000","last_became_peered":"2024-09-19T07:20:19.538884+0000","last_unstale":"2024-09-19T07:22:03.816520+0000","last_undegraded":"2024-09-19T07:22:03.816520+0000","last_fullsized":"2024-09-19T07:22:03.816520+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:23.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:17.919185+0000","last_change":"2024-09-19T07:20:17.513756+0000","last_active":"2024-09-19T07:22:17.919185+0000","last_peered":"2024-09-19T07:22:17.919185+0000","last_clean":"2024-09-19T07:22:17.919185+0000","last_became_active":"2024-09-19T07:20:17.513433+0000","last_became_peered":"2024-09-19T07:20:17.513433+0000","last_unstale":"2024-09-19T07:22:17.919185+0000","last_undegraded":"2024-09-19T07:22:17.919185+0000","last_fullsized":"2024-09-19T07:22:17.919185+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:27.681161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1374,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.809812+0000","last_change":"2024-09-19T07:20:19.539873+0000","last_active":"2024-09-19T07:22:03.809812+0000","last_peered":"2024-09-19T07:22:03.809812+0000","last_clean":"2024-09-19T07:22:03.809812+0000","last_became_active":"2024-09-19T07:20:19.539581+0000","last_became_peered":"2024-09-19T07:20:19.539581+0000","last_unstale":"2024-09-19T07:22:03.809812+0000","last_undegraded":"2024-09-19T07:22:03.809812+0000","last_fullsized":"2024-09-19T07:22:03.809812+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:31.164179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"78'15","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775476+0000","last_change":"2024-09-19T07:20:17.565864+0000","last_active":"2024-09-19T07:22:03.775476+0000","last_peered":"2024-09-19T07:22:03.775476+0000","last_clean":"2024-09-19T07:22:03.775476+0000","last_became_active":"2024-09-19T07:20:17.565459+0000","last_became_peered":"2024-09-19T07:20:17.565459+0000","last_unstale":"2024-09-19T07:22:03.775476+0000","last_undegraded":"2024-09-19T07:22:03.775476+0000","last_fullsized":"2024-09-19T07:22:03.775476+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:15.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"81'6","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.814439+0000","last_change":"2024-09-19T07:20:37.800857+0000","last_active":"2024-09-19T07:22:03.814439+0000","last_peered":"2024-09-19T07:22:03.814439+0000","last_clean":"2024-09-19T07:22:03.814439+0000","last_became_active":"2024-09-19T07:20:37.800347+0000","last_became_peered":"2024-09-19T07:20:37.800347+0000","last_unstale":"2024-09-19T07:22:03.814439+0000","last_undegraded":"2024-09-19T07:22:03.814439+0000","last_fullsized":"2024-09-19T07:22:03.814439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:48.678208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:04.762836+0000","last_change":"2024-09-19T07:20:17.521439+0000","last_active":"2024-09-19T07:22:04.762836+0000","last_peered":"2024-09-19T07:22:04.762836+0000","last_clean":"2024-09-19T07:22:04.762836+0000","last_became_active":"2024-09-19T07:20:17.521021+0000","last_became_peered":"2024-09-19T07:20:17.521021+0000","last_unstale":"2024-09-19T07:22:04.762836+0000","last_undegraded":"2024-09-19T07:22:04.762836+0000","last_fullsized":"2024-09-19T07:22:04.762836+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.322352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.802889+0000","last_change":"2024-09-19T07:20:19.531234+0000","last_active":"2024-09-19T07:22:03.802889+0000","last_peered":"2024-09-19T07:22:03.802889+0000","last_clean":"2024-09-19T07:22:03.802889+0000","last_became_active":"2024-09-19T07:20:19.530422+0000","last_became_peered":"2024-09-19T07:20:19.530422+0000","last_unstale":"2024-09-19T07:22:03.802889+0000","last_undegraded":"2024-09-19T07:22:03.802889+0000","last_fullsized":"2024-09-19T07:22:03.802889+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:57.325415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.762228+0000","last_change":"2024-09-19T07:20:17.522426+0000","last_active":"2024-09-19T07:22:03.762228+0000","last_peered":"2024-09-19T07:22:03.762228+0000","last_clean":"2024-09-19T07:22:03.762228+0000","last_became_active":"2024-09-19T07:20:17.522061+0000","last_became_peered":"2024-09-19T07:20:17.522061+0000","last_unstale":"2024-09-19T07:22:03.762228+0000","last_undegraded":"2024-09-19T07:22:03.762228+0000","last_fullsized":"2024-09-19T07:22:03.762228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:45:04.405585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805167+0000","last_change":"2024-09-19T07:20:19.543420+0000","last_active":"2024-09-19T07:22:03.805167+0000","last_peered":"2024-09-19T07:22:03.805167+0000","last_clean":"2024-09-19T07:22:03.805167+0000","last_became_active":"2024-09-19T07:20:19.542294+0000","last_became_peered":"2024-09-19T07:20:19.542294+0000","last_unstale":"2024-09-19T07:22:03.805167+0000","last_undegraded":"2024-09-19T07:22:03.805167+0000","last_fullsized":"2024-09-19T07:22:03.805167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:24:32.119366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'65","reported_seq":119,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:14.443512+0000","last_change":"2024-09-19T07:20:17.518402+0000","last_active":"2024-09-19T07:22:14.443512+0000","last_peered":"2024-09-19T07:22:14.443512+0000","last_clean":"2024-09-19T07:22:14.443512+0000","last_became_active":"2024-09-19T07:20:17.517524+0000","last_became_peered":"2024-09-19T07:20:17.517524+0000","last_unstale":"2024-09-19T07:22:14.443512+0000","last_undegraded":"2024-09-19T07:22:14.443512+0000","last_fullsized":"2024-09-19T07:22:14.443512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:41:49.843442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.809548+0000","last_change":"2024-09-19T07:20:19.540945+0000","last_active":"2024-09-19T07:22:03.809548+0000","last_peered":"2024-09-19T07:22:03.809548+0000","last_clean":"2024-09-19T07:22:03.809548+0000","last_became_active":"2024-09-19T07:20:19.540641+0000","last_became_peered":"2024-09-19T07:20:19.540641+0000","last_unstale":"2024-09-19T07:22:03.809548+0000","last_undegraded":"2024-09-19T07:22:03.809548+0000","last_fullsized":"2024-09-19T07:22:03.809548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:56:09.487418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"78'3","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.774962+0000","last_change":"2024-09-19T07:20:17.567010+0000","last_active":"2024-09-19T07:22:03.774962+0000","last_peered":"2024-09-19T07:22:03.774962+0000","last_clean":"2024-09-19T07:22:03.774962+0000","last_became_active":"2024-09-19T07:20:17.566560+0000","last_became_peered":"2024-09-19T07:20:17.566560+0000","last_unstale":"2024-09-19T07:22:03.774962+0000","last_undegraded":"2024-09-19T07:22:03.774962+0000","last_fullsized":"2024-09-19T07:22:03.774962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:52:36.349568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813860+0000","last_change":"2024-09-19T07:20:19.541808+0000","last_active":"2024-09-19T07:22:03.813860+0000","last_peered":"2024-09-19T07:22:03.813860+0000","last_clean":"2024-09-19T07:22:03.813860+0000","last_became_active":"2024-09-19T07:20:19.541510+0000","last_became_peered":"2024-09-19T07:20:19.541510+0000","last_unstale":"2024-09-19T07:22:03.813860+0000","last_undegraded":"2024-09-19T07:22:03.813860+0000","last_fullsized":"2024-09-19T07:22:03.813860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:04.156121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"81'148","reported_seq":388,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:05.912019+0000","last_change":"2024-09-19T07:19:11.632651+0000","last_active":"2024-09-19T07:22:05.912019+0000","last_peered":"2024-09-19T07:22:05.912019+0000","last_clean":"2024-09-19T07:22:05.912019+0000","last_became_active":"2024-09-19T07:19:11.632229+0000","last_became_peered":"2024-09-19T07:19:11.632229+0000","last_unstale":"2024-09-19T07:22:05.912019+0000","last_undegraded":"2024-09-19T07:22:05.912019+0000","last_fullsized":"2024-09-19T07:22:05.912019+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:15:50.875302+0000","last_clean_scrub_stamp":"2024-09-19T07:15:50.875302+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:50:32.716049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"78'3","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.763366+0000","last_change":"2024-09-19T07:20:17.512387+0000","last_active":"2024-09-19T07:22:03.763366+0000","last_peered":"2024-09-19T07:22:03.763366+0000","last_clean":"2024-09-19T07:22:03.763366+0000","last_became_active":"2024-09-19T07:20:17.511956+0000","last_became_peered":"2024-09-19T07:20:17.511956+0000","last_unstale":"2024-09-19T07:22:03.763366+0000","last_undegraded":"2024-09-19T07:22:03.763366+0000","last_fullsized":"2024-09-19T07:22:03.763366+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:13.098347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.813504+0000","last_change":"2024-09-19T07:20:19.536280+0000","last_active":"2024-09-19T07:22:03.813504+0000","last_peered":"2024-09-19T07:22:03.813504+0000","last_clean":"2024-09-19T07:22:03.813504+0000","last_became_active":"2024-09-19T07:20:19.535809+0000","last_became_peered":"2024-09-19T07:20:19.535809+0000","last_unstale":"2024-09-19T07:22:03.813504+0000","last_undegraded":"2024-09-19T07:22:03.813504+0000","last_fullsized":"2024-09-19T07:22:03.813504+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:07.645476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"78'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.765247+0000","last_change":"2024-09-19T07:20:37.800603+0000","last_active":"2024-09-19T07:22:03.765247+0000","last_peered":"2024-09-19T07:22:03.765247+0000","last_clean":"2024-09-19T07:22:03.765247+0000","last_became_active":"2024-09-19T07:20:37.794728+0000","last_became_peered":"2024-09-19T07:20:37.794728+0000","last_unstale":"2024-09-19T07:22:03.765247+0000","last_undegraded":"2024-09-19T07:22:03.765247+0000","last_fullsized":"2024-09-19T07:22:03.765247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:39:46.606645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808940+0000","last_change":"2024-09-19T07:20:19.540203+0000","last_active":"2024-09-19T07:22:03.808940+0000","last_peered":"2024-09-19T07:22:03.808940+0000","last_clean":"2024-09-19T07:22:03.808940+0000","last_became_active":"2024-09-19T07:20:19.539813+0000","last_became_peered":"2024-09-19T07:20:19.539813+0000","last_unstale":"2024-09-19T07:22:03.808940+0000","last_undegraded":"2024-09-19T07:22:03.808940+0000","last_fullsized":"2024-09-19T07:22:03.808940+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:52.164881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":139,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:17.918574+0000","last_change":"2024-09-19T07:20:17.565449+0000","last_active":"2024-09-19T07:22:17.918574+0000","last_peered":"2024-09-19T07:22:17.918574+0000","last_clean":"2024-09-19T07:22:17.918574+0000","last_became_active":"2024-09-19T07:20:17.565079+0000","last_became_peered":"2024-09-19T07:20:17.565079+0000","last_unstale":"2024-09-19T07:22:17.918574+0000","last_undegraded":"2024-09-19T07:22:17.918574+0000","last_fullsized":"2024-09-19T07:22:17.918574+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:50.791388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.808040+0000","last_change":"2024-09-19T07:20:19.533817+0000","last_active":"2024-09-19T07:22:03.808040+0000","last_peered":"2024-09-19T07:22:03.808040+0000","last_clean":"2024-09-19T07:22:03.808040+0000","last_became_active":"2024-09-19T07:20:19.532144+0000","last_became_peered":"2024-09-19T07:20:19.532144+0000","last_unstale":"2024-09-19T07:22:03.808040+0000","last_undegraded":"2024-09-19T07:22:03.808040+0000","last_fullsized":"2024-09-19T07:22:03.808040+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:18.928739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"78'1","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.779225+0000","last_change":"2024-09-19T07:20:17.514063+0000","last_active":"2024-09-19T07:22:03.779225+0000","last_peered":"2024-09-19T07:22:03.779225+0000","last_clean":"2024-09-19T07:22:03.779225+0000","last_became_active":"2024-09-19T07:20:17.513633+0000","last_became_peered":"2024-09-19T07:20:17.513633+0000","last_unstale":"2024-09-19T07:22:03.779225+0000","last_undegraded":"2024-09-19T07:22:03.779225+0000","last_fullsized":"2024-09-19T07:22:03.779225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:24.113053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815734+0000","last_change":"2024-09-19T07:20:19.540209+0000","last_active":"2024-09-19T07:22:03.815734+0000","last_peered":"2024-09-19T07:22:03.815734+0000","last_clean":"2024-09-19T07:22:03.815734+0000","last_became_active":"2024-09-19T07:20:19.539855+0000","last_became_peered":"2024-09-19T07:20:19.539855+0000","last_unstale":"2024-09-19T07:22:03.815734+0000","last_undegraded":"2024-09-19T07:22:03.815734+0000","last_fullsized":"2024-09-19T07:22:03.815734+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:40.878905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.776263+0000","last_change":"2024-09-19T07:20:17.565627+0000","last_active":"2024-09-19T07:22:03.776263+0000","last_peered":"2024-09-19T07:22:03.776263+0000","last_clean":"2024-09-19T07:22:03.776263+0000","last_became_active":"2024-09-19T07:20:17.565231+0000","last_became_peered":"2024-09-19T07:20:17.565231+0000","last_unstale":"2024-09-19T07:22:03.776263+0000","last_undegraded":"2024-09-19T07:22:03.776263+0000","last_fullsized":"2024-09-19T07:22:03.776263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:53.105336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817750+0000","last_change":"2024-09-19T07:20:19.532418+0000","last_active":"2024-09-19T07:22:03.817750+0000","last_peered":"2024-09-19T07:22:03.817750+0000","last_clean":"2024-09-19T07:22:03.817750+0000","last_became_active":"2024-09-19T07:20:19.532113+0000","last_became_peered":"2024-09-19T07:20:19.532113+0000","last_unstale":"2024-09-19T07:22:03.817750+0000","last_undegraded":"2024-09-19T07:22:03.817750+0000","last_fullsized":"2024-09-19T07:22:03.817750+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:24.953720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"78'1","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775943+0000","last_change":"2024-09-19T07:20:17.565984+0000","last_active":"2024-09-19T07:22:03.775943+0000","last_peered":"2024-09-19T07:22:03.775943+0000","last_clean":"2024-09-19T07:22:03.775943+0000","last_became_active":"2024-09-19T07:20:17.565240+0000","last_became_peered":"2024-09-19T07:20:17.565240+0000","last_unstale":"2024-09-19T07:22:03.775943+0000","last_undegraded":"2024-09-19T07:22:03.775943+0000","last_fullsized":"2024-09-19T07:22:03.775943+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:07.906716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.807964+0000","last_change":"2024-09-19T07:20:19.534400+0000","last_active":"2024-09-19T07:22:03.807964+0000","last_peered":"2024-09-19T07:22:03.807964+0000","last_clean":"2024-09-19T07:22:03.807964+0000","last_became_active":"2024-09-19T07:20:19.534130+0000","last_became_peered":"2024-09-19T07:20:19.534130+0000","last_unstale":"2024-09-19T07:22:03.807964+0000","last_undegraded":"2024-09-19T07:22:03.807964+0000","last_fullsized":"2024-09-19T07:22:03.807964+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:09.398112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'101","reported_seq":217,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:15.109349+0000","last_change":"2024-09-19T07:20:17.519628+0000","last_active":"2024-09-19T07:22:15.109349+0000","last_peered":"2024-09-19T07:22:15.109349+0000","last_clean":"2024-09-19T07:22:15.109349+0000","last_became_active":"2024-09-19T07:20:17.519276+0000","last_became_peered":"2024-09-19T07:20:17.519276+0000","last_unstale":"2024-09-19T07:22:15.109349+0000","last_undegraded":"2024-09-19T07:22:15.109349+0000","last_fullsized":"2024-09-19T07:22:15.109349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:15.193091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":186,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.805204+0000","last_change":"2024-09-19T07:20:19.533425+0000","last_active":"2024-09-19T07:22:03.805204+0000","last_peered":"2024-09-19T07:22:03.805204+0000","last_clean":"2024-09-19T07:22:03.805204+0000","last_became_active":"2024-09-19T07:20:19.533142+0000","last_became_peered":"2024-09-19T07:20:19.533142+0000","last_unstale":"2024-09-19T07:22:03.805204+0000","last_undegraded":"2024-09-19T07:22:03.805204+0000","last_fullsized":"2024-09-19T07:22:03.805204+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:47:07.048006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.763685+0000","last_change":"2024-09-19T07:20:17.512776+0000","last_active":"2024-09-19T07:22:03.763685+0000","last_peered":"2024-09-19T07:22:03.763685+0000","last_clean":"2024-09-19T07:22:03.763685+0000","last_became_active":"2024-09-19T07:20:17.511862+0000","last_became_peered":"2024-09-19T07:20:17.511862+0000","last_unstale":"2024-09-19T07:22:03.763685+0000","last_undegraded":"2024-09-19T07:22:03.763685+0000","last_fullsized":"2024-09-19T07:22:03.763685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:08.211654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.817223+0000","last_change":"2024-09-19T07:20:19.539260+0000","last_active":"2024-09-19T07:22:03.817223+0000","last_peered":"2024-09-19T07:22:03.817223+0000","last_clean":"2024-09-19T07:22:03.817223+0000","last_became_active":"2024-09-19T07:20:19.538868+0000","last_became_peered":"2024-09-19T07:20:19.538868+0000","last_unstale":"2024-09-19T07:22:03.817223+0000","last_undegraded":"2024-09-19T07:22:03.817223+0000","last_fullsized":"2024-09-19T07:22:03.817223+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:44.198084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.772518+0000","last_change":"2024-09-19T07:20:17.565544+0000","last_active":"2024-09-19T07:22:03.772518+0000","last_peered":"2024-09-19T07:22:03.772518+0000","last_clean":"2024-09-19T07:22:03.772518+0000","last_became_active":"2024-09-19T07:20:17.565250+0000","last_became_peered":"2024-09-19T07:20:17.565250+0000","last_unstale":"2024-09-19T07:22:03.772518+0000","last_undegraded":"2024-09-19T07:22:03.772518+0000","last_fullsized":"2024-09-19T07:22:03.772518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:25.523136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.788564+0000","last_change":"2024-09-19T07:20:19.531467+0000","last_active":"2024-09-19T07:22:03.788564+0000","last_peered":"2024-09-19T07:22:03.788564+0000","last_clean":"2024-09-19T07:22:03.788564+0000","last_became_active":"2024-09-19T07:20:19.531170+0000","last_became_peered":"2024-09-19T07:20:19.531170+0000","last_unstale":"2024-09-19T07:22:03.788564+0000","last_undegraded":"2024-09-19T07:22:03.788564+0000","last_fullsized":"2024-09-19T07:22:03.788564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:30:23.113097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"78'3","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775823+0000","last_change":"2024-09-19T07:20:17.511400+0000","last_active":"2024-09-19T07:22:03.775823+0000","last_peered":"2024-09-19T07:22:03.775823+0000","last_clean":"2024-09-19T07:22:03.775823+0000","last_became_active":"2024-09-19T07:20:17.511126+0000","last_became_peered":"2024-09-19T07:20:17.511126+0000","last_unstale":"2024-09-19T07:22:03.775823+0000","last_undegraded":"2024-09-19T07:22:03.775823+0000","last_fullsized":"2024-09-19T07:22:03.775823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:49.485406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818052+0000","last_change":"2024-09-19T07:20:19.529171+0000","last_active":"2024-09-19T07:22:03.818052+0000","last_peered":"2024-09-19T07:22:03.818052+0000","last_clean":"2024-09-19T07:22:03.818052+0000","last_became_active":"2024-09-19T07:20:19.528489+0000","last_became_peered":"2024-09-19T07:20:19.528489+0000","last_unstale":"2024-09-19T07:22:03.818052+0000","last_undegraded":"2024-09-19T07:22:03.818052+0000","last_fullsized":"2024-09-19T07:22:03.818052+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:10.842619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"78'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.765334+0000","last_change":"2024-09-19T07:20:37.803560+0000","last_active":"2024-09-19T07:22:03.765334+0000","last_peered":"2024-09-19T07:22:03.765334+0000","last_clean":"2024-09-19T07:22:03.765334+0000","last_became_active":"2024-09-19T07:20:37.797396+0000","last_became_peered":"2024-09-19T07:20:37.797396+0000","last_unstale":"2024-09-19T07:22:03.765334+0000","last_undegraded":"2024-09-19T07:22:03.765334+0000","last_fullsized":"2024-09-19T07:22:03.765334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:41.944179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"81'8","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.818481+0000","last_change":"2024-09-19T07:20:19.532698+0000","last_active":"2024-09-19T07:22:03.818481+0000","last_peered":"2024-09-19T07:22:03.818481+0000","last_clean":"2024-09-19T07:22:03.818481+0000","last_became_active":"2024-09-19T07:20:19.531978+0000","last_became_peered":"2024-09-19T07:20:19.531978+0000","last_unstale":"2024-09-19T07:22:03.818481+0000","last_undegraded":"2024-09-19T07:22:03.818481+0000","last_fullsized":"2024-09-19T07:22:03.818481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:44.257024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"78'4","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775088+0000","last_change":"2024-09-19T07:20:17.525240+0000","last_active":"2024-09-19T07:22:03.775088+0000","last_peered":"2024-09-19T07:22:03.775088+0000","last_clean":"2024-09-19T07:22:03.775088+0000","last_became_active":"2024-09-19T07:20:17.524880+0000","last_became_peered":"2024-09-19T07:20:17.524880+0000","last_unstale":"2024-09-19T07:22:03.775088+0000","last_undegraded":"2024-09-19T07:22:03.775088+0000","last_fullsized":"2024-09-19T07:22:03.775088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:41.380246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815849+0000","last_change":"2024-09-19T07:20:19.537116+0000","last_active":"2024-09-19T07:22:03.815849+0000","last_peered":"2024-09-19T07:22:03.815849+0000","last_clean":"2024-09-19T07:22:03.815849+0000","last_became_active":"2024-09-19T07:20:19.536799+0000","last_became_peered":"2024-09-19T07:20:19.536799+0000","last_unstale":"2024-09-19T07:22:03.815849+0000","last_undegraded":"2024-09-19T07:22:03.815849+0000","last_fullsized":"2024-09-19T07:22:03.815849+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:48.401159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"81'15","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815875+0000","last_change":"2024-09-19T07:20:19.527965+0000","last_active":"2024-09-19T07:22:03.815875+0000","last_peered":"2024-09-19T07:22:03.815875+0000","last_clean":"2024-09-19T07:22:03.815875+0000","last_became_active":"2024-09-19T07:20:19.527522+0000","last_became_peered":"2024-09-19T07:20:19.527522+0000","last_unstale":"2024-09-19T07:22:03.815875+0000","last_undegraded":"2024-09-19T07:22:03.815875+0000","last_fullsized":"2024-09-19T07:22:03.815875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:16.034153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775281+0000","last_change":"2024-09-19T07:20:17.519400+0000","last_active":"2024-09-19T07:22:03.775281+0000","last_peered":"2024-09-19T07:22:03.775281+0000","last_clean":"2024-09-19T07:22:03.775281+0000","last_became_active":"2024-09-19T07:20:17.518993+0000","last_became_peered":"2024-09-19T07:20:17.518993+0000","last_unstale":"2024-09-19T07:22:03.775281+0000","last_undegraded":"2024-09-19T07:22:03.775281+0000","last_fullsized":"2024-09-19T07:22:03.775281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:37.086763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"81'9","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.815623+0000","last_change":"2024-09-19T07:20:19.531016+0000","last_active":"2024-09-19T07:22:03.815623+0000","last_peered":"2024-09-19T07:22:03.815623+0000","last_clean":"2024-09-19T07:22:03.815623+0000","last_became_active":"2024-09-19T07:20:19.530706+0000","last_became_peered":"2024-09-19T07:20:19.530706+0000","last_unstale":"2024-09-19T07:22:03.815623+0000","last_undegraded":"2024-09-19T07:22:03.815623+0000","last_fullsized":"2024-09-19T07:22:03.815623+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:36.566185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"78'4","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775906+0000","last_change":"2024-09-19T07:20:17.524215+0000","last_active":"2024-09-19T07:22:03.775906+0000","last_peered":"2024-09-19T07:22:03.775906+0000","last_clean":"2024-09-19T07:22:03.775906+0000","last_became_active":"2024-09-19T07:20:17.523813+0000","last_became_peered":"2024-09-19T07:20:17.523813+0000","last_unstale":"2024-09-19T07:22:03.775906+0000","last_undegraded":"2024-09-19T07:22:03.775906+0000","last_fullsized":"2024-09-19T07:22:03.775906+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:45:58.803225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.821404+0000","last_change":"2024-09-19T07:20:19.540994+0000","last_active":"2024-09-19T07:22:03.821404+0000","last_peered":"2024-09-19T07:22:03.821404+0000","last_clean":"2024-09-19T07:22:03.821404+0000","last_became_active":"2024-09-19T07:20:19.540703+0000","last_became_peered":"2024-09-19T07:20:19.540703+0000","last_unstale":"2024-09-19T07:22:03.821404+0000","last_undegraded":"2024-09-19T07:22:03.821404+0000","last_fullsized":"2024-09-19T07:22:03.821404+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:37.065187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"78'2","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.775304+0000","last_change":"2024-09-19T07:20:17.565438+0000","last_active":"2024-09-19T07:22:03.775304+0000","last_peered":"2024-09-19T07:22:03.775304+0000","last_clean":"2024-09-19T07:22:03.775304+0000","last_became_active":"2024-09-19T07:20:17.565128+0000","last_became_peered":"2024-09-19T07:20:17.565128+0000","last_unstale":"2024-09-19T07:22:03.775304+0000","last_undegraded":"2024-09-19T07:22:03.775304+0000","last_fullsized":"2024-09-19T07:22:03.775304+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:02.048971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"81'5","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.810388+0000","last_change":"2024-09-19T07:20:37.794369+0000","last_active":"2024-09-19T07:22:03.810388+0000","last_peered":"2024-09-19T07:22:03.810388+0000","last_clean":"2024-09-19T07:22:03.810388+0000","last_became_active":"2024-09-19T07:20:37.794036+0000","last_became_peered":"2024-09-19T07:20:37.794036+0000","last_unstale":"2024-09-19T07:22:03.810388+0000","last_undegraded":"2024-09-19T07:22:03.810388+0000","last_fullsized":"2024-09-19T07:22:03.810388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:18.503703+0000","last_clean_scrub_stamp":"2024-09-19T07:20:18.503703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:02.684191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"78'9","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T07:22:03.777114+0000","last_change":"2024-09-19T07:20:37.950846+0000","last_active":"2024-09-19T07:22:03.777114+0000","last_peered":"2024-09-19T07:22:03.777114+0000","last_clean":"2024-09-19T07:22:03.777114+0000","last_became_active":"2024-09-19T07:20:37.944266+0000","last_became_peered":"2024-09-19T07:20:37.944266+0000","last_unstale":"2024-09-19T07:22:03.777114+0000","last_undegraded":"2024-09-19T07:22:03.777114+0000","last_fullsized":"2024-09-19T07:22:03.777114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T07:20:16.496415+0000","last_clean_scrub_stamp":"2024-09-19T07:20:16.496415+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:12.952833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":796331,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1019,"num_read_kb":720,"num_write":421,"num_write_kb":2354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27529,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2388993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645348,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":437330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874280,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28912,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716240,"statfs":{"total":95995035648,"available":95965429760,"internally_reserved":0,"allocated":1933312,"data_stored":1427222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037805,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1306624,"data_stored":830782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28296,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716856,"statfs":{"total":95995035648,"available":95966060544,"internally_reserved":0,"allocated":1302528,"data_stored":830120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495671,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28496,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716656,"statfs":{"total":95995035648,"available":95965855744,"internally_reserved":0,"allocated":1507328,"data_stored":1030905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659196,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":436955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888129,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28952,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716200,"statfs":{"total":95995035648,"available":95965388800,"internally_reserved":0,"allocated":1851392,"data_stored":1358035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":508153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28748,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716404,"statfs":{"total":95995035648,"available":95965597696,"internally_reserved":0,"allocated":1642496,"data_stored":1158714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":917504,"data_stored":439192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607637,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":970752,"data_stored":506141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":921600,"data_stored":438226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":71405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":330802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":399989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T07:22:20.685 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:22:20.933 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:20.983 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:20 smithi139 ceph-mon[35039]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-09-19T07:22:21.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:20 smithi098 ceph-mon[30950]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-09-19T07:22:21.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:20 smithi162 ceph-mon[35726]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-09-19T07:22:21.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.426+0000 7f8b04f91640 1 -- 172.21.15.98:0/3494507540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b00100a80 msgr2=0x7f8b00100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:21.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.426+0000 7f8b04f91640 1 --2- 172.21.15.98:0/3494507540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b00100a80 0x7f8b00100ee0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009930 tx=0x7f8ae802a420 comp rx=0 tx=0).stop 2024-09-19T07:22:21.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.426+0000 7f8b04f91640 1 -- 172.21.15.98:0/3494507540 shutdown_connections 2024-09-19T07:22:21.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.426+0000 7f8b04f91640 1 --2- 172.21.15.98:0/3494507540 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b00101420 0x7f8b0010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:21.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.426+0000 7f8b04f91640 1 --2- 172.21.15.98:0/3494507540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b00100a80 0x7f8b00100ee0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:21.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.426+0000 7f8b04f91640 1 --2- 172.21.15.98:0/3494507540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b00106a80 0x7f8b00106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:21.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.426+0000 7f8b04f91640 1 -- 172.21.15.98:0/3494507540 >> 172.21.15.98:0/3494507540 conn(0x7f8b000fc7a0 msgr2=0x7f8b000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:21.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.426+0000 7f8b04f91640 1 -- 172.21.15.98:0/3494507540 shutdown_connections 2024-09-19T07:22:21.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.426+0000 7f8b04f91640 1 -- 172.21.15.98:0/3494507540 wait complete. 2024-09-19T07:22:21.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8b04f91640 1 Processor -- start 2024-09-19T07:22:21.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8b04f91640 1 -- start start 2024-09-19T07:22:21.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8b04f91640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b00100a80 0x7f8b00198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:21.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8b04f91640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b00101420 0x7f8b001989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:21.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8b04f91640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b00106a80 0x7f8b0019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:21.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8b04f91640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b00110e80 con 0x7f8b00106a80 2024-09-19T07:22:21.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8b04f91640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8b00110d00 con 0x7f8b00100a80 2024-09-19T07:22:21.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8b04f91640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b00111000 con 0x7f8b00101420 2024-09-19T07:22:21.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8afed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b00106a80 0x7f8b0019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:21.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8afe59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b00100a80 0x7f8b00198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:21.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8afed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b00106a80 0x7f8b0019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:60260/0 (socket says 172.21.15.98:60260) 2024-09-19T07:22:21.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8afed9d640 1 -- 172.21.15.98:0/1304401116 learned_addr learned my addr 172.21.15.98:0/1304401116 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8afdd9b640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b00101420 0x7f8b001989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8afed9d640 1 -- 172.21.15.98:0/1304401116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b00101420 msgr2=0x7f8b001989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8afed9d640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b00101420 0x7f8b001989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8afed9d640 1 -- 172.21.15.98:0/1304401116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b00100a80 msgr2=0x7f8b00198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8afed9d640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b00100a80 0x7f8b00198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8afed9d640 1 -- 172.21.15.98:0/1304401116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0019d440 con 0x7f8b00106a80 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8afdd9b640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b00101420 0x7f8b001989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.427+0000 7f8afe59c640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b00100a80 0x7f8b00198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.428+0000 7f8afed9d640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b00106a80 0x7f8b0019cd60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8af800eaa0 tx=0x7f8af800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.428+0000 7f8af77fe640 1 -- 172.21.15.98:0/1304401116 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af800cdb0 con 0x7f8b00106a80 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.428+0000 7f8b04f91640 1 -- 172.21.15.98:0/1304401116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0019d730 con 0x7f8b00106a80 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.428+0000 7f8af77fe640 1 -- 172.21.15.98:0/1304401116 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8af8005020 con 0x7f8b00106a80 2024-09-19T07:22:21.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.428+0000 7f8af77fe640 1 -- 172.21.15.98:0/1304401116 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af80116b0 con 0x7f8b00106a80 2024-09-19T07:22:21.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.428+0000 7f8b04f91640 1 -- 172.21.15.98:0/1304401116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b001a5010 con 0x7f8b00106a80 2024-09-19T07:22:21.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.429+0000 7f8b04f91640 1 -- 172.21.15.98:0/1304401116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b00100ee0 con 0x7f8b00106a80 2024-09-19T07:22:21.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.430+0000 7f8af77fe640 1 -- 172.21.15.98:0/1304401116 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f8af8005560 con 0x7f8b00106a80 2024-09-19T07:22:21.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.431+0000 7f8af77fe640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8aec0a34d0 0x7f8aec0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:21.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.432+0000 7f8afe59c640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8aec0a34d0 0x7f8aec0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:21.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.432+0000 7f8af77fe640 1 -- 172.21.15.98:0/1304401116 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8af80d0280 con 0x7f8b00106a80 2024-09-19T07:22:21.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.432+0000 7f8afe59c640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8aec0a34d0 0x7f8aec0a5990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8af000bf50 tx=0x7f8af000b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:21.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.436+0000 7f8af77fe640 1 -- 172.21.15.98:0/1304401116 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8af8016030 con 0x7f8b00106a80 2024-09-19T07:22:21.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.635+0000 7f8b04f91640 1 -- 172.21.15.98:0/1304401116 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b00109a70 con 0x7f8b00106a80 2024-09-19T07:22:21.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.636+0000 7f8af77fe640 1 -- 172.21.15.98:0/1304401116 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f8af809c9e0 con 0x7f8b00106a80 2024-09-19T07:22:21.637 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:21.637 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:22:21.637 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.638+0000 7f8b04f91640 1 -- 172.21.15.98:0/1304401116 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8aec0a34d0 msgr2=0x7f8aec0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.638+0000 7f8b04f91640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8aec0a34d0 0x7f8aec0a5990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8af000bf50 tx=0x7f8af000b390 comp rx=0 tx=0).stop 2024-09-19T07:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.638+0000 7f8b04f91640 1 -- 172.21.15.98:0/1304401116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b00106a80 msgr2=0x7f8b0019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.638+0000 7f8b04f91640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b00106a80 0x7f8b0019cd60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8af800eaa0 tx=0x7f8af800ef60 comp rx=0 tx=0).stop 2024-09-19T07:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.638+0000 7f8b04f91640 1 -- 172.21.15.98:0/1304401116 shutdown_connections 2024-09-19T07:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.638+0000 7f8b04f91640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8aec0a34d0 0x7f8aec0a5990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.638+0000 7f8b04f91640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b00106a80 0x7f8b0019cd60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.638+0000 7f8b04f91640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b00101420 0x7f8b001989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.638+0000 7f8b04f91640 1 --2- 172.21.15.98:0/1304401116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b00100a80 0x7f8b00198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:21.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.638+0000 7f8b04f91640 1 -- 172.21.15.98:0/1304401116 >> 172.21.15.98:0/1304401116 conn(0x7f8b000fc7a0 msgr2=0x7f8b0006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:21.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.639+0000 7f8b04f91640 1 -- 172.21.15.98:0/1304401116 shutdown_connections 2024-09-19T07:22:21.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:21.639+0000 7f8b04f91640 1 -- 172.21.15.98:0/1304401116 wait complete. 2024-09-19T07:22:21.935 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:21 smithi098 ceph-mon[30950]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:21.935 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:21 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1304401116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:22.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:21 smithi139 ceph-mon[35039]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:22.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:21 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1304401116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:22.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:21 smithi162 ceph-mon[35726]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T07:22:22.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:21 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1304401116' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:22.398 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:22:22.645 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:23.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:22 smithi098 ceph-mon[30950]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-19T07:22:23.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:22 smithi139 ceph-mon[35039]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-19T07:22:23.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.127+0000 7f0d1561a640 1 -- 172.21.15.98:0/3785869333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d10106a80 msgr2=0x7f0d10106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:23.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.127+0000 7f0d1561a640 1 --2- 172.21.15.98:0/3785869333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d10106a80 0x7f0d10106e60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009930 tx=0x7f0d0802a420 comp rx=0 tx=0).stop 2024-09-19T07:22:23.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.127+0000 7f0d1561a640 1 -- 172.21.15.98:0/3785869333 shutdown_connections 2024-09-19T07:22:23.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.127+0000 7f0d1561a640 1 --2- 172.21.15.98:0/3785869333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d10101420 0x7f0d1010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:23.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.127+0000 7f0d1561a640 1 --2- 172.21.15.98:0/3785869333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d10100a80 0x7f0d10100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:23.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.127+0000 7f0d1561a640 1 --2- 172.21.15.98:0/3785869333 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d10106a80 0x7f0d10106e60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:23.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.127+0000 7f0d1561a640 1 -- 172.21.15.98:0/3785869333 >> 172.21.15.98:0/3785869333 conn(0x7f0d100fc7a0 msgr2=0x7f0d100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:23.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.127+0000 7f0d1561a640 1 -- 172.21.15.98:0/3785869333 shutdown_connections 2024-09-19T07:22:23.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.127+0000 7f0d1561a640 1 -- 172.21.15.98:0/3785869333 wait complete. 2024-09-19T07:22:23.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.128+0000 7f0d1561a640 1 Processor -- start 2024-09-19T07:22:23.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.128+0000 7f0d1561a640 1 -- start start 2024-09-19T07:22:23.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.128+0000 7f0d1561a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d10100a80 0x7f0d100fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:23.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.128+0000 7f0d1561a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d10101420 0x7f0d100fd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:23.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.128+0000 7f0d1561a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d10106a80 0x7f0d100fd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:23.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.128+0000 7f0d1561a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0d10110e80 con 0x7f0d10100a80 2024-09-19T07:22:23.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.128+0000 7f0d1561a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0d10110d00 con 0x7f0d10101420 2024-09-19T07:22:23.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.128+0000 7f0d1561a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d10111000 con 0x7f0d10106a80 2024-09-19T07:22:23.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d10100a80 0x7f0d100fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:23.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0e7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d10101420 0x7f0d100fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:23.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d10100a80 0x7f0d100fcdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58836/0 (socket says 172.21.15.98:58836) 2024-09-19T07:22:23.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d10106a80 0x7f0d100fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:23.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0effd640 1 -- 172.21.15.98:0/3899144637 learned_addr learned my addr 172.21.15.98:0/3899144637 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:23.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0e7fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d10101420 0x7f0d100fd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:57296/0 (socket says 172.21.15.98:57296) 2024-09-19T07:22:23.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0effd640 1 -- 172.21.15.98:0/3899144637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d10106a80 msgr2=0x7f0d100fd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:23.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0effd640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d10106a80 0x7f0d100fd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:23.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0effd640 1 -- 172.21.15.98:0/3899144637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d10101420 msgr2=0x7f0d100fd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:23.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0effd640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d10101420 0x7f0d100fd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:23.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0effd640 1 -- 172.21.15.98:0/3899144637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d101a6930 con 0x7f0d10100a80 2024-09-19T07:22:23.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0e7fc640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d10101420 0x7f0d100fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:23.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d0effd640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d10100a80 0x7f0d100fcdc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009230 tx=0x7f0d08004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:23.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d07fff640 1 -- 172.21.15.98:0/3899144637 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0803f030 con 0x7f0d10100a80 2024-09-19T07:22:23.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d07fff640 1 -- 172.21.15.98:0/3899144637 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d08003ad0 con 0x7f0d10100a80 2024-09-19T07:22:23.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.129+0000 7f0d1561a640 1 -- 172.21.15.98:0/3899144637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d101a6bc0 con 0x7f0d10100a80 2024-09-19T07:22:23.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.130+0000 7f0d07fff640 1 -- 172.21.15.98:0/3899144637 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d08035070 con 0x7f0d10100a80 2024-09-19T07:22:23.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.130+0000 7f0d1561a640 1 -- 172.21.15.98:0/3899144637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d101a70a0 con 0x7f0d10100a80 2024-09-19T07:22:23.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.131+0000 7f0d1561a640 1 -- 172.21.15.98:0/3899144637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d10100ee0 con 0x7f0d10100a80 2024-09-19T07:22:23.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:22 smithi162 ceph-mon[35726]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-19T07:22:23.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.132+0000 7f0d07fff640 1 -- 172.21.15.98:0/3899144637 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f0d08042030 con 0x7f0d10100a80 2024-09-19T07:22:23.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.132+0000 7f0d07fff640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0cfc0a34d0 0x7f0cfc0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:23.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.132+0000 7f0d0e7fc640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0cfc0a34d0 0x7f0cfc0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:23.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.132+0000 7f0d07fff640 1 -- 172.21.15.98:0/3899144637 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0d080f0380 con 0x7f0d10100a80 2024-09-19T07:22:23.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.133+0000 7f0d0e7fc640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0cfc0a34d0 0x7f0cfc0a5990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d100fe850 tx=0x7f0cf800b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:23.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.136+0000 7f0d07fff640 1 -- 172.21.15.98:0/3899144637 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d080bc560 con 0x7f0d10100a80 2024-09-19T07:22:23.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.335+0000 7f0d1561a640 1 -- 172.21.15.98:0/3899144637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d1010a000 con 0x7f0d10100a80 2024-09-19T07:22:23.337 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.336+0000 7f0d07fff640 1 -- 172.21.15.98:0/3899144637 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f0d080c0860 con 0x7f0d10100a80 2024-09-19T07:22:23.337 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:23.337 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:22:23.337 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:22:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.338+0000 7f0d1561a640 1 -- 172.21.15.98:0/3899144637 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0cfc0a34d0 msgr2=0x7f0cfc0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.338+0000 7f0d1561a640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0cfc0a34d0 0x7f0cfc0a5990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d100fe850 tx=0x7f0cf800b390 comp rx=0 tx=0).stop 2024-09-19T07:22:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.338+0000 7f0d1561a640 1 -- 172.21.15.98:0/3899144637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d10100a80 msgr2=0x7f0d100fcdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.338+0000 7f0d1561a640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d10100a80 0x7f0d100fcdc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009230 tx=0x7f0d08004270 comp rx=0 tx=0).stop 2024-09-19T07:22:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.338+0000 7f0d1561a640 1 -- 172.21.15.98:0/3899144637 shutdown_connections 2024-09-19T07:22:23.339 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.338+0000 7f0d1561a640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0cfc0a34d0 0x7f0cfc0a5990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:23.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.338+0000 7f0d1561a640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d10106a80 0x7f0d100fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:23.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.338+0000 7f0d1561a640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d10101420 0x7f0d100fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:23.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.338+0000 7f0d1561a640 1 --2- 172.21.15.98:0/3899144637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d10100a80 0x7f0d100fcdc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:23.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.338+0000 7f0d1561a640 1 -- 172.21.15.98:0/3899144637 >> 172.21.15.98:0/3899144637 conn(0x7f0d100fc7a0 msgr2=0x7f0d1006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:23.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.338+0000 7f0d1561a640 1 -- 172.21.15.98:0/3899144637 shutdown_connections 2024-09-19T07:22:23.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:23.338+0000 7f0d1561a640 1 -- 172.21.15.98:0/3899144637 wait complete. 2024-09-19T07:22:24.003 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:23 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3899144637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:24.031 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:22:24.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:23 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3899144637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:24.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:23 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3899144637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:24.277 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:24.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.760+0000 7fda69021640 1 -- 172.21.15.98:0/550169489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda64101bc0 msgr2=0x7fda6410d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:24.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.760+0000 7fda69021640 1 --2- 172.21.15.98:0/550169489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda64101bc0 0x7fda6410d910 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009ca0 tx=0x7fda5c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:22:24.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.760+0000 7fda69021640 1 -- 172.21.15.98:0/550169489 shutdown_connections 2024-09-19T07:22:24.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.760+0000 7fda69021640 1 --2- 172.21.15.98:0/550169489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda64101bc0 0x7fda6410d910 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:24.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.760+0000 7fda69021640 1 --2- 172.21.15.98:0/550169489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda64101240 0x7fda64101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:24.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.760+0000 7fda69021640 1 --2- 172.21.15.98:0/550169489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda64105a90 0x7fda64105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:24.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.760+0000 7fda69021640 1 -- 172.21.15.98:0/550169489 >> 172.21.15.98:0/550169489 conn(0x7fda64077210 msgr2=0x7fda640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:24.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.760+0000 7fda69021640 1 -- 172.21.15.98:0/550169489 shutdown_connections 2024-09-19T07:22:24.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.760+0000 7fda69021640 1 -- 172.21.15.98:0/550169489 wait complete. 2024-09-19T07:22:24.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda69021640 1 Processor -- start 2024-09-19T07:22:24.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda69021640 1 -- start start 2024-09-19T07:22:24.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda69021640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda64101240 0x7fda64199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:24.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda69021640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda64101bc0 0x7fda64199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:24.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda69021640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda64105a90 0x7fda641a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:24.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda69021640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fda64110f70 con 0x7fda64105a90 2024-09-19T07:22:24.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda69021640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fda64110df0 con 0x7fda64101bc0 2024-09-19T07:22:24.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda69021640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda641110f0 con 0x7fda64101240 2024-09-19T07:22:24.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda6359e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda64105a90 0x7fda641a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:24.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda6359e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda64105a90 0x7fda641a43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58850/0 (socket says 172.21.15.98:58850) 2024-09-19T07:22:24.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda6359e640 1 -- 172.21.15.98:0/900326679 learned_addr learned my addr 172.21.15.98:0/900326679 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:24.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda62d9d640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda64101240 0x7fda64199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:24.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.761+0000 7fda6259c640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda64101bc0 0x7fda64199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.762+0000 7fda6359e640 1 -- 172.21.15.98:0/900326679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda64101240 msgr2=0x7fda64199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.762+0000 7fda6359e640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda64101240 0x7fda64199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.762+0000 7fda6359e640 1 -- 172.21.15.98:0/900326679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda64101bc0 msgr2=0x7fda64199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.762+0000 7fda6359e640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda64101bc0 0x7fda64199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.762+0000 7fda6359e640 1 -- 172.21.15.98:0/900326679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda641a4900 con 0x7fda64105a90 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.762+0000 7fda62d9d640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda64101240 0x7fda64199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.762+0000 7fda6359e640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda64105a90 0x7fda641a43c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0097b0 tx=0x7fda5c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.762+0000 7fda4bfff640 1 -- 172.21.15.98:0/900326679 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c031810 con 0x7fda64105a90 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.762+0000 7fda69021640 1 -- 172.21.15.98:0/900326679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda641a4ad0 con 0x7fda64105a90 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.762+0000 7fda4bfff640 1 -- 172.21.15.98:0/900326679 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda5c0319b0 con 0x7fda64105a90 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.762+0000 7fda4bfff640 1 -- 172.21.15.98:0/900326679 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c030c90 con 0x7fda64105a90 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.762+0000 7fda69021640 1 -- 172.21.15.98:0/900326679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda641a4fb0 con 0x7fda64105a90 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.763+0000 7fda69021640 1 -- 172.21.15.98:0/900326679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda64101680 con 0x7fda64105a90 2024-09-19T07:22:24.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.764+0000 7fda4bfff640 1 -- 172.21.15.98:0/900326679 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fda5c004040 con 0x7fda64105a90 2024-09-19T07:22:24.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.765+0000 7fda4bfff640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fda4c0a34d0 0x7fda4c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:24.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.765+0000 7fda62d9d640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fda4c0a34d0 0x7fda4c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:24.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.765+0000 7fda4bfff640 1 -- 172.21.15.98:0/900326679 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fda5c0f17a0 con 0x7fda64105a90 2024-09-19T07:22:24.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.765+0000 7fda62d9d640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fda4c0a34d0 0x7fda4c0a5990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda54005d70 tx=0x7fda54005d00 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:24.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.769+0000 7fda4bfff640 1 -- 172.21.15.98:0/900326679 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda5c0be010 con 0x7fda64105a90 2024-09-19T07:22:24.939 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.938+0000 7fda69021640 1 -- 172.21.15.98:0/900326679 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda641a51e0 con 0x7fda64105a90 2024-09-19T07:22:24.939 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:24 smithi098 ceph-mon[30950]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-19T07:22:24.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.940+0000 7fda4bfff640 1 -- 172.21.15.98:0/900326679 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+23201 (secure 0 0 0) 0x7fda5c0098b0 con 0x7fda64105a90 2024-09-19T07:22:24.940 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:24.941 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":81,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:22:03.757463+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:20:16.391879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:20:18.243837+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/3732813400":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6801/2172632890":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/2271200719":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/617371908":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1543222160":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1123383068":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6800/2172632890":"2024-09-20T07:22:03.757428+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:22:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.942+0000 7fda69021640 1 -- 172.21.15.98:0/900326679 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fda4c0a34d0 msgr2=0x7fda4c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.942+0000 7fda69021640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fda4c0a34d0 0x7fda4c0a5990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda54005d70 tx=0x7fda54005d00 comp rx=0 tx=0).stop 2024-09-19T07:22:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.942+0000 7fda69021640 1 -- 172.21.15.98:0/900326679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda64105a90 msgr2=0x7fda641a43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.942+0000 7fda69021640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda64105a90 0x7fda641a43c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fda5c0097b0 tx=0x7fda5c003f10 comp rx=0 tx=0).stop 2024-09-19T07:22:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.942+0000 7fda69021640 1 -- 172.21.15.98:0/900326679 shutdown_connections 2024-09-19T07:22:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.942+0000 7fda69021640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fda4c0a34d0 0x7fda4c0a5990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.942+0000 7fda69021640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fda64105a90 0x7fda641a43c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.942+0000 7fda69021640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda64101bc0 0x7fda64199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.942+0000 7fda69021640 1 --2- 172.21.15.98:0/900326679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda64101240 0x7fda64199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:24.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.942+0000 7fda69021640 1 -- 172.21.15.98:0/900326679 >> 172.21.15.98:0/900326679 conn(0x7fda64077210 msgr2=0x7fda64103940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:24.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.942+0000 7fda69021640 1 -- 172.21.15.98:0/900326679 shutdown_connections 2024-09-19T07:22:24.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:24.942+0000 7fda69021640 1 -- 172.21.15.98:0/900326679 wait complete. 2024-09-19T07:22:25.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:24 smithi139 ceph-mon[35039]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-19T07:22:25.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:24 smithi162 ceph-mon[35726]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-09-19T07:22:25.738 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T07:22:25.989 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:26.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:25 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/900326679' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:22:26.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:25 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/900326679' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:22:26.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:25 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/900326679' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:22:27.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:26 smithi098 ceph-mon[30950]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-19T07:22:27.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:26 smithi098 ceph-mon[30950]: scrub summary: idle 2024-09-19T07:22:27.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:26 smithi139 ceph-mon[35039]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-19T07:22:27.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:26 smithi139 ceph-mon[35039]: scrub summary: idle 2024-09-19T07:22:27.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:26 smithi162 ceph-mon[35726]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 76 KiB/s wr, 39 op/s 2024-09-19T07:22:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:26 smithi162 ceph-mon[35726]: scrub summary: idle 2024-09-19T07:22:27.233 INFO:teuthology.orchestra.run.smithi098.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T07:22:27.233 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T07:22:27.234 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T07:22:27.234 DEBUG:tasks.quiescer:Yielding 2024-09-19T07:22:27.234 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T07:22:27.250 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T07:22:27.251 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T07:22:27.251 INFO:tasks.workunit:timeout=6h 2024-09-19T07:22:27.251 INFO:tasks.workunit:cleanup=True 2024-09-19T07:22:27.251 DEBUG:teuthology.orchestra.run.smithi098:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T07:22:27.252 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:22:27.269 INFO:teuthology.orchestra.run.smithi098.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T07:22:27.269 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T07:22:27.270 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 6ch/108d Inode: 1099511628283 Links: 2 2024-09-19T07:22:27.270 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T07:22:27.270 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T07:22:27.270 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-19 07:20:38.121612303 +0000 2024-09-19T07:22:27.270 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-19 07:20:38.121612303 +0000 2024-09-19T07:22:27.270 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-19 07:22:03.783869692 +0000 2024-09-19T07:22:27.270 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-19 07:20:38.121612303 +0000 2024-09-19T07:22:27.270 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T07:22:27.270 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T07:22:27.344 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T07:22:27.400 INFO:tasks.workunit.client.0.smithi098.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T07:22:27.506 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:27.915 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:27 smithi098 ceph-mon[30950]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T07:22:28.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.997+0000 7f240b4ea640 1 -- 172.21.15.98:0/398373516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2404103760 msgr2=0x7f2404107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.025 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.997+0000 7f240b4ea640 1 --2- 172.21.15.98:0/398373516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2404103760 0x7f2404107ba0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009930 tx=0x7f23f402a420 comp rx=0 tx=0).stop 2024-09-19T07:22:28.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.997+0000 7f240b4ea640 1 -- 172.21.15.98:0/398373516 shutdown_connections 2024-09-19T07:22:28.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.997+0000 7f240b4ea640 1 --2- 172.21.15.98:0/398373516 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24041082e0 0x7f240410ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.997+0000 7f240b4ea640 1 --2- 172.21.15.98:0/398373516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2404103760 0x7f2404107ba0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.997+0000 7f240b4ea640 1 --2- 172.21.15.98:0/398373516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2404102db0 0x7f2404103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.997+0000 7f240b4ea640 1 -- 172.21.15.98:0/398373516 >> 172.21.15.98:0/398373516 conn(0x7f24040fc7d0 msgr2=0x7f24040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:28.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.997+0000 7f240b4ea640 1 -- 172.21.15.98:0/398373516 shutdown_connections 2024-09-19T07:22:28.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.997+0000 7f240b4ea640 1 -- 172.21.15.98:0/398373516 wait complete. 2024-09-19T07:22:28.026 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f240b4ea640 1 Processor -- start 2024-09-19T07:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f240b4ea640 1 -- start start 2024-09-19T07:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f240b4ea640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2404102db0 0x7f24041985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f240b4ea640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2404103760 0x7f2404198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f240b4ea640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24041082e0 0x7f240419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f240b4ea640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2404112050 con 0x7f2404103760 2024-09-19T07:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f240b4ea640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2404111ed0 con 0x7f2404102db0 2024-09-19T07:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f240b4ea640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f24041121d0 con 0x7f24041082e0 2024-09-19T07:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2408a85640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2404103760 0x7f2404198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2408a85640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2404103760 0x7f2404198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58882/0 (socket says 172.21.15.98:58882) 2024-09-19T07:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2408a85640 1 -- 172.21.15.98:0/189577792 learned_addr learned my addr 172.21.15.98:0/189577792 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:28.027 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2409286640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2404102db0 0x7f24041985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2409a87640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24041082e0 0x7f240419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2408a85640 1 -- 172.21.15.98:0/189577792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24041082e0 msgr2=0x7f240419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2408a85640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24041082e0 0x7f240419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2408a85640 1 -- 172.21.15.98:0/189577792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2404102db0 msgr2=0x7f24041985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2408a85640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2404102db0 0x7f24041985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2408a85640 1 -- 172.21.15.98:0/189577792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240419d560 con 0x7f2404103760 2024-09-19T07:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2409a87640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24041082e0 0x7f240419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2409286640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2404102db0 0x7f24041985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.998+0000 7f2408a85640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2404103760 0x7f2404198af0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f23f4005940 tx=0x7f23f4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.999+0000 7f23fa7fc640 1 -- 172.21.15.98:0/189577792 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f403f070 con 0x7f2404103760 2024-09-19T07:22:28.028 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.999+0000 7f23fa7fc640 1 -- 172.21.15.98:0/189577792 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23f4031c30 con 0x7f2404103760 2024-09-19T07:22:28.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.999+0000 7f240b4ea640 1 -- 172.21.15.98:0/189577792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240419d7f0 con 0x7f2404103760 2024-09-19T07:22:28.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.999+0000 7f23fa7fc640 1 -- 172.21.15.98:0/189577792 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4035030 con 0x7f2404103760 2024-09-19T07:22:28.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:27.999+0000 7f240b4ea640 1 -- 172.21.15.98:0/189577792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24041a5130 con 0x7f2404103760 2024-09-19T07:22:28.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.000+0000 7f240b4ea640 1 -- 172.21.15.98:0/189577792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2404103190 con 0x7f2404103760 2024-09-19T07:22:28.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.001+0000 7f23fa7fc640 1 -- 172.21.15.98:0/189577792 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f23f4042070 con 0x7f2404103760 2024-09-19T07:22:28.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.002+0000 7f23fa7fc640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f23f00a3550 0x7f23f00a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.002+0000 7f2409286640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f23f00a3550 0x7f23f00a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.002+0000 7f23fa7fc640 1 -- 172.21.15.98:0/189577792 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f23f40f0b50 con 0x7f2404103760 2024-09-19T07:22:28.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.002+0000 7f2409286640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f23f00a3550 0x7f23f00a5a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f24000058c0 tx=0x7f2400005ec0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:28.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.008+0000 7f23fa7fc640 1 -- 172.21.15.98:0/189577792 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f23f40bd380 con 0x7f2404103760 2024-09-19T07:22:28.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:27 smithi162 ceph-mon[35726]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T07:22:28.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.212+0000 7f240b4ea640 1 -- 172.21.15.98:0/189577792 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2404199910 con 0x7f2404103760 2024-09-19T07:22:28.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.213+0000 7f23fa7fc640 1 -- 172.21.15.98:0/189577792 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f2404199910 con 0x7f2404103760 2024-09-19T07:22:28.213 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:28.213 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:22:28.214 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:22:28.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.216+0000 7f240b4ea640 1 -- 172.21.15.98:0/189577792 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f23f00a3550 msgr2=0x7f23f00a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.216+0000 7f240b4ea640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f23f00a3550 0x7f23f00a5a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f24000058c0 tx=0x7f2400005ec0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.216+0000 7f240b4ea640 1 -- 172.21.15.98:0/189577792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2404103760 msgr2=0x7f2404198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.216+0000 7f240b4ea640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2404103760 0x7f2404198af0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f23f4005940 tx=0x7f23f4003c10 comp rx=0 tx=0).stop 2024-09-19T07:22:28.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.216+0000 7f240b4ea640 1 -- 172.21.15.98:0/189577792 shutdown_connections 2024-09-19T07:22:28.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.216+0000 7f240b4ea640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f23f00a3550 0x7f23f00a5a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.216+0000 7f240b4ea640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24041082e0 0x7f240419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.216+0000 7f240b4ea640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2404103760 0x7f2404198af0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.216+0000 7f240b4ea640 1 --2- 172.21.15.98:0/189577792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2404102db0 0x7f24041985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.216+0000 7f240b4ea640 1 -- 172.21.15.98:0/189577792 >> 172.21.15.98:0/189577792 conn(0x7f24040fc7d0 msgr2=0x7f2404105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:28.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.216+0000 7f240b4ea640 1 -- 172.21.15.98:0/189577792 shutdown_connections 2024-09-19T07:22:28.217 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:28.216+0000 7f240b4ea640 1 -- 172.21.15.98:0/189577792 wait complete. 2024-09-19T07:22:28.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:27 smithi139 ceph-mon[35039]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T07:22:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.385+0000 7faa36586640 1 -- 172.21.15.98:0/255541897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa301035a0 msgr2=0x7faa3010ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.385+0000 7faa36586640 1 --2- 172.21.15.98:0/255541897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa301035a0 0x7faa3010ba80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faa24009900 tx=0x7faa2402a480 comp rx=0 tx=0).stop 2024-09-19T07:22:28.386 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.385+0000 7faa36586640 1 -- 172.21.15.98:0/255541897 shutdown_connections 2024-09-19T07:22:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.385+0000 7faa36586640 1 --2- 172.21.15.98:0/255541897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa3010c0d0 0x7faa3010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.385+0000 7faa36586640 1 --2- 172.21.15.98:0/255541897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa301035a0 0x7faa3010ba80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.385+0000 7faa36586640 1 --2- 172.21.15.98:0/255541897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa30102c80 0x7faa30103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.385+0000 7faa36586640 1 -- 172.21.15.98:0/255541897 >> 172.21.15.98:0/255541897 conn(0x7faa30077990 msgr2=0x7faa300fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.385+0000 7faa36586640 1 -- 172.21.15.98:0/255541897 shutdown_connections 2024-09-19T07:22:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.385+0000 7faa36586640 1 -- 172.21.15.98:0/255541897 wait complete. 2024-09-19T07:22:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.386+0000 7faa36586640 1 Processor -- start 2024-09-19T07:22:28.387 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.386+0000 7faa36586640 1 -- start start 2024-09-19T07:22:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.386+0000 7faa36586640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa30102c80 0x7faa30198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.386+0000 7faa36586640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa301035a0 0x7faa301988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.386+0000 7faa36586640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3010c0d0 0x7faa3019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.389 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.386+0000 7faa36586640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa30111eb0 con 0x7faa3010c0d0 2024-09-19T07:22:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.386+0000 7faa36586640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa30111d30 con 0x7faa301035a0 2024-09-19T07:22:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.386+0000 7faa36586640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa30112030 con 0x7faa30102c80 2024-09-19T07:22:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.386+0000 7faa34b23640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3010c0d0 0x7faa3019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa34b23640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3010c0d0 0x7faa3019cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58906/0 (socket says 172.21.15.98:58906) 2024-09-19T07:22:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa34b23640 1 -- 172.21.15.98:0/1324067769 learned_addr learned my addr 172.21.15.98:0/1324067769 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa301035a0 0x7faa301988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa2ffff640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa30102c80 0x7faa30198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa34b23640 1 -- 172.21.15.98:0/1324067769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa30102c80 msgr2=0x7faa30198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa34b23640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa30102c80 0x7faa30198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa34b23640 1 -- 172.21.15.98:0/1324067769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa301035a0 msgr2=0x7faa301988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa34b23640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa301035a0 0x7faa301988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa34b23640 1 -- 172.21.15.98:0/1324067769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3019d350 con 0x7faa3010c0d0 2024-09-19T07:22:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa301035a0 0x7faa301988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa34b23640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3010c0d0 0x7faa3019cc20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7faa28009fd0 tx=0x7faa2800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa2d7fa640 1 -- 172.21.15.98:0/1324067769 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28017070 con 0x7faa3010c0d0 2024-09-19T07:22:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa2d7fa640 1 -- 172.21.15.98:0/1324067769 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa28003e50 con 0x7faa3010c0d0 2024-09-19T07:22:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa36586640 1 -- 172.21.15.98:0/1324067769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3019d640 con 0x7faa3010c0d0 2024-09-19T07:22:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa2d7fa640 1 -- 172.21.15.98:0/1324067769 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa280106c0 con 0x7faa3010c0d0 2024-09-19T07:22:28.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.387+0000 7faa36586640 1 -- 172.21.15.98:0/1324067769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa301a4ed0 con 0x7faa3010c0d0 2024-09-19T07:22:28.397 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.390+0000 7faa2d7fa640 1 -- 172.21.15.98:0/1324067769 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7faa28003970 con 0x7faa3010c0d0 2024-09-19T07:22:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.390+0000 7faa393f9740 1 Processor -- start 2024-09-19T07:22:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.390+0000 7faa393f9740 1 -- start start 2024-09-19T07:22:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.390+0000 7faa393f9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfcaf0 0x557cd3bfced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.390+0000 7faa393f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3bfd410 0x557cd3c07770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.390+0000 7faa393f9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3c07cb0 0x557cd3c0a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.390+0000 7faa393f9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557cd3b612f0 con 0x557cd3c07cb0 2024-09-19T07:22:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.390+0000 7faa393f9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557cd3b09270 con 0x557cd3bfcaf0 2024-09-19T07:22:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.390+0000 7faa393f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557cd3b5d2b0 con 0x557cd3bfd410 2024-09-19T07:22:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.390+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3c07cb0 0x557cd3c0a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3c07cb0 0x557cd3c0a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58914/0 (socket says 172.21.15.98:58914) 2024-09-19T07:22:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa2f7fe640 1 -- 172.21.15.98:0/2524745361 learned_addr learned my addr 172.21.15.98:0/2524745361 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:28.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa2d7fa640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa180a3580 0x7faa180a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa2ffff640 1 --2- 172.21.15.98:0/2524745361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3bfd410 0x557cd3c07770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/2524745361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfcaf0 0x557cd3bfced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa2f7fe640 1 -- 172.21.15.98:0/2524745361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3bfd410 msgr2=0x557cd3c07770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:28.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/2524745361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3bfd410 0x557cd3c07770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa2f7fe640 1 -- 172.21.15.98:0/2524745361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfcaf0 msgr2=0x557cd3bfced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:28.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/2524745361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfcaf0 0x557cd3bfced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa34b23640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa180a3580 0x7faa180a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa2f7fe640 1 -- 172.21.15.98:0/2524745361 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cd3b08340 con 0x557cd3c07cb0 2024-09-19T07:22:28.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa2d7fa640 1 -- 172.21.15.98:0/1324067769 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7faa280cfde0 con 0x7faa3010c0d0 2024-09-19T07:22:28.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/2524745361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3c07cb0 0x557cd3c0a0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faa24005940 tx=0x7faa24005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199436093c7ed723 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:28.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa167fc640 1 -- 172.21.15.98:0/2524745361 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24043020 con 0x557cd3c07cb0 2024-09-19T07:22:28.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa167fc640 1 -- 172.21.15.98:0/2524745361 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa24031970 con 0x557cd3c07cb0 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.391+0000 7faa167fc640 1 -- 172.21.15.98:0/2524745361 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24035050 con 0x557cd3c07cb0 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.392+0000 7faa393f9740 1 -- 172.21.15.98:0/2524745361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3c07cb0 msgr2=0x557cd3c0a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.392+0000 7faa393f9740 1 --2- 172.21.15.98:0/2524745361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3c07cb0 0x557cd3c0a0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faa24005940 tx=0x7faa24005bd0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.392+0000 7faa34b23640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa180a3580 0x7faa180a5a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa280cd3e0 tx=0x7faa2806ab30 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.392+0000 7faa393f9740 1 -- 172.21.15.98:0/2524745361 shutdown_connections 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.392+0000 7faa393f9740 1 --2- 172.21.15.98:0/2524745361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3c07cb0 0x557cd3c0a0a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.392+0000 7faa393f9740 1 --2- 172.21.15.98:0/2524745361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3bfd410 0x557cd3c07770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.392+0000 7faa393f9740 1 --2- 172.21.15.98:0/2524745361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfcaf0 0x557cd3bfced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.392+0000 7faa393f9740 1 -- 172.21.15.98:0/2524745361 >> 172.21.15.98:0/2524745361 conn(0x557cd3bf9060 msgr2=0x557cd3bf9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.392+0000 7faa393f9740 1 -- 172.21.15.98:0/2524745361 shutdown_connections 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.392+0000 7faa393f9740 1 -- 172.21.15.98:0/2524745361 wait complete. 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.392+0000 7faa393f9740 1 -- start start 2024-09-19T07:22:28.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa393f9740 1 Processor -- start 2024-09-19T07:22:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa393f9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfcaf0 0x557cd3c04be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa393f9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfd410 0x557cd3c05120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa393f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3c07cb0 0x557cd3c05660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa393f9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557cd3c0a880 con 0x557cd3bfd410 2024-09-19T07:22:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa393f9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557cd3aea290 con 0x557cd3bfcaf0 2024-09-19T07:22:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa393f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557cd3c0aa00 con 0x557cd3c07cb0 2024-09-19T07:22:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa393f9740 10 client.0 _ll_register_callbacks cb 0x557cd3b1b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa2ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfd410 0x557cd3c05120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa2ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfd410 0x557cd3c05120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58928/0 (socket says 172.21.15.98:58928) 2024-09-19T07:22:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa2ffff640 1 -- 172.21.15.98:0/864936101 learned_addr learned my addr 172.21.15.98:0/864936101 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3c07cb0 0x557cd3c05660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfcaf0 0x557cd3c04be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa2ffff640 1 -- 172.21.15.98:0/864936101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3c07cb0 msgr2=0x557cd3c05660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa2ffff640 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3c07cb0 0x557cd3c05660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa2ffff640 1 -- 172.21.15.98:0/864936101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfcaf0 msgr2=0x557cd3c04be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa2ffff640 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfcaf0 0x557cd3c04be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa2ffff640 1 -- 172.21.15.98:0/864936101 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cd3874210 con 0x557cd3bfd410 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfcaf0 0x557cd3c04be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa2ffff640 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfd410 0x557cd3c05120 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faa2000bf00 tx=0x7faa200117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed1500e647e019 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa0f7fe640 1 -- 172.21.15.98:0/864936101 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20004220 con 0x557cd3bfd410 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa0f7fe640 1 -- 172.21.15.98:0/864936101 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7faa200043c0 con 0x557cd3bfd410 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.393+0000 7faa393f9740 1 -- 172.21.15.98:0/864936101 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa24031970 con 0x557cd3bfd410 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.394+0000 7faa0f7fe640 1 -- 172.21.15.98:0/864936101 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faa200035f0 con 0x557cd3bfd410 2024-09-19T07:22:28.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.394+0000 7faa393f9740 10 client.15381 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.394+0000 7faa393f9740 1 -- 172.21.15.98:0/864936101 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557cd3940620 con 0x557cd3bfd410 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.394+0000 7faa0f7fe640 1 -- 172.21.15.98:0/864936101 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa24031970 con 0x557cd3bfd410 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.394+0000 7faa0f7fe640 1 -- 172.21.15.98:0/864936101 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faa2001bac0 con 0x557cd3bfd410 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.394+0000 7faa393f9740 10 client.15381 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.394+0000 7faa393f9740 10 client.15381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.394+0000 7faa393f9740 20 client.15381 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.394+0000 7faa393f9740 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557cd3c17d00 0x557cd3c1a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.394+0000 7faa393f9740 4 client.15381 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.394+0000 7faa393f9740 1 -- 172.21.15.98:0/864936101 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557cd3b6ea20 con 0x557cd3c17d00 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.394+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557cd3c17d00 0x557cd3c1a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.395+0000 7faa0f7fe640 10 client.15381 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.395+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557cd3c17d00 0x557cd3c1a0f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b43515fd41b09f6 server_cookie=29bcf346411bd258 in_seq=0 out_seq=0 2024-09-19T07:22:28.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.395+0000 7faa0f7fe640 1 -- 172.21.15.98:0/864936101 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557cd3b6ea20 con 0x557cd3c17d00 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.395+0000 7faa0f7fe640 10 client.15381 handle_command_reply: tid=0 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa393f9740 1 client.15381 shutdown 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa393f9740 1 -- 172.21.15.98:0/864936101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfd410 msgr2=0x557cd3c05120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa393f9740 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfd410 0x557cd3c05120 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faa2000bf00 tx=0x7faa200117b0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa393f9740 1 -- 172.21.15.98:0/864936101 shutdown_connections 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa393f9740 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3c07cb0 0x557cd3c05660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa393f9740 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557cd3c17d00 0x557cd3c1a0f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa393f9740 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfd410 0x557cd3c05120 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa0f7fe640 0 client.15381 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa393f9740 1 --2- 172.21.15.98:0/864936101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfcaf0 0x557cd3c04be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa393f9740 1 -- 172.21.15.98:0/864936101 >> 172.21.15.98:0/864936101 conn(0x557cd3bf9060 msgr2=0x557cd3bfed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa393f9740 1 -- 172.21.15.98:0/864936101 shutdown_connections 2024-09-19T07:22:28.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa393f9740 1 -- 172.21.15.98:0/864936101 wait complete. 2024-09-19T07:22:28.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.396+0000 7faa393f9740 20 client.15381 trim_cache size 0 max 16384 2024-09-19T07:22:28.414 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.410+0000 7faa393f9740 1 Processor -- start 2024-09-19T07:22:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.410+0000 7faa393f9740 1 -- start start 2024-09-19T07:22:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.410+0000 7faa393f9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 0x557cd3c05490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.410+0000 7faa393f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3bfd410 0x557cd3c100a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.410+0000 7faa393f9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3c07cb0 0x557cd3c105e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.410+0000 7faa393f9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa301b0040 con 0x557cd3bfcaf0 2024-09-19T07:22:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.410+0000 7faa393f9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa301ad910 con 0x557cd3c07cb0 2024-09-19T07:22:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.410+0000 7faa393f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa301ab760 con 0x557cd3bfd410 2024-09-19T07:22:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.410+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 0x557cd3c05490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.410+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 0x557cd3c05490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58936/0 (socket says 172.21.15.98:58936) 2024-09-19T07:22:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.410+0000 7faa2f7fe640 1 -- 172.21.15.98:0/1590402489 learned_addr learned my addr 172.21.15.98:0/1590402489 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa2f7fe640 1 -- 172.21.15.98:0/1590402489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3bfd410 msgr2=0x557cd3c100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:28.415 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/1590402489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3bfd410 0x557cd3c100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa2f7fe640 1 -- 172.21.15.98:0/1590402489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3c07cb0 msgr2=0x557cd3c105e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/1590402489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3c07cb0 0x557cd3c105e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa2f7fe640 1 -- 172.21.15.98:0/1590402489 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cd3bfd240 con 0x557cd3bfcaf0 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/1590402489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 0x557cd3c05490 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faa24005e90 tx=0x7faa24005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142ca5822d99b3ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa15ffb640 1 -- 172.21.15.98:0/1590402489 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24035070 con 0x557cd3bfcaf0 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa15ffb640 1 -- 172.21.15.98:0/1590402489 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa24031b90 con 0x557cd3bfcaf0 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa15ffb640 1 -- 172.21.15.98:0/1590402489 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24043040 con 0x557cd3bfcaf0 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa393f9740 1 -- 172.21.15.98:0/1590402489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 msgr2=0x557cd3c05490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa393f9740 1 --2- 172.21.15.98:0/1590402489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 0x557cd3c05490 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faa24005e90 tx=0x7faa24005bd0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa393f9740 1 -- 172.21.15.98:0/1590402489 shutdown_connections 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa393f9740 1 --2- 172.21.15.98:0/1590402489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3c07cb0 0x557cd3c105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa393f9740 1 --2- 172.21.15.98:0/1590402489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3bfd410 0x557cd3c100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.416 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa393f9740 1 --2- 172.21.15.98:0/1590402489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 0x557cd3c05490 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa393f9740 1 -- 172.21.15.98:0/1590402489 >> 172.21.15.98:0/1590402489 conn(0x557cd3bf9060 msgr2=0x557cd3c06c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa393f9740 1 -- 172.21.15.98:0/1590402489 shutdown_connections 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.411+0000 7faa393f9740 1 -- 172.21.15.98:0/1590402489 wait complete. 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa393f9740 1 -- start start 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa393f9740 1 Processor -- start 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa393f9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 0x557cd3c00e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa393f9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfd410 0x557cd3c01370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa393f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3c07cb0 0x557cd3c01910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa393f9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa301abdd0 con 0x557cd3bfcaf0 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa393f9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa301ad240 con 0x557cd3bfd410 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa393f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa301ac4a0 con 0x557cd3c07cb0 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa393f9740 10 client.0 _ll_register_callbacks cb 0x7faa2000b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 0x557cd3c00e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa2f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 0x557cd3c00e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58940/0 (socket says 172.21.15.98:58940) 2024-09-19T07:22:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa2f7fe640 1 -- 172.21.15.98:0/3297512036 learned_addr learned my addr 172.21.15.98:0/3297512036 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa2ffff640 1 --2- 172.21.15.98:0/3297512036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfd410 0x557cd3c01370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.412+0000 7faa2f7fe640 1 -- 172.21.15.98:0/3297512036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3c07cb0 msgr2=0x557cd3c01910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/3297512036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3c07cb0 0x557cd3c01910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa2f7fe640 1 -- 172.21.15.98:0/3297512036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfd410 msgr2=0x557cd3c01370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/3297512036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfd410 0x557cd3c01370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa2f7fe640 1 -- 172.21.15.98:0/3297512036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cd3c02140 con 0x557cd3bfcaf0 2024-09-19T07:22:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa2f7fe640 1 --2- 172.21.15.98:0/3297512036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 0x557cd3c00e30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7faa24033000 tx=0x7faa24031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334c47ba5cc1e354 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa0f7fe640 1 -- 172.21.15.98:0/3297512036 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa24043070 con 0x557cd3bfcaf0 2024-09-19T07:22:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa0f7fe640 1 -- 172.21.15.98:0/3297512036 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7faa24051590 con 0x557cd3bfcaf0 2024-09-19T07:22:28.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa393f9740 1 -- 172.21.15.98:0/3297512036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa24031b90 con 0x557cd3bfcaf0 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa0f7fe640 1 -- 172.21.15.98:0/3297512036 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faa24035040 con 0x557cd3bfcaf0 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa393f9740 10 client.15387 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa393f9740 1 -- 172.21.15.98:0/3297512036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557cd3c87020 con 0x557cd3bfcaf0 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa0f7fe640 1 -- 172.21.15.98:0/3297512036 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa24031b90 con 0x557cd3bfcaf0 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa0f7fe640 1 -- 172.21.15.98:0/3297512036 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faa24062020 con 0x557cd3bfcaf0 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa393f9740 10 client.15387 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa393f9740 10 client.15387 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa393f9740 20 client.15387 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa393f9740 1 --2- 172.21.15.98:0/3297512036 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557cd3c871f0 0x557cd3c895e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa393f9740 4 client.15387 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.413+0000 7faa393f9740 1 -- 172.21.15.98:0/3297512036 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557cd3b68d70 con 0x557cd3c871f0 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.414+0000 7faa2ffff640 1 --2- 172.21.15.98:0/3297512036 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557cd3c871f0 0x557cd3c895e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:28.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.414+0000 7faa0f7fe640 10 client.15387 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:28.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.414+0000 7faa2ffff640 1 --2- 172.21.15.98:0/3297512036 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557cd3c871f0 0x557cd3c895e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c719071cdbe30073 server_cookie=fbe8861d4ddbb18f in_seq=0 out_seq=0 2024-09-19T07:22:28.427 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.426+0000 7faa0f7fe640 1 -- 172.21.15.98:0/3297512036 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557cd3b68d70 con 0x557cd3c871f0 2024-09-19T07:22:28.427 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.426+0000 7faa0f7fe640 10 client.15387 handle_command_reply: tid=0 2024-09-19T07:22:28.427 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.426+0000 7faa393f9740 1 client.15387 shutdown 2024-09-19T07:22:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.426+0000 7faa393f9740 1 -- 172.21.15.98:0/3297512036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 msgr2=0x557cd3c00e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.426+0000 7faa393f9740 1 --2- 172.21.15.98:0/3297512036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 0x557cd3c00e30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7faa24033000 tx=0x7faa24031920 comp rx=0 tx=0).stop 2024-09-19T07:22:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa393f9740 1 -- 172.21.15.98:0/3297512036 shutdown_connections 2024-09-19T07:22:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa393f9740 1 --2- 172.21.15.98:0/3297512036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557cd3c07cb0 0x557cd3c01910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa393f9740 1 --2- 172.21.15.98:0/3297512036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557cd3bfd410 0x557cd3c01370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa393f9740 1 --2- 172.21.15.98:0/3297512036 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557cd3c871f0 0x557cd3c895e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa393f9740 1 --2- 172.21.15.98:0/3297512036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557cd3bfcaf0 0x557cd3c00e30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa0f7fe640 0 client.15387 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa393f9740 1 -- 172.21.15.98:0/3297512036 >> 172.21.15.98:0/3297512036 conn(0x557cd3bf9060 msgr2=0x557cd3bfe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa393f9740 1 -- 172.21.15.98:0/3297512036 shutdown_connections 2024-09-19T07:22:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa393f9740 1 -- 172.21.15.98:0/3297512036 wait complete. 2024-09-19T07:22:28.428 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa393f9740 20 client.15387 trim_cache size 0 max 16384 2024-09-19T07:22:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:22:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:22:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:22:28.429 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:22:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa36586640 1 -- 172.21.15.98:0/1324067769 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa180a3580 msgr2=0x7faa180a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa36586640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa180a3580 0x7faa180a5a40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa280cd3e0 tx=0x7faa2806ab30 comp rx=0 tx=0).stop 2024-09-19T07:22:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa36586640 1 -- 172.21.15.98:0/1324067769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3010c0d0 msgr2=0x7faa3019cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa36586640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3010c0d0 0x7faa3019cc20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7faa28009fd0 tx=0x7faa2800b260 comp rx=0 tx=0).stop 2024-09-19T07:22:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa36586640 1 -- 172.21.15.98:0/1324067769 shutdown_connections 2024-09-19T07:22:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa36586640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa180a3580 0x7faa180a5a40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa36586640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa3010c0d0 0x7faa3019cc20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa36586640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa301035a0 0x7faa301988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa36586640 1 --2- 172.21.15.98:0/1324067769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa30102c80 0x7faa30198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa36586640 1 -- 172.21.15.98:0/1324067769 >> 172.21.15.98:0/1324067769 conn(0x7faa30077990 msgr2=0x7faa300fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa36586640 1 -- 172.21.15.98:0/1324067769 shutdown_connections 2024-09-19T07:22:28.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:28.427+0000 7faa36586640 1 -- 172.21.15.98:0/1324067769 wait complete. 2024-09-19T07:22:28.856 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T07:20:20.077021+0000', 'modified': '2024-09-19T07:22:04.561701+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24479, 'mds_1': 24458, 'mds_2': 24442}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24425': {'gid': 24425, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6833/587476912', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6832', 'nonce': 587476912}, {'type': 'v1', 'addr': '172.21.15.139:6833', 'nonce': 587476912}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6837/2810820400', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 2810820400}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 2810820400}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24437': {'gid': 24437, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6835/4113105598', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6834', 'nonce': 4113105598}, {'type': 'v1', 'addr': '172.21.15.139:6835', 'nonce': 4113105598}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.162:6839/609705447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 609705447}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 609705447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.139:6837/3386684827', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6836', 'nonce': 3386684827}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 3386684827}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24479': {'gid': 24479, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.139:6839/2420704228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6838', 'nonce': 2420704228}, {'type': 'v1', 'addr': '172.21.15.139:6839', 'nonce': 2420704228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24479, 'qdb_cluster': [24479, 24458, 24442]} 2024-09-19T07:22:28.856 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T07:22:28.856 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T07:22:29.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:28 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/189577792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:29.140 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:29.261 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:28 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/189577792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:29.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:28 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/189577792' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:29.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.594+0000 7f0f4bb79640 1 -- 172.21.15.98:0/718529127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f44105f40 msgr2=0x7f0f441063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:29.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.594+0000 7f0f4bb79640 1 --2- 172.21.15.98:0/718529127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f44105f40 0x7f0f441063d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009ca0 tx=0x7f0f3c02a940 comp rx=0 tx=0).stop 2024-09-19T07:22:29.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.594+0000 7f0f4bb79640 1 -- 172.21.15.98:0/718529127 shutdown_connections 2024-09-19T07:22:29.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.594+0000 7f0f4bb79640 1 --2- 172.21.15.98:0/718529127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f44105f40 0x7f0f441063d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.594+0000 7f0f4bb79640 1 --2- 172.21.15.98:0/718529127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f44101450 0x7f0f44105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.594+0000 7f0f4bb79640 1 --2- 172.21.15.98:0/718529127 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f44100b30 0x7f0f44100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.594+0000 7f0f4bb79640 1 -- 172.21.15.98:0/718529127 >> 172.21.15.98:0/718529127 conn(0x7f0f440fc7a0 msgr2=0x7f0f440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:29.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.595+0000 7f0f4bb79640 1 -- 172.21.15.98:0/718529127 shutdown_connections 2024-09-19T07:22:29.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.595+0000 7f0f4bb79640 1 -- 172.21.15.98:0/718529127 wait complete. 2024-09-19T07:22:29.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.595+0000 7f0f4bb79640 1 Processor -- start 2024-09-19T07:22:29.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.595+0000 7f0f4bb79640 1 -- start start 2024-09-19T07:22:29.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.595+0000 7f0f4bb79640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f44100b30 0x7f0f441a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.595+0000 7f0f4bb79640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f44101450 0x7f0f441a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.595+0000 7f0f4bb79640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f44105f40 0x7f0f4419e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.595+0000 7f0f4bb79640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0f44118560 con 0x7f0f44105f40 2024-09-19T07:22:29.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.595+0000 7f0f4bb79640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0f441183e0 con 0x7f0f44101450 2024-09-19T07:22:29.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.595+0000 7f0f4bb79640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0f441186e0 con 0x7f0f44100b30 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.595+0000 7f0f4a116640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f44105f40 0x7f0f4419e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.595+0000 7f0f4a116640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f44105f40 0x7f0f4419e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58962/0 (socket says 172.21.15.98:58962) 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f4a116640 1 -- 172.21.15.98:0/672109812 learned_addr learned my addr 172.21.15.98:0/672109812 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f49915640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f44100b30 0x7f0f441a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f49114640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f44101450 0x7f0f441a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f4a116640 1 -- 172.21.15.98:0/672109812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f44100b30 msgr2=0x7f0f441a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f4a116640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f44100b30 0x7f0f441a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f4a116640 1 -- 172.21.15.98:0/672109812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f44101450 msgr2=0x7f0f441a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f4a116640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f44101450 0x7f0f441a4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f4a116640 1 -- 172.21.15.98:0/672109812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4419ef50 con 0x7f0f44105f40 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f4a116640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f44105f40 0x7f0f4419e7b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c006010 tx=0x7f0f3c02f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f36ffd640 1 -- 172.21.15.98:0/672109812 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c034040 con 0x7f0f44105f40 2024-09-19T07:22:29.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f36ffd640 1 -- 172.21.15.98:0/672109812 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f3c003e50 con 0x7f0f44105f40 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f4bb79640 1 -- 172.21.15.98:0/672109812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4419f1e0 con 0x7f0f44105f40 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f36ffd640 1 -- 172.21.15.98:0/672109812 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c004800 con 0x7f0f44105f40 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.596+0000 7f0f4bb79640 1 -- 172.21.15.98:0/672109812 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f441ab490 con 0x7f0f44105f40 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.598+0000 7f0f36ffd640 1 -- 172.21.15.98:0/672109812 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f0f3c037020 con 0x7f0f44105f40 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.598+0000 7f0f4df52740 1 Processor -- start 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f4df52740 1 -- start start 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f4df52740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 0x5653f1882db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f4df52740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18832f0 0x5653f188d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f4df52740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 0x5653f188ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f4df52740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5653f17e9090 con 0x5653f18829d0 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f4df52740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5653f1790a70 con 0x5653f18832f0 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f4df52740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5653f17e5050 con 0x5653f188dbb0 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f49114640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 0x5653f1882db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.618 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f49114640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 0x5653f1882db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58968/0 (socket says 172.21.15.98:58968) 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f49114640 1 -- 172.21.15.98:0/1333339764 learned_addr learned my addr 172.21.15.98:0/1333339764 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f36ffd640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0f300a34d0 0x7f0f300a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f49915640 1 --2- 172.21.15.98:0/1333339764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18832f0 0x5653f188d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f4a116640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0f300a34d0 0x7f0f300a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f49114640 1 --2- 172.21.15.98:0/1333339764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 0x5653f188ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f49114640 1 -- 172.21.15.98:0/1333339764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 msgr2=0x5653f188ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f49114640 1 --2- 172.21.15.98:0/1333339764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 0x5653f188ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f49114640 1 -- 172.21.15.98:0/1333339764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18832f0 msgr2=0x5653f188d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.599+0000 7f0f49114640 1 --2- 172.21.15.98:0/1333339764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18832f0 0x5653f188d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.600+0000 7f0f49114640 1 -- 172.21.15.98:0/1333339764 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653f179d130 con 0x5653f18829d0 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.600+0000 7f0f36ffd640 1 -- 172.21.15.98:0/672109812 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0f3c0f0eb0 con 0x7f0f44105f40 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.600+0000 7f0f49915640 1 --2- 172.21.15.98:0/1333339764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18832f0 0x5653f188d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.600+0000 7f0f49114640 1 --2- 172.21.15.98:0/1333339764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 0x5653f1882db0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0f38004650 tx=0x7f0f38008510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ca1575b7669f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:29.619 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.600+0000 7f0f4a116640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0f300a34d0 0x7f0f300a5990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0ee5c0 tx=0x7f0f3c004290 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.600+0000 7f0f2ffff640 1 -- 172.21.15.98:0/1333339764 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38010e80 con 0x5653f18829d0 2024-09-19T07:22:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.600+0000 7f0f2ffff640 1 -- 172.21.15.98:0/1333339764 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f38012b40 con 0x5653f18829d0 2024-09-19T07:22:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.600+0000 7f0f2ffff640 1 -- 172.21.15.98:0/1333339764 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3800eb30 con 0x5653f18829d0 2024-09-19T07:22:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 -- 172.21.15.98:0/1333339764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 msgr2=0x5653f1882db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 --2- 172.21.15.98:0/1333339764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 0x5653f1882db0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0f38004650 tx=0x7f0f38008510 comp rx=0 tx=0).stop 2024-09-19T07:22:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 -- 172.21.15.98:0/1333339764 shutdown_connections 2024-09-19T07:22:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 --2- 172.21.15.98:0/1333339764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 0x5653f188ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 --2- 172.21.15.98:0/1333339764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18832f0 0x5653f188d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 --2- 172.21.15.98:0/1333339764 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 0x5653f1882db0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 -- 172.21.15.98:0/1333339764 >> 172.21.15.98:0/1333339764 conn(0x5653f187ef60 msgr2=0x5653f187f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 -- 172.21.15.98:0/1333339764 shutdown_connections 2024-09-19T07:22:29.620 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 -- 172.21.15.98:0/1333339764 wait complete. 2024-09-19T07:22:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 -- start start 2024-09-19T07:22:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 Processor -- start 2024-09-19T07:22:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f18829d0 0x5653f188d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.601+0000 7f0f4df52740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 0x5653f188a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f4df52740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f188dbb0 0x5653f188ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f4df52740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5653f1890780 con 0x5653f18832f0 2024-09-19T07:22:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f4df52740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5653f17a3f20 con 0x5653f188dbb0 2024-09-19T07:22:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f4df52740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5653f1890900 con 0x5653f18829d0 2024-09-19T07:22:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f4df52740 10 client.0 _ll_register_callbacks cb 0x5653f176d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f49915640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 0x5653f188a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.621 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f49915640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 0x5653f188a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58974/0 (socket says 172.21.15.98:58974) 2024-09-19T07:22:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f49114640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f18829d0 0x5653f188d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f49915640 1 -- 172.21.15.98:0/3138459136 learned_addr learned my addr 172.21.15.98:0/3138459136 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f49114640 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f188dbb0 0x5653f188ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f49915640 1 -- 172.21.15.98:0/3138459136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f18829d0 msgr2=0x5653f188d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f49915640 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f18829d0 0x5653f188d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f49915640 1 -- 172.21.15.98:0/3138459136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f188dbb0 msgr2=0x5653f188ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f49915640 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f188dbb0 0x5653f188ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f49915640 1 -- 172.21.15.98:0/3138459136 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653f155a2b0 con 0x5653f18832f0 2024-09-19T07:22:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f49114640 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f188dbb0 0x5653f188ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f49915640 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 0x5653f188a7c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000bfc0 tx=0x7f0f400118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf9f3eaf21526b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:29.622 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f2d7fa640 1 -- 172.21.15.98:0/3138459136 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40004020 con 0x5653f18832f0 2024-09-19T07:22:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f4df52740 1 -- 172.21.15.98:0/3138459136 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f38012b40 con 0x5653f18832f0 2024-09-19T07:22:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f2d7fa640 1 -- 172.21.15.98:0/3138459136 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0f400041c0 con 0x5653f18832f0 2024-09-19T07:22:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f2d7fa640 1 -- 172.21.15.98:0/3138459136 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0f400043c0 con 0x5653f18832f0 2024-09-19T07:22:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f4df52740 10 client.15399 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.602+0000 7f0f4df52740 1 -- 172.21.15.98:0/3138459136 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5653f189c150 con 0x5653f18832f0 2024-09-19T07:22:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.603+0000 7f0f2d7fa640 1 -- 172.21.15.98:0/3138459136 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f38012b40 con 0x5653f18832f0 2024-09-19T07:22:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.603+0000 7f0f2d7fa640 1 -- 172.21.15.98:0/3138459136 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0f40003ae0 con 0x5653f18832f0 2024-09-19T07:22:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.603+0000 7f0f4df52740 10 client.15399 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:29.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.603+0000 7f0f4df52740 10 client.15399 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:22:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.603+0000 7f0f4df52740 20 client.15399 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.603+0000 7f0f4df52740 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x5653f189e7c0 0x5653f189fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.603+0000 7f0f4df52740 4 client.15399 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.603+0000 7f0f4df52740 1 -- 172.21.15.98:0/3138459136 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653f17f6600 con 0x5653f189e7c0 2024-09-19T07:22:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.603+0000 7f0f49114640 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x5653f189e7c0 0x5653f189fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.603+0000 7f0f2d7fa640 10 client.15399 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:22:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.603+0000 7f0f49114640 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x5653f189e7c0 0x5653f189fc30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a59550aac57347d2 server_cookie=10e8dcb20c3f3473 in_seq=0 out_seq=0 2024-09-19T07:22:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.604+0000 7f0f2d7fa640 1 -- 172.21.15.98:0/3138459136 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653f17f6600 con 0x5653f189e7c0 2024-09-19T07:22:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.604+0000 7f0f2d7fa640 10 client.15399 handle_command_reply: tid=0 2024-09-19T07:22:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.604+0000 7f0f4df52740 1 client.15399 shutdown 2024-09-19T07:22:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.604+0000 7f0f4df52740 1 -- 172.21.15.98:0/3138459136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 msgr2=0x5653f188a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:29.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.604+0000 7f0f4df52740 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 0x5653f188a7c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000bfc0 tx=0x7f0f400118d0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.604+0000 7f0f4df52740 1 -- 172.21.15.98:0/3138459136 shutdown_connections 2024-09-19T07:22:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.604+0000 7f0f4df52740 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f188dbb0 0x5653f188ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.604+0000 7f0f4df52740 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 0x5653f188a7c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.604+0000 7f0f4df52740 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x5653f189e7c0 0x5653f189fc30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.604+0000 7f0f4df52740 1 --2- 172.21.15.98:0/3138459136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f18829d0 0x5653f188d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.604+0000 7f0f4df52740 1 -- 172.21.15.98:0/3138459136 >> 172.21.15.98:0/3138459136 conn(0x5653f187ef60 msgr2=0x5653f1884c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.604+0000 7f0f2d7fa640 0 client.15399 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:22:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.605+0000 7f0f4df52740 1 -- 172.21.15.98:0/3138459136 shutdown_connections 2024-09-19T07:22:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.605+0000 7f0f4df52740 1 -- 172.21.15.98:0/3138459136 wait complete. 2024-09-19T07:22:29.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.605+0000 7f0f4df52740 20 client.15399 trim_cache size 0 max 16384 2024-09-19T07:22:29.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.622+0000 7f0f4df52740 1 Processor -- start 2024-09-19T07:22:29.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.622+0000 7f0f4df52740 1 -- start start 2024-09-19T07:22:29.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.622+0000 7f0f4df52740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 0x5653f189fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.622+0000 7f0f4df52740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18832f0 0x5653f1879ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.622+0000 7f0f4df52740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 0x5653f1885d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.622+0000 7f0f4df52740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5653f189df70 con 0x5653f18829d0 2024-09-19T07:22:29.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.622+0000 7f0f4df52740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5653f189e640 con 0x5653f18832f0 2024-09-19T07:22:29.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.622+0000 7f0f4df52740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5653f189ed10 con 0x5653f188dbb0 2024-09-19T07:22:29.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.622+0000 7f0f49114640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 0x5653f189fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.622+0000 7f0f49114640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 0x5653f189fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58990/0 (socket says 172.21.15.98:58990) 2024-09-19T07:22:29.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.622+0000 7f0f49114640 1 -- 172.21.15.98:0/2977292031 learned_addr learned my addr 172.21.15.98:0/2977292031 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:29.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.623+0000 7f0f49915640 1 --2- 172.21.15.98:0/2977292031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18832f0 0x5653f1879ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.623+0000 7f0f49114640 1 -- 172.21.15.98:0/2977292031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 msgr2=0x5653f1885d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:29.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.623+0000 7f0f49114640 1 --2- 172.21.15.98:0/2977292031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 0x5653f1885d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.623+0000 7f0f49114640 1 -- 172.21.15.98:0/2977292031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18832f0 msgr2=0x5653f1879ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:29.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.623+0000 7f0f49114640 1 --2- 172.21.15.98:0/2977292031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18832f0 0x5653f1879ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.623+0000 7f0f49114640 1 -- 172.21.15.98:0/2977292031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653f1889770 con 0x5653f18829d0 2024-09-19T07:22:29.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.623+0000 7f0f49114640 1 --2- 172.21.15.98:0/2977292031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 0x5653f189fc30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0f38006010 tx=0x7f0f38005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3afc5aee31ddaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:29.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.623+0000 7f0f2f7fe640 1 -- 172.21.15.98:0/2977292031 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3800e3e0 con 0x5653f18829d0 2024-09-19T07:22:29.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.623+0000 7f0f2f7fe640 1 -- 172.21.15.98:0/2977292031 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f3800e580 con 0x5653f18829d0 2024-09-19T07:22:29.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.623+0000 7f0f2f7fe640 1 -- 172.21.15.98:0/2977292031 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38005580 con 0x5653f18829d0 2024-09-19T07:22:29.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.624+0000 7f0f4df52740 1 -- 172.21.15.98:0/2977292031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 msgr2=0x5653f189fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:29.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.624+0000 7f0f4df52740 1 --2- 172.21.15.98:0/2977292031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 0x5653f189fc30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0f38006010 tx=0x7f0f38005f60 comp rx=0 tx=0).stop 2024-09-19T07:22:29.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.624+0000 7f0f4df52740 1 -- 172.21.15.98:0/2977292031 shutdown_connections 2024-09-19T07:22:29.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.624+0000 7f0f4df52740 1 --2- 172.21.15.98:0/2977292031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 0x5653f1885d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.624+0000 7f0f4df52740 1 --2- 172.21.15.98:0/2977292031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18832f0 0x5653f1879ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.624+0000 7f0f4df52740 1 --2- 172.21.15.98:0/2977292031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18829d0 0x5653f189fc30 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.624+0000 7f0f4df52740 1 -- 172.21.15.98:0/2977292031 >> 172.21.15.98:0/2977292031 conn(0x5653f187ef60 msgr2=0x5653f1885610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:29.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.624+0000 7f0f4df52740 1 -- 172.21.15.98:0/2977292031 shutdown_connections 2024-09-19T07:22:29.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.624+0000 7f0f4df52740 1 -- 172.21.15.98:0/2977292031 wait complete. 2024-09-19T07:22:29.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.624+0000 7f0f4df52740 1 -- start start 2024-09-19T07:22:29.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.624+0000 7f0f4df52740 1 Processor -- start 2024-09-19T07:22:29.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f4df52740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18829d0 0x5653f18a8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f4df52740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 0x5653f18a8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f4df52740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 0x5653f18a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f4df52740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5653f189fab0 con 0x5653f18832f0 2024-09-19T07:22:29.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f4df52740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5653f189f3e0 con 0x5653f18829d0 2024-09-19T07:22:29.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f4df52740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5653f18a0180 con 0x5653f188dbb0 2024-09-19T07:22:29.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f4df52740 10 client.0 _ll_register_callbacks cb 0x7f0f4000bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:29.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f49915640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 0x5653f18a8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f49915640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 0x5653f18a8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58994/0 (socket says 172.21.15.98:58994) 2024-09-19T07:22:29.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f49915640 1 -- 172.21.15.98:0/2331402512 learned_addr learned my addr 172.21.15.98:0/2331402512 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:29.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f49114640 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18829d0 0x5653f18a8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f49114640 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 0x5653f18a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f49915640 1 -- 172.21.15.98:0/2331402512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 msgr2=0x5653f18a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:29.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f49915640 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 0x5653f18a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f49915640 1 -- 172.21.15.98:0/2331402512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18829d0 msgr2=0x5653f18a8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:29.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f49915640 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18829d0 0x5653f18a8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f49915640 1 -- 172.21.15.98:0/2331402512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653f18a1fb0 con 0x5653f18832f0 2024-09-19T07:22:29.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f49114640 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 0x5653f18a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:29.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f49915640 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 0x5653f18a8790 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0f40006010 tx=0x7f0f40005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef2c48d0cc2d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:29.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.625+0000 7f0f2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:29.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f2d7fa640 1 -- 172.21.15.98:0/2331402512 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40003bb0 con 0x5653f18832f0 2024-09-19T07:22:29.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f2d7fa640 1 -- 172.21.15.98:0/2331402512 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0f40005030 con 0x5653f18832f0 2024-09-19T07:22:29.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f4df52740 1 -- 172.21.15.98:0/2331402512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f3800e580 con 0x5653f18832f0 2024-09-19T07:22:29.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f2d7fa640 1 -- 172.21.15.98:0/2331402512 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0f40039050 con 0x5653f18832f0 2024-09-19T07:22:29.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f4df52740 10 client.15405 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:29.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f4df52740 1 -- 172.21.15.98:0/2331402512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5653f18a6a10 con 0x5653f18832f0 2024-09-19T07:22:29.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f2d7fa640 1 -- 172.21.15.98:0/2331402512 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f3800e580 con 0x5653f18832f0 2024-09-19T07:22:29.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f2d7fa640 1 -- 172.21.15.98:0/2331402512 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0f40010cc0 con 0x5653f18832f0 2024-09-19T07:22:29.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f4df52740 10 client.15405 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:29.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f4df52740 10 client.15405 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T07:22:29.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f4df52740 20 client.15405 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:29.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f4df52740 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x5653f190d7b0 0x5653f190c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:29.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f4df52740 4 client.15405 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:22:29.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.626+0000 7f0f4df52740 1 -- 172.21.15.98:0/2331402512 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "status"}) -- 0x5653f17f0b10 con 0x5653f190d7b0 2024-09-19T07:22:29.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f49114640 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x5653f190d7b0 0x5653f190c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:29.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f49114640 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x5653f190d7b0 0x5653f190c4c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a750f1b549183622 server_cookie=4a0b6a933ed75a0a in_seq=0 out_seq=0 2024-09-19T07:22:29.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f2d7fa640 10 client.15405 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:22:29.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f2d7fa640 1 -- 172.21.15.98:0/2331402512 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5653f17f0b10 con 0x5653f190d7b0 2024-09-19T07:22:29.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f2d7fa640 10 client.15405 handle_command_reply: tid=0 2024-09-19T07:22:29.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f4df52740 1 client.15405 shutdown 2024-09-19T07:22:29.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f4df52740 1 -- 172.21.15.98:0/2331402512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 msgr2=0x5653f18a8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:29.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f4df52740 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 0x5653f18a8790 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0f40006010 tx=0x7f0f40005c60 comp rx=0 tx=0).stop 2024-09-19T07:22:29.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f4df52740 1 -- 172.21.15.98:0/2331402512 shutdown_connections 2024-09-19T07:22:29.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f4df52740 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x5653f190d7b0 0x5653f190c4c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f4df52740 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653f188dbb0 0x5653f18a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f4df52740 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5653f18832f0 0x5653f18a8790 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f4df52740 1 --2- 172.21.15.98:0/2331402512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5653f18829d0 0x5653f18a8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f2d7fa640 0 client.15405 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:22:29.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f4df52740 1 -- 172.21.15.98:0/2331402512 >> 172.21.15.98:0/2331402512 conn(0x5653f187ef60 msgr2=0x5653f188c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:29.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f4df52740 1 -- 172.21.15.98:0/2331402512 shutdown_connections 2024-09-19T07:22:29.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.627+0000 7f0f4df52740 1 -- 172.21.15.98:0/2331402512 wait complete. 2024-09-19T07:22:29.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4df52740 20 client.15405 trim_cache size 0 max 16384 2024-09-19T07:22:29.644 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:22:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "73438718-7656-11ef-bceb-c7b262605968", 2024-09-19T07:22:29.644 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 2, 2024-09-19T07:22:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 24442, 2024-09-19T07:22:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-19T07:22:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-19T07:22:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-19T07:22:29.645 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 120.882488219, 2024-09-19T07:22:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 24, 2024-09-19T07:22:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 81, 2024-09-19T07:22:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T07:22:29.646 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 147.66029262999999 2024-09-19T07:22:29.646 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:22:29.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4bb79640 1 -- 172.21.15.98:0/672109812 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0f300a34d0 msgr2=0x7f0f300a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:29.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4bb79640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0f300a34d0 0x7f0f300a5990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0ee5c0 tx=0x7f0f3c004290 comp rx=0 tx=0).stop 2024-09-19T07:22:29.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4bb79640 1 -- 172.21.15.98:0/672109812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f44105f40 msgr2=0x7f0f4419e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:29.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4bb79640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f44105f40 0x7f0f4419e7b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c006010 tx=0x7f0f3c02f700 comp rx=0 tx=0).stop 2024-09-19T07:22:29.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4bb79640 1 -- 172.21.15.98:0/672109812 shutdown_connections 2024-09-19T07:22:29.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4bb79640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0f300a34d0 0x7f0f300a5990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4bb79640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f44105f40 0x7f0f4419e7b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4bb79640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f44101450 0x7f0f441a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4bb79640 1 --2- 172.21.15.98:0/672109812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0f44100b30 0x7f0f441a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:29.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4bb79640 1 -- 172.21.15.98:0/672109812 >> 172.21.15.98:0/672109812 conn(0x7f0f440fc7a0 msgr2=0x7f0f441038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:29.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4bb79640 1 -- 172.21.15.98:0/672109812 shutdown_connections 2024-09-19T07:22:29.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:29.628+0000 7f0f4bb79640 1 -- 172.21.15.98:0/672109812 wait complete. 2024-09-19T07:22:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:29 smithi162 ceph-mon[35726]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T07:22:30.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:29 smithi098 ceph-mon[30950]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T07:22:30.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:29 smithi139 ceph-mon[35039]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T07:22:30.347 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T07:22:30.592 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:31.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.044+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/2222360569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fb4102d30 msgr2=0x7f8fb4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:31.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.044+0000 7f8fbc4bc640 1 --2- 172.21.15.98:0/2222360569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fb4102d30 0x7f8fb4103110 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009930 tx=0x7f8fb002a420 comp rx=0 tx=0).stop 2024-09-19T07:22:31.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.044+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/2222360569 shutdown_connections 2024-09-19T07:22:31.056 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.044+0000 7f8fbc4bc640 1 --2- 172.21.15.98:0/2222360569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb41082a0 0x7f8fb410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.044+0000 7f8fbc4bc640 1 --2- 172.21.15.98:0/2222360569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb41036e0 0x7f8fb4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.044+0000 7f8fbc4bc640 1 --2- 172.21.15.98:0/2222360569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fb4102d30 0x7f8fb4103110 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.044+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/2222360569 >> 172.21.15.98:0/2222360569 conn(0x7f8fb40fc7d0 msgr2=0x7f8fb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.044+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/2222360569 shutdown_connections 2024-09-19T07:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.044+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/2222360569 wait complete. 2024-09-19T07:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.044+0000 7f8fbc4bc640 1 Processor -- start 2024-09-19T07:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.044+0000 7f8fbc4bc640 1 -- start start 2024-09-19T07:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbc4bc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb4102d30 0x7f8fb41985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbc4bc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb41036e0 0x7f8fb4198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbc4bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fb41082a0 0x7f8fb419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.057 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbc4bc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb41120a0 con 0x7f8fb41082a0 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbc4bc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4111f20 con 0x7f8fb4102d30 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbc4bc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb4112220 con 0x7f8fb41036e0 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbaa59640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fb41082a0 0x7f8fb419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbaa59640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fb41082a0 0x7f8fb419cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59012/0 (socket says 172.21.15.98:59012) 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbaa59640 1 -- 172.21.15.98:0/1086554595 learned_addr learned my addr 172.21.15.98:0/1086554595 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb41036e0 0x7f8fb4198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fba258640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb4102d30 0x7f8fb41985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbaa59640 1 -- 172.21.15.98:0/1086554595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb41036e0 msgr2=0x7f8fb4198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbaa59640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb41036e0 0x7f8fb4198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbaa59640 1 -- 172.21.15.98:0/1086554595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb4102d30 msgr2=0x7f8fb41985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbaa59640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb4102d30 0x7f8fb41985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbaa59640 1 -- 172.21.15.98:0/1086554595 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb419d5a0 con 0x7f8fb41082a0 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fba258640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb4102d30 0x7f8fb41985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:31.058 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbaa59640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fb41082a0 0x7f8fb419cec0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00eb10 tx=0x7f8fac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fab7fe640 1 -- 172.21.15.98:0/1086554595 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac004b20 con 0x7f8fb41082a0 2024-09-19T07:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fab7fe640 1 -- 172.21.15.98:0/1086554595 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fac004cc0 con 0x7f8fb41082a0 2024-09-19T07:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/1086554595 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb419d890 con 0x7f8fb41082a0 2024-09-19T07:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fab7fe640 1 -- 172.21.15.98:0/1086554595 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac010760 con 0x7f8fb41082a0 2024-09-19T07:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.045+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/1086554595 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb41a5170 con 0x7f8fb41082a0 2024-09-19T07:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fab7fe640 1 -- 172.21.15.98:0/1086554595 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f8fac005020 con 0x7f8fb41082a0 2024-09-19T07:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fbe895740 1 Processor -- start 2024-09-19T07:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fbe895740 1 -- start start 2024-09-19T07:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fbe895740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 0x561de5e6cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fbe895740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 0x561de5e77670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fbe895740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e77bb0 0x561de5e79fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.059 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fbe895740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561de5dd3090 con 0x561de5e6d2f0 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fbe895740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561de5d7aa70 con 0x561de5e6c9d0 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fbe895740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561de5dcf050 con 0x561de5e77bb0 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fba258640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 0x561de5e77670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fba258640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 0x561de5e77670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59028/0 (socket says 172.21.15.98:59028) 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fba258640 1 -- 172.21.15.98:0/3276495770 learned_addr learned my addr 172.21.15.98:0/3276495770 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/3276495770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 0x561de5e6cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.048+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/3276495770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e77bb0 0x561de5e79fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fab7fe640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8fa00a3550 0x7f8fa00a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fba258640 1 -- 172.21.15.98:0/3276495770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e77bb0 msgr2=0x561de5e79fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fba258640 1 --2- 172.21.15.98:0/3276495770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e77bb0 0x561de5e79fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fba258640 1 -- 172.21.15.98:0/3276495770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 msgr2=0x561de5e6cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fba258640 1 --2- 172.21.15.98:0/3276495770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 0x561de5e6cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fba258640 1 -- 172.21.15.98:0/3276495770 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de5d87130 con 0x561de5e6d2f0 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fbaa59640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8fa00a3550 0x7f8fa00a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fab7fe640 1 -- 172.21.15.98:0/1086554595 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8fac0d0660 con 0x7f8fb41082a0 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fba258640 1 --2- 172.21.15.98:0/3276495770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 0x561de5e77670 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009930 tx=0x7f8fb0005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a452195382cfb61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fa8ff9640 1 -- 172.21.15.98:0/3276495770 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb003f070 con 0x561de5e6d2f0 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fbaa59640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8fa00a3550 0x7f8fa00a5a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0cdc60 tx=0x7f8fac06e440 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fa8ff9640 1 -- 172.21.15.98:0/3276495770 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fb0004030 con 0x561de5e6d2f0 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.049+0000 7f8fa8ff9640 1 -- 172.21.15.98:0/3276495770 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0035070 con 0x561de5e6d2f0 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.050+0000 7f8fbe895740 1 -- 172.21.15.98:0/3276495770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 msgr2=0x561de5e77670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.050+0000 7f8fbe895740 1 --2- 172.21.15.98:0/3276495770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 0x561de5e77670 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009930 tx=0x7f8fb0005e60 comp rx=0 tx=0).stop 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.050+0000 7f8fbe895740 1 -- 172.21.15.98:0/3276495770 shutdown_connections 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.050+0000 7f8fbe895740 1 --2- 172.21.15.98:0/3276495770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e77bb0 0x561de5e79fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.050+0000 7f8fbe895740 1 --2- 172.21.15.98:0/3276495770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 0x561de5e77670 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.061 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.050+0000 7f8fbe895740 1 --2- 172.21.15.98:0/3276495770 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 0x561de5e6cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.050+0000 7f8fbe895740 1 -- 172.21.15.98:0/3276495770 >> 172.21.15.98:0/3276495770 conn(0x561de5e68f60 msgr2=0x561de5e69340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.050+0000 7f8fbe895740 1 -- 172.21.15.98:0/3276495770 shutdown_connections 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.050+0000 7f8fbe895740 1 -- 172.21.15.98:0/3276495770 wait complete. 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.050+0000 7f8fbe895740 1 -- start start 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fbe895740 1 Processor -- start 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fbe895740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 0x561de5e774a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fbe895740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 0x561de5e747f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fbe895740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e77bb0 0x561de5e74d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fbe895740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561de5e7a780 con 0x561de5e6d2f0 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fbe895740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561de5d8df20 con 0x561de5e6c9d0 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fbe895740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561de5e7a900 con 0x561de5e77bb0 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fbe895740 10 client.0 _ll_register_callbacks cb 0x561de5d57030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:31.062 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fba258640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 0x561de5e747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fba258640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 0x561de5e747f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59044/0 (socket says 172.21.15.98:59044) 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fba258640 1 -- 172.21.15.98:0/1443702212 learned_addr learned my addr 172.21.15.98:0/1443702212 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 0x561de5e774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e77bb0 0x561de5e74d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fba258640 1 -- 172.21.15.98:0/1443702212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e77bb0 msgr2=0x561de5e74d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fba258640 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e77bb0 0x561de5e74d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fba258640 1 -- 172.21.15.98:0/1443702212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 msgr2=0x561de5e774a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fba258640 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 0x561de5e774a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fba258640 1 -- 172.21.15.98:0/1443702212 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de5b442b0 con 0x561de5e6d2f0 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e77bb0 0x561de5e74d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8fba258640 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 0x561de5e747f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8fb002a940 tx=0x7f8fb0005530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f35a505d9100ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.051+0000 7f8f9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:31.063 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8f9dffb640 1 -- 172.21.15.98:0/1443702212 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0035070 con 0x561de5e6d2f0 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8f9dffb640 1 -- 172.21.15.98:0/1443702212 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8fb00317c0 con 0x561de5e6d2f0 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8fbe895740 1 -- 172.21.15.98:0/1443702212 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fb0004030 con 0x561de5e6d2f0 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8f9dffb640 1 -- 172.21.15.98:0/1443702212 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8fb0055050 con 0x561de5e6d2f0 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8fbe895740 10 client.15417 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8fbe895740 1 -- 172.21.15.98:0/1443702212 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561de5e860f0 con 0x561de5e6d2f0 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8f9dffb640 1 -- 172.21.15.98:0/1443702212 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fb0004030 con 0x561de5e6d2f0 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8f9dffb640 1 -- 172.21.15.98:0/1443702212 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8fb00035f0 con 0x561de5e6d2f0 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8fbe895740 10 client.15417 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8fbe895740 10 client.15417 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8fbe895740 20 client.15417 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8fbe895740 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x561de5e87440 0x561de5e89630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8fbe895740 4 client.15417 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:31.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8fbe895740 1 -- 172.21.15.98:0/1443702212 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561de5de0600 con 0x561de5e87440 2024-09-19T07:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.052+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x561de5e87440 0x561de5e89630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.053+0000 7f8f9dffb640 10 client.15417 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.053+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x561de5e87440 0x561de5e89630 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=66f30981a01fb5c7 server_cookie=4325ef3fd265f254 in_seq=0 out_seq=0 2024-09-19T07:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.053+0000 7f8f9dffb640 1 -- 172.21.15.98:0/1443702212 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561de5de0600 con 0x561de5e87440 2024-09-19T07:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.053+0000 7f8f9dffb640 10 client.15417 handle_command_reply: tid=0 2024-09-19T07:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8fbe895740 1 client.15417 shutdown 2024-09-19T07:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8fbe895740 1 -- 172.21.15.98:0/1443702212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 msgr2=0x561de5e747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8fbe895740 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 0x561de5e747f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8fb002a940 tx=0x7f8fb0005530 comp rx=0 tx=0).stop 2024-09-19T07:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8fbe895740 1 -- 172.21.15.98:0/1443702212 shutdown_connections 2024-09-19T07:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8fbe895740 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x561de5e87440 0x561de5e89630 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8fbe895740 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e77bb0 0x561de5e74d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8fbe895740 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e6d2f0 0x561de5e747f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8f9dffb640 0 client.15417 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8fbe895740 1 --2- 172.21.15.98:0/1443702212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 0x561de5e774a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8fbe895740 1 -- 172.21.15.98:0/1443702212 >> 172.21.15.98:0/1443702212 conn(0x561de5e68f60 msgr2=0x561de5e6ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8fbe895740 1 -- 172.21.15.98:0/1443702212 shutdown_connections 2024-09-19T07:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8fbe895740 1 -- 172.21.15.98:0/1443702212 wait complete. 2024-09-19T07:22:31.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.054+0000 7f8fbe895740 20 client.15417 trim_cache size 0 max 16384 2024-09-19T07:22:31.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.071+0000 7f8fbe895740 1 Processor -- start 2024-09-19T07:22:31.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.071+0000 7f8fbe895740 1 -- start start 2024-09-19T07:22:31.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fbe895740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e6c9d0 0x561de5e88890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fbe895740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6d2f0 0x561de5e76650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fbe895740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 0x561de5e71ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fbe895740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561de5e87970 con 0x561de5e77bb0 2024-09-19T07:22:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fbe895740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561de5e88040 con 0x561de5e6d2f0 2024-09-19T07:22:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fbe895740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561de5e88710 con 0x561de5e6c9d0 2024-09-19T07:22:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fb9a57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 0x561de5e71ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fb9a57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 0x561de5e71ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59048/0 (socket says 172.21.15.98:59048) 2024-09-19T07:22:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fb9a57640 1 -- 172.21.15.98:0/3155172481 learned_addr learned my addr 172.21.15.98:0/3155172481 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fb9a57640 1 -- 172.21.15.98:0/3155172481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e6c9d0 msgr2=0x561de5e88890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/3155172481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e6c9d0 0x561de5e88890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fb9a57640 1 -- 172.21.15.98:0/3155172481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6d2f0 msgr2=0x561de5e76650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/3155172481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6d2f0 0x561de5e76650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fb9a57640 1 -- 172.21.15.98:0/3155172481 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561de5e68c30 con 0x561de5e77bb0 2024-09-19T07:22:31.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/3155172481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 0x561de5e71ab0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8fb406a370 tx=0x7f8fa4014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5655ac32cfe063 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:31.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8f9ffff640 1 -- 172.21.15.98:0/3155172481 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4012d40 con 0x561de5e77bb0 2024-09-19T07:22:31.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8f9ffff640 1 -- 172.21.15.98:0/3155172481 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fa4005500 con 0x561de5e77bb0 2024-09-19T07:22:31.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.072+0000 7f8f9ffff640 1 -- 172.21.15.98:0/3155172481 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40035f0 con 0x561de5e77bb0 2024-09-19T07:22:31.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.073+0000 7f8fbe895740 1 -- 172.21.15.98:0/3155172481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 msgr2=0x561de5e71ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.073+0000 7f8fbe895740 1 --2- 172.21.15.98:0/3155172481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 0x561de5e71ab0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8fb406a370 tx=0x7f8fa4014040 comp rx=0 tx=0).stop 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.073+0000 7f8fbe895740 1 -- 172.21.15.98:0/3155172481 shutdown_connections 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.073+0000 7f8fbe895740 1 --2- 172.21.15.98:0/3155172481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 0x561de5e71ab0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.073+0000 7f8fbe895740 1 --2- 172.21.15.98:0/3155172481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6d2f0 0x561de5e76650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.073+0000 7f8fbe895740 1 --2- 172.21.15.98:0/3155172481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e6c9d0 0x561de5e88890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.073+0000 7f8fbe895740 1 -- 172.21.15.98:0/3155172481 >> 172.21.15.98:0/3155172481 conn(0x561de5e68f60 msgr2=0x561de5e75f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.073+0000 7f8fbe895740 1 -- 172.21.15.98:0/3155172481 shutdown_connections 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.073+0000 7f8fbe895740 1 -- 172.21.15.98:0/3155172481 wait complete. 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.073+0000 7f8fbe895740 1 -- start start 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.073+0000 7f8fbe895740 1 Processor -- start 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fbe895740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 0x561de5e92060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fbe895740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e6d2f0 0x561de5e8d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fbe895740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 0x561de5e8d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fbe895740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561de5e894b0 con 0x561de5e77bb0 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fbe895740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561de5e88de0 con 0x561de5e6c9d0 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fbe895740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561de5e89b80 con 0x561de5e6d2f0 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fbe895740 10 client.0 _ll_register_callbacks cb 0x7f8fa400ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fb9a57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 0x561de5e8d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fb9a57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 0x561de5e8d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59062/0 (socket says 172.21.15.98:59062) 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fb9a57640 1 -- 172.21.15.98:0/2141518365 learned_addr learned my addr 172.21.15.98:0/2141518365 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 0x561de5e92060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fba258640 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e6d2f0 0x561de5e8d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fb9a57640 1 -- 172.21.15.98:0/2141518365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e6d2f0 msgr2=0x561de5e8d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e6d2f0 0x561de5e8d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fb9a57640 1 -- 172.21.15.98:0/2141518365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 msgr2=0x561de5e92060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:31.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 0x561de5e92060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fb9a57640 1 -- 172.21.15.98:0/2141518365 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561de5e8e120 con 0x561de5e77bb0 2024-09-19T07:22:31.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fb9a57640 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 0x561de5e8d8d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4004c80 tx=0x7f8fa402f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a49089098802089 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:31.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8f9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:31.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8f9dffb640 1 -- 172.21.15.98:0/2141518365 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4004730 con 0x561de5e77bb0 2024-09-19T07:22:31.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8f9dffb640 1 -- 172.21.15.98:0/2141518365 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8fa4004d20 con 0x561de5e77bb0 2024-09-19T07:22:31.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.074+0000 7f8fbe895740 1 -- 172.21.15.98:0/2141518365 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fa4005500 con 0x561de5e77bb0 2024-09-19T07:22:31.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.075+0000 7f8f9dffb640 1 -- 172.21.15.98:0/2141518365 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8fa40048d0 con 0x561de5e77bb0 2024-09-19T07:22:31.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.075+0000 7f8fbe895740 10 client.15423 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:31.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.075+0000 7f8fbe895740 1 -- 172.21.15.98:0/2141518365 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561de5ef2900 con 0x561de5e77bb0 2024-09-19T07:22:31.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.075+0000 7f8f9dffb640 1 -- 172.21.15.98:0/2141518365 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8fa4005500 con 0x561de5e77bb0 2024-09-19T07:22:31.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.075+0000 7f8f9dffb640 1 -- 172.21.15.98:0/2141518365 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8fa402b480 con 0x561de5e77bb0 2024-09-19T07:22:31.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.075+0000 7f8fbe895740 10 client.15423 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.075+0000 7f8fbe895740 10 client.15423 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.075+0000 7f8fbe895740 20 client.15423 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.075+0000 7f8fbe895740 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x561de5e87440 0x561de5ef5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.075+0000 7f8fbe895740 4 client.15423 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.075+0000 7f8fbe895740 1 -- 172.21.15.98:0/2141518365 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "status"}) -- 0x561de5ddab10 con 0x561de5e87440 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.075+0000 7f8fba258640 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x561de5e87440 0x561de5ef5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fba258640 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x561de5e87440 0x561de5ef5dc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f79971b6978f125d server_cookie=f2771ed88b3b7eed in_seq=0 out_seq=0 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8f9dffb640 10 client.15423 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8f9dffb640 1 -- 172.21.15.98:0/2141518365 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x561de5ddab10 con 0x561de5e87440 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8f9dffb640 10 client.15423 handle_command_reply: tid=0 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fbe895740 1 client.15423 shutdown 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fbe895740 1 -- 172.21.15.98:0/2141518365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 msgr2=0x561de5e8d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:31.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fbe895740 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 0x561de5e8d8d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4004c80 tx=0x7f8fa402f040 comp rx=0 tx=0).stop 2024-09-19T07:22:31.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fbe895740 1 -- 172.21.15.98:0/2141518365 shutdown_connections 2024-09-19T07:22:31.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fbe895740 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x561de5e87440 0x561de5ef5dc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8f9dffb640 0 client.15423 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:22:31.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fbe895740 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561de5e77bb0 0x561de5e8d8d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fbe895740 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561de5e6d2f0 0x561de5e8d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fbe895740 1 --2- 172.21.15.98:0/2141518365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561de5e6c9d0 0x561de5e92060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fbe895740 1 -- 172.21.15.98:0/2141518365 >> 172.21.15.98:0/2141518365 conn(0x561de5e68f60 msgr2=0x561de5e68000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:31.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fbe895740 1 -- 172.21.15.98:0/2141518365 shutdown_connections 2024-09-19T07:22:31.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fbe895740 1 -- 172.21.15.98:0/2141518365 wait complete. 2024-09-19T07:22:31.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.076+0000 7f8fbe895740 20 client.15423 trim_cache size 0 max 16384 2024-09-19T07:22:31.082 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:22:31.083 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "73438718-7656-11ef-bceb-c7b262605968", 2024-09-19T07:22:31.083 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 1, 2024-09-19T07:22:31.083 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 24458, 2024-09-19T07:22:31.083 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-19T07:22:31.083 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-19T07:22:31.083 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-19T07:22:31.083 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 123.342950289, 2024-09-19T07:22:31.083 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 24, 2024-09-19T07:22:31.083 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 81, 2024-09-19T07:22:31.083 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T07:22:31.083 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 151.578874157 2024-09-19T07:22:31.083 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:22:31.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.077+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/1086554595 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8fa00a3550 msgr2=0x7f8fa00a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:31.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.077+0000 7f8fbc4bc640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8fa00a3550 0x7f8fa00a5a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0cdc60 tx=0x7f8fac06e440 comp rx=0 tx=0).stop 2024-09-19T07:22:31.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.077+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/1086554595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fb41082a0 msgr2=0x7f8fb419cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:31.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.077+0000 7f8fbc4bc640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fb41082a0 0x7f8fb419cec0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00eb10 tx=0x7f8fac00c2d0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.077+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/1086554595 shutdown_connections 2024-09-19T07:22:31.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.077+0000 7f8fbc4bc640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8fa00a3550 0x7f8fa00a5a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.077+0000 7f8fbc4bc640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8fb41082a0 0x7f8fb419cec0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.077+0000 7f8fbc4bc640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8fb41036e0 0x7f8fb4198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.077+0000 7f8fbc4bc640 1 --2- 172.21.15.98:0/1086554595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8fb4102d30 0x7f8fb41985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:31.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.077+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/1086554595 >> 172.21.15.98:0/1086554595 conn(0x7f8fb40fc7d0 msgr2=0x7f8fb4105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:31.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.077+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/1086554595 shutdown_connections 2024-09-19T07:22:31.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:31.077+0000 7f8fbc4bc640 1 -- 172.21.15.98:0/1086554595 wait complete. 2024-09-19T07:22:31.799 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T07:22:32.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:31 smithi098 ceph-mon[30950]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-19T07:22:32.055 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:32.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:31 smithi139 ceph-mon[35039]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-19T07:22:32.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:31 smithi162 ceph-mon[35726]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-19T07:22:32.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.603+0000 7f6a73bba640 1 -- 172.21.15.98:0/2381771088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a6c101280 msgr2=0x7f6a6c10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:32.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.603+0000 7f6a73bba640 1 --2- 172.21.15.98:0/2381771088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a6c101280 0x7f6a6c10df40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c009900 tx=0x7f6a5c02a440 comp rx=0 tx=0).stop 2024-09-19T07:22:32.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.603+0000 7f6a73bba640 1 -- 172.21.15.98:0/2381771088 shutdown_connections 2024-09-19T07:22:32.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.603+0000 7f6a73bba640 1 --2- 172.21.15.98:0/2381771088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a6c10e480 0x7f6a6c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.603+0000 7f6a73bba640 1 --2- 172.21.15.98:0/2381771088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a6c101280 0x7f6a6c10df40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.603+0000 7f6a73bba640 1 --2- 172.21.15.98:0/2381771088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a6c1008d0 0x7f6a6c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.603+0000 7f6a73bba640 1 -- 172.21.15.98:0/2381771088 >> 172.21.15.98:0/2381771088 conn(0x7f6a6c0fc7a0 msgr2=0x7f6a6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.603+0000 7f6a73bba640 1 -- 172.21.15.98:0/2381771088 shutdown_connections 2024-09-19T07:22:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.603+0000 7f6a73bba640 1 -- 172.21.15.98:0/2381771088 wait complete. 2024-09-19T07:22:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.604+0000 7f6a73bba640 1 Processor -- start 2024-09-19T07:22:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.604+0000 7f6a73bba640 1 -- start start 2024-09-19T07:22:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.604+0000 7f6a73bba640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a6c1008d0 0x7f6a6c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.604+0000 7f6a73bba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a6c101280 0x7f6a6c1a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.604+0000 7f6a73bba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a6c10e480 0x7f6a6c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.604+0000 7f6a73bba640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c1142d0 con 0x7f6a6c1008d0 2024-09-19T07:22:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.604+0000 7f6a73bba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c114150 con 0x7f6a6c10e480 2024-09-19T07:22:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.604+0000 7f6a73bba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c114450 con 0x7f6a6c101280 2024-09-19T07:22:32.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.604+0000 7f6a71956640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a6c1008d0 0x7f6a6c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.604+0000 7f6a71956640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a6c1008d0 0x7f6a6c1a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54064/0 (socket says 172.21.15.98:54064) 2024-09-19T07:22:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.604+0000 7f6a71956640 1 -- 172.21.15.98:0/3885706110 learned_addr learned my addr 172.21.15.98:0/3885706110 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a71155640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a6c101280 0x7f6a6c1a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a71956640 1 -- 172.21.15.98:0/3885706110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a6c101280 msgr2=0x7f6a6c1a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a71956640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a6c101280 0x7f6a6c1a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a71956640 1 -- 172.21.15.98:0/3885706110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a6c10e480 msgr2=0x7f6a6c19a6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:22:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a71956640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a6c10e480 0x7f6a6c19a6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a71956640 1 -- 172.21.15.98:0/3885706110 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c19af50 con 0x7f6a6c1008d0 2024-09-19T07:22:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a71155640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a6c101280 0x7f6a6c1a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a71956640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a6c1008d0 0x7f6a6c1a0610 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800b450 tx=0x7f6a6800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a62ffd640 1 -- 172.21.15.98:0/3885706110 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a68015020 con 0x7f6a6c1008d0 2024-09-19T07:22:32.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a62ffd640 1 -- 172.21.15.98:0/3885706110 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a68011d70 con 0x7f6a6c1008d0 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a62ffd640 1 -- 172.21.15.98:0/3885706110 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800f340 con 0x7f6a6c1008d0 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a73bba640 1 -- 172.21.15.98:0/3885706110 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c19b240 con 0x7f6a6c1008d0 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.605+0000 7f6a73bba640 1 -- 172.21.15.98:0/3885706110 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c1a7590 con 0x7f6a6c1008d0 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.607+0000 7f6a62ffd640 1 -- 172.21.15.98:0/3885706110 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f6a68018020 con 0x7f6a6c1008d0 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.608+0000 7f6a75f93740 1 Processor -- start 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.608+0000 7f6a75f93740 1 -- start start 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.608+0000 7f6a75f93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc525a9d0 0x556dc525adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.608+0000 7f6a75f93740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc525b2f0 0x556dc5265670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.608+0000 7f6a75f93740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc5265bb0 0x556dc5267fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.608+0000 7f6a75f93740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556dc51c1090 con 0x556dc5265bb0 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.608+0000 7f6a75f93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556dc5168a70 con 0x556dc525a9d0 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.608+0000 7f6a75f93740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556dc51bd050 con 0x556dc525b2f0 2024-09-19T07:22:32.626 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.608+0000 7f6a71155640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc5265bb0 0x556dc5267fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.608+0000 7f6a71155640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc5265bb0 0x556dc5267fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54072/0 (socket says 172.21.15.98:54072) 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.608+0000 7f6a71155640 1 -- 172.21.15.98:0/2875925604 learned_addr learned my addr 172.21.15.98:0/2875925604 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.608+0000 7f6a62ffd640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6a580a3550 0x7f6a580a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.609+0000 7f6a71155640 1 -- 172.21.15.98:0/2875925604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc525b2f0 msgr2=0x556dc5265670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.609+0000 7f6a71155640 1 --2- 172.21.15.98:0/2875925604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc525b2f0 0x556dc5265670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.609+0000 7f6a71155640 1 -- 172.21.15.98:0/2875925604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc525a9d0 msgr2=0x556dc525adb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.609+0000 7f6a71155640 1 --2- 172.21.15.98:0/2875925604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc525a9d0 0x556dc525adb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.609+0000 7f6a72157640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6a580a3550 0x7f6a580a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.609+0000 7f6a71155640 1 -- 172.21.15.98:0/2875925604 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc5175130 con 0x556dc5265bb0 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.609+0000 7f6a62ffd640 1 -- 172.21.15.98:0/3885706110 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f6a680cfa20 con 0x7f6a6c1008d0 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.609+0000 7f6a71155640 1 --2- 172.21.15.98:0/2875925604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc5265bb0 0x556dc5267fa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c004200 tx=0x7f6a5c009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237ef8a9bbf34534 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.609+0000 7f6a57fff640 1 -- 172.21.15.98:0/2875925604 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c03f070 con 0x556dc5265bb0 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.609+0000 7f6a57fff640 1 -- 172.21.15.98:0/2875925604 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a5c005520 con 0x556dc5265bb0 2024-09-19T07:22:32.627 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.609+0000 7f6a72157640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6a580a3550 0x7f6a580a5a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c06a0f0 tx=0x7f6a64009230 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.609+0000 7f6a57fff640 1 -- 172.21.15.98:0/2875925604 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c035030 con 0x556dc5265bb0 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.610+0000 7f6a75f93740 1 -- 172.21.15.98:0/2875925604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc5265bb0 msgr2=0x556dc5267fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.610+0000 7f6a75f93740 1 --2- 172.21.15.98:0/2875925604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc5265bb0 0x556dc5267fa0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c004200 tx=0x7f6a5c009680 comp rx=0 tx=0).stop 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.610+0000 7f6a75f93740 1 -- 172.21.15.98:0/2875925604 shutdown_connections 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.610+0000 7f6a75f93740 1 --2- 172.21.15.98:0/2875925604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc5265bb0 0x556dc5267fa0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.610+0000 7f6a75f93740 1 --2- 172.21.15.98:0/2875925604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc525b2f0 0x556dc5265670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.610+0000 7f6a75f93740 1 --2- 172.21.15.98:0/2875925604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc525a9d0 0x556dc525adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.610+0000 7f6a75f93740 1 -- 172.21.15.98:0/2875925604 >> 172.21.15.98:0/2875925604 conn(0x556dc5256f60 msgr2=0x556dc5257340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.610+0000 7f6a75f93740 1 -- 172.21.15.98:0/2875925604 shutdown_connections 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.610+0000 7f6a75f93740 1 -- 172.21.15.98:0/2875925604 wait complete. 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.610+0000 7f6a75f93740 1 -- start start 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.610+0000 7f6a75f93740 1 Processor -- start 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a75f93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc525a9d0 0x556dc5265440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a75f93740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc5262790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a75f93740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc5265bb0 0x556dc5262cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a75f93740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556dc5268780 con 0x556dc525b2f0 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a75f93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556dc517bf20 con 0x556dc525a9d0 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a75f93740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556dc5268900 con 0x556dc5265bb0 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a75f93740 10 client.0 _ll_register_callbacks cb 0x556dc5145030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a71155640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc5262790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a71155640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc5262790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54084/0 (socket says 172.21.15.98:54084) 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a71155640 1 -- 172.21.15.98:0/2904578100 learned_addr learned my addr 172.21.15.98:0/2904578100 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a71155640 1 -- 172.21.15.98:0/2904578100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc5265bb0 msgr2=0x556dc5262cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a71155640 1 --2- 172.21.15.98:0/2904578100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc5265bb0 0x556dc5262cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a71155640 1 -- 172.21.15.98:0/2904578100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc525a9d0 msgr2=0x556dc5265440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a71155640 1 --2- 172.21.15.98:0/2904578100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc525a9d0 0x556dc5265440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a71155640 1 -- 172.21.15.98:0/2904578100 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dc4f322b0 con 0x556dc525b2f0 2024-09-19T07:22:32.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a71155640 1 --2- 172.21.15.98:0/2904578100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc5262790 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c004e90 tx=0x7f6a5c004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fafc5627ad8fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a557fa640 1 -- 172.21.15.98:0/2904578100 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c04c020 con 0x556dc525b2f0 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a75f93740 1 -- 172.21.15.98:0/2904578100 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a5c005520 con 0x556dc525b2f0 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.611+0000 7f6a557fa640 1 -- 172.21.15.98:0/2904578100 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f6a5c0048c0 con 0x556dc525b2f0 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.612+0000 7f6a557fa640 1 -- 172.21.15.98:0/2904578100 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6a5c057050 con 0x556dc525b2f0 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.612+0000 7f6a75f93740 10 client.15435 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.612+0000 7f6a75f93740 1 -- 172.21.15.98:0/2904578100 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556dc52740c0 con 0x556dc525b2f0 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.612+0000 7f6a557fa640 1 -- 172.21.15.98:0/2904578100 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a5c005520 con 0x556dc525b2f0 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.612+0000 7f6a557fa640 1 -- 172.21.15.98:0/2904578100 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6a5c031640 con 0x556dc525b2f0 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.612+0000 7f6a75f93740 10 client.15435 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.612+0000 7f6a75f93740 10 client.15435 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.612+0000 7f6a75f93740 20 client.15435 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:32.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.612+0000 7f6a75f93740 1 --2- 172.21.15.98:0/2904578100 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556dc52762d0 0x556dc5277740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.612+0000 7f6a75f93740 4 client.15435 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.612+0000 7f6a75f93740 1 -- 172.21.15.98:0/2904578100 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556dc51ce600 con 0x556dc52762d0 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.614+0000 7f6a71956640 1 --2- 172.21.15.98:0/2904578100 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556dc52762d0 0x556dc5277740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.618+0000 7f6a71956640 1 --2- 172.21.15.98:0/2904578100 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556dc52762d0 0x556dc5277740 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26d0416fc9b37ca server_cookie=39616e1d7184703 in_seq=0 out_seq=0 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.618+0000 7f6a557fa640 10 client.15435 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.620+0000 7f6a557fa640 1 -- 172.21.15.98:0/2904578100 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556dc51ce600 con 0x556dc52762d0 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.620+0000 7f6a557fa640 10 client.15435 handle_command_reply: tid=0 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.620+0000 7f6a75f93740 1 client.15435 shutdown 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.620+0000 7f6a75f93740 1 -- 172.21.15.98:0/2904578100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 msgr2=0x556dc5262790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.620+0000 7f6a75f93740 1 --2- 172.21.15.98:0/2904578100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc5262790 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c004e90 tx=0x7f6a5c004fb0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.620+0000 7f6a75f93740 1 -- 172.21.15.98:0/2904578100 shutdown_connections 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.620+0000 7f6a75f93740 1 --2- 172.21.15.98:0/2904578100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc5265bb0 0x556dc5262cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.620+0000 7f6a75f93740 1 --2- 172.21.15.98:0/2904578100 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556dc52762d0 0x556dc5277740 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.620+0000 7f6a75f93740 1 --2- 172.21.15.98:0/2904578100 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc5262790 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.620+0000 7f6a75f93740 1 --2- 172.21.15.98:0/2904578100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc525a9d0 0x556dc5265440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.620+0000 7f6a557fa640 0 client.15435 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:32.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.620+0000 7f6a75f93740 1 -- 172.21.15.98:0/2904578100 >> 172.21.15.98:0/2904578100 conn(0x556dc5256f60 msgr2=0x556dc525cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:32.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.621+0000 7f6a75f93740 1 -- 172.21.15.98:0/2904578100 shutdown_connections 2024-09-19T07:22:32.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.621+0000 7f6a75f93740 1 -- 172.21.15.98:0/2904578100 wait complete. 2024-09-19T07:22:32.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.621+0000 7f6a75f93740 20 client.15435 trim_cache size 0 max 16384 2024-09-19T07:22:32.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a75f93740 1 Processor -- start 2024-09-19T07:22:32.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a75f93740 1 -- start start 2024-09-19T07:22:32.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a75f93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc525a9d0 0x556dc5277740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a75f93740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc5255ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a75f93740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc5265bb0 0x556dc525fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a75f93740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556dc5275a80 con 0x556dc525b2f0 2024-09-19T07:22:32.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a75f93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556dc5276150 con 0x556dc525a9d0 2024-09-19T07:22:32.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a75f93740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556dc5276820 con 0x556dc5265bb0 2024-09-19T07:22:32.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a71155640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc5255ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:32.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a71155640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc5255ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54098/0 (socket says 172.21.15.98:54098) 2024-09-19T07:22:32.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a71155640 1 -- 172.21.15.98:0/1840855234 learned_addr learned my addr 172.21.15.98:0/1840855234 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:32.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a71155640 1 -- 172.21.15.98:0/1840855234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc5265bb0 msgr2=0x556dc525fa10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:22:32.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a71155640 1 --2- 172.21.15.98:0/1840855234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc5265bb0 0x556dc525fa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a71155640 1 -- 172.21.15.98:0/1840855234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc525a9d0 msgr2=0x556dc5277740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:32.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a71155640 1 --2- 172.21.15.98:0/1840855234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc525a9d0 0x556dc5277740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.638+0000 7f6a71155640 1 -- 172.21.15.98:0/1840855234 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc5263550 con 0x556dc525b2f0 2024-09-19T07:22:32.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.639+0000 7f6a71155640 1 --2- 172.21.15.98:0/1840855234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc5255ef0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c02aa00 tx=0x7f6a5c032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7279779dbf542b57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:32.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.639+0000 7f6a577fe640 1 -- 172.21.15.98:0/1840855234 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c04c070 con 0x556dc525b2f0 2024-09-19T07:22:32.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.639+0000 7f6a577fe640 1 -- 172.21.15.98:0/1840855234 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a5c0317b0 con 0x556dc525b2f0 2024-09-19T07:22:32.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.639+0000 7f6a577fe640 1 -- 172.21.15.98:0/1840855234 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c03f070 con 0x556dc525b2f0 2024-09-19T07:22:32.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.639+0000 7f6a75f93740 1 -- 172.21.15.98:0/1840855234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 msgr2=0x556dc5255ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:32.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.639+0000 7f6a75f93740 1 --2- 172.21.15.98:0/1840855234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc5255ef0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c02aa00 tx=0x7f6a5c032fc0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 -- 172.21.15.98:0/1840855234 shutdown_connections 2024-09-19T07:22:32.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 --2- 172.21.15.98:0/1840855234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc5265bb0 0x556dc525fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 --2- 172.21.15.98:0/1840855234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc5255ef0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 --2- 172.21.15.98:0/1840855234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc525a9d0 0x556dc5277740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 -- 172.21.15.98:0/1840855234 >> 172.21.15.98:0/1840855234 conn(0x556dc5256f60 msgr2=0x556dc52557e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:32.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 -- 172.21.15.98:0/1840855234 shutdown_connections 2024-09-19T07:22:32.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 -- 172.21.15.98:0/1840855234 wait complete. 2024-09-19T07:22:32.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 -- start start 2024-09-19T07:22:32.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 Processor -- start 2024-09-19T07:22:32.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc525a9d0 0x556dc527fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc527b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc5265bb0 0x556dc527b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556dc52775c0 con 0x556dc525b2f0 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556dc5276ef0 con 0x556dc5265bb0 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.640+0000 7f6a75f93740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556dc5277c90 con 0x556dc525a9d0 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a75f93740 10 client.0 _ll_register_callbacks cb 0x7f6a5c0040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a71155640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc527b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a71155640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc527b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54112/0 (socket says 172.21.15.98:54112) 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a71155640 1 -- 172.21.15.98:0/3628759129 learned_addr learned my addr 172.21.15.98:0/3628759129 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a71155640 1 -- 172.21.15.98:0/3628759129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc525a9d0 msgr2=0x556dc527fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a71155640 1 --2- 172.21.15.98:0/3628759129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc525a9d0 0x556dc527fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a71155640 1 -- 172.21.15.98:0/3628759129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc5265bb0 msgr2=0x556dc527b6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a71155640 1 --2- 172.21.15.98:0/3628759129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc5265bb0 0x556dc527b6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a71155640 1 -- 172.21.15.98:0/3628759129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dc527bc10 con 0x556dc525b2f0 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a71155640 1 --2- 172.21.15.98:0/3628759129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc527b190 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c02a960 tx=0x7f6a5c02a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5502485c3db19e09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a557fa640 1 -- 172.21.15.98:0/3628759129 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c04c030 con 0x556dc525b2f0 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a557fa640 1 -- 172.21.15.98:0/3628759129 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f6a5c02ab40 con 0x556dc525b2f0 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a75f93740 1 -- 172.21.15.98:0/3628759129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a5c0317b0 con 0x556dc525b2f0 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a557fa640 1 -- 172.21.15.98:0/3628759129 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6a5c06a050 con 0x556dc525b2f0 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a75f93740 10 client.15441 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.641+0000 7f6a75f93740 1 -- 172.21.15.98:0/3628759129 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556dc52e06f0 con 0x556dc525b2f0 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.642+0000 7f6a557fa640 1 -- 172.21.15.98:0/3628759129 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a5c0317b0 con 0x556dc525b2f0 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.642+0000 7f6a557fa640 1 -- 172.21.15.98:0/3628759129 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6a5c003830 con 0x556dc525b2f0 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.642+0000 7f6a75f93740 10 client.15441 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.642+0000 7f6a75f93740 10 client.15441 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T07:22:32.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.642+0000 7f6a75f93740 20 client.15441 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:32.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.642+0000 7f6a75f93740 1 --2- 172.21.15.98:0/3628759129 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556dc52e50a0 0x556dc52e3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:32.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.642+0000 7f6a75f93740 4 client.15441 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T07:22:32.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.642+0000 7f6a75f93740 1 -- 172.21.15.98:0/3628759129 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "status"}) -- 0x556dc51c8b10 con 0x556dc52e50a0 2024-09-19T07:22:32.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.644+0000 7f6a71956640 1 --2- 172.21.15.98:0/3628759129 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556dc52e50a0 0x556dc52e3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:32.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a71956640 1 --2- 172.21.15.98:0/3628759129 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556dc52e50a0 0x556dc52e3db0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bca001b467433bc server_cookie=bfdcf42206cf0b78 in_seq=0 out_seq=0 2024-09-19T07:22:32.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a557fa640 10 client.15441 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:32.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a557fa640 1 -- 172.21.15.98:0/3628759129 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x556dc51c8b10 con 0x556dc52e50a0 2024-09-19T07:22:32.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a557fa640 10 client.15441 handle_command_reply: tid=0 2024-09-19T07:22:32.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a75f93740 1 client.15441 shutdown 2024-09-19T07:22:32.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a75f93740 1 -- 172.21.15.98:0/3628759129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 msgr2=0x556dc527b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:32.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a75f93740 1 --2- 172.21.15.98:0/3628759129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc527b190 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c02a960 tx=0x7f6a5c02a440 comp rx=0 tx=0).stop 2024-09-19T07:22:32.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a75f93740 1 -- 172.21.15.98:0/3628759129 shutdown_connections 2024-09-19T07:22:32.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a75f93740 1 --2- 172.21.15.98:0/3628759129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556dc5265bb0 0x556dc527b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a75f93740 1 --2- 172.21.15.98:0/3628759129 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556dc52e50a0 0x556dc52e3db0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a75f93740 1 --2- 172.21.15.98:0/3628759129 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556dc525b2f0 0x556dc527b190 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a75f93740 1 --2- 172.21.15.98:0/3628759129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556dc525a9d0 0x556dc527fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a557fa640 0 client.15441 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:32.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a75f93740 1 -- 172.21.15.98:0/3628759129 >> 172.21.15.98:0/3628759129 conn(0x556dc5256f60 msgr2=0x556dc5262840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:32.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a75f93740 1 -- 172.21.15.98:0/3628759129 shutdown_connections 2024-09-19T07:22:32.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a75f93740 1 -- 172.21.15.98:0/3628759129 wait complete. 2024-09-19T07:22:32.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.645+0000 7f6a75f93740 20 client.15441 trim_cache size 0 max 16384 2024-09-19T07:22:32.650 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:22:32.650 INFO:teuthology.orchestra.run.smithi098.stdout: "cluster_fsid": "73438718-7656-11ef-bceb-c7b262605968", 2024-09-19T07:22:32.650 INFO:teuthology.orchestra.run.smithi098.stdout: "whoami": 0, 2024-09-19T07:22:32.650 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 24479, 2024-09-19T07:22:32.650 INFO:teuthology.orchestra.run.smithi098.stdout: "want_state": "up:active", 2024-09-19T07:22:32.650 INFO:teuthology.orchestra.run.smithi098.stdout: "state": "up:active", 2024-09-19T07:22:32.650 INFO:teuthology.orchestra.run.smithi098.stdout: "fs_name": "cephfs", 2024-09-19T07:22:32.650 INFO:teuthology.orchestra.run.smithi098.stdout: "rank_uptime": 132.12693291900001, 2024-09-19T07:22:32.650 INFO:teuthology.orchestra.run.smithi098.stdout: "mdsmap_epoch": 24, 2024-09-19T07:22:32.650 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch": 81, 2024-09-19T07:22:32.650 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T07:22:32.650 INFO:teuthology.orchestra.run.smithi098.stdout: "uptime": 141.76280735 2024-09-19T07:22:32.651 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:22:32.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.646+0000 7f6a73bba640 1 -- 172.21.15.98:0/3885706110 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6a580a3550 msgr2=0x7f6a580a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:32.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.646+0000 7f6a73bba640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6a580a3550 0x7f6a580a5a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c06a0f0 tx=0x7f6a64009230 comp rx=0 tx=0).stop 2024-09-19T07:22:32.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.646+0000 7f6a73bba640 1 -- 172.21.15.98:0/3885706110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a6c1008d0 msgr2=0x7f6a6c1a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:32.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.646+0000 7f6a73bba640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a6c1008d0 0x7f6a6c1a0610 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800b450 tx=0x7f6a6800b910 comp rx=0 tx=0).stop 2024-09-19T07:22:32.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.646+0000 7f6a73bba640 1 -- 172.21.15.98:0/3885706110 shutdown_connections 2024-09-19T07:22:32.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.646+0000 7f6a73bba640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6a580a3550 0x7f6a580a5a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.646+0000 7f6a73bba640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6a6c10e480 0x7f6a6c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.646+0000 7f6a73bba640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a6c101280 0x7f6a6c1a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.646+0000 7f6a73bba640 1 --2- 172.21.15.98:0/3885706110 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6a6c1008d0 0x7f6a6c1a0610 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:32.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.646+0000 7f6a73bba640 1 -- 172.21.15.98:0/3885706110 >> 172.21.15.98:0/3885706110 conn(0x7f6a6c0fc7a0 msgr2=0x7f6a6c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:32.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.646+0000 7f6a73bba640 1 -- 172.21.15.98:0/3885706110 shutdown_connections 2024-09-19T07:22:32.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:32.646+0000 7f6a73bba640 1 -- 172.21.15.98:0/3885706110 wait complete. 2024-09-19T07:22:33.289 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T07:22:34.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:33 smithi162 ceph-mon[35726]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:22:34.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:33 smithi098 ceph-mon[30950]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:22:34.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:33 smithi139 ceph-mon[35039]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:22:36.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:35 smithi162 ceph-mon[35726]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-19T07:22:36.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:35 smithi098 ceph-mon[30950]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-19T07:22:36.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:35 smithi139 ceph-mon[35039]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.9 KiB/s wr, 12 op/s 2024-09-19T07:22:38.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:37 smithi162 ceph-mon[35726]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:22:38.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:37 smithi098 ceph-mon[30950]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:22:38.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:37 smithi139 ceph-mon[35039]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T07:22:40.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:39 smithi162 ceph-mon[35726]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-19T07:22:40.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:39 smithi098 ceph-mon[30950]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-19T07:22:40.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:39 smithi139 ceph-mon[35039]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-19T07:22:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.524+0000 7f0de3c27640 1 -- 172.21.15.98:0/1941307008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc105ea0 msgr2=0x7f0ddc106310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.524+0000 7f0de3c27640 1 --2- 172.21.15.98:0/1941307008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc105ea0 0x7f0ddc106310 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009ca0 tx=0x7f0dd402a950 comp rx=0 tx=0).stop 2024-09-19T07:22:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.524+0000 7f0de3c27640 1 -- 172.21.15.98:0/1941307008 shutdown_connections 2024-09-19T07:22:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.524+0000 7f0de3c27640 1 --2- 172.21.15.98:0/1941307008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc105ea0 0x7f0ddc106310 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.524+0000 7f0de3c27640 1 --2- 172.21.15.98:0/1941307008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ddc101390 0x7f0ddc105850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.525 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.524+0000 7f0de3c27640 1 --2- 172.21.15.98:0/1941307008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ddc100a70 0x7f0ddc100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.524+0000 7f0de3c27640 1 -- 172.21.15.98:0/1941307008 >> 172.21.15.98:0/1941307008 conn(0x7f0ddc077990 msgr2=0x7f0ddc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.524+0000 7f0de3c27640 1 -- 172.21.15.98:0/1941307008 shutdown_connections 2024-09-19T07:22:41.526 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.524+0000 7f0de3c27640 1 -- 172.21.15.98:0/1941307008 wait complete. 2024-09-19T07:22:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.525+0000 7f0de3c27640 1 Processor -- start 2024-09-19T07:22:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.525+0000 7f0de3c27640 1 -- start start 2024-09-19T07:22:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.525+0000 7f0de3c27640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc100a70 0x7f0ddc1a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.525+0000 7f0de3c27640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ddc101390 0x7f0ddc1a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.525+0000 7f0de3c27640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ddc105ea0 0x7f0ddc19e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.528 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.525+0000 7f0de3c27640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc1184f0 con 0x7f0ddc100a70 2024-09-19T07:22:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.525+0000 7f0de3c27640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc118370 con 0x7f0ddc105ea0 2024-09-19T07:22:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.525+0000 7f0de3c27640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc118670 con 0x7f0ddc101390 2024-09-19T07:22:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de19c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc100a70 0x7f0ddc1a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de19c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc100a70 0x7f0ddc1a4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54128/0 (socket says 172.21.15.98:54128) 2024-09-19T07:22:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de19c3640 1 -- 172.21.15.98:0/4134413074 learned_addr learned my addr 172.21.15.98:0/4134413074 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de11c2640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ddc101390 0x7f0ddc1a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de21c4640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ddc105ea0 0x7f0ddc19e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de19c3640 1 -- 172.21.15.98:0/4134413074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ddc101390 msgr2=0x7f0ddc1a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de19c3640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ddc101390 0x7f0ddc1a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.529 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de19c3640 1 -- 172.21.15.98:0/4134413074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ddc105ea0 msgr2=0x7f0ddc19e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de19c3640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ddc105ea0 0x7f0ddc19e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de19c3640 1 -- 172.21.15.98:0/4134413074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc19efe0 con 0x7f0ddc100a70 2024-09-19T07:22:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de19c3640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc100a70 0x7f0ddc1a4660 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800e9f0 tx=0x7f0dd800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0dd2ffd640 1 -- 172.21.15.98:0/4134413074 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd800cd80 con 0x7f0ddc100a70 2024-09-19T07:22:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0dd2ffd640 1 -- 172.21.15.98:0/4134413074 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dd8005500 con 0x7f0ddc100a70 2024-09-19T07:22:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de3c27640 1 -- 172.21.15.98:0/4134413074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ddc19f2d0 con 0x7f0ddc100a70 2024-09-19T07:22:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0dd2ffd640 1 -- 172.21.15.98:0/4134413074 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8010690 con 0x7f0ddc100a70 2024-09-19T07:22:41.530 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.526+0000 7f0de3c27640 1 -- 172.21.15.98:0/4134413074 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ddc1ab5e0 con 0x7f0ddc100a70 2024-09-19T07:22:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.529+0000 7f0dd2ffd640 1 -- 172.21.15.98:0/4134413074 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f0dd80046c0 con 0x7f0ddc100a70 2024-09-19T07:22:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.529+0000 7f0de69c2740 1 Processor -- start 2024-09-19T07:22:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.529+0000 7f0de69c2740 1 -- start start 2024-09-19T07:22:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de69c2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435daaf0 0x55d0435daed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de69c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 0x55d0435e5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de69c2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435e80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de69c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d04353f2f0 con 0x55d0435db410 2024-09-19T07:22:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de69c2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d0434e7270 con 0x55d0435daaf0 2024-09-19T07:22:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de69c2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d04353b2b0 con 0x55d0435e5cb0 2024-09-19T07:22:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de21c4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435daaf0 0x55d0435daed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0dd2ffd640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0dc80a3580 0x7f0dc80a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de19c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 0x55d0435e5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de19c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 0x55d0435e5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54134/0 (socket says 172.21.15.98:54134) 2024-09-19T07:22:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de19c3640 1 -- 172.21.15.98:0/3191084021 learned_addr learned my addr 172.21.15.98:0/3191084021 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de11c2640 1 --2- 172.21.15.98:0/3191084021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435e80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de21c4640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0dc80a3580 0x7f0dc80a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0dd2ffd640 1 -- 172.21.15.98:0/4134413074 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0dd80d0420 con 0x7f0ddc100a70 2024-09-19T07:22:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de19c3640 1 -- 172.21.15.98:0/3191084021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 msgr2=0x55d0435e80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de19c3640 1 --2- 172.21.15.98:0/3191084021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435e80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de19c3640 1 -- 172.21.15.98:0/3191084021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435daaf0 msgr2=0x55d0435daed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de19c3640 1 --2- 172.21.15.98:0/3191084021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435daaf0 0x55d0435daed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de19c3640 1 -- 172.21.15.98:0/3191084021 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0434e6340 con 0x55d0435db410 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de11c2640 1 --2- 172.21.15.98:0/3191084021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435e80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de21c4640 1 --2- 172.21.15.98:0/3191084021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435daaf0 0x55d0435daed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.530+0000 7f0de19c3640 1 --2- 172.21.15.98:0/3191084021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 0x55d0435e5770 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80a09f0 tx=0x7f0dd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b58f376ec68d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.531+0000 7f0dc7fff640 1 -- 172.21.15.98:0/3191084021 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80a0830 con 0x55d0435db410 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.531+0000 7f0de21c4640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0dc80a3580 0x7f0dc80a5a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4006010 tx=0x7f0dd402a950 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.531+0000 7f0dc7fff640 1 -- 172.21.15.98:0/3191084021 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dd809cb80 con 0x55d0435db410 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.531+0000 7f0dc7fff640 1 -- 172.21.15.98:0/3191084021 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80a4c60 con 0x55d0435db410 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.531+0000 7f0de69c2740 1 -- 172.21.15.98:0/3191084021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 msgr2=0x55d0435e5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.531+0000 7f0de69c2740 1 --2- 172.21.15.98:0/3191084021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 0x55d0435e5770 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80a09f0 tx=0x7f0dd8004a40 comp rx=0 tx=0).stop 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.531+0000 7f0de69c2740 1 -- 172.21.15.98:0/3191084021 shutdown_connections 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.531+0000 7f0de69c2740 1 --2- 172.21.15.98:0/3191084021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435e80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.531+0000 7f0de69c2740 1 --2- 172.21.15.98:0/3191084021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 0x55d0435e5770 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.543 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.531+0000 7f0de69c2740 1 --2- 172.21.15.98:0/3191084021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435daaf0 0x55d0435daed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.531+0000 7f0de69c2740 1 -- 172.21.15.98:0/3191084021 >> 172.21.15.98:0/3191084021 conn(0x55d0435d7060 msgr2=0x55d0435d7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.532+0000 7f0de69c2740 1 -- 172.21.15.98:0/3191084021 shutdown_connections 2024-09-19T07:22:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.532+0000 7f0de69c2740 1 -- 172.21.15.98:0/3191084021 wait complete. 2024-09-19T07:22:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.532+0000 7f0de69c2740 1 -- start start 2024-09-19T07:22:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.532+0000 7f0de69c2740 1 Processor -- start 2024-09-19T07:22:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.532+0000 7f0de69c2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435daaf0 0x55d0435e2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.532+0000 7f0de69c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 0x55d0435e3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.532+0000 7f0de69c2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435e5cb0 0x55d0435e36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.532+0000 7f0de69c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d0435e8820 con 0x55d0435db410 2024-09-19T07:22:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.532+0000 7f0de69c2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d0434c8290 con 0x55d0435e5cb0 2024-09-19T07:22:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.532+0000 7f0de69c2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d0435e89a0 con 0x55d0435daaf0 2024-09-19T07:22:41.544 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.532+0000 7f0de69c2740 10 client.0 _ll_register_callbacks cb 0x55d0434f9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.532+0000 7f0de11c2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 0x55d0435e3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de11c2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 0x55d0435e3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54136/0 (socket says 172.21.15.98:54136) 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de11c2640 1 -- 172.21.15.98:0/3376512628 learned_addr learned my addr 172.21.15.98:0/3376512628 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de19c3640 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435daaf0 0x55d0435e2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de21c4640 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435e5cb0 0x55d0435e36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de11c2640 1 -- 172.21.15.98:0/3376512628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435daaf0 msgr2=0x55d0435e2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de11c2640 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435daaf0 0x55d0435e2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de11c2640 1 -- 172.21.15.98:0/3376512628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435e5cb0 msgr2=0x55d0435e36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de11c2640 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435e5cb0 0x55d0435e36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de11c2640 1 -- 172.21.15.98:0/3376512628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d043252210 con 0x55d0435db410 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de21c4640 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435e5cb0 0x55d0435e36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de11c2640 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 0x55d0435e3160 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc012700 tx=0x7f0dcc012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e81dfaca707ef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0dc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0dc57fa640 1 -- 172.21.15.98:0/3376512628 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc004020 con 0x55d0435db410 2024-09-19T07:22:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0dc57fa640 1 -- 172.21.15.98:0/3376512628 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0dcc0041c0 con 0x55d0435db410 2024-09-19T07:22:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de69c2740 1 -- 172.21.15.98:0/3376512628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dd809cb80 con 0x55d0435db410 2024-09-19T07:22:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0dc57fa640 1 -- 172.21.15.98:0/3376512628 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0dcc0043c0 con 0x55d0435db410 2024-09-19T07:22:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de69c2740 10 client.15453 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0de69c2740 1 -- 172.21.15.98:0/3376512628 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d04331e620 con 0x55d0435db410 2024-09-19T07:22:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.533+0000 7f0dc57fa640 1 -- 172.21.15.98:0/3376512628 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dd809cb80 con 0x55d0435db410 2024-09-19T07:22:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.534+0000 7f0dc57fa640 1 -- 172.21.15.98:0/3376512628 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0dcc003c10 con 0x55d0435db410 2024-09-19T07:22:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.534+0000 7f0de69c2740 10 client.15453 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.534+0000 7f0de69c2740 10 client.15453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.534+0000 7f0de69c2740 20 client.15453 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.534+0000 7f0de69c2740 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d0435f5cc0 0x55d0435f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.534+0000 7f0de69c2740 4 client.15453 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.534+0000 7f0de69c2740 1 -- 172.21.15.98:0/3376512628 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d04354ca20 con 0x55d0435f5cc0 2024-09-19T07:22:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.534+0000 7f0de19c3640 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d0435f5cc0 0x55d0435f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.534+0000 7f0dc57fa640 10 client.15453 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.534+0000 7f0de19c3640 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d0435f5cc0 0x55d0435f80b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be887416e6dc2447 server_cookie=1ed35aba90864c54 in_seq=0 out_seq=0 2024-09-19T07:22:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0dc57fa640 1 -- 172.21.15.98:0/3376512628 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d04354ca20 con 0x55d0435f5cc0 2024-09-19T07:22:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0dc57fa640 10 client.15453 handle_command_reply: tid=0 2024-09-19T07:22:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0de69c2740 1 client.15453 shutdown 2024-09-19T07:22:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0de69c2740 1 -- 172.21.15.98:0/3376512628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 msgr2=0x55d0435e3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:41.547 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0de69c2740 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 0x55d0435e3160 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc012700 tx=0x7f0dcc012bc0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0de69c2740 1 -- 172.21.15.98:0/3376512628 shutdown_connections 2024-09-19T07:22:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0de69c2740 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435e5cb0 0x55d0435e36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0de69c2740 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d0435f5cc0 0x55d0435f80b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0de69c2740 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435db410 0x55d0435e3160 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0de69c2740 1 --2- 172.21.15.98:0/3376512628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435daaf0 0x55d0435e2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0dc57fa640 0 client.15453 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0de69c2740 1 -- 172.21.15.98:0/3376512628 >> 172.21.15.98:0/3376512628 conn(0x55d0435d7060 msgr2=0x55d0435dcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0de69c2740 1 -- 172.21.15.98:0/3376512628 shutdown_connections 2024-09-19T07:22:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.535+0000 7f0de69c2740 1 -- 172.21.15.98:0/3376512628 wait complete. 2024-09-19T07:22:41.548 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.536+0000 7f0de69c2740 20 client.15453 trim_cache size 0 max 16384 2024-09-19T07:22:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de69c2740 1 Processor -- start 2024-09-19T07:22:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de69c2740 1 -- start start 2024-09-19T07:22:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de69c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 0x55d0435dd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de69c2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435db410 0x55d0435e34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de69c2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435fd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de69c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc1b6760 con 0x55d0435daaf0 2024-09-19T07:22:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de69c2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc1b4030 con 0x55d0435db410 2024-09-19T07:22:41.555 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de69c2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc1b1e80 con 0x55d0435e5cb0 2024-09-19T07:22:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de19c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 0x55d0435dd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de19c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 0x55d0435dd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54144/0 (socket says 172.21.15.98:54144) 2024-09-19T07:22:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de19c3640 1 -- 172.21.15.98:0/184368385 learned_addr learned my addr 172.21.15.98:0/184368385 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de11c2640 1 --2- 172.21.15.98:0/184368385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435db410 0x55d0435e34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de21c4640 1 --2- 172.21.15.98:0/184368385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435fd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de19c3640 1 -- 172.21.15.98:0/184368385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 msgr2=0x55d0435fd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de19c3640 1 --2- 172.21.15.98:0/184368385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435fd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de19c3640 1 -- 172.21.15.98:0/184368385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435db410 msgr2=0x55d0435e34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de19c3640 1 --2- 172.21.15.98:0/184368385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435db410 0x55d0435e34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de19c3640 1 -- 172.21.15.98:0/184368385 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0435da920 con 0x55d0435daaf0 2024-09-19T07:22:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.550+0000 7f0de19c3640 1 --2- 172.21.15.98:0/184368385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 0x55d0435dd560 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80ce140 tx=0x7f0dd80d0620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d3c08ab6be362d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:41.556 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0dc77fe640 1 -- 172.21.15.98:0/184368385 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80b5070 con 0x55d0435daaf0 2024-09-19T07:22:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0dc77fe640 1 -- 172.21.15.98:0/184368385 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dd809cb80 con 0x55d0435daaf0 2024-09-19T07:22:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0dc77fe640 1 -- 172.21.15.98:0/184368385 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80b5470 con 0x55d0435daaf0 2024-09-19T07:22:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0de69c2740 1 -- 172.21.15.98:0/184368385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 msgr2=0x55d0435dd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0de69c2740 1 --2- 172.21.15.98:0/184368385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 0x55d0435dd560 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80ce140 tx=0x7f0dd80d0620 comp rx=0 tx=0).stop 2024-09-19T07:22:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0de69c2740 1 -- 172.21.15.98:0/184368385 shutdown_connections 2024-09-19T07:22:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0de69c2740 1 --2- 172.21.15.98:0/184368385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0de69c2740 1 --2- 172.21.15.98:0/184368385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435db410 0x55d0435e34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0de69c2740 1 --2- 172.21.15.98:0/184368385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 0x55d0435dd560 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.557 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0de69c2740 1 -- 172.21.15.98:0/184368385 >> 172.21.15.98:0/184368385 conn(0x55d0435d7060 msgr2=0x55d0435e4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0de69c2740 1 -- 172.21.15.98:0/184368385 shutdown_connections 2024-09-19T07:22:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0de69c2740 1 -- 172.21.15.98:0/184368385 wait complete. 2024-09-19T07:22:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.551+0000 7f0de69c2740 1 -- start start 2024-09-19T07:22:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de69c2740 1 Processor -- start 2024-09-19T07:22:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de69c2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 0x55d0435edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de69c2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435db410 0x55d0435ee4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de69c2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435df790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de69c2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc1b24f0 con 0x55d0435daaf0 2024-09-19T07:22:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de69c2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc1b3960 con 0x55d0435db410 2024-09-19T07:22:41.558 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de69c2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc1b2bc0 con 0x55d0435e5cb0 2024-09-19T07:22:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de69c2740 10 client.0 _ll_register_callbacks cb 0x7f0dcc009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de19c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 0x55d0435edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de19c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 0x55d0435edfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54154/0 (socket says 172.21.15.98:54154) 2024-09-19T07:22:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de19c3640 1 -- 172.21.15.98:0/746654483 learned_addr learned my addr 172.21.15.98:0/746654483 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de11c2640 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435db410 0x55d0435ee4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de21c4640 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435df790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de19c3640 1 -- 172.21.15.98:0/746654483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 msgr2=0x55d0435df790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de19c3640 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435df790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de19c3640 1 -- 172.21.15.98:0/746654483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435db410 msgr2=0x55d0435ee4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de19c3640 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435db410 0x55d0435ee4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de19c3640 1 -- 172.21.15.98:0/746654483 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0435dffc0 con 0x55d0435daaf0 2024-09-19T07:22:41.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.552+0000 7f0de11c2640 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435db410 0x55d0435ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0de19c3640 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 0x55d0435edfb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80988e0 tx=0x7f0dd809c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54902ad1b797340b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0dc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0dc57fa640 1 -- 172.21.15.98:0/746654483 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd80ba060 con 0x55d0435daaf0 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0dc57fa640 1 -- 172.21.15.98:0/746654483 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0dd80a4e70 con 0x55d0435daaf0 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0de69c2740 1 -- 172.21.15.98:0/746654483 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dd809cb80 con 0x55d0435daaf0 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0dc57fa640 1 -- 172.21.15.98:0/746654483 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0dd80b5040 con 0x55d0435daaf0 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0de69c2740 10 client.15459 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0de69c2740 1 -- 172.21.15.98:0/746654483 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d0436605c0 con 0x55d0435daaf0 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0dc57fa640 1 -- 172.21.15.98:0/746654483 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dd809cb80 con 0x55d0435daaf0 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0dc57fa640 1 -- 172.21.15.98:0/746654483 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0dd80af070 con 0x55d0435daaf0 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0de69c2740 10 client.15459 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0de69c2740 10 client.15459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0de69c2740 20 client.15459 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:41.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0de69c2740 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d0436608a0 0x55d043662c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0de69c2740 4 client.15459 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:22:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0de69c2740 1 -- 172.21.15.98:0/746654483 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d043546d70 con 0x55d0436608a0 2024-09-19T07:22:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.553+0000 7f0de11c2640 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d0436608a0 0x55d043662c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.554+0000 7f0dc57fa640 10 client.15459 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:41.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.554+0000 7f0de11c2640 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d0436608a0 0x55d043662c90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34abed03b3fc487c server_cookie=f97fdcfd8d0f6bd6 in_seq=0 out_seq=0 2024-09-19T07:22:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0dc57fa640 1 -- 172.21.15.98:0/746654483 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d043546d70 con 0x55d0436608a0 2024-09-19T07:22:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0dc57fa640 10 client.15459 handle_command_reply: tid=0 2024-09-19T07:22:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0de69c2740 1 client.15459 shutdown 2024-09-19T07:22:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0de69c2740 1 -- 172.21.15.98:0/746654483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 msgr2=0x55d0435edfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0de69c2740 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 0x55d0435edfb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80988e0 tx=0x7f0dd809c320 comp rx=0 tx=0).stop 2024-09-19T07:22:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0de69c2740 1 -- 172.21.15.98:0/746654483 shutdown_connections 2024-09-19T07:22:41.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0de69c2740 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0435e5cb0 0x55d0435df790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0de69c2740 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0435db410 0x55d0435ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0de69c2740 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d0436608a0 0x55d043662c90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0de69c2740 1 --2- 172.21.15.98:0/746654483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d0435daaf0 0x55d0435edfb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0dc57fa640 0 client.15459 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0de69c2740 1 -- 172.21.15.98:0/746654483 >> 172.21.15.98:0/746654483 conn(0x55d0435d7060 msgr2=0x55d0435e4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0de69c2740 1 -- 172.21.15.98:0/746654483 shutdown_connections 2024-09-19T07:22:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0de69c2740 1 -- 172.21.15.98:0/746654483 wait complete. 2024-09-19T07:22:41.563 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.561+0000 7f0de69c2740 20 client.15459 trim_cache size 0 max 16384 2024-09-19T07:22:41.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:22:41.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:22:41.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:22:41.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:22:41.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.562+0000 7f0de3c27640 1 -- 172.21.15.98:0/4134413074 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0dc80a3580 msgr2=0x7f0dc80a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.562+0000 7f0de3c27640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0dc80a3580 0x7f0dc80a5a40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4006010 tx=0x7f0dd402a950 comp rx=0 tx=0).stop 2024-09-19T07:22:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.562+0000 7f0de3c27640 1 -- 172.21.15.98:0/4134413074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc100a70 msgr2=0x7f0ddc1a4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.562+0000 7f0de3c27640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc100a70 0x7f0ddc1a4660 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0dd800e9f0 tx=0x7f0dd800edf0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.562+0000 7f0de3c27640 1 -- 172.21.15.98:0/4134413074 shutdown_connections 2024-09-19T07:22:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.562+0000 7f0de3c27640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0dc80a3580 0x7f0dc80a5a40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.562+0000 7f0de3c27640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0ddc105ea0 0x7f0ddc19e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.562+0000 7f0de3c27640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ddc101390 0x7f0ddc1a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.562+0000 7f0de3c27640 1 --2- 172.21.15.98:0/4134413074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ddc100a70 0x7f0ddc1a4660 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.562+0000 7f0de3c27640 1 -- 172.21.15.98:0/4134413074 >> 172.21.15.98:0/4134413074 conn(0x7f0ddc077990 msgr2=0x7f0ddc103800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.562+0000 7f0de3c27640 1 -- 172.21.15.98:0/4134413074 shutdown_connections 2024-09-19T07:22:41.566 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:41.562+0000 7f0de3c27640 1 -- 172.21.15.98:0/4134413074 wait complete. 2024-09-19T07:22:42.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:42 smithi098 ceph-mon[30950]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-19T07:22:42.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:42 smithi139 ceph-mon[35039]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-19T07:22:42.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:42 smithi162 ceph-mon[35726]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-19T07:22:44.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:43 smithi162 ceph-mon[35726]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:22:44.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:43 smithi098 ceph-mon[30950]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:22:44.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:43 smithi139 ceph-mon[35039]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:22:45.821 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:22:46.076 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:45 smithi162 ceph-mon[35726]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T07:22:46.197 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:45 smithi098 ceph-mon[30950]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T07:22:46.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:45 smithi139 ceph-mon[35039]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T07:22:46.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.590+0000 7fdc85234640 1 -- 172.21.15.98:0/3866423628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc80102d30 msgr2=0x7fdc80103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:46.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.590+0000 7fdc85234640 1 --2- 172.21.15.98:0/3866423628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc80102d30 0x7fdc80103110 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009930 tx=0x7fdc7002a420 comp rx=0 tx=0).stop 2024-09-19T07:22:46.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.590+0000 7fdc85234640 1 -- 172.21.15.98:0/3866423628 shutdown_connections 2024-09-19T07:22:46.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.590+0000 7fdc85234640 1 --2- 172.21.15.98:0/3866423628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc801082a0 0x7fdc8010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.590+0000 7fdc85234640 1 --2- 172.21.15.98:0/3866423628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc801036e0 0x7fdc80107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.590+0000 7fdc85234640 1 --2- 172.21.15.98:0/3866423628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc80102d30 0x7fdc80103110 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.591+0000 7fdc85234640 1 -- 172.21.15.98:0/3866423628 >> 172.21.15.98:0/3866423628 conn(0x7fdc800fc7d0 msgr2=0x7fdc800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:46.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.591+0000 7fdc85234640 1 -- 172.21.15.98:0/3866423628 shutdown_connections 2024-09-19T07:22:46.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.591+0000 7fdc85234640 1 -- 172.21.15.98:0/3866423628 wait complete. 2024-09-19T07:22:46.606 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.591+0000 7fdc85234640 1 Processor -- start 2024-09-19T07:22:46.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.592+0000 7fdc85234640 1 -- start start 2024-09-19T07:22:46.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.592+0000 7fdc85234640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc80102d30 0x7fdc801985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.592+0000 7fdc85234640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc801036e0 0x7fdc80198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.592+0000 7fdc85234640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc801082a0 0x7fdc8019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.592+0000 7fdc85234640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801120a0 con 0x7fdc801036e0 2024-09-19T07:22:46.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.592+0000 7fdc85234640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdc80111f20 con 0x7fdc80102d30 2024-09-19T07:22:46.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.592+0000 7fdc85234640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc80112220 con 0x7fdc801082a0 2024-09-19T07:22:46.607 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.592+0000 7fdc7e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc801036e0 0x7fdc80198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.592+0000 7fdc7e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc801036e0 0x7fdc80198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55526/0 (socket says 172.21.15.98:55526) 2024-09-19T07:22:46.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.592+0000 7fdc7e59c640 1 -- 172.21.15.98:0/1907377893 learned_addr learned my addr 172.21.15.98:0/1907377893 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:46.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.592+0000 7fdc7ed9d640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc80102d30 0x7fdc801985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.592+0000 7fdc7f59e640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc801082a0 0x7fdc8019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.593+0000 7fdc7e59c640 1 -- 172.21.15.98:0/1907377893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc801082a0 msgr2=0x7fdc8019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:46.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.593+0000 7fdc7e59c640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc801082a0 0x7fdc8019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.593+0000 7fdc7e59c640 1 -- 172.21.15.98:0/1907377893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc80102d30 msgr2=0x7fdc801985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:46.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.593+0000 7fdc7e59c640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc80102d30 0x7fdc801985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.608 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.593+0000 7fdc7e59c640 1 -- 172.21.15.98:0/1907377893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8019d550 con 0x7fdc801036e0 2024-09-19T07:22:46.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.593+0000 7fdc7e59c640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc801036e0 0x7fdc80198ae0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400c970 tx=0x7fdc7400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:46.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.593+0000 7fdc67fff640 1 -- 172.21.15.98:0/1907377893 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74007bb0 con 0x7fdc801036e0 2024-09-19T07:22:46.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.593+0000 7fdc85234640 1 -- 172.21.15.98:0/1907377893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8019d840 con 0x7fdc801036e0 2024-09-19T07:22:46.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.593+0000 7fdc67fff640 1 -- 172.21.15.98:0/1907377893 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc74007d50 con 0x7fdc801036e0 2024-09-19T07:22:46.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.593+0000 7fdc67fff640 1 -- 172.21.15.98:0/1907377893 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400f450 con 0x7fdc801036e0 2024-09-19T07:22:46.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.594+0000 7fdc85234640 1 -- 172.21.15.98:0/1907377893 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc801a5120 con 0x7fdc801036e0 2024-09-19T07:22:46.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.595+0000 7fdc67fff640 1 -- 172.21.15.98:0/1907377893 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fdc74004f60 con 0x7fdc801036e0 2024-09-19T07:22:46.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.596+0000 7fdc67fff640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdc680a34d0 0x7fdc680a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.596+0000 7fdc8760d740 1 Processor -- start 2024-09-19T07:22:46.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.596+0000 7fdc7ed9d640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdc680a34d0 0x7fdc680a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.596+0000 7fdc8760d740 1 -- start start 2024-09-19T07:22:46.609 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.596+0000 7fdc67fff640 1 -- 172.21.15.98:0/1907377893 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fdc740cfca0 con 0x7fdc801036e0 2024-09-19T07:22:46.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.596+0000 7fdc8760d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc764a0 0x56187dc76880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc8760d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc76dc0 0x56187dc81140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc8760d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc85a90 0x56187dc87e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc8760d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56187dbdc2e0 con 0x56187dc764a0 2024-09-19T07:22:46.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc8760d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56187db83ce0 con 0x56187dc85a90 2024-09-19T07:22:46.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc8760d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56187dbd82a0 con 0x56187dc76dc0 2024-09-19T07:22:46.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc7ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc764a0 0x56187dc76880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.610 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc7f59e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc85a90 0x56187dc87e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc7f59e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc85a90 0x56187dc87e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:34474/0 (socket says 172.21.15.98:34474) 2024-09-19T07:22:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc7f59e640 1 -- 172.21.15.98:0/4187157762 learned_addr learned my addr 172.21.15.98:0/4187157762 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc7e59c640 1 --2- 172.21.15.98:0/4187157762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc76dc0 0x56187dc81140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc7f59e640 1 -- 172.21.15.98:0/4187157762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc76dc0 msgr2=0x56187dc81140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc7f59e640 1 --2- 172.21.15.98:0/4187157762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc76dc0 0x56187dc81140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc7f59e640 1 -- 172.21.15.98:0/4187157762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc764a0 msgr2=0x56187dc76880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc7f59e640 1 --2- 172.21.15.98:0/4187157762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc764a0 0x56187dc76880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc7f59e640 1 -- 172.21.15.98:0/4187157762 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56187db68440 con 0x56187dc85a90 2024-09-19T07:22:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc7ed9d640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdc680a34d0 0x7fdc680a5990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009900 tx=0x7fdc700318d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc7f59e640 1 --2- 172.21.15.98:0/4187157762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc85a90 0x56187dc87e80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009f70 tx=0x7fdc78010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=720efe18a45db9d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:46.611 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.597+0000 7fdc657fa640 1 -- 172.21.15.98:0/4187157762 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78016070 con 0x56187dc85a90 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.598+0000 7fdc657fa640 1 -- 172.21.15.98:0/4187157762 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc78004d20 con 0x56187dc85a90 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.598+0000 7fdc657fa640 1 -- 172.21.15.98:0/4187157762 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78012870 con 0x56187dc85a90 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.598+0000 7fdc8760d740 1 -- 172.21.15.98:0/4187157762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc85a90 msgr2=0x56187dc87e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.598+0000 7fdc8760d740 1 --2- 172.21.15.98:0/4187157762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc85a90 0x56187dc87e80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009f70 tx=0x7fdc78010800 comp rx=0 tx=0).stop 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.598+0000 7fdc8760d740 1 -- 172.21.15.98:0/4187157762 shutdown_connections 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.598+0000 7fdc8760d740 1 --2- 172.21.15.98:0/4187157762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc85a90 0x56187dc87e80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.598+0000 7fdc8760d740 1 --2- 172.21.15.98:0/4187157762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc76dc0 0x56187dc81140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.598+0000 7fdc8760d740 1 --2- 172.21.15.98:0/4187157762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc764a0 0x56187dc76880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.598+0000 7fdc8760d740 1 -- 172.21.15.98:0/4187157762 >> 172.21.15.98:0/4187157762 conn(0x56187dc72a30 msgr2=0x56187dc72e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.598+0000 7fdc8760d740 1 -- 172.21.15.98:0/4187157762 shutdown_connections 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc8760d740 1 -- 172.21.15.98:0/4187157762 wait complete. 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc8760d740 1 -- start start 2024-09-19T07:22:46.612 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc8760d740 1 Processor -- start 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc8760d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc764a0 0x56187dc80fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc8760d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc7e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc8760d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc85a90 0x56187dc7e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc8760d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56187dc88660 con 0x56187dc764a0 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc8760d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56187db97050 con 0x56187dc76dc0 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc8760d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56187dc887e0 con 0x56187dc85a90 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc8760d740 10 client.0 _ll_register_callbacks cb 0x56187dbd7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc7ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc764a0 0x56187dc80fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc7e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc7e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc7e59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc7e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:34486/0 (socket says 172.21.15.98:34486) 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc7ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc764a0 0x56187dc80fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55556/0 (socket says 172.21.15.98:55556) 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc7e59c640 1 -- 172.21.15.98:0/1080966878 learned_addr learned my addr 172.21.15.98:0/1080966878 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:46.613 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.599+0000 7fdc7f59e640 1 --2- 172.21.15.98:0/1080966878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc85a90 0x56187dc7e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc7ed9d640 1 -- 172.21.15.98:0/1080966878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc85a90 msgr2=0x56187dc7e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc7ed9d640 1 --2- 172.21.15.98:0/1080966878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc85a90 0x56187dc7e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc7ed9d640 1 -- 172.21.15.98:0/1080966878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 msgr2=0x56187dc7e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc7ed9d640 1 --2- 172.21.15.98:0/1080966878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc7e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc7ed9d640 1 -- 172.21.15.98:0/1080966878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56187d94d3c0 con 0x56187dc764a0 2024-09-19T07:22:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc7ed9d640 1 --2- 172.21.15.98:0/1080966878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc764a0 0x56187dc80fc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdc70005940 tx=0x7fdc7002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14da18e3a1fc43a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc62ff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc62ff5640 1 -- 172.21.15.98:0/1080966878 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70035040 con 0x56187dc764a0 2024-09-19T07:22:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc62ff5640 1 -- 172.21.15.98:0/1080966878 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fdc70003dd0 con 0x56187dc764a0 2024-09-19T07:22:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc8760d740 1 -- 172.21.15.98:0/1080966878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc78004d20 con 0x56187dc764a0 2024-09-19T07:22:46.614 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc62ff5640 1 -- 172.21.15.98:0/1080966878 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdc7003c440 con 0x56187dc764a0 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc8760d740 10 client.15471 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc8760d740 1 -- 172.21.15.98:0/1080966878 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56187dc94010 con 0x56187dc764a0 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.600+0000 7fdc62ff5640 1 -- 172.21.15.98:0/1080966878 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc78004d20 con 0x56187dc764a0 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.601+0000 7fdc62ff5640 1 -- 172.21.15.98:0/1080966878 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdc7004a670 con 0x56187dc764a0 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.601+0000 7fdc8760d740 10 client.15471 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.601+0000 7fdc8760d740 10 client.15471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.601+0000 7fdc8760d740 20 client.15471 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.601+0000 7fdc8760d740 1 --2- 172.21.15.98:0/1080966878 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56187dc954d0 0x56187dc978c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.601+0000 7fdc8760d740 4 client.15471 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.601+0000 7fdc8760d740 1 -- 172.21.15.98:0/1080966878 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56187dbe9850 con 0x56187dc954d0 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.601+0000 7fdc7e59c640 1 --2- 172.21.15.98:0/1080966878 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56187dc954d0 0x56187dc978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.602+0000 7fdc7e59c640 1 --2- 172.21.15.98:0/1080966878 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56187dc954d0 0x56187dc978c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b9f415c1a7caf3b server_cookie=ff8b46ffa39b5e43 in_seq=0 out_seq=0 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.602+0000 7fdc62ff5640 10 client.15471 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:46.615 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.602+0000 7fdc62ff5640 1 -- 172.21.15.98:0/1080966878 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56187dbe9850 con 0x56187dc954d0 2024-09-19T07:22:46.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.602+0000 7fdc62ff5640 10 client.15471 handle_command_reply: tid=0 2024-09-19T07:22:46.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.602+0000 7fdc8760d740 1 client.15471 shutdown 2024-09-19T07:22:46.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.603+0000 7fdc8760d740 1 -- 172.21.15.98:0/1080966878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc764a0 msgr2=0x56187dc80fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:46.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.603+0000 7fdc8760d740 1 --2- 172.21.15.98:0/1080966878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc764a0 0x56187dc80fc0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdc70005940 tx=0x7fdc7002a420 comp rx=0 tx=0).stop 2024-09-19T07:22:46.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.603+0000 7fdc8760d740 1 -- 172.21.15.98:0/1080966878 shutdown_connections 2024-09-19T07:22:46.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.603+0000 7fdc8760d740 1 --2- 172.21.15.98:0/1080966878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc85a90 0x56187dc7e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.603+0000 7fdc8760d740 1 --2- 172.21.15.98:0/1080966878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc7e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.603+0000 7fdc8760d740 1 --2- 172.21.15.98:0/1080966878 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56187dc954d0 0x56187dc978c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.603+0000 7fdc8760d740 1 --2- 172.21.15.98:0/1080966878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc764a0 0x56187dc80fc0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.603+0000 7fdc8760d740 1 -- 172.21.15.98:0/1080966878 >> 172.21.15.98:0/1080966878 conn(0x56187dc72a30 msgr2=0x56187dc78760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:46.616 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.603+0000 7fdc62ff5640 0 client.15471 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:46.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.603+0000 7fdc8760d740 1 -- 172.21.15.98:0/1080966878 shutdown_connections 2024-09-19T07:22:46.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.603+0000 7fdc8760d740 1 -- 172.21.15.98:0/1080966878 wait complete. 2024-09-19T07:22:46.617 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.603+0000 7fdc8760d740 20 client.15471 trim_cache size 0 max 16384 2024-09-19T07:22:46.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc8760d740 1 Processor -- start 2024-09-19T07:22:46.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc8760d740 1 -- start start 2024-09-19T07:22:46.623 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc8760d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc764a0 0x56187dc918c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc8760d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc9d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc8760d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 0x56187dc9d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc8760d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801ae160 con 0x56187dc85a90 2024-09-19T07:22:46.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc8760d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801aba30 con 0x56187dc76dc0 2024-09-19T07:22:46.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc8760d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801a9880 con 0x56187dc764a0 2024-09-19T07:22:46.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc7f59e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 0x56187dc9d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc7f59e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 0x56187dc9d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55558/0 (socket says 172.21.15.98:55558) 2024-09-19T07:22:46.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc7f59e640 1 -- 172.21.15.98:0/2814234356 learned_addr learned my addr 172.21.15.98:0/2814234356 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:46.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc7e59c640 1 --2- 172.21.15.98:0/2814234356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc9d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.624 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.622+0000 7fdc7ed9d640 1 --2- 172.21.15.98:0/2814234356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc764a0 0x56187dc918c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.623+0000 7fdc7f59e640 1 -- 172.21.15.98:0/2814234356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc764a0 msgr2=0x56187dc918c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:46.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.623+0000 7fdc7f59e640 1 --2- 172.21.15.98:0/2814234356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc764a0 0x56187dc918c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.623+0000 7fdc7f59e640 1 -- 172.21.15.98:0/2814234356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 msgr2=0x56187dc9d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:46.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.623+0000 7fdc7f59e640 1 --2- 172.21.15.98:0/2814234356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc9d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.623+0000 7fdc7f59e640 1 -- 172.21.15.98:0/2814234356 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56187dc73ba0 con 0x56187dc85a90 2024-09-19T07:22:46.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.623+0000 7fdc7f59e640 1 --2- 172.21.15.98:0/2814234356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 0x56187dc9d670 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009f70 tx=0x7fdc78012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adaf3b59e008f55d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:46.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.623+0000 7fdc64ff9640 1 -- 172.21.15.98:0/2814234356 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78016070 con 0x56187dc85a90 2024-09-19T07:22:46.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.623+0000 7fdc64ff9640 1 -- 172.21.15.98:0/2814234356 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc78004c00 con 0x56187dc85a90 2024-09-19T07:22:46.625 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.623+0000 7fdc64ff9640 1 -- 172.21.15.98:0/2814234356 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78012720 con 0x56187dc85a90 2024-09-19T07:22:46.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.624+0000 7fdc8760d740 1 -- 172.21.15.98:0/2814234356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 msgr2=0x56187dc9d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:46.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.624+0000 7fdc8760d740 1 --2- 172.21.15.98:0/2814234356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 0x56187dc9d670 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009f70 tx=0x7fdc78012450 comp rx=0 tx=0).stop 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.624+0000 7fdc8760d740 1 -- 172.21.15.98:0/2814234356 shutdown_connections 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.624+0000 7fdc8760d740 1 --2- 172.21.15.98:0/2814234356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 0x56187dc9d670 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.624+0000 7fdc8760d740 1 --2- 172.21.15.98:0/2814234356 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc9d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.624+0000 7fdc8760d740 1 --2- 172.21.15.98:0/2814234356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc764a0 0x56187dc918c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.624+0000 7fdc8760d740 1 -- 172.21.15.98:0/2814234356 >> 172.21.15.98:0/2814234356 conn(0x56187dc72a30 msgr2=0x56187dc7cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.624+0000 7fdc8760d740 1 -- 172.21.15.98:0/2814234356 shutdown_connections 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.624+0000 7fdc8760d740 1 -- 172.21.15.98:0/2814234356 wait complete. 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.624+0000 7fdc8760d740 1 -- start start 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.624+0000 7fdc8760d740 1 Processor -- start 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc8760d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc764a0 0x56187dc899c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc8760d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc89f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc8760d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 0x56187dc8a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc8760d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801a9ef0 con 0x56187dc85a90 2024-09-19T07:22:46.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc8760d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801ab360 con 0x56187dc76dc0 2024-09-19T07:22:46.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc8760d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc801aa5c0 con 0x56187dc764a0 2024-09-19T07:22:46.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc8760d740 10 client.0 _ll_register_callbacks cb 0x7fdc7002aae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:46.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc7f59e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 0x56187dc8a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc7f59e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 0x56187dc8a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55560/0 (socket says 172.21.15.98:55560) 2024-09-19T07:22:46.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc7f59e640 1 -- 172.21.15.98:0/2594217567 learned_addr learned my addr 172.21.15.98:0/2594217567 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:46.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc7e59c640 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc89f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc7ed9d640 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc764a0 0x56187dc899c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc7f59e640 1 -- 172.21.15.98:0/2594217567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc764a0 msgr2=0x56187dc899c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:46.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc7f59e640 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc764a0 0x56187dc899c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc7f59e640 1 -- 172.21.15.98:0/2594217567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 msgr2=0x56187dc89f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:46.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc7f59e640 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc89f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc7f59e640 1 -- 172.21.15.98:0/2594217567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56187dcff300 con 0x56187dc85a90 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc7f59e640 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 0x56187dc8a440 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdc78010840 tx=0x7fdc78005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb00f79d8d3bb92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.625+0000 7fdc62ff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc62ff5640 1 -- 172.21.15.98:0/2594217567 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc78016070 con 0x56187dc85a90 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc62ff5640 1 -- 172.21.15.98:0/2594217567 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fdc78004fc0 con 0x56187dc85a90 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc8760d740 1 -- 172.21.15.98:0/2594217567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc78004c00 con 0x56187dc85a90 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc62ff5640 1 -- 172.21.15.98:0/2594217567 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdc780051e0 con 0x56187dc85a90 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc8760d740 10 client.15477 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc8760d740 1 -- 172.21.15.98:0/2594217567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56187dd005d0 con 0x56187dc85a90 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc62ff5640 1 -- 172.21.15.98:0/2594217567 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc78004c00 con 0x56187dc85a90 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc62ff5640 1 -- 172.21.15.98:0/2594217567 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdc78036030 con 0x56187dc85a90 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc8760d740 10 client.15477 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:46.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc8760d740 10 client.15477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc8760d740 20 client.15477 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc8760d740 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56187dd00af0 0x56187dd02ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc8760d740 4 client.15477 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.626+0000 7fdc8760d740 1 -- 172.21.15.98:0/2594217567 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56187dbe3d60 con 0x56187dd00af0 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc7ed9d640 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56187dd00af0 0x56187dd02ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc7ed9d640 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56187dd00af0 0x56187dd02ee0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33ede1fdbd6905fd server_cookie=aab1beafcbf7a982 in_seq=0 out_seq=0 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc62ff5640 10 client.15477 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc62ff5640 1 -- 172.21.15.98:0/2594217567 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56187dbe3d60 con 0x56187dd00af0 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc62ff5640 10 client.15477 handle_command_reply: tid=0 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc8760d740 1 client.15477 shutdown 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc8760d740 1 -- 172.21.15.98:0/2594217567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 msgr2=0x56187dc8a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc8760d740 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 0x56187dc8a440 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdc78010840 tx=0x7fdc78005a40 comp rx=0 tx=0).stop 2024-09-19T07:22:46.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc8760d740 1 -- 172.21.15.98:0/2594217567 shutdown_connections 2024-09-19T07:22:46.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc8760d740 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56187dd00af0 0x56187dd02ee0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc8760d740 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56187dc85a90 0x56187dc8a440 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc8760d740 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56187dc76dc0 0x56187dc89f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc8760d740 1 --2- 172.21.15.98:0/2594217567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56187dc764a0 0x56187dc899c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc8760d740 1 -- 172.21.15.98:0/2594217567 >> 172.21.15.98:0/2594217567 conn(0x56187dc72a30 msgr2=0x56187dc71b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:46.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.627+0000 7fdc62ff5640 0 client.15477 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:46.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc8760d740 1 -- 172.21.15.98:0/2594217567 shutdown_connections 2024-09-19T07:22:46.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc8760d740 1 -- 172.21.15.98:0/2594217567 wait complete. 2024-09-19T07:22:46.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc8760d740 20 client.15477 trim_cache size 0 max 16384 2024-09-19T07:22:46.634 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:22:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: "status": "no active scrubs running", 2024-09-19T07:22:46.635 INFO:teuthology.orchestra.run.smithi098.stdout: "scrubs": {} 2024-09-19T07:22:46.635 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:22:46.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc85234640 1 -- 172.21.15.98:0/1907377893 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdc680a34d0 msgr2=0x7fdc680a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:46.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc85234640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdc680a34d0 0x7fdc680a5990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009900 tx=0x7fdc700318d0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc85234640 1 -- 172.21.15.98:0/1907377893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc801036e0 msgr2=0x7fdc80198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:46.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc85234640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc801036e0 0x7fdc80198ae0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400c970 tx=0x7fdc7400ce30 comp rx=0 tx=0).stop 2024-09-19T07:22:46.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc85234640 1 -- 172.21.15.98:0/1907377893 shutdown_connections 2024-09-19T07:22:46.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc85234640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdc680a34d0 0x7fdc680a5990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc85234640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc801082a0 0x7fdc8019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc85234640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdc801036e0 0x7fdc80198ae0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc85234640 1 --2- 172.21.15.98:0/1907377893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdc80102d30 0x7fdc801985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:46.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc85234640 1 -- 172.21.15.98:0/1907377893 >> 172.21.15.98:0/1907377893 conn(0x7fdc800fc7d0 msgr2=0x7fdc80105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:46.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc85234640 1 -- 172.21.15.98:0/1907377893 shutdown_connections 2024-09-19T07:22:46.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:46.628+0000 7fdc85234640 1 -- 172.21.15.98:0/1907377893 wait complete. 2024-09-19T07:22:47.415 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:22:47.415 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:22:47.674 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:48.106 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:47 smithi098 ceph-mon[30950]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:22:48.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:47 smithi162 ceph-mon[35726]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:22:48.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.186+0000 7f5b4e55e640 1 -- 172.21.15.98:0/702858382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b48100e20 msgr2=0x7f5b48101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:48.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.186+0000 7f5b4e55e640 1 --2- 172.21.15.98:0/702858382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b48100e20 0x7f5b48101200 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009900 tx=0x7f5b3802a480 comp rx=0 tx=0).stop 2024-09-19T07:22:48.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.187+0000 7f5b4e55e640 1 -- 172.21.15.98:0/702858382 shutdown_connections 2024-09-19T07:22:48.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.187+0000 7f5b4e55e640 1 --2- 172.21.15.98:0/702858382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b48102ef0 0x7f5b4810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:48.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.187+0000 7f5b4e55e640 1 --2- 172.21.15.98:0/702858382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b48102570 0x7f5b481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:48.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.187+0000 7f5b4e55e640 1 --2- 172.21.15.98:0/702858382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b48100e20 0x7f5b48101200 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:48.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.187+0000 7f5b4e55e640 1 -- 172.21.15.98:0/702858382 >> 172.21.15.98:0/702858382 conn(0x7f5b480fc7d0 msgr2=0x7f5b480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:48.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.187+0000 7f5b4e55e640 1 -- 172.21.15.98:0/702858382 shutdown_connections 2024-09-19T07:22:48.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.187+0000 7f5b4e55e640 1 -- 172.21.15.98:0/702858382 wait complete. 2024-09-19T07:22:48.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.187+0000 7f5b4e55e640 1 Processor -- start 2024-09-19T07:22:48.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.187+0000 7f5b4e55e640 1 -- start start 2024-09-19T07:22:48.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b4e55e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b48100e20 0x7f5b481985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:48.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b4e55e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b48102570 0x7f5b48198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:48.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b4e55e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b48102ef0 0x7f5b4819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:48.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b4e55e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481120a0 con 0x7f5b48100e20 2024-09-19T07:22:48.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b4e55e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48111f20 con 0x7f5b48102570 2024-09-19T07:22:48.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b4e55e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b48112220 con 0x7f5b48102ef0 2024-09-19T07:22:48.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b48100e20 0x7f5b481985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:48.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b47fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b48100e20 0x7f5b481985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55578/0 (socket says 172.21.15.98:55578) 2024-09-19T07:22:48.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b47fff640 1 -- 172.21.15.98:0/1310212490 learned_addr learned my addr 172.21.15.98:0/1310212490 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:48.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b4cafb640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b48102ef0 0x7f5b4819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:48.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b477fe640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b48102570 0x7f5b48198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:48.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b47fff640 1 -- 172.21.15.98:0/1310212490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b48102ef0 msgr2=0x7f5b4819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:48.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b47fff640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b48102ef0 0x7f5b4819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:48.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b47fff640 1 -- 172.21.15.98:0/1310212490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b48102570 msgr2=0x7f5b48198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:48.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b47fff640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b48102570 0x7f5b48198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:48.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b47fff640 1 -- 172.21.15.98:0/1310212490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4819d550 con 0x7f5b48100e20 2024-09-19T07:22:48.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.188+0000 7f5b47fff640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b48100e20 0x7f5b481985a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5b38006010 tx=0x7f5b38003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:48.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.189+0000 7f5b457fa640 1 -- 172.21.15.98:0/1310212490 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3803f070 con 0x7f5b48100e20 2024-09-19T07:22:48.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.189+0000 7f5b457fa640 1 -- 172.21.15.98:0/1310212490 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b38031c30 con 0x7f5b48100e20 2024-09-19T07:22:48.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.189+0000 7f5b4e55e640 1 -- 172.21.15.98:0/1310212490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b4819d7e0 con 0x7f5b48100e20 2024-09-19T07:22:48.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.189+0000 7f5b457fa640 1 -- 172.21.15.98:0/1310212490 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38035030 con 0x7f5b48100e20 2024-09-19T07:22:48.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.189+0000 7f5b4e55e640 1 -- 172.21.15.98:0/1310212490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b481a5120 con 0x7f5b48100e20 2024-09-19T07:22:48.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.190+0000 7f5b4e55e640 1 -- 172.21.15.98:0/1310212490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b48101200 con 0x7f5b48100e20 2024-09-19T07:22:48.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.191+0000 7f5b457fa640 1 -- 172.21.15.98:0/1310212490 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f5b38042070 con 0x7f5b48100e20 2024-09-19T07:22:48.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.191+0000 7f5b457fa640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f5b300a34d0 0x7f5b300a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:48.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.192+0000 7f5b477fe640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f5b300a34d0 0x7f5b300a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:48.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.192+0000 7f5b457fa640 1 -- 172.21.15.98:0/1310212490 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f5b380f0590 con 0x7f5b48100e20 2024-09-19T07:22:48.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.192+0000 7f5b477fe640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f5b300a34d0 0x7f5b300a5990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b480ffe50 tx=0x7f5b3c005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:48.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.196+0000 7f5b457fa640 1 -- 172.21.15.98:0/1310212490 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b380bc770 con 0x7f5b48100e20 2024-09-19T07:22:48.290 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T07:22:48.291 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:22:48.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:47 smithi139 ceph-mon[35039]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:22:48.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.440+0000 7f5b4e55e640 1 -- 172.21.15.98:0/1310212490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b48109090 con 0x7f5b48100e20 2024-09-19T07:22:48.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.440+0000 7f5b457fa640 1 -- 172.21.15.98:0/1310212490 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f5b380c0a70 con 0x7f5b48100e20 2024-09-19T07:22:48.441 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:48.441 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:22:48.441 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:22:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.443+0000 7f5b4e55e640 1 -- 172.21.15.98:0/1310212490 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f5b300a34d0 msgr2=0x7f5b300a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.443+0000 7f5b4e55e640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f5b300a34d0 0x7f5b300a5990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5b480ffe50 tx=0x7f5b3c005f90 comp rx=0 tx=0).stop 2024-09-19T07:22:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.443+0000 7f5b4e55e640 1 -- 172.21.15.98:0/1310212490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b48100e20 msgr2=0x7f5b481985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.443+0000 7f5b4e55e640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b48100e20 0x7f5b481985a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5b38006010 tx=0x7f5b38003c10 comp rx=0 tx=0).stop 2024-09-19T07:22:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.444+0000 7f5b4e55e640 1 -- 172.21.15.98:0/1310212490 shutdown_connections 2024-09-19T07:22:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.444+0000 7f5b4e55e640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f5b300a34d0 0x7f5b300a5990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.444+0000 7f5b4e55e640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b48102ef0 0x7f5b4819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.444+0000 7f5b4e55e640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b48102570 0x7f5b48198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.444+0000 7f5b4e55e640 1 --2- 172.21.15.98:0/1310212490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b48100e20 0x7f5b481985a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:48.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.444+0000 7f5b4e55e640 1 -- 172.21.15.98:0/1310212490 >> 172.21.15.98:0/1310212490 conn(0x7f5b480fc7d0 msgr2=0x7f5b480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:48.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.444+0000 7f5b4e55e640 1 -- 172.21.15.98:0/1310212490 shutdown_connections 2024-09-19T07:22:48.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:48.444+0000 7f5b4e55e640 1 -- 172.21.15.98:0/1310212490 wait complete. 2024-09-19T07:22:49.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:48 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1310212490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:49.098 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:22:49.194 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:49.218 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:48 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1310212490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:49.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:48 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1310212490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:49.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.873+0000 7f442d3ba640 1 -- 172.21.15.98:0/1125069380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4428106a80 msgr2=0x7f4428106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:49.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.873+0000 7f442d3ba640 1 --2- 172.21.15.98:0/1125069380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4428106a80 0x7f4428106e60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4418009930 tx=0x7f441802a420 comp rx=0 tx=0).stop 2024-09-19T07:22:49.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.873+0000 7f442d3ba640 1 -- 172.21.15.98:0/1125069380 shutdown_connections 2024-09-19T07:22:49.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.873+0000 7f442d3ba640 1 --2- 172.21.15.98:0/1125069380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4428101420 0x7f442810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:49.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.873+0000 7f442d3ba640 1 --2- 172.21.15.98:0/1125069380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4428100a80 0x7f4428100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:49.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.873+0000 7f442d3ba640 1 --2- 172.21.15.98:0/1125069380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4428106a80 0x7f4428106e60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:49.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.873+0000 7f442d3ba640 1 -- 172.21.15.98:0/1125069380 >> 172.21.15.98:0/1125069380 conn(0x7f44280fc7a0 msgr2=0x7f44280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:49.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.873+0000 7f442d3ba640 1 -- 172.21.15.98:0/1125069380 shutdown_connections 2024-09-19T07:22:49.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.873+0000 7f442d3ba640 1 -- 172.21.15.98:0/1125069380 wait complete. 2024-09-19T07:22:49.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.873+0000 7f442d3ba640 1 Processor -- start 2024-09-19T07:22:49.900 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f442d3ba640 1 -- start start 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f442d3ba640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4428100a80 0x7f4428197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f442d3ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4428101420 0x7f4428197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f442d3ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4428106a80 0x7f4428197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f442d3ba640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4428110e80 con 0x7f4428100a80 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f442d3ba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4428110d00 con 0x7f4428101420 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f442d3ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4428111000 con 0x7f4428106a80 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f4426ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4428100a80 0x7f4428197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f4426ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4428100a80 0x7f4428197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55598/0 (socket says 172.21.15.98:55598) 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f4426ffd640 1 -- 172.21.15.98:0/1692628924 learned_addr learned my addr 172.21.15.98:0/1692628924 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f441ffff640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4428101420 0x7f4428197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f44277fe640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4428106a80 0x7f4428197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f4426ffd640 1 -- 172.21.15.98:0/1692628924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4428106a80 msgr2=0x7f4428197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:49.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f4426ffd640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4428106a80 0x7f4428197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f4426ffd640 1 -- 172.21.15.98:0/1692628924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4428101420 msgr2=0x7f4428197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f4426ffd640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4428101420 0x7f4428197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f4426ffd640 1 -- 172.21.15.98:0/1692628924 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44281a68b0 con 0x7f4428100a80 2024-09-19T07:22:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f441ffff640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4428101420 0x7f4428197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.874+0000 7f4426ffd640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4428100a80 0x7f4428197040 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4418009230 tx=0x7f4418004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.875+0000 7f4424ff9640 1 -- 172.21.15.98:0/1692628924 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441803f030 con 0x7f4428100a80 2024-09-19T07:22:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.875+0000 7f4424ff9640 1 -- 172.21.15.98:0/1692628924 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4418003ad0 con 0x7f4428100a80 2024-09-19T07:22:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.875+0000 7f442d3ba640 1 -- 172.21.15.98:0/1692628924 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44281a6b40 con 0x7f4428100a80 2024-09-19T07:22:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.875+0000 7f4424ff9640 1 -- 172.21.15.98:0/1692628924 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4418035070 con 0x7f4428100a80 2024-09-19T07:22:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.875+0000 7f442d3ba640 1 -- 172.21.15.98:0/1692628924 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44281a7070 con 0x7f4428100a80 2024-09-19T07:22:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.876+0000 7f442d3ba640 1 -- 172.21.15.98:0/1692628924 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4428100ee0 con 0x7f4428100a80 2024-09-19T07:22:49.902 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.877+0000 7f4424ff9640 1 -- 172.21.15.98:0/1692628924 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f4418042030 con 0x7f4428100a80 2024-09-19T07:22:49.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.877+0000 7f4424ff9640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f44140a3550 0x7f44140a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:49.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.878+0000 7f441ffff640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f44140a3550 0x7f44140a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:49.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.878+0000 7f4424ff9640 1 -- 172.21.15.98:0/1692628924 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f44180f0570 con 0x7f4428100a80 2024-09-19T07:22:49.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.878+0000 7f441ffff640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f44140a3550 0x7f44140a5a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44281991a0 tx=0x7f441000a5c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:49.903 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:49.882+0000 7f4424ff9640 1 -- 172.21.15.98:0/1692628924 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f44180bcda0 con 0x7f4428100a80 2024-09-19T07:22:49.941 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:50.066 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:49 smithi098 ceph-mon[30950]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T07:22:50.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.114+0000 7f442d3ba640 1 -- 172.21.15.98:0/1692628924 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44281a73e0 con 0x7f4428100a80 2024-09-19T07:22:50.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.115+0000 7f4424ff9640 1 -- 172.21.15.98:0/1692628924 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f44180bc6a0 con 0x7f4428100a80 2024-09-19T07:22:50.115 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:22:50.116 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:22:50.116 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:22:50.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.118+0000 7f442d3ba640 1 -- 172.21.15.98:0/1692628924 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f44140a3550 msgr2=0x7f44140a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:50.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.118+0000 7f442d3ba640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f44140a3550 0x7f44140a5a10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44281991a0 tx=0x7f441000a5c0 comp rx=0 tx=0).stop 2024-09-19T07:22:50.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.118+0000 7f442d3ba640 1 -- 172.21.15.98:0/1692628924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4428100a80 msgr2=0x7f4428197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:50.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.118+0000 7f442d3ba640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4428100a80 0x7f4428197040 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4418009230 tx=0x7f4418004270 comp rx=0 tx=0).stop 2024-09-19T07:22:50.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.118+0000 7f442d3ba640 1 -- 172.21.15.98:0/1692628924 shutdown_connections 2024-09-19T07:22:50.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.118+0000 7f442d3ba640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f44140a3550 0x7f44140a5a10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:50.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.118+0000 7f442d3ba640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4428106a80 0x7f4428197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:50.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.118+0000 7f442d3ba640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4428101420 0x7f4428197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:50.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.118+0000 7f442d3ba640 1 --2- 172.21.15.98:0/1692628924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4428100a80 0x7f4428197040 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:50.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.118+0000 7f442d3ba640 1 -- 172.21.15.98:0/1692628924 >> 172.21.15.98:0/1692628924 conn(0x7f44280fc7a0 msgr2=0x7f44280fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:50.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.118+0000 7f442d3ba640 1 -- 172.21.15.98:0/1692628924 shutdown_connections 2024-09-19T07:22:50.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:50.118+0000 7f442d3ba640 1 -- 172.21.15.98:0/1692628924 wait complete. 2024-09-19T07:22:50.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:49 smithi139 ceph-mon[35039]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T07:22:50.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:49 smithi162 ceph-mon[35726]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-19T07:22:50.819 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T07:22:50.819 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T07:22:51.075 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:50 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1692628924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:51.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.075+0000 7fbbae9cf640 1 -- 172.21.15.98:0/1873495173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba81082a0 msgr2=0x7fbba810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:51.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.075+0000 7fbbae9cf640 1 --2- 172.21.15.98:0/1873495173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba81082a0 0x7fbba810ec40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009cd0 tx=0x7fbba002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.075+0000 7fbbae9cf640 1 -- 172.21.15.98:0/1873495173 shutdown_connections 2024-09-19T07:22:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.075+0000 7fbbae9cf640 1 --2- 172.21.15.98:0/1873495173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba81082a0 0x7fbba810ec40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.075+0000 7fbbae9cf640 1 --2- 172.21.15.98:0/1873495173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbba81036e0 0x7fbba8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.075+0000 7fbbae9cf640 1 --2- 172.21.15.98:0/1873495173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbba8102d30 0x7fbba8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.075+0000 7fbbae9cf640 1 -- 172.21.15.98:0/1873495173 >> 172.21.15.98:0/1873495173 conn(0x7fbba80fc7d0 msgr2=0x7fbba80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.075+0000 7fbbae9cf640 1 -- 172.21.15.98:0/1873495173 shutdown_connections 2024-09-19T07:22:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.075+0000 7fbbae9cf640 1 -- 172.21.15.98:0/1873495173 wait complete. 2024-09-19T07:22:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbbae9cf640 1 Processor -- start 2024-09-19T07:22:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbbae9cf640 1 -- start start 2024-09-19T07:22:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbbae9cf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba8102d30 0x7fbba81a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbbae9cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbba81036e0 0x7fbba81a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbbae9cf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbba81082a0 0x7fbba819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbbae9cf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81120a0 con 0x7fbba8102d30 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbbae9cf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbba8111f20 con 0x7fbba81082a0 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbbae9cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbba8112220 con 0x7fbba81036e0 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbba7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba8102d30 0x7fbba81a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbba7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba8102d30 0x7fbba81a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55616/0 (socket says 172.21.15.98:55616) 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbba7fff640 1 -- 172.21.15.98:0/636882829 learned_addr learned my addr 172.21.15.98:0/636882829 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbba77fe640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbba81036e0 0x7fbba81a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.076+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbba81082a0 0x7fbba819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.077+0000 7fbba7fff640 1 -- 172.21.15.98:0/636882829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbba81036e0 msgr2=0x7fbba81a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.077+0000 7fbba7fff640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbba81036e0 0x7fbba81a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.077+0000 7fbba7fff640 1 -- 172.21.15.98:0/636882829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbba81082a0 msgr2=0x7fbba819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.077+0000 7fbba7fff640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbba81082a0 0x7fbba819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.104 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.077+0000 7fbba7fff640 1 -- 172.21.15.98:0/636882829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba819acd0 con 0x7fbba8102d30 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.077+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbba81082a0 0x7fbba819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.077+0000 7fbba7fff640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba8102d30 0x7fbba81a03e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800d770 tx=0x7fbb9800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.077+0000 7fbba57fa640 1 -- 172.21.15.98:0/636882829 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb98017070 con 0x7fbba8102d30 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.077+0000 7fbbae9cf640 1 -- 172.21.15.98:0/636882829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba819afc0 con 0x7fbba8102d30 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.077+0000 7fbba57fa640 1 -- 172.21.15.98:0/636882829 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb98005500 con 0x7fbba8102d30 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.077+0000 7fbba57fa640 1 -- 172.21.15.98:0/636882829 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb98004e00 con 0x7fbba8102d30 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.077+0000 7fbbae9cf640 1 -- 172.21.15.98:0/636882829 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba81a72b0 con 0x7fbba8102d30 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbba57fa640 1 -- 172.21.15.98:0/636882829 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fbb98004fa0 con 0x7fbba8102d30 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbb0da8740 1 Processor -- start 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbb0da8740 1 -- start start 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbb0da8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd66090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbb0da8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd665d0 0x55838fd66a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.105 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbb0da8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd73760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbb0da8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55838fccc2f0 con 0x55838fd67b40 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbb0da8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55838fc73cf0 con 0x55838fd71370 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbb0da8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55838fcc82b0 con 0x55838fd665d0 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbacf6c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd66090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbacf6c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd66090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55630/0 (socket says 172.21.15.98:55630) 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbacf6c640 1 -- 172.21.15.98:0/36597244 learned_addr learned my addr 172.21.15.98:0/36597244 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbba77fe640 1 --2- 172.21.15.98:0/36597244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd73760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbba7fff640 1 --2- 172.21.15.98:0/36597244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd665d0 0x55838fd66a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbacf6c640 1 -- 172.21.15.98:0/36597244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd665d0 msgr2=0x55838fd66a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/36597244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd665d0 0x55838fd66a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbacf6c640 1 -- 172.21.15.98:0/36597244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 msgr2=0x55838fd73760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/36597244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd73760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.106 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbbacf6c640 1 -- 172.21.15.98:0/36597244 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55838fc583a0 con 0x55838fd67b40 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbba77fe640 1 --2- 172.21.15.98:0/36597244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd73760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.080+0000 7fbba7fff640 1 --2- 172.21.15.98:0/36597244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd665d0 0x55838fd66a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.081+0000 7fbba57fa640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fbb900a34d0 0x7fbb900a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.081+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/36597244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd66090 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009430 tx=0x7fbba0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f64d7832d71058e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.081+0000 7fbba7fff640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fbb900a34d0 0x7fbb900a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.081+0000 7fbb8e7fc640 1 -- 172.21.15.98:0/36597244 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba00318c0 con 0x55838fd67b40 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.081+0000 7fbb8e7fc640 1 -- 172.21.15.98:0/36597244 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba0036040 con 0x55838fd67b40 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.081+0000 7fbb8e7fc640 1 -- 172.21.15.98:0/36597244 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba00045a0 con 0x55838fd67b40 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.081+0000 7fbba57fa640 1 -- 172.21.15.98:0/636882829 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fbb980cfa80 con 0x7fbba8102d30 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.082+0000 7fbbb0da8740 1 -- 172.21.15.98:0/36597244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 msgr2=0x55838fd66090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.082+0000 7fbba7fff640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fbb900a34d0 0x7fbb900a5990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbb980cd080 tx=0x7fbb98086040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.082+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/36597244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd66090 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fbba0009430 tx=0x7fbba0009a20 comp rx=0 tx=0).stop 2024-09-19T07:22:51.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.082+0000 7fbbb0da8740 1 -- 172.21.15.98:0/36597244 shutdown_connections 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.082+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/36597244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd73760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.082+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/36597244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd665d0 0x55838fd66a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.082+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/36597244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd66090 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.082+0000 7fbbb0da8740 1 -- 172.21.15.98:0/36597244 >> 172.21.15.98:0/36597244 conn(0x55838fd2f310 msgr2=0x55838fd62c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.082+0000 7fbbb0da8740 1 -- 172.21.15.98:0/36597244 shutdown_connections 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.082+0000 7fbbb0da8740 1 -- 172.21.15.98:0/36597244 wait complete. 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.082+0000 7fbbb0da8740 1 -- start start 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.082+0000 7fbbb0da8740 1 Processor -- start 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbb0da8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd665d0 0x55838fd70d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbb0da8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd67b40 0x55838fd6e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbb0da8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd6e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbb0da8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55838fd74010 con 0x55838fd665d0 2024-09-19T07:22:51.108 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbb0da8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55838fc87060 con 0x55838fd71370 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbb0da8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55838fd74190 con 0x55838fd67b40 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbb0da8740 10 client.0 _ll_register_callbacks cb 0x55838f9da8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbacf6c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd665d0 0x55838fd70d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbacf6c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd665d0 0x55838fd70d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55638/0 (socket says 172.21.15.98:55638) 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbacf6c640 1 -- 172.21.15.98:0/1740403031 learned_addr learned my addr 172.21.15.98:0/1740403031 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbba77fe640 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd67b40 0x55838fd6e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd6e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbacf6c640 1 -- 172.21.15.98:0/1740403031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd67b40 msgr2=0x55838fd6e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd67b40 0x55838fd6e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbacf6c640 1 -- 172.21.15.98:0/1740403031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 msgr2=0x55838fd6e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd6e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbacf6c640 1 -- 172.21.15.98:0/1740403031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55838fa3d3c0 con 0x55838fd665d0 2024-09-19T07:22:51.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbba77fe640 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd67b40 0x55838fd6e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd665d0 0x55838fd70d90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbba002a920 tx=0x7fbba0004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43998e9a1e5d5274 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.083+0000 7fbb877fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbb877fe640 1 -- 172.21.15.98:0/1740403031 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0003970 con 0x55838fd665d0 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbb877fe640 1 -- 172.21.15.98:0/1740403031 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fbba0003b10 con 0x55838fd665d0 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1740403031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbba0036040 con 0x55838fd665d0 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbb877fe640 1 -- 172.21.15.98:0/1740403031 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbba005d050 con 0x55838fd665d0 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbbb0da8740 10 client.15501 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1740403031 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55838fd7fa50 con 0x55838fd665d0 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbb877fe640 1 -- 172.21.15.98:0/1740403031 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbba0036040 con 0x55838fd665d0 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbb877fe640 1 -- 172.21.15.98:0/1740403031 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbba0030070 con 0x55838fd665d0 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbbb0da8740 10 client.15501 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbbb0da8740 10 client.15501 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbbb0da8740 20 client.15501 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:51.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55838fd80da0 0x55838fd83190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbbb0da8740 4 client.15501 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:51.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.084+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1740403031 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55838fcd9860 con 0x55838fd80da0 2024-09-19T07:22:51.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.085+0000 7fbba77fe640 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55838fd80da0 0x55838fd83190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.085+0000 7fbba77fe640 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55838fd80da0 0x55838fd83190 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=140a424f8ae62fb0 server_cookie=e4f475c8c6f36271 in_seq=0 out_seq=0 2024-09-19T07:22:51.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.085+0000 7fbb877fe640 10 client.15501 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:22:51.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbb877fe640 1 -- 172.21.15.98:0/1740403031 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55838fcd9860 con 0x55838fd80da0 2024-09-19T07:22:51.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbb877fe640 10 client.15501 handle_command_reply: tid=0 2024-09-19T07:22:51.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbbb0da8740 1 client.15501 shutdown 2024-09-19T07:22:51.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1740403031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd665d0 msgr2=0x55838fd70d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:51.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd665d0 0x55838fd70d90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbba002a920 tx=0x7fbba0004180 comp rx=0 tx=0).stop 2024-09-19T07:22:51.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1740403031 shutdown_connections 2024-09-19T07:22:51.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd6e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55838fd80da0 0x55838fd83190 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbb877fe640 0 client.15501 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:22:51.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd67b40 0x55838fd6e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/1740403031 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd665d0 0x55838fd70d90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1740403031 >> 172.21.15.98:0/1740403031 conn(0x55838fd2f310 msgr2=0x55838fd68960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:51.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1740403031 shutdown_connections 2024-09-19T07:22:51.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1740403031 wait complete. 2024-09-19T07:22:51.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.086+0000 7fbbb0da8740 20 client.15501 trim_cache size 0 max 16384 2024-09-19T07:22:51.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.101+0000 7fbbb0da8740 1 Processor -- start 2024-09-19T07:22:51.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.101+0000 7fbbb0da8740 1 -- start start 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.101+0000 7fbbb0da8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd665d0 0x55838fd7d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.101+0000 7fbbb0da8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd62510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.101+0000 7fbbb0da8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd62a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.101+0000 7fbbb0da8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81b2480 con 0x55838fd67b40 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.101+0000 7fbbb0da8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81afd50 con 0x55838fd71370 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.101+0000 7fbbb0da8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81adba0 con 0x55838fd665d0 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.101+0000 7fbba77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd62510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.101+0000 7fbba77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd62510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55642/0 (socket says 172.21.15.98:55642) 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.101+0000 7fbba77fe640 1 -- 172.21.15.98:0/3123161646 learned_addr learned my addr 172.21.15.98:0/3123161646 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.102+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/3123161646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd62a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.102+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/3123161646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd665d0 0x55838fd7d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.102+0000 7fbba77fe640 1 -- 172.21.15.98:0/3123161646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd665d0 msgr2=0x55838fd7d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:51.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.102+0000 7fbba77fe640 1 --2- 172.21.15.98:0/3123161646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd665d0 0x55838fd7d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.102+0000 7fbba77fe640 1 -- 172.21.15.98:0/3123161646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 msgr2=0x55838fd62a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:51.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.102+0000 7fbba77fe640 1 --2- 172.21.15.98:0/3123161646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd62a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.102+0000 7fbba77fe640 1 -- 172.21.15.98:0/3123161646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55838fd74060 con 0x55838fd67b40 2024-09-19T07:22:51.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.102+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/3123161646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd62a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:51.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.102+0000 7fbba77fe640 1 --2- 172.21.15.98:0/3123161646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd62510 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbba819b6e0 tx=0x7fbb9c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dad5bd70a1c955c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:51.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.102+0000 7fbb8dffb640 1 -- 172.21.15.98:0/3123161646 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0120d0 con 0x55838fd67b40 2024-09-19T07:22:51.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.102+0000 7fbb8dffb640 1 -- 172.21.15.98:0/3123161646 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb9c012270 con 0x55838fd67b40 2024-09-19T07:22:51.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.102+0000 7fbb8dffb640 1 -- 172.21.15.98:0/3123161646 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c0038e0 con 0x55838fd67b40 2024-09-19T07:22:51.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.103+0000 7fbbb0da8740 1 -- 172.21.15.98:0/3123161646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 msgr2=0x55838fd62510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:51.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.103+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/3123161646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd62510 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbba819b6e0 tx=0x7fbb9c005f90 comp rx=0 tx=0).stop 2024-09-19T07:22:51.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.103+0000 7fbbb0da8740 1 -- 172.21.15.98:0/3123161646 shutdown_connections 2024-09-19T07:22:51.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.103+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/3123161646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd71370 0x55838fd62a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.103+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/3123161646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd62510 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.103+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/3123161646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd665d0 0x55838fd7d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.103+0000 7fbbb0da8740 1 -- 172.21.15.98:0/3123161646 >> 172.21.15.98:0/3123161646 conn(0x55838fd2f310 msgr2=0x55838fd6d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:51.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.103+0000 7fbbb0da8740 1 -- 172.21.15.98:0/3123161646 shutdown_connections 2024-09-19T07:22:51.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.103+0000 7fbbb0da8740 1 -- 172.21.15.98:0/3123161646 wait complete. 2024-09-19T07:22:51.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.103+0000 7fbbb0da8740 1 -- start start 2024-09-19T07:22:51.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbbb0da8740 1 Processor -- start 2024-09-19T07:22:51.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbbb0da8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd665d0 0x55838fd867f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbbb0da8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd83b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbbb0da8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd71370 0x55838fd840d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbbb0da8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81ae210 con 0x55838fd67b40 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbbb0da8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81af680 con 0x55838fd665d0 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbbb0da8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81ae8e0 con 0x55838fd71370 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbbb0da8740 10 client.0 _ll_register_callbacks cb 0x7fbba0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbba77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd83b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbba77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd83b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:55656/0 (socket says 172.21.15.98:55656) 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbba77fe640 1 -- 172.21.15.98:0/1725268673 learned_addr learned my addr 172.21.15.98:0/1725268673 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd71370 0x55838fd840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd665d0 0x55838fd867f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbba77fe640 1 -- 172.21.15.98:0/1725268673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd71370 msgr2=0x55838fd840d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbba77fe640 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd71370 0x55838fd840d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbba77fe640 1 -- 172.21.15.98:0/1725268673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd665d0 msgr2=0x55838fd867f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbba77fe640 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd665d0 0x55838fd867f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbba77fe640 1 -- 172.21.15.98:0/1725268673 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55838fd6efe0 con 0x55838fd67b40 2024-09-19T07:22:51.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.104+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd665d0 0x55838fd867f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbba77fe640 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd83b90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c000c00 tx=0x7fbb9c0120d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c513f8b831919b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbb877fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbb877fe640 1 -- 172.21.15.98:0/1725268673 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c00fa80 con 0x55838fd67b40 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbb877fe640 1 -- 172.21.15.98:0/1725268673 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fbb9c00fc20 con 0x55838fd67b40 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1725268673 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb9c012270 con 0x55838fd67b40 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbb877fe640 1 -- 172.21.15.98:0/1725268673 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbb9c00fe20 con 0x55838fd67b40 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbbb0da8740 10 client.15507 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1725268673 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55838fdeb360 con 0x55838fd67b40 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbb877fe640 1 -- 172.21.15.98:0/1725268673 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb9c012270 con 0x55838fd67b40 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbb877fe640 1 -- 172.21.15.98:0/1725268673 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fbb9c010570 con 0x55838fd67b40 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbbb0da8740 10 client.15507 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbbb0da8740 10 client.15507 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.105+0000 7fbbb0da8740 20 client.15507 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:51.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.106+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55838fdeba00 0x55838fdede20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.106+0000 7fbbb0da8740 4 client.15507 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.106+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1725268673 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55838fcd3d70 con 0x55838fdeba00 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.106+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55838fdeba00 0x55838fdede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.106+0000 7fbbacf6c640 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55838fdeba00 0x55838fdede20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dfcf1c922d80afe9 server_cookie=b5a026a1741296ad in_seq=0 out_seq=0 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.106+0000 7fbb877fe640 10 client.15507 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.106+0000 7fbb877fe640 1 -- 172.21.15.98:0/1725268673 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55838fcd3d70 con 0x55838fdeba00 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.106+0000 7fbb877fe640 10 client.15507 handle_command_reply: tid=0 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.106+0000 7fbbb0da8740 1 client.15507 shutdown 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.107+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1725268673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 msgr2=0x55838fd83b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.107+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd83b90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c000c00 tx=0x7fbb9c0120d0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.107+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1725268673 shutdown_connections 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.107+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55838fdeba00 0x55838fdede20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.107+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55838fd71370 0x55838fd840d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.107+0000 7fbb877fe640 0 client.15507 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:22:51.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.107+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55838fd67b40 0x55838fd83b90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.107+0000 7fbbb0da8740 1 --2- 172.21.15.98:0/1725268673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55838fd665d0 0x55838fd867f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.107+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1725268673 >> 172.21.15.98:0/1725268673 conn(0x55838fd2f310 msgr2=0x55838fd68110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:51.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.107+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1725268673 shutdown_connections 2024-09-19T07:22:51.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.107+0000 7fbbb0da8740 1 -- 172.21.15.98:0/1725268673 wait complete. 2024-09-19T07:22:51.124 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.107+0000 7fbbb0da8740 20 client.15507 trim_cache size 0 max 16384 2024-09-19T07:22:51.124 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:22:51.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.108+0000 7fbbae9cf640 1 -- 172.21.15.98:0/636882829 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fbb900a34d0 msgr2=0x7fbb900a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:51.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.108+0000 7fbbae9cf640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fbb900a34d0 0x7fbb900a5990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbb980cd080 tx=0x7fbb98086040 comp rx=0 tx=0).stop 2024-09-19T07:22:51.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.108+0000 7fbbae9cf640 1 -- 172.21.15.98:0/636882829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba8102d30 msgr2=0x7fbba81a03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:51.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.108+0000 7fbbae9cf640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba8102d30 0x7fbba81a03e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800d770 tx=0x7fbb9800dc30 comp rx=0 tx=0).stop 2024-09-19T07:22:51.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.108+0000 7fbbae9cf640 1 -- 172.21.15.98:0/636882829 shutdown_connections 2024-09-19T07:22:51.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.108+0000 7fbbae9cf640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fbb900a34d0 0x7fbb900a5990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.108+0000 7fbbae9cf640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbba81082a0 0x7fbba819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.108+0000 7fbbae9cf640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbba81036e0 0x7fbba81a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.108+0000 7fbbae9cf640 1 --2- 172.21.15.98:0/636882829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbba8102d30 0x7fbba81a03e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:51.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.108+0000 7fbbae9cf640 1 -- 172.21.15.98:0/636882829 >> 172.21.15.98:0/636882829 conn(0x7fbba80fc7d0 msgr2=0x7fbba81012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:51.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.108+0000 7fbbae9cf640 1 -- 172.21.15.98:0/636882829 shutdown_connections 2024-09-19T07:22:51.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:51.108+0000 7fbbae9cf640 1 -- 172.21.15.98:0/636882829 wait complete. 2024-09-19T07:22:51.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:50 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1692628924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:51.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:50 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1692628924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:22:51.912 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:51.916 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:22:52.217 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:51 smithi098 ceph-mon[30950]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-19T07:22:52.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:51 smithi139 ceph-mon[35039]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-19T07:22:52.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:51 smithi162 ceph-mon[35726]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-19T07:22:52.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.486+0000 7fc8700ee640 1 -- 172.21.15.98:0/328263868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc868102ef0 msgr2=0x7fc86810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:52.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.486+0000 7fc8700ee640 1 --2- 172.21.15.98:0/328263868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc868102ef0 0x7fc86810da40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc860009ca0 tx=0x7fc86002a950 comp rx=0 tx=0).stop 2024-09-19T07:22:52.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.486+0000 7fc8700ee640 1 -- 172.21.15.98:0/328263868 shutdown_connections 2024-09-19T07:22:52.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.486+0000 7fc8700ee640 1 --2- 172.21.15.98:0/328263868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc868102ef0 0x7fc86810da40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.486+0000 7fc8700ee640 1 --2- 172.21.15.98:0/328263868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc868102570 0x7fc8681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.486+0000 7fc8700ee640 1 --2- 172.21.15.98:0/328263868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc868100e20 0x7fc868101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.486+0000 7fc8700ee640 1 -- 172.21.15.98:0/328263868 >> 172.21.15.98:0/328263868 conn(0x7fc8680fc7d0 msgr2=0x7fc8680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:52.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.486+0000 7fc8700ee640 1 -- 172.21.15.98:0/328263868 shutdown_connections 2024-09-19T07:22:52.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.486+0000 7fc8700ee640 1 -- 172.21.15.98:0/328263868 wait complete. 2024-09-19T07:22:52.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.487+0000 7fc8700ee640 1 Processor -- start 2024-09-19T07:22:52.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.487+0000 7fc8700ee640 1 -- start start 2024-09-19T07:22:52.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.487+0000 7fc8700ee640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc868100e20 0x7fc868197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.487+0000 7fc8700ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc868102570 0x7fc8681975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.487+0000 7fc8700ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc868102ef0 0x7fc868197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.487+0000 7fc86de8a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc868100e20 0x7fc868197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc86de8a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc868100e20 0x7fc868197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54668/0 (socket says 172.21.15.98:54668) 2024-09-19T07:22:52.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc8700ee640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc868110fa0 con 0x7fc868100e20 2024-09-19T07:22:52.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc8700ee640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc868110e20 con 0x7fc868102ef0 2024-09-19T07:22:52.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc86de8a640 1 -- 172.21.15.98:0/2076834122 learned_addr learned my addr 172.21.15.98:0/2076834122 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:52.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc8700ee640 1 -- 172.21.15.98:0/2076834122 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc868111120 con 0x7fc868102570 2024-09-19T07:22:52.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc86e68b640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc868102ef0 0x7fc868197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc86d689640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc868102570 0x7fc8681975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc86de8a640 1 -- 172.21.15.98:0/2076834122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc868102570 msgr2=0x7fc8681975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:52.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc86de8a640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc868102570 0x7fc8681975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc86de8a640 1 -- 172.21.15.98:0/2076834122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc868102ef0 msgr2=0x7fc868197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:52.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc86de8a640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc868102ef0 0x7fc868197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc86de8a640 1 -- 172.21.15.98:0/2076834122 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8681a6900 con 0x7fc868100e20 2024-09-19T07:22:52.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc86de8a640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc868100e20 0x7fc868197090 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc86400b4a0 tx=0x7fc86400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:52.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc85effd640 1 -- 172.21.15.98:0/2076834122 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc864015020 con 0x7fc868100e20 2024-09-19T07:22:52.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc8700ee640 1 -- 172.21.15.98:0/2076834122 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8681a6bf0 con 0x7fc868100e20 2024-09-19T07:22:52.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc85effd640 1 -- 172.21.15.98:0/2076834122 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc864011d10 con 0x7fc868100e20 2024-09-19T07:22:52.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc85effd640 1 -- 172.21.15.98:0/2076834122 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86400f2e0 con 0x7fc868100e20 2024-09-19T07:22:52.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.488+0000 7fc8700ee640 1 -- 172.21.15.98:0/2076834122 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8681a7130 con 0x7fc868100e20 2024-09-19T07:22:52.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.491+0000 7fc85effd640 1 -- 172.21.15.98:0/2076834122 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fc864018020 con 0x7fc868100e20 2024-09-19T07:22:52.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.491+0000 7fc8724c7740 1 Processor -- start 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.491+0000 7fc8724c7740 1 -- start start 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc8724c7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856e760 0x55953856eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc8724c7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856f080 0x559538579400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc8724c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559538579940 0x55953857bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc8724c7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5595384d42a0 con 0x55953856f080 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc8724c7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55953847bb10 con 0x55953856e760 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc8724c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5595384d0260 con 0x559538579940 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc85effd640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc8540a34d0 0x7fc8540a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86de8a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856f080 0x559538579400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86de8a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856f080 0x559538579400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54672/0 (socket says 172.21.15.98:54672) 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86de8a640 1 -- 172.21.15.98:0/2152351199 learned_addr learned my addr 172.21.15.98:0/2152351199 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86e68b640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc8540a34d0 0x7fc8540a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86e68b640 1 --2- 172.21.15.98:0/2152351199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856e760 0x55953856eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86d689640 1 --2- 172.21.15.98:0/2152351199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559538579940 0x55953857bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86de8a640 1 -- 172.21.15.98:0/2152351199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559538579940 msgr2=0x55953857bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:52.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86de8a640 1 --2- 172.21.15.98:0/2152351199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559538579940 0x55953857bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86de8a640 1 -- 172.21.15.98:0/2152351199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856e760 msgr2=0x55953856eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:52.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86de8a640 1 --2- 172.21.15.98:0/2152351199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856e760 0x55953856eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86de8a640 1 -- 172.21.15.98:0/2152351199 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559538245b90 con 0x55953856f080 2024-09-19T07:22:52.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc85effd640 1 -- 172.21.15.98:0/2076834122 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc8640cf790 con 0x7fc868100e20 2024-09-19T07:22:52.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86e68b640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc8540a34d0 0x7fc8540a5990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc860005fe0 tx=0x7fc860005c50 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:52.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.492+0000 7fc86de8a640 1 --2- 172.21.15.98:0/2152351199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856f080 0x559538579400 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc8640ccf50 tx=0x7fc8640c66d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e2aa8a06cb478f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:52.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.493+0000 7fc853fff640 1 -- 172.21.15.98:0/2152351199 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86409b440 con 0x55953856f080 2024-09-19T07:22:52.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.493+0000 7fc853fff640 1 -- 172.21.15.98:0/2152351199 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc86409c000 con 0x55953856f080 2024-09-19T07:22:52.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.493+0000 7fc853fff640 1 -- 172.21.15.98:0/2152351199 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8640092b0 con 0x55953856f080 2024-09-19T07:22:52.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.494+0000 7fc8724c7740 1 -- 172.21.15.98:0/2152351199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856f080 msgr2=0x559538579400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:52.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.494+0000 7fc8724c7740 1 --2- 172.21.15.98:0/2152351199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856f080 0x559538579400 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc8640ccf50 tx=0x7fc8640c66d0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.494+0000 7fc8724c7740 1 -- 172.21.15.98:0/2152351199 shutdown_connections 2024-09-19T07:22:52.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.494+0000 7fc8724c7740 1 --2- 172.21.15.98:0/2152351199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559538579940 0x55953857bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.494+0000 7fc8724c7740 1 --2- 172.21.15.98:0/2152351199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856f080 0x559538579400 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.494+0000 7fc8724c7740 1 --2- 172.21.15.98:0/2152351199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856e760 0x55953856eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.494+0000 7fc8724c7740 1 -- 172.21.15.98:0/2152351199 >> 172.21.15.98:0/2152351199 conn(0x55953856acf0 msgr2=0x55953856b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:52.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.494+0000 7fc8724c7740 1 -- 172.21.15.98:0/2152351199 shutdown_connections 2024-09-19T07:22:52.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.494+0000 7fc8724c7740 1 -- 172.21.15.98:0/2152351199 wait complete. 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.494+0000 7fc8724c7740 1 -- start start 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.494+0000 7fc8724c7740 1 Processor -- start 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc8724c7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856e760 0x559538576760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc8724c7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856f080 0x559538576ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc8724c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559538579940 0x5595385771e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc8724c7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55953857c4b0 con 0x55953856e760 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc8724c7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55953845c6e0 con 0x55953856f080 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc8724c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55953857c630 con 0x559538579940 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc8724c7740 10 client.0 _ll_register_callbacks cb 0x559538480a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc86de8a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856e760 0x559538576760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc86de8a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856e760 0x559538576760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54678/0 (socket says 172.21.15.98:54678) 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc86de8a640 1 -- 172.21.15.98:0/1998115665 learned_addr learned my addr 172.21.15.98:0/1998115665 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:52.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc86e68b640 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559538579940 0x5595385771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc86d689640 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856f080 0x559538576ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc86de8a640 1 -- 172.21.15.98:0/1998115665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559538579940 msgr2=0x5595385771e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:52.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc86de8a640 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559538579940 0x5595385771e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc86de8a640 1 -- 172.21.15.98:0/1998115665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856f080 msgr2=0x559538576ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:52.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc86de8a640 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856f080 0x559538576ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc86de8a640 1 -- 172.21.15.98:0/1998115665 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559538585950 con 0x55953856e760 2024-09-19T07:22:52.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc86e68b640 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559538579940 0x5595385771e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:52.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.495+0000 7fc86d689640 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856f080 0x559538576ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:52.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc86de8a640 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856e760 0x559538576760 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc8640cd4b0 tx=0x7fc8640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82e9660146d61dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:52.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8517fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:52.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8517fa640 1 -- 172.21.15.98:0/1998115665 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86409cc30 con 0x55953856e760 2024-09-19T07:22:52.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8517fa640 1 -- 172.21.15.98:0/1998115665 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc8640d5120 con 0x55953856e760 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8724c7740 1 -- 172.21.15.98:0/1998115665 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc86409c000 con 0x55953856e760 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8517fa640 1 -- 172.21.15.98:0/1998115665 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc86409b260 con 0x55953856e760 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8724c7740 10 client.15519 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8724c7740 1 -- 172.21.15.98:0/1998115665 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55953857c4b0 con 0x55953856e760 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8517fa640 1 -- 172.21.15.98:0/1998115665 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc86409c000 con 0x55953856e760 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8517fa640 1 -- 172.21.15.98:0/1998115665 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc864097f70 con 0x55953856e760 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8724c7740 10 client.15519 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8724c7740 10 client.15519 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8724c7740 20 client.15519 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559538589410 0x55953858b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8724c7740 4 client.15519 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.496+0000 7fc8724c7740 1 -- 172.21.15.98:0/1998115665 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595384e19d0 con 0x559538589410 2024-09-19T07:22:52.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.497+0000 7fc86d689640 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559538589410 0x55953858b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.497+0000 7fc86d689640 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559538589410 0x55953858b820 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86dd9bc1e2c56050 server_cookie=c015ffc7c8425bb0 in_seq=0 out_seq=0 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.497+0000 7fc8517fa640 10 client.15519 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8517fa640 1 -- 172.21.15.98:0/1998115665 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5595384e19d0 con 0x559538589410 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8517fa640 10 client.15519 handle_command_reply: tid=0 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8724c7740 1 client.15519 shutdown 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8724c7740 1 -- 172.21.15.98:0/1998115665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856e760 msgr2=0x559538576760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856e760 0x559538576760 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc8640cd4b0 tx=0x7fc8640046c0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8724c7740 1 -- 172.21.15.98:0/1998115665 shutdown_connections 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559538579940 0x5595385771e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856f080 0x559538576ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559538589410 0x55953858b820 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1998115665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55953856e760 0x559538576760 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8724c7740 1 -- 172.21.15.98:0/1998115665 >> 172.21.15.98:0/1998115665 conn(0x55953856acf0 msgr2=0x559538569e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:52.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8517fa640 0 client.15519 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:52.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8724c7740 1 -- 172.21.15.98:0/1998115665 shutdown_connections 2024-09-19T07:22:52.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8724c7740 1 -- 172.21.15.98:0/1998115665 wait complete. 2024-09-19T07:22:52.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.498+0000 7fc8724c7740 20 client.15519 trim_cache size 0 max 16384 2024-09-19T07:22:52.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc8724c7740 1 Processor -- start 2024-09-19T07:22:52.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc8724c7740 1 -- start start 2024-09-19T07:22:52.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc8724c7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856e760 0x5595385711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc8724c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55953856f080 0x559538578630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc8724c7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 0x5595385910f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.521 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc8724c7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681b2400 con 0x559538579940 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc8724c7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681afcd0 con 0x55953856e760 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc8724c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681adb20 con 0x55953856f080 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc86e68b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 0x5595385910f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc86e68b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 0x5595385910f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54684/0 (socket says 172.21.15.98:54684) 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc86e68b640 1 -- 172.21.15.98:0/1220741615 learned_addr learned my addr 172.21.15.98:0/1220741615 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc86d689640 1 --2- 172.21.15.98:0/1220741615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55953856f080 0x559538578630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.520+0000 7fc86de8a640 1 --2- 172.21.15.98:0/1220741615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856e760 0x5595385711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.521+0000 7fc86d689640 1 -- 172.21.15.98:0/1220741615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856e760 msgr2=0x5595385711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.521+0000 7fc86d689640 1 --2- 172.21.15.98:0/1220741615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856e760 0x5595385711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.521+0000 7fc86d689640 1 -- 172.21.15.98:0/1220741615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 msgr2=0x5595385910f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.521+0000 7fc86d689640 1 --2- 172.21.15.98:0/1220741615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 0x5595385910f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.521+0000 7fc86d689640 1 -- 172.21.15.98:0/1220741615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55953856eeb0 con 0x55953856f080 2024-09-19T07:22:52.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.521+0000 7fc86e68b640 1 --2- 172.21.15.98:0/1220741615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 0x5595385910f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:52.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.521+0000 7fc86d689640 1 --2- 172.21.15.98:0/1220741615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55953856f080 0x559538578630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55953858c090 tx=0x7fc85800f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63ed26dfbd7349d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:52.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.521+0000 7fc8537fe640 1 -- 172.21.15.98:0/1220741615 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858005020 con 0x55953856f080 2024-09-19T07:22:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.521+0000 7fc8537fe640 1 -- 172.21.15.98:0/1220741615 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8580047a0 con 0x55953856f080 2024-09-19T07:22:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.521+0000 7fc8537fe640 1 -- 172.21.15.98:0/1220741615 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85801b7a0 con 0x55953856f080 2024-09-19T07:22:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.522+0000 7fc8724c7740 1 -- 172.21.15.98:0/1220741615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55953856f080 msgr2=0x559538578630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.522+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1220741615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55953856f080 0x559538578630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55953858c090 tx=0x7fc85800f7f0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.522+0000 7fc8724c7740 1 -- 172.21.15.98:0/1220741615 shutdown_connections 2024-09-19T07:22:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.522+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1220741615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 0x5595385910f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.522+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1220741615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55953856f080 0x559538578630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.522+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1220741615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856e760 0x5595385711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.522+0000 7fc8724c7740 1 -- 172.21.15.98:0/1220741615 >> 172.21.15.98:0/1220741615 conn(0x55953856acf0 msgr2=0x559538575720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.522+0000 7fc8724c7740 1 -- 172.21.15.98:0/1220741615 shutdown_connections 2024-09-19T07:22:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.522+0000 7fc8724c7740 1 -- 172.21.15.98:0/1220741615 wait complete. 2024-09-19T07:22:52.526 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.523+0000 7fc8724c7740 1 -- start start 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.523+0000 7fc8724c7740 1 Processor -- start 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.523+0000 7fc8724c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55953856e760 0x559538573870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.523+0000 7fc8724c7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856f080 0x559538573db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc8724c7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 0x5595385742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc8724c7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681ae190 con 0x559538579940 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc8724c7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681af600 con 0x55953856f080 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc8724c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681ae860 con 0x55953856e760 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc8724c7740 10 client.0 _ll_register_callbacks cb 0x7fc8640ccde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc86de8a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55953856e760 0x559538573870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc86e68b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 0x5595385742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc86d689640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856f080 0x559538573db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc86e68b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 0x5595385742f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54698/0 (socket says 172.21.15.98:54698) 2024-09-19T07:22:52.527 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc86de8a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55953856e760 0x559538573870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:56214/0 (socket says 172.21.15.98:56214) 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc86e68b640 1 -- 172.21.15.98:0/1161646058 learned_addr learned my addr 172.21.15.98:0/1161646058 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc86d689640 1 -- 172.21.15.98:0/1161646058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55953856e760 msgr2=0x559538573870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc86d689640 1 --2- 172.21.15.98:0/1161646058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55953856e760 0x559538573870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc86d689640 1 -- 172.21.15.98:0/1161646058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 msgr2=0x5595385742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc86d689640 1 --2- 172.21.15.98:0/1161646058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 0x5595385742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc86d689640 1 -- 172.21.15.98:0/1161646058 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595385f3220 con 0x55953856f080 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.524+0000 7fc86e68b640 1 --2- 172.21.15.98:0/1161646058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 0x5595385742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.525+0000 7fc86d689640 1 --2- 172.21.15.98:0/1161646058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856f080 0x559538573db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc85800ffd0 tx=0x7fc85800add0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3aaaa69448d0b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.525+0000 7fc8517fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.525+0000 7fc8517fa640 1 -- 172.21.15.98:0/1161646058 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858005000 con 0x55953856f080 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.525+0000 7fc8724c7740 1 -- 172.21.15.98:0/1161646058 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8580047a0 con 0x55953856f080 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.525+0000 7fc8517fa640 1 -- 172.21.15.98:0/1161646058 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc8580051a0 con 0x55953856f080 2024-09-19T07:22:52.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.525+0000 7fc8517fa640 1 -- 172.21.15.98:0/1161646058 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc858005400 con 0x55953856f080 2024-09-19T07:22:52.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.525+0000 7fc8724c7740 10 client.25049 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:52.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.525+0000 7fc8724c7740 1 -- 172.21.15.98:0/1161646058 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5595385f4480 con 0x55953856f080 2024-09-19T07:22:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.526+0000 7fc8517fa640 1 -- 172.21.15.98:0/1161646058 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8580047a0 con 0x55953856f080 2024-09-19T07:22:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.526+0000 7fc8517fa640 1 -- 172.21.15.98:0/1161646058 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc858036070 con 0x55953856f080 2024-09-19T07:22:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.526+0000 7fc8724c7740 10 client.25049 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.526+0000 7fc8724c7740 10 client.25049 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:22:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.526+0000 7fc8724c7740 20 client.25049 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.526+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1161646058 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5595385f4b40 0x5595385f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.526+0000 7fc8724c7740 4 client.25049 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T07:22:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.526+0000 7fc8724c7740 1 -- 172.21.15.98:0/1161646058 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x5595384dbd20 con 0x5595385f4b40 2024-09-19T07:22:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.527+0000 7fc86de8a640 1 --2- 172.21.15.98:0/1161646058 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5595385f4b40 0x5595385f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.527+0000 7fc86de8a640 1 --2- 172.21.15.98:0/1161646058 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5595385f4b40 0x5595385f6f60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c2f0481b4e83f54 server_cookie=36d6dd084d37f982 in_seq=0 out_seq=0 2024-09-19T07:22:52.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.527+0000 7fc8517fa640 10 client.25049 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:52.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.542+0000 7fc8517fa640 1 -- 172.21.15.98:0/1161646058 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5595384dbd20 con 0x5595385f4b40 2024-09-19T07:22:52.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.542+0000 7fc8517fa640 10 client.25049 handle_command_reply: tid=0 2024-09-19T07:22:52.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.542+0000 7fc8724c7740 1 client.25049 shutdown 2024-09-19T07:22:52.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.542+0000 7fc8724c7740 1 -- 172.21.15.98:0/1161646058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856f080 msgr2=0x559538573db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.542+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1161646058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856f080 0x559538573db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc85800ffd0 tx=0x7fc85800add0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.542+0000 7fc8724c7740 1 -- 172.21.15.98:0/1161646058 shutdown_connections 2024-09-19T07:22:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.542+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1161646058 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5595385f4b40 0x5595385f6f60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.542+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1161646058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559538579940 0x5595385742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.542+0000 7fc8517fa640 0 client.25049 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.542+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1161646058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55953856f080 0x559538573db0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.542+0000 7fc8724c7740 1 --2- 172.21.15.98:0/1161646058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55953856e760 0x559538573870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.542+0000 7fc8724c7740 1 -- 172.21.15.98:0/1161646058 >> 172.21.15.98:0/1161646058 conn(0x55953856acf0 msgr2=0x559538574f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.543+0000 7fc8724c7740 1 -- 172.21.15.98:0/1161646058 shutdown_connections 2024-09-19T07:22:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.543+0000 7fc8724c7740 1 -- 172.21.15.98:0/1161646058 wait complete. 2024-09-19T07:22:52.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.543+0000 7fc8724c7740 20 client.25049 trim_cache size 0 max 16384 2024-09-19T07:22:52.545 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:22:52.545 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 24, 2024-09-19T07:22:52.545 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:22:52.545 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 2, 2024-09-19T07:22:52.545 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": { 2024-09-19T07:22:52.545 INFO:teuthology.orchestra.run.smithi098.stdout: "6de5aad8": { 2024-09-19T07:22:52.545 INFO:teuthology.orchestra.run.smithi098.stdout: "version": 2, 2024-09-19T07:22:52.545 INFO:teuthology.orchestra.run.smithi098.stdout: "age_ref": 0.0, 2024-09-19T07:22:52.545 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:22:52.546 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "QUIESCED", 2024-09-19T07:22:52.546 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:22:52.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:22:52.546 INFO:teuthology.orchestra.run.smithi098.stdout: "timeout": 90.0, 2024-09-19T07:22:52.546 INFO:teuthology.orchestra.run.smithi098.stdout: "expiration": 131.2, 2024-09-19T07:22:52.546 INFO:teuthology.orchestra.run.smithi098.stdout: "members": { 2024-09-19T07:22:52.546 INFO:teuthology.orchestra.run.smithi098.stdout: "file:/": { 2024-09-19T07:22:52.546 INFO:teuthology.orchestra.run.smithi098.stdout: "excluded": false, 2024-09-19T07:22:52.546 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:22:52.546 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "QUIESCED", 2024-09-19T07:22:52.547 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:22:52.547 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:22:52.547 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:22:52.547 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:22:52.547 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:22:52.547 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:22:52.547 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:22:52.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.544+0000 7fc8700ee640 1 -- 172.21.15.98:0/2076834122 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc8540a34d0 msgr2=0x7fc8540a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:52.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.544+0000 7fc8700ee640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc8540a34d0 0x7fc8540a5990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc860005fe0 tx=0x7fc860005c50 comp rx=0 tx=0).stop 2024-09-19T07:22:52.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.544+0000 7fc8700ee640 1 -- 172.21.15.98:0/2076834122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc868100e20 msgr2=0x7fc868197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:52.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.544+0000 7fc8700ee640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc868100e20 0x7fc868197090 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc86400b4a0 tx=0x7fc86400b8a0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.544+0000 7fc8700ee640 1 -- 172.21.15.98:0/2076834122 shutdown_connections 2024-09-19T07:22:52.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.544+0000 7fc8700ee640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc8540a34d0 0x7fc8540a5990 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.544+0000 7fc8700ee640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc868102ef0 0x7fc868197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.544+0000 7fc8700ee640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc868102570 0x7fc8681975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.544+0000 7fc8700ee640 1 --2- 172.21.15.98:0/2076834122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc868100e20 0x7fc868197090 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:52.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.544+0000 7fc8700ee640 1 -- 172.21.15.98:0/2076834122 >> 172.21.15.98:0/2076834122 conn(0x7fc8680fc7d0 msgr2=0x7fc868106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:52.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.544+0000 7fc8700ee640 1 -- 172.21.15.98:0/2076834122 shutdown_connections 2024-09-19T07:22:52.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:52.544+0000 7fc8700ee640 1 -- 172.21.15.98:0/2076834122 wait complete. 2024-09-19T07:22:52.549 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:53.593 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6de5aad8', quiesce took 5.3 seconds. Will release after: 5.8999999999999995 2024-09-19T07:22:53.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.822+0000 7f4746e29640 1 -- 172.21.15.98:0/1309108388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4740102570 msgr2=0x7f47401029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:53.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.822+0000 7f4746e29640 1 --2- 172.21.15.98:0/1309108388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4740102570 0x7f47401029b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f472c009900 tx=0x7f472c02a480 comp rx=0 tx=0).stop 2024-09-19T07:22:53.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.822+0000 7f4746e29640 1 -- 172.21.15.98:0/1309108388 shutdown_connections 2024-09-19T07:22:53.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.822+0000 7f4746e29640 1 --2- 172.21.15.98:0/1309108388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4740102ef0 0x7f474010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.822+0000 7f4746e29640 1 --2- 172.21.15.98:0/1309108388 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4740102570 0x7f47401029b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.822+0000 7f4746e29640 1 --2- 172.21.15.98:0/1309108388 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4740100e20 0x7f4740101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.822+0000 7f4746e29640 1 -- 172.21.15.98:0/1309108388 >> 172.21.15.98:0/1309108388 conn(0x7f47400fc7d0 msgr2=0x7f47400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:53.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.822+0000 7f4746e29640 1 -- 172.21.15.98:0/1309108388 shutdown_connections 2024-09-19T07:22:53.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.822+0000 7f4746e29640 1 -- 172.21.15.98:0/1309108388 wait complete. 2024-09-19T07:22:53.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.823+0000 7f4746e29640 1 Processor -- start 2024-09-19T07:22:53.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.823+0000 7f4746e29640 1 -- start start 2024-09-19T07:22:53.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.823+0000 7f4746e29640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4740100e20 0x7f47401984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.823+0000 7f4746e29640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4740102570 0x7f47401989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.823+0000 7f4746e29640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4740102ef0 0x7f474019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.823+0000 7f4746e29640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4740110f80 con 0x7f4740100e20 2024-09-19T07:22:53.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.823+0000 7f4746e29640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4740110e00 con 0x7f4740102570 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.823+0000 7f4746e29640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4740111100 con 0x7f4740102ef0 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.823+0000 7f4744bc5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4740100e20 0x7f47401984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.823+0000 7f4744bc5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4740100e20 0x7f47401984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54708/0 (socket says 172.21.15.98:54708) 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.823+0000 7f4744bc5640 1 -- 172.21.15.98:0/3751454966 learned_addr learned my addr 172.21.15.98:0/3751454966 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.824+0000 7f4744bc5640 1 -- 172.21.15.98:0/3751454966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4740102ef0 msgr2=0x7f474019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.824+0000 7f4744bc5640 1 --2- 172.21.15.98:0/3751454966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4740102ef0 0x7f474019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.824+0000 7f4744bc5640 1 -- 172.21.15.98:0/3751454966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4740102570 msgr2=0x7f47401989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.824+0000 7f4744bc5640 1 --2- 172.21.15.98:0/3751454966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4740102570 0x7f47401989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.824+0000 7f4744bc5640 1 -- 172.21.15.98:0/3751454966 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f474019d460 con 0x7f4740100e20 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.824+0000 7f4744bc5640 1 --2- 172.21.15.98:0/3751454966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4740100e20 0x7f47401984b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f473400e9f0 tx=0x7f473400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.824+0000 7f473dffb640 1 -- 172.21.15.98:0/3751454966 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473400cd80 con 0x7f4740100e20 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.824+0000 7f4746e29640 1 -- 172.21.15.98:0/3751454966 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f474019d750 con 0x7f4740100e20 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.824+0000 7f473dffb640 1 -- 172.21.15.98:0/3751454966 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4734010910 con 0x7f4740100e20 2024-09-19T07:22:53.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.824+0000 7f473dffb640 1 -- 172.21.15.98:0/3751454966 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47340188f0 con 0x7f4740100e20 2024-09-19T07:22:53.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.824+0000 7f4746e29640 1 -- 172.21.15.98:0/3751454966 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47401a5030 con 0x7f4740100e20 2024-09-19T07:22:53.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.827+0000 7f4749202740 1 Processor -- start 2024-09-19T07:22:53.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.827+0000 7f4749202740 1 -- start start 2024-09-19T07:22:53.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.827+0000 7f473dffb640 1 -- 172.21.15.98:0/3751454966 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f4734010ac0 con 0x7f4740100e20 2024-09-19T07:22:53.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4749202740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef67698090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4749202740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676985d0 0x55ef67698a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4749202740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676a3370 0x55ef676a5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4749202740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ef675fe2f0 con 0x55ef676985d0 2024-09-19T07:22:53.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4749202740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ef675a5cf0 con 0x55ef676a3370 2024-09-19T07:22:53.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4749202740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ef675fa2b0 con 0x55ef67699b40 2024-09-19T07:22:53.831 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4744bc5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676985d0 0x55ef67698a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f47453c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef67698090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4744bc5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676985d0 0x55ef67698a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54712/0 (socket says 172.21.15.98:54712) 2024-09-19T07:22:53.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4744bc5640 1 -- 172.21.15.98:0/3078336612 learned_addr learned my addr 172.21.15.98:0/3078336612 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:53.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f473ffff640 1 --2- 172.21.15.98:0/3078336612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676a3370 0x55ef676a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4744bc5640 1 -- 172.21.15.98:0/3078336612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 msgr2=0x55ef67698090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:53.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4744bc5640 1 --2- 172.21.15.98:0/3078336612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef67698090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4744bc5640 1 -- 172.21.15.98:0/3078336612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676a3370 msgr2=0x55ef676a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:53.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4744bc5640 1 --2- 172.21.15.98:0/3078336612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676a3370 0x55ef676a5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.828+0000 7f4744bc5640 1 -- 172.21.15.98:0/3078336612 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef6758a3a0 con 0x55ef676985d0 2024-09-19T07:22:53.835 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.829+0000 7f4744bc5640 1 --2- 172.21.15.98:0/3078336612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676985d0 0x55ef67698a10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f47340cdc90 tx=0x7f47340d8670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe15ea29292cc343 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.829+0000 7f473dffb640 1 --2- 172.21.15.98:0/3751454966 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f47300a34d0 0x7f47300a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.829+0000 7f47453c6640 1 --2- 172.21.15.98:0/3751454966 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f47300a34d0 0x7f47300a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.829+0000 7f472affd640 1 -- 172.21.15.98:0/3078336612 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734098a50 con 0x55ef676985d0 2024-09-19T07:22:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.829+0000 7f473dffb640 1 -- 172.21.15.98:0/3751454966 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f47340d07b0 con 0x7f4740100e20 2024-09-19T07:22:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.829+0000 7f472affd640 1 -- 172.21.15.98:0/3078336612 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47340ea070 con 0x55ef676985d0 2024-09-19T07:22:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.829+0000 7f472affd640 1 -- 172.21.15.98:0/3078336612 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473409bc00 con 0x55ef676985d0 2024-09-19T07:22:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.830+0000 7f4749202740 1 -- 172.21.15.98:0/3078336612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676985d0 msgr2=0x55ef67698a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.830+0000 7f47453c6640 1 --2- 172.21.15.98:0/3751454966 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f47300a34d0 0x7f47300a5990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4738009270 tx=0x7f47380095e0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.830+0000 7f4749202740 1 --2- 172.21.15.98:0/3078336612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676985d0 0x55ef67698a10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f47340cdc90 tx=0x7f47340d8670 comp rx=0 tx=0).stop 2024-09-19T07:22:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.830+0000 7f4749202740 1 -- 172.21.15.98:0/3078336612 shutdown_connections 2024-09-19T07:22:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.830+0000 7f4749202740 1 --2- 172.21.15.98:0/3078336612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676a3370 0x55ef676a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.836 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.830+0000 7f4749202740 1 --2- 172.21.15.98:0/3078336612 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676985d0 0x55ef67698a10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.830+0000 7f4749202740 1 --2- 172.21.15.98:0/3078336612 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef67698090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.830+0000 7f4749202740 1 -- 172.21.15.98:0/3078336612 >> 172.21.15.98:0/3078336612 conn(0x55ef67661310 msgr2=0x55ef67694c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.830+0000 7f4749202740 1 -- 172.21.15.98:0/3078336612 shutdown_connections 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.830+0000 7f4749202740 1 -- 172.21.15.98:0/3078336612 wait complete. 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.831+0000 7f4749202740 1 -- start start 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.831+0000 7f4749202740 1 Processor -- start 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.831+0000 7f4749202740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef676a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.831+0000 7f4749202740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef6769ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.831+0000 7f4749202740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 0x55ef676a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.831+0000 7f4749202740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ef676a6070 con 0x55ef676a3370 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.831+0000 7f4749202740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ef675b9060 con 0x55ef676985d0 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.831+0000 7f4749202740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ef676a61f0 con 0x55ef67699b40 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.831+0000 7f4749202740 10 client.0 _ll_register_callbacks cb 0x55ef6730c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:53.837 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f47453c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 0x55ef676a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f47453c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 0x55ef676a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54722/0 (socket says 172.21.15.98:54722) 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f47453c6640 1 -- 172.21.15.98:0/2627163738 learned_addr learned my addr 172.21.15.98:0/2627163738 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f473ffff640 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef6769ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f4744bc5640 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef676a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f47453c6640 1 -- 172.21.15.98:0/2627163738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 msgr2=0x55ef6769ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f47453c6640 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef6769ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f47453c6640 1 -- 172.21.15.98:0/2627163738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 msgr2=0x55ef676a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f47453c6640 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef676a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f47453c6640 1 -- 172.21.15.98:0/2627163738 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef6736f3c0 con 0x55ef676a3370 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f47453c6640 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 0x55ef676a05d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f47380127b0 tx=0x7f4738004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3066991ffe045832 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f471ffff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f471ffff640 1 -- 172.21.15.98:0/2627163738 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738003b70 con 0x55ef676a3370 2024-09-19T07:22:53.838 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f471ffff640 1 -- 172.21.15.98:0/2627163738 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f4738003d10 con 0x55ef676a3370 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.832+0000 7f4749202740 1 -- 172.21.15.98:0/2627163738 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47340ea070 con 0x55ef676a3370 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.833+0000 7f471ffff640 1 -- 172.21.15.98:0/2627163738 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4738004b20 con 0x55ef676a3370 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.833+0000 7f4749202740 10 client.15537 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.833+0000 7f4749202740 1 -- 172.21.15.98:0/2627163738 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ef676b1b30 con 0x55ef676a3370 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.833+0000 7f471ffff640 1 -- 172.21.15.98:0/2627163738 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47340ea070 con 0x55ef676a3370 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.833+0000 7f471ffff640 1 -- 172.21.15.98:0/2627163738 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f473800f040 con 0x55ef676a3370 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.833+0000 7f4749202740 10 client.15537 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.833+0000 7f4749202740 10 client.15537 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.833+0000 7f4749202740 20 client.15537 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.833+0000 7f4749202740 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55ef676b2ff0 0x55ef676b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.833+0000 7f4749202740 4 client.15537 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.833+0000 7f4749202740 1 -- 172.21.15.98:0/2627163738 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef6760b860 con 0x55ef676b2ff0 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.834+0000 7f4744bc5640 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55ef676b2ff0 0x55ef676b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.839 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.834+0000 7f4744bc5640 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55ef676b2ff0 0x55ef676b53e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=11826204c7d9380f server_cookie=179d970e77da6f91 in_seq=0 out_seq=0 2024-09-19T07:22:53.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.834+0000 7f471ffff640 10 client.15537 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:22:53.840 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.835+0000 7f471ffff640 1 -- 172.21.15.98:0/2627163738 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef6760b860 con 0x55ef676b2ff0 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.835+0000 7f471ffff640 10 client.15537 handle_command_reply: tid=0 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.835+0000 7f4749202740 1 client.15537 shutdown 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.835+0000 7f4749202740 1 -- 172.21.15.98:0/2627163738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 msgr2=0x55ef676a05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.835+0000 7f4749202740 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 0x55ef676a05d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f47380127b0 tx=0x7f4738004a40 comp rx=0 tx=0).stop 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.835+0000 7f4749202740 1 -- 172.21.15.98:0/2627163738 shutdown_connections 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.835+0000 7f4749202740 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55ef676b2ff0 0x55ef676b53e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.835+0000 7f4749202740 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 0x55ef676a05d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.835+0000 7f4749202740 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef6769ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.835+0000 7f471ffff640 0 client.15537 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.835+0000 7f4749202740 1 --2- 172.21.15.98:0/2627163738 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef676a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.835+0000 7f4749202740 1 -- 172.21.15.98:0/2627163738 >> 172.21.15.98:0/2627163738 conn(0x55ef67661310 msgr2=0x55ef6769a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.836+0000 7f4749202740 1 -- 172.21.15.98:0/2627163738 shutdown_connections 2024-09-19T07:22:53.841 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.836+0000 7f4749202740 1 -- 172.21.15.98:0/2627163738 wait complete. 2024-09-19T07:22:53.842 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.836+0000 7f4749202740 20 client.15537 trim_cache size 0 max 16384 2024-09-19T07:22:53.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f4749202740 1 Processor -- start 2024-09-19T07:22:53.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f4749202740 1 -- start start 2024-09-19T07:22:53.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f4749202740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef67694e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f4749202740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef67699b40 0x55ef676af310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f4749202740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef676a3370 0x55ef6769b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f4749202740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f47401ae120 con 0x55ef67699b40 2024-09-19T07:22:53.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f4749202740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f47401ab9f0 con 0x55ef676985d0 2024-09-19T07:22:53.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f4749202740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47401a9860 con 0x55ef676a3370 2024-09-19T07:22:53.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f473ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef67699b40 0x55ef676af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f473ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef67699b40 0x55ef676af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54728/0 (socket says 172.21.15.98:54728) 2024-09-19T07:22:53.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f473ffff640 1 -- 172.21.15.98:0/2283308402 learned_addr learned my addr 172.21.15.98:0/2283308402 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:53.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f4744bc5640 1 --2- 172.21.15.98:0/2283308402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef67694e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f47453c6640 1 --2- 172.21.15.98:0/2283308402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef676a3370 0x55ef6769b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f473ffff640 1 -- 172.21.15.98:0/2283308402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef676a3370 msgr2=0x55ef6769b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:53.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f473ffff640 1 --2- 172.21.15.98:0/2283308402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef676a3370 0x55ef6769b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f473ffff640 1 -- 172.21.15.98:0/2283308402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 msgr2=0x55ef67694e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:53.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f473ffff640 1 --2- 172.21.15.98:0/2283308402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef67694e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f473ffff640 1 -- 172.21.15.98:0/2283308402 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef6769e530 con 0x55ef67699b40 2024-09-19T07:22:53.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.850+0000 7f473ffff640 1 --2- 172.21.15.98:0/2283308402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef67699b40 0x55ef676af310 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f47400fef00 tx=0x7f472c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ed3478446c416e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:53.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.851+0000 7f472a7fc640 1 -- 172.21.15.98:0/2283308402 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c035040 con 0x55ef67699b40 2024-09-19T07:22:53.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.851+0000 7f472a7fc640 1 -- 172.21.15.98:0/2283308402 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f472c0043b0 con 0x55ef67699b40 2024-09-19T07:22:53.852 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.851+0000 7f472a7fc640 1 -- 172.21.15.98:0/2283308402 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c031ba0 con 0x55ef67699b40 2024-09-19T07:22:53.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.851+0000 7f4749202740 1 -- 172.21.15.98:0/2283308402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef67699b40 msgr2=0x55ef676af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:53.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.851+0000 7f4749202740 1 --2- 172.21.15.98:0/2283308402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef67699b40 0x55ef676af310 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f47400fef00 tx=0x7f472c004040 comp rx=0 tx=0).stop 2024-09-19T07:22:53.856 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.851+0000 7f4749202740 1 -- 172.21.15.98:0/2283308402 shutdown_connections 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.851+0000 7f4749202740 1 --2- 172.21.15.98:0/2283308402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef676a3370 0x55ef6769b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.851+0000 7f4749202740 1 --2- 172.21.15.98:0/2283308402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef67699b40 0x55ef676af310 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.851+0000 7f4749202740 1 --2- 172.21.15.98:0/2283308402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef67694e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.851+0000 7f4749202740 1 -- 172.21.15.98:0/2283308402 >> 172.21.15.98:0/2283308402 conn(0x55ef67661310 msgr2=0x55ef67694700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.852+0000 7f4749202740 1 -- 172.21.15.98:0/2283308402 shutdown_connections 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.852+0000 7f4749202740 1 -- 172.21.15.98:0/2283308402 wait complete. 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.852+0000 7f4749202740 1 -- start start 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.852+0000 7f4749202740 1 Processor -- start 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.852+0000 7f4749202740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef676abc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.852+0000 7f4749202740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef676a6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.852+0000 7f4749202740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 0x55ef676a74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.852+0000 7f4749202740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f47401a9eb0 con 0x55ef676a3370 2024-09-19T07:22:53.857 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.852+0000 7f4749202740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f47401ab320 con 0x55ef676985d0 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.852+0000 7f4749202740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f47401aa580 con 0x55ef67699b40 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.852+0000 7f4749202740 10 client.0 _ll_register_callbacks cb 0x7f4738009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f47453c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 0x55ef676a74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f47453c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 0x55ef676a74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54744/0 (socket says 172.21.15.98:54744) 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f47453c6640 1 -- 172.21.15.98:0/3643361883 learned_addr learned my addr 172.21.15.98:0/3643361883 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f473ffff640 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef676a6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f4744bc5640 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef676abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f47453c6640 1 -- 172.21.15.98:0/3643361883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 msgr2=0x55ef676a6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f47453c6640 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef676a6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f47453c6640 1 -- 172.21.15.98:0/3643361883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 msgr2=0x55ef676abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f47453c6640 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef676abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f47453c6640 1 -- 172.21.15.98:0/3643361883 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef676a7d20 con 0x55ef676a3370 2024-09-19T07:22:53.858 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f473ffff640 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef676a6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f4744bc5640 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef676abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f47453c6640 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 0x55ef676a74f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4738006010 tx=0x7f4738009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6becc4cd5b27c2da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f471ffff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f471ffff640 1 -- 172.21.15.98:0/3643361883 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738034040 con 0x55ef676a3370 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.853+0000 7f4749202740 1 -- 172.21.15.98:0/3643361883 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f472c0043b0 con 0x55ef676a3370 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.854+0000 7f471ffff640 1 -- 172.21.15.98:0/3643361883 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f473801d710 con 0x55ef676a3370 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.854+0000 7f471ffff640 1 -- 172.21.15.98:0/3643361883 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4738045050 con 0x55ef676a3370 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.854+0000 7f4749202740 10 client.15543 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.854+0000 7f4749202740 1 -- 172.21.15.98:0/3643361883 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ef6771dcc0 con 0x55ef676a3370 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.854+0000 7f471ffff640 1 -- 172.21.15.98:0/3643361883 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f472c0043b0 con 0x55ef676a3370 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.854+0000 7f471ffff640 1 -- 172.21.15.98:0/3643361883 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4738040030 con 0x55ef676a3370 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.854+0000 7f4749202740 10 client.15543 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:53.859 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.854+0000 7f4749202740 10 client.15543 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.854+0000 7f4749202740 20 client.15543 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.854+0000 7f4749202740 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55ef676b2ff0 0x55ef67720430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.854+0000 7f4749202740 4 client.15543 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.854+0000 7f4749202740 1 -- 172.21.15.98:0/3643361883 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ef67605d70 con 0x55ef676b2ff0 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.855+0000 7f4744bc5640 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55ef676b2ff0 0x55ef67720430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.855+0000 7f471ffff640 10 client.15543 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.855+0000 7f4744bc5640 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55ef676b2ff0 0x55ef67720430 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=353c07c81b5651b7 server_cookie=d3a4342d342dc73c in_seq=0 out_seq=0 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.855+0000 7f471ffff640 1 -- 172.21.15.98:0/3643361883 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ef67605d70 con 0x55ef676b2ff0 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.855+0000 7f471ffff640 10 client.15543 handle_command_reply: tid=0 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.855+0000 7f4749202740 1 client.15543 shutdown 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.855+0000 7f4749202740 1 -- 172.21.15.98:0/3643361883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 msgr2=0x55ef676a74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.855+0000 7f4749202740 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 0x55ef676a74f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4738006010 tx=0x7f4738009cc0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.855+0000 7f4749202740 1 -- 172.21.15.98:0/3643361883 shutdown_connections 2024-09-19T07:22:53.860 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.855+0000 7f4749202740 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55ef676b2ff0 0x55ef67720430 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.856+0000 7f4749202740 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ef676a3370 0x55ef676a74f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.856+0000 7f4749202740 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef67699b40 0x55ef676a6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.856+0000 7f4749202740 1 --2- 172.21.15.98:0/3643361883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ef676985d0 0x55ef676abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.856+0000 7f4749202740 1 -- 172.21.15.98:0/3643361883 >> 172.21.15.98:0/3643361883 conn(0x55ef67661310 msgr2=0x55ef676934e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:53.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.856+0000 7f471ffff640 0 client.15543 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:22:53.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.856+0000 7f4749202740 1 -- 172.21.15.98:0/3643361883 shutdown_connections 2024-09-19T07:22:53.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.856+0000 7f4749202740 1 -- 172.21.15.98:0/3643361883 wait complete. 2024-09-19T07:22:53.861 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.856+0000 7f4749202740 20 client.15543 trim_cache size 0 max 16384 2024-09-19T07:22:53.861 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:22:53.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.857+0000 7f4746e29640 1 -- 172.21.15.98:0/3751454966 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f47300a34d0 msgr2=0x7f47300a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:53.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.857+0000 7f4746e29640 1 --2- 172.21.15.98:0/3751454966 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f47300a34d0 0x7f47300a5990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4738009270 tx=0x7f47380095e0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.857+0000 7f4746e29640 1 -- 172.21.15.98:0/3751454966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4740100e20 msgr2=0x7f47401984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:53.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.857+0000 7f4746e29640 1 --2- 172.21.15.98:0/3751454966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4740100e20 0x7f47401984b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f473400e9f0 tx=0x7f473400eeb0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.857+0000 7f4746e29640 1 -- 172.21.15.98:0/3751454966 shutdown_connections 2024-09-19T07:22:53.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.857+0000 7f4746e29640 1 --2- 172.21.15.98:0/3751454966 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f47300a34d0 0x7f47300a5990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.862 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.857+0000 7f4746e29640 1 --2- 172.21.15.98:0/3751454966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4740102ef0 0x7f474019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.857+0000 7f4746e29640 1 --2- 172.21.15.98:0/3751454966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4740102570 0x7f47401989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.857+0000 7f4746e29640 1 --2- 172.21.15.98:0/3751454966 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4740100e20 0x7f47401984b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:53.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.857+0000 7f4746e29640 1 -- 172.21.15.98:0/3751454966 >> 172.21.15.98:0/3751454966 conn(0x7f47400fc7d0 msgr2=0x7f4740069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:53.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.857+0000 7f4746e29640 1 -- 172.21.15.98:0/3751454966 shutdown_connections 2024-09-19T07:22:53.863 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:53.857+0000 7f4746e29640 1 -- 172.21.15.98:0/3751454966 wait complete. 2024-09-19T07:22:54.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:53 smithi162 ceph-mon[35726]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:22:54.165 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:53 smithi098 ceph-mon[30950]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:22:54.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:53 smithi139 ceph-mon[35039]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-19T07:22:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.654+0000 7f7221b23640 1 -- 172.21.15.98:0/2508497744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f721c101350 msgr2=0x7f721c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.654+0000 7f7221b23640 1 --2- 172.21.15.98:0/2508497744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f721c101350 0x7f721c10d880 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7214009c10 tx=0x7f721402a6e0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.654+0000 7f7221b23640 1 -- 172.21.15.98:0/2508497744 shutdown_connections 2024-09-19T07:22:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.654+0000 7f7221b23640 1 --2- 172.21.15.98:0/2508497744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f721c101350 0x7f721c10d880 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.654+0000 7f7221b23640 1 --2- 172.21.15.98:0/2508497744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f721c1009b0 0x7f721c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.654+0000 7f7221b23640 1 --2- 172.21.15.98:0/2508497744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f721c1069c0 0x7f721c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.654+0000 7f7221b23640 1 -- 172.21.15.98:0/2508497744 >> 172.21.15.98:0/2508497744 conn(0x7f721c077990 msgr2=0x7f721c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.654+0000 7f7221b23640 1 -- 172.21.15.98:0/2508497744 shutdown_connections 2024-09-19T07:22:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.654+0000 7f7221b23640 1 -- 172.21.15.98:0/2508497744 wait complete. 2024-09-19T07:22:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.655+0000 7f7221b23640 1 Processor -- start 2024-09-19T07:22:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f7221b23640 1 -- start start 2024-09-19T07:22:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f7221b23640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f721c1009b0 0x7f721c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f7221b23640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f721c101350 0x7f721c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f7221b23640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f721c1069c0 0x7f721c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f7221b23640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f721c110db0 con 0x7f721c101350 2024-09-19T07:22:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f7221b23640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f721c110c30 con 0x7f721c1009b0 2024-09-19T07:22:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f7221b23640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f721c110f30 con 0x7f721c1069c0 2024-09-19T07:22:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f721affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f721c101350 0x7f721c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.658 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f721affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f721c101350 0x7f721c198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54760/0 (socket says 172.21.15.98:54760) 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f721affd640 1 -- 172.21.15.98:0/1174677953 learned_addr learned my addr 172.21.15.98:0/1174677953 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f721b7fe640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f721c1009b0 0x7f721c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f721bfff640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f721c1069c0 0x7f721c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f721affd640 1 -- 172.21.15.98:0/1174677953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f721c1069c0 msgr2=0x7f721c19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f721affd640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f721c1069c0 0x7f721c19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f721affd640 1 -- 172.21.15.98:0/1174677953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f721c1009b0 msgr2=0x7f721c198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f721affd640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f721c1009b0 0x7f721c198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f721affd640 1 -- 172.21.15.98:0/1174677953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721c19d330 con 0x7f721c101350 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f721bfff640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f721c1069c0 0x7f721c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.656+0000 7f721affd640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f721c101350 0x7f721c198880 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f721000e9f0 tx=0x7f721000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.657+0000 7f7218ff9640 1 -- 172.21.15.98:0/1174677953 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721000ccc0 con 0x7f721c101350 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.657+0000 7f7221b23640 1 -- 172.21.15.98:0/1174677953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721c19d620 con 0x7f721c101350 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.657+0000 7f7218ff9640 1 -- 172.21.15.98:0/1174677953 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f721000ce60 con 0x7f721c101350 2024-09-19T07:22:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.657+0000 7f7218ff9640 1 -- 172.21.15.98:0/1174677953 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7210010690 con 0x7f721c101350 2024-09-19T07:22:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.657+0000 7f7221b23640 1 -- 172.21.15.98:0/1174677953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f721c1a4eb0 con 0x7f721c101350 2024-09-19T07:22:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.659+0000 7f72248bb740 1 Processor -- start 2024-09-19T07:22:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.659+0000 7f72248bb740 1 -- start start 2024-09-19T07:22:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.659+0000 7f7218ff9640 1 -- 172.21.15.98:0/1174677953 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f72100046c0 con 0x7f721c101350 2024-09-19T07:22:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f72248bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e95080 0x5601a4e93990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f72248bb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e93ed0 0x5601a4e94310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.662 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f72248bb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4ea9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f72248bb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5601a4df82f0 con 0x5601a4e93ed0 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f72248bb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5601a4da0270 con 0x5601a4ea7350 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f72248bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5601a4df42b0 con 0x5601a4e95080 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f721b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e93ed0 0x5601a4e94310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f721b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e93ed0 0x5601a4e94310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54770/0 (socket says 172.21.15.98:54770) 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f721b7fe640 1 -- 172.21.15.98:0/2535343682 learned_addr learned my addr 172.21.15.98:0/2535343682 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f721bfff640 1 --2- 172.21.15.98:0/2535343682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e95080 0x5601a4e93990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f721affd640 1 --2- 172.21.15.98:0/2535343682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4ea9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f721b7fe640 1 -- 172.21.15.98:0/2535343682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e95080 msgr2=0x5601a4e93990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f721b7fe640 1 --2- 172.21.15.98:0/2535343682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e95080 0x5601a4e93990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f721b7fe640 1 -- 172.21.15.98:0/2535343682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 msgr2=0x5601a4ea9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f721b7fe640 1 --2- 172.21.15.98:0/2535343682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4ea9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f721b7fe640 1 -- 172.21.15.98:0/2535343682 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a4d9f340 con 0x5601a4e93ed0 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f7218ff9640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f72040a3580 0x7f72040a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f721b7fe640 1 --2- 172.21.15.98:0/2535343682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e93ed0 0x5601a4e94310 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f720c009c50 tx=0x7f720c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77801c3d19b4c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.660+0000 7f721bfff640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f72040a3580 0x7f72040a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.661+0000 7f7218ff9640 1 -- 172.21.15.98:0/1174677953 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f72100d04c0 con 0x7f721c101350 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.661+0000 7f7201ffb640 1 -- 172.21.15.98:0/2535343682 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c01e070 con 0x5601a4e93ed0 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.661+0000 7f7201ffb640 1 -- 172.21.15.98:0/2535343682 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f720c019b10 con 0x5601a4e93ed0 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.661+0000 7f7201ffb640 1 -- 172.21.15.98:0/2535343682 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c00ea50 con 0x5601a4e93ed0 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.661+0000 7f72248bb740 1 -- 172.21.15.98:0/2535343682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e93ed0 msgr2=0x5601a4e94310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.661+0000 7f721bfff640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f72040a3580 0x7f72040a5a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7214005f00 tx=0x7f7214004a40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.661+0000 7f72248bb740 1 --2- 172.21.15.98:0/2535343682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e93ed0 0x5601a4e94310 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f720c009c50 tx=0x7f720c011810 comp rx=0 tx=0).stop 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.661+0000 7f72248bb740 1 -- 172.21.15.98:0/2535343682 shutdown_connections 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.661+0000 7f72248bb740 1 --2- 172.21.15.98:0/2535343682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4ea9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.661+0000 7f72248bb740 1 --2- 172.21.15.98:0/2535343682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e93ed0 0x5601a4e94310 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.661+0000 7f72248bb740 1 --2- 172.21.15.98:0/2535343682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e95080 0x5601a4e93990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.661+0000 7f72248bb740 1 -- 172.21.15.98:0/2535343682 >> 172.21.15.98:0/2535343682 conn(0x5601a4e90060 msgr2=0x5601a4e90440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.662+0000 7f72248bb740 1 -- 172.21.15.98:0/2535343682 shutdown_connections 2024-09-19T07:22:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.662+0000 7f72248bb740 1 -- 172.21.15.98:0/2535343682 wait complete. 2024-09-19T07:22:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.662+0000 7f72248bb740 1 -- start start 2024-09-19T07:22:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.662+0000 7f72248bb740 1 Processor -- start 2024-09-19T07:22:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.662+0000 7f72248bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4ea0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.662+0000 7f72248bb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4e95080 0x5601a4ea6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.662+0000 7f72248bb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4ea7350 0x5601a4ea1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.662+0000 7f72248bb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5601a4e9af20 con 0x5601a4ea7350 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.662+0000 7f72248bb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5601a4d81290 con 0x5601a4e95080 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.662+0000 7f72248bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5601a4e9b0a0 con 0x5601a4e93ed0 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.662+0000 7f72248bb740 10 client.0 _ll_register_callbacks cb 0x5601a4db2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f721bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4ea7350 0x5601a4ea1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f721bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4ea7350 0x5601a4ea1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54776/0 (socket says 172.21.15.98:54776) 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f721bfff640 1 -- 172.21.15.98:0/2435842076 learned_addr learned my addr 172.21.15.98:0/2435842076 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f721b7fe640 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4ea0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f721affd640 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4e95080 0x5601a4ea6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f721bfff640 1 -- 172.21.15.98:0/2435842076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 msgr2=0x5601a4ea0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f721bfff640 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4ea0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f721bfff640 1 -- 172.21.15.98:0/2435842076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4e95080 msgr2=0x5601a4ea6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f721bfff640 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4e95080 0x5601a4ea6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f721bfff640 1 -- 172.21.15.98:0/2435842076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601a4b0b210 con 0x5601a4ea7350 2024-09-19T07:22:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f721bfff640 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4ea7350 0x5601a4ea1560 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7214004af0 tx=0x7f721402a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a30f709c0bc023 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f71faffd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f71faffd640 1 -- 172.21.15.98:0/2435842076 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7214050070 con 0x5601a4ea7350 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f71faffd640 1 -- 172.21.15.98:0/2435842076 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f7214004240 con 0x5601a4ea7350 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f72248bb740 1 -- 172.21.15.98:0/2435842076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f720c019b10 con 0x5601a4ea7350 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f71faffd640 1 -- 172.21.15.98:0/2435842076 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f721405c050 con 0x5601a4ea7350 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f72248bb740 10 client.15555 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.663+0000 7f72248bb740 1 -- 172.21.15.98:0/2435842076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5601a4bd7620 con 0x5601a4ea7350 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.664+0000 7f71faffd640 1 -- 172.21.15.98:0/2435842076 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f720c019b10 con 0x5601a4ea7350 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.664+0000 7f71faffd640 1 -- 172.21.15.98:0/2435842076 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f721403c040 con 0x5601a4ea7350 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.664+0000 7f72248bb740 10 client.15555 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.664+0000 7f72248bb740 10 client.15555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.664+0000 7f72248bb740 20 client.15555 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.664+0000 7f72248bb740 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5601a4ebfca0 0x5601a4ec20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.664+0000 7f72248bb740 4 client.15555 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.664+0000 7f72248bb740 1 -- 172.21.15.98:0/2435842076 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601a4e05a20 con 0x5601a4ebfca0 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.664+0000 7f721b7fe640 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5601a4ebfca0 0x5601a4ec20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.665+0000 7f721b7fe640 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5601a4ebfca0 0x5601a4ec20b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab34ae4d7286a2 server_cookie=6326fb9c9c077eb0 in_seq=0 out_seq=0 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.665+0000 7f71faffd640 10 client.15555 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.665+0000 7f71faffd640 1 -- 172.21.15.98:0/2435842076 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5601a4e05a20 con 0x5601a4ebfca0 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.665+0000 7f71faffd640 10 client.15555 handle_command_reply: tid=0 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.665+0000 7f72248bb740 1 client.15555 shutdown 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.666+0000 7f72248bb740 1 -- 172.21.15.98:0/2435842076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4ea7350 msgr2=0x5601a4ea1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.666+0000 7f72248bb740 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4ea7350 0x5601a4ea1560 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7214004af0 tx=0x7f721402a6e0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.666+0000 7f72248bb740 1 -- 172.21.15.98:0/2435842076 shutdown_connections 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.666+0000 7f72248bb740 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5601a4ebfca0 0x5601a4ec20b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.666+0000 7f72248bb740 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4ea7350 0x5601a4ea1560 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.666+0000 7f72248bb740 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4e95080 0x5601a4ea6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.666+0000 7f72248bb740 1 --2- 172.21.15.98:0/2435842076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4ea0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.666+0000 7f72248bb740 1 -- 172.21.15.98:0/2435842076 >> 172.21.15.98:0/2435842076 conn(0x5601a4e90060 msgr2=0x5601a4e95dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.666+0000 7f71faffd640 0 client.15555 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.666+0000 7f72248bb740 1 -- 172.21.15.98:0/2435842076 shutdown_connections 2024-09-19T07:22:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.666+0000 7f72248bb740 1 -- 172.21.15.98:0/2435842076 wait complete. 2024-09-19T07:22:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.666+0000 7f72248bb740 20 client.15555 trim_cache size 0 max 16384 2024-09-19T07:22:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.680+0000 7f72248bb740 1 Processor -- start 2024-09-19T07:22:54.682 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.680+0000 7f72248bb740 1 -- start start 2024-09-19T07:22:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.680+0000 7f72248bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4ea6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.680+0000 7f72248bb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 0x5601a4ea14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.680+0000 7f72248bb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4e8e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.680+0000 7f72248bb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f721c1adfa0 con 0x5601a4e95080 2024-09-19T07:22:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.680+0000 7f72248bb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f721c1ab870 con 0x5601a4ea7350 2024-09-19T07:22:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.680+0000 7f72248bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f721c1a96e0 con 0x5601a4e93ed0 2024-09-19T07:22:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.680+0000 7f721affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 0x5601a4ea14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.680+0000 7f721affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 0x5601a4ea14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54786/0 (socket says 172.21.15.98:54786) 2024-09-19T07:22:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.680+0000 7f721affd640 1 -- 172.21.15.98:0/731658950 learned_addr learned my addr 172.21.15.98:0/731658950 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f721bfff640 1 --2- 172.21.15.98:0/731658950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4e8e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f721b7fe640 1 --2- 172.21.15.98:0/731658950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4ea6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.683 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f721affd640 1 -- 172.21.15.98:0/731658950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 msgr2=0x5601a4ea6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f721affd640 1 --2- 172.21.15.98:0/731658950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4ea6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f721affd640 1 -- 172.21.15.98:0/731658950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 msgr2=0x5601a4e8e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f721affd640 1 --2- 172.21.15.98:0/731658950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4e8e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f721affd640 1 -- 172.21.15.98:0/731658950 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601a4e94710 con 0x5601a4e95080 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f721bfff640 1 --2- 172.21.15.98:0/731658950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4e8e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f721b7fe640 1 --2- 172.21.15.98:0/731658950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4ea6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f721affd640 1 --2- 172.21.15.98:0/731658950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 0x5601a4ea14e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f72100ce1e0 tx=0x7f72100d6060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449c35c544aca6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f72017fa640 1 -- 172.21.15.98:0/731658950 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72100987c0 con 0x5601a4e95080 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f72017fa640 1 -- 172.21.15.98:0/731658950 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f721009cc20 con 0x5601a4e95080 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.681+0000 7f72017fa640 1 -- 172.21.15.98:0/731658950 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721009be80 con 0x5601a4e95080 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.682+0000 7f72248bb740 1 -- 172.21.15.98:0/731658950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 msgr2=0x5601a4ea14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.682+0000 7f72248bb740 1 --2- 172.21.15.98:0/731658950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 0x5601a4ea14e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f72100ce1e0 tx=0x7f72100d6060 comp rx=0 tx=0).stop 2024-09-19T07:22:54.684 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.682+0000 7f72248bb740 1 -- 172.21.15.98:0/731658950 shutdown_connections 2024-09-19T07:22:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.682+0000 7f72248bb740 1 --2- 172.21.15.98:0/731658950 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4e8e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.682+0000 7f72248bb740 1 --2- 172.21.15.98:0/731658950 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 0x5601a4ea14e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.682+0000 7f72248bb740 1 --2- 172.21.15.98:0/731658950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4ea6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.682+0000 7f72248bb740 1 -- 172.21.15.98:0/731658950 >> 172.21.15.98:0/731658950 conn(0x5601a4e90060 msgr2=0x5601a4ea0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.682+0000 7f72248bb740 1 -- 172.21.15.98:0/731658950 shutdown_connections 2024-09-19T07:22:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.682+0000 7f72248bb740 1 -- 172.21.15.98:0/731658950 wait complete. 2024-09-19T07:22:54.685 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.682+0000 7f72248bb740 1 -- start start 2024-09-19T07:22:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f72248bb740 1 Processor -- start 2024-09-19T07:22:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f72248bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4e99180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f72248bb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 0x5601a4ed36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f72248bb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4ed3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f72248bb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f721c1a9d30 con 0x5601a4e95080 2024-09-19T07:22:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f72248bb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f721c1ab1a0 con 0x5601a4ea7350 2024-09-19T07:22:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f72248bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f721c1aa400 con 0x5601a4e93ed0 2024-09-19T07:22:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f72248bb740 10 client.0 _ll_register_callbacks cb 0x7f7214043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f721affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 0x5601a4ed36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f721affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 0x5601a4ed36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54802/0 (socket says 172.21.15.98:54802) 2024-09-19T07:22:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f721affd640 1 -- 172.21.15.98:0/1779749662 learned_addr learned my addr 172.21.15.98:0/1779749662 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:54.688 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f721b7fe640 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4e99180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f721bfff640 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4ed3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f721affd640 1 -- 172.21.15.98:0/1779749662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 msgr2=0x5601a4e99180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f721affd640 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4e99180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f721affd640 1 -- 172.21.15.98:0/1779749662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 msgr2=0x5601a4ed3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f721affd640 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4ed3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f721affd640 1 -- 172.21.15.98:0/1779749662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601a4ec73b0 con 0x5601a4e95080 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f721bfff640 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4ed3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f721affd640 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 0x5601a4ed36f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7210098980 tx=0x7f7210005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758551cfb168d6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.683+0000 7f71faffd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f71faffd640 1 -- 172.21.15.98:0/1779749662 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72100b4070 con 0x5601a4e95080 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f71faffd640 1 -- 172.21.15.98:0/1779749662 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f72100cdd40 con 0x5601a4e95080 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f72248bb740 1 -- 172.21.15.98:0/1779749662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f721009cc20 con 0x5601a4e95080 2024-09-19T07:22:54.689 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f71faffd640 1 -- 172.21.15.98:0/1779749662 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f721009c060 con 0x5601a4e95080 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f72248bb740 10 client.15561 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f72248bb740 1 -- 172.21.15.98:0/1779749662 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5601a4f2a900 con 0x5601a4e95080 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f71faffd640 1 -- 172.21.15.98:0/1779749662 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f721009cc20 con 0x5601a4e95080 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f71faffd640 1 -- 172.21.15.98:0/1779749662 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f72100b5260 con 0x5601a4e95080 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f72248bb740 10 client.15561 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f72248bb740 10 client.15561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f72248bb740 20 client.15561 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f72248bb740 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5601a4f2af40 0x5601a4f2d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f72248bb740 4 client.15561 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.684+0000 7f72248bb740 1 -- 172.21.15.98:0/1779749662 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5601a4dffd70 con 0x5601a4f2af40 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.685+0000 7f721b7fe640 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5601a4f2af40 0x5601a4f2d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.685+0000 7f721b7fe640 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5601a4f2af40 0x5601a4f2d360 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1c3c3148f6ca4f5 server_cookie=6aea21ecb70c0d2 in_seq=0 out_seq=0 2024-09-19T07:22:54.690 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.685+0000 7f71faffd640 10 client.15561 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f71faffd640 1 -- 172.21.15.98:0/1779749662 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5601a4dffd70 con 0x5601a4f2af40 2024-09-19T07:22:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f71faffd640 10 client.15561 handle_command_reply: tid=0 2024-09-19T07:22:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f72248bb740 1 client.15561 shutdown 2024-09-19T07:22:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f72248bb740 1 -- 172.21.15.98:0/1779749662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 msgr2=0x5601a4ed36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f72248bb740 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 0x5601a4ed36f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7210098980 tx=0x7f7210005cc0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f72248bb740 1 -- 172.21.15.98:0/1779749662 shutdown_connections 2024-09-19T07:22:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f72248bb740 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5601a4ea7350 0x5601a4ed3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f72248bb740 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5601a4f2af40 0x5601a4f2d360 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f72248bb740 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5601a4e95080 0x5601a4ed36f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f72248bb740 1 --2- 172.21.15.98:0/1779749662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601a4e93ed0 0x5601a4e99180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f71faffd640 0 client.15561 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:54.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f72248bb740 1 -- 172.21.15.98:0/1779749662 >> 172.21.15.98:0/1779749662 conn(0x5601a4e90060 msgr2=0x5601a4e8e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f72248bb740 1 -- 172.21.15.98:0/1779749662 shutdown_connections 2024-09-19T07:22:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f72248bb740 1 -- 172.21.15.98:0/1779749662 wait complete. 2024-09-19T07:22:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.692+0000 7f72248bb740 20 client.15561 trim_cache size 0 max 16384 2024-09-19T07:22:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:22:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:22:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:22:54.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:22:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.693+0000 7f7221b23640 1 -- 172.21.15.98:0/1174677953 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f72040a3580 msgr2=0x7f72040a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.693+0000 7f7221b23640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f72040a3580 0x7f72040a5a40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7214005f00 tx=0x7f7214004a40 comp rx=0 tx=0).stop 2024-09-19T07:22:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.693+0000 7f7221b23640 1 -- 172.21.15.98:0/1174677953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f721c101350 msgr2=0x7f721c198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.693+0000 7f7221b23640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f721c101350 0x7f721c198880 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f721000e9f0 tx=0x7f721000edf0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.693+0000 7f7221b23640 1 -- 172.21.15.98:0/1174677953 shutdown_connections 2024-09-19T07:22:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.693+0000 7f7221b23640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f72040a3580 0x7f72040a5a40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.695 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.693+0000 7f7221b23640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f721c1069c0 0x7f721c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.693+0000 7f7221b23640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f721c101350 0x7f721c198880 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.693+0000 7f7221b23640 1 --2- 172.21.15.98:0/1174677953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f721c1009b0 0x7f721c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.693+0000 7f7221b23640 1 -- 172.21.15.98:0/1174677953 >> 172.21.15.98:0/1174677953 conn(0x7f721c077990 msgr2=0x7f721c0699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.693+0000 7f7221b23640 1 -- 172.21.15.98:0/1174677953 shutdown_connections 2024-09-19T07:22:54.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:22:54.693+0000 7f7221b23640 1 -- 172.21.15.98:0/1174677953 wait complete. 2024-09-19T07:22:55.476 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:22:55.730 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:22:56.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:55 smithi162 ceph-mon[35726]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-19T07:22:56.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:55 smithi098 ceph-mon[30950]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-19T07:22:56.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:55 smithi139 ceph-mon[35039]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-09-19T07:22:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:57 smithi098 ceph-mon[30950]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:22:58.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:57 smithi162 ceph-mon[35726]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:22:58.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:57 smithi139 ceph-mon[35039]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:22:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.780+0000 7fd8d43ee640 1 -- 172.21.15.98:0/2502786604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8cc102ef0 msgr2=0x7fd8cc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:59.440 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.780+0000 7fd8d43ee640 1 --2- 172.21.15.98:0/2502786604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8cc102ef0 0x7fd8cc10da40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009ca0 tx=0x7fd8c402a950 comp rx=0 tx=0).stop 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.780+0000 7fd8d43ee640 1 -- 172.21.15.98:0/2502786604 shutdown_connections 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.780+0000 7fd8d43ee640 1 --2- 172.21.15.98:0/2502786604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8cc102ef0 0x7fd8cc10da40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.780+0000 7fd8d43ee640 1 --2- 172.21.15.98:0/2502786604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8cc102570 0x7fd8cc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.780+0000 7fd8d43ee640 1 --2- 172.21.15.98:0/2502786604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8cc100e20 0x7fd8cc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.781+0000 7fd8d43ee640 1 -- 172.21.15.98:0/2502786604 >> 172.21.15.98:0/2502786604 conn(0x7fd8cc0fc7d0 msgr2=0x7fd8cc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.781+0000 7fd8d43ee640 1 -- 172.21.15.98:0/2502786604 shutdown_connections 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.781+0000 7fd8d43ee640 1 -- 172.21.15.98:0/2502786604 wait complete. 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.781+0000 7fd8d43ee640 1 Processor -- start 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.781+0000 7fd8d43ee640 1 -- start start 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d43ee640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8cc100e20 0x7fd8cc1a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d43ee640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8cc102570 0x7fd8cc1a4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d43ee640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8cc102ef0 0x7fd8cc19ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.441 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d43ee640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc110ff0 con 0x7fd8cc102570 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d43ee640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc110e70 con 0x7fd8cc102ef0 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d43ee640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc111170 con 0x7fd8cc100e20 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d1989640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8cc102570 0x7fd8cc1a4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d1989640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8cc102570 0x7fd8cc1a4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54826/0 (socket says 172.21.15.98:54826) 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d1989640 1 -- 172.21.15.98:0/24901759 learned_addr learned my addr 172.21.15.98:0/24901759 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d218a640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8cc100e20 0x7fd8cc1a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d298b640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8cc102ef0 0x7fd8cc19ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d1989640 1 -- 172.21.15.98:0/24901759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8cc100e20 msgr2=0x7fd8cc1a4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d1989640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8cc100e20 0x7fd8cc1a4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d1989640 1 -- 172.21.15.98:0/24901759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8cc102ef0 msgr2=0x7fd8cc19ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d1989640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8cc102ef0 0x7fd8cc19ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.782+0000 7fd8d1989640 1 -- 172.21.15.98:0/24901759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8cc19f500 con 0x7fd8cc102570 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.783+0000 7fd8d1989640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8cc102570 0x7fd8cc1a4d50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00b4a0 tx=0x7fd8bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:59.442 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.783+0000 7fd8c37fe640 1 -- 172.21.15.98:0/24901759 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc014070 con 0x7fd8cc102570 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.783+0000 7fd8c37fe640 1 -- 172.21.15.98:0/24901759 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8bc010af0 con 0x7fd8cc102570 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.783+0000 7fd8c37fe640 1 -- 172.21.15.98:0/24901759 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc017d10 con 0x7fd8cc102570 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.783+0000 7fd8d43ee640 1 -- 172.21.15.98:0/24901759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8cc19f7f0 con 0x7fd8cc102570 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.783+0000 7fd8d43ee640 1 -- 172.21.15.98:0/24901759 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8cc1ab680 con 0x7fd8cc102570 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.785+0000 7fd8c37fe640 1 -- 172.21.15.98:0/24901759 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fd8bc017070 con 0x7fd8cc102570 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.786+0000 7fd8c37fe640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd8b80a3620 0x7fd8b80a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.786+0000 7fd8d67c7740 1 Processor -- start 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.786+0000 7fd8c37fe640 1 -- 172.21.15.98:0/24901759 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fd8bc0cf150 con 0x7fd8cc102570 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.786+0000 7fd8d218a640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd8b80a3620 0x7fd8b80a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.787+0000 7fd8d67c7740 1 -- start start 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.787+0000 7fd8d218a640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd8b80a3620 0x7fd8b80a5ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80058c0 tx=0x7fd8c800a2d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.787+0000 7fd8d67c7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77359b40 0x557d77358090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.443 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.787+0000 7fd8d67c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 0x557d77358a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.787+0000 7fd8d67c7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 0x557d77365760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.787+0000 7fd8d67c7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557d772be2f0 con 0x557d77363370 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.787+0000 7fd8d67c7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557d77265cf0 con 0x557d77359b40 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.787+0000 7fd8d67c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557d772ba2b0 con 0x557d773585d0 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.787+0000 7fd8d298b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 0x557d77365760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.787+0000 7fd8d298b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 0x557d77365760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54834/0 (socket says 172.21.15.98:54834) 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.787+0000 7fd8d298b640 1 -- 172.21.15.98:0/4267921561 learned_addr learned my addr 172.21.15.98:0/4267921561 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.788+0000 7fd8d1989640 1 --2- 172.21.15.98:0/4267921561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 0x557d77358a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.788+0000 7fd8d218a640 1 --2- 172.21.15.98:0/4267921561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77359b40 0x557d77358090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.788+0000 7fd8d298b640 1 -- 172.21.15.98:0/4267921561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 msgr2=0x557d77358a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.788+0000 7fd8d298b640 1 --2- 172.21.15.98:0/4267921561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 0x557d77358a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.788+0000 7fd8d298b640 1 -- 172.21.15.98:0/4267921561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77359b40 msgr2=0x557d77358090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:59.444 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.788+0000 7fd8d298b640 1 --2- 172.21.15.98:0/4267921561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77359b40 0x557d77358090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.788+0000 7fd8d298b640 1 -- 172.21.15.98:0/4267921561 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d7724a3a0 con 0x557d77363370 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.788+0000 7fd8d298b640 1 --2- 172.21.15.98:0/4267921561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 0x557d77365760 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009ca0 tx=0x7fd8c4031fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edeec4c9f5d2d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.788+0000 7fd8c0dea640 1 -- 172.21.15.98:0/4267921561 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4048070 con 0x557d77363370 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.788+0000 7fd8c0dea640 1 -- 172.21.15.98:0/4267921561 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8c4003e50 con 0x557d77363370 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.788+0000 7fd8c0dea640 1 -- 172.21.15.98:0/4267921561 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4034040 con 0x557d77363370 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.789+0000 7fd8d67c7740 1 -- 172.21.15.98:0/4267921561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 msgr2=0x557d77365760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.789+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/4267921561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 0x557d77365760 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009ca0 tx=0x7fd8c4031fa0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.789+0000 7fd8d67c7740 1 -- 172.21.15.98:0/4267921561 shutdown_connections 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.789+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/4267921561 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 0x557d77365760 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.789+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/4267921561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 0x557d77358a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.789+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/4267921561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77359b40 0x557d77358090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.789+0000 7fd8d67c7740 1 -- 172.21.15.98:0/4267921561 >> 172.21.15.98:0/4267921561 conn(0x557d77321310 msgr2=0x557d77354c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.790+0000 7fd8d67c7740 1 -- 172.21.15.98:0/4267921561 shutdown_connections 2024-09-19T07:22:59.445 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.790+0000 7fd8d67c7740 1 -- 172.21.15.98:0/4267921561 wait complete. 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.790+0000 7fd8d67c7740 1 -- start start 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.790+0000 7fd8d67c7740 1 Processor -- start 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.791+0000 7fd8d67c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 0x557d77362d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.791+0000 7fd8d67c7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77359b40 0x557d77360000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.791+0000 7fd8d67c7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77363370 0x557d773605d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.791+0000 7fd8d67c7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557d77366010 con 0x557d77359b40 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.791+0000 7fd8d67c7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557d77279060 con 0x557d77363370 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.791+0000 7fd8d67c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557d77366190 con 0x557d773585d0 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.791+0000 7fd8d1989640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77359b40 0x557d77360000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.791+0000 7fd8d1989640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77359b40 0x557d77360000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54846/0 (socket says 172.21.15.98:54846) 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.791+0000 7fd8d1989640 1 -- 172.21.15.98:0/2437974391 learned_addr learned my addr 172.21.15.98:0/2437974391 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.792+0000 7fd8d218a640 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 0x557d77362d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.792+0000 7fd8d298b640 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77363370 0x557d773605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.446 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.792+0000 7fd8d67c7740 10 client.0 _ll_register_callbacks cb 0x557d76fcc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.792+0000 7fd8d1989640 1 -- 172.21.15.98:0/2437974391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 msgr2=0x557d77362d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.792+0000 7fd8d1989640 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 0x557d77362d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.792+0000 7fd8d1989640 1 -- 172.21.15.98:0/2437974391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77363370 msgr2=0x557d773605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.792+0000 7fd8d1989640 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77363370 0x557d773605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.792+0000 7fd8d1989640 1 -- 172.21.15.98:0/2437974391 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d7702f3c0 con 0x557d77359b40 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.792+0000 7fd8d1989640 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77359b40 0x557d77360000 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc09b010 tx=0x7fd8bc09ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a156cbb80d5bd1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.792+0000 7fd8b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.792+0000 7fd8b5ffb640 1 -- 172.21.15.98:0/2437974391 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc0b3020 con 0x557d77359b40 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.792+0000 7fd8b5ffb640 1 -- 172.21.15.98:0/2437974391 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fd8bc097980 con 0x557d77359b40 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.793+0000 7fd8d67c7740 1 -- 172.21.15.98:0/2437974391 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8c4003e50 con 0x557d77359b40 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.793+0000 7fd8b5ffb640 1 -- 172.21.15.98:0/2437974391 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd8bc0a6050 con 0x557d77359b40 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.793+0000 7fd8d67c7740 10 client.15573 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:59.447 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.793+0000 7fd8d67c7740 1 -- 172.21.15.98:0/2437974391 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557d77371ad0 con 0x557d77359b40 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.793+0000 7fd8b5ffb640 1 -- 172.21.15.98:0/2437974391 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8c4003e50 con 0x557d77359b40 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.793+0000 7fd8b5ffb640 1 -- 172.21.15.98:0/2437974391 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd8bc0bb0b0 con 0x557d77359b40 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.793+0000 7fd8d67c7740 10 client.15573 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.793+0000 7fd8d67c7740 10 client.15573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.793+0000 7fd8d67c7740 20 client.15573 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.793+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557d77372fe0 0x557d77375410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.793+0000 7fd8d67c7740 4 client.15573 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.793+0000 7fd8d67c7740 1 -- 172.21.15.98:0/2437974391 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d772cb860 con 0x557d77372fe0 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.794+0000 7fd8d218a640 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557d77372fe0 0x557d77375410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.794+0000 7fd8b5ffb640 10 client.15573 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.794+0000 7fd8d218a640 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557d77372fe0 0x557d77375410 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfb6a78a628b1f60 server_cookie=4829d08dc1d00205 in_seq=0 out_seq=0 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.795+0000 7fd8b5ffb640 1 -- 172.21.15.98:0/2437974391 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d772cb860 con 0x557d77372fe0 2024-09-19T07:22:59.448 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.795+0000 7fd8b5ffb640 10 client.15573 handle_command_reply: tid=0 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.795+0000 7fd8d67c7740 1 client.15573 shutdown 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.795+0000 7fd8d67c7740 1 -- 172.21.15.98:0/2437974391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77359b40 msgr2=0x557d77360000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.795+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77359b40 0x557d77360000 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc09b010 tx=0x7fd8bc09ad30 comp rx=0 tx=0).stop 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.795+0000 7fd8d67c7740 1 -- 172.21.15.98:0/2437974391 shutdown_connections 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.795+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77363370 0x557d773605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.795+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557d77372fe0 0x557d77375410 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.795+0000 7fd8b5ffb640 0 client.15573 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.795+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77359b40 0x557d77360000 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.795+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/2437974391 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 0x557d77362d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.795+0000 7fd8d67c7740 1 -- 172.21.15.98:0/2437974391 >> 172.21.15.98:0/2437974391 conn(0x557d77321310 msgr2=0x557d7735a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.796+0000 7fd8d67c7740 1 -- 172.21.15.98:0/2437974391 shutdown_connections 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.796+0000 7fd8d67c7740 1 -- 172.21.15.98:0/2437974391 wait complete. 2024-09-19T07:22:59.449 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.796+0000 7fd8d67c7740 20 client.15573 trim_cache size 0 max 16384 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.809+0000 7fd8d67c7740 1 Processor -- start 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.809+0000 7fd8d67c7740 1 -- start start 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.809+0000 7fd8d67c7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d773585d0 0x557d7735b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d67c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d77359b40 0x557d7735b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d67c7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77363370 0x557d7737ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d67c7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1b67c0 con 0x557d773585d0 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d67c7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1b4090 con 0x557d77363370 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d67c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1b1ee0 con 0x557d77359b40 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d218a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d773585d0 0x557d7735b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d218a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d773585d0 0x557d7735b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54858/0 (socket says 172.21.15.98:54858) 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d218a640 1 -- 172.21.15.98:0/3610270028 learned_addr learned my addr 172.21.15.98:0/3610270028 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d1989640 1 --2- 172.21.15.98:0/3610270028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d77359b40 0x557d7735b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.450 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d298b640 1 --2- 172.21.15.98:0/3610270028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77363370 0x557d7737ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d218a640 1 -- 172.21.15.98:0/3610270028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d77359b40 msgr2=0x557d7735b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d218a640 1 --2- 172.21.15.98:0/3610270028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d77359b40 0x557d7735b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d218a640 1 -- 172.21.15.98:0/3610270028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77363370 msgr2=0x557d7737ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d218a640 1 --2- 172.21.15.98:0/3610270028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77363370 0x557d7737ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d218a640 1 -- 172.21.15.98:0/3610270028 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d773630c0 con 0x557d773585d0 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.810+0000 7fd8d218a640 1 --2- 172.21.15.98:0/3610270028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d773585d0 0x557d7735b120 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x557d77375c50 tx=0x7fd8c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8a1817ca4158fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.811+0000 7fd8b7fff640 1 -- 172.21.15.98:0/3610270028 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8016070 con 0x557d773585d0 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.811+0000 7fd8b7fff640 1 -- 172.21.15.98:0/3610270028 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8c8005500 con 0x557d773585d0 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.811+0000 7fd8b7fff640 1 -- 172.21.15.98:0/3610270028 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c801c420 con 0x557d773585d0 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.811+0000 7fd8d67c7740 1 -- 172.21.15.98:0/3610270028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d773585d0 msgr2=0x557d7735b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.811+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/3610270028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d773585d0 0x557d7735b120 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x557d77375c50 tx=0x7fd8c8012000 comp rx=0 tx=0).stop 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 -- 172.21.15.98:0/3610270028 shutdown_connections 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/3610270028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77363370 0x557d7737ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.451 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/3610270028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d77359b40 0x557d7735b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/3610270028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d773585d0 0x557d7735b120 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 -- 172.21.15.98:0/3610270028 >> 172.21.15.98:0/3610270028 conn(0x557d77321310 msgr2=0x557d77362080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 -- 172.21.15.98:0/3610270028 shutdown_connections 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 -- 172.21.15.98:0/3610270028 wait complete. 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 -- start start 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 Processor -- start 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 0x557d77367830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77359b40 0x557d77367d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 0x557d773dccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.812+0000 7fd8d67c7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1b2550 con 0x557d77363370 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d67c7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1b39c0 con 0x557d77359b40 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d298b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 0x557d773dccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.452 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d298b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 0x557d773dccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:54860/0 (socket says 172.21.15.98:54860) 2024-09-19T07:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d298b640 1 -- 172.21.15.98:0/1349320840 learned_addr learned my addr 172.21.15.98:0/1349320840 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d67c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1b2c20 con 0x557d773585d0 2024-09-19T07:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d218a640 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 0x557d77367830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d1989640 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77359b40 0x557d77367d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d67c7740 10 client.0 _ll_register_callbacks cb 0x7fd8bc097630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d298b640 1 -- 172.21.15.98:0/1349320840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 msgr2=0x557d77367830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d298b640 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 0x557d77367830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d298b640 1 -- 172.21.15.98:0/1349320840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77359b40 msgr2=0x557d77367d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d298b640 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77359b40 0x557d77367d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d298b640 1 -- 172.21.15.98:0/1349320840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d773dd1f0 con 0x557d77363370 2024-09-19T07:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d67c7740 1 -- 172.21.15.98:0/1349320840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8c8005500 con 0x557d77363370 2024-09-19T07:22:59.453 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8d298b640 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 0x557d773dccb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009430 tx=0x7fd8c4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5607c49457d82f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8b5ffb640 10 client.15579 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8b5ffb640 1 -- 172.21.15.98:0/1349320840 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c4048040 con 0x557d77363370 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.813+0000 7fd8b5ffb640 1 -- 172.21.15.98:0/1349320840 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fd8c4003d10 con 0x557d77363370 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.814+0000 7fd8b5ffb640 1 -- 172.21.15.98:0/1349320840 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd8c4034040 con 0x557d77363370 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.814+0000 7fd8d67c7740 10 client.15579 fetch_fsmap learned FSMap version 24 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.814+0000 7fd8d67c7740 1 -- 172.21.15.98:0/1349320840 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({fsmap=24}) -- 0x557d773de310 con 0x557d77363370 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.814+0000 7fd8b5ffb640 1 -- 172.21.15.98:0/1349320840 <== mon.0 v2:172.21.15.98:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd8c4056030 con 0x557d77363370 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.814+0000 7fd8d67c7740 10 client.15579 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.814+0000 7fd8d67c7740 10 client.15579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.814+0000 7fd8d67c7740 20 client.15579 populate_metadata read hostname 'smithi098' 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.814+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557d773de540 0x557d773e0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.814+0000 7fd8d67c7740 4 client.15579 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:22:59.454 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.814+0000 7fd8d67c7740 1 -- 172.21.15.98:0/1349320840 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d772c5d70 con 0x557d773de540 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.815+0000 7fd8d218a640 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557d773de540 0x557d773e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8d218a640 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557d773de540 0x557d773e0930 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ebed02d27afe741 server_cookie=20ad9d4949ac76eb in_seq=0 out_seq=0 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8b5ffb640 10 client.15579 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8b5ffb640 1 -- 172.21.15.98:0/1349320840 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d772c5d70 con 0x557d773de540 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8b5ffb640 10 client.15579 handle_command_reply: tid=0 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8d67c7740 1 client.15579 shutdown 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8d67c7740 1 -- 172.21.15.98:0/1349320840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 msgr2=0x557d773dccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 0x557d773dccb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009430 tx=0x7fd8c4003ba0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8d67c7740 1 -- 172.21.15.98:0/1349320840 shutdown_connections 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557d773de540 0x557d773e0930 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557d77363370 0x557d773dccb0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557d77359b40 0x557d77367d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.455 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8d67c7740 1 --2- 172.21.15.98:0/1349320840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557d773585d0 0x557d77367830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8d67c7740 1 -- 172.21.15.98:0/1349320840 >> 172.21.15.98:0/1349320840 conn(0x557d77321310 msgr2=0x557d773534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.816+0000 7fd8b5ffb640 0 client.15579 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:22:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.817+0000 7fd8d67c7740 1 -- 172.21.15.98:0/1349320840 shutdown_connections 2024-09-19T07:22:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.817+0000 7fd8d67c7740 1 -- 172.21.15.98:0/1349320840 wait complete. 2024-09-19T07:22:59.456 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.817+0000 7fd8d67c7740 20 client.15579 trim_cache size 0 max 16384 2024-09-19T07:22:59.456 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:22:59.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.817+0000 7fd8d43ee640 1 -- 172.21.15.98:0/24901759 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd8b80a3620 msgr2=0x7fd8b80a5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:59.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.817+0000 7fd8d43ee640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd8b80a3620 0x7fd8b80a5ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80058c0 tx=0x7fd8c800a2d0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.817+0000 7fd8d43ee640 1 -- 172.21.15.98:0/24901759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8cc102570 msgr2=0x7fd8cc1a4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:22:59.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.817+0000 7fd8d43ee640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8cc102570 0x7fd8cc1a4d50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00b4a0 tx=0x7fd8bc00b960 comp rx=0 tx=0).stop 2024-09-19T07:22:59.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.817+0000 7fd8d43ee640 1 -- 172.21.15.98:0/24901759 shutdown_connections 2024-09-19T07:22:59.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.817+0000 7fd8d43ee640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd8b80a3620 0x7fd8b80a5ae0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.817+0000 7fd8d43ee640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8cc102ef0 0x7fd8cc19ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.817+0000 7fd8d43ee640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd8cc102570 0x7fd8cc1a4d50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.817+0000 7fd8d43ee640 1 --2- 172.21.15.98:0/24901759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8cc100e20 0x7fd8cc1a4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:22:59.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.818+0000 7fd8d43ee640 1 -- 172.21.15.98:0/24901759 >> 172.21.15.98:0/24901759 conn(0x7fd8cc0fc7d0 msgr2=0x7fd8cc06a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:22:59.457 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.818+0000 7fd8d43ee640 1 -- 172.21.15.98:0/24901759 shutdown_connections 2024-09-19T07:22:59.458 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:22:58.818+0000 7fd8d43ee640 1 -- 172.21.15.98:0/24901759 wait complete. 2024-09-19T07:22:59.494 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:23:00.061 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:22:59 smithi098 ceph-mon[30950]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T07:23:00.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:22:59 smithi162 ceph-mon[35726]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T07:23:00.241 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:00.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:22:59 smithi139 ceph-mon[35039]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-19T07:23:00.688 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:23:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:23:00.455+0000 7faf528a5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:23:00.688 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:23:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:23:00.455+0000 7faf528a5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:23:00.688 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:23:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:23:00.455+0000 7faf528a5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:23:00.688 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:23:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:23:00.455+0000 7faf528a5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:23:00.688 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:23:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:23:00.455+0000 7faf528a5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T07:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.843+0000 7fc291ae7640 1 -- 172.21.15.98:0/531572711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c101df0 msgr2=0x7fc28c1021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.843+0000 7fc291ae7640 1 --2- 172.21.15.98:0/531572711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c101df0 0x7fc28c1021d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009900 tx=0x7fc27c02a410 comp rx=0 tx=0).stop 2024-09-19T07:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.843+0000 7fc291ae7640 1 -- 172.21.15.98:0/531572711 shutdown_connections 2024-09-19T07:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.843+0000 7fc291ae7640 1 --2- 172.21.15.98:0/531572711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28c106f20 0x7fc28c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.843+0000 7fc291ae7640 1 --2- 172.21.15.98:0/531572711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c1027a0 0x7fc28c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.843+0000 7fc291ae7640 1 --2- 172.21.15.98:0/531572711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c101df0 0x7fc28c1021d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.843+0000 7fc291ae7640 1 -- 172.21.15.98:0/531572711 >> 172.21.15.98:0/531572711 conn(0x7fc28c0fd8b0 msgr2=0x7fc28c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.843+0000 7fc291ae7640 1 -- 172.21.15.98:0/531572711 shutdown_connections 2024-09-19T07:23:00.844 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.843+0000 7fc291ae7640 1 -- 172.21.15.98:0/531572711 wait complete. 2024-09-19T07:23:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.844+0000 7fc291ae7640 1 Processor -- start 2024-09-19T07:23:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.845+0000 7fc291ae7640 1 -- start start 2024-09-19T07:23:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.845+0000 7fc291ae7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c101df0 0x7fc28c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.845+0000 7fc291ae7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28c1027a0 0x7fc28c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.845+0000 7fc291ae7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c106f20 0x7fc28c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.845+0000 7fc291ae7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c111f90 con 0x7fc28c106f20 2024-09-19T07:23:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.845+0000 7fc291ae7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c111e10 con 0x7fc28c101df0 2024-09-19T07:23:00.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.845+0000 7fc291ae7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc28c112110 con 0x7fc28c1027a0 2024-09-19T07:23:00.846 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.845+0000 7fc28b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c101df0 0x7fc28c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.845+0000 7fc28b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c101df0 0x7fc28c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:35930/0 (socket says 172.21.15.98:35930) 2024-09-19T07:23:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.845+0000 7fc28b7fe640 1 -- 172.21.15.98:0/116032075 learned_addr learned my addr 172.21.15.98:0/116032075 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.845+0000 7fc28bfff640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c106f20 0x7fc28c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.845+0000 7fc28b7fe640 1 -- 172.21.15.98:0/116032075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28c1027a0 msgr2=0x7fc28c074a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T07:23:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.846+0000 7fc28b7fe640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28c1027a0 0x7fc28c074a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.846+0000 7fc28b7fe640 1 -- 172.21.15.98:0/116032075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c106f20 msgr2=0x7fc28c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.846+0000 7fc28b7fe640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c106f20 0x7fc28c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.846+0000 7fc28b7fe640 1 -- 172.21.15.98:0/116032075 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28c1a6730 con 0x7fc28c101df0 2024-09-19T07:23:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.846+0000 7fc28bfff640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c106f20 0x7fc28c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:23:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.846+0000 7fc28b7fe640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c101df0 0x7fc28c0744f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009850 tx=0x7fc27c030940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.846+0000 7fc288ff9640 1 -- 172.21.15.98:0/116032075 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c03f070 con 0x7fc28c101df0 2024-09-19T07:23:00.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.846+0000 7fc291ae7640 1 -- 172.21.15.98:0/116032075 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28c1a69c0 con 0x7fc28c101df0 2024-09-19T07:23:00.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.846+0000 7fc288ff9640 1 -- 172.21.15.98:0/116032075 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc27c030d70 con 0x7fc28c101df0 2024-09-19T07:23:00.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.846+0000 7fc288ff9640 1 -- 172.21.15.98:0/116032075 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c035030 con 0x7fc28c101df0 2024-09-19T07:23:00.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.846+0000 7fc291ae7640 1 -- 172.21.15.98:0/116032075 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc28c1a6e30 con 0x7fc28c101df0 2024-09-19T07:23:00.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.848+0000 7fc291ae7640 1 -- 172.21.15.98:0/116032075 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc28c075a20 con 0x7fc28c101df0 2024-09-19T07:23:00.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.850+0000 7fc288ff9640 1 -- 172.21.15.98:0/116032075 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fc27c042070 con 0x7fc28c101df0 2024-09-19T07:23:00.850 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.850+0000 7fc288ff9640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc2740a3590 0x7fc2740a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:00.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.851+0000 7fc28affd640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc2740a3590 0x7fc2740a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:00.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.851+0000 7fc288ff9640 1 -- 172.21.15.98:0/116032075 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc27c0f0960 con 0x7fc28c101df0 2024-09-19T07:23:00.851 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.851+0000 7fc28affd640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc2740a3590 0x7fc2740a5a50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc28c075f80 tx=0x7fc28000b370 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:00.853 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:00.853+0000 7fc288ff9640 1 -- 172.21.15.98:0/116032075 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc27c0bd190 con 0x7fc28c101df0 2024-09-19T07:23:01.094 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:23:01.095 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:23:01.175 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.174+0000 7fc291ae7640 1 -- 172.21.15.98:0/116032075 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc28c1a7340 con 0x7fc28c101df0 2024-09-19T07:23:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:23:01.177 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:23:01.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.176+0000 7fc288ff9640 1 -- 172.21.15.98:0/116032075 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7fc27c0bca90 con 0x7fc28c101df0 2024-09-19T07:23:01.177 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:23:01.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.178+0000 7fc291ae7640 1 -- 172.21.15.98:0/116032075 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc2740a3590 msgr2=0x7fc2740a5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:01.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.178+0000 7fc291ae7640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc2740a3590 0x7fc2740a5a50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc28c075f80 tx=0x7fc28000b370 comp rx=0 tx=0).stop 2024-09-19T07:23:01.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.178+0000 7fc291ae7640 1 -- 172.21.15.98:0/116032075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c101df0 msgr2=0x7fc28c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:01.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.178+0000 7fc291ae7640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c101df0 0x7fc28c0744f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009850 tx=0x7fc27c030940 comp rx=0 tx=0).stop 2024-09-19T07:23:01.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.178+0000 7fc291ae7640 1 -- 172.21.15.98:0/116032075 shutdown_connections 2024-09-19T07:23:01.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.178+0000 7fc291ae7640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc2740a3590 0x7fc2740a5a50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:01.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.178+0000 7fc291ae7640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc28c106f20 0x7fc28c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:01.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.178+0000 7fc291ae7640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28c1027a0 0x7fc28c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:01.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.178+0000 7fc291ae7640 1 --2- 172.21.15.98:0/116032075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc28c101df0 0x7fc28c0744f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:01.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.178+0000 7fc291ae7640 1 -- 172.21.15.98:0/116032075 >> 172.21.15.98:0/116032075 conn(0x7fc28c0fd8b0 msgr2=0x7fc28c0fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:01.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.179+0000 7fc291ae7640 1 -- 172.21.15.98:0/116032075 shutdown_connections 2024-09-19T07:23:01.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:01.179+0000 7fc291ae7640 1 -- 172.21.15.98:0/116032075 wait complete. 2024-09-19T07:23:01.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:01 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/116032075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:01.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:01 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/116032075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:01.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:01 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/116032075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:01.887 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db --set-id 6de5aad8 --release --await' 2024-09-19T07:23:01.888 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db --set-id 6de5aad8 --release --await 2024-09-19T07:23:01.920 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:02.457 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:02 smithi098 ceph-mon[30950]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:23:02.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.488+0000 7f6084b67640 1 -- 172.21.15.98:0/306758120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6080102d30 msgr2=0x7f6080103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:02.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.488+0000 7f6084b67640 1 --2- 172.21.15.98:0/306758120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6080102d30 0x7f6080103110 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6070009900 tx=0x7f607002a480 comp rx=0 tx=0).stop 2024-09-19T07:23:02.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.488+0000 7f6084b67640 1 -- 172.21.15.98:0/306758120 shutdown_connections 2024-09-19T07:23:02.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.488+0000 7f6084b67640 1 --2- 172.21.15.98:0/306758120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f608010c160 0x7f608010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.488+0000 7f6084b67640 1 --2- 172.21.15.98:0/306758120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6080103650 0x7f608010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.488+0000 7f6084b67640 1 --2- 172.21.15.98:0/306758120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6080102d30 0x7f6080103110 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.489+0000 7f6084b67640 1 -- 172.21.15.98:0/306758120 >> 172.21.15.98:0/306758120 conn(0x7f60800fc790 msgr2=0x7f60800febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:02.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.489+0000 7f6084b67640 1 -- 172.21.15.98:0/306758120 shutdown_connections 2024-09-19T07:23:02.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.489+0000 7f6084b67640 1 -- 172.21.15.98:0/306758120 wait complete. 2024-09-19T07:23:02.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f6084b67640 1 Processor -- start 2024-09-19T07:23:02.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f6084b67640 1 -- start start 2024-09-19T07:23:02.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f6084b67640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6080102d30 0x7f60800739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f6084b67640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6080103650 0x7f608006ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f6084b67640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f608010c160 0x7f608006cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f6084b67640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6080111fb0 con 0x7f6080103650 2024-09-19T07:23:02.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f6084b67640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6080111e30 con 0x7f6080102d30 2024-09-19T07:23:02.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f6084b67640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6080112130 con 0x7f608010c160 2024-09-19T07:23:02.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f607dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6080103650 0x7f608006ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f607dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6080103650 0x7f608006ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56820/0 (socket says 172.21.15.98:56820) 2024-09-19T07:23:02.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f607dd9b640 1 -- 172.21.15.98:0/736452348 learned_addr learned my addr 172.21.15.98:0/736452348 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:02.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f607ed9d640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f608010c160 0x7f608006cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.490+0000 7f607e59c640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6080102d30 0x7f60800739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.491+0000 7f607dd9b640 1 -- 172.21.15.98:0/736452348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f608010c160 msgr2=0x7f608006cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:02.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.491+0000 7f607dd9b640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f608010c160 0x7f608006cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.491+0000 7f607dd9b640 1 -- 172.21.15.98:0/736452348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6080102d30 msgr2=0x7f60800739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:02.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.491+0000 7f607dd9b640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6080102d30 0x7f60800739d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.491+0000 7f607dd9b640 1 -- 172.21.15.98:0/736452348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608006d530 con 0x7f6080103650 2024-09-19T07:23:02.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.491+0000 7f607ed9d640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f608010c160 0x7f608006cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:02.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.491+0000 7f607dd9b640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6080103650 0x7f608006ca60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f607400be90 tx=0x7f607400dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:02.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.491+0000 7f606f7fe640 1 -- 172.21.15.98:0/736452348 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074018070 con 0x7f6080103650 2024-09-19T07:23:02.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.491+0000 7f606f7fe640 1 -- 172.21.15.98:0/736452348 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6074016070 con 0x7f6080103650 2024-09-19T07:23:02.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.491+0000 7f606f7fe640 1 -- 172.21.15.98:0/736452348 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60740047a0 con 0x7f6080103650 2024-09-19T07:23:02.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.491+0000 7f6084b67640 1 -- 172.21.15.98:0/736452348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608006d820 con 0x7f6080103650 2024-09-19T07:23:02.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.491+0000 7f6084b67640 1 -- 172.21.15.98:0/736452348 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6080071760 con 0x7f6080103650 2024-09-19T07:23:02.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.495+0000 7f6086f40740 1 Processor -- start 2024-09-19T07:23:02.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.495+0000 7f606f7fe640 1 -- 172.21.15.98:0/736452348 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f60740099b0 con 0x7f6080103650 2024-09-19T07:23:02.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.495+0000 7f6086f40740 1 -- start start 2024-09-19T07:23:02.510 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.496+0000 7f6086f40740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5030b60 0x55d4c5030f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.496+0000 7f6086f40740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c5031480 0x55d4c503b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.496+0000 7f6086f40740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c503bd40 0x55d4c503e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.496+0000 7f6086f40740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d4c4f96280 con 0x55d4c503bd40 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.496+0000 7f6086f40740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d4c4f3db10 con 0x55d4c5031480 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.496+0000 7f6086f40740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d4c4f92240 con 0x55d4c5030b60 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.496+0000 7f607dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c503bd40 0x55d4c503e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.496+0000 7f607dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c503bd40 0x55d4c503e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56826/0 (socket says 172.21.15.98:56826) 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.496+0000 7f607dd9b640 1 -- 172.21.15.98:0/3190838634 learned_addr learned my addr 172.21.15.98:0/3190838634 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.496+0000 7f607ed9d640 1 --2- 172.21.15.98:0/3190838634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5030b60 0x55d4c5030f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.496+0000 7f606f7fe640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f60680a35e0 0x7f60680a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.497+0000 7f607ed9d640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f60680a35e0 0x7f60680a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.497+0000 7f606f7fe640 1 -- 172.21.15.98:0/736452348 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f60740d39f0 con 0x7f6080103650 2024-09-19T07:23:02.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.497+0000 7f607dd9b640 1 -- 172.21.15.98:0/3190838634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5030b60 msgr2=0x55d4c5030f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.497+0000 7f607dd9b640 1 --2- 172.21.15.98:0/3190838634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5030b60 0x55d4c5030f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.497+0000 7f607dd9b640 1 -- 172.21.15.98:0/3190838634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c5031480 msgr2=0x55d4c503b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.497+0000 7f607e59c640 1 --2- 172.21.15.98:0/3190838634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c5031480 0x55d4c503b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.497+0000 7f607dd9b640 1 --2- 172.21.15.98:0/3190838634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c5031480 0x55d4c503b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.497+0000 7f607dd9b640 1 -- 172.21.15.98:0/3190838634 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c4f4a1f0 con 0x55d4c503bd40 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.497+0000 7f607e59c640 1 --2- 172.21.15.98:0/3190838634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c5031480 0x55d4c503b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.497+0000 7f607dd9b640 1 --2- 172.21.15.98:0/3190838634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c503bd40 0x55d4c503e130 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f60740d0f80 tx=0x7f6074005120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36478535c9d7de96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.497+0000 7f607ed9d640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f60680a35e0 0x7f60680a5aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6078009370 tx=0x7f6078009d30 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.498+0000 7f606cff9640 1 -- 172.21.15.98:0/3190838634 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074021030 con 0x55d4c503bd40 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.498+0000 7f606cff9640 1 -- 172.21.15.98:0/3190838634 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6074005680 con 0x55d4c503bd40 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.498+0000 7f606cff9640 1 -- 172.21.15.98:0/3190838634 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60740a87e0 con 0x55d4c503bd40 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.498+0000 7f6086f40740 1 -- 172.21.15.98:0/3190838634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c503bd40 msgr2=0x55d4c503e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:02.512 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.498+0000 7f6086f40740 1 --2- 172.21.15.98:0/3190838634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c503bd40 0x55d4c503e130 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f60740d0f80 tx=0x7f6074005120 comp rx=0 tx=0).stop 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.498+0000 7f6086f40740 1 -- 172.21.15.98:0/3190838634 shutdown_connections 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.498+0000 7f6086f40740 1 --2- 172.21.15.98:0/3190838634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c503bd40 0x55d4c503e130 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.498+0000 7f6086f40740 1 --2- 172.21.15.98:0/3190838634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c5031480 0x55d4c503b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.498+0000 7f6086f40740 1 --2- 172.21.15.98:0/3190838634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5030b60 0x55d4c5030f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.498+0000 7f6086f40740 1 -- 172.21.15.98:0/3190838634 >> 172.21.15.98:0/3190838634 conn(0x55d4c502d0f0 msgr2=0x55d4c502d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.498+0000 7f6086f40740 1 -- 172.21.15.98:0/3190838634 shutdown_connections 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.499+0000 7f6086f40740 1 -- 172.21.15.98:0/3190838634 wait complete. 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.499+0000 7f6086f40740 1 -- start start 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.499+0000 7f6086f40740 1 Processor -- start 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.499+0000 7f6086f40740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 0x55d4c5038c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.499+0000 7f6086f40740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5031480 0x55d4c50391a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.499+0000 7f6086f40740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c503bd40 0x55d4c50396e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.513 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.499+0000 7f6086f40740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d4c503e910 con 0x55d4c5030b60 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.499+0000 7f6086f40740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d4c4f50f10 con 0x55d4c503bd40 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.499+0000 7f6086f40740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d4c503ea90 con 0x55d4c5031480 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.499+0000 7f6086f40740 10 client.0 _ll_register_callbacks cb 0x55d4c4f19a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.500+0000 7f607e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 0x55d4c5038c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.500+0000 7f607e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 0x55d4c5038c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56830/0 (socket says 172.21.15.98:56830) 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.500+0000 7f607e59c640 1 -- 172.21.15.98:0/2251992749 learned_addr learned my addr 172.21.15.98:0/2251992749 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.500+0000 7f607e59c640 1 -- 172.21.15.98:0/2251992749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5031480 msgr2=0x55d4c50391a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.500+0000 7f607e59c640 1 --2- 172.21.15.98:0/2251992749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5031480 0x55d4c50391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.500+0000 7f607e59c640 1 -- 172.21.15.98:0/2251992749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c503bd40 msgr2=0x55d4c50396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.500+0000 7f607e59c640 1 --2- 172.21.15.98:0/2251992749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c503bd40 0x55d4c50396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.500+0000 7f607e59c640 1 -- 172.21.15.98:0/2251992749 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4c4d076a0 con 0x55d4c5030b60 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.500+0000 7f607e59c640 1 --2- 172.21.15.98:0/2251992749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 0x55d4c5038c60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6070005ab0 tx=0x7f6070005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2dfd98e410f6c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.500+0000 7f6065ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:02.514 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.501+0000 7f6065ffb640 1 -- 172.21.15.98:0/2251992749 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6070035030 con 0x55d4c5030b60 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.501+0000 7f6086f40740 1 -- 172.21.15.98:0/2251992749 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6074005680 con 0x55d4c5030b60 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.501+0000 7f6065ffb640 1 -- 172.21.15.98:0/2251992749 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f60700048c0 con 0x55d4c5030b60 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.501+0000 7f6065ffb640 1 -- 172.21.15.98:0/2251992749 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6070005d50 con 0x55d4c5030b60 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.501+0000 7f6086f40740 10 client.15603 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.501+0000 7f6086f40740 1 -- 172.21.15.98:0/2251992749 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d4c504a4c0 con 0x55d4c5030b60 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.501+0000 7f6065ffb640 1 -- 172.21.15.98:0/2251992749 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6074005680 con 0x55d4c5030b60 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.502+0000 7f6065ffb640 1 -- 172.21.15.98:0/2251992749 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f607004a070 con 0x55d4c5030b60 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.502+0000 7f6086f40740 10 client.15603 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.502+0000 7f6086f40740 10 client.15603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.502+0000 7f6086f40740 20 client.15603 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.502+0000 7f6086f40740 1 --2- 172.21.15.98:0/2251992749 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d4c504b980 0x55d4c504ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.502+0000 7f6086f40740 4 client.15603 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.502+0000 7f6086f40740 1 -- 172.21.15.98:0/2251992749 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4c4fa37f0 con 0x55d4c504b980 2024-09-19T07:23:02.515 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.503+0000 7f607dd9b640 1 --2- 172.21.15.98:0/2251992749 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d4c504b980 0x55d4c504ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.504+0000 7f6065ffb640 10 client.15603 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.504+0000 7f607dd9b640 1 --2- 172.21.15.98:0/2251992749 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d4c504b980 0x55d4c504ddd0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9375671033af9f12 server_cookie=c0a7781a62e15b9e in_seq=0 out_seq=0 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6065ffb640 1 -- 172.21.15.98:0/2251992749 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d4c4fa37f0 con 0x55d4c504b980 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6065ffb640 10 client.15603 handle_command_reply: tid=0 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6086f40740 1 client.15603 shutdown 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6086f40740 1 -- 172.21.15.98:0/2251992749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 msgr2=0x55d4c5038c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6086f40740 1 --2- 172.21.15.98:0/2251992749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 0x55d4c5038c60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6070005ab0 tx=0x7f6070005270 comp rx=0 tx=0).stop 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6086f40740 1 -- 172.21.15.98:0/2251992749 shutdown_connections 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6086f40740 1 --2- 172.21.15.98:0/2251992749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c503bd40 0x55d4c50396e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6086f40740 1 --2- 172.21.15.98:0/2251992749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5031480 0x55d4c50391a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6086f40740 1 --2- 172.21.15.98:0/2251992749 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d4c504b980 0x55d4c504ddd0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6086f40740 1 --2- 172.21.15.98:0/2251992749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 0x55d4c5038c60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6086f40740 1 -- 172.21.15.98:0/2251992749 >> 172.21.15.98:0/2251992749 conn(0x55d4c502d0f0 msgr2=0x55d4c502c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:02.516 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6065ffb640 0 client.15603 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:02.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.505+0000 7f6086f40740 1 -- 172.21.15.98:0/2251992749 shutdown_connections 2024-09-19T07:23:02.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.506+0000 7f6086f40740 1 -- 172.21.15.98:0/2251992749 wait complete. 2024-09-19T07:23:02.517 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.506+0000 7f6086f40740 20 client.15603 trim_cache size 0 max 16384 2024-09-19T07:23:02.517 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:02.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.538+0000 7f6086f40740 1 Processor -- start 2024-09-19T07:23:02.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.539+0000 7f6086f40740 1 -- start start 2024-09-19T07:23:02.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.539+0000 7f6086f40740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5030b60 0x55d4c503aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.539+0000 7f6086f40740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5031480 0x55d4c50536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.539+0000 7f6086f40740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c503bd40 0x55d4c5053be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.539+0000 7f6086f40740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f60801b69f0 con 0x55d4c5031480 2024-09-19T07:23:02.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.539+0000 7f6086f40740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f60801b42c0 con 0x55d4c503bd40 2024-09-19T07:23:02.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.539+0000 7f6086f40740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60801b2110 con 0x55d4c5030b60 2024-09-19T07:23:02.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.539+0000 7f607dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5031480 0x55d4c50536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.539+0000 7f607dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5031480 0x55d4c50536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56842/0 (socket says 172.21.15.98:56842) 2024-09-19T07:23:02.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.539+0000 7f607dd9b640 1 -- 172.21.15.98:0/810385278 learned_addr learned my addr 172.21.15.98:0/810385278 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:02.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.539+0000 7f607e59c640 1 --2- 172.21.15.98:0/810385278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5030b60 0x55d4c503aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.539+0000 7f607ed9d640 1 --2- 172.21.15.98:0/810385278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c503bd40 0x55d4c5053be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.540+0000 7f607dd9b640 1 -- 172.21.15.98:0/810385278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5030b60 msgr2=0x55d4c503aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:02.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.540+0000 7f607dd9b640 1 --2- 172.21.15.98:0/810385278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5030b60 0x55d4c503aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.540+0000 7f607dd9b640 1 -- 172.21.15.98:0/810385278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c503bd40 msgr2=0x55d4c5053be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:02.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.540+0000 7f607dd9b640 1 --2- 172.21.15.98:0/810385278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c503bd40 0x55d4c5053be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.540+0000 7f607dd9b640 1 -- 172.21.15.98:0/810385278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4c5037c10 con 0x55d4c5031480 2024-09-19T07:23:02.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.540+0000 7f607e59c640 1 --2- 172.21.15.98:0/810385278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5030b60 0x55d4c503aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:02.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.540+0000 7f607dd9b640 1 --2- 172.21.15.98:0/810385278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5031480 0x55d4c50536a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6074009610 tx=0x7f60740d0fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84123b0781b62e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:02.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.540+0000 7f6067fff640 1 -- 172.21.15.98:0/810385278 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60740db040 con 0x55d4c5031480 2024-09-19T07:23:02.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.541+0000 7f6067fff640 1 -- 172.21.15.98:0/810385278 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60740b7030 con 0x55d4c5031480 2024-09-19T07:23:02.542 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.541+0000 7f6067fff640 1 -- 172.21.15.98:0/810385278 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074021040 con 0x55d4c5031480 2024-09-19T07:23:02.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.542+0000 7f6086f40740 1 -- 172.21.15.98:0/810385278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5031480 msgr2=0x55d4c50536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:02.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.542+0000 7f6086f40740 1 --2- 172.21.15.98:0/810385278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5031480 0x55d4c50536a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6074009610 tx=0x7f60740d0fb0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.542+0000 7f6086f40740 1 -- 172.21.15.98:0/810385278 shutdown_connections 2024-09-19T07:23:02.543 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.542+0000 7f6086f40740 1 --2- 172.21.15.98:0/810385278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c503bd40 0x55d4c5053be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.542+0000 7f6086f40740 1 --2- 172.21.15.98:0/810385278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5031480 0x55d4c50536a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.542+0000 7f6086f40740 1 --2- 172.21.15.98:0/810385278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c5030b60 0x55d4c503aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.542+0000 7f6086f40740 1 -- 172.21.15.98:0/810385278 >> 172.21.15.98:0/810385278 conn(0x55d4c502d0f0 msgr2=0x55d4c503a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:02.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.542+0000 7f6086f40740 1 -- 172.21.15.98:0/810385278 shutdown_connections 2024-09-19T07:23:02.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.543+0000 7f6086f40740 1 -- 172.21.15.98:0/810385278 wait complete. 2024-09-19T07:23:02.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.543+0000 7f6086f40740 1 -- start start 2024-09-19T07:23:02.544 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.543+0000 7f6086f40740 1 Processor -- start 2024-09-19T07:23:02.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.544+0000 7f6086f40740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 0x55d4c5040410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.544+0000 7f6086f40740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c5031480 0x55d4c5040950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.544+0000 7f6086f40740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c503bd40 0x55d4c5043a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.544+0000 7f6086f40740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f60801b2780 con 0x55d4c5030b60 2024-09-19T07:23:02.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.544+0000 7f6086f40740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f60801b3bf0 con 0x55d4c5031480 2024-09-19T07:23:02.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.544+0000 7f6086f40740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f60801b2e50 con 0x55d4c503bd40 2024-09-19T07:23:02.545 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.544+0000 7f6086f40740 10 client.0 _ll_register_callbacks cb 0x7f6070009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:02.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.544+0000 7f607dd9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c5031480 0x55d4c5040950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.544+0000 7f607e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 0x55d4c5040410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.544+0000 7f607e59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 0x55d4c5040410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56846/0 (socket says 172.21.15.98:56846) 2024-09-19T07:23:02.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.544+0000 7f607e59c640 1 -- 172.21.15.98:0/3284035826 learned_addr learned my addr 172.21.15.98:0/3284035826 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:02.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.545+0000 7f607ed9d640 1 --2- 172.21.15.98:0/3284035826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c503bd40 0x55d4c5043a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.545+0000 7f607e59c640 1 -- 172.21.15.98:0/3284035826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c503bd40 msgr2=0x55d4c5043a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:02.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.545+0000 7f607e59c640 1 --2- 172.21.15.98:0/3284035826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c503bd40 0x55d4c5043a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.545+0000 7f607e59c640 1 -- 172.21.15.98:0/3284035826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c5031480 msgr2=0x55d4c5040950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:02.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.545+0000 7f607e59c640 1 --2- 172.21.15.98:0/3284035826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c5031480 0x55d4c5040950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.545+0000 7f607e59c640 1 -- 172.21.15.98:0/3284035826 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4c5044170 con 0x55d4c5030b60 2024-09-19T07:23:02.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.545+0000 7f607e59c640 1 --2- 172.21.15.98:0/3284035826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 0x55d4c5040410 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6070005c40 tx=0x7f60700058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276f5b0161c27d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:02.546 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.545+0000 7f6065ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.545+0000 7f6065ffb640 1 -- 172.21.15.98:0/3284035826 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6070050040 con 0x55d4c5030b60 2024-09-19T07:23:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.545+0000 7f6065ffb640 1 -- 172.21.15.98:0/3284035826 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f60700315b0 con 0x55d4c5030b60 2024-09-19T07:23:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.545+0000 7f6086f40740 1 -- 172.21.15.98:0/3284035826 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60740b7030 con 0x55d4c5030b60 2024-09-19T07:23:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.546+0000 7f6065ffb640 1 -- 172.21.15.98:0/3284035826 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6070035040 con 0x55d4c5030b60 2024-09-19T07:23:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.546+0000 7f6086f40740 10 client.15609 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.546+0000 7f6086f40740 1 -- 172.21.15.98:0/3284035826 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d4c50b71c0 con 0x55d4c5030b60 2024-09-19T07:23:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.546+0000 7f6065ffb640 1 -- 172.21.15.98:0/3284035826 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60740b7030 con 0x55d4c5030b60 2024-09-19T07:23:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.546+0000 7f6065ffb640 1 -- 172.21.15.98:0/3284035826 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f607004a070 con 0x55d4c5030b60 2024-09-19T07:23:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.546+0000 7f6086f40740 10 client.15609 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.546+0000 7f6086f40740 10 client.15609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.546+0000 7f6086f40740 20 client.15609 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:02.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.546+0000 7f6086f40740 1 --2- 172.21.15.98:0/3284035826 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d4c50b7910 0x55d4c50b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.546+0000 7f6086f40740 4 client.15609 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:23:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.546+0000 7f6086f40740 1 -- 172.21.15.98:0/3284035826 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d4c4f9dd00 con 0x55d4c50b7910 2024-09-19T07:23:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.546+0000 7f607dd9b640 1 --2- 172.21.15.98:0/3284035826 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d4c50b7910 0x55d4c50b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.547+0000 7f6065ffb640 10 client.15609 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:02.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.547+0000 7f607dd9b640 1 --2- 172.21.15.98:0/3284035826 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d4c50b7910 0x55d4c50b9d30 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc6b9200c2d229e0 server_cookie=2264b3f379324577 in_seq=0 out_seq=0 2024-09-19T07:23:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6065ffb640 1 -- 172.21.15.98:0/3284035826 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d4c4f9dd00 con 0x55d4c50b7910 2024-09-19T07:23:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6065ffb640 10 client.15609 handle_command_reply: tid=0 2024-09-19T07:23:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6086f40740 1 client.15609 shutdown 2024-09-19T07:23:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6086f40740 1 -- 172.21.15.98:0/3284035826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 msgr2=0x55d4c5040410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6086f40740 1 --2- 172.21.15.98:0/3284035826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 0x55d4c5040410 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f6070005c40 tx=0x7f60700058d0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6086f40740 1 -- 172.21.15.98:0/3284035826 shutdown_connections 2024-09-19T07:23:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6086f40740 1 --2- 172.21.15.98:0/3284035826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4c503bd40 0x55d4c5043a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6086f40740 1 --2- 172.21.15.98:0/3284035826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d4c5031480 0x55d4c5040950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6086f40740 1 --2- 172.21.15.98:0/3284035826 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d4c50b7910 0x55d4c50b9d30 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6086f40740 1 --2- 172.21.15.98:0/3284035826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4c5030b60 0x55d4c5040410 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6086f40740 1 -- 172.21.15.98:0/3284035826 >> 172.21.15.98:0/3284035826 conn(0x55d4c502d0f0 msgr2=0x55d4c502c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:02.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6065ffb640 0 client.15609 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:02.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6086f40740 1 -- 172.21.15.98:0/3284035826 shutdown_connections 2024-09-19T07:23:02.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.548+0000 7f6086f40740 1 -- 172.21.15.98:0/3284035826 wait complete. 2024-09-19T07:23:02.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.549+0000 7f6086f40740 20 client.15609 trim_cache size 0 max 16384 2024-09-19T07:23:02.551 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:23:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: "return_code": 0, 2024-09-19T07:23:02.551 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_tag": "0a95e0be-e9f4-4ad4-83c7-8185c88ad18f", 2024-09-19T07:23:02.552 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": "asynchronous" 2024-09-19T07:23:02.552 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:23:02.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.549+0000 7f6084b67640 1 -- 172.21.15.98:0/736452348 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f60680a35e0 msgr2=0x7f60680a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:02.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.549+0000 7f6084b67640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f60680a35e0 0x7f60680a5aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6078009370 tx=0x7f6078009d30 comp rx=0 tx=0).stop 2024-09-19T07:23:02.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.549+0000 7f6084b67640 1 -- 172.21.15.98:0/736452348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6080103650 msgr2=0x7f608006ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:02.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.549+0000 7f6084b67640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6080103650 0x7f608006ca60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f607400be90 tx=0x7f607400dca0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.549+0000 7f6084b67640 1 -- 172.21.15.98:0/736452348 shutdown_connections 2024-09-19T07:23:02.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.549+0000 7f6084b67640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f60680a35e0 0x7f60680a5aa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.549+0000 7f6084b67640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f608010c160 0x7f608006cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.549+0000 7f6084b67640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6080103650 0x7f608006ca60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.550+0000 7f6084b67640 1 --2- 172.21.15.98:0/736452348 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6080102d30 0x7f60800739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:02.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.550+0000 7f6084b67640 1 -- 172.21.15.98:0/736452348 >> 172.21.15.98:0/736452348 conn(0x7f60800fc790 msgr2=0x7f60800fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:02.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.550+0000 7f6084b67640 1 -- 172.21.15.98:0/736452348 shutdown_connections 2024-09-19T07:23:02.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:02.550+0000 7f6084b67640 1 -- 172.21.15.98:0/736452348 wait complete. 2024-09-19T07:23:02.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:02 smithi139 ceph-mon[35039]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:23:02.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:02 smithi162 ceph-mon[35726]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:23:03.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.294+0000 7ff646232640 1 -- 172.21.15.98:0/3261030878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff640106a80 msgr2=0x7ff640106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:03.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.294+0000 7ff646232640 1 --2- 172.21.15.98:0/3261030878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff640106a80 0x7ff640106e60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff630009930 tx=0x7ff63002a440 comp rx=0 tx=0).stop 2024-09-19T07:23:03.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.294+0000 7ff646232640 1 -- 172.21.15.98:0/3261030878 shutdown_connections 2024-09-19T07:23:03.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.294+0000 7ff646232640 1 --2- 172.21.15.98:0/3261030878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff640101420 0x7ff64010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.294+0000 7ff646232640 1 --2- 172.21.15.98:0/3261030878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff640100a80 0x7ff640100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.294+0000 7ff646232640 1 --2- 172.21.15.98:0/3261030878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff640106a80 0x7ff640106e60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.294+0000 7ff646232640 1 -- 172.21.15.98:0/3261030878 >> 172.21.15.98:0/3261030878 conn(0x7ff6400fc7a0 msgr2=0x7ff6400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:03.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.294+0000 7ff646232640 1 -- 172.21.15.98:0/3261030878 shutdown_connections 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.294+0000 7ff646232640 1 -- 172.21.15.98:0/3261030878 wait complete. 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.295+0000 7ff646232640 1 Processor -- start 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.295+0000 7ff646232640 1 -- start start 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff646232640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff640100a80 0x7ff640102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff646232640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff640101420 0x7ff640102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff646232640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff640106a80 0x7ff6401030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff646232640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff640110f10 con 0x7ff640100a80 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff646232640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff640110d90 con 0x7ff640106a80 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff63f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff640100a80 0x7ff640102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff646232640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff640111090 con 0x7ff640101420 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff63f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff640100a80 0x7ff640102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56866/0 (socket says 172.21.15.98:56866) 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff63f7fe640 1 -- 172.21.15.98:0/412055363 learned_addr learned my addr 172.21.15.98:0/412055363 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:03.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff63effd640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff640101420 0x7ff640102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff63ffff640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff640106a80 0x7ff6401030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff63f7fe640 1 -- 172.21.15.98:0/412055363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff640101420 msgr2=0x7ff640102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff63f7fe640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff640101420 0x7ff640102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff63f7fe640 1 -- 172.21.15.98:0/412055363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff640106a80 msgr2=0x7ff6401030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff63f7fe640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff640106a80 0x7ff6401030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.296+0000 7ff63f7fe640 1 -- 172.21.15.98:0/412055363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6401a6a00 con 0x7ff640100a80 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.297+0000 7ff63f7fe640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff640100a80 0x7ff640102650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff630004770 tx=0x7ff630003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.297+0000 7ff63cff9640 1 -- 172.21.15.98:0/412055363 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63003f070 con 0x7ff640100a80 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.297+0000 7ff646232640 1 -- 172.21.15.98:0/412055363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6401a6c90 con 0x7ff640100a80 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.297+0000 7ff63cff9640 1 -- 172.21.15.98:0/412055363 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff630031ca0 con 0x7ff640100a80 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.298+0000 7ff63cff9640 1 -- 172.21.15.98:0/412055363 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff630035030 con 0x7ff640100a80 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.298+0000 7ff646232640 1 -- 172.21.15.98:0/412055363 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6401a71c0 con 0x7ff640100a80 2024-09-19T07:23:03.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.300+0000 7ff63cff9640 1 -- 172.21.15.98:0/412055363 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7ff630042070 con 0x7ff640100a80 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.301+0000 7ff63cff9640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff62c0a34c0 0x7ff62c0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.301+0000 7ff63cff9640 1 -- 172.21.15.98:0/412055363 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7ff6300f0070 con 0x7ff640100a80 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.301+0000 7ff64860b740 1 Processor -- start 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.301+0000 7ff63effd640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff62c0a34c0 0x7ff62c0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.302+0000 7ff64860b740 1 -- start start 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.302+0000 7ff64860b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638060 0x561e15638440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.302+0000 7ff64860b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638980 0x561e15642d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.302+0000 7ff64860b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15645630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.302+0000 7ff64860b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561e1559d620 con 0x561e15643240 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.302+0000 7ff64860b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561e15544e50 con 0x561e15638060 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.302+0000 7ff64860b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561e155995e0 con 0x561e15638980 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.302+0000 7ff63ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15645630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.302+0000 7ff63ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15645630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56878/0 (socket says 172.21.15.98:56878) 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.302+0000 7ff63effd640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff62c0a34c0 0x7ff62c0a5980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff6401040e0 tx=0x7ff62800b410 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.302+0000 7ff63ffff640 1 -- 172.21.15.98:0/2480783125 learned_addr learned my addr 172.21.15.98:0/2480783125 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.302+0000 7ff63f7fe640 1 --2- 172.21.15.98:0/2480783125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638060 0x561e15638440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.303+0000 7ff63effd640 1 --2- 172.21.15.98:0/2480783125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638980 0x561e15642d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.303+0000 7ff63ffff640 1 -- 172.21.15.98:0/2480783125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638980 msgr2=0x561e15642d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.303+0000 7ff63ffff640 1 --2- 172.21.15.98:0/2480783125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638980 0x561e15642d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.303+0000 7ff63ffff640 1 -- 172.21.15.98:0/2480783125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638060 msgr2=0x561e15638440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.303+0000 7ff63ffff640 1 --2- 172.21.15.98:0/2480783125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638060 0x561e15638440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.303+0000 7ff63ffff640 1 -- 172.21.15.98:0/2480783125 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e15535d40 con 0x561e15643240 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.303+0000 7ff63ffff640 1 --2- 172.21.15.98:0/2480783125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15645630 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff63800a4d0 tx=0x7ff638009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8641999c60939059 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.303+0000 7ff635ffb640 1 -- 172.21.15.98:0/2480783125 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff638018020 con 0x561e15643240 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.304+0000 7ff635ffb640 1 -- 172.21.15.98:0/2480783125 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff638014cf0 con 0x561e15643240 2024-09-19T07:23:03.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.304+0000 7ff635ffb640 1 -- 172.21.15.98:0/2480783125 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63801a2c0 con 0x561e15643240 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.304+0000 7ff64860b740 1 -- 172.21.15.98:0/2480783125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 msgr2=0x561e15645630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.304+0000 7ff64860b740 1 --2- 172.21.15.98:0/2480783125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15645630 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff63800a4d0 tx=0x7ff638009650 comp rx=0 tx=0).stop 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.305+0000 7ff64860b740 1 -- 172.21.15.98:0/2480783125 shutdown_connections 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.305+0000 7ff64860b740 1 --2- 172.21.15.98:0/2480783125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15645630 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.305+0000 7ff64860b740 1 --2- 172.21.15.98:0/2480783125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638980 0x561e15642d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.305+0000 7ff64860b740 1 --2- 172.21.15.98:0/2480783125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638060 0x561e15638440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.305+0000 7ff64860b740 1 -- 172.21.15.98:0/2480783125 >> 172.21.15.98:0/2480783125 conn(0x561e156345f0 msgr2=0x561e156349d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.305+0000 7ff64860b740 1 -- 172.21.15.98:0/2480783125 shutdown_connections 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.305+0000 7ff64860b740 1 -- 172.21.15.98:0/2480783125 wait complete. 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.305+0000 7ff64860b740 1 -- start start 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff64860b740 1 Processor -- start 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff64860b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638060 0x561e156400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff64860b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638980 0x561e15640630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff64860b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15640b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff63ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15640b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff63f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638060 0x561e156400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff63effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638980 0x561e15640630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff63f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638060 0x561e156400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:57932/0 (socket says 172.21.15.98:57932) 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff63ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15640b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56880/0 (socket says 172.21.15.98:56880) 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff63effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638980 0x561e15640630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:55416/0 (socket says 172.21.15.98:55416) 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff64860b740 1 -- 172.21.15.98:0/4044037871 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561e15656e20 con 0x561e15643240 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff63f7fe640 1 -- 172.21.15.98:0/4044037871 learned_addr learned my addr 172.21.15.98:0/4044037871 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff64860b740 1 -- 172.21.15.98:0/4044037871 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561e15525f10 con 0x561e15638980 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.306+0000 7ff64860b740 1 -- 172.21.15.98:0/4044037871 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x561e15656fa0 con 0x561e15638060 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.307+0000 7ff63ffff640 1 -- 172.21.15.98:0/4044037871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638060 msgr2=0x561e156400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.307+0000 7ff63ffff640 1 --2- 172.21.15.98:0/4044037871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638060 0x561e156400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.307+0000 7ff63ffff640 1 -- 172.21.15.98:0/4044037871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638980 msgr2=0x561e15640630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.307+0000 7ff63ffff640 1 --2- 172.21.15.98:0/4044037871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638980 0x561e15640630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.307+0000 7ff63ffff640 1 -- 172.21.15.98:0/4044037871 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e152ac580 con 0x561e15643240 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.307+0000 7ff63ffff640 1 --2- 172.21.15.98:0/4044037871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15640b70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff6380093b0 tx=0x7ff638013db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4ed6c9e4b6e9f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.307+0000 7ff61effd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.307+0000 7ff64860b740 10 client.0 _ll_register_callbacks cb 0x561e15549db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.307+0000 7ff64860b740 1 -- 172.21.15.98:0/4044037871 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff638014cf0 con 0x561e15643240 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.308+0000 7ff61effd640 1 -- 172.21.15.98:0/4044037871 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff638018030 con 0x561e15643240 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.308+0000 7ff61effd640 1 -- 172.21.15.98:0/4044037871 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7ff638014810 con 0x561e15643240 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.308+0000 7ff61effd640 1 -- 172.21.15.98:0/4044037871 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff638014a70 con 0x561e15643240 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.308+0000 7ff64860b740 10 client.15621 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.308+0000 7ff64860b740 1 -- 172.21.15.98:0/4044037871 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({fsmap=24}) -- 0x561e15376960 con 0x561e15643240 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.308+0000 7ff61effd640 1 -- 172.21.15.98:0/4044037871 <== mon.0 v2:172.21.15.98:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff63801d420 con 0x561e15643240 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.308+0000 7ff64860b740 10 client.15621 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:03.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.308+0000 7ff64860b740 10 client.15621 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.308+0000 7ff64860b740 20 client.15621 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.308+0000 7ff64860b740 1 --2- 172.21.15.98:0/4044037871 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561e15663b60 0x561e15665f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.309+0000 7ff64860b740 4 client.15621 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.309+0000 7ff64860b740 1 -- 172.21.15.98:0/4044037871 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e155aab90 con 0x561e15663b60 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.309+0000 7ff63f7fe640 1 --2- 172.21.15.98:0/4044037871 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561e15663b60 0x561e15665f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.309+0000 7ff61effd640 10 client.15621 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.309+0000 7ff63f7fe640 1 --2- 172.21.15.98:0/4044037871 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561e15663b60 0x561e15665f50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a031cdcfcadc7fe server_cookie=fe09319b230ec02a in_seq=0 out_seq=0 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.310+0000 7ff61effd640 1 -- 172.21.15.98:0/4044037871 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e155aab90 con 0x561e15663b60 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.310+0000 7ff61effd640 10 client.15621 handle_command_reply: tid=0 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.310+0000 7ff64860b740 1 client.15621 shutdown 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.310+0000 7ff64860b740 1 -- 172.21.15.98:0/4044037871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 msgr2=0x561e15640b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.310+0000 7ff64860b740 1 --2- 172.21.15.98:0/4044037871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15640b70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff6380093b0 tx=0x7ff638013db0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.311+0000 7ff64860b740 1 -- 172.21.15.98:0/4044037871 shutdown_connections 2024-09-19T07:23:03.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.311+0000 7ff64860b740 1 --2- 172.21.15.98:0/4044037871 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561e15663b60 0x561e15665f50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.311+0000 7ff64860b740 1 --2- 172.21.15.98:0/4044037871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15640b70 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.311+0000 7ff61effd640 0 client.15621 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:03.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.311+0000 7ff64860b740 1 --2- 172.21.15.98:0/4044037871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638980 0x561e15640630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.311+0000 7ff64860b740 1 --2- 172.21.15.98:0/4044037871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638060 0x561e156400f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.311+0000 7ff64860b740 1 -- 172.21.15.98:0/4044037871 >> 172.21.15.98:0/4044037871 conn(0x561e156345f0 msgr2=0x561e1563a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:03.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.311+0000 7ff64860b740 1 -- 172.21.15.98:0/4044037871 shutdown_connections 2024-09-19T07:23:03.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.311+0000 7ff64860b740 1 -- 172.21.15.98:0/4044037871 wait complete. 2024-09-19T07:23:03.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.311+0000 7ff64860b740 20 client.15621 trim_cache size 0 max 16384 2024-09-19T07:23:03.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff64860b740 1 Processor -- start 2024-09-19T07:23:03.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff64860b740 1 -- start start 2024-09-19T07:23:03.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff64860b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638060 0x561e1563a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff64860b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15638980 0x561e1566b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff64860b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15643240 0x561e1566bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff64860b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff6401a9960 con 0x561e15638980 2024-09-19T07:23:03.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff64860b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff6401a7390 con 0x561e15643240 2024-09-19T07:23:03.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff64860b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff6401021c0 con 0x561e15638060 2024-09-19T07:23:03.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff63effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15638980 0x561e1566b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff63effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15638980 0x561e1566b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56890/0 (socket says 172.21.15.98:56890) 2024-09-19T07:23:03.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff63effd640 1 -- 172.21.15.98:0/3094585456 learned_addr learned my addr 172.21.15.98:0/3094585456 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:03.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff63ffff640 1 --2- 172.21.15.98:0/3094585456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15643240 0x561e1566bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff63f7fe640 1 --2- 172.21.15.98:0/3094585456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638060 0x561e1563a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.342+0000 7ff63effd640 1 -- 172.21.15.98:0/3094585456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638060 msgr2=0x561e1563a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:03.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.343+0000 7ff63effd640 1 --2- 172.21.15.98:0/3094585456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638060 0x561e1563a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.343+0000 7ff63effd640 1 -- 172.21.15.98:0/3094585456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15643240 msgr2=0x561e1566bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:03.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.343+0000 7ff63effd640 1 --2- 172.21.15.98:0/3094585456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15643240 0x561e1566bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.343+0000 7ff63effd640 1 -- 172.21.15.98:0/3094585456 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e1563f0a0 con 0x561e15638980 2024-09-19T07:23:03.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.343+0000 7ff63f7fe640 1 --2- 172.21.15.98:0/3094585456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638060 0x561e1563a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:03.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.343+0000 7ff63ffff640 1 --2- 172.21.15.98:0/3094585456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15643240 0x561e1566bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:03.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.343+0000 7ff63effd640 1 --2- 172.21.15.98:0/3094585456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15638980 0x561e1566b580 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff628005d00 tx=0x7ff628013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29cec4aae49d58f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:03.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.344+0000 7ff6357fa640 1 -- 172.21.15.98:0/3094585456 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62801f430 con 0x561e15638980 2024-09-19T07:23:03.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.344+0000 7ff6357fa640 1 -- 172.21.15.98:0/3094585456 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff62801fab0 con 0x561e15638980 2024-09-19T07:23:03.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.344+0000 7ff6357fa640 1 -- 172.21.15.98:0/3094585456 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62801ec50 con 0x561e15638980 2024-09-19T07:23:03.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.345+0000 7ff64860b740 1 -- 172.21.15.98:0/3094585456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15638980 msgr2=0x561e1566b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:03.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.345+0000 7ff64860b740 1 --2- 172.21.15.98:0/3094585456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15638980 0x561e1566b580 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff628005d00 tx=0x7ff628013000 comp rx=0 tx=0).stop 2024-09-19T07:23:03.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.345+0000 7ff64860b740 1 -- 172.21.15.98:0/3094585456 shutdown_connections 2024-09-19T07:23:03.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.345+0000 7ff64860b740 1 --2- 172.21.15.98:0/3094585456 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15643240 0x561e1566bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.345+0000 7ff64860b740 1 --2- 172.21.15.98:0/3094585456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15638980 0x561e1566b580 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.345+0000 7ff64860b740 1 --2- 172.21.15.98:0/3094585456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15638060 0x561e1563a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.345+0000 7ff64860b740 1 -- 172.21.15.98:0/3094585456 >> 172.21.15.98:0/3094585456 conn(0x561e156345f0 msgr2=0x561e15632f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.345+0000 7ff64860b740 1 -- 172.21.15.98:0/3094585456 shutdown_connections 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.345+0000 7ff64860b740 1 -- 172.21.15.98:0/3094585456 wait complete. 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.345+0000 7ff64860b740 1 -- start start 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.346+0000 7ff64860b740 1 Processor -- start 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.346+0000 7ff64860b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638060 0x561e15659220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.346+0000 7ff64860b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15659760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.346+0000 7ff63effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15659760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.346+0000 7ff63effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15659760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56900/0 (socket says 172.21.15.98:56900) 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.346+0000 7ff63effd640 1 -- 172.21.15.98:0/2066887105 learned_addr learned my addr 172.21.15.98:0/2066887105 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.346+0000 7ff64860b740 1 --2- 172.21.15.98:0/2066887105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15663b60 0x561e15659ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.346+0000 7ff64860b740 1 -- 172.21.15.98:0/2066887105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff640103b80 con 0x561e15643240 2024-09-19T07:23:03.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.346+0000 7ff64860b740 1 -- 172.21.15.98:0/2066887105 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff640073c60 con 0x561e15638060 2024-09-19T07:23:03.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.346+0000 7ff64860b740 1 -- 172.21.15.98:0/2066887105 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff640072ec0 con 0x561e15663b60 2024-09-19T07:23:03.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.347+0000 7ff64860b740 10 client.0 _ll_register_callbacks cb 0x7ff638004a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:03.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.347+0000 7ff63effd640 1 -- 172.21.15.98:0/2066887105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15663b60 msgr2=0x561e15659ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:23:03.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.347+0000 7ff63effd640 1 --2- 172.21.15.98:0/2066887105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15663b60 0x561e15659ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.350 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.347+0000 7ff63effd640 1 -- 172.21.15.98:0/2066887105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638060 msgr2=0x561e15659220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.347+0000 7ff63effd640 1 --2- 172.21.15.98:0/2066887105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638060 0x561e15659220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.347+0000 7ff63effd640 1 -- 172.21.15.98:0/2066887105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e156d6d70 con 0x561e15643240 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.347+0000 7ff63effd640 1 --2- 172.21.15.98:0/2066887105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15659760 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x561e15638e10 tx=0x7ff62801f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ceec1e30a7481f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.347+0000 7ff61effd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.347+0000 7ff61effd640 1 -- 172.21.15.98:0/2066887105 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62800be90 con 0x561e15643240 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.347+0000 7ff64860b740 1 -- 172.21.15.98:0/2066887105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff62801fab0 con 0x561e15643240 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.348+0000 7ff61effd640 1 -- 172.21.15.98:0/2066887105 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7ff628025040 con 0x561e15643240 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.348+0000 7ff61effd640 1 -- 172.21.15.98:0/2066887105 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff62801e420 con 0x561e15643240 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.348+0000 7ff64860b740 10 client.15627 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.348+0000 7ff64860b740 1 -- 172.21.15.98:0/2066887105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561e156d7f40 con 0x561e15643240 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.348+0000 7ff61effd640 1 -- 172.21.15.98:0/2066887105 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff62801fab0 con 0x561e15643240 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.348+0000 7ff61effd640 1 -- 172.21.15.98:0/2066887105 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff628031b50 con 0x561e15643240 2024-09-19T07:23:03.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.348+0000 7ff64860b740 10 client.15627 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:03.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.348+0000 7ff64860b740 10 client.15627 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:23:03.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.349+0000 7ff64860b740 20 client.15627 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:03.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.349+0000 7ff64860b740 1 --2- 172.21.15.98:0/2066887105 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561e156d85a0 0x561e156da9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:03.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.349+0000 7ff64860b740 4 client.15627 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6de5aad8", "release": true, "await": true}] 2024-09-19T07:23:03.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.349+0000 7ff64860b740 1 -- 172.21.15.98:0/2066887105 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6de5aad8", "release": true, "await": true}) -- 0x561e15633ec0 con 0x561e156d85a0 2024-09-19T07:23:03.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.349+0000 7ff63f7fe640 1 --2- 172.21.15.98:0/2066887105 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561e156d85a0 0x561e156da9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:03.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.349+0000 7ff61effd640 10 client.15627 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:03.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.349+0000 7ff63f7fe640 1 --2- 172.21.15.98:0/2066887105 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561e156d85a0 0x561e156da9b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90ce30c25e8fffcd server_cookie=dd2daadc4da5ac9a in_seq=0 out_seq=0 2024-09-19T07:23:03.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.351+0000 7ff61effd640 1 -- 172.21.15.98:0/2066887105 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x561e15633ec0 con 0x561e156d85a0 2024-09-19T07:23:03.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.351+0000 7ff61effd640 10 client.15627 handle_command_reply: tid=0 2024-09-19T07:23:03.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.351+0000 7ff64860b740 1 client.15627 shutdown 2024-09-19T07:23:03.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.352+0000 7ff64860b740 1 -- 172.21.15.98:0/2066887105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 msgr2=0x561e15659760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:03.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.352+0000 7ff64860b740 1 --2- 172.21.15.98:0/2066887105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15659760 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x561e15638e10 tx=0x7ff62801f660 comp rx=0 tx=0).stop 2024-09-19T07:23:03.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.352+0000 7ff64860b740 1 -- 172.21.15.98:0/2066887105 shutdown_connections 2024-09-19T07:23:03.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.352+0000 7ff64860b740 1 --2- 172.21.15.98:0/2066887105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561e15663b60 0x561e15659ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.352+0000 7ff64860b740 1 --2- 172.21.15.98:0/2066887105 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x561e156d85a0 0x561e156da9b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.352+0000 7ff64860b740 1 --2- 172.21.15.98:0/2066887105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e15643240 0x561e15659760 secure :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0x561e15638e10 tx=0x7ff62801f660 comp rx=0 tx=0).stop 2024-09-19T07:23:03.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.352+0000 7ff64860b740 1 --2- 172.21.15.98:0/2066887105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561e15638060 0x561e15659220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.352+0000 7ff61effd640 0 client.15627 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:03.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.352+0000 7ff64860b740 1 -- 172.21.15.98:0/2066887105 >> 172.21.15.98:0/2066887105 conn(0x561e156345f0 msgr2=0x561e1565f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:03.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.352+0000 7ff64860b740 1 -- 172.21.15.98:0/2066887105 shutdown_connections 2024-09-19T07:23:03.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.352+0000 7ff64860b740 1 -- 172.21.15.98:0/2066887105 wait complete. 2024-09-19T07:23:03.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.352+0000 7ff64860b740 20 client.15627 trim_cache size 0 max 16384 2024-09-19T07:23:03.355 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:23:03.355 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 24, 2024-09-19T07:23:03.355 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:23:03.355 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 4, 2024-09-19T07:23:03.355 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": { 2024-09-19T07:23:03.355 INFO:teuthology.orchestra.run.smithi098.stdout: "6de5aad8": { 2024-09-19T07:23:03.355 INFO:teuthology.orchestra.run.smithi098.stdout: "version": 4, 2024-09-19T07:23:03.355 INFO:teuthology.orchestra.run.smithi098.stdout: "age_ref": 0.0, 2024-09-19T07:23:03.355 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:23:03.355 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RELEASED", 2024-09-19T07:23:03.355 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:23:03.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:23:03.356 INFO:teuthology.orchestra.run.smithi098.stdout: "timeout": 90.0, 2024-09-19T07:23:03.356 INFO:teuthology.orchestra.run.smithi098.stdout: "expiration": 131.2, 2024-09-19T07:23:03.356 INFO:teuthology.orchestra.run.smithi098.stdout: "members": { 2024-09-19T07:23:03.356 INFO:teuthology.orchestra.run.smithi098.stdout: "file:/": { 2024-09-19T07:23:03.356 INFO:teuthology.orchestra.run.smithi098.stdout: "excluded": false, 2024-09-19T07:23:03.356 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:23:03.356 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RELEASED", 2024-09-19T07:23:03.356 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:23:03.356 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:03.356 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:03.356 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:03.356 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:03.357 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:03.357 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:23:03.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.353+0000 7ff646232640 1 -- 172.21.15.98:0/412055363 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff62c0a34c0 msgr2=0x7ff62c0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:03.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.353+0000 7ff646232640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff62c0a34c0 0x7ff62c0a5980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff6401040e0 tx=0x7ff62800b410 comp rx=0 tx=0).stop 2024-09-19T07:23:03.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.353+0000 7ff646232640 1 -- 172.21.15.98:0/412055363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff640100a80 msgr2=0x7ff640102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:03.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.353+0000 7ff646232640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff640100a80 0x7ff640102650 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff630004770 tx=0x7ff630003c10 comp rx=0 tx=0).stop 2024-09-19T07:23:03.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.353+0000 7ff646232640 1 -- 172.21.15.98:0/412055363 shutdown_connections 2024-09-19T07:23:03.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.353+0000 7ff646232640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff62c0a34c0 0x7ff62c0a5980 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.353+0000 7ff646232640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff640106a80 0x7ff6401030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.353+0000 7ff646232640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff640101420 0x7ff640102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.353+0000 7ff646232640 1 --2- 172.21.15.98:0/412055363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff640100a80 0x7ff640102650 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:03.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.353+0000 7ff646232640 1 -- 172.21.15.98:0/412055363 >> 172.21.15.98:0/412055363 conn(0x7ff6400fc7a0 msgr2=0x7ff64006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:03.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.353+0000 7ff646232640 1 -- 172.21.15.98:0/412055363 shutdown_connections 2024-09-19T07:23:03.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:03.353+0000 7ff646232640 1 -- 172.21.15.98:0/412055363 wait complete. 2024-09-19T07:23:03.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:03 smithi098 ceph-mon[30950]: mgrmap e24: x(active, since 58s), standbys: z, y 2024-09-19T07:23:03.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:03 smithi098 ceph-mon[30950]: scrub queued for path: / 2024-09-19T07:23:03.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:03 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:23:03.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:03 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:23:03.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:03 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:23:03.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:03 smithi139 ceph-mon[35039]: mgrmap e24: x(active, since 58s), standbys: z, y 2024-09-19T07:23:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:03 smithi139 ceph-mon[35039]: scrub queued for path: / 2024-09-19T07:23:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:03 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:23:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:03 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:23:03.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:03 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:23:03.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:03 smithi162 ceph-mon[35726]: mgrmap e24: x(active, since 58s), standbys: z, y 2024-09-19T07:23:03.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:03 smithi162 ceph-mon[35726]: scrub queued for path: / 2024-09-19T07:23:03.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:03 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:23:03.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:03 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:23:03.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:03 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:23:03.931 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6de5aad8', total seconds elapsed: 15.6 2024-09-19T07:23:04.246 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:04 smithi098 ceph-mon[30950]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:23:04.401 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:23:04.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:04 smithi139 ceph-mon[35039]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:23:04.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:04 smithi162 ceph-mon[35726]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-19T07:23:04.673 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:05.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.221+0000 7fc650e6e640 1 -- 172.21.15.98:0/3519277985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc64c102ef0 msgr2=0x7fc64c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:05.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.221+0000 7fc650e6e640 1 --2- 172.21.15.98:0/3519277985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc64c102ef0 0x7fc64c10da40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc644009ca0 tx=0x7fc64402a950 comp rx=0 tx=0).stop 2024-09-19T07:23:05.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.221+0000 7fc650e6e640 1 -- 172.21.15.98:0/3519277985 shutdown_connections 2024-09-19T07:23:05.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.221+0000 7fc650e6e640 1 --2- 172.21.15.98:0/3519277985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc64c102ef0 0x7fc64c10da40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.221+0000 7fc650e6e640 1 --2- 172.21.15.98:0/3519277985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc64c102570 0x7fc64c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.221+0000 7fc650e6e640 1 --2- 172.21.15.98:0/3519277985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc64c100e20 0x7fc64c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.221+0000 7fc650e6e640 1 -- 172.21.15.98:0/3519277985 >> 172.21.15.98:0/3519277985 conn(0x7fc64c0fc7d0 msgr2=0x7fc64c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:05.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.221+0000 7fc650e6e640 1 -- 172.21.15.98:0/3519277985 shutdown_connections 2024-09-19T07:23:05.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.221+0000 7fc650e6e640 1 -- 172.21.15.98:0/3519277985 wait complete. 2024-09-19T07:23:05.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.222+0000 7fc650e6e640 1 Processor -- start 2024-09-19T07:23:05.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc650e6e640 1 -- start start 2024-09-19T07:23:05.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc650e6e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc64c100e20 0x7fc64c197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc650e6e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc64c102570 0x7fc64c197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc650e6e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc64c102ef0 0x7fc64c19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc650e6e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c110f80 con 0x7fc64c102ef0 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc650e6e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c110e00 con 0x7fc64c100e20 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc650e6e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c111100 con 0x7fc64c102570 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc64ad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc64c102ef0 0x7fc64c19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc64ad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc64c102ef0 0x7fc64c19bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56928/0 (socket says 172.21.15.98:56928) 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc64ad9d640 1 -- 172.21.15.98:0/464243839 learned_addr learned my addr 172.21.15.98:0/464243839 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc641d9b640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc64c102570 0x7fc64c197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc64a59c640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc64c100e20 0x7fc64c197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc64ad9d640 1 -- 172.21.15.98:0/464243839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc64c102570 msgr2=0x7fc64c197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc64ad9d640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc64c102570 0x7fc64c197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.223+0000 7fc64ad9d640 1 -- 172.21.15.98:0/464243839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc64c100e20 msgr2=0x7fc64c197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:05.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.224+0000 7fc64ad9d640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc64c100e20 0x7fc64c197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.224+0000 7fc64ad9d640 1 -- 172.21.15.98:0/464243839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64c19c3b0 con 0x7fc64c102ef0 2024-09-19T07:23:05.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.224+0000 7fc641d9b640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc64c102570 0x7fc64c197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:05.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.224+0000 7fc64ad9d640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc64c102ef0 0x7fc64c19bcd0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc64402ae70 tx=0x7fc64402f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:05.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.224+0000 7fc643fff640 1 -- 172.21.15.98:0/464243839 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc644034040 con 0x7fc64c102ef0 2024-09-19T07:23:05.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.224+0000 7fc643fff640 1 -- 172.21.15.98:0/464243839 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc644030920 con 0x7fc64c102ef0 2024-09-19T07:23:05.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.224+0000 7fc650e6e640 1 -- 172.21.15.98:0/464243839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64c19c640 con 0x7fc64c102ef0 2024-09-19T07:23:05.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.224+0000 7fc650e6e640 1 -- 172.21.15.98:0/464243839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc64c069f70 con 0x7fc64c102ef0 2024-09-19T07:23:05.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.226+0000 7fc643fff640 1 -- 172.21.15.98:0/464243839 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc644045480 con 0x7fc64c102ef0 2024-09-19T07:23:05.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.227+0000 7fc643fff640 1 -- 172.21.15.98:0/464243839 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7fc644037020 con 0x7fc64c102ef0 2024-09-19T07:23:05.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.228+0000 7fc653247740 1 Processor -- start 2024-09-19T07:23:05.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.228+0000 7fc653247740 1 -- start start 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.228+0000 7fc643fff640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc6380a57f0 0x7fc6380a7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.228+0000 7fc653247740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588042654a0 0x558804265880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.228+0000 7fc653247740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558804265dc0 0x558804270140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.228+0000 7fc653247740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804270680 0x558804272a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.228+0000 7fc653247740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5588041cb2e0 con 0x558804265dc0 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.228+0000 7fc653247740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558804172ce0 con 0x558804270680 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.228+0000 7fc653247740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5588041c72a0 con 0x5588042654a0 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.229+0000 7fc643fff640 1 -- 172.21.15.98:0/464243839 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc6440f0c00 con 0x7fc64c102ef0 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.229+0000 7fc64ad9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804270680 0x558804272a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.229+0000 7fc64ad9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804270680 0x558804272a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:55466/0 (socket says 172.21.15.98:55466) 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.229+0000 7fc64a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588042654a0 0x558804265880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.229+0000 7fc64ad9d640 1 -- 172.21.15.98:0/3814101101 learned_addr learned my addr 172.21.15.98:0/3814101101 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:05.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.229+0000 7fc641d9b640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc6380a57f0 0x7fc6380a7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.229+0000 7fc641d9b640 1 --2- 172.21.15.98:0/3814101101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558804265dc0 0x558804270140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.229+0000 7fc64ad9d640 1 -- 172.21.15.98:0/3814101101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588042654a0 msgr2=0x558804265880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:05.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.229+0000 7fc64ad9d640 1 --2- 172.21.15.98:0/3814101101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588042654a0 0x558804265880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.229+0000 7fc64ad9d640 1 -- 172.21.15.98:0/3814101101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558804265dc0 msgr2=0x558804270140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:05.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.229+0000 7fc64ad9d640 1 --2- 172.21.15.98:0/3814101101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558804265dc0 0x558804270140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.229+0000 7fc64ad9d640 1 -- 172.21.15.98:0/3814101101 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558804157440 con 0x558804270680 2024-09-19T07:23:05.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.230+0000 7fc641d9b640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc6380a57f0 0x7fc6380a7cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc6340058c0 tx=0x7fc6340139c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:05.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.230+0000 7fc64ad9d640 1 --2- 172.21.15.98:0/3814101101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804270680 0x558804272a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc6440098d0 tx=0x7fc6440bde60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dc39737b0edcb8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:05.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.231+0000 7fc640d99640 1 -- 172.21.15.98:0/3814101101 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64402c040 con 0x558804270680 2024-09-19T07:23:05.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.231+0000 7fc640d99640 1 -- 172.21.15.98:0/3814101101 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6440be660 con 0x558804270680 2024-09-19T07:23:05.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.231+0000 7fc640d99640 1 -- 172.21.15.98:0/3814101101 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6440ba5d0 con 0x558804270680 2024-09-19T07:23:05.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.231+0000 7fc653247740 1 -- 172.21.15.98:0/3814101101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804270680 msgr2=0x558804272a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:05.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.231+0000 7fc653247740 1 --2- 172.21.15.98:0/3814101101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804270680 0x558804272a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc6440098d0 tx=0x7fc6440bde60 comp rx=0 tx=0).stop 2024-09-19T07:23:05.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.231+0000 7fc653247740 1 -- 172.21.15.98:0/3814101101 shutdown_connections 2024-09-19T07:23:05.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.231+0000 7fc653247740 1 --2- 172.21.15.98:0/3814101101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804270680 0x558804272a70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.231+0000 7fc653247740 1 --2- 172.21.15.98:0/3814101101 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558804265dc0 0x558804270140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.231+0000 7fc653247740 1 --2- 172.21.15.98:0/3814101101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5588042654a0 0x558804265880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.231+0000 7fc653247740 1 -- 172.21.15.98:0/3814101101 >> 172.21.15.98:0/3814101101 conn(0x558804261a30 msgr2=0x558804261e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:05.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc653247740 1 -- 172.21.15.98:0/3814101101 shutdown_connections 2024-09-19T07:23:05.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc653247740 1 -- 172.21.15.98:0/3814101101 wait complete. 2024-09-19T07:23:05.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc653247740 1 -- start start 2024-09-19T07:23:05.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc653247740 1 Processor -- start 2024-09-19T07:23:05.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc653247740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588042654a0 0x55880426ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc653247740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804265dc0 0x55880426d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc653247740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804270680 0x55880426d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc653247740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558804277420 con 0x5588042654a0 2024-09-19T07:23:05.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc64a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588042654a0 0x55880426ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc653247740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558804186050 con 0x558804265dc0 2024-09-19T07:23:05.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc653247740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5588042775a0 con 0x558804270680 2024-09-19T07:23:05.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc641d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804265dc0 0x55880426d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc653247740 10 client.0 _ll_register_callbacks cb 0x5588041c6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:05.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc641d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804265dc0 0x55880426d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:55470/0 (socket says 172.21.15.98:55470) 2024-09-19T07:23:05.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.232+0000 7fc641d9b640 1 -- 172.21.15.98:0/559834796 learned_addr learned my addr 172.21.15.98:0/559834796 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:05.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.233+0000 7fc64ad9d640 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804270680 0x55880426d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.233+0000 7fc641d9b640 1 -- 172.21.15.98:0/559834796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804270680 msgr2=0x55880426d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:05.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.233+0000 7fc641d9b640 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804270680 0x55880426d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.233+0000 7fc641d9b640 1 -- 172.21.15.98:0/559834796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588042654a0 msgr2=0x55880426ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:05.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.233+0000 7fc641d9b640 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588042654a0 0x55880426ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.233+0000 7fc641d9b640 1 -- 172.21.15.98:0/559834796 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558803f3c3c0 con 0x558804265dc0 2024-09-19T07:23:05.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.233+0000 7fc64ad9d640 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804270680 0x55880426d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:05.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.233+0000 7fc641d9b640 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804265dc0 0x55880426d1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc634011670 tx=0x7fc634004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7b4c81ddcaca06c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:05.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.233+0000 7fc631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-19T07:23:05.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.233+0000 7fc631ffb640 1 -- 172.21.15.98:0/559834796 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634024030 con 0x558804265dc0 2024-09-19T07:23:05.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.233+0000 7fc631ffb640 1 -- 172.21.15.98:0/559834796 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc63400e760 con 0x558804265dc0 2024-09-19T07:23:05.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.233+0000 7fc653247740 1 -- 172.21.15.98:0/559834796 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6440be660 con 0x558804265dc0 2024-09-19T07:23:05.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.234+0000 7fc631ffb640 1 -- 172.21.15.98:0/559834796 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc63400e960 con 0x558804265dc0 2024-09-19T07:23:05.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.234+0000 7fc653247740 10 client.25133 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:05.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.234+0000 7fc653247740 1 -- 172.21.15.98:0/559834796 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558804272fe0 con 0x558804265dc0 2024-09-19T07:23:05.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.234+0000 7fc631ffb640 1 -- 172.21.15.98:0/559834796 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc634020420 con 0x558804265dc0 2024-09-19T07:23:05.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.234+0000 7fc631ffb640 1 -- 172.21.15.98:0/559834796 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc63402b4c0 con 0x558804265dc0 2024-09-19T07:23:05.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.234+0000 7fc653247740 10 client.25133 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:05.249 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.234+0000 7fc653247740 10 client.25133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:05.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.234+0000 7fc653247740 20 client.25133 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:05.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.234+0000 7fc653247740 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558804274440 0x5588042768a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.234+0000 7fc653247740 4 client.25133 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:05.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.234+0000 7fc653247740 1 -- 172.21.15.98:0/559834796 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc6440be660 con 0x558804274440 2024-09-19T07:23:05.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.235+0000 7fc64a59c640 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558804274440 0x5588042768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.235+0000 7fc64a59c640 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558804274440 0x5588042768a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb6eb48f54697406 server_cookie=88d77d42536552fc in_seq=0 out_seq=0 2024-09-19T07:23:05.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.235+0000 7fc631ffb640 10 client.25133 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:05.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc631ffb640 1 -- 172.21.15.98:0/559834796 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fc6440be660 con 0x558804274440 2024-09-19T07:23:05.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc631ffb640 10 client.25133 handle_command_reply: tid=0 2024-09-19T07:23:05.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc653247740 1 client.25133 shutdown 2024-09-19T07:23:05.250 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc653247740 1 -- 172.21.15.98:0/559834796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804265dc0 msgr2=0x55880426d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:05.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc653247740 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804265dc0 0x55880426d1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc634011670 tx=0x7fc634004730 comp rx=0 tx=0).stop 2024-09-19T07:23:05.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc653247740 1 -- 172.21.15.98:0/559834796 shutdown_connections 2024-09-19T07:23:05.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc653247740 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804270680 0x55880426d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc653247740 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804265dc0 0x55880426d1c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc653247740 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558804274440 0x5588042768a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc653247740 1 --2- 172.21.15.98:0/559834796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588042654a0 0x55880426ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc653247740 1 -- 172.21.15.98:0/559834796 >> 172.21.15.98:0/559834796 conn(0x558804261a30 msgr2=0x558804267760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:05.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc631ffb640 0 client.25133 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:05.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc653247740 1 -- 172.21.15.98:0/559834796 shutdown_connections 2024-09-19T07:23:05.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc653247740 1 -- 172.21.15.98:0/559834796 wait complete. 2024-09-19T07:23:05.251 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.236+0000 7fc653247740 20 client.25133 trim_cache size 0 max 16384 2024-09-19T07:23:05.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.269+0000 7fc653247740 1 Processor -- start 2024-09-19T07:23:05.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.269+0000 7fc653247740 1 -- start start 2024-09-19T07:23:05.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.269+0000 7fc653247740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588042654a0 0x5588042688b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.269 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.269+0000 7fc653247740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558804265dc0 0x55880426c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.269+0000 7fc653247740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804270680 0x558804287c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.269+0000 7fc653247740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c0110e0 con 0x558804265dc0 2024-09-19T07:23:05.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.269+0000 7fc653247740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c00e9b0 con 0x5588042654a0 2024-09-19T07:23:05.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.269+0000 7fc653247740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c00c800 con 0x558804270680 2024-09-19T07:23:05.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.269+0000 7fc641d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558804265dc0 0x55880426c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.269+0000 7fc64a59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588042654a0 0x5588042688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.269+0000 7fc64a59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588042654a0 0x5588042688b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:55486/0 (socket says 172.21.15.98:55486) 2024-09-19T07:23:05.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.269+0000 7fc64a59c640 1 -- 172.21.15.98:0/3450127583 learned_addr learned my addr 172.21.15.98:0/3450127583 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:05.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.270+0000 7fc64ad9d640 1 --2- 172.21.15.98:0/3450127583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804270680 0x558804287c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.270+0000 7fc641d9b640 1 -- 172.21.15.98:0/3450127583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804270680 msgr2=0x558804287c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:05.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.270+0000 7fc641d9b640 1 --2- 172.21.15.98:0/3450127583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804270680 0x558804287c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.270+0000 7fc641d9b640 1 -- 172.21.15.98:0/3450127583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588042654a0 msgr2=0x5588042688b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:05.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.270+0000 7fc641d9b640 1 --2- 172.21.15.98:0/3450127583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588042654a0 0x5588042688b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.270+0000 7fc641d9b640 1 -- 172.21.15.98:0/3450127583 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558804261860 con 0x558804265dc0 2024-09-19T07:23:05.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.270+0000 7fc641d9b640 1 --2- 172.21.15.98:0/3450127583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558804265dc0 0x55880426c1a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc634013ee0 tx=0x7fc63402cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb74246e9e53442 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:05.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.270+0000 7fc633fff640 1 -- 172.21.15.98:0/3450127583 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634024070 con 0x558804265dc0 2024-09-19T07:23:05.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.270+0000 7fc633fff640 1 -- 172.21.15.98:0/3450127583 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc63402bb50 con 0x558804265dc0 2024-09-19T07:23:05.272 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.270+0000 7fc633fff640 1 -- 172.21.15.98:0/3450127583 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63402b310 con 0x558804265dc0 2024-09-19T07:23:05.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.271+0000 7fc653247740 1 -- 172.21.15.98:0/3450127583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558804265dc0 msgr2=0x55880426c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:05.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.271+0000 7fc653247740 1 --2- 172.21.15.98:0/3450127583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558804265dc0 0x55880426c1a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc634013ee0 tx=0x7fc63402cf90 comp rx=0 tx=0).stop 2024-09-19T07:23:05.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.271+0000 7fc653247740 1 -- 172.21.15.98:0/3450127583 shutdown_connections 2024-09-19T07:23:05.273 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.271+0000 7fc653247740 1 --2- 172.21.15.98:0/3450127583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804270680 0x558804287c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.271+0000 7fc653247740 1 --2- 172.21.15.98:0/3450127583 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558804265dc0 0x55880426c1a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.271+0000 7fc653247740 1 --2- 172.21.15.98:0/3450127583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588042654a0 0x5588042688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.271+0000 7fc653247740 1 -- 172.21.15.98:0/3450127583 >> 172.21.15.98:0/3450127583 conn(0x558804261a30 msgr2=0x55880426ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.272+0000 7fc653247740 1 -- 172.21.15.98:0/3450127583 shutdown_connections 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.272+0000 7fc653247740 1 -- 172.21.15.98:0/3450127583 wait complete. 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.272+0000 7fc653247740 1 -- start start 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.272+0000 7fc653247740 1 Processor -- start 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.272+0000 7fc653247740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588042654a0 0x5588042880c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc653247740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804265dc0 0x558804285410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc64a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588042654a0 0x5588042880c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc64a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588042654a0 0x5588042880c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56954/0 (socket says 172.21.15.98:56954) 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc64a59c640 1 -- 172.21.15.98:0/1979644210 learned_addr learned my addr 172.21.15.98:0/1979644210 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:05.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc653247740 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804270680 0x558804285950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc653247740 1 -- 172.21.15.98:0/1979644210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c00ce70 con 0x5588042654a0 2024-09-19T07:23:05.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc653247740 1 -- 172.21.15.98:0/1979644210 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c00e2e0 con 0x558804270680 2024-09-19T07:23:05.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc653247740 1 -- 172.21.15.98:0/1979644210 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc62c00d540 con 0x558804265dc0 2024-09-19T07:23:05.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc641d9b640 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804265dc0 0x558804285410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc64ad9d640 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804270680 0x558804285950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc64a59c640 1 -- 172.21.15.98:0/1979644210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804265dc0 msgr2=0x558804285410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:05.276 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc64a59c640 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804265dc0 0x558804285410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc64a59c640 1 -- 172.21.15.98:0/1979644210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804270680 msgr2=0x558804285950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc64a59c640 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804270680 0x558804285950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.273+0000 7fc64a59c640 1 -- 172.21.15.98:0/1979644210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558804285e90 con 0x5588042654a0 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.274+0000 7fc64a59c640 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588042654a0 0x5588042880c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00bb80 tx=0x7fc63c023380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664cbbe3d6556b70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.274+0000 7fc631ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.274+0000 7fc653247740 10 client.0 _ll_register_callbacks cb 0x7fc634011580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.274+0000 7fc653247740 1 -- 172.21.15.98:0/1979644210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc63402bb50 con 0x5588042654a0 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.274+0000 7fc631ffb640 1 -- 172.21.15.98:0/1979644210 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c031060 con 0x5588042654a0 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.274+0000 7fc631ffb640 1 -- 172.21.15.98:0/1979644210 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc63c023cd0 con 0x5588042654a0 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.274+0000 7fc631ffb640 1 -- 172.21.15.98:0/1979644210 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc63c004020 con 0x5588042654a0 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.274+0000 7fc653247740 10 client.15645 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.274+0000 7fc653247740 1 -- 172.21.15.98:0/1979644210 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({fsmap=24}) -- 0x5588042ea860 con 0x5588042654a0 2024-09-19T07:23:05.277 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.275+0000 7fc631ffb640 1 -- 172.21.15.98:0/1979644210 <== mon.0 v2:172.21.15.98:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc63c034050 con 0x5588042654a0 2024-09-19T07:23:05.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.275+0000 7fc653247740 10 client.15645 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:05.278 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.275+0000 7fc653247740 10 client.15645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.275+0000 7fc653247740 20 client.15645 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.275+0000 7fc653247740 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5588042eaed0 0x5588042ed330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.275+0000 7fc653247740 4 client.15645 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:23:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.275+0000 7fc653247740 1 -- 172.21.15.98:0/1979644210 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fc63402bb50 con 0x5588042eaed0 2024-09-19T07:23:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.275+0000 7fc641d9b640 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5588042eaed0 0x5588042ed330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.276+0000 7fc631ffb640 10 client.15645 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:05.279 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.276+0000 7fc641d9b640 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5588042eaed0 0x5588042ed330 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdef46dbd870e634 server_cookie=ae85cbc8e9f90d4 in_seq=0 out_seq=0 2024-09-19T07:23:05.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc631ffb640 1 -- 172.21.15.98:0/1979644210 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fc63402bb50 con 0x5588042eaed0 2024-09-19T07:23:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc631ffb640 10 client.15645 handle_command_reply: tid=0 2024-09-19T07:23:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc653247740 1 client.15645 shutdown 2024-09-19T07:23:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc653247740 1 -- 172.21.15.98:0/1979644210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588042654a0 msgr2=0x5588042880c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc653247740 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588042654a0 0x5588042880c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00bb80 tx=0x7fc63c023380 comp rx=0 tx=0).stop 2024-09-19T07:23:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc653247740 1 -- 172.21.15.98:0/1979644210 shutdown_connections 2024-09-19T07:23:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc653247740 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558804270680 0x558804285950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc653247740 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558804265dc0 0x558804285410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc653247740 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5588042eaed0 0x5588042ed330 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc653247740 1 --2- 172.21.15.98:0/1979644210 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588042654a0 0x5588042880c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc631ffb640 0 client.15645 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc653247740 1 -- 172.21.15.98:0/1979644210 >> 172.21.15.98:0/1979644210 conn(0x558804261a30 msgr2=0x55880426c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:05.281 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc653247740 1 -- 172.21.15.98:0/1979644210 shutdown_connections 2024-09-19T07:23:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc653247740 1 -- 172.21.15.98:0/1979644210 wait complete. 2024-09-19T07:23:05.282 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.277+0000 7fc653247740 20 client.15645 trim_cache size 0 max 16384 2024-09-19T07:23:05.282 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:23:05.282 INFO:teuthology.orchestra.run.smithi098.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:23:05.282 INFO:teuthology.orchestra.run.smithi098.stdout: "scrubs": { 2024-09-19T07:23:05.282 INFO:teuthology.orchestra.run.smithi098.stdout: "0a95e0be-e9f4-4ad4-83c7-8185c88ad18f": { 2024-09-19T07:23:05.282 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-19T07:23:05.282 INFO:teuthology.orchestra.run.smithi098.stdout: "tag": "0a95e0be-e9f4-4ad4-83c7-8185c88ad18f", 2024-09-19T07:23:05.282 INFO:teuthology.orchestra.run.smithi098.stdout: "options": "recursive,force" 2024-09-19T07:23:05.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:05.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:05.283 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:23:05.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.278+0000 7fc650e6e640 1 -- 172.21.15.98:0/464243839 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc6380a57f0 msgr2=0x7fc6380a7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:05.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.278+0000 7fc650e6e640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc6380a57f0 0x7fc6380a7cb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc6340058c0 tx=0x7fc6340139c0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.283 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.278+0000 7fc650e6e640 1 -- 172.21.15.98:0/464243839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc64c102ef0 msgr2=0x7fc64c19bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:05.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.278+0000 7fc650e6e640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc64c102ef0 0x7fc64c19bcd0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc64402ae70 tx=0x7fc64402f5d0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.278+0000 7fc650e6e640 1 -- 172.21.15.98:0/464243839 shutdown_connections 2024-09-19T07:23:05.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.279+0000 7fc650e6e640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc6380a57f0 0x7fc6380a7cb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.279+0000 7fc650e6e640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc64c102ef0 0x7fc64c19bcd0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.279+0000 7fc650e6e640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc64c102570 0x7fc64c197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.279+0000 7fc650e6e640 1 --2- 172.21.15.98:0/464243839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc64c100e20 0x7fc64c197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:05.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.279+0000 7fc650e6e640 1 -- 172.21.15.98:0/464243839 >> 172.21.15.98:0/464243839 conn(0x7fc64c0fc7d0 msgr2=0x7fc64c106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:05.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.279+0000 7fc650e6e640 1 -- 172.21.15.98:0/464243839 shutdown_connections 2024-09-19T07:23:05.284 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:05.279+0000 7fc650e6e640 1 -- 172.21.15.98:0/464243839 wait complete. 2024-09-19T07:23:05.971 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:05 smithi098 ceph-mon[30950]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-19T07:23:06.001 INFO:tasks.cephfs.filesystem:scrub status for tag:0a95e0be-e9f4-4ad4-83c7-8185c88ad18f - {'path': '/', 'tag': '0a95e0be-e9f4-4ad4-83c7-8185c88ad18f', 'options': 'recursive,force'} 2024-09-19T07:23:06.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:05 smithi162 ceph-mon[35726]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-19T07:23:06.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:05 smithi139 ceph-mon[35039]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-19T07:23:07.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:06 smithi162 ceph-mon[35726]: scrub summary: idle 2024-09-19T07:23:07.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:06 smithi098 ceph-mon[30950]: scrub summary: idle 2024-09-19T07:23:07.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:06 smithi139 ceph-mon[35039]: scrub summary: idle 2024-09-19T07:23:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.825+0000 7f8f52694640 1 -- 172.21.15.98:0/1867225609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f4c107b70 msgr2=0x7f8f4c107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.825+0000 7f8f52694640 1 --2- 172.21.15.98:0/1867225609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f4c107b70 0x7f8f4c107f50 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009930 tx=0x7f8f3c02a420 comp rx=0 tx=0).stop 2024-09-19T07:23:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.825+0000 7f8f52694640 1 -- 172.21.15.98:0/1867225609 shutdown_connections 2024-09-19T07:23:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.825+0000 7f8f52694640 1 --2- 172.21.15.98:0/1867225609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f4c102470 0x7f8f4c10e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.825+0000 7f8f52694640 1 --2- 172.21.15.98:0/1867225609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f4c101ad0 0x7f8f4c101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.825+0000 7f8f52694640 1 --2- 172.21.15.98:0/1867225609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f4c107b70 0x7f8f4c107f50 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.825+0000 7f8f52694640 1 -- 172.21.15.98:0/1867225609 >> 172.21.15.98:0/1867225609 conn(0x7f8f4c0fd7d0 msgr2=0x7f8f4c0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.825+0000 7f8f52694640 1 -- 172.21.15.98:0/1867225609 shutdown_connections 2024-09-19T07:23:07.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.825+0000 7f8f52694640 1 -- 172.21.15.98:0/1867225609 wait complete. 2024-09-19T07:23:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.826+0000 7f8f52694640 1 Processor -- start 2024-09-19T07:23:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.826+0000 7f8f52694640 1 -- start start 2024-09-19T07:23:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f52694640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f4c101ad0 0x7f8f4c198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f52694640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f4c102470 0x7f8f4c198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f52694640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f4c107b70 0x7f8f4c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f52694640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c111fd0 con 0x7f8f4c101ad0 2024-09-19T07:23:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f52694640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c111e50 con 0x7f8f4c107b70 2024-09-19T07:23:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f52694640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c112150 con 0x7f8f4c102470 2024-09-19T07:23:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f4bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f4c101ad0 0x7f8f4c198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f4bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f4c101ad0 0x7f8f4c198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56980/0 (socket says 172.21.15.98:56980) 2024-09-19T07:23:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f4bfff640 1 -- 172.21.15.98:0/2879081287 learned_addr learned my addr 172.21.15.98:0/2879081287 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:07.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f50c31640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f4c107b70 0x7f8f4c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f4b7fe640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f4c102470 0x7f8f4c198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f4bfff640 1 -- 172.21.15.98:0/2879081287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f4c102470 msgr2=0x7f8f4c198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f4bfff640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f4c102470 0x7f8f4c198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f4bfff640 1 -- 172.21.15.98:0/2879081287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f4c107b70 msgr2=0x7f8f4c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f4bfff640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f4c107b70 0x7f8f4c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f4bfff640 1 -- 172.21.15.98:0/2879081287 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4c19d4f0 con 0x7f8f4c101ad0 2024-09-19T07:23:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f4b7fe640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f4c102470 0x7f8f4c198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.827+0000 7f8f4bfff640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f4c101ad0 0x7f8f4c198500 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c02a940 tx=0x7f8f3c003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.828+0000 7f8f497fa640 1 -- 172.21.15.98:0/2879081287 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c03f070 con 0x7f8f4c101ad0 2024-09-19T07:23:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.828+0000 7f8f52694640 1 -- 172.21.15.98:0/2879081287 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4c19d780 con 0x7f8f4c101ad0 2024-09-19T07:23:07.830 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.828+0000 7f8f52694640 1 -- 172.21.15.98:0/2879081287 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4c1a5070 con 0x7f8f4c101ad0 2024-09-19T07:23:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.828+0000 7f8f497fa640 1 -- 172.21.15.98:0/2879081287 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f3c03b940 con 0x7f8f4c101ad0 2024-09-19T07:23:07.831 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.829+0000 7f8f497fa640 1 -- 172.21.15.98:0/2879081287 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c049060 con 0x7f8f4c101ad0 2024-09-19T07:23:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.831+0000 7f8f497fa640 1 -- 172.21.15.98:0/2879081287 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f8f3c042070 con 0x7f8f4c101ad0 2024-09-19T07:23:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.831+0000 7f8f55430740 1 Processor -- start 2024-09-19T07:23:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.831+0000 7f8f55430740 1 -- start start 2024-09-19T07:23:07.833 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.831+0000 7f8f55430740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcaaf0 0x55ea1efcaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.831+0000 7f8f55430740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcb410 0x55ea1efd5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.831+0000 7f8f55430740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efd5cb0 0x55ea1efd80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.831+0000 7f8f55430740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ea1ef2f2f0 con 0x55ea1efcb410 2024-09-19T07:23:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.831+0000 7f8f55430740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ea1eed7270 con 0x55ea1efd5cb0 2024-09-19T07:23:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.831+0000 7f8f55430740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ea1ef2b2b0 con 0x55ea1efcaaf0 2024-09-19T07:23:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.832+0000 7f8f4bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcb410 0x55ea1efd5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.832+0000 7f8f50c31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcaaf0 0x55ea1efcaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.832+0000 7f8f50c31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcaaf0 0x55ea1efcaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:58036/0 (socket says 172.21.15.98:58036) 2024-09-19T07:23:07.834 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.832+0000 7f8f50c31640 1 -- 172.21.15.98:0/1397785687 learned_addr learned my addr 172.21.15.98:0/1397785687 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.832+0000 7f8f50c31640 1 -- 172.21.15.98:0/1397785687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efd5cb0 msgr2=0x55ea1efd80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.832+0000 7f8f50c31640 1 --2- 172.21.15.98:0/1397785687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efd5cb0 0x55ea1efd80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.832+0000 7f8f50c31640 1 -- 172.21.15.98:0/1397785687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcb410 msgr2=0x55ea1efd5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.832+0000 7f8f50c31640 1 --2- 172.21.15.98:0/1397785687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcb410 0x55ea1efd5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.832+0000 7f8f50c31640 1 -- 172.21.15.98:0/1397785687 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea1eed6340 con 0x55ea1efcaaf0 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.832+0000 7f8f4bfff640 1 --2- 172.21.15.98:0/1397785687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcb410 0x55ea1efd5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.832+0000 7f8f497fa640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8f340a3690 0x7f8f340a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.832+0000 7f8f50c31640 1 --2- 172.21.15.98:0/1397785687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcaaf0 0x55ea1efcaed0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400a430 tx=0x7f8f44009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85d0970aeb989efc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.833+0000 7f8f497fa640 1 -- 172.21.15.98:0/2879081287 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8f3c0f0850 con 0x7f8f4c101ad0 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.833+0000 7f8f4bfff640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8f340a3690 0x7f8f340a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.833+0000 7f8f327fc640 1 -- 172.21.15.98:0/1397785687 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44013790 con 0x55ea1efcaaf0 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.833+0000 7f8f327fc640 1 -- 172.21.15.98:0/1397785687 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f44019070 con 0x55ea1efcaaf0 2024-09-19T07:23:07.835 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.833+0000 7f8f327fc640 1 -- 172.21.15.98:0/1397785687 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44014d80 con 0x55ea1efcaaf0 2024-09-19T07:23:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.834+0000 7f8f55430740 1 -- 172.21.15.98:0/1397785687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcaaf0 msgr2=0x55ea1efcaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.834+0000 7f8f4bfff640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8f340a3690 0x7f8f340a5b50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0edd90 tx=0x7f8f3c0f6530 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.834+0000 7f8f55430740 1 --2- 172.21.15.98:0/1397785687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcaaf0 0x55ea1efcaed0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400a430 tx=0x7f8f44009650 comp rx=0 tx=0).stop 2024-09-19T07:23:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.834+0000 7f8f55430740 1 -- 172.21.15.98:0/1397785687 shutdown_connections 2024-09-19T07:23:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.834+0000 7f8f55430740 1 --2- 172.21.15.98:0/1397785687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efd5cb0 0x55ea1efd80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.839 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.834+0000 7f8f55430740 1 --2- 172.21.15.98:0/1397785687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcb410 0x55ea1efd5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.834+0000 7f8f55430740 1 --2- 172.21.15.98:0/1397785687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcaaf0 0x55ea1efcaed0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.834+0000 7f8f55430740 1 -- 172.21.15.98:0/1397785687 >> 172.21.15.98:0/1397785687 conn(0x55ea1efc7060 msgr2=0x55ea1efc7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.834+0000 7f8f55430740 1 -- 172.21.15.98:0/1397785687 shutdown_connections 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.834+0000 7f8f55430740 1 -- 172.21.15.98:0/1397785687 wait complete. 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.834+0000 7f8f55430740 1 -- start start 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.835+0000 7f8f55430740 1 Processor -- start 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.835+0000 7f8f55430740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 0x55ea1efd2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.835+0000 7f8f55430740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efcb410 0x55ea1efd3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.835+0000 7f8f50c31640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 0x55ea1efd2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.835+0000 7f8f50c31640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 0x55ea1efd2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:56996/0 (socket says 172.21.15.98:56996) 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.835+0000 7f8f50c31640 1 -- 172.21.15.98:0/3355167643 learned_addr learned my addr 172.21.15.98:0/3355167643 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f55430740 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efd5cb0 0x55ea1efd3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.840 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f55430740 1 -- 172.21.15.98:0/3355167643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ea1efd8880 con 0x55ea1efcaaf0 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f55430740 1 -- 172.21.15.98:0/3355167643 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ea1eeb8290 con 0x55ea1efcb410 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f55430740 1 -- 172.21.15.98:0/3355167643 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ea1efd8a00 con 0x55ea1efd5cb0 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f4b7fe640 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efcb410 0x55ea1efd3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f50c31640 1 -- 172.21.15.98:0/3355167643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efd5cb0 msgr2=0x55ea1efd3580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f50c31640 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efd5cb0 0x55ea1efd3580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f50c31640 1 -- 172.21.15.98:0/3355167643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efcb410 msgr2=0x55ea1efd3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f50c31640 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efcb410 0x55ea1efd3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f50c31640 1 -- 172.21.15.98:0/3355167643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea1ec42210 con 0x55ea1efcaaf0 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f55430740 10 client.0 _ll_register_callbacks cb 0x55ea1eee9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f50c31640 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 0x55ea1efd2b00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8f440148e0 tx=0x7f8f44014680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41579fa8ba43e6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.836+0000 7f8f2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.837+0000 7f8f2b7fe640 1 -- 172.21.15.98:0/3355167643 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f440139a0 con 0x55ea1efcaaf0 2024-09-19T07:23:07.841 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.837+0000 7f8f2b7fe640 1 -- 172.21.15.98:0/3355167643 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8f44013b40 con 0x55ea1efcaaf0 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.837+0000 7f8f55430740 1 -- 172.21.15.98:0/3355167643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f44019070 con 0x55ea1efcaaf0 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.837+0000 7f8f2b7fe640 1 -- 172.21.15.98:0/3355167643 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8f44014420 con 0x55ea1efcaaf0 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.837+0000 7f8f55430740 10 client.15657 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.837+0000 7f8f55430740 1 -- 172.21.15.98:0/3355167643 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55ea1ed0e620 con 0x55ea1efcaaf0 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.838+0000 7f8f2b7fe640 1 -- 172.21.15.98:0/3355167643 <== mon.0 v2:172.21.15.98:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8f4402f070 con 0x55ea1efcaaf0 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.838+0000 7f8f55430740 10 client.15657 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.838+0000 7f8f55430740 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.838+0000 7f8f55430740 20 client.15657 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.838+0000 7f8f55430740 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ea1efe5860 0x55ea1efe7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.838+0000 7f8f55430740 4 client.15657 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.838+0000 7f8f55430740 1 -- 172.21.15.98:0/3355167643 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8f44019070 con 0x55ea1efe5860 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.838+0000 7f8f4b7fe640 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ea1efe5860 0x55ea1efe7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.839+0000 7f8f2b7fe640 10 client.15657 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:07.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.839+0000 7f8f4b7fe640 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ea1efe5860 0x55ea1efe7c50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4b12dcb85a9b992 server_cookie=109e84b16bb98282 in_seq=0 out_seq=0 2024-09-19T07:23:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.839+0000 7f8f2b7fe640 1 -- 172.21.15.98:0/3355167643 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8f44019070 con 0x55ea1efe5860 2024-09-19T07:23:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.839+0000 7f8f2b7fe640 10 client.15657 handle_command_reply: tid=0 2024-09-19T07:23:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.839+0000 7f8f55430740 1 client.15657 shutdown 2024-09-19T07:23:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.840+0000 7f8f55430740 1 -- 172.21.15.98:0/3355167643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 msgr2=0x55ea1efd2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.840+0000 7f8f55430740 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 0x55ea1efd2b00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8f440148e0 tx=0x7f8f44014680 comp rx=0 tx=0).stop 2024-09-19T07:23:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.840+0000 7f8f55430740 1 -- 172.21.15.98:0/3355167643 shutdown_connections 2024-09-19T07:23:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.840+0000 7f8f55430740 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efd5cb0 0x55ea1efd3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.840+0000 7f8f55430740 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efcb410 0x55ea1efd3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.840+0000 7f8f55430740 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ea1efe5860 0x55ea1efe7c50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.840+0000 7f8f55430740 1 --2- 172.21.15.98:0/3355167643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 0x55ea1efd2b00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.840+0000 7f8f2b7fe640 0 client.15657 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.840+0000 7f8f55430740 1 -- 172.21.15.98:0/3355167643 >> 172.21.15.98:0/3355167643 conn(0x55ea1efc7060 msgr2=0x55ea1efccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.840+0000 7f8f55430740 1 -- 172.21.15.98:0/3355167643 shutdown_connections 2024-09-19T07:23:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.840+0000 7f8f55430740 1 -- 172.21.15.98:0/3355167643 wait complete. 2024-09-19T07:23:07.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.840+0000 7f8f55430740 20 client.15657 trim_cache size 0 max 16384 2024-09-19T07:23:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.868+0000 7f8f55430740 1 Processor -- start 2024-09-19T07:23:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.868+0000 7f8f55430740 1 -- start start 2024-09-19T07:23:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.868+0000 7f8f55430740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 0x55ea1efd33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f55430740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcb410 0x55ea1efed300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f55430740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efd5cb0 0x55ea1efed840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f55430740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c1b01d0 con 0x55ea1efcaaf0 2024-09-19T07:23:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f55430740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c1adaa0 con 0x55ea1efd5cb0 2024-09-19T07:23:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f55430740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c1ab8f0 con 0x55ea1efcb410 2024-09-19T07:23:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f50c31640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 0x55ea1efd33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f4b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcb410 0x55ea1efed300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f50c31640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 0x55ea1efd33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57008/0 (socket says 172.21.15.98:57008) 2024-09-19T07:23:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f50c31640 1 -- 172.21.15.98:0/3951587579 learned_addr learned my addr 172.21.15.98:0/3951587579 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f50c31640 1 -- 172.21.15.98:0/3951587579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcb410 msgr2=0x55ea1efed300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f50c31640 1 --2- 172.21.15.98:0/3951587579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcb410 0x55ea1efed300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f50c31640 1 -- 172.21.15.98:0/3951587579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efd5cb0 msgr2=0x55ea1efed840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:23:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f50c31640 1 --2- 172.21.15.98:0/3951587579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efd5cb0 0x55ea1efed840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.871 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f50c31640 1 -- 172.21.15.98:0/3951587579 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea1efc6e90 con 0x55ea1efcaaf0 2024-09-19T07:23:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.869+0000 7f8f4b7fe640 1 --2- 172.21.15.98:0/3951587579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcb410 0x55ea1efed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:23:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.870+0000 7f8f50c31640 1 --2- 172.21.15.98:0/3951587579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 0x55ea1efd33b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400ad80 tx=0x7f8f44022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1d14dd6218c263 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.870+0000 7f8f31ffb640 1 -- 172.21.15.98:0/3951587579 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f440139a0 con 0x55ea1efcaaf0 2024-09-19T07:23:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.870+0000 7f8f31ffb640 1 -- 172.21.15.98:0/3951587579 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f44019070 con 0x55ea1efcaaf0 2024-09-19T07:23:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.870+0000 7f8f31ffb640 1 -- 172.21.15.98:0/3951587579 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44029bc0 con 0x55ea1efcaaf0 2024-09-19T07:23:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.871+0000 7f8f55430740 1 -- 172.21.15.98:0/3951587579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 msgr2=0x55ea1efd33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.871+0000 7f8f55430740 1 --2- 172.21.15.98:0/3951587579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 0x55ea1efd33b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400ad80 tx=0x7f8f44022000 comp rx=0 tx=0).stop 2024-09-19T07:23:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.871+0000 7f8f55430740 1 -- 172.21.15.98:0/3951587579 shutdown_connections 2024-09-19T07:23:07.875 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.871+0000 7f8f55430740 1 --2- 172.21.15.98:0/3951587579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efd5cb0 0x55ea1efed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.871+0000 7f8f55430740 1 --2- 172.21.15.98:0/3951587579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcb410 0x55ea1efed300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.871+0000 7f8f55430740 1 --2- 172.21.15.98:0/3951587579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efcaaf0 0x55ea1efd33b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.871+0000 7f8f55430740 1 -- 172.21.15.98:0/3951587579 >> 172.21.15.98:0/3951587579 conn(0x55ea1efc7060 msgr2=0x55ea1efd4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.871+0000 7f8f55430740 1 -- 172.21.15.98:0/3951587579 shutdown_connections 2024-09-19T07:23:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.871+0000 7f8f55430740 1 -- 172.21.15.98:0/3951587579 wait complete. 2024-09-19T07:23:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.871+0000 7f8f55430740 1 -- start start 2024-09-19T07:23:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f55430740 1 Processor -- start 2024-09-19T07:23:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f55430740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcaaf0 0x55ea1efde5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f55430740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efcb410 0x55ea1efcf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.876 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f55430740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efd5cb0 0x55ea1efd00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f55430740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c1abf60 con 0x55ea1efd5cb0 2024-09-19T07:23:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f55430740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c1ad3d0 con 0x55ea1efcb410 2024-09-19T07:23:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f55430740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c1ac630 con 0x55ea1efcaaf0 2024-09-19T07:23:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f50c31640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efd5cb0 0x55ea1efd00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f55430740 10 client.0 _ll_register_callbacks cb 0x7f8f3c0f6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f50c31640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efd5cb0 0x55ea1efd00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57024/0 (socket says 172.21.15.98:57024) 2024-09-19T07:23:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f50c31640 1 -- 172.21.15.98:0/1026725864 learned_addr learned my addr 172.21.15.98:0/1026725864 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f4b7fe640 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efcb410 0x55ea1efcf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.872+0000 7f8f50c31640 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcaaf0 0x55ea1efde5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f50c31640 1 -- 172.21.15.98:0/1026725864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcaaf0 msgr2=0x55ea1efde5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:07.877 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f50c31640 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcaaf0 0x55ea1efde5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f50c31640 1 -- 172.21.15.98:0/1026725864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efcb410 msgr2=0x55ea1efcf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f50c31640 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efcb410 0x55ea1efcf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f50c31640 1 -- 172.21.15.98:0/1026725864 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea1efc22d0 con 0x55ea1efd5cb0 2024-09-19T07:23:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f50c31640 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efd5cb0 0x55ea1efd00b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8f44014ab0 tx=0x7f8f4400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e90cce5eec0d7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f2b7fe640 1 -- 172.21.15.98:0/1026725864 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44031660 con 0x55ea1efd5cb0 2024-09-19T07:23:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f2b7fe640 1 -- 172.21.15.98:0/1026725864 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8f44031800 con 0x55ea1efd5cb0 2024-09-19T07:23:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f55430740 1 -- 172.21.15.98:0/1026725864 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f44019070 con 0x55ea1efd5cb0 2024-09-19T07:23:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f2b7fe640 1 -- 172.21.15.98:0/1026725864 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8f44013d80 con 0x55ea1efd5cb0 2024-09-19T07:23:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f55430740 10 client.15663 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.873+0000 7f8f55430740 1 -- 172.21.15.98:0/1026725864 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ea1f0502b0 con 0x55ea1efd5cb0 2024-09-19T07:23:07.878 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.874+0000 7f8f2b7fe640 1 -- 172.21.15.98:0/1026725864 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f44014cf0 con 0x55ea1efd5cb0 2024-09-19T07:23:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.875+0000 7f8f2b7fe640 1 -- 172.21.15.98:0/1026725864 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8f44038020 con 0x55ea1efd5cb0 2024-09-19T07:23:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.875+0000 7f8f55430740 10 client.15663 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.875+0000 7f8f55430740 10 client.15663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.875+0000 7f8f55430740 20 client.15663 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.875+0000 7f8f55430740 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ea1f050640 0x55ea1f052a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.875+0000 7f8f55430740 4 client.15663 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:23:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.875+0000 7f8f55430740 1 -- 172.21.15.98:0/1026725864 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8f44019070 con 0x55ea1f050640 2024-09-19T07:23:07.879 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.875+0000 7f8f4b7fe640 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ea1f050640 0x55ea1f052a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.875+0000 7f8f2b7fe640 10 client.15663 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:07.880 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.875+0000 7f8f4b7fe640 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ea1f050640 0x55ea1f052a30 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0408c3f5a707f5f server_cookie=bf52cf74ae1ba843 in_seq=0 out_seq=0 2024-09-19T07:23:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f2b7fe640 1 -- 172.21.15.98:0/1026725864 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8f44019070 con 0x55ea1f050640 2024-09-19T07:23:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f2b7fe640 10 client.15663 handle_command_reply: tid=0 2024-09-19T07:23:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f55430740 1 client.15663 shutdown 2024-09-19T07:23:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f55430740 1 -- 172.21.15.98:0/1026725864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efd5cb0 msgr2=0x55ea1efd00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f55430740 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efd5cb0 0x55ea1efd00b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8f44014ab0 tx=0x7f8f4400c040 comp rx=0 tx=0).stop 2024-09-19T07:23:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f55430740 1 -- 172.21.15.98:0/1026725864 shutdown_connections 2024-09-19T07:23:07.883 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f55430740 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ea1f050640 0x55ea1f052a30 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f55430740 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ea1efd5cb0 0x55ea1efd00b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f55430740 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea1efcb410 0x55ea1efcf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f55430740 1 --2- 172.21.15.98:0/1026725864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea1efcaaf0 0x55ea1efde5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f55430740 1 -- 172.21.15.98:0/1026725864 >> 172.21.15.98:0/1026725864 conn(0x55ea1efc7060 msgr2=0x55ea1efcc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f2b7fe640 0 client.15663 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f55430740 1 -- 172.21.15.98:0/1026725864 shutdown_connections 2024-09-19T07:23:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.882+0000 7f8f55430740 1 -- 172.21.15.98:0/1026725864 wait complete. 2024-09-19T07:23:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f55430740 20 client.15663 trim_cache size 0 max 16384 2024-09-19T07:23:07.884 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:23:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:23:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:23:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:23:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f52694640 1 -- 172.21.15.98:0/2879081287 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8f340a3690 msgr2=0x7f8f340a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f52694640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8f340a3690 0x7f8f340a5b50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0edd90 tx=0x7f8f3c0f6530 comp rx=0 tx=0).stop 2024-09-19T07:23:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f52694640 1 -- 172.21.15.98:0/2879081287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f4c101ad0 msgr2=0x7f8f4c198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f52694640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f4c101ad0 0x7f8f4c198500 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c02a940 tx=0x7f8f3c003c00 comp rx=0 tx=0).stop 2024-09-19T07:23:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f52694640 1 -- 172.21.15.98:0/2879081287 shutdown_connections 2024-09-19T07:23:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f52694640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8f340a3690 0x7f8f340a5b50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f52694640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8f4c107b70 0x7f8f4c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f52694640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f4c102470 0x7f8f4c198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f52694640 1 --2- 172.21.15.98:0/2879081287 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f4c101ad0 0x7f8f4c198500 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f52694640 1 -- 172.21.15.98:0/2879081287 >> 172.21.15.98:0/2879081287 conn(0x7f8f4c0fd7d0 msgr2=0x7f8f4c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f52694640 1 -- 172.21.15.98:0/2879081287 shutdown_connections 2024-09-19T07:23:07.886 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:07.883+0000 7f8f52694640 1 -- 172.21.15.98:0/2879081287 wait complete. 2024-09-19T07:23:08.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:07 smithi162 ceph-mon[35726]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T07:23:08.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:07 smithi098 ceph-mon[30950]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T07:23:08.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:07 smithi139 ceph-mon[35039]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-19T07:23:10.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:09 smithi162 ceph-mon[35726]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T07:23:10.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:09 smithi098 ceph-mon[30950]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T07:23:10.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:09 smithi139 ceph-mon[35039]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T07:23:12.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:11 smithi162 ceph-mon[35726]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:23:12.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:11 smithi098 ceph-mon[30950]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:23:12.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:11 smithi139 ceph-mon[35039]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:23:14.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:13 smithi162 ceph-mon[35726]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:23:14.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:13 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:23:14.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:13 smithi098 ceph-mon[30950]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:23:14.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:13 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:23:14.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:13 smithi139 ceph-mon[35039]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:23:14.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:13 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:23:15.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:23:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:23:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:23:15.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:23:15.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:23:15.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:23:15.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:23:15.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:23:15.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:23:16.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:15 smithi162 ceph-mon[35726]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T07:23:16.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:15 smithi098 ceph-mon[30950]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T07:23:16.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:15 smithi139 ceph-mon[35039]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T07:23:18.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:17 smithi162 ceph-mon[35726]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T07:23:18.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:17 smithi098 ceph-mon[30950]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T07:23:18.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:17 smithi139 ceph-mon[35039]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-19T07:23:20.119 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:19 smithi139 ceph-mon[35039]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T07:23:20.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:19 smithi162 ceph-mon[35726]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T07:23:20.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:19 smithi098 ceph-mon[30950]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-19T07:23:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.016+0000 7f10ff398640 1 -- 172.21.15.98:0/470878767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f8107b70 msgr2=0x7f10f8107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.016+0000 7f10ff398640 1 --2- 172.21.15.98:0/470878767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f8107b70 0x7f10f8107f50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f10f4009930 tx=0x7f10f402a420 comp rx=0 tx=0).stop 2024-09-19T07:23:21.017 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.016+0000 7f10ff398640 1 -- 172.21.15.98:0/470878767 shutdown_connections 2024-09-19T07:23:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.016+0000 7f10ff398640 1 --2- 172.21.15.98:0/470878767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10f8102470 0x7f10f810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.016+0000 7f10ff398640 1 --2- 172.21.15.98:0/470878767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10f8101ad0 0x7f10f8101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.016+0000 7f10ff398640 1 --2- 172.21.15.98:0/470878767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f8107b70 0x7f10f8107f50 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.016+0000 7f10ff398640 1 -- 172.21.15.98:0/470878767 >> 172.21.15.98:0/470878767 conn(0x7f10f80fd7d0 msgr2=0x7f10f80ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.017+0000 7f10ff398640 1 -- 172.21.15.98:0/470878767 shutdown_connections 2024-09-19T07:23:21.018 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.017+0000 7f10ff398640 1 -- 172.21.15.98:0/470878767 wait complete. 2024-09-19T07:23:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.017+0000 7f10ff398640 1 Processor -- start 2024-09-19T07:23:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.017+0000 7f10ff398640 1 -- start start 2024-09-19T07:23:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10ff398640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f8101ad0 0x7f10f8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10ff398640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10f8102470 0x7f10f81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10ff398640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10f8107b70 0x7f10f819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.021 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10ff398640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10f8111f70 con 0x7f10f8101ad0 2024-09-19T07:23:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10fd134640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f8101ad0 0x7f10f8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10fd134640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f8101ad0 0x7f10f8198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42048/0 (socket says 172.21.15.98:42048) 2024-09-19T07:23:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10fd134640 1 -- 172.21.15.98:0/4123604657 learned_addr learned my addr 172.21.15.98:0/4123604657 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10ff398640 1 -- 172.21.15.98:0/4123604657 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f10f8111df0 con 0x7f10f8107b70 2024-09-19T07:23:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10ff398640 1 -- 172.21.15.98:0/4123604657 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10f81120f0 con 0x7f10f8102470 2024-09-19T07:23:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10fc933640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10f8102470 0x7f10f81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10fd935640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10f8107b70 0x7f10f819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10fd134640 1 -- 172.21.15.98:0/4123604657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10f8102470 msgr2=0x7f10f81988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10fd134640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10f8102470 0x7f10f81988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10fd134640 1 -- 172.21.15.98:0/4123604657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10f8107b70 msgr2=0x7f10f819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:21.022 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.018+0000 7f10fd134640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10f8107b70 0x7f10f819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.019+0000 7f10fd134640 1 -- 172.21.15.98:0/4123604657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f819d350 con 0x7f10f8101ad0 2024-09-19T07:23:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.019+0000 7f10fd935640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10f8107b70 0x7f10f819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.019+0000 7f10fd134640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f8101ad0 0x7f10f8198360 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f10f402a940 tx=0x7f10f4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.019+0000 7f10ee7fc640 1 -- 172.21.15.98:0/4123604657 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f403f070 con 0x7f10f8101ad0 2024-09-19T07:23:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.019+0000 7f10ee7fc640 1 -- 172.21.15.98:0/4123604657 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10f4031c90 con 0x7f10f8101ad0 2024-09-19T07:23:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.019+0000 7f10ff398640 1 -- 172.21.15.98:0/4123604657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f819d5e0 con 0x7f10f8101ad0 2024-09-19T07:23:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.019+0000 7f10ee7fc640 1 -- 172.21.15.98:0/4123604657 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4035030 con 0x7f10f8101ad0 2024-09-19T07:23:21.023 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.020+0000 7f10ff398640 1 -- 172.21.15.98:0/4123604657 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f81a4ed0 con 0x7f10f8101ad0 2024-09-19T07:23:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.022+0000 7f10ee7fc640 1 -- 172.21.15.98:0/4123604657 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f10f4042070 con 0x7f10f8101ad0 2024-09-19T07:23:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.023+0000 7f110220f740 1 Processor -- start 2024-09-19T07:23:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f110220f740 1 -- start start 2024-09-19T07:23:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f10ee7fc640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f10e40a3690 0x7f10e40a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f110220f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b6faf0 0x5571c8b6fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f110220f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b70410 0x5571c8b7a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f110220f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b7acb0 0x5571c8b7d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f110220f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5571c8ad42f0 con 0x5571c8b70410 2024-09-19T07:23:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f110220f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5571c8a7c270 con 0x5571c8b6faf0 2024-09-19T07:23:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f110220f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5571c8ad02b0 con 0x5571c8b7acb0 2024-09-19T07:23:21.025 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f10fc933640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b70410 0x5571c8b7a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f10fc933640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b70410 0x5571c8b7a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42050/0 (socket says 172.21.15.98:42050) 2024-09-19T07:23:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f10fc933640 1 -- 172.21.15.98:0/389681232 learned_addr learned my addr 172.21.15.98:0/389681232 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f10fd134640 1 --2- 172.21.15.98:0/389681232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b6faf0 0x5571c8b6fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f10fd935640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f10e40a3690 0x7f10e40a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.024+0000 7f10fd935640 1 --2- 172.21.15.98:0/389681232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b7acb0 0x5571c8b7d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.025+0000 7f10fc933640 1 -- 172.21.15.98:0/389681232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b7acb0 msgr2=0x5571c8b7d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.025+0000 7f10fc933640 1 --2- 172.21.15.98:0/389681232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b7acb0 0x5571c8b7d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.025+0000 7f10fc933640 1 -- 172.21.15.98:0/389681232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b6faf0 msgr2=0x5571c8b6fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.025+0000 7f10fc933640 1 --2- 172.21.15.98:0/389681232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b6faf0 0x5571c8b6fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.025+0000 7f10fc933640 1 -- 172.21.15.98:0/389681232 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571c8a7b340 con 0x5571c8b70410 2024-09-19T07:23:21.026 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.025+0000 7f10fd134640 1 --2- 172.21.15.98:0/389681232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b6faf0 0x5571c8b6fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:23:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.025+0000 7f10fc933640 1 --2- 172.21.15.98:0/389681232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b70410 0x5571c8b7a770 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009cf0 tx=0x7f10e8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6069a3ee6d6dd7ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.025+0000 7f10fd935640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f10e40a3690 0x7f10e40a5b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009fd0 tx=0x7f10f0009a30 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.025+0000 7f10ee7fc640 1 -- 172.21.15.98:0/4123604657 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f10f40f03a0 con 0x7f10f8101ad0 2024-09-19T07:23:21.030 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.025+0000 7f10e37fe640 1 -- 172.21.15.98:0/389681232 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8019620 con 0x5571c8b70410 2024-09-19T07:23:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.025+0000 7f10e37fe640 1 -- 172.21.15.98:0/389681232 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10e8019ca0 con 0x5571c8b70410 2024-09-19T07:23:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.025+0000 7f10e37fe640 1 -- 172.21.15.98:0/389681232 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8018cb0 con 0x5571c8b70410 2024-09-19T07:23:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.026+0000 7f110220f740 1 -- 172.21.15.98:0/389681232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b70410 msgr2=0x5571c8b7a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.026+0000 7f110220f740 1 --2- 172.21.15.98:0/389681232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b70410 0x5571c8b7a770 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009cf0 tx=0x7f10e8011810 comp rx=0 tx=0).stop 2024-09-19T07:23:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.026+0000 7f110220f740 1 -- 172.21.15.98:0/389681232 shutdown_connections 2024-09-19T07:23:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.026+0000 7f110220f740 1 --2- 172.21.15.98:0/389681232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b7acb0 0x5571c8b7d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.026+0000 7f110220f740 1 --2- 172.21.15.98:0/389681232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b70410 0x5571c8b7a770 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.026+0000 7f110220f740 1 --2- 172.21.15.98:0/389681232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b6faf0 0x5571c8b6fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.026+0000 7f110220f740 1 -- 172.21.15.98:0/389681232 >> 172.21.15.98:0/389681232 conn(0x5571c8b6c060 msgr2=0x5571c8b6c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.026+0000 7f110220f740 1 -- 172.21.15.98:0/389681232 shutdown_connections 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.026+0000 7f110220f740 1 -- 172.21.15.98:0/389681232 wait complete. 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.027+0000 7f110220f740 1 -- start start 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.027+0000 7f110220f740 1 Processor -- start 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.027+0000 7f110220f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b6faf0 0x5571c8b77dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.027+0000 7f110220f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b7acb0 0x5571c8b78300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.027+0000 7f110220f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b78840 0x5571c8b86db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.027+0000 7f110220f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5571c8b7d880 con 0x5571c8b7acb0 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.027+0000 7f110220f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5571c8a5d290 con 0x5571c8b78840 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.027+0000 7f110220f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5571c8b7da00 con 0x5571c8b6faf0 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.027+0000 7f110220f740 10 client.0 _ll_register_callbacks cb 0x5571c8a8e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10fd134640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b6faf0 0x5571c8b77dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10fc933640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b7acb0 0x5571c8b78300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10fd134640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b6faf0 0x5571c8b77dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:59012/0 (socket says 172.21.15.98:59012) 2024-09-19T07:23:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10fd134640 1 -- 172.21.15.98:0/2272616658 learned_addr learned my addr 172.21.15.98:0/2272616658 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10fd935640 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b78840 0x5571c8b86db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10fd134640 1 -- 172.21.15.98:0/2272616658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b78840 msgr2=0x5571c8b86db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10fd134640 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b78840 0x5571c8b86db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10fd134640 1 -- 172.21.15.98:0/2272616658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b7acb0 msgr2=0x5571c8b78300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10fd134640 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b7acb0 0x5571c8b78300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10fd134640 1 -- 172.21.15.98:0/2272616658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571c87e7210 con 0x5571c8b6faf0 2024-09-19T07:23:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10fc933640 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b7acb0 0x5571c8b78300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:23:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10fd134640 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b6faf0 0x5571c8b77dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f10f40bc110 tx=0x7f10f402a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfd87f287da9f14e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T07:23:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.028+0000 7f10e0ff9640 1 -- 172.21.15.98:0/2272616658 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4049030 con 0x5571c8b6faf0 2024-09-19T07:23:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.029+0000 7f10e0ff9640 1 -- 172.21.15.98:0/2272616658 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f10f40c4bf0 con 0x5571c8b6faf0 2024-09-19T07:23:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.029+0000 7f110220f740 1 -- 172.21.15.98:0/2272616658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10e8019ca0 con 0x5571c8b6faf0 2024-09-19T07:23:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.029+0000 7f10e0ff9640 1 -- 172.21.15.98:0/2272616658 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f10f40bcb10 con 0x5571c8b6faf0 2024-09-19T07:23:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.029+0000 7f110220f740 10 client.25105 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.029+0000 7f110220f740 1 -- 172.21.15.98:0/2272616658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5571c88b3620 con 0x5571c8b6faf0 2024-09-19T07:23:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.029+0000 7f10e0ff9640 1 -- 172.21.15.98:0/2272616658 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10e8019ca0 con 0x5571c8b6faf0 2024-09-19T07:23:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.030+0000 7f10e0ff9640 1 -- 172.21.15.98:0/2272616658 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f10f40d51d0 con 0x5571c8b6faf0 2024-09-19T07:23:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.030+0000 7f110220f740 10 client.25105 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.030+0000 7f110220f740 10 client.25105 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.030+0000 7f110220f740 20 client.25105 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.030+0000 7f110220f740 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5571c8b8b1c0 0x5571c8b8d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.030+0000 7f110220f740 4 client.25105 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.030+0000 7f110220f740 1 -- 172.21.15.98:0/2272616658 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571c8ae1a20 con 0x5571c8b8b1c0 2024-09-19T07:23:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.030+0000 7f10fc933640 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5571c8b8b1c0 0x5571c8b8d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.031+0000 7f10e0ff9640 10 client.25105 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.031+0000 7f10fc933640 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5571c8b8b1c0 0x5571c8b8d5b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2e226788f1220b9 server_cookie=9515c9053e2bcd5 in_seq=0 out_seq=0 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f10e0ff9640 1 -- 172.21.15.98:0/2272616658 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571c8ae1a20 con 0x5571c8b8b1c0 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f10e0ff9640 10 client.25105 handle_command_reply: tid=0 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f110220f740 1 client.25105 shutdown 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f110220f740 1 -- 172.21.15.98:0/2272616658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b6faf0 msgr2=0x5571c8b77dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f110220f740 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b6faf0 0x5571c8b77dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f10f40bc110 tx=0x7f10f402a420 comp rx=0 tx=0).stop 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f110220f740 1 -- 172.21.15.98:0/2272616658 shutdown_connections 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f110220f740 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b78840 0x5571c8b86db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f110220f740 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5571c8b8b1c0 0x5571c8b8d5b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f10e0ff9640 0 client.25105 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f110220f740 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b7acb0 0x5571c8b78300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f110220f740 1 --2- 172.21.15.98:0/2272616658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b6faf0 0x5571c8b77dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f110220f740 1 -- 172.21.15.98:0/2272616658 >> 172.21.15.98:0/2272616658 conn(0x5571c8b6c060 msgr2=0x5571c8b71dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f110220f740 1 -- 172.21.15.98:0/2272616658 shutdown_connections 2024-09-19T07:23:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f110220f740 1 -- 172.21.15.98:0/2272616658 wait complete. 2024-09-19T07:23:21.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.032+0000 7f110220f740 20 client.25105 trim_cache size 0 max 16384 2024-09-19T07:23:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.060+0000 7f110220f740 1 Processor -- start 2024-09-19T07:23:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.060+0000 7f110220f740 1 -- start start 2024-09-19T07:23:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f110220f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b6faf0 0x5571c8b76670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f110220f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b78840 0x5571c8b86ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f110220f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b7acb0 0x5571c8b92ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f110220f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10f81b0150 con 0x5571c8b6faf0 2024-09-19T07:23:21.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f110220f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f10f81ada20 con 0x5571c8b7acb0 2024-09-19T07:23:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f110220f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10f81ab870 con 0x5571c8b78840 2024-09-19T07:23:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f10fd134640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b6faf0 0x5571c8b76670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f10fd134640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b6faf0 0x5571c8b76670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42064/0 (socket says 172.21.15.98:42064) 2024-09-19T07:23:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f10fd134640 1 -- 172.21.15.98:0/259405856 learned_addr learned my addr 172.21.15.98:0/259405856 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f10fd935640 1 --2- 172.21.15.98:0/259405856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b7acb0 0x5571c8b92ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f10fc933640 1 --2- 172.21.15.98:0/259405856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b78840 0x5571c8b86ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f10fd134640 1 -- 172.21.15.98:0/259405856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b78840 msgr2=0x5571c8b86ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f10fd134640 1 --2- 172.21.15.98:0/259405856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b78840 0x5571c8b86ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f10fd134640 1 -- 172.21.15.98:0/259405856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b7acb0 msgr2=0x5571c8b92ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f10fd134640 1 --2- 172.21.15.98:0/259405856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b7acb0 0x5571c8b92ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f10fd134640 1 -- 172.21.15.98:0/259405856 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571c8b76d50 con 0x5571c8b6faf0 2024-09-19T07:23:21.080 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.061+0000 7f10fd134640 1 --2- 172.21.15.98:0/259405856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b6faf0 0x5571c8b76670 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f10f40bc3a0 tx=0x7f10f4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6384731b8b3206c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.062+0000 7f10e2ffd640 1 -- 172.21.15.98:0/259405856 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4049070 con 0x5571c8b6faf0 2024-09-19T07:23:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.062+0000 7f10e2ffd640 1 -- 172.21.15.98:0/259405856 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10f40c07c0 con 0x5571c8b6faf0 2024-09-19T07:23:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.062+0000 7f10e2ffd640 1 -- 172.21.15.98:0/259405856 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f40bbae0 con 0x5571c8b6faf0 2024-09-19T07:23:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.063+0000 7f110220f740 1 -- 172.21.15.98:0/259405856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b6faf0 msgr2=0x5571c8b76670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.063+0000 7f110220f740 1 --2- 172.21.15.98:0/259405856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b6faf0 0x5571c8b76670 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f10f40bc3a0 tx=0x7f10f4003f90 comp rx=0 tx=0).stop 2024-09-19T07:23:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.063+0000 7f110220f740 1 -- 172.21.15.98:0/259405856 shutdown_connections 2024-09-19T07:23:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.063+0000 7f110220f740 1 --2- 172.21.15.98:0/259405856 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b7acb0 0x5571c8b92ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.063+0000 7f110220f740 1 --2- 172.21.15.98:0/259405856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b78840 0x5571c8b86ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.063+0000 7f110220f740 1 --2- 172.21.15.98:0/259405856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b6faf0 0x5571c8b76670 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.063+0000 7f110220f740 1 -- 172.21.15.98:0/259405856 >> 172.21.15.98:0/259405856 conn(0x5571c8b6c060 msgr2=0x5571c8b79e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.063+0000 7f110220f740 1 -- 172.21.15.98:0/259405856 shutdown_connections 2024-09-19T07:23:21.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.063+0000 7f110220f740 1 -- 172.21.15.98:0/259405856 wait complete. 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.063+0000 7f110220f740 1 -- start start 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.064+0000 7f110220f740 1 Processor -- start 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.064+0000 7f110220f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b6faf0 0x5571c8b83430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.064+0000 7f110220f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b78840 0x5571c8b74a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.064+0000 7f110220f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b7acb0 0x5571c8b74fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.064+0000 7f110220f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10f81abee0 con 0x5571c8b78840 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f110220f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f10f81ad350 con 0x5571c8b7acb0 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f110220f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10f81ac5b0 con 0x5571c8b6faf0 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fc933640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b78840 0x5571c8b74a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fd134640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b6faf0 0x5571c8b83430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fd935640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b7acb0 0x5571c8b74fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fc933640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b78840 0x5571c8b74a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42080/0 (socket says 172.21.15.98:42080) 2024-09-19T07:23:21.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fd935640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b7acb0 0x5571c8b74fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:38846/0 (socket says 172.21.15.98:38846) 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fc933640 1 -- 172.21.15.98:0/3391497753 learned_addr learned my addr 172.21.15.98:0/3391497753 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f110220f740 10 client.0 _ll_register_callbacks cb 0x7f10f4009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fd935640 1 -- 172.21.15.98:0/3391497753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b6faf0 msgr2=0x5571c8b83430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fd935640 1 --2- 172.21.15.98:0/3391497753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b6faf0 0x5571c8b83430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fd935640 1 -- 172.21.15.98:0/3391497753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b78840 msgr2=0x5571c8b74a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fd935640 1 --2- 172.21.15.98:0/3391497753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b78840 0x5571c8b74a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fd935640 1 -- 172.21.15.98:0/3391497753 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571c8b757b0 con 0x5571c8b7acb0 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fc933640 1 --2- 172.21.15.98:0/3391497753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b78840 0x5571c8b74a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10fd935640 1 --2- 172.21.15.98:0/3391497753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b7acb0 0x5571c8b74fb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10f0014650 tx=0x7f10f001c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935253f436c4c4d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.065+0000 7f10e0ff9640 1 -- 172.21.15.98:0/3391497753 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f0030060 con 0x5571c8b7acb0 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.066+0000 7f10e0ff9640 1 -- 172.21.15.98:0/3391497753 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f10f00105e0 con 0x5571c8b7acb0 2024-09-19T07:23:21.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.066+0000 7f110220f740 1 -- 172.21.15.98:0/3391497753 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10f40c07c0 con 0x5571c8b7acb0 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.066+0000 7f10e0ff9640 1 -- 172.21.15.98:0/3391497753 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f10f0012ea0 con 0x5571c8b7acb0 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.066+0000 7f110220f740 10 client.25166 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.066+0000 7f110220f740 1 -- 172.21.15.98:0/3391497753 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5571c8bf5e30 con 0x5571c8b7acb0 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.066+0000 7f10e0ff9640 1 -- 172.21.15.98:0/3391497753 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10f40c07c0 con 0x5571c8b7acb0 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.066+0000 7f10e0ff9640 1 -- 172.21.15.98:0/3391497753 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f10f002a070 con 0x5571c8b7acb0 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.066+0000 7f110220f740 10 client.25166 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.066+0000 7f110220f740 10 client.25166 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.066+0000 7f110220f740 20 client.25166 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.066+0000 7f110220f740 1 --2- 172.21.15.98:0/3391497753 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5571c8b8b1c0 0x5571c8bf85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.067+0000 7f110220f740 4 client.25166 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.067+0000 7f110220f740 1 -- 172.21.15.98:0/3391497753 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5571c8adbd70 con 0x5571c8b8b1c0 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.067+0000 7f10fd134640 1 --2- 172.21.15.98:0/3391497753 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5571c8b8b1c0 0x5571c8bf85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:21.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.067+0000 7f10fd134640 1 --2- 172.21.15.98:0/3391497753 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5571c8b8b1c0 0x5571c8bf85c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9ffc8e667c1763b server_cookie=b27e70cacc473ff6 in_seq=0 out_seq=0 2024-09-19T07:23:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.067+0000 7f10e0ff9640 10 client.25166 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.070+0000 7f10e0ff9640 1 -- 172.21.15.98:0/3391497753 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5571c8adbd70 con 0x5571c8b8b1c0 2024-09-19T07:23:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.070+0000 7f10e0ff9640 10 client.25166 handle_command_reply: tid=0 2024-09-19T07:23:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.070+0000 7f110220f740 1 client.25166 shutdown 2024-09-19T07:23:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.071+0000 7f110220f740 1 -- 172.21.15.98:0/3391497753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b7acb0 msgr2=0x5571c8b74fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.071+0000 7f110220f740 1 --2- 172.21.15.98:0/3391497753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b7acb0 0x5571c8b74fb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10f0014650 tx=0x7f10f001c000 comp rx=0 tx=0).stop 2024-09-19T07:23:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.071+0000 7f110220f740 1 -- 172.21.15.98:0/3391497753 shutdown_connections 2024-09-19T07:23:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.071+0000 7f110220f740 1 --2- 172.21.15.98:0/3391497753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571c8b7acb0 0x5571c8b74fb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.071+0000 7f110220f740 1 --2- 172.21.15.98:0/3391497753 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5571c8b8b1c0 0x5571c8bf85c0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.071+0000 7f110220f740 1 --2- 172.21.15.98:0/3391497753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5571c8b78840 0x5571c8b74a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.071+0000 7f110220f740 1 --2- 172.21.15.98:0/3391497753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5571c8b6faf0 0x5571c8b83430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.071+0000 7f10e0ff9640 0 client.25166 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.071+0000 7f110220f740 1 -- 172.21.15.98:0/3391497753 >> 172.21.15.98:0/3391497753 conn(0x5571c8b6c060 msgr2=0x5571c8b79e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.071+0000 7f110220f740 1 -- 172.21.15.98:0/3391497753 shutdown_connections 2024-09-19T07:23:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.071+0000 7f110220f740 1 -- 172.21.15.98:0/3391497753 wait complete. 2024-09-19T07:23:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.071+0000 7f110220f740 20 client.25166 trim_cache size 0 max 16384 2024-09-19T07:23:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:23:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:23:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:23:21.086 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:23:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.072+0000 7f10ff398640 1 -- 172.21.15.98:0/4123604657 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f10e40a3690 msgr2=0x7f10e40a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.072+0000 7f10ff398640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f10e40a3690 0x7f10e40a5b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009fd0 tx=0x7f10f0009a30 comp rx=0 tx=0).stop 2024-09-19T07:23:21.087 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.072+0000 7f10ff398640 1 -- 172.21.15.98:0/4123604657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f8101ad0 msgr2=0x7f10f8198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.072+0000 7f10ff398640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f8101ad0 0x7f10f8198360 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f10f402a940 tx=0x7f10f4003b90 comp rx=0 tx=0).stop 2024-09-19T07:23:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.072+0000 7f10ff398640 1 -- 172.21.15.98:0/4123604657 shutdown_connections 2024-09-19T07:23:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.072+0000 7f10ff398640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f10e40a3690 0x7f10e40a5b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.072+0000 7f10ff398640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10f8107b70 0x7f10f819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.072+0000 7f10ff398640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10f8102470 0x7f10f81988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.072+0000 7f10ff398640 1 --2- 172.21.15.98:0/4123604657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10f8101ad0 0x7f10f8198360 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.072+0000 7f10ff398640 1 -- 172.21.15.98:0/4123604657 >> 172.21.15.98:0/4123604657 conn(0x7f10f80fd7d0 msgr2=0x7f10f80fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.072+0000 7f10ff398640 1 -- 172.21.15.98:0/4123604657 shutdown_connections 2024-09-19T07:23:21.089 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:21.072+0000 7f10ff398640 1 -- 172.21.15.98:0/4123604657 wait complete. 2024-09-19T07:23:22.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:21 smithi162 ceph-mon[35726]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:23:22.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:21 smithi098 ceph-mon[30950]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:23:22.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:21 smithi139 ceph-mon[35039]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:23:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:23 smithi162 ceph-mon[35726]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:23:24.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:23 smithi098 ceph-mon[30950]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:23:24.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:23 smithi139 ceph-mon[35039]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:23:24.732 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T07:23:24.732 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T07:23:24.733 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:23:24.988 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:25.608 INFO:tasks.workunit.client.0.smithi098.stderr:Updating files: 96% (12484/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T07:23:25.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.675+0000 7f406048f640 1 -- 172.21.15.98:0/1827666364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4058102ef0 msgr2=0x7f405810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:25.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.675+0000 7f406048f640 1 --2- 172.21.15.98:0/1827666364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4058102ef0 0x7f405810da40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4050009ca0 tx=0x7f405002a950 comp rx=0 tx=0).stop 2024-09-19T07:23:25.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.675+0000 7f406048f640 1 -- 172.21.15.98:0/1827666364 shutdown_connections 2024-09-19T07:23:25.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.675+0000 7f406048f640 1 --2- 172.21.15.98:0/1827666364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4058102ef0 0x7f405810da40 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:25.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.675+0000 7f406048f640 1 --2- 172.21.15.98:0/1827666364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4058102570 0x7f40581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:25.711 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.675+0000 7f406048f640 1 --2- 172.21.15.98:0/1827666364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4058100e20 0x7f4058101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.675+0000 7f406048f640 1 -- 172.21.15.98:0/1827666364 >> 172.21.15.98:0/1827666364 conn(0x7f40580fc7d0 msgr2=0x7f40580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.675+0000 7f406048f640 1 -- 172.21.15.98:0/1827666364 shutdown_connections 2024-09-19T07:23:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.675+0000 7f406048f640 1 -- 172.21.15.98:0/1827666364 wait complete. 2024-09-19T07:23:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.675+0000 7f406048f640 1 Processor -- start 2024-09-19T07:23:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f406048f640 1 -- start start 2024-09-19T07:23:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f406048f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4058100e20 0x7f4058198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f406048f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4058102570 0x7f40581989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f406048f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4058102ef0 0x7f405819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f406048f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4058110f80 con 0x7f4058102570 2024-09-19T07:23:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f406048f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4058110e00 con 0x7f4058102ef0 2024-09-19T07:23:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f406048f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4058111100 con 0x7f4058100e20 2024-09-19T07:23:25.712 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f405da2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4058102570 0x7f40581989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:25.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f405da2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4058102570 0x7f40581989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37652/0 (socket says 172.21.15.98:37652) 2024-09-19T07:23:25.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f405da2a640 1 -- 172.21.15.98:0/1076243739 learned_addr learned my addr 172.21.15.98:0/1076243739 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:25.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f405e22b640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4058100e20 0x7f4058198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:25.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f405ea2c640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4058102ef0 0x7f405819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:25.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f405da2a640 1 -- 172.21.15.98:0/1076243739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4058100e20 msgr2=0x7f4058198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:25.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f405da2a640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4058100e20 0x7f4058198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:25.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f405da2a640 1 -- 172.21.15.98:0/1076243739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4058102ef0 msgr2=0x7f405819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:25.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f405da2a640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4058102ef0 0x7f405819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:25.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.676+0000 7f405da2a640 1 -- 172.21.15.98:0/1076243739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405819d410 con 0x7f4058102570 2024-09-19T07:23:25.713 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.677+0000 7f405da2a640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4058102570 0x7f40581989a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f404800e9f0 tx=0x7f404800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:25.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.677+0000 7f404f7fe640 1 -- 172.21.15.98:0/1076243739 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404800cd80 con 0x7f4058102570 2024-09-19T07:23:25.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.677+0000 7f404f7fe640 1 -- 172.21.15.98:0/1076243739 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4048010910 con 0x7f4058102570 2024-09-19T07:23:25.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.677+0000 7f406048f640 1 -- 172.21.15.98:0/1076243739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405819d700 con 0x7f4058102570 2024-09-19T07:23:25.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.677+0000 7f404f7fe640 1 -- 172.21.15.98:0/1076243739 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048018990 con 0x7f4058102570 2024-09-19T07:23:25.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.677+0000 7f406048f640 1 -- 172.21.15.98:0/1076243739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40581a4fe0 con 0x7f4058102570 2024-09-19T07:23:25.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.678+0000 7f406048f640 1 -- 172.21.15.98:0/1076243739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4058101200 con 0x7f4058102570 2024-09-19T07:23:25.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.679+0000 7f404f7fe640 1 -- 172.21.15.98:0/1076243739 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f4048010ac0 con 0x7f4058102570 2024-09-19T07:23:25.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.679+0000 7f404f7fe640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f40440a3560 0x7f40440a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:25.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.680+0000 7f405e22b640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f40440a3560 0x7f40440a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:25.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.680+0000 7f404f7fe640 1 -- 172.21.15.98:0/1076243739 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f40480d0410 con 0x7f4058102570 2024-09-19T07:23:25.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.680+0000 7f405e22b640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f40440a3560 0x7f40440a5a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4054005d00 tx=0x7f4054005c50 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:25.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.684+0000 7f404f7fe640 1 -- 172.21.15.98:0/1076243739 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f404809cb80 con 0x7f4058102570 2024-09-19T07:23:25.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.906+0000 7f406048f640 1 -- 172.21.15.98:0/1076243739 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f405810a0d0 con 0x7f4058102570 2024-09-19T07:23:25.907 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.907+0000 7f404f7fe640 1 -- 172.21.15.98:0/1076243739 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f404809c480 con 0x7f4058102570 2024-09-19T07:23:25.908 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:23:25.908 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:23:25.908 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:23:25.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.909+0000 7f406048f640 1 -- 172.21.15.98:0/1076243739 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f40440a3560 msgr2=0x7f40440a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:25.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.909+0000 7f406048f640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f40440a3560 0x7f40440a5a20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4054005d00 tx=0x7f4054005c50 comp rx=0 tx=0).stop 2024-09-19T07:23:25.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.909+0000 7f406048f640 1 -- 172.21.15.98:0/1076243739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4058102570 msgr2=0x7f40581989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:25.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.909+0000 7f406048f640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4058102570 0x7f40581989a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f404800e9f0 tx=0x7f404800eeb0 comp rx=0 tx=0).stop 2024-09-19T07:23:25.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.909+0000 7f406048f640 1 -- 172.21.15.98:0/1076243739 shutdown_connections 2024-09-19T07:23:25.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.909+0000 7f406048f640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f40440a3560 0x7f40440a5a20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:25.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.909+0000 7f406048f640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4058102ef0 0x7f405819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:25.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.909+0000 7f406048f640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4058102570 0x7f40581989a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:25.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.909+0000 7f406048f640 1 --2- 172.21.15.98:0/1076243739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4058100e20 0x7f4058198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:25.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.909+0000 7f406048f640 1 -- 172.21.15.98:0/1076243739 >> 172.21.15.98:0/1076243739 conn(0x7f40580fc7d0 msgr2=0x7f405806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:25.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.909+0000 7f406048f640 1 -- 172.21.15.98:0/1076243739 shutdown_connections 2024-09-19T07:23:25.911 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:25.909+0000 7f406048f640 1 -- 172.21.15.98:0/1076243739 wait complete. 2024-09-19T07:23:26.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:25 smithi098 ceph-mon[30950]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T07:23:26.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:25 smithi162 ceph-mon[35726]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T07:23:26.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:25 smithi139 ceph-mon[35039]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T07:23:26.432 INFO:tasks.workunit.client.0.smithi098.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T07:23:26.432 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-19T07:23:26.433 INFO:tasks.workunit.client.0.smithi098.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T07:23:26.433 INFO:tasks.workunit.client.0.smithi098.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T07:23:26.433 INFO:tasks.workunit.client.0.smithi098.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T07:23:26.433 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-19T07:23:26.433 INFO:tasks.workunit.client.0.smithi098.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T07:23:26.433 INFO:tasks.workunit.client.0.smithi098.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T07:23:26.433 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-19T07:23:26.433 INFO:tasks.workunit.client.0.smithi098.stderr: git switch -c 2024-09-19T07:23:26.433 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-19T07:23:26.434 INFO:tasks.workunit.client.0.smithi098.stderr:Or undo this operation with: 2024-09-19T07:23:26.434 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-19T07:23:26.434 INFO:tasks.workunit.client.0.smithi098.stderr: git switch - 2024-09-19T07:23:26.434 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-19T07:23:26.434 INFO:tasks.workunit.client.0.smithi098.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T07:23:26.434 INFO:tasks.workunit.client.0.smithi098.stderr: 2024-09-19T07:23:26.434 INFO:tasks.workunit.client.0.smithi098.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T07:23:26.438 DEBUG:teuthology.orchestra.run.smithi098:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T07:23:26.498 INFO:tasks.workunit.client.0.smithi098.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T07:23:26.500 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T07:23:26.500 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T07:23:26.829 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T07:23:26.829 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T07:23:27.079 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:27.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:26 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1076243739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:27.200 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:26 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1076243739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:27.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:26 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1076243739' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:27.628 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.592+0000 7f42906b7640 1 -- 172.21.15.98:0/4042867065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4288102790 msgr2=0x7f42881067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:27.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.592+0000 7f42906b7640 1 --2- 172.21.15.98:0/4042867065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4288102790 0x7f42881067e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f427c009900 tx=0x7f427c02a410 comp rx=0 tx=0).stop 2024-09-19T07:23:27.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.592+0000 7f42906b7640 1 -- 172.21.15.98:0/4042867065 shutdown_connections 2024-09-19T07:23:27.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.592+0000 7f42906b7640 1 --2- 172.21.15.98:0/4042867065 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4288106f10 0x7f428810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.629 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.592+0000 7f42906b7640 1 --2- 172.21.15.98:0/4042867065 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4288102790 0x7f42881067e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.592+0000 7f42906b7640 1 --2- 172.21.15.98:0/4042867065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4288101de0 0x7f42881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.592+0000 7f42906b7640 1 -- 172.21.15.98:0/4042867065 >> 172.21.15.98:0/4042867065 conn(0x7f42880fd8c0 msgr2=0x7f42880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:27.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.592+0000 7f42906b7640 1 -- 172.21.15.98:0/4042867065 shutdown_connections 2024-09-19T07:23:27.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.592+0000 7f42906b7640 1 -- 172.21.15.98:0/4042867065 wait complete. 2024-09-19T07:23:27.630 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f42906b7640 1 Processor -- start 2024-09-19T07:23:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f42906b7640 1 -- start start 2024-09-19T07:23:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f42906b7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4288101de0 0x7f42881985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f42906b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4288102790 0x7f4288198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f42906b7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4288106f10 0x7f428819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f42906b7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4288112010 con 0x7f4288106f10 2024-09-19T07:23:27.631 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f42906b7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4288111e90 con 0x7f4288101de0 2024-09-19T07:23:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f42906b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4288112190 con 0x7f4288102790 2024-09-19T07:23:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f428ec54640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4288106f10 0x7f428819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f428ec54640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4288106f10 0x7f428819cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37668/0 (socket says 172.21.15.98:37668) 2024-09-19T07:23:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f428ec54640 1 -- 172.21.15.98:0/3402162056 learned_addr learned my addr 172.21.15.98:0/3402162056 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f428dc52640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4288102790 0x7f4288198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.632 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f428e453640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4288101de0 0x7f42881985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f428ec54640 1 -- 172.21.15.98:0/3402162056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4288102790 msgr2=0x7f4288198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f428ec54640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4288102790 0x7f4288198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f428ec54640 1 -- 172.21.15.98:0/3402162056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4288101de0 msgr2=0x7f42881985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f428ec54640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4288101de0 0x7f42881985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f428ec54640 1 -- 172.21.15.98:0/3402162056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428819d580 con 0x7f4288106f10 2024-09-19T07:23:27.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.593+0000 7f428dc52640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4288102790 0x7f4288198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.594+0000 7f428ec54640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4288106f10 0x7f428819cea0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f428000b970 tx=0x7f428000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.594+0000 7f427b7fe640 1 -- 172.21.15.98:0/3402162056 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280019070 con 0x7f4288106f10 2024-09-19T07:23:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.594+0000 7f427b7fe640 1 -- 172.21.15.98:0/3402162056 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f428000cb40 con 0x7f4288106f10 2024-09-19T07:23:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.594+0000 7f42906b7640 1 -- 172.21.15.98:0/3402162056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f428819d870 con 0x7f4288106f10 2024-09-19T07:23:27.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.594+0000 7f427b7fe640 1 -- 172.21.15.98:0/3402162056 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4280007650 con 0x7f4288106f10 2024-09-19T07:23:27.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.594+0000 7f42906b7640 1 -- 172.21.15.98:0/3402162056 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42881a5150 con 0x7f4288106f10 2024-09-19T07:23:27.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.596+0000 7f427b7fe640 1 -- 172.21.15.98:0/3402162056 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f428001c070 con 0x7f4288106f10 2024-09-19T07:23:27.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.596+0000 7f4292a90740 1 Processor -- start 2024-09-19T07:23:27.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f4292a90740 1 -- start start 2024-09-19T07:23:27.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f4292a90740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e832f6850 0x556e832f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f4292a90740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f7170 0x556e833014f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f4292a90740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e83301a30 0x556e83303e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f4292a90740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556e8325b160 con 0x556e83301a30 2024-09-19T07:23:27.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f4292a90740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556e83202720 con 0x556e832f6850 2024-09-19T07:23:27.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f4292a90740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556e83257120 con 0x556e832f7170 2024-09-19T07:23:27.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f428dc52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e83301a30 0x556e83303e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f428dc52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e83301a30 0x556e83303e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37678/0 (socket says 172.21.15.98:37678) 2024-09-19T07:23:27.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f428dc52640 1 -- 172.21.15.98:0/3088023266 learned_addr learned my addr 172.21.15.98:0/3088023266 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:27.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f428dc52640 1 --2- 172.21.15.98:0/3088023266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e832f6850 0x556e832f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f428e453640 1 --2- 172.21.15.98:0/3088023266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f7170 0x556e833014f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f427b7fe640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42740a3560 0x7f42740a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f428ec54640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42740a3560 0x7f42740a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f428dc52640 1 -- 172.21.15.98:0/3088023266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f7170 msgr2=0x556e833014f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f428dc52640 1 --2- 172.21.15.98:0/3088023266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f7170 0x556e833014f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f428dc52640 1 -- 172.21.15.98:0/3088023266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e832f6850 msgr2=0x556e832f6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f428dc52640 1 --2- 172.21.15.98:0/3088023266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e832f6850 0x556e832f6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.638 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f428dc52640 1 -- 172.21.15.98:0/3088023266 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e82fccba0 con 0x556e83301a30 2024-09-19T07:23:27.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.597+0000 7f427b7fe640 1 -- 172.21.15.98:0/3402162056 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f42800cf5d0 con 0x7f4288106f10 2024-09-19T07:23:27.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.598+0000 7f428dc52640 1 --2- 172.21.15.98:0/3088023266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e83301a30 0x556e83303e20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f427c02a930 tx=0x7f427c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64ce4d7eb586cce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:27.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.598+0000 7f428ec54640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42740a3560 0x7f42740a5a20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f42800ccc20 tx=0x7f428006d4d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:27.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.598+0000 7f4278ff9640 1 -- 172.21.15.98:0/3088023266 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c035040 con 0x556e83301a30 2024-09-19T07:23:27.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.598+0000 7f4278ff9640 1 -- 172.21.15.98:0/3088023266 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f427c0319f0 con 0x556e83301a30 2024-09-19T07:23:27.639 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.598+0000 7f4278ff9640 1 -- 172.21.15.98:0/3088023266 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c004a00 con 0x556e83301a30 2024-09-19T07:23:27.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 -- 172.21.15.98:0/3088023266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e83301a30 msgr2=0x556e83303e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:27.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 --2- 172.21.15.98:0/3088023266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e83301a30 0x556e83303e20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f427c02a930 tx=0x7f427c031400 comp rx=0 tx=0).stop 2024-09-19T07:23:27.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 -- 172.21.15.98:0/3088023266 shutdown_connections 2024-09-19T07:23:27.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 --2- 172.21.15.98:0/3088023266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e83301a30 0x556e83303e20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 --2- 172.21.15.98:0/3088023266 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f7170 0x556e833014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.640 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 --2- 172.21.15.98:0/3088023266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e832f6850 0x556e832f6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 -- 172.21.15.98:0/3088023266 >> 172.21.15.98:0/3088023266 conn(0x556e832f2de0 msgr2=0x556e832f31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 -- 172.21.15.98:0/3088023266 shutdown_connections 2024-09-19T07:23:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 -- 172.21.15.98:0/3088023266 wait complete. 2024-09-19T07:23:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 -- start start 2024-09-19T07:23:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 Processor -- start 2024-09-19T07:23:27.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f6850 0x556e832fe900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 0x556e832fee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e83301a30 0x556e832ff380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556e83304600 con 0x556e832f7170 2024-09-19T07:23:27.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556e831e3900 con 0x556e83301a30 2024-09-19T07:23:27.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556e83304780 con 0x556e832f6850 2024-09-19T07:23:27.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.599+0000 7f4292a90740 10 client.0 _ll_register_callbacks cb 0x556e831e1780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:27.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f428e453640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 0x556e832fee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f428e453640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 0x556e832fee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37684/0 (socket says 172.21.15.98:37684) 2024-09-19T07:23:27.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f428e453640 1 -- 172.21.15.98:0/210705375 learned_addr learned my addr 172.21.15.98:0/210705375 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:27.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f428dc52640 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f6850 0x556e832fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.643 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f428dc52640 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e83301a30 0x556e832ff380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f428e453640 1 -- 172.21.15.98:0/210705375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f6850 msgr2=0x556e832fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:27.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f428e453640 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f6850 0x556e832fe900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f428e453640 1 -- 172.21.15.98:0/210705375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e83301a30 msgr2=0x556e832ff380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:27.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f428e453640 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e83301a30 0x556e832ff380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f428e453640 1 -- 172.21.15.98:0/210705375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e83223c50 con 0x556e832f7170 2024-09-19T07:23:27.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f428dc52640 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e83301a30 0x556e832ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f428e453640 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 0x556e832fee40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4284010500 tx=0x7f42840109c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba741c0b50039d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f4271ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f4271ffb640 1 -- 172.21.15.98:0/210705375 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428401a020 con 0x556e832f7170 2024-09-19T07:23:27.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f4271ffb640 1 -- 172.21.15.98:0/210705375 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f4284016690 con 0x556e832f7170 2024-09-19T07:23:27.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f4292a90740 1 -- 172.21.15.98:0/210705375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f427c0319f0 con 0x556e832f7170 2024-09-19T07:23:27.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f4271ffb640 1 -- 172.21.15.98:0/210705375 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4284025050 con 0x556e832f7170 2024-09-19T07:23:27.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f4292a90740 10 client.15699 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:27.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.600+0000 7f4292a90740 1 -- 172.21.15.98:0/210705375 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556e833102f0 con 0x556e832f7170 2024-09-19T07:23:27.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.601+0000 7f4271ffb640 1 -- 172.21.15.98:0/210705375 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f427c0319f0 con 0x556e832f7170 2024-09-19T07:23:27.646 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.601+0000 7f4271ffb640 1 -- 172.21.15.98:0/210705375 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4284014b30 con 0x556e832f7170 2024-09-19T07:23:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.601+0000 7f4292a90740 10 client.15699 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.601+0000 7f4292a90740 10 client.15699 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:23:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.601+0000 7f4292a90740 20 client.15699 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.601+0000 7f4292a90740 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556e83311850 0x556e83313c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.601+0000 7f4292a90740 4 client.15699 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:27.647 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.601+0000 7f4292a90740 1 -- 172.21.15.98:0/210705375 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e83268890 con 0x556e83311850 2024-09-19T07:23:27.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.601+0000 7f428dc52640 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556e83311850 0x556e83313c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4271ffb640 10 client.15699 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:27.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f428dc52640 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556e83311850 0x556e83313c70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=394d765433f23001 server_cookie=bd0a9e0b13f4a2a in_seq=0 out_seq=0 2024-09-19T07:23:27.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4271ffb640 1 -- 172.21.15.98:0/210705375 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e83268890 con 0x556e83311850 2024-09-19T07:23:27.648 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4271ffb640 10 client.15699 handle_command_reply: tid=0 2024-09-19T07:23:27.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4292a90740 1 client.15699 shutdown 2024-09-19T07:23:27.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4292a90740 1 -- 172.21.15.98:0/210705375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 msgr2=0x556e832fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:27.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4292a90740 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 0x556e832fee40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4284010500 tx=0x7f42840109c0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4292a90740 1 -- 172.21.15.98:0/210705375 shutdown_connections 2024-09-19T07:23:27.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4292a90740 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e83301a30 0x556e832ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.649 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4292a90740 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556e83311850 0x556e83313c70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4292a90740 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 0x556e832fee40 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4292a90740 1 --2- 172.21.15.98:0/210705375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f6850 0x556e832fe900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4292a90740 1 -- 172.21.15.98:0/210705375 >> 172.21.15.98:0/210705375 conn(0x556e832f2de0 msgr2=0x556e832f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:27.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4271ffb640 0 client.15699 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:27.650 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.602+0000 7f4292a90740 1 -- 172.21.15.98:0/210705375 shutdown_connections 2024-09-19T07:23:27.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.603+0000 7f4292a90740 1 -- 172.21.15.98:0/210705375 wait complete. 2024-09-19T07:23:27.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.603+0000 7f4292a90740 20 client.15699 trim_cache size 0 max 16384 2024-09-19T07:23:27.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.619+0000 7f4292a90740 1 Processor -- start 2024-09-19T07:23:27.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.619+0000 7f4292a90740 1 -- start start 2024-09-19T07:23:27.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.619+0000 7f4292a90740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f6850 0x556e83313860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.651 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.619+0000 7f4292a90740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f7170 0x556e83300870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.619+0000 7f4292a90740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e83301a30 0x556e832ff1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.619+0000 7f4292a90740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42881b02e0 con 0x556e832f6850 2024-09-19T07:23:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.619+0000 7f4292a90740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f42881adbb0 con 0x556e83301a30 2024-09-19T07:23:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.619+0000 7f4292a90740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42881aba00 con 0x556e832f7170 2024-09-19T07:23:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.619+0000 7f428dc52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f6850 0x556e83313860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.652 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f428dc52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f6850 0x556e83313860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37698/0 (socket says 172.21.15.98:37698) 2024-09-19T07:23:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f428dc52640 1 -- 172.21.15.98:0/2177286237 learned_addr learned my addr 172.21.15.98:0/2177286237 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f428e453640 1 --2- 172.21.15.98:0/2177286237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f7170 0x556e83300870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f428dc52640 1 -- 172.21.15.98:0/2177286237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f7170 msgr2=0x556e83300870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f428dc52640 1 --2- 172.21.15.98:0/2177286237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f7170 0x556e83300870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.653 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f428dc52640 1 -- 172.21.15.98:0/2177286237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e83301a30 msgr2=0x556e832ff1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f428dc52640 1 --2- 172.21.15.98:0/2177286237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e83301a30 0x556e832ff1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f428dc52640 1 -- 172.21.15.98:0/2177286237 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e832fd8b0 con 0x556e832f6850 2024-09-19T07:23:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f428e453640 1 --2- 172.21.15.98:0/2177286237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f7170 0x556e83300870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f428dc52640 1 --2- 172.21.15.98:0/2177286237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f6850 0x556e83313860 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f427c0316b0 tx=0x7f427c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e667ee11c902da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f4273fff640 1 -- 172.21.15.98:0/2177286237 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c035040 con 0x556e832f6850 2024-09-19T07:23:27.654 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f4273fff640 1 -- 172.21.15.98:0/2177286237 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f427c031e50 con 0x556e832f6850 2024-09-19T07:23:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.620+0000 7f4273fff640 1 -- 172.21.15.98:0/2177286237 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c004ba0 con 0x556e832f6850 2024-09-19T07:23:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 -- 172.21.15.98:0/2177286237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f6850 msgr2=0x556e83313860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 --2- 172.21.15.98:0/2177286237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f6850 0x556e83313860 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f427c0316b0 tx=0x7f427c031400 comp rx=0 tx=0).stop 2024-09-19T07:23:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 -- 172.21.15.98:0/2177286237 shutdown_connections 2024-09-19T07:23:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 --2- 172.21.15.98:0/2177286237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e83301a30 0x556e832ff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.655 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 --2- 172.21.15.98:0/2177286237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e832f7170 0x556e83300870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 --2- 172.21.15.98:0/2177286237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f6850 0x556e83313860 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 -- 172.21.15.98:0/2177286237 >> 172.21.15.98:0/2177286237 conn(0x556e832f2de0 msgr2=0x556e83300160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 -- 172.21.15.98:0/2177286237 shutdown_connections 2024-09-19T07:23:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 -- 172.21.15.98:0/2177286237 wait complete. 2024-09-19T07:23:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 -- start start 2024-09-19T07:23:27.656 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 Processor -- start 2024-09-19T07:23:27.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e832f6850 0x556e833099b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 0x556e83309ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e83301a30 0x556e83304f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42881ac070 con 0x556e832f7170 2024-09-19T07:23:27.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f42881ad4e0 con 0x556e832f6850 2024-09-19T07:23:27.657 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42881ac740 con 0x556e83301a30 2024-09-19T07:23:27.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f4292a90740 10 client.0 _ll_register_callbacks cb 0x7f428400b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:27.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f428e453640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 0x556e83309ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f428e453640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 0x556e83309ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37706/0 (socket says 172.21.15.98:37706) 2024-09-19T07:23:27.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.621+0000 7f428e453640 1 -- 172.21.15.98:0/2283082754 learned_addr learned my addr 172.21.15.98:0/2283082754 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:27.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f428dc52640 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e832f6850 0x556e833099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.658 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f428dc52640 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e83301a30 0x556e83304f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f428e453640 1 -- 172.21.15.98:0/2283082754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e83301a30 msgr2=0x556e83304f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f428e453640 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e83301a30 0x556e83304f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f428e453640 1 -- 172.21.15.98:0/2283082754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e832f6850 msgr2=0x556e833099b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f428e453640 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e832f6850 0x556e833099b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f428e453640 1 -- 172.21.15.98:0/2283082754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e83305710 con 0x556e832f7170 2024-09-19T07:23:27.659 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f428dc52640 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e83301a30 0x556e83304f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:27.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f428e453640 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 0x556e83309ef0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4284004810 tx=0x7f4284012860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e144b21746a547 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:27.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4271ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:27.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4271ffb640 1 -- 172.21.15.98:0/2283082754 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428402e060 con 0x556e832f7170 2024-09-19T07:23:27.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4271ffb640 1 -- 172.21.15.98:0/2283082754 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f4284012b70 con 0x556e832f7170 2024-09-19T07:23:27.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4292a90740 1 -- 172.21.15.98:0/2283082754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f427c031e50 con 0x556e832f7170 2024-09-19T07:23:27.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4271ffb640 1 -- 172.21.15.98:0/2283082754 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f428401a040 con 0x556e832f7170 2024-09-19T07:23:27.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4292a90740 10 client.15705 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:27.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4292a90740 1 -- 172.21.15.98:0/2283082754 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556e8337bf70 con 0x556e832f7170 2024-09-19T07:23:27.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4271ffb640 1 -- 172.21.15.98:0/2283082754 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f427c031e50 con 0x556e832f7170 2024-09-19T07:23:27.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4271ffb640 1 -- 172.21.15.98:0/2283082754 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f42840144c0 con 0x556e832f7170 2024-09-19T07:23:27.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4292a90740 10 client.15705 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:27.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4292a90740 10 client.15705 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:23:27.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4292a90740 20 client.15705 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:27.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4292a90740 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556e8337c730 0x556e8337eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:27.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4292a90740 4 client.15705 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T07:23:27.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.622+0000 7f4292a90740 1 -- 172.21.15.98:0/2283082754 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x556e83262be0 con 0x556e8337c730 2024-09-19T07:23:27.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.623+0000 7f428dc52640 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556e8337c730 0x556e8337eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:27.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.623+0000 7f428dc52640 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556e8337c730 0x556e8337eb50 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc5c0a4fcbe55da6 server_cookie=77c28c4f2c0b0092 in_seq=0 out_seq=0 2024-09-19T07:23:27.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.623+0000 7f4271ffb640 10 client.15705 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:27.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4271ffb640 1 -- 172.21.15.98:0/2283082754 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x556e83262be0 con 0x556e8337c730 2024-09-19T07:23:27.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4271ffb640 10 client.15705 handle_command_reply: tid=0 2024-09-19T07:23:27.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4292a90740 1 client.15705 shutdown 2024-09-19T07:23:27.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4292a90740 1 -- 172.21.15.98:0/2283082754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 msgr2=0x556e83309ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:27.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4292a90740 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 0x556e83309ef0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4284004810 tx=0x7f4284012860 comp rx=0 tx=0).stop 2024-09-19T07:23:27.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4292a90740 1 -- 172.21.15.98:0/2283082754 shutdown_connections 2024-09-19T07:23:27.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4292a90740 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556e83301a30 0x556e83304f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4292a90740 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556e8337c730 0x556e8337eb50 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4292a90740 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e832f7170 0x556e83309ef0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.666 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4292a90740 1 --2- 172.21.15.98:0/2283082754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556e832f6850 0x556e833099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4292a90740 1 -- 172.21.15.98:0/2283082754 >> 172.21.15.98:0/2283082754 conn(0x556e832f2de0 msgr2=0x556e83300980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:27.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4271ffb640 0 client.15705 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:27.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4292a90740 1 -- 172.21.15.98:0/2283082754 shutdown_connections 2024-09-19T07:23:27.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4292a90740 1 -- 172.21.15.98:0/2283082754 wait complete. 2024-09-19T07:23:27.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.630+0000 7f4292a90740 20 client.15705 trim_cache size 0 max 16384 2024-09-19T07:23:27.668 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:23:27.668 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 24, 2024-09-19T07:23:27.668 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:23:27.668 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 6, 2024-09-19T07:23:27.668 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": { 2024-09-19T07:23:27.669 INFO:teuthology.orchestra.run.smithi098.stdout: "71cce13a": { 2024-09-19T07:23:27.669 INFO:teuthology.orchestra.run.smithi098.stdout: "version": 6, 2024-09-19T07:23:27.669 INFO:teuthology.orchestra.run.smithi098.stdout: "age_ref": 0.0, 2024-09-19T07:23:27.669 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:23:27.669 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "QUIESCED", 2024-09-19T07:23:27.671 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:23:27.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:23:27.671 INFO:teuthology.orchestra.run.smithi098.stdout: "timeout": 90.0, 2024-09-19T07:23:27.671 INFO:teuthology.orchestra.run.smithi098.stdout: "expiration": 140.3, 2024-09-19T07:23:27.671 INFO:teuthology.orchestra.run.smithi098.stdout: "members": { 2024-09-19T07:23:27.671 INFO:teuthology.orchestra.run.smithi098.stdout: "file:/": { 2024-09-19T07:23:27.671 INFO:teuthology.orchestra.run.smithi098.stdout: "excluded": false, 2024-09-19T07:23:27.671 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:23:27.671 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "QUIESCED", 2024-09-19T07:23:27.671 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:23:27.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:27.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:27.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:27.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:27.672 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:27.672 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:23:27.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.631+0000 7f42906b7640 1 -- 172.21.15.98:0/3402162056 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42740a3560 msgr2=0x7f42740a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:27.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.631+0000 7f42906b7640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42740a3560 0x7f42740a5a20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f42800ccc20 tx=0x7f428006d4d0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.631+0000 7f42906b7640 1 -- 172.21.15.98:0/3402162056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4288106f10 msgr2=0x7f428819cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:27.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.631+0000 7f42906b7640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4288106f10 0x7f428819cea0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f428000b970 tx=0x7f428000be30 comp rx=0 tx=0).stop 2024-09-19T07:23:27.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.631+0000 7f42906b7640 1 -- 172.21.15.98:0/3402162056 shutdown_connections 2024-09-19T07:23:27.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.631+0000 7f42906b7640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42740a3560 0x7f42740a5a20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.631+0000 7f42906b7640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4288106f10 0x7f428819cea0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.631+0000 7f42906b7640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4288102790 0x7f4288198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.631+0000 7f42906b7640 1 --2- 172.21.15.98:0/3402162056 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4288101de0 0x7f42881985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:27.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.631+0000 7f42906b7640 1 -- 172.21.15.98:0/3402162056 >> 172.21.15.98:0/3402162056 conn(0x7f42880fd8c0 msgr2=0x7f42880fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:27.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.631+0000 7f42906b7640 1 -- 172.21.15.98:0/3402162056 shutdown_connections 2024-09-19T07:23:27.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:27.631+0000 7f42906b7640 1 -- 172.21.15.98:0/3402162056 wait complete. 2024-09-19T07:23:27.734 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T07:23:27.889 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T07:23:27.927 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T07:23:27.929 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T07:23:27.929 INFO:tasks.workunit.client.0.smithi098.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T07:23:27.969 INFO:tasks.workunit.client.0.smithi098.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T07:23:27.972 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:23:27.972 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T07:23:27.991 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-19T07:23:27.992 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-19T07:23:27.993 DEBUG:teuthology.orchestra.run.smithi098:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-19T07:23:28.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:27 smithi162 ceph-mon[35726]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:23:28.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:27 smithi098 ceph-mon[30950]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:23:28.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:27 smithi139 ceph-mon[35039]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T07:23:28.446 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '71cce13a', quiesce took 3.7 seconds. Will release after: 16.650000000000002 2024-09-19T07:23:30.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:29 smithi162 ceph-mon[35726]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-19T07:23:30.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:29 smithi098 ceph-mon[30950]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-19T07:23:30.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:29 smithi139 ceph-mon[35039]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-19T07:23:32.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:31 smithi162 ceph-mon[35726]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T07:23:32.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:31 smithi098 ceph-mon[30950]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T07:23:32.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:31 smithi139 ceph-mon[35039]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T07:23:34.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:33 smithi162 ceph-mon[35726]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T07:23:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.169+0000 7f9dd3178640 1 -- 172.21.15.98:0/3544502987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc1069e0 msgr2=0x7f9dcc106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.169+0000 7f9dd3178640 1 --2- 172.21.15.98:0/3544502987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc1069e0 0x7f9dcc106dc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009930 tx=0x7f9db402a420 comp rx=0 tx=0).stop 2024-09-19T07:23:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 -- 172.21.15.98:0/3544502987 shutdown_connections 2024-09-19T07:23:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 --2- 172.21.15.98:0/3544502987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc101370 0x7f9dcc10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 --2- 172.21.15.98:0/3544502987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dcc1009d0 0x7f9dcc100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 --2- 172.21.15.98:0/3544502987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc1069e0 0x7f9dcc106dc0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 -- 172.21.15.98:0/3544502987 >> 172.21.15.98:0/3544502987 conn(0x7f9dcc0fc6f0 msgr2=0x7f9dcc0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 -- 172.21.15.98:0/3544502987 shutdown_connections 2024-09-19T07:23:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 -- 172.21.15.98:0/3544502987 wait complete. 2024-09-19T07:23:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 Processor -- start 2024-09-19T07:23:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 -- start start 2024-09-19T07:23:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc1009d0 0x7f9dcc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dcc101370 0x7f9dcc1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc1069e0 0x7f9dcc19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc111f10 con 0x7f9dcc1009d0 2024-09-19T07:23:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc111d90 con 0x7f9dcc101370 2024-09-19T07:23:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.170+0000 7f9dd3178640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc112090 con 0x7f9dcc1069e0 2024-09-19T07:23:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dd0f14640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc1009d0 0x7f9dcc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dd0f14640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc1009d0 0x7f9dcc198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40296/0 (socket says 172.21.15.98:40296) 2024-09-19T07:23:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dd0f14640 1 -- 172.21.15.98:0/2628853750 learned_addr learned my addr 172.21.15.98:0/2628853750 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dcbfff640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dcc101370 0x7f9dcc1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dd1715640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc1069e0 0x7f9dcc19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dd0f14640 1 -- 172.21.15.98:0/2628853750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc1069e0 msgr2=0x7f9dcc19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dd0f14640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc1069e0 0x7f9dcc19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dd0f14640 1 -- 172.21.15.98:0/2628853750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dcc101370 msgr2=0x7f9dcc1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dd0f14640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dcc101370 0x7f9dcc1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dd0f14640 1 -- 172.21.15.98:0/2628853750 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc19d350 con 0x7f9dcc1009d0 2024-09-19T07:23:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dcbfff640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dcc101370 0x7f9dcc1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dd0f14640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc1009d0 0x7f9dcc198360 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009a50 tx=0x7f9db4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dc9ffb640 1 -- 172.21.15.98:0/2628853750 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db403f030 con 0x7f9dcc1009d0 2024-09-19T07:23:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dc9ffb640 1 -- 172.21.15.98:0/2628853750 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9db4003ce0 con 0x7f9dcc1009d0 2024-09-19T07:23:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dd3178640 1 -- 172.21.15.98:0/2628853750 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc19d5e0 con 0x7f9dcc1009d0 2024-09-19T07:23:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.171+0000 7f9dc9ffb640 1 -- 172.21.15.98:0/2628853750 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4035070 con 0x7f9dcc1009d0 2024-09-19T07:23:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.172+0000 7f9dd3178640 1 -- 172.21.15.98:0/2628853750 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc1a4ed0 con 0x7f9dcc1009d0 2024-09-19T07:23:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.174+0000 7f9dc9ffb640 1 -- 172.21.15.98:0/2628853750 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f9db4042030 con 0x7f9dcc1009d0 2024-09-19T07:23:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.174+0000 7f9dd5ff1740 1 Processor -- start 2024-09-19T07:23:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.174+0000 7f9dd5ff1740 1 -- start start 2024-09-19T07:23:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.174+0000 7f9dd5ff1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296479d0 0x564a29647db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.174+0000 7f9dd5ff1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296482f0 0x564a29656b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.174+0000 7f9dd5ff1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a296594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.174+0000 7f9dd5ff1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564a295ac2f0 con 0x564a296570c0 2024-09-19T07:23:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.174+0000 7f9dd5ff1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x564a29554270 con 0x564a296479d0 2024-09-19T07:23:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.174+0000 7f9dd5ff1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564a295a82b0 con 0x564a296482f0 2024-09-19T07:23:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.174+0000 7f9dc9ffb640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9db80a3610 0x7f9db80a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.174+0000 7f9dcbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a296594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dcbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a296594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40312/0 (socket says 172.21.15.98:40312) 2024-09-19T07:23:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dcbfff640 1 -- 172.21.15.98:0/3485379593 learned_addr learned my addr 172.21.15.98:0/3485379593 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dd1715640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9db80a3610 0x7f9db80a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dd0f14640 1 --2- 172.21.15.98:0/3485379593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296482f0 0x564a29656b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dd1715640 1 --2- 172.21.15.98:0/3485379593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296479d0 0x564a29647db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dc9ffb640 1 -- 172.21.15.98:0/2628853750 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f9db40f0650 con 0x7f9dcc1009d0 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dcbfff640 1 -- 172.21.15.98:0/3485379593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296482f0 msgr2=0x564a29656b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dcbfff640 1 --2- 172.21.15.98:0/3485379593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296482f0 0x564a29656b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dcbfff640 1 -- 172.21.15.98:0/3485379593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296479d0 msgr2=0x564a29647db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dcbfff640 1 --2- 172.21.15.98:0/3485379593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296479d0 0x564a29647db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dcbfff640 1 -- 172.21.15.98:0/3485379593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a29553340 con 0x564a296570c0 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dd1715640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9db80a3610 0x7f9db80a5ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400bb40 tx=0x7f9dc400b670 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dcbfff640 1 --2- 172.21.15.98:0/3485379593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a296594b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00af20 tx=0x7f9dbc00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c936c61531355ff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dc2ffd640 1 -- 172.21.15.98:0/3485379593 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc011850 con 0x564a296570c0 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dc2ffd640 1 -- 172.21.15.98:0/3485379593 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dbc01a480 con 0x564a296570c0 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.175+0000 7f9dc2ffd640 1 -- 172.21.15.98:0/3485379593 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc010630 con 0x564a296570c0 2024-09-19T07:23:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.176+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/3485379593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 msgr2=0x564a296594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.176+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/3485379593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a296594b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00af20 tx=0x7f9dbc00f7f0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.176+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/3485379593 shutdown_connections 2024-09-19T07:23:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.176+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/3485379593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a296594b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.176+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/3485379593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296482f0 0x564a29656b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.176+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/3485379593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296479d0 0x564a29647db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.176+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/3485379593 >> 172.21.15.98:0/3485379593 conn(0x564a29644060 msgr2=0x564a29644440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.176+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/3485379593 shutdown_connections 2024-09-19T07:23:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.176+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/3485379593 wait complete. 2024-09-19T07:23:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.176+0000 7f9dd5ff1740 1 -- start start 2024-09-19T07:23:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.176+0000 7f9dd5ff1740 1 Processor -- start 2024-09-19T07:23:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd5ff1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296479d0 0x564a29654010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd5ff1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a29654550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd5ff1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a29654a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd5ff1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564a29659cf0 con 0x564a296570c0 2024-09-19T07:23:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd5ff1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x564a29535290 con 0x564a296482f0 2024-09-19T07:23:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd5ff1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564a29659e70 con 0x564a296479d0 2024-09-19T07:23:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd5ff1740 10 client.0 _ll_register_callbacks cb 0x564a29566140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd1715640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a29654a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd1715640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a29654a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40326/0 (socket says 172.21.15.98:40326) 2024-09-19T07:23:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd1715640 1 -- 172.21.15.98:0/539176509 learned_addr learned my addr 172.21.15.98:0/539176509 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dcbfff640 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a29654550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd0f14640 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296479d0 0x564a29654010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd1715640 1 -- 172.21.15.98:0/539176509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296479d0 msgr2=0x564a29654010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd1715640 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296479d0 0x564a29654010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd1715640 1 -- 172.21.15.98:0/539176509 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 msgr2=0x564a29654550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd1715640 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a29654550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd1715640 1 -- 172.21.15.98:0/539176509 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a292bf210 con 0x564a296570c0 2024-09-19T07:23:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd0f14640 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296479d0 0x564a29654010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dd1715640 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a29654a90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4010860 tx=0x7f9dc4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d086050cdb5fbe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.177+0000 7f9dabfff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dabfff640 1 -- 172.21.15.98:0/539176509 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4023070 con 0x564a296570c0 2024-09-19T07:23:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dabfff640 1 -- 172.21.15.98:0/539176509 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f9dc4004250 con 0x564a296570c0 2024-09-19T07:23:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/539176509 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dbc01a480 con 0x564a296570c0 2024-09-19T07:23:34.190 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dabfff640 1 -- 172.21.15.98:0/539176509 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9dc402e050 con 0x564a296570c0 2024-09-19T07:23:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dd5ff1740 10 client.15717 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/539176509 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564a2938b620 con 0x564a296570c0 2024-09-19T07:23:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dabfff640 1 -- 172.21.15.98:0/539176509 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dbc01a480 con 0x564a296570c0 2024-09-19T07:23:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dabfff640 1 -- 172.21.15.98:0/539176509 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9dc4005490 con 0x564a296570c0 2024-09-19T07:23:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dd5ff1740 10 client.15717 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dd5ff1740 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dd5ff1740 20 client.15717 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x564a29667090 0x564a29669520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dd5ff1740 4 client.15717 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/539176509 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a295b9a20 con 0x564a29667090 2024-09-19T07:23:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.178+0000 7f9dd0f14640 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x564a29667090 0x564a29669520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.179+0000 7f9dabfff640 10 client.15717 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.179+0000 7f9dd0f14640 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x564a29667090 0x564a29669520 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=501f5c2635396dc4 server_cookie=634bcc99fd9da09d in_seq=0 out_seq=0 2024-09-19T07:23:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dabfff640 1 -- 172.21.15.98:0/539176509 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564a295b9a20 con 0x564a29667090 2024-09-19T07:23:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dabfff640 10 client.15717 handle_command_reply: tid=0 2024-09-19T07:23:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dd5ff1740 1 client.15717 shutdown 2024-09-19T07:23:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/539176509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 msgr2=0x564a29654a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a29654a90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4010860 tx=0x7f9dc4018000 comp rx=0 tx=0).stop 2024-09-19T07:23:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/539176509 shutdown_connections 2024-09-19T07:23:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x564a29667090 0x564a29669520 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a29654a90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a29654550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/539176509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296479d0 0x564a29654010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dabfff640 0 client.15717 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/539176509 >> 172.21.15.98:0/539176509 conn(0x564a29644060 msgr2=0x564a29649d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/539176509 shutdown_connections 2024-09-19T07:23:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/539176509 wait complete. 2024-09-19T07:23:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.180+0000 7f9dd5ff1740 20 client.15717 trim_cache size 0 max 16384 2024-09-19T07:23:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.194+0000 7f9dd5ff1740 1 Processor -- start 2024-09-19T07:23:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.194+0000 7f9dd5ff1740 1 -- start start 2024-09-19T07:23:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.194+0000 7f9dd5ff1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296479d0 0x564a2966ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.194+0000 7f9dd5ff1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a2966f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.194+0000 7f9dd5ff1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a29651250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.194+0000 7f9dd5ff1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1ade60 con 0x564a296570c0 2024-09-19T07:23:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.194+0000 7f9dd5ff1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1ab730 con 0x564a296482f0 2024-09-19T07:23:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.194+0000 7f9dd5ff1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1a9580 con 0x564a296479d0 2024-09-19T07:23:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.194+0000 7f9dd1715640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a29651250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.194+0000 7f9dd1715640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a29651250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40342/0 (socket says 172.21.15.98:40342) 2024-09-19T07:23:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.194+0000 7f9dd1715640 1 -- 172.21.15.98:0/482032174 learned_addr learned my addr 172.21.15.98:0/482032174 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.194+0000 7f9dd0f14640 1 --2- 172.21.15.98:0/482032174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296479d0 0x564a2966ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dcbfff640 1 --2- 172.21.15.98:0/482032174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a2966f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dd1715640 1 -- 172.21.15.98:0/482032174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296479d0 msgr2=0x564a2966ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dd1715640 1 --2- 172.21.15.98:0/482032174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296479d0 0x564a2966ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dd1715640 1 -- 172.21.15.98:0/482032174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 msgr2=0x564a2966f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dd1715640 1 --2- 172.21.15.98:0/482032174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a2966f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dd1715640 1 -- 172.21.15.98:0/482032174 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a2964fbb0 con 0x564a296570c0 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dcbfff640 1 --2- 172.21.15.98:0/482032174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a2966f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dd1715640 1 --2- 172.21.15.98:0/482032174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a29651250 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40049e0 tx=0x7f9dc4012e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a5be6dda5f1799 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dc27fc640 1 -- 172.21.15.98:0/482032174 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4037070 con 0x564a296570c0 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dc27fc640 1 -- 172.21.15.98:0/482032174 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dc4004c60 con 0x564a296570c0 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dc27fc640 1 -- 172.21.15.98:0/482032174 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4023070 con 0x564a296570c0 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/482032174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 msgr2=0x564a29651250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.195+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/482032174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a29651250 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40049e0 tx=0x7f9dc4012e80 comp rx=0 tx=0).stop 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/482032174 shutdown_connections 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/482032174 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296570c0 0x564a29651250 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/482032174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a2966f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/482032174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296479d0 0x564a2966ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/482032174 >> 172.21.15.98:0/482032174 conn(0x564a29644060 msgr2=0x564a29656090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/482032174 shutdown_connections 2024-09-19T07:23:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/482032174 wait complete. 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 -- start start 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 Processor -- start 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296479d0 0x564a2965b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a2965ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296570c0 0x564a296d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1a9bf0 con 0x564a296479d0 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1ab060 con 0x564a296482f0 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1aa2c0 con 0x564a296570c0 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd5ff1740 10 client.0 _ll_register_callbacks cb 0x7f9dc400ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd0f14640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296479d0 0x564a2965b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.196+0000 7f9dd0f14640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296479d0 0x564a2965b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40350/0 (socket says 172.21.15.98:40350) 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dd0f14640 1 -- 172.21.15.98:0/1358136681 learned_addr learned my addr 172.21.15.98:0/1358136681 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dd1715640 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296570c0 0x564a296d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dcbfff640 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a2965ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dd0f14640 1 -- 172.21.15.98:0/1358136681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296570c0 msgr2=0x564a296d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dd0f14640 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296570c0 0x564a296d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dd0f14640 1 -- 172.21.15.98:0/1358136681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 msgr2=0x564a2965ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dd0f14640 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a2965ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dd0f14640 1 -- 172.21.15.98:0/1358136681 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a296d1390 con 0x564a296479d0 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dd0f14640 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296479d0 0x564a2965b4c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009900 tx=0x7f9db40b8280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da85c17a9caf4f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dabfff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dabfff640 1 -- 172.21.15.98:0/1358136681 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4049040 con 0x564a296479d0 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dabfff640 1 -- 172.21.15.98:0/1358136681 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f9db40b8d30 con 0x564a296479d0 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/1358136681 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dc4004c60 con 0x564a296479d0 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dabfff640 1 -- 172.21.15.98:0/1358136681 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9db40c0a70 con 0x564a296479d0 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dd5ff1740 10 client.15723 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/1358136681 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564a296d25e0 con 0x564a296479d0 2024-09-19T07:23:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.197+0000 7f9dabfff640 1 -- 172.21.15.98:0/1358136681 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dc4004c60 con 0x564a296479d0 2024-09-19T07:23:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.198+0000 7f9dabfff640 1 -- 172.21.15.98:0/1358136681 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9db40d0be0 con 0x564a296479d0 2024-09-19T07:23:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.198+0000 7f9dd5ff1740 10 client.15723 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.198+0000 7f9dd5ff1740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.198+0000 7f9dd5ff1740 20 client.15723 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.198+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x564a296d2d50 0x564a296d5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.198+0000 7f9dd5ff1740 4 client.15723 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:23:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.198+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/1358136681 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564a295b3d70 con 0x564a296d2d50 2024-09-19T07:23:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.198+0000 7f9dcbfff640 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x564a296d2d50 0x564a296d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.198+0000 7f9dabfff640 10 client.15723 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.198+0000 7f9dcbfff640 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x564a296d2d50 0x564a296d5140 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4027aa20d787174c server_cookie=17a06c926beeb3bc in_seq=0 out_seq=0 2024-09-19T07:23:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.204+0000 7f9dabfff640 1 -- 172.21.15.98:0/1358136681 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564a295b3d70 con 0x564a296d2d50 2024-09-19T07:23:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.204+0000 7f9dabfff640 10 client.15723 handle_command_reply: tid=0 2024-09-19T07:23:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.204+0000 7f9dd5ff1740 1 client.15723 shutdown 2024-09-19T07:23:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.204+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/1358136681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296479d0 msgr2=0x564a2965b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.204+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296479d0 0x564a2965b4c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009900 tx=0x7f9db40b8280 comp rx=0 tx=0).stop 2024-09-19T07:23:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.204+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/1358136681 shutdown_connections 2024-09-19T07:23:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.204+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564a296570c0 0x564a296d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.204+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a296482f0 0x564a2965ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.204+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x564a296d2d50 0x564a296d5140 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.204+0000 7f9dd5ff1740 1 --2- 172.21.15.98:0/1358136681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564a296479d0 0x564a2965b4c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.204+0000 7f9dabfff640 0 client.15723 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.204+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/1358136681 >> 172.21.15.98:0/1358136681 conn(0x564a29644060 msgr2=0x564a29656090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/1358136681 shutdown_connections 2024-09-19T07:23:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd5ff1740 1 -- 172.21.15.98:0/1358136681 wait complete. 2024-09-19T07:23:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd5ff1740 20 client.15723 trim_cache size 0 max 16384 2024-09-19T07:23:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:23:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:23:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:23:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:23:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd3178640 1 -- 172.21.15.98:0/2628853750 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9db80a3610 msgr2=0x7f9db80a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd3178640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9db80a3610 0x7f9db80a5ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400bb40 tx=0x7f9dc400b670 comp rx=0 tx=0).stop 2024-09-19T07:23:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd3178640 1 -- 172.21.15.98:0/2628853750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc1009d0 msgr2=0x7f9dcc198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd3178640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc1009d0 0x7f9dcc198360 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9db4009a50 tx=0x7f9db4004270 comp rx=0 tx=0).stop 2024-09-19T07:23:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd3178640 1 -- 172.21.15.98:0/2628853750 shutdown_connections 2024-09-19T07:23:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd3178640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9db80a3610 0x7f9db80a5ad0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd3178640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dcc1069e0 0x7f9dcc19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd3178640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9dcc101370 0x7f9dcc1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd3178640 1 --2- 172.21.15.98:0/2628853750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dcc1009d0 0x7f9dcc198360 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd3178640 1 -- 172.21.15.98:0/2628853750 >> 172.21.15.98:0/2628853750 conn(0x7f9dcc0fc6f0 msgr2=0x7f9dcc0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd3178640 1 -- 172.21.15.98:0/2628853750 shutdown_connections 2024-09-19T07:23:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:34.205+0000 7f9dd3178640 1 -- 172.21.15.98:0/2628853750 wait complete. 2024-09-19T07:23:34.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:33 smithi098 ceph-mon[30950]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T07:23:34.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:33 smithi139 ceph-mon[35039]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T07:23:36.002 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:23:36.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:35 smithi162 ceph-mon[35726]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-19T07:23:36.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:35 smithi162 ceph-mon[35726]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-19T07:23:36.270 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:36.272 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:35 smithi098 ceph-mon[30950]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-19T07:23:36.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:35 smithi098 ceph-mon[30950]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-19T07:23:36.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:35 smithi139 ceph-mon[35039]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-19T07:23:36.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:35 smithi139 ceph-mon[35039]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-19T07:23:36.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.789+0000 7fdb1fee3640 1 -- 172.21.15.98:0/73322225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb18102570 msgr2=0x7fdb181029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.789+0000 7fdb1fee3640 1 --2- 172.21.15.98:0/73322225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb18102570 0x7fdb181029b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009980 tx=0x7fdb1402c6b0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.789+0000 7fdb1fee3640 1 -- 172.21.15.98:0/73322225 shutdown_connections 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.789+0000 7fdb1fee3640 1 --2- 172.21.15.98:0/73322225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb18102ef0 0x7fdb1810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.789+0000 7fdb1fee3640 1 --2- 172.21.15.98:0/73322225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb18102570 0x7fdb181029b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.789+0000 7fdb1fee3640 1 --2- 172.21.15.98:0/73322225 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb18100e20 0x7fdb18101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.789+0000 7fdb1fee3640 1 -- 172.21.15.98:0/73322225 >> 172.21.15.98:0/73322225 conn(0x7fdb180fc7d0 msgr2=0x7fdb180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.789+0000 7fdb1fee3640 1 -- 172.21.15.98:0/73322225 shutdown_connections 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.789+0000 7fdb1fee3640 1 -- 172.21.15.98:0/73322225 wait complete. 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1fee3640 1 Processor -- start 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1fee3640 1 -- start start 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1fee3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb18100e20 0x7fdb1819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1fee3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb18102570 0x7fdb1819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1fee3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb18102ef0 0x7fdb1819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1fee3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdb18114250 con 0x7fdb18102570 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1fee3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdb181140d0 con 0x7fdb18100e20 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1fee3640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb181143d0 con 0x7fdb18102ef0 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1d47e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb18102570 0x7fdb1819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1d47e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb18102570 0x7fdb1819ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40360/0 (socket says 172.21.15.98:40360) 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1d47e640 1 -- 172.21.15.98:0/1861239574 learned_addr learned my addr 172.21.15.98:0/1861239574 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1dc7f640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb18100e20 0x7fdb1819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1d47e640 1 -- 172.21.15.98:0/1861239574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb18102ef0 msgr2=0x7fdb1819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1e480640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb18102ef0 0x7fdb1819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb18102ef0 0x7fdb1819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1d47e640 1 -- 172.21.15.98:0/1861239574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb18100e20 msgr2=0x7fdb1819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.790+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb18100e20 0x7fdb1819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.791+0000 7fdb1d47e640 1 -- 172.21.15.98:0/1861239574 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1819f6e0 con 0x7fdb18102570 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.791+0000 7fdb1e480640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb18102ef0 0x7fdb1819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.791+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb18102570 0x7fdb1819ac70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdb14006010 tx=0x7fdb14003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.791+0000 7fdb0effd640 1 -- 172.21.15.98:0/1861239574 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14040070 con 0x7fdb18102570 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.791+0000 7fdb1fee3640 1 -- 172.21.15.98:0/1861239574 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1819f970 con 0x7fdb18102570 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.791+0000 7fdb0effd640 1 -- 172.21.15.98:0/1861239574 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb14033c30 con 0x7fdb18102570 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.791+0000 7fdb1fee3640 1 -- 172.21.15.98:0/1861239574 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb181a72b0 con 0x7fdb18102570 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.792+0000 7fdb0effd640 1 -- 172.21.15.98:0/1861239574 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14049060 con 0x7fdb18102570 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.794+0000 7fdb222bc740 1 Processor -- start 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.794+0000 7fdb222bc740 1 -- start start 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.794+0000 7fdb222bc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609ca974a0 0x55609ca97880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.794+0000 7fdb222bc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca97dc0 0x55609caa2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.794+0000 7fdb222bc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609caa2680 0x55609caa4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.794+0000 7fdb222bc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55609c9fd2e0 con 0x55609caa2680 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.794+0000 7fdb222bc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55609c9a4ce0 con 0x55609ca97dc0 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.794+0000 7fdb222bc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55609c9f92a0 con 0x55609ca974a0 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.794+0000 7fdb1e480640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609ca974a0 0x55609ca97880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.794+0000 7fdb0effd640 1 -- 172.21.15.98:0/1861239574 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fdb1403c440 con 0x7fdb18102570 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1e480640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609ca974a0 0x55609ca97880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:57216/0 (socket says 172.21.15.98:57216) 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1e480640 1 -- 172.21.15.98:0/42806684 learned_addr learned my addr 172.21.15.98:0/42806684 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1dc7f640 1 --2- 172.21.15.98:0/42806684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca97dc0 0x55609caa2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/42806684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609caa2680 0x55609caa4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1e480640 1 -- 172.21.15.98:0/42806684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca97dc0 msgr2=0x55609caa2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1e480640 1 --2- 172.21.15.98:0/42806684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca97dc0 0x55609caa2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1e480640 1 -- 172.21.15.98:0/42806684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609caa2680 msgr2=0x55609caa4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1e480640 1 --2- 172.21.15.98:0/42806684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609caa2680 0x55609caa4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1e480640 1 -- 172.21.15.98:0/42806684 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55609c989440 con 0x55609ca974a0 2024-09-19T07:23:36.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1dc7f640 1 --2- 172.21.15.98:0/42806684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca97dc0 0x55609caa2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/42806684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609caa2680 0x55609caa4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1e480640 1 --2- 172.21.15.98:0/42806684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609ca974a0 0x55609ca97880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009ea0 tx=0x7fdb10009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78479abae8e22ead server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb0effd640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdb040a33b0 0x7fdb040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb03fff640 1 -- 172.21.15.98:0/42806684 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10004d20 con 0x55609ca974a0 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.795+0000 7fdb1dc7f640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdb040a33b0 0x7fdb040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.796+0000 7fdb03fff640 1 -- 172.21.15.98:0/42806684 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb10005500 con 0x55609ca974a0 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.796+0000 7fdb03fff640 1 -- 172.21.15.98:0/42806684 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011880 con 0x55609ca974a0 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.796+0000 7fdb0effd640 1 -- 172.21.15.98:0/1861239574 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fdb140f0700 con 0x7fdb18102570 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.797+0000 7fdb222bc740 1 -- 172.21.15.98:0/42806684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609ca974a0 msgr2=0x55609ca97880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.797+0000 7fdb1dc7f640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdb040a33b0 0x7fdb040a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55609ca94890 tx=0x7fdb0800c330 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.797+0000 7fdb222bc740 1 --2- 172.21.15.98:0/42806684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609ca974a0 0x55609ca97880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009ea0 tx=0x7fdb10009f90 comp rx=0 tx=0).stop 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.797+0000 7fdb222bc740 1 -- 172.21.15.98:0/42806684 shutdown_connections 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.797+0000 7fdb222bc740 1 --2- 172.21.15.98:0/42806684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609caa2680 0x55609caa4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.797+0000 7fdb222bc740 1 --2- 172.21.15.98:0/42806684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca97dc0 0x55609caa2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.797+0000 7fdb222bc740 1 --2- 172.21.15.98:0/42806684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609ca974a0 0x55609ca97880 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.797+0000 7fdb222bc740 1 -- 172.21.15.98:0/42806684 >> 172.21.15.98:0/42806684 conn(0x55609ca93a30 msgr2=0x55609ca93e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:36.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.797+0000 7fdb222bc740 1 -- 172.21.15.98:0/42806684 shutdown_connections 2024-09-19T07:23:36.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.797+0000 7fdb222bc740 1 -- 172.21.15.98:0/42806684 wait complete. 2024-09-19T07:23:36.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.797+0000 7fdb222bc740 1 -- start start 2024-09-19T07:23:36.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.797+0000 7fdb222bc740 1 Processor -- start 2024-09-19T07:23:36.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb222bc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609ca974a0 0x55609caa1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb222bc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 0x55609ca9f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb222bc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609caa2680 0x55609ca9f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb222bc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55609caa5250 con 0x55609ca97dc0 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb222bc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55609c9b8050 con 0x55609caa2680 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb222bc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55609caa53d0 con 0x55609ca974a0 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb222bc740 10 client.0 _ll_register_callbacks cb 0x55609c9f8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb1d47e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 0x55609ca9f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb1e480640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609caa2680 0x55609ca9f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb1d47e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 0x55609ca9f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40382/0 (socket says 172.21.15.98:40382) 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb1d47e640 1 -- 172.21.15.98:0/929971637 learned_addr learned my addr 172.21.15.98:0/929971637 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb1dc7f640 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609ca974a0 0x55609caa1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb1d47e640 1 -- 172.21.15.98:0/929971637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609ca974a0 msgr2=0x55609caa1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609ca974a0 0x55609caa1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb1d47e640 1 -- 172.21.15.98:0/929971637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609caa2680 msgr2=0x55609ca9f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609caa2680 0x55609ca9f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb1d47e640 1 -- 172.21.15.98:0/929971637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55609c76e3c0 con 0x55609ca97dc0 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb1e480640 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609caa2680 0x55609ca9f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 0x55609ca9f230 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdb14000c00 tx=0x7fdb1403c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f902439a23eeb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.798+0000 7fdb017fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb017fa640 1 -- 172.21.15.98:0/929971637 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14037070 con 0x55609ca97dc0 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb017fa640 1 -- 172.21.15.98:0/929971637 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fdb140b9020 con 0x55609ca97dc0 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb222bc740 1 -- 172.21.15.98:0/929971637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb10005500 con 0x55609ca97dc0 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb017fa640 1 -- 172.21.15.98:0/929971637 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdb140bc4f0 con 0x55609ca97dc0 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb222bc740 10 client.15735 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb222bc740 1 -- 172.21.15.98:0/929971637 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55609cab0bc0 con 0x55609ca97dc0 2024-09-19T07:23:36.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb017fa640 1 -- 172.21.15.98:0/929971637 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb10005500 con 0x55609ca97dc0 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb017fa640 1 -- 172.21.15.98:0/929971637 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdb140bdce0 con 0x55609ca97dc0 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb222bc740 10 client.15735 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb222bc740 10 client.15735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb222bc740 20 client.15735 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb222bc740 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55609cab1fb0 0x55609cab43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb222bc740 4 client.15735 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.799+0000 7fdb222bc740 1 -- 172.21.15.98:0/929971637 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55609ca0a850 con 0x55609cab1fb0 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.800+0000 7fdb1dc7f640 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55609cab1fb0 0x55609cab43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.800+0000 7fdb017fa640 10 client.15735 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.800+0000 7fdb1dc7f640 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55609cab1fb0 0x55609cab43a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2de0312cfc26128 server_cookie=1ede054b08e38ba4 in_seq=0 out_seq=0 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb017fa640 1 -- 172.21.15.98:0/929971637 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55609ca0a850 con 0x55609cab1fb0 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb017fa640 10 client.15735 handle_command_reply: tid=0 2024-09-19T07:23:36.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb222bc740 1 client.15735 shutdown 2024-09-19T07:23:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb222bc740 1 -- 172.21.15.98:0/929971637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 msgr2=0x55609ca9f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb222bc740 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 0x55609ca9f230 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdb14000c00 tx=0x7fdb1403c770 comp rx=0 tx=0).stop 2024-09-19T07:23:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb222bc740 1 -- 172.21.15.98:0/929971637 shutdown_connections 2024-09-19T07:23:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb222bc740 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609caa2680 0x55609ca9f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb222bc740 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55609cab1fb0 0x55609cab43a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb222bc740 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 0x55609ca9f230 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb222bc740 1 --2- 172.21.15.98:0/929971637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609ca974a0 0x55609caa1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb222bc740 1 -- 172.21.15.98:0/929971637 >> 172.21.15.98:0/929971637 conn(0x55609ca93a30 msgr2=0x55609ca99710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb017fa640 0 client.15735 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb222bc740 1 -- 172.21.15.98:0/929971637 shutdown_connections 2024-09-19T07:23:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb222bc740 1 -- 172.21.15.98:0/929971637 wait complete. 2024-09-19T07:23:36.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.801+0000 7fdb222bc740 20 client.15735 trim_cache size 0 max 16384 2024-09-19T07:23:36.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb222bc740 1 Processor -- start 2024-09-19T07:23:36.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb222bc740 1 -- start start 2024-09-19T07:23:36.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb222bc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca974a0 0x55609caae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb222bc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 0x55609cab3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb222bc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609caa2680 0x55609ca9a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.819 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb222bc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdb181b2380 con 0x55609ca97dc0 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb222bc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdb181afc50 con 0x55609ca974a0 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb222bc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb181adaa0 con 0x55609caa2680 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb1d47e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 0x55609cab3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb1d47e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 0x55609cab3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40398/0 (socket says 172.21.15.98:40398) 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb1d47e640 1 -- 172.21.15.98:0/2754311523 learned_addr learned my addr 172.21.15.98:0/2754311523 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb1dc7f640 1 --2- 172.21.15.98:0/2754311523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca974a0 0x55609caae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.818+0000 7fdb1e480640 1 --2- 172.21.15.98:0/2754311523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609caa2680 0x55609ca9a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.819+0000 7fdb1d47e640 1 -- 172.21.15.98:0/2754311523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609caa2680 msgr2=0x55609ca9a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.819+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/2754311523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609caa2680 0x55609ca9a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.819+0000 7fdb1d47e640 1 -- 172.21.15.98:0/2754311523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca974a0 msgr2=0x55609caae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.819+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/2754311523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca974a0 0x55609caae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.819+0000 7fdb1d47e640 1 -- 172.21.15.98:0/2754311523 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55609ca9e1e0 con 0x55609ca97dc0 2024-09-19T07:23:36.820 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.819+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/2754311523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 0x55609cab3fc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdb14005940 tx=0x7fdb14009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5492538b56bcd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:36.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.819+0000 7fdb037fe640 1 -- 172.21.15.98:0/2754311523 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14037070 con 0x55609ca97dc0 2024-09-19T07:23:36.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.819+0000 7fdb037fe640 1 -- 172.21.15.98:0/2754311523 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb140c5400 con 0x55609ca97dc0 2024-09-19T07:23:36.821 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.819+0000 7fdb037fe640 1 -- 172.21.15.98:0/2754311523 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb140bc310 con 0x55609ca97dc0 2024-09-19T07:23:36.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.820+0000 7fdb222bc740 1 -- 172.21.15.98:0/2754311523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 msgr2=0x55609cab3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.820+0000 7fdb222bc740 1 --2- 172.21.15.98:0/2754311523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 0x55609cab3fc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdb14005940 tx=0x7fdb14009680 comp rx=0 tx=0).stop 2024-09-19T07:23:36.825 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.820+0000 7fdb222bc740 1 -- 172.21.15.98:0/2754311523 shutdown_connections 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.820+0000 7fdb222bc740 1 --2- 172.21.15.98:0/2754311523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609caa2680 0x55609ca9a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.820+0000 7fdb222bc740 1 --2- 172.21.15.98:0/2754311523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca97dc0 0x55609cab3fc0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.820+0000 7fdb222bc740 1 --2- 172.21.15.98:0/2754311523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca974a0 0x55609caae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.820+0000 7fdb222bc740 1 -- 172.21.15.98:0/2754311523 >> 172.21.15.98:0/2754311523 conn(0x55609ca93a30 msgr2=0x55609ca9a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.820+0000 7fdb222bc740 1 -- 172.21.15.98:0/2754311523 shutdown_connections 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.820+0000 7fdb222bc740 1 -- 172.21.15.98:0/2754311523 wait complete. 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.820+0000 7fdb222bc740 1 -- start start 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.820+0000 7fdb222bc740 1 Processor -- start 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb222bc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca974a0 0x55609caaaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb222bc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca97dc0 0x55609caa5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb222bc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609caa2680 0x55609caa6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb222bc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdb181ae110 con 0x55609ca974a0 2024-09-19T07:23:36.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb222bc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdb181af580 con 0x55609ca97dc0 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb222bc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb181ae7e0 con 0x55609caa2680 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb222bc740 10 client.0 _ll_register_callbacks cb 0x7fdb14005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1dc7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca974a0 0x55609caaaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1dc7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca974a0 0x55609caaaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40410/0 (socket says 172.21.15.98:40410) 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1dc7f640 1 -- 172.21.15.98:0/393919714 learned_addr learned my addr 172.21.15.98:0/393919714 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca97dc0 0x55609caa5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1dc7f640 1 -- 172.21.15.98:0/393919714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609caa2680 msgr2=0x55609caa6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1e480640 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609caa2680 0x55609caa6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1dc7f640 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609caa2680 0x55609caa6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1dc7f640 1 -- 172.21.15.98:0/393919714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca97dc0 msgr2=0x55609caa5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1dc7f640 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca97dc0 0x55609caa5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1dc7f640 1 -- 172.21.15.98:0/393919714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55609caa22f0 con 0x55609ca974a0 2024-09-19T07:23:36.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca97dc0 0x55609caa5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1e480640 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609caa2680 0x55609caa6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb1dc7f640 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca974a0 0x55609caaaa70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdb080058c0 tx=0x7fdb08013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753a0e389810c652 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb017fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb017fa640 1 -- 172.21.15.98:0/393919714 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb08004220 con 0x55609ca974a0 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb017fa640 1 -- 172.21.15.98:0/393919714 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fdb080043c0 con 0x55609ca974a0 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.821+0000 7fdb222bc740 1 -- 172.21.15.98:0/393919714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55609ca04d60 con 0x55609ca974a0 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.822+0000 7fdb017fa640 1 -- 172.21.15.98:0/393919714 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdb08020940 con 0x55609ca974a0 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.822+0000 7fdb222bc740 10 client.15741 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.822+0000 7fdb222bc740 1 -- 172.21.15.98:0/393919714 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55609cb1c7a0 con 0x55609ca974a0 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.822+0000 7fdb017fa640 1 -- 172.21.15.98:0/393919714 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55609ca04d60 con 0x55609ca974a0 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.822+0000 7fdb017fa640 1 -- 172.21.15.98:0/393919714 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fdb08003ca0 con 0x55609ca974a0 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.822+0000 7fdb222bc740 10 client.15741 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:36.828 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.822+0000 7fdb222bc740 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.822+0000 7fdb222bc740 20 client.15741 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.822+0000 7fdb222bc740 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55609cb1cf20 0x55609cb1f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.822+0000 7fdb222bc740 4 client.15741 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.822+0000 7fdb222bc740 1 -- 172.21.15.98:0/393919714 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55609c981210 con 0x55609cb1cf20 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.822+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55609cb1cf20 0x55609cb1f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb1d47e640 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55609cb1cf20 0x55609cb1f340 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cbb775b7c461b23 server_cookie=76685c7c217ff18b in_seq=0 out_seq=0 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb017fa640 10 client.15741 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb017fa640 1 -- 172.21.15.98:0/393919714 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55609c981210 con 0x55609cb1cf20 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb017fa640 10 client.15741 handle_command_reply: tid=0 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb222bc740 1 client.15741 shutdown 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb222bc740 1 -- 172.21.15.98:0/393919714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca974a0 msgr2=0x55609caaaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb222bc740 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca974a0 0x55609caaaa70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fdb080058c0 tx=0x7fdb08013000 comp rx=0 tx=0).stop 2024-09-19T07:23:36.829 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb222bc740 1 -- 172.21.15.98:0/393919714 shutdown_connections 2024-09-19T07:23:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb222bc740 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55609caa2680 0x55609caa6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb222bc740 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55609ca97dc0 0x55609caa5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb222bc740 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55609cb1cf20 0x55609cb1f340 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb222bc740 1 --2- 172.21.15.98:0/393919714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55609ca974a0 0x55609caaaa70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb017fa640 0 client.15741 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb222bc740 1 -- 172.21.15.98:0/393919714 >> 172.21.15.98:0/393919714 conn(0x55609ca93a30 msgr2=0x55609caa12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb222bc740 1 -- 172.21.15.98:0/393919714 shutdown_connections 2024-09-19T07:23:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.823+0000 7fdb222bc740 1 -- 172.21.15.98:0/393919714 wait complete. 2024-09-19T07:23:36.830 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb222bc740 20 client.15741 trim_cache size 0 max 16384 2024-09-19T07:23:36.830 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:23:36.831 INFO:teuthology.orchestra.run.smithi098.stdout: "status": "no active scrubs running", 2024-09-19T07:23:36.831 INFO:teuthology.orchestra.run.smithi098.stdout: "scrubs": {} 2024-09-19T07:23:36.831 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:23:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb1fee3640 1 -- 172.21.15.98:0/1861239574 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdb040a33b0 msgr2=0x7fdb040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb1fee3640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdb040a33b0 0x7fdb040a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55609ca94890 tx=0x7fdb0800c330 comp rx=0 tx=0).stop 2024-09-19T07:23:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb1fee3640 1 -- 172.21.15.98:0/1861239574 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb18102570 msgr2=0x7fdb1819ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb1fee3640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb18102570 0x7fdb1819ac70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fdb14006010 tx=0x7fdb14003c10 comp rx=0 tx=0).stop 2024-09-19T07:23:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb1fee3640 1 -- 172.21.15.98:0/1861239574 shutdown_connections 2024-09-19T07:23:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb1fee3640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdb040a33b0 0x7fdb040a5870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb1fee3640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb18102ef0 0x7fdb1819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb1fee3640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdb18102570 0x7fdb1819ac70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb1fee3640 1 --2- 172.21.15.98:0/1861239574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb18100e20 0x7fdb1819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb1fee3640 1 -- 172.21.15.98:0/1861239574 >> 172.21.15.98:0/1861239574 conn(0x7fdb180fc7d0 msgr2=0x7fdb180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb1fee3640 1 -- 172.21.15.98:0/1861239574 shutdown_connections 2024-09-19T07:23:36.832 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:36.824+0000 7fdb1fee3640 1 -- 172.21.15.98:0/1861239574 wait complete. 2024-09-19T07:23:37.553 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:23:37.553 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:23:37.800 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:38.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:37 smithi162 ceph-mon[35726]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T07:23:38.231 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:37 smithi098 ceph-mon[30950]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T07:23:38.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:37 smithi139 ceph-mon[35039]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T07:23:38.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.310+0000 7fd128272640 1 -- 172.21.15.98:0/4258784938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd120102790 msgr2=0x7fd1201067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:38.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.310+0000 7fd128272640 1 --2- 172.21.15.98:0/4258784938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd120102790 0x7fd1201067e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd114009900 tx=0x7fd11402a410 comp rx=0 tx=0).stop 2024-09-19T07:23:38.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.310+0000 7fd128272640 1 -- 172.21.15.98:0/4258784938 shutdown_connections 2024-09-19T07:23:38.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.310+0000 7fd128272640 1 --2- 172.21.15.98:0/4258784938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd120106f10 0x7fd12010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:38.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.310+0000 7fd128272640 1 --2- 172.21.15.98:0/4258784938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd120102790 0x7fd1201067e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:38.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.310+0000 7fd128272640 1 --2- 172.21.15.98:0/4258784938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd120101de0 0x7fd1201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:38.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.310+0000 7fd128272640 1 -- 172.21.15.98:0/4258784938 >> 172.21.15.98:0/4258784938 conn(0x7fd1200fd8c0 msgr2=0x7fd1200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:38.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.310+0000 7fd128272640 1 -- 172.21.15.98:0/4258784938 shutdown_connections 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.310+0000 7fd128272640 1 -- 172.21.15.98:0/4258784938 wait complete. 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd128272640 1 Processor -- start 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd128272640 1 -- start start 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd128272640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd120101de0 0x7fd120198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd128272640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd120102790 0x7fd120198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd128272640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd120106f10 0x7fd12019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd128272640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd120111f70 con 0x7fd120101de0 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd128272640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd120111df0 con 0x7fd120102790 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd128272640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd1201120f0 con 0x7fd120106f10 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12600e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd120101de0 0x7fd120198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12600e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd120101de0 0x7fd120198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40432/0 (socket says 172.21.15.98:40432) 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12600e640 1 -- 172.21.15.98:0/460470573 learned_addr learned my addr 172.21.15.98:0/460470573 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:38.323 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12680f640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd120106f10 0x7fd12019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12600e640 1 -- 172.21.15.98:0/460470573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd120106f10 msgr2=0x7fd12019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12580d640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd120102790 0x7fd120198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12600e640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd120106f10 0x7fd12019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12600e640 1 -- 172.21.15.98:0/460470573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd120102790 msgr2=0x7fd120198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12600e640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd120102790 0x7fd120198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12600e640 1 -- 172.21.15.98:0/460470573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12019d3c0 con 0x7fd120101de0 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12680f640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd120106f10 0x7fd12019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12580d640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd120102790 0x7fd120198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.311+0000 7fd12600e640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd120101de0 0x7fd120198410 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd11800d950 tx=0x7fd11800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.312+0000 7fd11f7fe640 1 -- 172.21.15.98:0/460470573 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd118017070 con 0x7fd120101de0 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.312+0000 7fd11f7fe640 1 -- 172.21.15.98:0/460470573 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd118009c30 con 0x7fd120101de0 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.312+0000 7fd128272640 1 -- 172.21.15.98:0/460470573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd12019d6b0 con 0x7fd120101de0 2024-09-19T07:23:38.324 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.312+0000 7fd11f7fe640 1 -- 172.21.15.98:0/460470573 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11800f6b0 con 0x7fd120101de0 2024-09-19T07:23:38.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.312+0000 7fd128272640 1 -- 172.21.15.98:0/460470573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1201a4f90 con 0x7fd120101de0 2024-09-19T07:23:38.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.313+0000 7fd128272640 1 -- 172.21.15.98:0/460470573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1201021c0 con 0x7fd120101de0 2024-09-19T07:23:38.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.314+0000 7fd11f7fe640 1 -- 172.21.15.98:0/460470573 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd1180109d0 con 0x7fd120101de0 2024-09-19T07:23:38.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.314+0000 7fd11f7fe640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd1080a33b0 0x7fd1080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:38.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.314+0000 7fd11f7fe640 1 -- 172.21.15.98:0/460470573 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fd1180cfaf0 con 0x7fd120101de0 2024-09-19T07:23:38.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.314+0000 7fd12580d640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd1080a33b0 0x7fd1080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:38.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.315+0000 7fd12580d640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd1080a33b0 0x7fd1080a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd114000c00 tx=0x7fd114032c70 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:38.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.318+0000 7fd11f7fe640 1 -- 172.21.15.98:0/460470573 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd118009de0 con 0x7fd120101de0 2024-09-19T07:23:38.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.519+0000 7fd128272640 1 -- 172.21.15.98:0/460470573 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd120199770 con 0x7fd120101de0 2024-09-19T07:23:38.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.520+0000 7fd11f7fe640 1 -- 172.21.15.98:0/460470573 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7fd11809c440 con 0x7fd120101de0 2024-09-19T07:23:38.520 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:23:38.520 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:23:38.521 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:23:38.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.522+0000 7fd128272640 1 -- 172.21.15.98:0/460470573 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd1080a33b0 msgr2=0x7fd1080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:38.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.522+0000 7fd128272640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd1080a33b0 0x7fd1080a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd114000c00 tx=0x7fd114032c70 comp rx=0 tx=0).stop 2024-09-19T07:23:38.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.522+0000 7fd128272640 1 -- 172.21.15.98:0/460470573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd120101de0 msgr2=0x7fd120198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:38.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.522+0000 7fd128272640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd120101de0 0x7fd120198410 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd11800d950 tx=0x7fd11800de10 comp rx=0 tx=0).stop 2024-09-19T07:23:38.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.522+0000 7fd128272640 1 -- 172.21.15.98:0/460470573 shutdown_connections 2024-09-19T07:23:38.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.522+0000 7fd128272640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd1080a33b0 0x7fd1080a5870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:38.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.522+0000 7fd128272640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd120106f10 0x7fd12019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:38.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.522+0000 7fd128272640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd120102790 0x7fd120198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:38.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.522+0000 7fd128272640 1 --2- 172.21.15.98:0/460470573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd120101de0 0x7fd120198410 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:38.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.522+0000 7fd128272640 1 -- 172.21.15.98:0/460470573 >> 172.21.15.98:0/460470573 conn(0x7fd1200fd8c0 msgr2=0x7fd1200fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:38.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.522+0000 7fd128272640 1 -- 172.21.15.98:0/460470573 shutdown_connections 2024-09-19T07:23:38.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:38.522+0000 7fd128272640 1 -- 172.21.15.98:0/460470573 wait complete. 2024-09-19T07:23:39.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:38 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/460470573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:39.218 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:38 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/460470573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:39.247 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:23:39.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:38 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/460470573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:39.494 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.953+0000 7faa9bd6f640 1 -- 172.21.15.98:0/4235891160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa94102790 msgr2=0x7faa941067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.953+0000 7faa9bd6f640 1 --2- 172.21.15.98:0/4235891160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa94102790 0x7faa941067e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7faa84009900 tx=0x7faa8402a410 comp rx=0 tx=0).stop 2024-09-19T07:23:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.953+0000 7faa9bd6f640 1 -- 172.21.15.98:0/4235891160 shutdown_connections 2024-09-19T07:23:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.953+0000 7faa9bd6f640 1 --2- 172.21.15.98:0/4235891160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa94106f10 0x7faa9410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.953+0000 7faa9bd6f640 1 --2- 172.21.15.98:0/4235891160 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa94102790 0x7faa941067e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.953+0000 7faa9bd6f640 1 --2- 172.21.15.98:0/4235891160 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa94101de0 0x7faa941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.953+0000 7faa9bd6f640 1 -- 172.21.15.98:0/4235891160 >> 172.21.15.98:0/4235891160 conn(0x7faa940fd8c0 msgr2=0x7faa940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.953+0000 7faa9bd6f640 1 -- 172.21.15.98:0/4235891160 shutdown_connections 2024-09-19T07:23:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.953+0000 7faa9bd6f640 1 -- 172.21.15.98:0/4235891160 wait complete. 2024-09-19T07:23:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.954+0000 7faa9bd6f640 1 Processor -- start 2024-09-19T07:23:39.990 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.954+0000 7faa9bd6f640 1 -- start start 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.954+0000 7faa9bd6f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa94101de0 0x7faa940744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.954+0000 7faa9bd6f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa94102790 0x7faa94074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.954+0000 7faa9bd6f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa94106f10 0x7faa94074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.954+0000 7faa9bd6f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa94111f70 con 0x7faa94102790 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.954+0000 7faa9bd6f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa94111df0 con 0x7faa94101de0 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.954+0000 7faa9bd6f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa941120f0 con 0x7faa94106f10 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.954+0000 7faa9930a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa94102790 0x7faa94074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.954+0000 7faa9930a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa94102790 0x7faa94074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40446/0 (socket says 172.21.15.98:40446) 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.954+0000 7faa9930a640 1 -- 172.21.15.98:0/908889175 learned_addr learned my addr 172.21.15.98:0/908889175 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.954+0000 7faa99b0b640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa94101de0 0x7faa940744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.955+0000 7faa9a30c640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa94106f10 0x7faa94074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.955+0000 7faa9930a640 1 -- 172.21.15.98:0/908889175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa94106f10 msgr2=0x7faa94074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:39.991 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.955+0000 7faa9930a640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa94106f10 0x7faa94074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.955+0000 7faa9930a640 1 -- 172.21.15.98:0/908889175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa94101de0 msgr2=0x7faa940744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.955+0000 7faa9930a640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa94101de0 0x7faa940744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.955+0000 7faa9930a640 1 -- 172.21.15.98:0/908889175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa941a6990 con 0x7faa94102790 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.955+0000 7faa9930a640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa94102790 0x7faa94074a30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faa84006010 tx=0x7faa840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.955+0000 7faa8affd640 1 -- 172.21.15.98:0/908889175 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8403f030 con 0x7faa94102790 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.955+0000 7faa8affd640 1 -- 172.21.15.98:0/908889175 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa84003ce0 con 0x7faa94102790 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.955+0000 7faa9bd6f640 1 -- 172.21.15.98:0/908889175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa941a6c20 con 0x7faa94102790 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.955+0000 7faa8affd640 1 -- 172.21.15.98:0/908889175 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84035070 con 0x7faa94102790 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.955+0000 7faa9bd6f640 1 -- 172.21.15.98:0/908889175 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa941a7100 con 0x7faa94102790 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.957+0000 7faa8affd640 1 -- 172.21.15.98:0/908889175 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7faa84042030 con 0x7faa94102790 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9e148740 1 Processor -- start 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9e148740 1 -- start start 2024-09-19T07:23:39.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9e148740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9e148740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321e35d0 0x55e0321e3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9e148740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321ee370 0x55e0321f0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9e148740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e0321492f0 con 0x55e0321e4b40 2024-09-19T07:23:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9e148740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e0320f0cf0 con 0x55e0321e35d0 2024-09-19T07:23:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9e148740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e0321452b0 con 0x55e0321ee370 2024-09-19T07:23:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa8affd640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa800a33b0 0x7faa800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9a30c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9a30c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321e3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40456/0 (socket says 172.21.15.98:40456) 2024-09-19T07:23:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9a30c640 1 -- 172.21.15.98:0/3001736424 learned_addr learned my addr 172.21.15.98:0/3001736424 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9a30c640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa800a33b0 0x7faa800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:39.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa8affd640 1 -- 172.21.15.98:0/908889175 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7faa840f02f0 con 0x7faa94102790 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa99b0b640 1 --2- 172.21.15.98:0/3001736424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321e35d0 0x55e0321e3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.958+0000 7faa9930a640 1 --2- 172.21.15.98:0/3001736424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321ee370 0x55e0321f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.959+0000 7faa9a30c640 1 -- 172.21.15.98:0/3001736424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321ee370 msgr2=0x55e0321f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.959+0000 7faa9a30c640 1 --2- 172.21.15.98:0/3001736424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321ee370 0x55e0321f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.959+0000 7faa9a30c640 1 -- 172.21.15.98:0/3001736424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321e35d0 msgr2=0x55e0321e3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.959+0000 7faa9a30c640 1 --2- 172.21.15.98:0/3001736424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321e35d0 0x55e0321e3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.959+0000 7faa9a30c640 1 -- 172.21.15.98:0/3001736424 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0320d53a0 con 0x55e0321e4b40 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.959+0000 7faa9930a640 1 --2- 172.21.15.98:0/3001736424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321ee370 0x55e0321f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.959+0000 7faa9a30c640 1 --2- 172.21.15.98:0/3001736424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321e3090 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0139b0 tx=0x7faa8c013e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3326b7d699449f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.959+0000 7faa7ffff640 1 -- 172.21.15.98:0/3001736424 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c023070 con 0x55e0321e4b40 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.959+0000 7faa7ffff640 1 -- 172.21.15.98:0/3001736424 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa8c011e40 con 0x55e0321e4b40 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.959+0000 7faa7ffff640 1 -- 172.21.15.98:0/3001736424 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c0126b0 con 0x55e0321e4b40 2024-09-19T07:23:39.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.960+0000 7faa9e148740 1 -- 172.21.15.98:0/3001736424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 msgr2=0x55e0321e3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.960+0000 7faa9a30c640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa800a33b0 0x7faa800a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa8c020000 tx=0x7faa8c01d000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.960+0000 7faa9e148740 1 --2- 172.21.15.98:0/3001736424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321e3090 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0139b0 tx=0x7faa8c013e70 comp rx=0 tx=0).stop 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.960+0000 7faa9e148740 1 -- 172.21.15.98:0/3001736424 shutdown_connections 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.960+0000 7faa9e148740 1 --2- 172.21.15.98:0/3001736424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321ee370 0x55e0321f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.960+0000 7faa9e148740 1 --2- 172.21.15.98:0/3001736424 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321e35d0 0x55e0321e3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.960+0000 7faa9e148740 1 --2- 172.21.15.98:0/3001736424 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321e3090 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.960+0000 7faa9e148740 1 -- 172.21.15.98:0/3001736424 >> 172.21.15.98:0/3001736424 conn(0x55e0321ac310 msgr2=0x55e0321dfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.960+0000 7faa9e148740 1 -- 172.21.15.98:0/3001736424 shutdown_connections 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.960+0000 7faa9e148740 1 -- 172.21.15.98:0/3001736424 wait complete. 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.960+0000 7faa9e148740 1 -- start start 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.960+0000 7faa9e148740 1 Processor -- start 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9e148740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321e35d0 0x55e0321edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9e148740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321eb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.995 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9e148740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321ee370 0x55e0321eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9e148740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e0321f1070 con 0x55e0321e4b40 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9e148740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e032104060 con 0x55e0321e35d0 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9e148740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55e0321f11f0 con 0x55e0321ee370 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9e148740 10 client.0 _ll_register_callbacks cb 0x55e031e578c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9930a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321eb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9930a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321eb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40468/0 (socket says 172.21.15.98:40468) 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9930a640 1 -- 172.21.15.98:0/3278419891 learned_addr learned my addr 172.21.15.98:0/3278419891 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa99b0b640 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321e35d0 0x55e0321edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9a30c640 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321ee370 0x55e0321eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9930a640 1 -- 172.21.15.98:0/3278419891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321ee370 msgr2=0x55e0321eb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9930a640 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321ee370 0x55e0321eb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9930a640 1 -- 172.21.15.98:0/3278419891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321e35d0 msgr2=0x55e0321edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9930a640 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321e35d0 0x55e0321edda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9930a640 1 -- 172.21.15.98:0/3278419891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e031eba3c0 con 0x55e0321e4b40 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa99b0b640 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321e35d0 0x55e0321edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9930a640 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321eb050 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faa840b8fd0 tx=0x7faa840b8960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae236c11f68d3304 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa7d7fa640 1 -- 172.21.15.98:0/3278419891 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84049040 con 0x55e0321e4b40 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa7d7fa640 1 -- 172.21.15.98:0/3278419891 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7faa840d6250 con 0x55e0321e4b40 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.961+0000 7faa9e148740 1 -- 172.21.15.98:0/3278419891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e032156860 con 0x55e0321e4b40 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.962+0000 7faa7d7fa640 1 -- 172.21.15.98:0/3278419891 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faa8403bcb0 con 0x55e0321e4b40 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.962+0000 7faa9e148740 10 client.15759 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.962+0000 7faa9e148740 1 -- 172.21.15.98:0/3278419891 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e0321fcac0 con 0x55e0321e4b40 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.962+0000 7faa7d7fa640 1 -- 172.21.15.98:0/3278419891 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55e032156860 con 0x55e0321e4b40 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.962+0000 7faa7d7fa640 1 -- 172.21.15.98:0/3278419891 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faa840bc860 con 0x55e0321e4b40 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.962+0000 7faa9e148740 10 client.15759 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:39.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.962+0000 7faa9e148740 10 client.15759 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.962+0000 7faa9e148740 20 client.15759 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.962+0000 7faa9e148740 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55e0321fdf20 0x55e032200350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.962+0000 7faa9e148740 4 client.15759 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.962+0000 7faa9e148740 1 -- 172.21.15.98:0/3278419891 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e032150d70 con 0x55e0321fdf20 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.962+0000 7faa99b0b640 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55e0321fdf20 0x55e032200350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.963+0000 7faa99b0b640 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55e0321fdf20 0x55e032200350 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa3a57db0fd5321b server_cookie=9742d2f1eb4536a7 in_seq=0 out_seq=0 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.963+0000 7faa7d7fa640 10 client.15759 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.963+0000 7faa7d7fa640 1 -- 172.21.15.98:0/3278419891 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e032150d70 con 0x55e0321fdf20 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.963+0000 7faa7d7fa640 10 client.15759 handle_command_reply: tid=0 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.963+0000 7faa9e148740 1 client.15759 shutdown 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.963+0000 7faa9e148740 1 -- 172.21.15.98:0/3278419891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 msgr2=0x55e0321eb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.963+0000 7faa9e148740 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321eb050 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faa840b8fd0 tx=0x7faa840b8960 comp rx=0 tx=0).stop 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.964+0000 7faa9e148740 1 -- 172.21.15.98:0/3278419891 shutdown_connections 2024-09-19T07:23:39.998 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.964+0000 7faa9e148740 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55e0321fdf20 0x55e032200350 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.964+0000 7faa9e148740 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321ee370 0x55e0321eb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.964+0000 7faa9e148740 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321eb050 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.964+0000 7faa9e148740 1 --2- 172.21.15.98:0/3278419891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321e35d0 0x55e0321edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.964+0000 7faa9e148740 1 -- 172.21.15.98:0/3278419891 >> 172.21.15.98:0/3278419891 conn(0x55e0321ac310 msgr2=0x55e0321e5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.964+0000 7faa7d7fa640 0 client.15759 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.964+0000 7faa9e148740 1 -- 172.21.15.98:0/3278419891 shutdown_connections 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.964+0000 7faa9e148740 1 -- 172.21.15.98:0/3278419891 wait complete. 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.964+0000 7faa9e148740 20 client.15759 trim_cache size 0 max 16384 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.976+0000 7faa9e148740 1 Processor -- start 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.976+0000 7faa9e148740 1 -- start start 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.976+0000 7faa9e148740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e35d0 0x55e0321ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.976+0000 7faa9e148740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321e4b40 0x55e0321e6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:39.999 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.976+0000 7faa9e148740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321ee370 0x55e0321e6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.976+0000 7faa9e148740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa941b23e0 con 0x55e0321e35d0 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.976+0000 7faa9e148740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa941afcb0 con 0x55e0321ee370 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.976+0000 7faa9e148740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa941adb00 con 0x55e0321e4b40 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.977+0000 7faa99b0b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e35d0 0x55e0321ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.977+0000 7faa99b0b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e35d0 0x55e0321ecfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40478/0 (socket says 172.21.15.98:40478) 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.977+0000 7faa99b0b640 1 -- 172.21.15.98:0/1169810211 learned_addr learned my addr 172.21.15.98:0/1169810211 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.977+0000 7faa99b0b640 1 -- 172.21.15.98:0/1169810211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321e4b40 msgr2=0x55e0321e6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.977+0000 7faa99b0b640 1 --2- 172.21.15.98:0/1169810211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321e4b40 0x55e0321e6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.977+0000 7faa99b0b640 1 -- 172.21.15.98:0/1169810211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321ee370 msgr2=0x55e0321e6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.977+0000 7faa99b0b640 1 --2- 172.21.15.98:0/1169810211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321ee370 0x55e0321e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.977+0000 7faa99b0b640 1 -- 172.21.15.98:0/1169810211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0322009d0 con 0x55e0321e35d0 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.977+0000 7faa99b0b640 1 --2- 172.21.15.98:0/1169810211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e35d0 0x55e0321ecfc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faa90005f00 tx=0x7faa9000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe4483d28f4cd0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:40.000 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.977+0000 7faa7f7fe640 1 -- 172.21.15.98:0/1169810211 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90003d60 con 0x55e0321e35d0 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.977+0000 7faa7f7fe640 1 -- 172.21.15.98:0/1169810211 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa90011920 con 0x55e0321e35d0 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.977+0000 7faa7f7fe640 1 -- 172.21.15.98:0/1169810211 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9001c850 con 0x55e0321e35d0 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 -- 172.21.15.98:0/1169810211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e35d0 msgr2=0x55e0321ecfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 --2- 172.21.15.98:0/1169810211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e35d0 0x55e0321ecfc0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faa90005f00 tx=0x7faa9000bd60 comp rx=0 tx=0).stop 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 -- 172.21.15.98:0/1169810211 shutdown_connections 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 --2- 172.21.15.98:0/1169810211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321ee370 0x55e0321e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 --2- 172.21.15.98:0/1169810211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321e4b40 0x55e0321e6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 --2- 172.21.15.98:0/1169810211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e35d0 0x55e0321ecfc0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 -- 172.21.15.98:0/1169810211 >> 172.21.15.98:0/1169810211 conn(0x55e0321ac310 msgr2=0x55e0321ec8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 -- 172.21.15.98:0/1169810211 shutdown_connections 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 -- 172.21.15.98:0/1169810211 wait complete. 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 -- start start 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 Processor -- start 2024-09-19T07:23:40.001 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321e35d0 0x55e0321f2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321f2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321ee370 0x55e0321f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faa941ae170 con 0x55e0321e4b40 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa941af5e0 con 0x55e0321ee370 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa941ae840 con 0x55e0321e35d0 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.978+0000 7faa9e148740 10 client.0 _ll_register_callbacks cb 0x7faa84005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9930a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9930a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321f2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40492/0 (socket says 172.21.15.98:40492) 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9930a640 1 -- 172.21.15.98:0/3461031096 learned_addr learned my addr 172.21.15.98:0/3461031096 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa99b0b640 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321e35d0 0x55e0321f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9a30c640 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321ee370 0x55e0321f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9930a640 1 -- 172.21.15.98:0/3461031096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321e35d0 msgr2=0x55e0321f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:40.002 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9930a640 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321e35d0 0x55e0321f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9930a640 1 -- 172.21.15.98:0/3461031096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321ee370 msgr2=0x55e0321f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:40.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9930a640 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321ee370 0x55e0321f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9930a640 1 -- 172.21.15.98:0/3461031096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e032267e80 con 0x55e0321e4b40 2024-09-19T07:23:40.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9a30c640 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321ee370 0x55e0321f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:40.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9930a640 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321f2990 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faa840d6180 tx=0x7faa84005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5c401e477c3e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:40.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa7d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:40.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa7d7fa640 1 -- 172.21.15.98:0/3461031096 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa84078060 con 0x55e0321e4b40 2024-09-19T07:23:40.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa7d7fa640 1 -- 172.21.15.98:0/3461031096 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7faa840c4fe0 con 0x55e0321e4b40 2024-09-19T07:23:40.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9e148740 1 -- 172.21.15.98:0/3461031096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa90011920 con 0x55e0321e4b40 2024-09-19T07:23:40.003 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa7d7fa640 1 -- 172.21.15.98:0/3461031096 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7faa84049070 con 0x55e0321e4b40 2024-09-19T07:23:40.004 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:23:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9e148740 10 client.15765 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa9e148740 1 -- 172.21.15.98:0/3461031096 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e032267e80 con 0x55e0321e4b40 2024-09-19T07:23:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.979+0000 7faa7d7fa640 1 -- 172.21.15.98:0/3461031096 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa90011920 con 0x55e0321e4b40 2024-09-19T07:23:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.980+0000 7faa7d7fa640 1 -- 172.21.15.98:0/3461031096 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7faa840bba50 con 0x55e0321e4b40 2024-09-19T07:23:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.980+0000 7faa9e148740 10 client.15765 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.980+0000 7faa9e148740 10 client.15765 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T07:23:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.980+0000 7faa9e148740 20 client.15765 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.980+0000 7faa9e148740 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55e0322695f0 0x55e03226ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:40.004 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.980+0000 7faa9e148740 4 client.15765 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.980+0000 7faa9e148740 1 -- 172.21.15.98:0/3461031096 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e0320cd170 con 0x55e0322695f0 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.980+0000 7faa99b0b640 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55e0322695f0 0x55e03226ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.980+0000 7faa7d7fa640 10 client.15765 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.980+0000 7faa99b0b640 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55e0322695f0 0x55e03226ba10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d3cdbcc601154cfb server_cookie=6d2b701b48edf107 in_seq=0 out_seq=0 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.980+0000 7faa7d7fa640 1 -- 172.21.15.98:0/3461031096 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e0320cd170 con 0x55e0322695f0 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.980+0000 7faa7d7fa640 10 client.15765 handle_command_reply: tid=0 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9e148740 1 client.15765 shutdown 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9e148740 1 -- 172.21.15.98:0/3461031096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 msgr2=0x55e0321f2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9e148740 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321f2990 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faa840d6180 tx=0x7faa84005900 comp rx=0 tx=0).stop 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9e148740 1 -- 172.21.15.98:0/3461031096 shutdown_connections 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9e148740 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e0321ee370 0x55e0321f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9e148740 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e0321e4b40 0x55e0321f2990 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.005 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9e148740 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55e0322695f0 0x55e03226ba10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9e148740 1 --2- 172.21.15.98:0/3461031096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e0321e35d0 0x55e0321f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa7d7fa640 0 client.15765 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9e148740 1 -- 172.21.15.98:0/3461031096 >> 172.21.15.98:0/3461031096 conn(0x55e0321ac310 msgr2=0x55e0321f9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9e148740 1 -- 172.21.15.98:0/3461031096 shutdown_connections 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9e148740 1 -- 172.21.15.98:0/3461031096 wait complete. 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9e148740 20 client.15765 trim_cache size 0 max 16384 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9bd6f640 1 -- 172.21.15.98:0/908889175 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa800a33b0 msgr2=0x7faa800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9bd6f640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa800a33b0 0x7faa800a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faa8c020000 tx=0x7faa8c01d000 comp rx=0 tx=0).stop 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9bd6f640 1 -- 172.21.15.98:0/908889175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa94102790 msgr2=0x7faa94074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9bd6f640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa94102790 0x7faa94074a30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faa84006010 tx=0x7faa840042f0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9bd6f640 1 -- 172.21.15.98:0/908889175 shutdown_connections 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9bd6f640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faa800a33b0 0x7faa800a5870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9bd6f640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa94106f10 0x7faa94074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.006 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9bd6f640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faa94102790 0x7faa94074a30 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9bd6f640 1 --2- 172.21.15.98:0/908889175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa94101de0 0x7faa940744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:40.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.981+0000 7faa9bd6f640 1 -- 172.21.15.98:0/908889175 >> 172.21.15.98:0/908889175 conn(0x7faa940fd8c0 msgr2=0x7faa940fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:40.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.982+0000 7faa9bd6f640 1 -- 172.21.15.98:0/908889175 shutdown_connections 2024-09-19T07:23:40.007 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:39.982+0000 7faa9bd6f640 1 -- 172.21.15.98:0/908889175 wait complete. 2024-09-19T07:23:40.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:39 smithi162 ceph-mon[35726]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-19T07:23:40.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:39 smithi098 ceph-mon[30950]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-19T07:23:40.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:39 smithi139 ceph-mon[35039]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-19T07:23:40.854 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:23:41.098 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:41.522 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.519+0000 7f1b38335640 1 -- 172.21.15.98:0/315751685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b30100a80 msgr2=0x7f1b30100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.519+0000 7f1b38335640 1 --2- 172.21.15.98:0/315751685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b30100a80 0x7f1b30100ee0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009930 tx=0x7f1b2402a420 comp rx=0 tx=0).stop 2024-09-19T07:23:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.519+0000 7f1b38335640 1 -- 172.21.15.98:0/315751685 shutdown_connections 2024-09-19T07:23:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.519+0000 7f1b38335640 1 --2- 172.21.15.98:0/315751685 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b30101420 0x7f1b3010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.519+0000 7f1b38335640 1 --2- 172.21.15.98:0/315751685 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b30100a80 0x7f1b30100ee0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.519+0000 7f1b38335640 1 --2- 172.21.15.98:0/315751685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b30106a80 0x7f1b30106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.519+0000 7f1b38335640 1 -- 172.21.15.98:0/315751685 >> 172.21.15.98:0/315751685 conn(0x7f1b300fc7a0 msgr2=0x7f1b300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.519+0000 7f1b38335640 1 -- 172.21.15.98:0/315751685 shutdown_connections 2024-09-19T07:23:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.519+0000 7f1b38335640 1 -- 172.21.15.98:0/315751685 wait complete. 2024-09-19T07:23:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.520+0000 7f1b38335640 1 Processor -- start 2024-09-19T07:23:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.520+0000 7f1b38335640 1 -- start start 2024-09-19T07:23:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.520+0000 7f1b38335640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b30100a80 0x7f1b301983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.520+0000 7f1b38335640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b30101420 0x7f1b30198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.520+0000 7f1b38335640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b30106a80 0x7f1b3019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.520+0000 7f1b38335640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30110e80 con 0x7f1b30100a80 2024-09-19T07:23:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.520+0000 7f1b38335640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30110d00 con 0x7f1b30101420 2024-09-19T07:23:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.520+0000 7f1b38335640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30111000 con 0x7f1b30106a80 2024-09-19T07:23:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.520+0000 7f1b360d1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b30100a80 0x7f1b301983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.520+0000 7f1b360d1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b30100a80 0x7f1b301983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40502/0 (socket says 172.21.15.98:40502) 2024-09-19T07:23:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.520+0000 7f1b360d1640 1 -- 172.21.15.98:0/4080268400 learned_addr learned my addr 172.21.15.98:0/4080268400 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.520+0000 7f1b368d2640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b30106a80 0x7f1b3019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b358d0640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b30101420 0x7f1b30198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b360d1640 1 -- 172.21.15.98:0/4080268400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b30106a80 msgr2=0x7f1b3019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b360d1640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b30106a80 0x7f1b3019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b360d1640 1 -- 172.21.15.98:0/4080268400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b30101420 msgr2=0x7f1b30198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b360d1640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b30101420 0x7f1b30198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b360d1640 1 -- 172.21.15.98:0/4080268400 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3019d380 con 0x7f1b30100a80 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b368d2640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b30106a80 0x7f1b3019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b358d0640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b30101420 0x7f1b30198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b360d1640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b30100a80 0x7f1b301983d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00d770 tx=0x7f1b2c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b237fe640 1 -- 172.21.15.98:0/4080268400 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c017070 con 0x7f1b30100a80 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b237fe640 1 -- 172.21.15.98:0/4080268400 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b2c005500 con 0x7f1b30100a80 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b38335640 1 -- 172.21.15.98:0/4080268400 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b3019d670 con 0x7f1b30100a80 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b237fe640 1 -- 172.21.15.98:0/4080268400 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c004e00 con 0x7f1b30100a80 2024-09-19T07:23:41.525 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.521+0000 7f1b38335640 1 -- 172.21.15.98:0/4080268400 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b301a4f50 con 0x7f1b30100a80 2024-09-19T07:23:41.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.523+0000 7f1b237fe640 1 -- 172.21.15.98:0/4080268400 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1b2c004fa0 con 0x7f1b30100a80 2024-09-19T07:23:41.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.524+0000 7f1b237fe640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f1b1c0a3430 0x7f1b1c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.524+0000 7f1b358d0640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f1b1c0a3430 0x7f1b1c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.524+0000 7f1b237fe640 1 -- 172.21.15.98:0/4080268400 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f1b2c0cf7a0 con 0x7f1b30100a80 2024-09-19T07:23:41.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.524+0000 7f1b3a70e740 1 Processor -- start 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b3a70e740 1 -- start start 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b358d0640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f1b1c0a3430 0x7f1b1c0a58f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1b24000c00 tx=0x7f1b24032c70 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b3a70e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 0x555959bf3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b3a70e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf35d0 0x555959bf3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b3a70e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959c00760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b3a70e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555959b592f0 con 0x555959bf4b40 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b3a70e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555959b00cf0 con 0x555959bf35d0 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b3a70e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555959b552b0 con 0x555959bfe370 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b360d1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 0x555959bf3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b360d1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 0x555959bf3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40516/0 (socket says 172.21.15.98:40516) 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b360d1640 1 -- 172.21.15.98:0/3614635635 learned_addr learned my addr 172.21.15.98:0/3614635635 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b358d0640 1 --2- 172.21.15.98:0/3614635635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf35d0 0x555959bf3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.532 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b368d2640 1 --2- 172.21.15.98:0/3614635635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959c00760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b360d1640 1 -- 172.21.15.98:0/3614635635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 msgr2=0x555959c00760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:41.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b360d1640 1 --2- 172.21.15.98:0/3614635635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959c00760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b360d1640 1 -- 172.21.15.98:0/3614635635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf35d0 msgr2=0x555959bf3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:41.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b360d1640 1 --2- 172.21.15.98:0/3614635635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf35d0 0x555959bf3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b360d1640 1 -- 172.21.15.98:0/3614635635 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555959ae53a0 con 0x555959bf4b40 2024-09-19T07:23:41.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b368d2640 1 --2- 172.21.15.98:0/3614635635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959c00760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:41.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.525+0000 7f1b360d1640 1 --2- 172.21.15.98:0/3614635635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 0x555959bf3090 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c098420 tx=0x7f1b2c004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715cd2bdc4ade173 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:41.533 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.526+0000 7f1b20dea640 1 -- 172.21.15.98:0/3614635635 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c020070 con 0x555959bf4b40 2024-09-19T07:23:41.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.526+0000 7f1b20dea640 1 -- 172.21.15.98:0/3614635635 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b2c09fe00 con 0x555959bf4b40 2024-09-19T07:23:41.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.526+0000 7f1b20dea640 1 -- 172.21.15.98:0/3614635635 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0cd140 con 0x555959bf4b40 2024-09-19T07:23:41.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.526+0000 7f1b3a70e740 1 -- 172.21.15.98:0/3614635635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 msgr2=0x555959bf3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:41.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.526+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/3614635635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 0x555959bf3090 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c098420 tx=0x7f1b2c004780 comp rx=0 tx=0).stop 2024-09-19T07:23:41.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.526+0000 7f1b3a70e740 1 -- 172.21.15.98:0/3614635635 shutdown_connections 2024-09-19T07:23:41.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.526+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/3614635635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959c00760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.526+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/3614635635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf35d0 0x555959bf3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.526+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/3614635635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 0x555959bf3090 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.526+0000 7f1b3a70e740 1 -- 172.21.15.98:0/3614635635 >> 172.21.15.98:0/3614635635 conn(0x555959bbc310 msgr2=0x555959befc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:41.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b3a70e740 1 -- 172.21.15.98:0/3614635635 shutdown_connections 2024-09-19T07:23:41.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b3a70e740 1 -- 172.21.15.98:0/3614635635 wait complete. 2024-09-19T07:23:41.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b3a70e740 1 -- start start 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b3a70e740 1 Processor -- start 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b3a70e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf35d0 0x555959bfb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b3a70e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 0x555959bfb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b3a70e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959bfbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b3a70e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555959c01070 con 0x555959bf4b40 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b3a70e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555959b14060 con 0x555959bf35d0 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b3a70e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555959c011f0 con 0x555959bfe370 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b3a70e740 10 client.0 _ll_register_callbacks cb 0x5559598678c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b358d0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 0x555959bfb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b358d0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 0x555959bfb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40526/0 (socket says 172.21.15.98:40526) 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b358d0640 1 -- 172.21.15.98:0/574975201 learned_addr learned my addr 172.21.15.98:0/574975201 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.527+0000 7f1b360d1640 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf35d0 0x555959bfb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b368d2640 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959bfbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b358d0640 1 -- 172.21.15.98:0/574975201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 msgr2=0x555959bfbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:41.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b358d0640 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959bfbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b358d0640 1 -- 172.21.15.98:0/574975201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf35d0 msgr2=0x555959bfb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:41.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b358d0640 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf35d0 0x555959bfb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b358d0640 1 -- 172.21.15.98:0/574975201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559598ca3c0 con 0x555959bf4b40 2024-09-19T07:23:41.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b358d0640 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 0x555959bfb630 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1b24033000 tx=0x7f1b24009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5341c36ab836606 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:41.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:41.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b19ffb640 1 -- 172.21.15.98:0/574975201 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2404c020 con 0x555959bf4b40 2024-09-19T07:23:41.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b19ffb640 1 -- 172.21.15.98:0/574975201 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f1b24005450 con 0x555959bf4b40 2024-09-19T07:23:41.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b3a70e740 1 -- 172.21.15.98:0/574975201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b2c09fe00 con 0x555959bf4b40 2024-09-19T07:23:41.536 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b19ffb640 1 -- 172.21.15.98:0/574975201 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1b24057050 con 0x555959bf4b40 2024-09-19T07:23:41.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b3a70e740 10 client.15777 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:41.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.528+0000 7f1b3a70e740 1 -- 172.21.15.98:0/574975201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555959c10fd0 con 0x555959bf4b40 2024-09-19T07:23:41.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.529+0000 7f1b19ffb640 1 -- 172.21.15.98:0/574975201 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b2c09fe00 con 0x555959bf4b40 2024-09-19T07:23:41.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.529+0000 7f1b19ffb640 1 -- 172.21.15.98:0/574975201 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1b24003710 con 0x555959bf4b40 2024-09-19T07:23:41.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.529+0000 7f1b3a70e740 10 client.15777 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:41.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.529+0000 7f1b3a70e740 10 client.15777 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T07:23:41.537 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.529+0000 7f1b3a70e740 20 client.15777 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:41.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.529+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x555959c12490 0x555959c14910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.529+0000 7f1b3a70e740 4 client.15777 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:41.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.529+0000 7f1b3a70e740 1 -- 172.21.15.98:0/574975201 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555959b66860 con 0x555959c12490 2024-09-19T07:23:41.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.529+0000 7f1b360d1640 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x555959c12490 0x555959c14910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b360d1640 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x555959c12490 0x555959c14910 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b351f395c558f07d server_cookie=11529ca44809c879 in_seq=0 out_seq=0 2024-09-19T07:23:41.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b19ffb640 10 client.15777 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:23:41.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b19ffb640 1 -- 172.21.15.98:0/574975201 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555959b66860 con 0x555959c12490 2024-09-19T07:23:41.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b19ffb640 10 client.15777 handle_command_reply: tid=0 2024-09-19T07:23:41.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b3a70e740 1 client.15777 shutdown 2024-09-19T07:23:41.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b3a70e740 1 -- 172.21.15.98:0/574975201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 msgr2=0x555959bfb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:41.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 0x555959bfb630 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1b24033000 tx=0x7f1b24009260 comp rx=0 tx=0).stop 2024-09-19T07:23:41.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b3a70e740 1 -- 172.21.15.98:0/574975201 shutdown_connections 2024-09-19T07:23:41.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x555959c12490 0x555959c14910 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959bfbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf4b40 0x555959bfb630 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/574975201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf35d0 0x555959bfb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b3a70e740 1 -- 172.21.15.98:0/574975201 >> 172.21.15.98:0/574975201 conn(0x555959bbc310 msgr2=0x555959bf5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:41.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.530+0000 7f1b19ffb640 0 client.15777 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:23:41.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.531+0000 7f1b3a70e740 1 -- 172.21.15.98:0/574975201 shutdown_connections 2024-09-19T07:23:41.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.531+0000 7f1b3a70e740 1 -- 172.21.15.98:0/574975201 wait complete. 2024-09-19T07:23:41.540 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.531+0000 7f1b3a70e740 20 client.15777 trim_cache size 0 max 16384 2024-09-19T07:23:41.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.543+0000 7f1b3a70e740 1 Processor -- start 2024-09-19T07:23:41.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b3a70e740 1 -- start start 2024-09-19T07:23:41.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b3a70e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf35d0 0x555959c1a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b3a70e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf4b40 0x555959c1a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b3a70e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959bfc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.548 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b3a70e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301adfc0 con 0x555959bf35d0 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b3a70e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301ab890 con 0x555959bf4b40 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b3a70e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301a96e0 con 0x555959bfe370 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b360d1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf35d0 0x555959c1a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b360d1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf35d0 0x555959c1a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40530/0 (socket says 172.21.15.98:40530) 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b360d1640 1 -- 172.21.15.98:0/2636535212 learned_addr learned my addr 172.21.15.98:0/2636535212 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b358d0640 1 --2- 172.21.15.98:0/2636535212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf4b40 0x555959c1a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b360d1640 1 -- 172.21.15.98:0/2636535212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 msgr2=0x555959bfc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b368d2640 1 --2- 172.21.15.98:0/2636535212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959bfc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b360d1640 1 --2- 172.21.15.98:0/2636535212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959bfc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b360d1640 1 -- 172.21.15.98:0/2636535212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf4b40 msgr2=0x555959c1a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b360d1640 1 --2- 172.21.15.98:0/2636535212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf4b40 0x555959c1a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b360d1640 1 -- 172.21.15.98:0/2636535212 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555959bf0960 con 0x555959bf35d0 2024-09-19T07:23:41.549 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b368d2640 1 --2- 172.21.15.98:0/2636535212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959bfc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:41.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b358d0640 1 --2- 172.21.15.98:0/2636535212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf4b40 0x555959c1a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:41.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b360d1640 1 --2- 172.21.15.98:0/2636535212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf35d0 0x555959c1a1e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0cd4c0 tx=0x7f1b2c0057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b8a4cc8fb7a1dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:41.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b1bfff640 1 -- 172.21.15.98:0/2636535212 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0b9070 con 0x555959bf35d0 2024-09-19T07:23:41.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.544+0000 7f1b1bfff640 1 -- 172.21.15.98:0/2636535212 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b2c005290 con 0x555959bf35d0 2024-09-19T07:23:41.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.545+0000 7f1b1bfff640 1 -- 172.21.15.98:0/2636535212 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0b3030 con 0x555959bf35d0 2024-09-19T07:23:41.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.545+0000 7f1b3a70e740 1 -- 172.21.15.98:0/2636535212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf35d0 msgr2=0x555959c1a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:41.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.545+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/2636535212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf35d0 0x555959c1a1e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0cd4c0 tx=0x7f1b2c0057b0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.545+0000 7f1b3a70e740 1 -- 172.21.15.98:0/2636535212 shutdown_connections 2024-09-19T07:23:41.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.545+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/2636535212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bfe370 0x555959bfc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.545+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/2636535212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf4b40 0x555959c1a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.550 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.545+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/2636535212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bf35d0 0x555959c1a1e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.545+0000 7f1b3a70e740 1 -- 172.21.15.98:0/2636535212 >> 172.21.15.98:0/2636535212 conn(0x555959bbc310 msgr2=0x555959bfa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:41.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.545+0000 7f1b3a70e740 1 -- 172.21.15.98:0/2636535212 shutdown_connections 2024-09-19T07:23:41.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.545+0000 7f1b3a70e740 1 -- 172.21.15.98:0/2636535212 wait complete. 2024-09-19T07:23:41.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.545+0000 7f1b3a70e740 1 -- start start 2024-09-19T07:23:41.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b3a70e740 1 Processor -- start 2024-09-19T07:23:41.551 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b3a70e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bf35d0 0x555959c02170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b3a70e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf4b40 0x555959c026b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b3a70e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bfe370 0x555959c02bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b3a70e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301a9d50 con 0x555959bfe370 2024-09-19T07:23:41.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b3a70e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301ab1c0 con 0x555959bf4b40 2024-09-19T07:23:41.552 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b3a70e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1b301aa420 con 0x555959bf35d0 2024-09-19T07:23:41.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b3a70e740 10 client.0 _ll_register_callbacks cb 0x7f1b24009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:41.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b368d2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bfe370 0x555959c02bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b368d2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bfe370 0x555959c02bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:40540/0 (socket says 172.21.15.98:40540) 2024-09-19T07:23:41.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b368d2640 1 -- 172.21.15.98:0/161048970 learned_addr learned my addr 172.21.15.98:0/161048970 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:41.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b358d0640 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf4b40 0x555959c026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.553 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b368d2640 1 -- 172.21.15.98:0/161048970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bf35d0 msgr2=0x555959c02170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:41.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b368d2640 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bf35d0 0x555959c02170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b368d2640 1 -- 172.21.15.98:0/161048970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf4b40 msgr2=0x555959c026b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:41.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b368d2640 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf4b40 0x555959c026b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b368d2640 1 -- 172.21.15.98:0/161048970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555959c7c1b0 con 0x555959bfe370 2024-09-19T07:23:41.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b358d0640 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf4b40 0x555959c026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:41.554 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b368d2640 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bfe370 0x555959c02bf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1b280127c0 tx=0x7f1b28012c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23daa84fc155fd8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:41.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.546+0000 7f1b19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:41.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b19ffb640 1 -- 172.21.15.98:0/161048970 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800dd90 con 0x555959bfe370 2024-09-19T07:23:41.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b19ffb640 1 -- 172.21.15.98:0/161048970 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f1b28004b20 con 0x555959bfe370 2024-09-19T07:23:41.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b3a70e740 1 -- 172.21.15.98:0/161048970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b2c005290 con 0x555959bfe370 2024-09-19T07:23:41.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b19ffb640 1 -- 172.21.15.98:0/161048970 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1b28004d20 con 0x555959bfe370 2024-09-19T07:23:41.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b3a70e740 10 client.15783 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:41.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b3a70e740 1 -- 172.21.15.98:0/161048970 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555959c7d400 con 0x555959bfe370 2024-09-19T07:23:41.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b19ffb640 1 -- 172.21.15.98:0/161048970 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b2c005290 con 0x555959bfe370 2024-09-19T07:23:41.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b19ffb640 1 -- 172.21.15.98:0/161048970 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f1b28020070 con 0x555959bfe370 2024-09-19T07:23:41.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b3a70e740 10 client.15783 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:41.555 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b3a70e740 10 client.15783 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T07:23:41.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b3a70e740 20 client.15783 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:41.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x555959c7dbd0 0x555959c80030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:41.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b3a70e740 4 client.15783 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:23:41.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.547+0000 7f1b3a70e740 1 -- 172.21.15.98:0/161048970 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555959b60d70 con 0x555959c7dbd0 2024-09-19T07:23:41.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b360d1640 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x555959c7dbd0 0x555959c80030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:41.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b360d1640 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x555959c7dbd0 0x555959c80030 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6be64d780a38839c server_cookie=174f74d865c2e9a5 in_seq=0 out_seq=0 2024-09-19T07:23:41.556 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b19ffb640 10 client.15783 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:23:41.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b19ffb640 1 -- 172.21.15.98:0/161048970 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555959b60d70 con 0x555959c7dbd0 2024-09-19T07:23:41.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b19ffb640 10 client.15783 handle_command_reply: tid=0 2024-09-19T07:23:41.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b3a70e740 1 client.15783 shutdown 2024-09-19T07:23:41.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b3a70e740 1 -- 172.21.15.98:0/161048970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bfe370 msgr2=0x555959c02bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:41.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bfe370 0x555959c02bf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1b280127c0 tx=0x7f1b28012c80 comp rx=0 tx=0).stop 2024-09-19T07:23:41.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b3a70e740 1 -- 172.21.15.98:0/161048970 shutdown_connections 2024-09-19T07:23:41.557 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x555959c7dbd0 0x555959c80030 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b19ffb640 0 client.15783 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:23:41.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555959bfe370 0x555959c02bf0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555959bf4b40 0x555959c026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b3a70e740 1 --2- 172.21.15.98:0/161048970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555959bf35d0 0x555959c02170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.548+0000 7f1b3a70e740 1 -- 172.21.15.98:0/161048970 >> 172.21.15.98:0/161048970 conn(0x555959bbc310 msgr2=0x555959bfc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:41.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b3a70e740 1 -- 172.21.15.98:0/161048970 shutdown_connections 2024-09-19T07:23:41.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b3a70e740 1 -- 172.21.15.98:0/161048970 wait complete. 2024-09-19T07:23:41.558 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b3a70e740 20 client.15783 trim_cache size 0 max 16384 2024-09-19T07:23:41.558 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:23:41.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b38335640 1 -- 172.21.15.98:0/4080268400 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f1b1c0a3430 msgr2=0x7f1b1c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:41.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b38335640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f1b1c0a3430 0x7f1b1c0a58f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1b24000c00 tx=0x7f1b24032c70 comp rx=0 tx=0).stop 2024-09-19T07:23:41.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b38335640 1 -- 172.21.15.98:0/4080268400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b30100a80 msgr2=0x7f1b301983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:41.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b38335640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b30100a80 0x7f1b301983d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00d770 tx=0x7f1b2c00dc30 comp rx=0 tx=0).stop 2024-09-19T07:23:41.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b38335640 1 -- 172.21.15.98:0/4080268400 shutdown_connections 2024-09-19T07:23:41.559 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b38335640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f1b1c0a3430 0x7f1b1c0a58f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b38335640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b30106a80 0x7f1b3019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b38335640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b30101420 0x7f1b30198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b38335640 1 --2- 172.21.15.98:0/4080268400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b30100a80 0x7f1b301983d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:41.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b38335640 1 -- 172.21.15.98:0/4080268400 >> 172.21.15.98:0/4080268400 conn(0x7f1b300fc7a0 msgr2=0x7f1b30104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:41.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b38335640 1 -- 172.21.15.98:0/4080268400 shutdown_connections 2024-09-19T07:23:41.560 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:41.549+0000 7f1b38335640 1 -- 172.21.15.98:0/4080268400 wait complete. 2024-09-19T07:23:42.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:41 smithi162 ceph-mon[35726]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T07:23:42.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:41 smithi098 ceph-mon[30950]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T07:23:42.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:41 smithi139 ceph-mon[35039]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T07:23:42.322 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:23:42.568 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:43.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.045+0000 7f885e9a6640 1 -- 172.21.15.98:0/1988293427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8858101240 msgr2=0x7f8858101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:43.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.045+0000 7f885e9a6640 1 --2- 172.21.15.98:0/1988293427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8858101240 0x7f8858101680 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8840009900 tx=0x7f884002a410 comp rx=0 tx=0).stop 2024-09-19T07:23:43.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.045+0000 7f885e9a6640 1 -- 172.21.15.98:0/1988293427 shutdown_connections 2024-09-19T07:23:43.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.045+0000 7f885e9a6640 1 --2- 172.21.15.98:0/1988293427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8858101bc0 0x7f885810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.045+0000 7f885e9a6640 1 --2- 172.21.15.98:0/1988293427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8858101240 0x7f8858101680 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.045+0000 7f885e9a6640 1 --2- 172.21.15.98:0/1988293427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858105a90 0x7f8858105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.045+0000 7f885e9a6640 1 -- 172.21.15.98:0/1988293427 >> 172.21.15.98:0/1988293427 conn(0x7f8858077210 msgr2=0x7f88580fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:43.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.045+0000 7f885e9a6640 1 -- 172.21.15.98:0/1988293427 shutdown_connections 2024-09-19T07:23:43.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.045+0000 7f885e9a6640 1 -- 172.21.15.98:0/1988293427 wait complete. 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.046+0000 7f885e9a6640 1 Processor -- start 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.046+0000 7f885e9a6640 1 -- start start 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.046+0000 7f885e9a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858101240 0x7f8858197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.046+0000 7f885e9a6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8858101bc0 0x7f88581979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.046+0000 7f885e9a6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8858105a90 0x7f885819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.046+0000 7f885e9a6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8858110fb0 con 0x7f8858105a90 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.046+0000 7f885e9a6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8858110e30 con 0x7f8858101bc0 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.046+0000 7f885e9a6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8858111130 con 0x7f8858101240 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.046+0000 7f885cf43640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8858105a90 0x7f885819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.046+0000 7f885cf43640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8858105a90 0x7f885819bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59080/0 (socket says 172.21.15.98:59080) 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.046+0000 7f885cf43640 1 -- 172.21.15.98:0/557885795 learned_addr learned my addr 172.21.15.98:0/557885795 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.046+0000 7f8857fff640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858101240 0x7f8858197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.066 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.047+0000 7f884ffff640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8858101bc0 0x7f88581979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.047+0000 7f885cf43640 1 -- 172.21.15.98:0/557885795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858101240 msgr2=0x7f8858197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.047+0000 7f885cf43640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858101240 0x7f8858197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.047+0000 7f885cf43640 1 -- 172.21.15.98:0/557885795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8858101bc0 msgr2=0x7f88581979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.047+0000 7f885cf43640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8858101bc0 0x7f88581979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.047+0000 7f885cf43640 1 -- 172.21.15.98:0/557885795 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885819c440 con 0x7f8858105a90 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.047+0000 7f885cf43640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8858105a90 0x7f885819bd60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f885000cad0 tx=0x7f885000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.047+0000 7f8855ffb640 1 -- 172.21.15.98:0/557885795 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885000ad60 con 0x7f8858105a90 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.047+0000 7f885e9a6640 1 -- 172.21.15.98:0/557885795 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885819c730 con 0x7f8858105a90 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.047+0000 7f8855ffb640 1 -- 172.21.15.98:0/557885795 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8850005020 con 0x7f8858105a90 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.047+0000 7f8855ffb640 1 -- 172.21.15.98:0/557885795 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885001d060 con 0x7f8858105a90 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.047+0000 7f885e9a6640 1 -- 172.21.15.98:0/557885795 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88581a4010 con 0x7f8858105a90 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.049+0000 7f8855ffb640 1 -- 172.21.15.98:0/557885795 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8850005560 con 0x7f8858105a90 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f8860d7f740 1 Processor -- start 2024-09-19T07:23:43.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f8860d7f740 1 -- start start 2024-09-19T07:23:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f8860d7f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 0x55b7229c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f8860d7f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229c85d0 0x55b7229c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f8860d7f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229d7970 0x55b7229d9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f8860d7f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b72292e2f0 con 0x55b7229c9a20 2024-09-19T07:23:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f8860d7f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b7228d5cf0 con 0x55b7229d7970 2024-09-19T07:23:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f8860d7f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b72292a2b0 con 0x55b7229c85d0 2024-09-19T07:23:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f884ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 0x55b7229c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f8855ffb640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f88440a33b0 0x7f88440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f884ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 0x55b7229c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59086/0 (socket says 172.21.15.98:59086) 2024-09-19T07:23:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f884ffff640 1 -- 172.21.15.98:0/2998061953 learned_addr learned my addr 172.21.15.98:0/2998061953 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f885cf43640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f88440a33b0 0x7f88440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f884ffff640 1 --2- 172.21.15.98:0/2998061953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229d7970 0x55b7229d9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f8857fff640 1 --2- 172.21.15.98:0/2998061953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229c85d0 0x55b7229c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f884ffff640 1 -- 172.21.15.98:0/2998061953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229c85d0 msgr2=0x55b7229c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.050+0000 7f884ffff640 1 --2- 172.21.15.98:0/2998061953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229c85d0 0x55b7229c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.051+0000 7f884ffff640 1 -- 172.21.15.98:0/2998061953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229d7970 msgr2=0x55b7229d9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.051+0000 7f884ffff640 1 --2- 172.21.15.98:0/2998061953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229d7970 0x55b7229d9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.051+0000 7f884ffff640 1 -- 172.21.15.98:0/2998061953 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7228ba3a0 con 0x55b7229c9a20 2024-09-19T07:23:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.051+0000 7f8855ffb640 1 -- 172.21.15.98:0/557885795 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f88500cfd50 con 0x7f8858105a90 2024-09-19T07:23:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.051+0000 7f884ffff640 1 --2- 172.21.15.98:0/2998061953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 0x55b7229c8090 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8840005c40 tx=0x7f8840005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f5d934b3374edc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.051+0000 7f885cf43640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f88440a33b0 0x7f88440a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f88500989d0 tx=0x7f885006dd80 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.051+0000 7f884e7fc640 1 -- 172.21.15.98:0/2998061953 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840044020 con 0x55b7229c9a20 2024-09-19T07:23:43.069 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.051+0000 7f884e7fc640 1 -- 172.21.15.98:0/2998061953 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8840003d50 con 0x55b7229c9a20 2024-09-19T07:23:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.051+0000 7f884e7fc640 1 -- 172.21.15.98:0/2998061953 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840035070 con 0x55b7229c9a20 2024-09-19T07:23:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 -- 172.21.15.98:0/2998061953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 msgr2=0x55b7229c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 --2- 172.21.15.98:0/2998061953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 0x55b7229c8090 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8840005c40 tx=0x7f8840005b50 comp rx=0 tx=0).stop 2024-09-19T07:23:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 -- 172.21.15.98:0/2998061953 shutdown_connections 2024-09-19T07:23:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 --2- 172.21.15.98:0/2998061953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229d7970 0x55b7229d9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 --2- 172.21.15.98:0/2998061953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229c85d0 0x55b7229c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 --2- 172.21.15.98:0/2998061953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 0x55b7229c8090 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 -- 172.21.15.98:0/2998061953 >> 172.21.15.98:0/2998061953 conn(0x55b722991310 msgr2=0x55b7229c4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 -- 172.21.15.98:0/2998061953 shutdown_connections 2024-09-19T07:23:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 -- 172.21.15.98:0/2998061953 wait complete. 2024-09-19T07:23:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 -- start start 2024-09-19T07:23:43.070 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 Processor -- start 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 0x55b7229d72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c9a20 0x55b7229d4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229d7970 0x55b7229d4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b7229da4e0 con 0x55b7229c85d0 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b7228e9060 con 0x55b7229c9a20 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.052+0000 7f8860d7f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b7229da660 con 0x55b7229d7970 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f8860d7f740 10 client.0 _ll_register_callbacks cb 0x55b72263c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f884ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 0x55b7229d72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f884ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 0x55b7229d72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59088/0 (socket says 172.21.15.98:59088) 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f884ffff640 1 -- 172.21.15.98:0/3009016182 learned_addr learned my addr 172.21.15.98:0/3009016182 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f884ffff640 1 -- 172.21.15.98:0/3009016182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229d7970 msgr2=0x55b7229d4af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f884ffff640 1 --2- 172.21.15.98:0/3009016182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229d7970 0x55b7229d4af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.071 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f884ffff640 1 -- 172.21.15.98:0/3009016182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c9a20 msgr2=0x55b7229d4590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f884ffff640 1 --2- 172.21.15.98:0/3009016182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c9a20 0x55b7229d4590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f884ffff640 1 -- 172.21.15.98:0/3009016182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72269f3c0 con 0x55b7229c85d0 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f884ffff640 1 --2- 172.21.15.98:0/3009016182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 0x55b7229d72e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8840006010 tx=0x7f8840005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9cf3a56c1272b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f88377fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f88377fe640 1 -- 172.21.15.98:0/3009016182 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884004d020 con 0x55b7229c85d0 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f88377fe640 1 -- 172.21.15.98:0/3009016182 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8840031740 con 0x55b7229c85d0 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f8860d7f740 1 -- 172.21.15.98:0/3009016182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8840003d50 con 0x55b7229c85d0 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f88377fe640 1 -- 172.21.15.98:0/3009016182 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8840058050 con 0x55b7229c85d0 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f8860d7f740 10 client.15795 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.053+0000 7f8860d7f740 1 -- 172.21.15.98:0/3009016182 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b7229e5ef0 con 0x55b7229c85d0 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.054+0000 7f88377fe640 1 -- 172.21.15.98:0/3009016182 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8840003d50 con 0x55b7229c85d0 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.054+0000 7f88377fe640 1 -- 172.21.15.98:0/3009016182 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8840049a10 con 0x55b7229c85d0 2024-09-19T07:23:43.072 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.054+0000 7f8860d7f740 10 client.15795 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.054+0000 7f8860d7f740 10 client.15795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.054+0000 7f8860d7f740 20 client.15795 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.054+0000 7f8860d7f740 1 --2- 172.21.15.98:0/3009016182 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b7229e7240 0x55b7229e9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.054+0000 7f8860d7f740 4 client.15795 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.054+0000 7f8860d7f740 1 -- 172.21.15.98:0/3009016182 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b72293b860 con 0x55b7229e7240 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.054+0000 7f8857fff640 1 --2- 172.21.15.98:0/3009016182 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b7229e7240 0x55b7229e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f8857fff640 1 --2- 172.21.15.98:0/3009016182 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b7229e7240 0x55b7229e9630 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9435022ff7739571 server_cookie=e48113ac1a64703e in_seq=0 out_seq=0 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f88377fe640 10 client.15795 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f88377fe640 1 -- 172.21.15.98:0/3009016182 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b72293b860 con 0x55b7229e7240 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f88377fe640 10 client.15795 handle_command_reply: tid=0 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f8860d7f740 1 client.15795 shutdown 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f8860d7f740 1 -- 172.21.15.98:0/3009016182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 msgr2=0x55b7229d72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f8860d7f740 1 --2- 172.21.15.98:0/3009016182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 0x55b7229d72e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8840006010 tx=0x7f8840005a20 comp rx=0 tx=0).stop 2024-09-19T07:23:43.073 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f8860d7f740 1 -- 172.21.15.98:0/3009016182 shutdown_connections 2024-09-19T07:23:43.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f8860d7f740 1 --2- 172.21.15.98:0/3009016182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229d7970 0x55b7229d4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f8860d7f740 1 --2- 172.21.15.98:0/3009016182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c9a20 0x55b7229d4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f8860d7f740 1 --2- 172.21.15.98:0/3009016182 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b7229e7240 0x55b7229e9630 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f8860d7f740 1 --2- 172.21.15.98:0/3009016182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 0x55b7229d72e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f88377fe640 0 client.15795 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:43.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.055+0000 7f8860d7f740 1 -- 172.21.15.98:0/3009016182 >> 172.21.15.98:0/3009016182 conn(0x55b722991310 msgr2=0x55b7229ca9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:43.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.056+0000 7f8860d7f740 1 -- 172.21.15.98:0/3009016182 shutdown_connections 2024-09-19T07:23:43.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.056+0000 7f8860d7f740 1 -- 172.21.15.98:0/3009016182 wait complete. 2024-09-19T07:23:43.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.056+0000 7f8860d7f740 20 client.15795 trim_cache size 0 max 16384 2024-09-19T07:23:43.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8860d7f740 1 Processor -- start 2024-09-19T07:23:43.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8860d7f740 1 -- start start 2024-09-19T07:23:43.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8860d7f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c85d0 0x55b7229d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8860d7f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 0x55b7229d8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.078 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8860d7f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229d7970 0x55b7229ec650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8860d7f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f88581ae020 con 0x55b7229c9a20 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8860d7f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f88581ab8f0 con 0x55b7229c85d0 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8860d7f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88581a9740 con 0x55b7229d7970 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8857fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 0x55b7229d8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8857fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 0x55b7229d8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59102/0 (socket says 172.21.15.98:59102) 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8857fff640 1 -- 172.21.15.98:0/3437033809 learned_addr learned my addr 172.21.15.98:0/3437033809 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8857fff640 1 -- 172.21.15.98:0/3437033809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229d7970 msgr2=0x55b7229ec650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8857fff640 1 --2- 172.21.15.98:0/3437033809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229d7970 0x55b7229ec650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8857fff640 1 -- 172.21.15.98:0/3437033809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c85d0 msgr2=0x55b7229d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f884ffff640 1 --2- 172.21.15.98:0/3437033809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c85d0 0x55b7229d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8857fff640 1 --2- 172.21.15.98:0/3437033809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c85d0 0x55b7229d3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8857fff640 1 -- 172.21.15.98:0/3437033809 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7229d3560 con 0x55b7229c9a20 2024-09-19T07:23:43.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.069+0000 7f8857fff640 1 --2- 172.21.15.98:0/3437033809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 0x55b7229d8460 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x55b7229d5bd0 tx=0x7f8848009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf21b82021141fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.070+0000 7f884dffb640 1 -- 172.21.15.98:0/3437033809 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8848016d10 con 0x55b7229c9a20 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.070+0000 7f884dffb640 1 -- 172.21.15.98:0/3437033809 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8848024910 con 0x55b7229c9a20 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.070+0000 7f884dffb640 1 -- 172.21.15.98:0/3437033809 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8848014730 con 0x55b7229c9a20 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.070+0000 7f8860d7f740 1 -- 172.21.15.98:0/3437033809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 msgr2=0x55b7229d8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.070+0000 7f8860d7f740 1 --2- 172.21.15.98:0/3437033809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 0x55b7229d8460 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x55b7229d5bd0 tx=0x7f8848009110 comp rx=0 tx=0).stop 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.070+0000 7f8860d7f740 1 -- 172.21.15.98:0/3437033809 shutdown_connections 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.070+0000 7f8860d7f740 1 --2- 172.21.15.98:0/3437033809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229d7970 0x55b7229ec650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.070+0000 7f8860d7f740 1 --2- 172.21.15.98:0/3437033809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c9a20 0x55b7229d8460 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.070+0000 7f8860d7f740 1 --2- 172.21.15.98:0/3437033809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c85d0 0x55b7229d3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.070+0000 7f8860d7f740 1 -- 172.21.15.98:0/3437033809 >> 172.21.15.98:0/3437033809 conn(0x55b722991310 msgr2=0x55b7229d7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.070+0000 7f8860d7f740 1 -- 172.21.15.98:0/3437033809 shutdown_connections 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.070+0000 7f8860d7f740 1 -- 172.21.15.98:0/3437033809 wait complete. 2024-09-19T07:23:43.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f8860d7f740 1 -- start start 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f8860d7f740 1 Processor -- start 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f8860d7f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 0x55b7229ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f8860d7f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c9a20 0x55b7229ea270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f8860d7f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229d7970 0x55b7229eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f8860d7f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f88581a9db0 con 0x55b7229c85d0 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f8860d7f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f88581ab220 con 0x55b7229c9a20 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f8860d7f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88581aa480 con 0x55b7229d7970 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f8860d7f740 10 client.0 _ll_register_callbacks cb 0x7f8840004440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f884ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 0x55b7229ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f884ffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 0x55b7229ecf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59108/0 (socket says 172.21.15.98:59108) 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f884ffff640 1 -- 172.21.15.98:0/763280197 learned_addr learned my addr 172.21.15.98:0/763280197 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.071+0000 7f8857fff640 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c9a20 0x55b7229ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f884ffff640 1 -- 172.21.15.98:0/763280197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229d7970 msgr2=0x55b7229eaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:43.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f884ffff640 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229d7970 0x55b7229eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f884ffff640 1 -- 172.21.15.98:0/763280197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c9a20 msgr2=0x55b7229ea270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:43.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f884ffff640 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c9a20 0x55b7229ea270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f884ffff640 1 -- 172.21.15.98:0/763280197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b722a50b80 con 0x55b7229c85d0 2024-09-19T07:23:43.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f8857fff640 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c9a20 0x55b7229ea270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:43.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f884ffff640 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 0x55b7229ecf20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f884002a930 tx=0x7f8840005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3d9347a02d8d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:43.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f88377fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:43.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f88377fe640 1 -- 172.21.15.98:0/763280197 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840060070 con 0x55b7229c85d0 2024-09-19T07:23:43.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f88377fe640 1 -- 172.21.15.98:0/763280197 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8840005020 con 0x55b7229c85d0 2024-09-19T07:23:43.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f8860d7f740 1 -- 172.21.15.98:0/763280197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8848024910 con 0x55b7229c85d0 2024-09-19T07:23:43.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f88377fe640 1 -- 172.21.15.98:0/763280197 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8840069050 con 0x55b7229c85d0 2024-09-19T07:23:43.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f8860d7f740 10 client.15801 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f8860d7f740 1 -- 172.21.15.98:0/763280197 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b722a51d00 con 0x55b7229c85d0 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.072+0000 7f88377fe640 1 -- 172.21.15.98:0/763280197 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8848024910 con 0x55b7229c85d0 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.073+0000 7f88377fe640 1 -- 172.21.15.98:0/763280197 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8840063020 con 0x55b7229c85d0 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.073+0000 7f8860d7f740 10 client.15801 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.073+0000 7f8860d7f740 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.073+0000 7f8860d7f740 20 client.15801 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.073+0000 7f8860d7f740 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b722a52300 0x55b722a54720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.073+0000 7f8860d7f740 4 client.15801 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.073+0000 7f8860d7f740 1 -- 172.21.15.98:0/763280197 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b722935d70 con 0x55b722a52300 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.073+0000 7f8857fff640 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b722a52300 0x55b722a54720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.073+0000 7f88377fe640 10 client.15801 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.073+0000 7f8857fff640 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b722a52300 0x55b722a54720 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dd6b8ce60a46da2 server_cookie=3b302755400cdf3a in_seq=0 out_seq=0 2024-09-19T07:23:43.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.073+0000 7f88377fe640 1 -- 172.21.15.98:0/763280197 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b722935d70 con 0x55b722a52300 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.073+0000 7f88377fe640 10 client.15801 handle_command_reply: tid=0 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f8860d7f740 1 client.15801 shutdown 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f8860d7f740 1 -- 172.21.15.98:0/763280197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 msgr2=0x55b7229ecf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f8860d7f740 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 0x55b7229ecf20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f884002a930 tx=0x7f8840005b50 comp rx=0 tx=0).stop 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f8860d7f740 1 -- 172.21.15.98:0/763280197 shutdown_connections 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f8860d7f740 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b7229d7970 0x55b7229eaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f8860d7f740 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b7229c9a20 0x55b7229ea270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f8860d7f740 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b722a52300 0x55b722a54720 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f88377fe640 0 client.15801 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f8860d7f740 1 --2- 172.21.15.98:0/763280197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7229c85d0 0x55b7229ecf20 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f8860d7f740 1 -- 172.21.15.98:0/763280197 >> 172.21.15.98:0/763280197 conn(0x55b722991310 msgr2=0x55b7229d8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f8860d7f740 1 -- 172.21.15.98:0/763280197 shutdown_connections 2024-09-19T07:23:43.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f8860d7f740 1 -- 172.21.15.98:0/763280197 wait complete. 2024-09-19T07:23:43.085 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f8860d7f740 20 client.15801 trim_cache size 0 max 16384 2024-09-19T07:23:43.085 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:23:43.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f885e9a6640 1 -- 172.21.15.98:0/557885795 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f88440a33b0 msgr2=0x7f88440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:43.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f885e9a6640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f88440a33b0 0x7f88440a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f88500989d0 tx=0x7f885006dd80 comp rx=0 tx=0).stop 2024-09-19T07:23:43.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f885e9a6640 1 -- 172.21.15.98:0/557885795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8858105a90 msgr2=0x7f885819bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:43.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f885e9a6640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8858105a90 0x7f885819bd60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f885000cad0 tx=0x7f885000ced0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f885e9a6640 1 -- 172.21.15.98:0/557885795 shutdown_connections 2024-09-19T07:23:43.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f885e9a6640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f88440a33b0 0x7f88440a5870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f885e9a6640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8858105a90 0x7f885819bd60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f885e9a6640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8858101bc0 0x7f88581979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f885e9a6640 1 --2- 172.21.15.98:0/557885795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858101240 0x7f8858197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:43.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.074+0000 7f885e9a6640 1 -- 172.21.15.98:0/557885795 >> 172.21.15.98:0/557885795 conn(0x7f8858077210 msgr2=0x7f8858103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:43.086 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.075+0000 7f885e9a6640 1 -- 172.21.15.98:0/557885795 shutdown_connections 2024-09-19T07:23:43.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:43.075+0000 7f885e9a6640 1 -- 172.21.15.98:0/557885795 wait complete. 2024-09-19T07:23:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:43 smithi098 ceph-mon[30950]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T07:23:44.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:43 smithi162 ceph-mon[35726]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T07:23:44.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:43 smithi139 ceph-mon[35039]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T07:23:44.698 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:23:44.699 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:23:44.961 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:45.097 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:23:45.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.463+0000 7f8b858a1640 1 -- 172.21.15.98:0/1935647511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102790 msgr2=0x7f8b801067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:45.489 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.463+0000 7f8b858a1640 1 --2- 172.21.15.98:0/1935647511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102790 0x7f8b801067e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009900 tx=0x7f8b6802a410 comp rx=0 tx=0).stop 2024-09-19T07:23:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.463+0000 7f8b858a1640 1 -- 172.21.15.98:0/1935647511 shutdown_connections 2024-09-19T07:23:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.463+0000 7f8b858a1640 1 --2- 172.21.15.98:0/1935647511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b80106f10 0x7f8b8010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.463+0000 7f8b858a1640 1 --2- 172.21.15.98:0/1935647511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102790 0x7f8b801067e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.463+0000 7f8b858a1640 1 --2- 172.21.15.98:0/1935647511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b80101de0 0x7f8b801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.463+0000 7f8b858a1640 1 -- 172.21.15.98:0/1935647511 >> 172.21.15.98:0/1935647511 conn(0x7f8b800fd8c0 msgr2=0x7f8b800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.463+0000 7f8b858a1640 1 -- 172.21.15.98:0/1935647511 shutdown_connections 2024-09-19T07:23:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.463+0000 7f8b858a1640 1 -- 172.21.15.98:0/1935647511 wait complete. 2024-09-19T07:23:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.464+0000 7f8b858a1640 1 Processor -- start 2024-09-19T07:23:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.464+0000 7f8b858a1640 1 -- start start 2024-09-19T07:23:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.464+0000 7f8b858a1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b80101de0 0x7f8b801983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.464+0000 7f8b858a1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102790 0x7f8b801988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.464+0000 7f8b858a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b80106f10 0x7f8b8019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.464+0000 7f8b858a1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80111f70 con 0x7f8b80102790 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.464+0000 7f8b858a1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80111df0 con 0x7f8b80101de0 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.464+0000 7f8b858a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b801120f0 con 0x7f8b80106f10 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.464+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102790 0x7f8b801988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.464+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102790 0x7f8b801988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59130/0 (socket says 172.21.15.98:59130) 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.464+0000 7f8b77fff640 1 -- 172.21.15.98:0/524643778 learned_addr learned my addr 172.21.15.98:0/524643778 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.464+0000 7f8b7f7fe640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b80106f10 0x7f8b8019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b7effd640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b80101de0 0x7f8b801983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b77fff640 1 -- 172.21.15.98:0/524643778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b80106f10 msgr2=0x7f8b8019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b77fff640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b80106f10 0x7f8b8019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b77fff640 1 -- 172.21.15.98:0/524643778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b80101de0 msgr2=0x7f8b801983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b77fff640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b80101de0 0x7f8b801983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b77fff640 1 -- 172.21.15.98:0/524643778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8019d360 con 0x7f8b80102790 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b7effd640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b80101de0 0x7f8b801983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b77fff640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102790 0x7f8b801988f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8b68006010 tx=0x7f8b680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b8489f640 1 -- 172.21.15.98:0/524643778 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6803f030 con 0x7f8b80102790 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b8489f640 1 -- 172.21.15.98:0/524643778 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b68003ce0 con 0x7f8b80102790 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b858a1640 1 -- 172.21.15.98:0/524643778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8019d5f0 con 0x7f8b80102790 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b8489f640 1 -- 172.21.15.98:0/524643778 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68035070 con 0x7f8b80102790 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.465+0000 7f8b858a1640 1 -- 172.21.15.98:0/524643778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b801a4f30 con 0x7f8b80102790 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.467+0000 7f8b8489f640 1 -- 172.21.15.98:0/524643778 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8b68042030 con 0x7f8b80102790 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.467+0000 7f8b87c7a740 1 Processor -- start 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b87c7a740 1 -- start start 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b87c7a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29db60 0x556c8f29df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b87c7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29e480 0x556c8f2a8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b87c7a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2ab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b8489f640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8b6c0a3430 0x7f8b6c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b87c7a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556c8f203280 con 0x556c8f2a8d40 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b87c7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556c8f1aab10 con 0x556c8f29e480 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b87c7a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556c8f1ff240 con 0x556c8f29db60 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b7f7fe640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8b6c0a3430 0x7f8b6c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b77fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59142/0 (socket says 172.21.15.98:59142) 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b77fff640 1 -- 172.21.15.98:0/3486778627 learned_addr learned my addr 172.21.15.98:0/3486778627 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b7f7fe640 1 --2- 172.21.15.98:0/3486778627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29db60 0x556c8f29df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b7effd640 1 --2- 172.21.15.98:0/3486778627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29e480 0x556c8f2a8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b8489f640 1 -- 172.21.15.98:0/524643778 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8b680f0340 con 0x7f8b80102790 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b77fff640 1 -- 172.21.15.98:0/3486778627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29db60 msgr2=0x556c8f29df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b77fff640 1 --2- 172.21.15.98:0/3486778627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29db60 0x556c8f29df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.493 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b77fff640 1 -- 172.21.15.98:0/3486778627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29e480 msgr2=0x556c8f2a8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b77fff640 1 --2- 172.21.15.98:0/3486778627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29e480 0x556c8f2a8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b77fff640 1 -- 172.21.15.98:0/3486778627 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8f1b71f0 con 0x556c8f2a8d40 2024-09-19T07:23:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.468+0000 7f8b7f7fe640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8b6c0a3430 0x7f8b6c0a58f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b78007fd0 tx=0x7f8b78007d60 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b77fff640 1 --2- 172.21.15.98:0/3486778627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2ab130 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8b680b8a60 tx=0x7f8b6808f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f72146d7780458 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b75ffb640 1 -- 172.21.15.98:0/3486778627 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68049070 con 0x556c8f2a8d40 2024-09-19T07:23:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b75ffb640 1 -- 172.21.15.98:0/3486778627 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b68041e70 con 0x556c8f2a8d40 2024-09-19T07:23:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b75ffb640 1 -- 172.21.15.98:0/3486778627 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680bc650 con 0x556c8f2a8d40 2024-09-19T07:23:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b87c7a740 1 -- 172.21.15.98:0/3486778627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 msgr2=0x556c8f2ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/3486778627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2ab130 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8b680b8a60 tx=0x7f8b6808f540 comp rx=0 tx=0).stop 2024-09-19T07:23:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b87c7a740 1 -- 172.21.15.98:0/3486778627 shutdown_connections 2024-09-19T07:23:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/3486778627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2ab130 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.494 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/3486778627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29e480 0x556c8f2a8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/3486778627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29db60 0x556c8f29df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b87c7a740 1 -- 172.21.15.98:0/3486778627 >> 172.21.15.98:0/3486778627 conn(0x556c8f29a0f0 msgr2=0x556c8f29a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b87c7a740 1 -- 172.21.15.98:0/3486778627 shutdown_connections 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.469+0000 7f8b87c7a740 1 -- 172.21.15.98:0/3486778627 wait complete. 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b87c7a740 1 -- start start 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b87c7a740 1 Processor -- start 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b87c7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29db60 0x556c8f2a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b87c7a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29e480 0x556c8f2a6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b87c7a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2a6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b87c7a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556c8f2ab6d0 con 0x556c8f2a8d40 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b87c7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556c8f1bdf10 con 0x556c8f29db60 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b87c7a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556c8f2ab850 con 0x556c8f29e480 2024-09-19T07:23:45.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b87c7a740 10 client.0 _ll_register_callbacks cb 0x556c8f186a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b7f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b7f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2a6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59158/0 (socket says 172.21.15.98:59158) 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b7f7fe640 1 -- 172.21.15.98:0/1262405420 learned_addr learned my addr 172.21.15.98:0/1262405420 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b7effd640 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29db60 0x556c8f2a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.470+0000 7f8b77fff640 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29e480 0x556c8f2a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b7f7fe640 1 -- 172.21.15.98:0/1262405420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29e480 msgr2=0x556c8f2a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b7f7fe640 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29e480 0x556c8f2a6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b7f7fe640 1 -- 172.21.15.98:0/1262405420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29db60 msgr2=0x556c8f2a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b7f7fe640 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29db60 0x556c8f2a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b7f7fe640 1 -- 172.21.15.98:0/1262405420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c8ef746a0 con 0x556c8f2a8d40 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b7effd640 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29db60 0x556c8f2a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b7f7fe640 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2a6770 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8b78014440 tx=0x7f8b78007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc89d7e7a95a13e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:45.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b5effd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b5effd640 1 -- 172.21.15.98:0/1262405420 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78026070 con 0x556c8f2a8d40 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b5effd640 1 -- 172.21.15.98:0/1262405420 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8b78020860 con 0x556c8f2a8d40 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1262405420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556c8f2107f0 con 0x556c8f2a8d40 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b5effd640 1 -- 172.21.15.98:0/1262405420 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8b78032050 con 0x556c8f2a8d40 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b87c7a740 10 client.15813 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1262405420 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556c8f2b72a0 con 0x556c8f2a8d40 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b5effd640 1 -- 172.21.15.98:0/1262405420 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x556c8f2107f0 con 0x556c8f2a8d40 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.471+0000 7f8b5effd640 1 -- 172.21.15.98:0/1262405420 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8b7800fa80 con 0x556c8f2a8d40 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.472+0000 7f8b87c7a740 10 client.15813 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.472+0000 7f8b87c7a740 10 client.15813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.472+0000 7f8b87c7a740 20 client.15813 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.472+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556c8f2b86b0 0x556c8f2bab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.472+0000 7f8b87c7a740 4 client.15813 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:45.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.472+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1262405420 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c8f20ad00 con 0x556c8f2b86b0 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.472+0000 7f8b7effd640 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556c8f2b86b0 0x556c8f2bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.472+0000 7f8b7effd640 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556c8f2b86b0 0x556c8f2bab10 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d1834636bcfc769 server_cookie=f4ec7fbb51bdac11 in_seq=0 out_seq=0 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.472+0000 7f8b5effd640 10 client.15813 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b5effd640 1 -- 172.21.15.98:0/1262405420 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c8f20ad00 con 0x556c8f2b86b0 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b5effd640 10 client.15813 handle_command_reply: tid=0 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b87c7a740 1 client.15813 shutdown 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1262405420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 msgr2=0x556c8f2a6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2a6770 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8b78014440 tx=0x7f8b78007520 comp rx=0 tx=0).stop 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1262405420 shutdown_connections 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556c8f2b86b0 0x556c8f2bab10 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2a6770 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29e480 0x556c8f2a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1262405420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29db60 0x556c8f2a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1262405420 >> 172.21.15.98:0/1262405420 conn(0x556c8f29a0f0 msgr2=0x556c8f29fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:45.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b5effd640 0 client.15813 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:45.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1262405420 shutdown_connections 2024-09-19T07:23:45.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1262405420 wait complete. 2024-09-19T07:23:45.499 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.473+0000 7f8b87c7a740 20 client.15813 trim_cache size 0 max 16384 2024-09-19T07:23:45.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.490+0000 7f8b87c7a740 1 Processor -- start 2024-09-19T07:23:45.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.490+0000 7f8b87c7a740 1 -- start start 2024-09-19T07:23:45.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b87c7a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29db60 0x556c8f2a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b87c7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29e480 0x556c8f2c0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b87c7a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2c0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.503 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b87c7a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b801b01a0 con 0x556c8f2a8d40 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b87c7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8b801ada70 con 0x556c8f29e480 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b87c7a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b801ab8c0 con 0x556c8f29db60 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b7f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2c0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b7f7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2c0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59166/0 (socket says 172.21.15.98:59166) 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b7f7fe640 1 -- 172.21.15.98:0/1787484947 learned_addr learned my addr 172.21.15.98:0/1787484947 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b7effd640 1 --2- 172.21.15.98:0/1787484947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29db60 0x556c8f2a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b7f7fe640 1 -- 172.21.15.98:0/1787484947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29db60 msgr2=0x556c8f2a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b7f7fe640 1 --2- 172.21.15.98:0/1787484947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29db60 0x556c8f2a7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b77fff640 1 --2- 172.21.15.98:0/1787484947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29e480 0x556c8f2c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b7f7fe640 1 -- 172.21.15.98:0/1787484947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29e480 msgr2=0x556c8f2c0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b7f7fe640 1 --2- 172.21.15.98:0/1787484947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29e480 0x556c8f2c0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b7f7fe640 1 -- 172.21.15.98:0/1787484947 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8f2b48a0 con 0x556c8f2a8d40 2024-09-19T07:23:45.504 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b7f7fe640 1 --2- 172.21.15.98:0/1787484947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2c0970 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8b78005f10 tx=0x7f8b7801f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbb05f6c21fed2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b757fa640 1 -- 172.21.15.98:0/1787484947 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78026070 con 0x556c8f2a8d40 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b757fa640 1 -- 172.21.15.98:0/1787484947 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b78012cb0 con 0x556c8f2a8d40 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.491+0000 7f8b757fa640 1 -- 172.21.15.98:0/1787484947 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78020660 con 0x556c8f2a8d40 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.492+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1787484947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 msgr2=0x556c8f2c0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.492+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1787484947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2c0970 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8b78005f10 tx=0x7f8b7801f5f0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.492+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1787484947 shutdown_connections 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.492+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1787484947 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f2a8d40 0x556c8f2c0970 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.492+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1787484947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f29e480 0x556c8f2c0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.492+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1787484947 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29db60 0x556c8f2a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.492+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1787484947 >> 172.21.15.98:0/1787484947 conn(0x556c8f29a0f0 msgr2=0x556c8f2a7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.492+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1787484947 shutdown_connections 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.492+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1787484947 wait complete. 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.492+0000 7f8b87c7a740 1 -- start start 2024-09-19T07:23:45.505 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b87c7a740 1 Processor -- start 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b87c7a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f29db60 0x556c8f2ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b87c7a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29e480 0x556c8f2acd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b87c7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f2a8d40 0x556c8f2ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b87c7a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b801abf30 con 0x556c8f29db60 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b87c7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8b801ad3a0 con 0x556c8f2a8d40 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b87c7a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8b801ac600 con 0x556c8f29e480 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b87c7a740 10 client.0 _ll_register_callbacks cb 0x7f8b78011d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b7effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f29db60 0x556c8f2ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b7effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f29db60 0x556c8f2ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59178/0 (socket says 172.21.15.98:59178) 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b7effd640 1 -- 172.21.15.98:0/1686840357 learned_addr learned my addr 172.21.15.98:0/1686840357 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b7f7fe640 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f2a8d40 0x556c8f2ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b77fff640 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29e480 0x556c8f2acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.506 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b7effd640 1 -- 172.21.15.98:0/1686840357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29e480 msgr2=0x556c8f2acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b7effd640 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29e480 0x556c8f2acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b7effd640 1 -- 172.21.15.98:0/1686840357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f2a8d40 msgr2=0x556c8f2ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b7effd640 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f2a8d40 0x556c8f2ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b7effd640 1 -- 172.21.15.98:0/1686840357 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c8f322480 con 0x556c8f29db60 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b7effd640 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f29db60 0x556c8f2ac840 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8b700099f0 tx=0x7f8b70013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ceeebe09fd976f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.493+0000 7f8b5effd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.494+0000 7f8b5effd640 1 -- 172.21.15.98:0/1686840357 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70004220 con 0x556c8f29db60 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.494+0000 7f8b5effd640 1 -- 172.21.15.98:0/1686840357 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8b700043c0 con 0x556c8f29db60 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.494+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1686840357 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b78012cb0 con 0x556c8f29db60 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.494+0000 7f8b5effd640 1 -- 172.21.15.98:0/1686840357 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8b700035f0 con 0x556c8f29db60 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.494+0000 7f8b87c7a740 10 client.15819 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.494+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1686840357 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556c8f323800 con 0x556c8f29db60 2024-09-19T07:23:45.507 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.494+0000 7f8b5effd640 1 -- 172.21.15.98:0/1686840357 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b78012cb0 con 0x556c8f29db60 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.495+0000 7f8b5effd640 1 -- 172.21.15.98:0/1686840357 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8b7000f040 con 0x556c8f29db60 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.495+0000 7f8b87c7a740 10 client.15819 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.495+0000 7f8b87c7a740 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.495+0000 7f8b87c7a740 20 client.15819 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.495+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556c8f323f20 0x556c8f326310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.495+0000 7f8b87c7a740 4 client.15819 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.495+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1686840357 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556c8f187110 con 0x556c8f323f20 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.495+0000 7f8b77fff640 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556c8f323f20 0x556c8f326310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.495+0000 7f8b77fff640 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556c8f323f20 0x556c8f326310 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f8ee89ce0584877 server_cookie=ae55cb414bd20573 in_seq=0 out_seq=0 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.495+0000 7f8b5effd640 10 client.15819 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.496+0000 7f8b5effd640 1 -- 172.21.15.98:0/1686840357 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556c8f187110 con 0x556c8f323f20 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.496+0000 7f8b5effd640 10 client.15819 handle_command_reply: tid=0 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.496+0000 7f8b87c7a740 1 client.15819 shutdown 2024-09-19T07:23:45.508 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.496+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1686840357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f29db60 msgr2=0x556c8f2ac840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:45.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.496+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f29db60 0x556c8f2ac840 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8b700099f0 tx=0x7f8b70013830 comp rx=0 tx=0).stop 2024-09-19T07:23:45.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.496+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1686840357 shutdown_connections 2024-09-19T07:23:45.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.496+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556c8f2a8d40 0x556c8f2ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.496+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c8f29e480 0x556c8f2acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.496+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x556c8f323f20 0x556c8f326310 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.496+0000 7f8b87c7a740 1 --2- 172.21.15.98:0/1686840357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556c8f29db60 0x556c8f2ac840 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.496+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1686840357 >> 172.21.15.98:0/1686840357 conn(0x556c8f29a0f0 msgr2=0x556c8f2b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:45.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b5effd640 0 client.15819 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:45.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1686840357 shutdown_connections 2024-09-19T07:23:45.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b87c7a740 1 -- 172.21.15.98:0/1686840357 wait complete. 2024-09-19T07:23:45.509 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b87c7a740 20 client.15819 trim_cache size 0 max 16384 2024-09-19T07:23:45.510 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:23:45.510 INFO:teuthology.orchestra.run.smithi098.stdout: "return_code": 0, 2024-09-19T07:23:45.510 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_tag": "13d639df-caab-476b-b229-cab1313eca6d", 2024-09-19T07:23:45.510 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": "asynchronous" 2024-09-19T07:23:45.510 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:23:45.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b858a1640 1 -- 172.21.15.98:0/524643778 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8b6c0a3430 msgr2=0x7f8b6c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:45.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b858a1640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8b6c0a3430 0x7f8b6c0a58f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b78007fd0 tx=0x7f8b78007d60 comp rx=0 tx=0).stop 2024-09-19T07:23:45.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b858a1640 1 -- 172.21.15.98:0/524643778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102790 msgr2=0x7f8b801988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:45.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b858a1640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102790 0x7f8b801988f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8b68006010 tx=0x7f8b680042f0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b858a1640 1 -- 172.21.15.98:0/524643778 shutdown_connections 2024-09-19T07:23:45.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b858a1640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8b6c0a3430 0x7f8b6c0a58f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b858a1640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b80106f10 0x7f8b8019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b858a1640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b80102790 0x7f8b801988f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b858a1640 1 --2- 172.21.15.98:0/524643778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8b80101de0 0x7f8b801983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:45.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b858a1640 1 -- 172.21.15.98:0/524643778 >> 172.21.15.98:0/524643778 conn(0x7f8b800fd8c0 msgr2=0x7f8b800fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:45.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b858a1640 1 -- 172.21.15.98:0/524643778 shutdown_connections 2024-09-19T07:23:45.511 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:45.497+0000 7f8b858a1640 1 -- 172.21.15.98:0/524643778 wait complete. 2024-09-19T07:23:46.114 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:45 smithi098 ceph-mon[30950]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-19T07:23:46.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:45 smithi162 ceph-mon[35726]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-19T07:23:46.161 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:23:46.291 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:46.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:45 smithi139 ceph-mon[35039]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-19T07:23:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.776+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/940118955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e48100e20 msgr2=0x7f8e48101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.776+0000 7f8e4dcfc640 1 --2- 172.21.15.98:0/940118955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e48100e20 0x7f8e48101200 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009900 tx=0x7f8e3802a480 comp rx=0 tx=0).stop 2024-09-19T07:23:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.777+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/940118955 shutdown_connections 2024-09-19T07:23:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.777+0000 7f8e4dcfc640 1 --2- 172.21.15.98:0/940118955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e48102ef0 0x7f8e4810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.777+0000 7f8e4dcfc640 1 --2- 172.21.15.98:0/940118955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e48102570 0x7f8e481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.777+0000 7f8e4dcfc640 1 --2- 172.21.15.98:0/940118955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e48100e20 0x7f8e48101200 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.777+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/940118955 >> 172.21.15.98:0/940118955 conn(0x7f8e480fc7d0 msgr2=0x7f8e480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.777+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/940118955 shutdown_connections 2024-09-19T07:23:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.777+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/940118955 wait complete. 2024-09-19T07:23:46.790 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.777+0000 7f8e4dcfc640 1 Processor -- start 2024-09-19T07:23:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.777+0000 7f8e4dcfc640 1 -- start start 2024-09-19T07:23:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.777+0000 7f8e4dcfc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e48100e20 0x7f8e48198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.777+0000 7f8e4dcfc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e48102570 0x7f8e48198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e4dcfc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e48102ef0 0x7f8e4819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e4dcfc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8e48110f80 con 0x7f8e48102ef0 2024-09-19T07:23:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e4dcfc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8e48110e00 con 0x7f8e48102570 2024-09-19T07:23:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e4dcfc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e48111100 con 0x7f8e48100e20 2024-09-19T07:23:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e47fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e48102ef0 0x7f8e4819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:46.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e477fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e48100e20 0x7f8e48198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:46.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e47fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e48102ef0 0x7f8e4819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59190/0 (socket says 172.21.15.98:59190) 2024-09-19T07:23:46.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e47fff640 1 -- 172.21.15.98:0/1766001961 learned_addr learned my addr 172.21.15.98:0/1766001961 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:46.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e3effd640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e48102570 0x7f8e48198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:46.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e47fff640 1 -- 172.21.15.98:0/1766001961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e48100e20 msgr2=0x7f8e48198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:46.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e47fff640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e48100e20 0x7f8e48198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:46.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e47fff640 1 -- 172.21.15.98:0/1766001961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e48102570 msgr2=0x7f8e48198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:46.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e47fff640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e48102570 0x7f8e48198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:46.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e47fff640 1 -- 172.21.15.98:0/1766001961 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4819d4d0 con 0x7f8e48102ef0 2024-09-19T07:23:46.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e3effd640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e48102570 0x7f8e48198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:23:46.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e47fff640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e48102ef0 0x7f8e4819cdf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000eb10 tx=0x7f8e4000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:46.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e457fa640 1 -- 172.21.15.98:0/1766001961 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40004b20 con 0x7f8e48102ef0 2024-09-19T07:23:46.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/1766001961 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4819d7c0 con 0x7f8e48102ef0 2024-09-19T07:23:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e457fa640 1 -- 172.21.15.98:0/1766001961 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e40004cc0 con 0x7f8e48102ef0 2024-09-19T07:23:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e457fa640 1 -- 172.21.15.98:0/1766001961 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40010760 con 0x7f8e48102ef0 2024-09-19T07:23:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.778+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/1766001961 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e481a50a0 con 0x7f8e48102ef0 2024-09-19T07:23:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.779+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/1766001961 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e48101200 con 0x7f8e48102ef0 2024-09-19T07:23:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.780+0000 7f8e457fa640 1 -- 172.21.15.98:0/1766001961 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8e40005020 con 0x7f8e48102ef0 2024-09-19T07:23:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.781+0000 7f8e457fa640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8e340a33b0 0x7f8e340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.781+0000 7f8e477fe640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8e340a33b0 0x7f8e340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.781+0000 7f8e457fa640 1 -- 172.21.15.98:0/1766001961 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8e400d0300 con 0x7f8e48102ef0 2024-09-19T07:23:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.782+0000 7f8e477fe640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8e340a33b0 0x7f8e340a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009230 tx=0x7f8e380058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:46.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.785+0000 7f8e457fa640 1 -- 172.21.15.98:0/1766001961 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e4009ccb0 con 0x7f8e48102ef0 2024-09-19T07:23:46.877 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:46.993 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.993+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/1766001961 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e481a52a0 con 0x7f8e48102ef0 2024-09-19T07:23:46.993 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:46 smithi098 ceph-mon[30950]: scrub queued for path: / 2024-09-19T07:23:46.994 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:46 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:23:46.994 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:46 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:23:46.994 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:46 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:23:46.994 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:46 smithi098 ceph-mon[30950]: scrub summary: idle 2024-09-19T07:23:46.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.993+0000 7f8e457fa640 1 -- 172.21.15.98:0/1766001961 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f8e4009c5b0 con 0x7f8e48102ef0 2024-09-19T07:23:46.995 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:23:46.995 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:23:46.995 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:23:46.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.996+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/1766001961 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8e340a33b0 msgr2=0x7f8e340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:46.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.996+0000 7f8e4dcfc640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8e340a33b0 0x7f8e340a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009230 tx=0x7f8e380058d0 comp rx=0 tx=0).stop 2024-09-19T07:23:46.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.996+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/1766001961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e48102ef0 msgr2=0x7f8e4819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:46.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.996+0000 7f8e4dcfc640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e48102ef0 0x7f8e4819cdf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8e4000eb10 tx=0x7f8e4000c2d0 comp rx=0 tx=0).stop 2024-09-19T07:23:46.996 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.996+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/1766001961 shutdown_connections 2024-09-19T07:23:46.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.996+0000 7f8e4dcfc640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f8e340a33b0 0x7f8e340a5870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:46.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.996+0000 7f8e4dcfc640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e48102ef0 0x7f8e4819cdf0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:46.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.996+0000 7f8e4dcfc640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e48102570 0x7f8e48198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:46.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.996+0000 7f8e4dcfc640 1 --2- 172.21.15.98:0/1766001961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e48100e20 0x7f8e48198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:46.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.996+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/1766001961 >> 172.21.15.98:0/1766001961 conn(0x7f8e480fc7d0 msgr2=0x7f8e4806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:46.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.996+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/1766001961 shutdown_connections 2024-09-19T07:23:46.997 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:46.996+0000 7f8e4dcfc640 1 -- 172.21.15.98:0/1766001961 wait complete. 2024-09-19T07:23:47.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:46 smithi162 ceph-mon[35726]: scrub queued for path: / 2024-09-19T07:23:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:46 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:23:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:46 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:23:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:46 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:23:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:46 smithi162 ceph-mon[35726]: scrub summary: idle 2024-09-19T07:23:47.300 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.297+0000 7f87c85a6640 1 -- 172.21.15.98:0/82844728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c0101150 msgr2=0x7f87c0107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.300 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.297+0000 7f87c85a6640 1 --2- 172.21.15.98:0/82844728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c0101150 0x7f87c0107990 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009930 tx=0x7f87bc02a4d0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.300 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.297+0000 7f87c85a6640 1 -- 172.21.15.98:0/82844728 shutdown_connections 2024-09-19T07:23:47.300 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.297+0000 7f87c85a6640 1 --2- 172.21.15.98:0/82844728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87c01080f0 0x7f87c010ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.300 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.297+0000 7f87c85a6640 1 --2- 172.21.15.98:0/82844728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c0101150 0x7f87c0107990 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.300 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.297+0000 7f87c85a6640 1 --2- 172.21.15.98:0/82844728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c0100830 0x7f87c0100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.300 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.297+0000 7f87c85a6640 1 -- 172.21.15.98:0/82844728 >> 172.21.15.98:0/82844728 conn(0x7f87c0075ec0 msgr2=0x7f87c00762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:47.300 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.297+0000 7f87c85a6640 1 -- 172.21.15.98:0/82844728 shutdown_connections 2024-09-19T07:23:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.297+0000 7f87c85a6640 1 -- 172.21.15.98:0/82844728 wait complete. 2024-09-19T07:23:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c85a6640 1 Processor -- start 2024-09-19T07:23:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c85a6640 1 -- start start 2024-09-19T07:23:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c85a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c0100830 0x7f87c01983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c85a6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87c0101150 0x7f87c01988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c85a6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c01080f0 0x7f87c019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c85a6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f87c0111f20 con 0x7f87c01080f0 2024-09-19T07:23:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c85a6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f87c0111da0 con 0x7f87c0101150 2024-09-19T07:23:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c85a6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01120a0 con 0x7f87c0100830 2024-09-19T07:23:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c6b43640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c01080f0 0x7f87c019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c6b43640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c01080f0 0x7f87c019cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59208/0 (socket says 172.21.15.98:59208) 2024-09-19T07:23:47.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c6b43640 1 -- 172.21.15.98:0/2591768802 learned_addr learned my addr 172.21.15.98:0/2591768802 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c6342640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c0100830 0x7f87c01983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c5b41640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87c0101150 0x7f87c01988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c6b43640 1 -- 172.21.15.98:0/2591768802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c0100830 msgr2=0x7f87c01983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c6b43640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c0100830 0x7f87c01983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c6b43640 1 -- 172.21.15.98:0/2591768802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87c0101150 msgr2=0x7f87c01988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c6b43640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87c0101150 0x7f87c01988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.298+0000 7f87c6b43640 1 -- 172.21.15.98:0/2591768802 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c019d3a0 con 0x7f87c01080f0 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.299+0000 7f87c6b43640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c01080f0 0x7f87c019cc70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f87b800cad0 tx=0x7f87b800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.299+0000 7f87b77fe640 1 -- 172.21.15.98:0/2591768802 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b800ae20 con 0x7f87c01080f0 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.299+0000 7f87b77fe640 1 -- 172.21.15.98:0/2591768802 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87b8005020 con 0x7f87c01080f0 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.299+0000 7f87c85a6640 1 -- 172.21.15.98:0/2591768802 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c019d690 con 0x7f87c01080f0 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.299+0000 7f87b77fe640 1 -- 172.21.15.98:0/2591768802 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b800f6f0 con 0x7f87c01080f0 2024-09-19T07:23:47.302 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.299+0000 7f87c85a6640 1 -- 172.21.15.98:0/2591768802 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c01a4f20 con 0x7f87c01080f0 2024-09-19T07:23:47.308 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.301+0000 7f87b77fe640 1 -- 172.21.15.98:0/2591768802 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f87b80051d0 con 0x7f87c01080f0 2024-09-19T07:23:47.308 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.301+0000 7f87cb41e740 1 Processor -- start 2024-09-19T07:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87cb41e740 1 -- start start 2024-09-19T07:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87cb41e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 0x56351ce8c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87cb41e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8c820 0x56351ce96b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87cb41e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 0x56351ce994b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87cb41e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56351cdec2f0 con 0x56351ce8bf00 2024-09-19T07:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87cb41e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56351cd94270 con 0x56351ce970c0 2024-09-19T07:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87cb41e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56351cde82b0 con 0x56351ce8c820 2024-09-19T07:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87c5b41640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 0x56351ce8c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87c5b41640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 0x56351ce8c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59214/0 (socket says 172.21.15.98:59214) 2024-09-19T07:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87c5b41640 1 -- 172.21.15.98:0/2775167278 learned_addr learned my addr 172.21.15.98:0/2775167278 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87b77fe640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f87ac0a34e0 0x7f87ac0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.309 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87c6b43640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f87ac0a34e0 0x7f87ac0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87c6342640 1 --2- 172.21.15.98:0/2775167278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8c820 0x56351ce96b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87c5b41640 1 --2- 172.21.15.98:0/2775167278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 0x56351ce994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87b77fe640 1 -- 172.21.15.98:0/2591768802 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f87b80cfda0 con 0x7f87c01080f0 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87c5b41640 1 -- 172.21.15.98:0/2775167278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8c820 msgr2=0x56351ce96b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87c5b41640 1 --2- 172.21.15.98:0/2775167278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8c820 0x56351ce96b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87c5b41640 1 -- 172.21.15.98:0/2775167278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 msgr2=0x56351ce994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87c5b41640 1 --2- 172.21.15.98:0/2775167278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 0x56351ce994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87c5b41640 1 -- 172.21.15.98:0/2775167278 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56351cd93340 con 0x56351ce8bf00 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.302+0000 7f87c6342640 1 --2- 172.21.15.98:0/2775167278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8c820 0x56351ce96b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.303+0000 7f87c5b41640 1 --2- 172.21.15.98:0/2775167278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 0x56351ce8c2e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f87bc031550 tx=0x7f87bc005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d15ae226084f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.303+0000 7f87c6b43640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f87ac0a34e0 0x7f87ac0a59a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f87b80cd570 tx=0x7f87b8092040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.303+0000 7f87b4bfe640 1 -- 172.21.15.98:0/2775167278 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc035050 con 0x56351ce8bf00 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.303+0000 7f87b4bfe640 1 -- 172.21.15.98:0/2775167278 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87bc031950 con 0x56351ce8bf00 2024-09-19T07:23:47.310 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.303+0000 7f87b4bfe640 1 -- 172.21.15.98:0/2775167278 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc004900 con 0x56351ce8bf00 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.303+0000 7f87cb41e740 1 -- 172.21.15.98:0/2775167278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 msgr2=0x56351ce8c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 --2- 172.21.15.98:0/2775167278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 0x56351ce8c2e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f87bc031550 tx=0x7f87bc005a40 comp rx=0 tx=0).stop 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 -- 172.21.15.98:0/2775167278 shutdown_connections 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 --2- 172.21.15.98:0/2775167278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 0x56351ce994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 --2- 172.21.15.98:0/2775167278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8c820 0x56351ce96b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 --2- 172.21.15.98:0/2775167278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 0x56351ce8c2e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 -- 172.21.15.98:0/2775167278 >> 172.21.15.98:0/2775167278 conn(0x56351ce88470 msgr2=0x56351ce88850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 -- 172.21.15.98:0/2775167278 shutdown_connections 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 -- 172.21.15.98:0/2775167278 wait complete. 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 -- start start 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 Processor -- start 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce8bf00 0x56351ce94000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.311 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 0x56351ce94540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce970c0 0x56351ce94a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56351ce99c90 con 0x56351ce8c820 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56351cd75290 con 0x56351ce8bf00 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56351ce99e10 con 0x56351ce970c0 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87cb41e740 10 client.0 _ll_register_callbacks cb 0x56351cda6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87c6342640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 0x56351ce94540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87c6342640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 0x56351ce94540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59226/0 (socket says 172.21.15.98:59226) 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.304+0000 7f87c6342640 1 -- 172.21.15.98:0/367304499 learned_addr learned my addr 172.21.15.98:0/367304499 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87c5b41640 1 --2- 172.21.15.98:0/367304499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce8bf00 0x56351ce94000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87c6342640 1 -- 172.21.15.98:0/367304499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce970c0 msgr2=0x56351ce94a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87c6342640 1 --2- 172.21.15.98:0/367304499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce970c0 0x56351ce94a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87c6342640 1 -- 172.21.15.98:0/367304499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce8bf00 msgr2=0x56351ce94000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87c6342640 1 --2- 172.21.15.98:0/367304499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce8bf00 0x56351ce94000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.312 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87c6342640 1 -- 172.21.15.98:0/367304499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56351caff210 con 0x56351ce8c820 2024-09-19T07:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87c6342640 1 --2- 172.21.15.98:0/367304499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 0x56351ce94540 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f87b000bed0 tx=0x7f87b00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6600b9afdb707c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87a9ffb640 1 -- 172.21.15.98:0/367304499 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0012650 con 0x56351ce8c820 2024-09-19T07:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87a9ffb640 1 -- 172.21.15.98:0/367304499 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f87b00127f0 con 0x56351ce8c820 2024-09-19T07:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87cb41e740 1 -- 172.21.15.98:0/367304499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87bc031950 con 0x56351ce8c820 2024-09-19T07:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87a9ffb640 1 -- 172.21.15.98:0/367304499 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f87b00129f0 con 0x56351ce8c820 2024-09-19T07:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87cb41e740 10 client.15837 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87cb41e740 1 -- 172.21.15.98:0/367304499 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56351cbcb620 con 0x56351ce8c820 2024-09-19T07:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87a9ffb640 1 -- 172.21.15.98:0/367304499 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87bc031950 con 0x56351ce8c820 2024-09-19T07:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87a9ffb640 1 -- 172.21.15.98:0/367304499 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f87b001b430 con 0x56351ce8c820 2024-09-19T07:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87cb41e740 10 client.15837 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:47.313 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87cb41e740 10 client.15837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.305+0000 7f87cb41e740 20 client.15837 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.306+0000 7f87cb41e740 1 --2- 172.21.15.98:0/367304499 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56351cea70c0 0x56351cea9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.306+0000 7f87cb41e740 4 client.15837 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.306+0000 7f87cb41e740 1 -- 172.21.15.98:0/367304499 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56351cdf9a20 con 0x56351cea70c0 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.306+0000 7f87c5b41640 1 --2- 172.21.15.98:0/367304499 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56351cea70c0 0x56351cea9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.306+0000 7f87a9ffb640 10 client.15837 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.306+0000 7f87c5b41640 1 --2- 172.21.15.98:0/367304499 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56351cea70c0 0x56351cea9510 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9094ef5601bd22b server_cookie=cdb5026b96931911 in_seq=0 out_seq=0 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87a9ffb640 1 -- 172.21.15.98:0/367304499 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56351cdf9a20 con 0x56351cea70c0 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87a9ffb640 10 client.15837 handle_command_reply: tid=0 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87cb41e740 1 client.15837 shutdown 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87cb41e740 1 -- 172.21.15.98:0/367304499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 msgr2=0x56351ce94540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87cb41e740 1 --2- 172.21.15.98:0/367304499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 0x56351ce94540 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f87b000bed0 tx=0x7f87b00117b0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.314 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87cb41e740 1 -- 172.21.15.98:0/367304499 shutdown_connections 2024-09-19T07:23:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87cb41e740 1 --2- 172.21.15.98:0/367304499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce970c0 0x56351ce94a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87cb41e740 1 --2- 172.21.15.98:0/367304499 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56351cea70c0 0x56351cea9510 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87cb41e740 1 --2- 172.21.15.98:0/367304499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 0x56351ce94540 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87cb41e740 1 --2- 172.21.15.98:0/367304499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce8bf00 0x56351ce94000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87a9ffb640 0 client.15837 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87cb41e740 1 -- 172.21.15.98:0/367304499 >> 172.21.15.98:0/367304499 conn(0x56351ce88470 msgr2=0x56351ce8e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87cb41e740 1 -- 172.21.15.98:0/367304499 shutdown_connections 2024-09-19T07:23:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87cb41e740 1 -- 172.21.15.98:0/367304499 wait complete. 2024-09-19T07:23:47.315 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.307+0000 7f87cb41e740 20 client.15837 trim_cache size 0 max 16384 2024-09-19T07:23:47.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:46 smithi139 ceph-mon[35039]: scrub queued for path: / 2024-09-19T07:23:47.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:46 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:23:47.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:46 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:23:47.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:46 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:23:47.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:46 smithi139 ceph-mon[35039]: scrub summary: idle 2024-09-19T07:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.321+0000 7f87cb41e740 1 Processor -- start 2024-09-19T07:23:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.321+0000 7f87cb41e740 1 -- start start 2024-09-19T07:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.321+0000 7f87cb41e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 0x56351ce96080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.321+0000 7f87cb41e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8c820 0x56351ceaee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.321+0000 7f87cb41e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 0x56351ceaf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.321+0000 7f87cb41e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01adec0 con 0x56351ce8bf00 2024-09-19T07:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.321+0000 7f87cb41e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01ab790 con 0x56351ce970c0 2024-09-19T07:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.321+0000 7f87cb41e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01a95e0 con 0x56351ce8c820 2024-09-19T07:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.321+0000 7f87c5b41640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 0x56351ce96080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.321+0000 7f87c5b41640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 0x56351ce96080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59238/0 (socket says 172.21.15.98:59238) 2024-09-19T07:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.321+0000 7f87c5b41640 1 -- 172.21.15.98:0/634187982 learned_addr learned my addr 172.21.15.98:0/634187982 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87c6342640 1 --2- 172.21.15.98:0/634187982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8c820 0x56351ceaee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87c5b41640 1 -- 172.21.15.98:0/634187982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8c820 msgr2=0x56351ceaee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87c5b41640 1 --2- 172.21.15.98:0/634187982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8c820 0x56351ceaee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87c5b41640 1 -- 172.21.15.98:0/634187982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 msgr2=0x56351ceaf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87c5b41640 1 --2- 172.21.15.98:0/634187982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 0x56351ceaf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87c5b41640 1 -- 172.21.15.98:0/634187982 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56351ce92f90 con 0x56351ce8bf00 2024-09-19T07:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87c5b41640 1 --2- 172.21.15.98:0/634187982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 0x56351ce96080 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f87bc033000 tx=0x7f87bc02a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686ad205d85b3970 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87abfff640 1 -- 172.21.15.98:0/634187982 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc04e030 con 0x56351ce8bf00 2024-09-19T07:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87abfff640 1 -- 172.21.15.98:0/634187982 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87bc0055d0 con 0x56351ce8bf00 2024-09-19T07:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87abfff640 1 -- 172.21.15.98:0/634187982 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87bc035040 con 0x56351ce8bf00 2024-09-19T07:23:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87cb41e740 1 -- 172.21.15.98:0/634187982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 msgr2=0x56351ce96080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87cb41e740 1 --2- 172.21.15.98:0/634187982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 0x56351ce96080 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f87bc033000 tx=0x7f87bc02a4d0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87cb41e740 1 -- 172.21.15.98:0/634187982 shutdown_connections 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87cb41e740 1 --2- 172.21.15.98:0/634187982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 0x56351ceaf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87cb41e740 1 --2- 172.21.15.98:0/634187982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8c820 0x56351ceaee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.322+0000 7f87cb41e740 1 --2- 172.21.15.98:0/634187982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8bf00 0x56351ce96080 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87cb41e740 1 -- 172.21.15.98:0/634187982 >> 172.21.15.98:0/634187982 conn(0x56351ce88470 msgr2=0x56351ce88850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87cb41e740 1 -- 172.21.15.98:0/634187982 shutdown_connections 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87cb41e740 1 -- 172.21.15.98:0/634187982 wait complete. 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87cb41e740 1 -- start start 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87cb41e740 1 Processor -- start 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87cb41e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8bf00 0x56351ce9f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87cb41e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 0x56351ce9f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87cb41e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 0x56351ce9c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87cb41e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01a9c50 con 0x56351ce8c820 2024-09-19T07:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87cb41e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01ab0c0 con 0x56351ce970c0 2024-09-19T07:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87cb41e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01aa320 con 0x56351ce8bf00 2024-09-19T07:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87cb41e740 10 client.0 _ll_register_callbacks cb 0x7f87b000b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87c6342640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 0x56351ce9f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87c6342640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 0x56351ce9f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59244/0 (socket says 172.21.15.98:59244) 2024-09-19T07:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87c6342640 1 -- 172.21.15.98:0/4064871774 learned_addr learned my addr 172.21.15.98:0/4064871774 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87c5b41640 1 --2- 172.21.15.98:0/4064871774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 0x56351ce9c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87c6342640 1 -- 172.21.15.98:0/4064871774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8bf00 msgr2=0x56351ce9f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87c6342640 1 --2- 172.21.15.98:0/4064871774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8bf00 0x56351ce9f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87c6342640 1 -- 172.21.15.98:0/4064871774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 msgr2=0x56351ce9c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87c6342640 1 --2- 172.21.15.98:0/4064871774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 0x56351ce9c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.323+0000 7f87c6342640 1 -- 172.21.15.98:0/4064871774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56351ce8c650 con 0x56351ce8c820 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87c6342640 1 --2- 172.21.15.98:0/4064871774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 0x56351ce9f5e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x56351ce93870 tx=0x7f87b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361ef71bfd677ce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87a9ffb640 1 -- 172.21.15.98:0/4064871774 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b0030060 con 0x56351ce8c820 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87a9ffb640 1 -- 172.21.15.98:0/4064871774 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f87b001bcd0 con 0x56351ce8c820 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87cb41e740 1 -- 172.21.15.98:0/4064871774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87bc0055d0 con 0x56351ce8c820 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87a9ffb640 1 -- 172.21.15.98:0/4064871774 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f87b0012b90 con 0x56351ce8c820 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87cb41e740 10 client.15843 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87cb41e740 1 -- 172.21.15.98:0/4064871774 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56351cf12280 con 0x56351ce8c820 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87a9ffb640 1 -- 172.21.15.98:0/4064871774 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87bc0055d0 con 0x56351ce8c820 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87a9ffb640 1 -- 172.21.15.98:0/4064871774 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f87b0004640 con 0x56351ce8c820 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87cb41e740 10 client.15843 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87cb41e740 10 client.15843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:47.331 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87cb41e740 20 client.15843 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:47.331 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87cb41e740 1 --2- 172.21.15.98:0/4064871774 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56351cf129a0 0x56351cf14d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.331 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87cb41e740 4 client.15843 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:23:47.331 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87cb41e740 1 -- 172.21.15.98:0/4064871774 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56351cdf3d70 con 0x56351cf129a0 2024-09-19T07:23:47.331 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.324+0000 7f87c5b41640 1 --2- 172.21.15.98:0/4064871774 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56351cf129a0 0x56351cf14d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.331 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.325+0000 7f87c5b41640 1 --2- 172.21.15.98:0/4064871774 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56351cf129a0 0x56351cf14d90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba475c01dcb86ad8 server_cookie=45ed17c109b1ef1d in_seq=0 out_seq=0 2024-09-19T07:23:47.331 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.325+0000 7f87a9ffb640 10 client.15843 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.328+0000 7f87a9ffb640 1 -- 172.21.15.98:0/4064871774 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56351cdf3d70 con 0x56351cf129a0 2024-09-19T07:23:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.328+0000 7f87a9ffb640 10 client.15843 handle_command_reply: tid=0 2024-09-19T07:23:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.328+0000 7f87cb41e740 1 client.15843 shutdown 2024-09-19T07:23:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.328+0000 7f87cb41e740 1 -- 172.21.15.98:0/4064871774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 msgr2=0x56351ce9f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.328+0000 7f87cb41e740 1 --2- 172.21.15.98:0/4064871774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 0x56351ce9f5e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x56351ce93870 tx=0x7f87b000b330 comp rx=0 tx=0).stop 2024-09-19T07:23:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87cb41e740 1 -- 172.21.15.98:0/4064871774 shutdown_connections 2024-09-19T07:23:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87cb41e740 1 --2- 172.21.15.98:0/4064871774 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56351ce970c0 0x56351ce9c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87cb41e740 1 --2- 172.21.15.98:0/4064871774 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56351cf129a0 0x56351cf14d90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87cb41e740 1 --2- 172.21.15.98:0/4064871774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56351ce8c820 0x56351ce9f5e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87cb41e740 1 --2- 172.21.15.98:0/4064871774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56351ce8bf00 0x56351ce9f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87a9ffb640 0 client.15843 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87cb41e740 1 -- 172.21.15.98:0/4064871774 >> 172.21.15.98:0/4064871774 conn(0x56351ce88470 msgr2=0x56351ce947c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87cb41e740 1 -- 172.21.15.98:0/4064871774 shutdown_connections 2024-09-19T07:23:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87cb41e740 1 -- 172.21.15.98:0/4064871774 wait complete. 2024-09-19T07:23:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87cb41e740 20 client.15843 trim_cache size 0 max 16384 2024-09-19T07:23:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:23:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:23:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:23:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:23:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87c85a6640 1 -- 172.21.15.98:0/2591768802 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f87ac0a34e0 msgr2=0x7f87ac0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87c85a6640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f87ac0a34e0 0x7f87ac0a59a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f87b80cd570 tx=0x7f87b8092040 comp rx=0 tx=0).stop 2024-09-19T07:23:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87c85a6640 1 -- 172.21.15.98:0/2591768802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c01080f0 msgr2=0x7f87c019cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87c85a6640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c01080f0 0x7f87c019cc70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f87b800cad0 tx=0x7f87b800cf90 comp rx=0 tx=0).stop 2024-09-19T07:23:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87c85a6640 1 -- 172.21.15.98:0/2591768802 shutdown_connections 2024-09-19T07:23:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87c85a6640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f87ac0a34e0 0x7f87ac0a59a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87c85a6640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f87c01080f0 0x7f87c019cc70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87c85a6640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f87c0101150 0x7f87c01988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87c85a6640 1 --2- 172.21.15.98:0/2591768802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c0100830 0x7f87c01983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87c85a6640 1 -- 172.21.15.98:0/2591768802 >> 172.21.15.98:0/2591768802 conn(0x7f87c0075ec0 msgr2=0x7f87c00ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87c85a6640 1 -- 172.21.15.98:0/2591768802 shutdown_connections 2024-09-19T07:23:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:23:47.329+0000 7f87c85a6640 1 -- 172.21.15.98:0/2591768802 wait complete. 2024-09-19T07:23:47.757 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db --set-id 71cce13a --release --await' 2024-09-19T07:23:47.757 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db --set-id 71cce13a --release --await 2024-09-19T07:23:47.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.923+0000 7fd45273d640 1 -- 172.21.15.98:0/2389742131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd44c102ef0 msgr2=0x7fd44c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.923+0000 7fd45273d640 1 --2- 172.21.15.98:0/2389742131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd44c102ef0 0x7fd44c10da40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd444009ca0 tx=0x7fd44402a950 comp rx=0 tx=0).stop 2024-09-19T07:23:47.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.924+0000 7fd45273d640 1 -- 172.21.15.98:0/2389742131 shutdown_connections 2024-09-19T07:23:47.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.924+0000 7fd45273d640 1 --2- 172.21.15.98:0/2389742131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd44c102ef0 0x7fd44c10da40 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.924+0000 7fd45273d640 1 --2- 172.21.15.98:0/2389742131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd44c102570 0x7fd44c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.924+0000 7fd45273d640 1 --2- 172.21.15.98:0/2389742131 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44c100e20 0x7fd44c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.924+0000 7fd45273d640 1 -- 172.21.15.98:0/2389742131 >> 172.21.15.98:0/2389742131 conn(0x7fd44c0fc7d0 msgr2=0x7fd44c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.924+0000 7fd45273d640 1 -- 172.21.15.98:0/2389742131 shutdown_connections 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.924+0000 7fd45273d640 1 -- 172.21.15.98:0/2389742131 wait complete. 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.924+0000 7fd45273d640 1 Processor -- start 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.924+0000 7fd45273d640 1 -- start start 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd45273d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd44c100e20 0x7fd44c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd45273d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd44c102570 0x7fd44c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd45273d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44c102ef0 0x7fd44c199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd45273d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c110f80 con 0x7fd44c100e20 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd45273d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c110e00 con 0x7fd44c102570 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd45273d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c111100 con 0x7fd44c102ef0 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd44bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd44c100e20 0x7fd44c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd44bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd44c100e20 0x7fd44c1993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59266/0 (socket says 172.21.15.98:59266) 2024-09-19T07:23:47.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd44bfff640 1 -- 172.21.15.98:0/2794406837 learned_addr learned my addr 172.21.15.98:0/2794406837 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd450cda640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44c102ef0 0x7fd44c199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd44b7fe640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd44c102570 0x7fd44c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd44bfff640 1 -- 172.21.15.98:0/2794406837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44c102ef0 msgr2=0x7fd44c199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd44bfff640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44c102ef0 0x7fd44c199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd44bfff640 1 -- 172.21.15.98:0/2794406837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd44c102570 msgr2=0x7fd44c199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd44bfff640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd44c102570 0x7fd44c199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd44bfff640 1 -- 172.21.15.98:0/2794406837 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c1a47d0 con 0x7fd44c100e20 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.925+0000 7fd44bfff640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd44c100e20 0x7fd44c1993d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00d770 tx=0x7fd43c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.926+0000 7fd4497fa640 1 -- 172.21.15.98:0/2794406837 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c017070 con 0x7fd44c100e20 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.926+0000 7fd4497fa640 1 -- 172.21.15.98:0/2794406837 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd43c005500 con 0x7fd44c100e20 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.926+0000 7fd4497fa640 1 -- 172.21.15.98:0/2794406837 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c004e00 con 0x7fd44c100e20 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.926+0000 7fd45273d640 1 -- 172.21.15.98:0/2794406837 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44c1a4ac0 con 0x7fd44c100e20 2024-09-19T07:23:47.942 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.926+0000 7fd45273d640 1 -- 172.21.15.98:0/2794406837 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44c1a4fb0 con 0x7fd44c100e20 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.928+0000 7fd4497fa640 1 -- 172.21.15.98:0/2794406837 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd43c004fa0 con 0x7fd44c100e20 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.928+0000 7fd454b16740 1 Processor -- start 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.928+0000 7fd454b16740 1 -- start start 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.928+0000 7fd454b16740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9532374a0 0x55a953237880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.928+0000 7fd454b16740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953237dc0 0x55a953242140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.928+0000 7fd454b16740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a953244a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.928+0000 7fd454b16740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a95319d2e0 con 0x55a953242680 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.928+0000 7fd454b16740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a953144ce0 con 0x55a953237dc0 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.928+0000 7fd454b16740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a9531992a0 con 0x55a9532374a0 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd44b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a953244a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd450cda640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9532374a0 0x55a953237880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd44b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a953244a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59276/0 (socket says 172.21.15.98:59276) 2024-09-19T07:23:47.943 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd44b7fe640 1 -- 172.21.15.98:0/4115794839 learned_addr learned my addr 172.21.15.98:0/4115794839 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd44bfff640 1 --2- 172.21.15.98:0/4115794839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953237dc0 0x55a953242140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd4497fa640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd4340a33b0 0x7fd4340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd44b7fe640 1 -- 172.21.15.98:0/4115794839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9532374a0 msgr2=0x55a953237880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd44b7fe640 1 --2- 172.21.15.98:0/4115794839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9532374a0 0x55a953237880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd44b7fe640 1 -- 172.21.15.98:0/4115794839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953237dc0 msgr2=0x55a953242140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd44b7fe640 1 --2- 172.21.15.98:0/4115794839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953237dc0 0x55a953242140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd44b7fe640 1 -- 172.21.15.98:0/4115794839 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a953129440 con 0x55a953242680 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd450cda640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd4340a33b0 0x7fd4340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd4497fa640 1 -- 172.21.15.98:0/2794406837 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fd43c0cf720 con 0x7fd44c100e20 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd44b7fe640 1 --2- 172.21.15.98:0/4115794839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a953244a70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd44000bc10 tx=0x7fd4400107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbe921349d6f4b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd4327fc640 1 -- 172.21.15.98:0/4115794839 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440005020 con 0x55a953242680 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd4327fc640 1 -- 172.21.15.98:0/4115794839 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4400047a0 con 0x55a953242680 2024-09-19T07:23:47.944 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.929+0000 7fd4327fc640 1 -- 172.21.15.98:0/4115794839 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440011740 con 0x55a953242680 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.930+0000 7fd454b16740 1 -- 172.21.15.98:0/4115794839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 msgr2=0x55a953244a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.930+0000 7fd450cda640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd4340a33b0 0x7fd4340a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd44c06b050 tx=0x7fd44403c040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.930+0000 7fd454b16740 1 --2- 172.21.15.98:0/4115794839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a953244a70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd44000bc10 tx=0x7fd4400107a0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.930+0000 7fd454b16740 1 -- 172.21.15.98:0/4115794839 shutdown_connections 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.930+0000 7fd454b16740 1 --2- 172.21.15.98:0/4115794839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a953244a70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.930+0000 7fd454b16740 1 --2- 172.21.15.98:0/4115794839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953237dc0 0x55a953242140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.930+0000 7fd454b16740 1 --2- 172.21.15.98:0/4115794839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9532374a0 0x55a953237880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.930+0000 7fd454b16740 1 -- 172.21.15.98:0/4115794839 >> 172.21.15.98:0/4115794839 conn(0x55a953233a30 msgr2=0x55a953233e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.931+0000 7fd454b16740 1 -- 172.21.15.98:0/4115794839 shutdown_connections 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.931+0000 7fd454b16740 1 -- 172.21.15.98:0/4115794839 wait complete. 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.931+0000 7fd454b16740 1 -- start start 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.931+0000 7fd454b16740 1 Processor -- start 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.931+0000 7fd454b16740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9532374a0 0x55a953241f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.945 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.931+0000 7fd454b16740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a953237dc0 0x55a95323f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.931+0000 7fd454b16740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a95323f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.931+0000 7fd454b16740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a953249660 con 0x55a953242680 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.931+0000 7fd454b16740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a953158050 con 0x55a9532374a0 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.931+0000 7fd454b16740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a9532497e0 con 0x55a953237dc0 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.931+0000 7fd454b16740 10 client.0 _ll_register_callbacks cb 0x55a953198160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd450cda640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a95323f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd450cda640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a95323f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59278/0 (socket says 172.21.15.98:59278) 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd450cda640 1 -- 172.21.15.98:0/835003107 learned_addr learned my addr 172.21.15.98:0/835003107 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd44bfff640 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9532374a0 0x55a953241f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd44b7fe640 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a953237dc0 0x55a95323f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd450cda640 1 -- 172.21.15.98:0/835003107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a953237dc0 msgr2=0x55a95323f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd450cda640 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a953237dc0 0x55a95323f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd450cda640 1 -- 172.21.15.98:0/835003107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9532374a0 msgr2=0x55a953241f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd450cda640 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9532374a0 0x55a953241f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.946 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd450cda640 1 -- 172.21.15.98:0/835003107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a952f0e3c0 con 0x55a953242680 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd450cda640 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a95323f750 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd444035000 tx=0x7fd444005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9597b678603ccd52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd42b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd42b7fe640 1 -- 172.21.15.98:0/835003107 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444034040 con 0x55a953242680 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd42b7fe640 1 -- 172.21.15.98:0/835003107 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fd444004050 con 0x55a953242680 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.932+0000 7fd454b16740 1 -- 172.21.15.98:0/835003107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4400047a0 con 0x55a953242680 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.933+0000 7fd42b7fe640 1 -- 172.21.15.98:0/835003107 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd444003e40 con 0x55a953242680 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.933+0000 7fd454b16740 10 client.15855 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.933+0000 7fd454b16740 1 -- 172.21.15.98:0/835003107 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a953254fd0 con 0x55a953242680 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.933+0000 7fd42b7fe640 1 -- 172.21.15.98:0/835003107 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4400047a0 con 0x55a953242680 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.933+0000 7fd42b7fe640 1 -- 172.21.15.98:0/835003107 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd444030b50 con 0x55a953242680 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.933+0000 7fd454b16740 10 client.15855 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.933+0000 7fd454b16740 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.933+0000 7fd454b16740 20 client.15855 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.933+0000 7fd454b16740 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a953256480 0x55a9532588f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.947 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.933+0000 7fd454b16740 4 client.15855 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.933+0000 7fd454b16740 1 -- 172.21.15.98:0/835003107 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9531aa850 con 0x55a953256480 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.933+0000 7fd44bfff640 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a953256480 0x55a9532588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.934+0000 7fd44bfff640 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a953256480 0x55a9532588f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f59def1ed107ca0a server_cookie=a32b517dd53b7b56 in_seq=0 out_seq=0 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.934+0000 7fd42b7fe640 10 client.15855 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.934+0000 7fd42b7fe640 1 -- 172.21.15.98:0/835003107 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9531aa850 con 0x55a953256480 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.934+0000 7fd42b7fe640 10 client.15855 handle_command_reply: tid=0 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.934+0000 7fd454b16740 1 client.15855 shutdown 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.935+0000 7fd454b16740 1 -- 172.21.15.98:0/835003107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 msgr2=0x55a95323f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.935+0000 7fd454b16740 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a95323f750 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd444035000 tx=0x7fd444005c50 comp rx=0 tx=0).stop 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.935+0000 7fd454b16740 1 -- 172.21.15.98:0/835003107 shutdown_connections 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.935+0000 7fd454b16740 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a953256480 0x55a9532588f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.935+0000 7fd454b16740 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a95323f750 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.935+0000 7fd454b16740 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a953237dc0 0x55a95323f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.935+0000 7fd454b16740 1 --2- 172.21.15.98:0/835003107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a9532374a0 0x55a953241f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.948 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.935+0000 7fd42b7fe640 0 client.15855 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:47.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.935+0000 7fd454b16740 1 -- 172.21.15.98:0/835003107 >> 172.21.15.98:0/835003107 conn(0x55a953233a30 msgr2=0x55a953239710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:47.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.935+0000 7fd454b16740 1 -- 172.21.15.98:0/835003107 shutdown_connections 2024-09-19T07:23:47.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.935+0000 7fd454b16740 1 -- 172.21.15.98:0/835003107 wait complete. 2024-09-19T07:23:47.949 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.935+0000 7fd454b16740 20 client.15855 trim_cache size 0 max 16384 2024-09-19T07:23:47.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.954+0000 7fd454b16740 1 Processor -- start 2024-09-19T07:23:47.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.954+0000 7fd454b16740 1 -- start start 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.954+0000 7fd454b16740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9532374a0 0x55a9532528c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.954+0000 7fd454b16740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953237dc0 0x55a953239600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.954+0000 7fd454b16740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a95325e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.954+0000 7fd454b16740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c1ae000 con 0x55a953242680 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.954+0000 7fd454b16740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c1ab8d0 con 0x55a953237dc0 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.954+0000 7fd454b16740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c1a9720 con 0x55a9532374a0 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd450cda640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a95325e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd450cda640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a95325e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59292/0 (socket says 172.21.15.98:59292) 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd450cda640 1 -- 172.21.15.98:0/2501725833 learned_addr learned my addr 172.21.15.98:0/2501725833 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd44b7fe640 1 --2- 172.21.15.98:0/2501725833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953237dc0 0x55a953239600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd44bfff640 1 --2- 172.21.15.98:0/2501725833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9532374a0 0x55a9532528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd450cda640 1 -- 172.21.15.98:0/2501725833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9532374a0 msgr2=0x55a9532528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd450cda640 1 --2- 172.21.15.98:0/2501725833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9532374a0 0x55a9532528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.956 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd450cda640 1 -- 172.21.15.98:0/2501725833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953237dc0 msgr2=0x55a953239600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd450cda640 1 --2- 172.21.15.98:0/2501725833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953237dc0 0x55a953239600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd450cda640 1 -- 172.21.15.98:0/2501725833 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9532334d0 con 0x55a953242680 2024-09-19T07:23:47.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd450cda640 1 --2- 172.21.15.98:0/2501725833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a95325e1c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd44403a670 tx=0x7fd44402f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47955b959f0b49bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:47.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd431ffb640 1 -- 172.21.15.98:0/2501725833 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44403a8f0 con 0x55a953242680 2024-09-19T07:23:47.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd431ffb640 1 -- 172.21.15.98:0/2501725833 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd444003fe0 con 0x55a953242680 2024-09-19T07:23:47.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.955+0000 7fd431ffb640 1 -- 172.21.15.98:0/2501725833 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444030760 con 0x55a953242680 2024-09-19T07:23:47.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.956+0000 7fd454b16740 1 -- 172.21.15.98:0/2501725833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 msgr2=0x55a95325e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.956+0000 7fd454b16740 1 --2- 172.21.15.98:0/2501725833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a95325e1c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd44403a670 tx=0x7fd44402f830 comp rx=0 tx=0).stop 2024-09-19T07:23:47.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.956+0000 7fd454b16740 1 -- 172.21.15.98:0/2501725833 shutdown_connections 2024-09-19T07:23:47.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.956+0000 7fd454b16740 1 --2- 172.21.15.98:0/2501725833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a953242680 0x55a95325e1c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.956+0000 7fd454b16740 1 --2- 172.21.15.98:0/2501725833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953237dc0 0x55a953239600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.956+0000 7fd454b16740 1 --2- 172.21.15.98:0/2501725833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a9532374a0 0x55a9532528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.956+0000 7fd454b16740 1 -- 172.21.15.98:0/2501725833 >> 172.21.15.98:0/2501725833 conn(0x55a953233a30 msgr2=0x55a953238ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:47.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.956+0000 7fd454b16740 1 -- 172.21.15.98:0/2501725833 shutdown_connections 2024-09-19T07:23:47.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.956+0000 7fd454b16740 1 -- 172.21.15.98:0/2501725833 wait complete. 2024-09-19T07:23:47.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd454b16740 1 -- start start 2024-09-19T07:23:47.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd454b16740 1 Processor -- start 2024-09-19T07:23:47.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd454b16740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9532374a0 0x55a95324abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd454b16740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a953237dc0 0x55a95324b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd454b16740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953242680 0x55a9532c0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd454b16740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c1a9d90 con 0x55a9532374a0 2024-09-19T07:23:47.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd454b16740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c1ab200 con 0x55a953242680 2024-09-19T07:23:47.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd454b16740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c1aa460 con 0x55a953237dc0 2024-09-19T07:23:47.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd44bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9532374a0 0x55a95324abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd454b16740 10 client.0 _ll_register_callbacks cb 0x7fd44402f9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:47.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd44bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9532374a0 0x55a95324abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59294/0 (socket says 172.21.15.98:59294) 2024-09-19T07:23:47.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd44bfff640 1 -- 172.21.15.98:0/3385276569 learned_addr learned my addr 172.21.15.98:0/3385276569 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:47.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd44b7fe640 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a953237dc0 0x55a95324b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.957+0000 7fd450cda640 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953242680 0x55a9532c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd44bfff640 1 -- 172.21.15.98:0/3385276569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a953237dc0 msgr2=0x55a95324b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd44bfff640 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a953237dc0 0x55a95324b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd44bfff640 1 -- 172.21.15.98:0/3385276569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953242680 msgr2=0x55a9532c0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd44bfff640 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953242680 0x55a9532c0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd44bfff640 1 -- 172.21.15.98:0/3385276569 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9532c06d0 con 0x55a9532374a0 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd44bfff640 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9532374a0 0x55a95324abb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0ccea0 tx=0x7fd43c086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bb8b3c8e77f0de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd42b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd42b7fe640 1 -- 172.21.15.98:0/3385276569 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c020040 con 0x55a9532374a0 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd42b7fe640 1 -- 172.21.15.98:0/3385276569 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fd43c009cc0 con 0x55a9532374a0 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd454b16740 1 -- 172.21.15.98:0/3385276569 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd444003fe0 con 0x55a9532374a0 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd42b7fe640 1 -- 172.21.15.98:0/3385276569 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd43c09fd80 con 0x55a9532374a0 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd454b16740 10 client.15861 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd454b16740 1 -- 172.21.15.98:0/3385276569 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a9532c18a0 con 0x55a9532374a0 2024-09-19T07:23:47.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.958+0000 7fd42b7fe640 1 -- 172.21.15.98:0/3385276569 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd444003fe0 con 0x55a9532374a0 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.959+0000 7fd42b7fe640 1 -- 172.21.15.98:0/3385276569 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd43c0980f0 con 0x55a9532374a0 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.959+0000 7fd454b16740 10 client.15861 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.959+0000 7fd454b16740 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.959+0000 7fd454b16740 20 client.15861 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.959+0000 7fd454b16740 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a9532c1f70 0x55a9532c4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.959+0000 7fd454b16740 4 client.15861 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.959+0000 7fd454b16740 1 -- 172.21.15.98:0/3385276569 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a9531a4d60 con 0x55a9532c1f70 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.959+0000 7fd44b7fe640 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a9532c1f70 0x55a9532c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.959+0000 7fd44b7fe640 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a9532c1f70 0x55a9532c4390 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea798ee07b43f10b server_cookie=69fada10001aed94 in_seq=0 out_seq=0 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.959+0000 7fd42b7fe640 10 client.15861 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd42b7fe640 1 -- 172.21.15.98:0/3385276569 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a9531a4d60 con 0x55a9532c1f70 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd42b7fe640 10 client.15861 handle_command_reply: tid=0 2024-09-19T07:23:47.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd454b16740 1 client.15861 shutdown 2024-09-19T07:23:47.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd454b16740 1 -- 172.21.15.98:0/3385276569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9532374a0 msgr2=0x55a95324abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd454b16740 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9532374a0 0x55a95324abb0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0ccea0 tx=0x7fd43c086040 comp rx=0 tx=0).stop 2024-09-19T07:23:47.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd454b16740 1 -- 172.21.15.98:0/3385276569 shutdown_connections 2024-09-19T07:23:47.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd454b16740 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a953242680 0x55a9532c0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd454b16740 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a953237dc0 0x55a95324b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd454b16740 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a9532c1f70 0x55a9532c4390 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd454b16740 1 --2- 172.21.15.98:0/3385276569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a9532374a0 0x55a95324abb0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd42b7fe640 0 client.15861 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:47.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd454b16740 1 -- 172.21.15.98:0/3385276569 >> 172.21.15.98:0/3385276569 conn(0x55a953233a30 msgr2=0x55a953232350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:47.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd454b16740 1 -- 172.21.15.98:0/3385276569 shutdown_connections 2024-09-19T07:23:47.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd454b16740 1 -- 172.21.15.98:0/3385276569 wait complete. 2024-09-19T07:23:47.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.960+0000 7fd454b16740 20 client.15861 trim_cache size 0 max 16384 2024-09-19T07:23:47.965 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:23:47.965 INFO:teuthology.orchestra.run.smithi098.stdout: "status": "no active scrubs running", 2024-09-19T07:23:47.966 INFO:teuthology.orchestra.run.smithi098.stdout: "scrubs": {} 2024-09-19T07:23:47.966 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:23:47.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.961+0000 7fd45273d640 1 -- 172.21.15.98:0/2794406837 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd4340a33b0 msgr2=0x7fd4340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.961+0000 7fd45273d640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd4340a33b0 0x7fd4340a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd44c06b050 tx=0x7fd44403c040 comp rx=0 tx=0).stop 2024-09-19T07:23:47.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.961+0000 7fd45273d640 1 -- 172.21.15.98:0/2794406837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd44c100e20 msgr2=0x7fd44c1993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:47.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.961+0000 7fd45273d640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd44c100e20 0x7fd44c1993d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00d770 tx=0x7fd43c00dc30 comp rx=0 tx=0).stop 2024-09-19T07:23:47.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.961+0000 7fd45273d640 1 -- 172.21.15.98:0/2794406837 shutdown_connections 2024-09-19T07:23:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.961+0000 7fd45273d640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd4340a33b0 0x7fd4340a5870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.961+0000 7fd45273d640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd44c102ef0 0x7fd44c199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.961+0000 7fd45273d640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd44c102570 0x7fd44c199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.961+0000 7fd45273d640 1 --2- 172.21.15.98:0/2794406837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd44c100e20 0x7fd44c1993d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.961+0000 7fd45273d640 1 -- 172.21.15.98:0/2794406837 >> 172.21.15.98:0/2794406837 conn(0x7fd44c0fc7d0 msgr2=0x7fd44c1068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.961+0000 7fd45273d640 1 -- 172.21.15.98:0/2794406837 shutdown_connections 2024-09-19T07:23:47.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:47.961+0000 7fd45273d640 1 -- 172.21.15.98:0/2794406837 wait complete. 2024-09-19T07:23:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:47 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1766001961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:47 smithi098 ceph-mon[30950]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:23:48.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:47 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1766001961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:48.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:47 smithi162 ceph-mon[35726]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:23:48.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:47 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1766001961' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:48.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:47 smithi139 ceph-mon[35039]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T07:23:48.712 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:23:48.712 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:23:48.775 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:49.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.286+0000 7f6e91cc5640 1 -- 172.21.15.98:0/390868919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e8c10c180 msgr2=0x7f6e8c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.286+0000 7f6e91cc5640 1 --2- 172.21.15.98:0/390868919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e8c10c180 0x7f6e8c10e600 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6e84009ca0 tx=0x7f6e8402a950 comp rx=0 tx=0).stop 2024-09-19T07:23:49.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.286+0000 7f6e91cc5640 1 -- 172.21.15.98:0/390868919 shutdown_connections 2024-09-19T07:23:49.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.286+0000 7f6e91cc5640 1 --2- 172.21.15.98:0/390868919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e8c10c180 0x7f6e8c10e600 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.286+0000 7f6e91cc5640 1 --2- 172.21.15.98:0/390868919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c1036c0 0x7f6e8c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.286+0000 7f6e91cc5640 1 --2- 172.21.15.98:0/390868919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e8c102da0 0x7f6e8c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.286+0000 7f6e91cc5640 1 -- 172.21.15.98:0/390868919 >> 172.21.15.98:0/390868919 conn(0x7f6e8c0fc7a0 msgr2=0x7f6e8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:49.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.286+0000 7f6e91cc5640 1 -- 172.21.15.98:0/390868919 shutdown_connections 2024-09-19T07:23:49.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.286+0000 7f6e91cc5640 1 -- 172.21.15.98:0/390868919 wait complete. 2024-09-19T07:23:49.288 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.287+0000 7f6e91cc5640 1 Processor -- start 2024-09-19T07:23:49.289 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.287+0000 7f6e91cc5640 1 -- start start 2024-09-19T07:23:49.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.287+0000 7f6e91cc5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e8c102da0 0x7f6e8c100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.287+0000 7f6e91cc5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e8c1036c0 0x7f6e8c100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.287+0000 7f6e91cc5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c10c180 0x7f6e8c101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.287+0000 7f6e91cc5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c111f60 con 0x7f6e8c102da0 2024-09-19T07:23:49.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.287+0000 7f6e91cc5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c111de0 con 0x7f6e8c1036c0 2024-09-19T07:23:49.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.287+0000 7f6e91cc5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c1120e0 con 0x7f6e8c10c180 2024-09-19T07:23:49.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.287+0000 7f6e8b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e8c102da0 0x7f6e8c100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.287+0000 7f6e8b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e8c102da0 0x7f6e8c100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59310/0 (socket says 172.21.15.98:59310) 2024-09-19T07:23:49.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.287+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/2025909046 learned_addr learned my addr 172.21.15.98:0/2025909046 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:49.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.287+0000 7f6e8bfff640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c10c180 0x7f6e8c101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.288+0000 7f6e8affd640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e8c1036c0 0x7f6e8c100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.290 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.288+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/2025909046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c10c180 msgr2=0x7f6e8c101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.288+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c10c180 0x7f6e8c101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.288+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/2025909046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e8c1036c0 msgr2=0x7f6e8c100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.288+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e8c1036c0 0x7f6e8c100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.288+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/2025909046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8c1a68d0 con 0x7f6e8c102da0 2024-09-19T07:23:49.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.288+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e8c102da0 0x7f6e8c100a00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00d950 tx=0x7f6e7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:49.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.288+0000 7f6e88ff9640 1 -- 172.21.15.98:0/2025909046 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c017070 con 0x7f6e8c102da0 2024-09-19T07:23:49.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.288+0000 7f6e88ff9640 1 -- 172.21.15.98:0/2025909046 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e7c009c30 con 0x7f6e8c102da0 2024-09-19T07:23:49.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.288+0000 7f6e91cc5640 1 -- 172.21.15.98:0/2025909046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8c1a6bc0 con 0x7f6e8c102da0 2024-09-19T07:23:49.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.288+0000 7f6e88ff9640 1 -- 172.21.15.98:0/2025909046 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c00f6b0 con 0x7f6e8c102da0 2024-09-19T07:23:49.291 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.289+0000 7f6e91cc5640 1 -- 172.21.15.98:0/2025909046 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e8c1a7150 con 0x7f6e8c102da0 2024-09-19T07:23:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.291+0000 7f6e88ff9640 1 -- 172.21.15.98:0/2025909046 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6e7c00f850 con 0x7f6e8c102da0 2024-09-19T07:23:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.291+0000 7f6e9409e740 1 Processor -- start 2024-09-19T07:23:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.291+0000 7f6e9409e740 1 -- start start 2024-09-19T07:23:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e9409e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33060 0x557b1ed33440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e9409e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed33980 0x557b1ed3dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e9409e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed3e240 0x557b1ed40630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e9409e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557b1ec98620 con 0x557b1ed3e240 2024-09-19T07:23:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e9409e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b1ec3fe50 con 0x557b1ed33060 2024-09-19T07:23:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e9409e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557b1ec945e0 con 0x557b1ed33980 2024-09-19T07:23:49.295 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e88ff9640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6e740a3430 0x7f6e740a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e8b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed33980 0x557b1ed3dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e8bfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33060 0x557b1ed33440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e88ff9640 1 -- 172.21.15.98:0/2025909046 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f6e7c0cf830 con 0x7f6e8c102da0 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e8b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed33980 0x557b1ed3dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:50720/0 (socket says 172.21.15.98:50720) 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/2847412927 learned_addr learned my addr 172.21.15.98:0/2847412927 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e8affd640 1 --2- 172.21.15.98:0/2847412927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed3e240 0x557b1ed40630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/2847412927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33060 msgr2=0x557b1ed33440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/2847412927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33060 0x557b1ed33440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/2847412927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed3e240 msgr2=0x557b1ed40630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.292+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/2847412927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed3e240 0x557b1ed40630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.293+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/2847412927 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b1ec30d40 con 0x557b1ed33980 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.293+0000 7f6e8affd640 1 --2- 172.21.15.98:0/2847412927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed3e240 0x557b1ed40630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:49.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.293+0000 7f6e8bfff640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6e740a3430 0x7f6e740a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.293+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/2847412927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed33980 0x557b1ed3dd00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0cd550 tx=0x7f6e7c015880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66cad5f2021e5fa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:49.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.293+0000 7f6e71ffb640 1 -- 172.21.15.98:0/2847412927 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c09fe90 con 0x557b1ed33980 2024-09-19T07:23:49.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.293+0000 7f6e71ffb640 1 -- 172.21.15.98:0/2847412927 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e7c0a4750 con 0x557b1ed33980 2024-09-19T07:23:49.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.294+0000 7f6e71ffb640 1 -- 172.21.15.98:0/2847412927 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0cd310 con 0x557b1ed33980 2024-09-19T07:23:49.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.294+0000 7f6e8bfff640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6e740a3430 0x7f6e740a58f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6e84005fe0 tx=0x7f6e8402a950 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:49.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.294+0000 7f6e9409e740 1 -- 172.21.15.98:0/2847412927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed33980 msgr2=0x557b1ed3dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.294+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2847412927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed33980 0x557b1ed3dd00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0cd550 tx=0x7f6e7c015880 comp rx=0 tx=0).stop 2024-09-19T07:23:49.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.294+0000 7f6e9409e740 1 -- 172.21.15.98:0/2847412927 shutdown_connections 2024-09-19T07:23:49.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.294+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2847412927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed3e240 0x557b1ed40630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.294+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2847412927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed33980 0x557b1ed3dd00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.297 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.294+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2847412927 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33060 0x557b1ed33440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.294+0000 7f6e9409e740 1 -- 172.21.15.98:0/2847412927 >> 172.21.15.98:0/2847412927 conn(0x557b1ed2f5f0 msgr2=0x557b1ed2f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:49.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.294+0000 7f6e9409e740 1 -- 172.21.15.98:0/2847412927 shutdown_connections 2024-09-19T07:23:49.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.294+0000 7f6e9409e740 1 -- 172.21.15.98:0/2847412927 wait complete. 2024-09-19T07:23:49.298 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.295+0000 7f6e9409e740 1 -- start start 2024-09-19T07:23:49.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.295+0000 7f6e9409e740 1 Processor -- start 2024-09-19T07:23:49.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.296+0000 7f6e9409e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 0x557b1ed3b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.296+0000 7f6e8b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 0x557b1ed3b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.296+0000 7f6e8b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 0x557b1ed3b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59316/0 (socket says 172.21.15.98:59316) 2024-09-19T07:23:49.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.296+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/1705226128 learned_addr learned my addr 172.21.15.98:0/1705226128 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:49.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.296+0000 7f6e9409e740 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33980 0x557b1ed3b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.296+0000 7f6e9409e740 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed3e240 0x557b1ed3bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.296+0000 7f6e9409e740 1 -- 172.21.15.98:0/1705226128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557b1ed40eb0 con 0x557b1ed33060 2024-09-19T07:23:49.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.296+0000 7f6e9409e740 1 -- 172.21.15.98:0/1705226128 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b1ec20f10 con 0x557b1ed33980 2024-09-19T07:23:49.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.296+0000 7f6e9409e740 1 -- 172.21.15.98:0/1705226128 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557b1ed41030 con 0x557b1ed3e240 2024-09-19T07:23:49.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.297+0000 7f6e9409e740 10 client.0 _ll_register_callbacks cb 0x557b1ec44db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:49.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.297+0000 7f6e8affd640 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33980 0x557b1ed3b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.297+0000 7f6e8bfff640 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed3e240 0x557b1ed3bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.297+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/1705226128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed3e240 msgr2=0x557b1ed3bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.297+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed3e240 0x557b1ed3bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.297+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/1705226128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33980 msgr2=0x557b1ed3b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.297+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33980 0x557b1ed3b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.297+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/1705226128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b1e9a7580 con 0x557b1ed33060 2024-09-19T07:23:49.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.297+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 0x557b1ed3b150 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009610 tx=0x7f6e7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e63c02d3444bdc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:49.303 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.297+0000 7f6e6affd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.298+0000 7f6e6affd640 1 -- 172.21.15.98:0/1705226128 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c098200 con 0x557b1ed33060 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.298+0000 7f6e6affd640 1 -- 172.21.15.98:0/1705226128 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f6e7c0109d0 con 0x557b1ed33060 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.298+0000 7f6e9409e740 1 -- 172.21.15.98:0/1705226128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e7c0a4750 con 0x557b1ed33060 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.298+0000 7f6e6affd640 1 -- 172.21.15.98:0/1705226128 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6e7c0983a0 con 0x557b1ed33060 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.298+0000 7f6e9409e740 10 client.15870 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.298+0000 7f6e9409e740 1 -- 172.21.15.98:0/1705226128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557b1ea71960 con 0x557b1ed33060 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.298+0000 7f6e6affd640 1 -- 172.21.15.98:0/1705226128 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e7c0ba2a0 con 0x557b1ed33060 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.298+0000 7f6e6affd640 1 -- 172.21.15.98:0/1705226128 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6e7c0b4ce0 con 0x557b1ed33060 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.299+0000 7f6e9409e740 10 client.15870 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.299+0000 7f6e9409e740 10 client.15870 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.299+0000 7f6e9409e740 20 client.15870 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.299+0000 7f6e9409e740 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b1ed564e0 0x557b1ed588d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.299+0000 7f6e9409e740 4 client.15870 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:49.304 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.299+0000 7f6e9409e740 1 -- 172.21.15.98:0/1705226128 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f6e7c0a4750 con 0x557b1ed564e0 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.299+0000 7f6e8affd640 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b1ed564e0 0x557b1ed588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.300+0000 7f6e8affd640 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b1ed564e0 0x557b1ed588d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce8ddbc74c7c0288 server_cookie=8374fef95e4d715c in_seq=0 out_seq=0 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.300+0000 7f6e6affd640 10 client.15870 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.300+0000 7f6e6affd640 1 -- 172.21.15.98:0/1705226128 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f6e7c0a4750 con 0x557b1ed564e0 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.300+0000 7f6e6affd640 10 client.15870 handle_command_reply: tid=0 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.300+0000 7f6e9409e740 1 client.15870 shutdown 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.301+0000 7f6e9409e740 1 -- 172.21.15.98:0/1705226128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 msgr2=0x557b1ed3b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.301+0000 7f6e9409e740 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 0x557b1ed3b150 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009610 tx=0x7f6e7c005880 comp rx=0 tx=0).stop 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.301+0000 7f6e9409e740 1 -- 172.21.15.98:0/1705226128 shutdown_connections 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.301+0000 7f6e9409e740 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed3e240 0x557b1ed3bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.301+0000 7f6e9409e740 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33980 0x557b1ed3b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.301+0000 7f6e9409e740 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b1ed564e0 0x557b1ed588d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.305 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.301+0000 7f6e9409e740 1 --2- 172.21.15.98:0/1705226128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 0x557b1ed3b150 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.301+0000 7f6e6affd640 0 client.15870 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:49.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.301+0000 7f6e9409e740 1 -- 172.21.15.98:0/1705226128 >> 172.21.15.98:0/1705226128 conn(0x557b1ed2f5f0 msgr2=0x557b1ed352d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:49.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.301+0000 7f6e9409e740 1 -- 172.21.15.98:0/1705226128 shutdown_connections 2024-09-19T07:23:49.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.301+0000 7f6e9409e740 1 -- 172.21.15.98:0/1705226128 wait complete. 2024-09-19T07:23:49.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.301+0000 7f6e9409e740 20 client.15870 trim_cache size 0 max 16384 2024-09-19T07:23:49.306 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:49.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e9409e740 1 Processor -- start 2024-09-19T07:23:49.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e9409e740 1 -- start start 2024-09-19T07:23:49.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e9409e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 0x557b1ed52270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.320 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e9409e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed33980 0x557b1ed383b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e9409e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed3e240 0x557b1ed388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e9409e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c1adfe0 con 0x557b1ed33060 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e9409e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c1ab8b0 con 0x557b1ed3e240 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e9409e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c1a9700 con 0x557b1ed33980 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e8b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 0x557b1ed52270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e8b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 0x557b1ed52270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59322/0 (socket says 172.21.15.98:59322) 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/2902578260 learned_addr learned my addr 172.21.15.98:0/2902578260 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/2902578260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed33980 msgr2=0x557b1ed383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/2902578260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed33980 0x557b1ed383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/2902578260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed3e240 msgr2=0x557b1ed388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/2902578260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed3e240 0x557b1ed388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.319+0000 7f6e8b7fe640 1 -- 172.21.15.98:0/2902578260 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b1ed337b0 con 0x557b1ed33060 2024-09-19T07:23:49.321 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.320+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/2902578260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 0x557b1ed52270 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0b6040 tx=0x7f6e7c0cd240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c50b370db28068b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:49.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.320+0000 7f6e717fa640 1 -- 172.21.15.98:0/2902578260 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0a4750 con 0x557b1ed33060 2024-09-19T07:23:49.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.320+0000 7f6e717fa640 1 -- 172.21.15.98:0/2902578260 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e7c00fc80 con 0x557b1ed33060 2024-09-19T07:23:49.322 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.320+0000 7f6e717fa640 1 -- 172.21.15.98:0/2902578260 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c086110 con 0x557b1ed33060 2024-09-19T07:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.320+0000 7f6e9409e740 1 -- 172.21.15.98:0/2902578260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 msgr2=0x557b1ed52270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.320+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2902578260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 0x557b1ed52270 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0b6040 tx=0x7f6e7c0cd240 comp rx=0 tx=0).stop 2024-09-19T07:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 -- 172.21.15.98:0/2902578260 shutdown_connections 2024-09-19T07:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2902578260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed3e240 0x557b1ed388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2902578260 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed33980 0x557b1ed383b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2902578260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33060 0x557b1ed52270 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 -- 172.21.15.98:0/2902578260 >> 172.21.15.98:0/2902578260 conn(0x557b1ed2f5f0 msgr2=0x557b1ed51b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 -- 172.21.15.98:0/2902578260 shutdown_connections 2024-09-19T07:23:49.325 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 -- 172.21.15.98:0/2902578260 wait complete. 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 -- start start 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 Processor -- start 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33060 0x557b1ed59ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33980 0x557b1ed5a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed3e240 0x557b1edb9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c1a9d70 con 0x557b1ed33980 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c1ab1e0 con 0x557b1ed33060 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c1aa440 con 0x557b1ed3e240 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.321+0000 7f6e9409e740 10 client.0 _ll_register_callbacks cb 0x7f6e7c097e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e8affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33980 0x557b1ed5a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e8affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33980 0x557b1ed5a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59328/0 (socket says 172.21.15.98:59328) 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e8affd640 1 -- 172.21.15.98:0/2627339692 learned_addr learned my addr 172.21.15.98:0/2627339692 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e8bfff640 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed3e240 0x557b1edb9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33060 0x557b1ed59ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e8affd640 1 -- 172.21.15.98:0/2627339692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed3e240 msgr2=0x557b1edb9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e8affd640 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed3e240 0x557b1edb9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e8affd640 1 -- 172.21.15.98:0/2627339692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33060 msgr2=0x557b1ed59ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e8affd640 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33060 0x557b1ed59ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e8affd640 1 -- 172.21.15.98:0/2627339692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b1edba430 con 0x557b1ed33980 2024-09-19T07:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e8affd640 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33980 0x557b1ed5a420 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c102490 tx=0x7f6e80014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa1aefe4f49e292 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e6affd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e6affd640 1 -- 172.21.15.98:0/2627339692 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80012450 con 0x557b1ed33980 2024-09-19T07:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e6affd640 1 -- 172.21.15.98:0/2627339692 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f6e800125f0 con 0x557b1ed33980 2024-09-19T07:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e9409e740 1 -- 172.21.15.98:0/2627339692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e7c00fc80 con 0x557b1ed33980 2024-09-19T07:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e6affd640 1 -- 172.21.15.98:0/2627339692 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6e800127f0 con 0x557b1ed33980 2024-09-19T07:23:49.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.322+0000 7f6e9409e740 10 client.15876 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.323+0000 7f6e9409e740 1 -- 172.21.15.98:0/2627339692 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557b1edc1870 con 0x557b1ed33980 2024-09-19T07:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.323+0000 7f6e6affd640 1 -- 172.21.15.98:0/2627339692 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e80026420 con 0x557b1ed33980 2024-09-19T07:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.323+0000 7f6e6affd640 1 -- 172.21.15.98:0/2627339692 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6e8002d070 con 0x557b1ed33980 2024-09-19T07:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.323+0000 7f6e9409e740 10 client.15876 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.323+0000 7f6e9409e740 10 client.15876 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.323+0000 7f6e9409e740 20 client.15876 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.323+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b1ed564e0 0x557b1edc4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.323+0000 7f6e9409e740 4 client.15876 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "71cce13a", "release": true, "await": true}] 2024-09-19T07:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.323+0000 7f6e9409e740 1 -- 172.21.15.98:0/2627339692 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "set_id": "71cce13a", "release": true, "await": true}) -- 0x7f6e7c00fc80 con 0x557b1ed564e0 2024-09-19T07:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.323+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b1ed564e0 0x557b1edc4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.324+0000 7f6e6affd640 10 client.15876 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:49.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.324+0000 7f6e8b7fe640 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b1ed564e0 0x557b1edc4060 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa0eddfcc3e71c1d server_cookie=2351ac0e00a78d93 in_seq=0 out_seq=0 2024-09-19T07:23:49.329 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e6affd640 1 -- 172.21.15.98:0/2627339692 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f6e7c00fc80 con 0x557b1ed564e0 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e6affd640 10 client.15876 handle_command_reply: tid=0 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e9409e740 1 client.15876 shutdown 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e9409e740 1 -- 172.21.15.98:0/2627339692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33980 msgr2=0x557b1ed5a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33980 0x557b1ed5a420 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c102490 tx=0x7f6e80014840 comp rx=0 tx=0).stop 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e9409e740 1 -- 172.21.15.98:0/2627339692 shutdown_connections 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b1ed3e240 0x557b1edb9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b1ed564e0 0x557b1edc4060 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b1ed33980 0x557b1ed5a420 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e6affd640 0 client.15876 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e9409e740 1 --2- 172.21.15.98:0/2627339692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b1ed33060 0x557b1ed59ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e9409e740 1 -- 172.21.15.98:0/2627339692 >> 172.21.15.98:0/2627339692 conn(0x557b1ed2f5f0 msgr2=0x557b1ed352d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e9409e740 1 -- 172.21.15.98:0/2627339692 shutdown_connections 2024-09-19T07:23:49.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e9409e740 1 -- 172.21.15.98:0/2627339692 wait complete. 2024-09-19T07:23:49.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.327+0000 7f6e9409e740 20 client.15876 trim_cache size 0 max 16384 2024-09-19T07:23:49.331 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:23:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 24, 2024-09-19T07:23:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:23:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 8, 2024-09-19T07:23:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": { 2024-09-19T07:23:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "71cce13a": { 2024-09-19T07:23:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "version": 8, 2024-09-19T07:23:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "age_ref": 0.0, 2024-09-19T07:23:49.331 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RELEASED", 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "timeout": 90.0, 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "expiration": 140.3, 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "members": { 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "file:/": { 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "excluded": false, 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RELEASED", 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:49.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:49.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:49.333 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:23:49.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.328+0000 7f6e91cc5640 1 -- 172.21.15.98:0/2025909046 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6e740a3430 msgr2=0x7f6e740a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.328+0000 7f6e91cc5640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6e740a3430 0x7f6e740a58f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6e84005fe0 tx=0x7f6e8402a950 comp rx=0 tx=0).stop 2024-09-19T07:23:49.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.328+0000 7f6e91cc5640 1 -- 172.21.15.98:0/2025909046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e8c102da0 msgr2=0x7f6e8c100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:49.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.328+0000 7f6e91cc5640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e8c102da0 0x7f6e8c100a00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00d950 tx=0x7f6e7c00de10 comp rx=0 tx=0).stop 2024-09-19T07:23:49.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.328+0000 7f6e91cc5640 1 -- 172.21.15.98:0/2025909046 shutdown_connections 2024-09-19T07:23:49.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.328+0000 7f6e91cc5640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6e740a3430 0x7f6e740a58f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.328+0000 7f6e91cc5640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e8c10c180 0x7f6e8c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.328+0000 7f6e91cc5640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6e8c1036c0 0x7f6e8c100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.328+0000 7f6e91cc5640 1 --2- 172.21.15.98:0/2025909046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e8c102da0 0x7f6e8c100a00 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:49.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.328+0000 7f6e91cc5640 1 -- 172.21.15.98:0/2025909046 >> 172.21.15.98:0/2025909046 conn(0x7f6e8c0fc7a0 msgr2=0x7f6e8c0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:49.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.329+0000 7f6e91cc5640 1 -- 172.21.15.98:0/2025909046 shutdown_connections 2024-09-19T07:23:49.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:49.329+0000 7f6e91cc5640 1 -- 172.21.15.98:0/2025909046 wait complete. 2024-09-19T07:23:49.335 INFO:tasks.workunit.client.0.smithi098.stderr:+ mkdir -p fsstress 2024-09-19T07:23:49.335 INFO:tasks.workunit.client.0.smithi098.stderr:+ pushd fsstress 2024-09-19T07:23:49.335 INFO:tasks.workunit.client.0.smithi098.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T07:23:49.336 INFO:tasks.workunit.client.0.smithi098.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-19T07:23:49.962 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:49 smithi098 ceph-mon[30950]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-19T07:23:50.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.041+0000 7fc427caa640 1 -- 172.21.15.98:0/2436468944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc420101de0 msgr2=0x7fc4201021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:50.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.041+0000 7fc427caa640 1 --2- 172.21.15.98:0/2436468944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc420101de0 0x7fc4201021c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009900 tx=0x7fc41c02a410 comp rx=0 tx=0).stop 2024-09-19T07:23:50.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.041+0000 7fc427caa640 1 -- 172.21.15.98:0/2436468944 shutdown_connections 2024-09-19T07:23:50.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.041+0000 7fc427caa640 1 --2- 172.21.15.98:0/2436468944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc420106f10 0x7fc42010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:50.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.041+0000 7fc427caa640 1 --2- 172.21.15.98:0/2436468944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc420102790 0x7fc4201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:50.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.041+0000 7fc427caa640 1 --2- 172.21.15.98:0/2436468944 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc420101de0 0x7fc4201021c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:50.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.041+0000 7fc427caa640 1 -- 172.21.15.98:0/2436468944 >> 172.21.15.98:0/2436468944 conn(0x7fc4200fd8c0 msgr2=0x7fc4200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:50.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.041+0000 7fc427caa640 1 -- 172.21.15.98:0/2436468944 shutdown_connections 2024-09-19T07:23:50.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.041+0000 7fc427caa640 1 -- 172.21.15.98:0/2436468944 wait complete. 2024-09-19T07:23:50.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.042+0000 7fc427caa640 1 Processor -- start 2024-09-19T07:23:50.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.042+0000 7fc427caa640 1 -- start start 2024-09-19T07:23:50.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.042+0000 7fc427caa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc420101de0 0x7fc4200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:50.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.042+0000 7fc427caa640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc420102790 0x7fc420074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:50.044 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.042+0000 7fc427caa640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc420106f10 0x7fc420074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.042+0000 7fc427caa640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc420111f30 con 0x7fc420102790 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.042+0000 7fc427caa640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc420111db0 con 0x7fc420106f10 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.042+0000 7fc427caa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4201120b0 con 0x7fc420101de0 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.042+0000 7fc425245640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc420102790 0x7fc420074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.042+0000 7fc425245640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc420102790 0x7fc420074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59350/0 (socket says 172.21.15.98:59350) 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.042+0000 7fc425245640 1 -- 172.21.15.98:0/1918259426 learned_addr learned my addr 172.21.15.98:0/1918259426 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.042+0000 7fc426247640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc420106f10 0x7fc420074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc425a46640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc420101de0 0x7fc4200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc425245640 1 -- 172.21.15.98:0/1918259426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc420101de0 msgr2=0x7fc4200744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc425245640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc420101de0 0x7fc4200744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc425245640 1 -- 172.21.15.98:0/1918259426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc420106f10 msgr2=0x7fc420074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc425245640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc420106f10 0x7fc420074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc425245640 1 -- 172.21.15.98:0/1918259426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4201a68f0 con 0x7fc420102790 2024-09-19T07:23:50.045 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc426247640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc420106f10 0x7fc420074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:50.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc425245640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc420102790 0x7fc420074a30 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc41000c920 tx=0x7fc41000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:50.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc416ffd640 1 -- 172.21.15.98:0/1918259426 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc410007c70 con 0x7fc420102790 2024-09-19T07:23:50.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc416ffd640 1 -- 172.21.15.98:0/1918259426 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc410007e10 con 0x7fc420102790 2024-09-19T07:23:50.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc416ffd640 1 -- 172.21.15.98:0/1918259426 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc410018890 con 0x7fc420102790 2024-09-19T07:23:50.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc427caa640 1 -- 172.21.15.98:0/1918259426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4201a6be0 con 0x7fc420102790 2024-09-19T07:23:50.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.043+0000 7fc427caa640 1 -- 172.21.15.98:0/1918259426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4201a70d0 con 0x7fc420102790 2024-09-19T07:23:50.046 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.044+0000 7fc427caa640 1 -- 172.21.15.98:0/1918259426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4201021c0 con 0x7fc420102790 2024-09-19T07:23:50.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.045+0000 7fc416ffd640 1 -- 172.21.15.98:0/1918259426 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc410018a70 con 0x7fc420102790 2024-09-19T07:23:50.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.046+0000 7fc416ffd640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc40c0a3430 0x7fc40c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:50.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.046+0000 7fc425a46640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc40c0a3430 0x7fc40c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:50.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.046+0000 7fc416ffd640 1 -- 172.21.15.98:0/1918259426 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc4100cfeb0 con 0x7fc420102790 2024-09-19T07:23:50.047 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.046+0000 7fc425a46640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc40c0a3430 0x7fc40c0a58f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0096c0 tx=0x7fc41c000bc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:50.050 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.050+0000 7fc416ffd640 1 -- 172.21.15.98:0/1918259426 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc410014030 con 0x7fc420102790 2024-09-19T07:23:50.119 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:49 smithi139 ceph-mon[35039]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-19T07:23:50.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:49 smithi162 ceph-mon[35726]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-19T07:23:50.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.256+0000 7fc427caa640 1 -- 172.21.15.98:0/1918259426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc420075a20 con 0x7fc420102790 2024-09-19T07:23:50.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.256+0000 7fc416ffd640 1 -- 172.21.15.98:0/1918259426 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7fc41009c860 con 0x7fc420102790 2024-09-19T07:23:50.257 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:23:50.257 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:23:50.257 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:23:50.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.259+0000 7fc427caa640 1 -- 172.21.15.98:0/1918259426 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc40c0a3430 msgr2=0x7fc40c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:50.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.259+0000 7fc427caa640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc40c0a3430 0x7fc40c0a58f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0096c0 tx=0x7fc41c000bc0 comp rx=0 tx=0).stop 2024-09-19T07:23:50.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.259+0000 7fc427caa640 1 -- 172.21.15.98:0/1918259426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc420102790 msgr2=0x7fc420074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:50.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.259+0000 7fc427caa640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc420102790 0x7fc420074a30 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc41000c920 tx=0x7fc41000cde0 comp rx=0 tx=0).stop 2024-09-19T07:23:50.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.259+0000 7fc427caa640 1 -- 172.21.15.98:0/1918259426 shutdown_connections 2024-09-19T07:23:50.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.259+0000 7fc427caa640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc40c0a3430 0x7fc40c0a58f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:50.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.259+0000 7fc427caa640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc420106f10 0x7fc420074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:50.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.259+0000 7fc427caa640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc420102790 0x7fc420074a30 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:50.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.259+0000 7fc427caa640 1 --2- 172.21.15.98:0/1918259426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc420101de0 0x7fc4200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:50.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.259+0000 7fc427caa640 1 -- 172.21.15.98:0/1918259426 >> 172.21.15.98:0/1918259426 conn(0x7fc4200fd8c0 msgr2=0x7fc4200feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:50.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.259+0000 7fc427caa640 1 -- 172.21.15.98:0/1918259426 shutdown_connections 2024-09-19T07:23:50.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:50.259+0000 7fc427caa640 1 -- 172.21.15.98:0/1918259426 wait complete. 2024-09-19T07:23:50.485 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '71cce13a', total seconds elapsed: 25.8 2024-09-19T07:23:50.485 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T07:23:50.485 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:23:51.120 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:50 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1918259426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:51.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:50 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1918259426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:51.147 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:23:51.265 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:51.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:50 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1918259426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:51.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.788+0000 7f307bedf640 1 -- 172.21.15.98:0/8687969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3074100a80 msgr2=0x7f3074100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:51.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.788+0000 7f307bedf640 1 --2- 172.21.15.98:0/8687969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3074100a80 0x7f3074100ee0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3068009930 tx=0x7f306802a420 comp rx=0 tx=0).stop 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.788+0000 7f307bedf640 1 -- 172.21.15.98:0/8687969 shutdown_connections 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.788+0000 7f307bedf640 1 --2- 172.21.15.98:0/8687969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3074101420 0x7f307410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.788+0000 7f307bedf640 1 --2- 172.21.15.98:0/8687969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3074100a80 0x7f3074100ee0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.788+0000 7f307bedf640 1 --2- 172.21.15.98:0/8687969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3074106a80 0x7f3074106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.788+0000 7f307bedf640 1 -- 172.21.15.98:0/8687969 >> 172.21.15.98:0/8687969 conn(0x7f30740fc7a0 msgr2=0x7f30740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.788+0000 7f307bedf640 1 -- 172.21.15.98:0/8687969 shutdown_connections 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.788+0000 7f307bedf640 1 -- 172.21.15.98:0/8687969 wait complete. 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f307bedf640 1 Processor -- start 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f307bedf640 1 -- start start 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f307bedf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3074100a80 0x7f30741985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f307bedf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3074101420 0x7f3074198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f307bedf640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3074106a80 0x7f307419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:51.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f307bedf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3074110f20 con 0x7f3074100a80 2024-09-19T07:23:51.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f307bedf640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3074110da0 con 0x7f3074106a80 2024-09-19T07:23:51.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f307bedf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f30741110a0 con 0x7f3074101420 2024-09-19T07:23:51.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f3079c7b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3074100a80 0x7f30741985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:51.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f3079c7b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3074100a80 0x7f30741985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59356/0 (socket says 172.21.15.98:59356) 2024-09-19T07:23:51.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f3079c7b640 1 -- 172.21.15.98:0/2528271359 learned_addr learned my addr 172.21.15.98:0/2528271359 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:51.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f307947a640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3074101420 0x7f3074198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:51.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f3079c7b640 1 -- 172.21.15.98:0/2528271359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3074101420 msgr2=0x7f3074198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:51.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f3079c7b640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3074101420 0x7f3074198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:51.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f307a47c640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3074106a80 0x7f307419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:51.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f3079c7b640 1 -- 172.21.15.98:0/2528271359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3074106a80 msgr2=0x7f307419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:51.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f3079c7b640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3074106a80 0x7f307419cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:51.801 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.789+0000 7f3079c7b640 1 -- 172.21.15.98:0/2528271359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307419d580 con 0x7f3074100a80 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.790+0000 7f3079c7b640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3074100a80 0x7f30741985d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f306c00b4a0 tx=0x7f306c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.790+0000 7f3072ffd640 1 -- 172.21.15.98:0/2528271359 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c014070 con 0x7f3074100a80 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.790+0000 7f3072ffd640 1 -- 172.21.15.98:0/2528271359 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f306c010af0 con 0x7f3074100a80 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.790+0000 7f307bedf640 1 -- 172.21.15.98:0/2528271359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307419d870 con 0x7f3074100a80 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.790+0000 7f3072ffd640 1 -- 172.21.15.98:0/2528271359 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c017d10 con 0x7f3074100a80 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.790+0000 7f307bedf640 1 -- 172.21.15.98:0/2528271359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30741a5150 con 0x7f3074100a80 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.791+0000 7f307bedf640 1 -- 172.21.15.98:0/2528271359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3074100f60 con 0x7f3074100a80 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.792+0000 7f3072ffd640 1 -- 172.21.15.98:0/2528271359 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f306c017070 con 0x7f3074100a80 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.793+0000 7f3072ffd640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f305c0a33b0 0x7f305c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.793+0000 7f307947a640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f305c0a33b0 0x7f305c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.793+0000 7f3072ffd640 1 -- 172.21.15.98:0/2528271359 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f306c0cf130 con 0x7f3074100a80 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.793+0000 7f307947a640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f305c0a33b0 0x7f305c0a5870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3068000c00 tx=0x7f3068031490 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:51.802 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:51.797+0000 7f3072ffd640 1 -- 172.21.15.98:0/2528271359 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f306c09bbf0 con 0x7f3074100a80 2024-09-19T07:23:51.835 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:51.975 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:51 smithi098 ceph-mon[30950]: pgmap v57: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T07:23:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.013+0000 7f307bedf640 1 -- 172.21.15.98:0/2528271359 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f307410a020 con 0x7f3074100a80 2024-09-19T07:23:52.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.014+0000 7f3072ffd640 1 -- 172.21.15.98:0/2528271359 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f306c09b4f0 con 0x7f3074100a80 2024-09-19T07:23:52.015 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:23:52.015 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:23:52.015 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:23:52.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.017+0000 7f307bedf640 1 -- 172.21.15.98:0/2528271359 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f305c0a33b0 msgr2=0x7f305c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:52.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.017+0000 7f307bedf640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f305c0a33b0 0x7f305c0a5870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3068000c00 tx=0x7f3068031490 comp rx=0 tx=0).stop 2024-09-19T07:23:52.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.017+0000 7f307bedf640 1 -- 172.21.15.98:0/2528271359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3074100a80 msgr2=0x7f30741985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:52.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.017+0000 7f307bedf640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3074100a80 0x7f30741985d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f306c00b4a0 tx=0x7f306c00b960 comp rx=0 tx=0).stop 2024-09-19T07:23:52.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.017+0000 7f307bedf640 1 -- 172.21.15.98:0/2528271359 shutdown_connections 2024-09-19T07:23:52.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.017+0000 7f307bedf640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f305c0a33b0 0x7f305c0a5870 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.017+0000 7f307bedf640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3074106a80 0x7f307419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.017 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.017+0000 7f307bedf640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3074101420 0x7f3074198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.017+0000 7f307bedf640 1 --2- 172.21.15.98:0/2528271359 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3074100a80 0x7f30741985d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.017+0000 7f307bedf640 1 -- 172.21.15.98:0/2528271359 >> 172.21.15.98:0/2528271359 conn(0x7f30740fc7a0 msgr2=0x7f307406aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:52.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.017+0000 7f307bedf640 1 -- 172.21.15.98:0/2528271359 shutdown_connections 2024-09-19T07:23:52.018 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.017+0000 7f307bedf640 1 -- 172.21.15.98:0/2528271359 wait complete. 2024-09-19T07:23:52.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:51 smithi162 ceph-mon[35726]: pgmap v57: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T07:23:52.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:51 smithi139 ceph-mon[35039]: pgmap v57: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T07:23:52.710 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T07:23:52.710 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T07:23:52.949 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:52 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2528271359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:52.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.948+0000 7f166ef94640 1 -- 172.21.15.98:0/2351211816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16681027a0 msgr2=0x7f16681067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:52.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.948+0000 7f166ef94640 1 --2- 172.21.15.98:0/2351211816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16681027a0 0x7f16681067f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1654009900 tx=0x7f165402a410 comp rx=0 tx=0).stop 2024-09-19T07:23:52.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.948+0000 7f166ef94640 1 -- 172.21.15.98:0/2351211816 shutdown_connections 2024-09-19T07:23:52.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.948+0000 7f166ef94640 1 --2- 172.21.15.98:0/2351211816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1668106f20 0x7f166810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.948+0000 7f166ef94640 1 --2- 172.21.15.98:0/2351211816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16681027a0 0x7f16681067f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.948+0000 7f166ef94640 1 --2- 172.21.15.98:0/2351211816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1668101df0 0x7f16681021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.948+0000 7f166ef94640 1 -- 172.21.15.98:0/2351211816 >> 172.21.15.98:0/2351211816 conn(0x7f16680fd8f0 msgr2=0x7f16680ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.948+0000 7f166ef94640 1 -- 172.21.15.98:0/2351211816 shutdown_connections 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.949+0000 7f166ef94640 1 -- 172.21.15.98:0/2351211816 wait complete. 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.949+0000 7f166ef94640 1 Processor -- start 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.949+0000 7f166ef94640 1 -- start start 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.949+0000 7f166ef94640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1668101df0 0x7f16680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.949+0000 7f166ef94640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16681027a0 0x7f1668074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.949+0000 7f166ef94640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f20 0x7f1668074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.949+0000 7f166ef94640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1668112020 con 0x7f1668106f20 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.949+0000 7f166ef94640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1668111ea0 con 0x7f16681027a0 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.949+0000 7f166ef94640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16681121a0 con 0x7f1668101df0 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.949+0000 7f166d531640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f20 0x7f1668074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.949+0000 7f166d531640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f20 0x7f1668074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39050/0 (socket says 172.21.15.98:39050) 2024-09-19T07:23:52.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.949+0000 7f166d531640 1 -- 172.21.15.98:0/3099612077 learned_addr learned my addr 172.21.15.98:0/3099612077 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f166cd30640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1668101df0 0x7f16680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f1667fff640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16681027a0 0x7f1668074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f166d531640 1 -- 172.21.15.98:0/3099612077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1668101df0 msgr2=0x7f16680744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f166d531640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1668101df0 0x7f16680744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f166d531640 1 -- 172.21.15.98:0/3099612077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16681027a0 msgr2=0x7f1668074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f166d531640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16681027a0 0x7f1668074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f166d531640 1 -- 172.21.15.98:0/3099612077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16681a6b30 con 0x7f1668106f20 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f166d531640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f20 0x7f1668074f70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f166000b970 tx=0x7f166000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f1665ffb640 1 -- 172.21.15.98:0/3099612077 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660019070 con 0x7f1668106f20 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f1665ffb640 1 -- 172.21.15.98:0/3099612077 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f166000cb40 con 0x7f1668106f20 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f166ef94640 1 -- 172.21.15.98:0/3099612077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16681a6e20 con 0x7f1668106f20 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f1665ffb640 1 -- 172.21.15.98:0/3099612077 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660007650 con 0x7f1668106f20 2024-09-19T07:23:52.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.950+0000 7f166ef94640 1 -- 172.21.15.98:0/3099612077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16681a7330 con 0x7f1668106f20 2024-09-19T07:23:52.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.952+0000 7f1665ffb640 1 -- 172.21.15.98:0/3099612077 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f166001c070 con 0x7f1668106f20 2024-09-19T07:23:52.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f167136d740 1 Processor -- start 2024-09-19T07:23:52.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f167136d740 1 -- start start 2024-09-19T07:23:52.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f1665ffb640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16580a3430 0x7f16580a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f167136d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48157b40 0x55ec48156090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f167136d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec481565d0 0x55ec48156a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f167136d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48161370 0x55ec48163760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f167136d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ec480bc2f0 con 0x55ec48161370 2024-09-19T07:23:52.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f167136d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ec48063cf0 con 0x55ec481565d0 2024-09-19T07:23:52.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f167136d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ec480b82b0 con 0x55ec48157b40 2024-09-19T07:23:52.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f1667fff640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16580a3430 0x7f16580a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f1665ffb640 1 -- 172.21.15.98:0/3099612077 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f16600cf280 con 0x7f1668106f20 2024-09-19T07:23:52.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f166d531640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48161370 0x55ec48163760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f166d531640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48161370 0x55ec48163760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39052/0 (socket says 172.21.15.98:39052) 2024-09-19T07:23:52.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f166d531640 1 -- 172.21.15.98:0/589379980 learned_addr learned my addr 172.21.15.98:0/589379980 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:52.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f166cd30640 1 --2- 172.21.15.98:0/589379980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48157b40 0x55ec48156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f166d531640 1 -- 172.21.15.98:0/589379980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48157b40 msgr2=0x55ec48156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:52.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.953+0000 7f166d531640 1 --2- 172.21.15.98:0/589379980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48157b40 0x55ec48156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.954+0000 7f166d531640 1 -- 172.21.15.98:0/589379980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec481565d0 msgr2=0x55ec48156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:52.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.954+0000 7f166d531640 1 --2- 172.21.15.98:0/589379980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec481565d0 0x55ec48156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.954+0000 7f166d531640 1 -- 172.21.15.98:0/589379980 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec480483a0 con 0x55ec48161370 2024-09-19T07:23:52.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.954+0000 7f1667fff640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16580a3430 0x7f16580a58f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f16680fff10 tx=0x7f16540315b0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:52.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.954+0000 7f166d531640 1 --2- 172.21.15.98:0/589379980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48161370 0x55ec48163760 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f16600a3d20 tx=0x7f166009b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb831678c86f2aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:52.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.954+0000 7f1652ffd640 1 -- 172.21.15.98:0/589379980 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166009b5e0 con 0x55ec48161370 2024-09-19T07:23:52.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.954+0000 7f1652ffd640 1 -- 172.21.15.98:0/589379980 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f166009f990 con 0x55ec48161370 2024-09-19T07:23:52.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.954+0000 7f1652ffd640 1 -- 172.21.15.98:0/589379980 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16600a3dc0 con 0x55ec48161370 2024-09-19T07:23:52.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.954+0000 7f167136d740 1 -- 172.21.15.98:0/589379980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48161370 msgr2=0x55ec48163760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:52.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.954+0000 7f167136d740 1 --2- 172.21.15.98:0/589379980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48161370 0x55ec48163760 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f16600a3d20 tx=0x7f166009b000 comp rx=0 tx=0).stop 2024-09-19T07:23:52.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 -- 172.21.15.98:0/589379980 shutdown_connections 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 --2- 172.21.15.98:0/589379980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48161370 0x55ec48163760 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 --2- 172.21.15.98:0/589379980 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec481565d0 0x55ec48156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 --2- 172.21.15.98:0/589379980 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48157b40 0x55ec48156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 -- 172.21.15.98:0/589379980 >> 172.21.15.98:0/589379980 conn(0x55ec4811f310 msgr2=0x55ec48152c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 -- 172.21.15.98:0/589379980 shutdown_connections 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 -- 172.21.15.98:0/589379980 wait complete. 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 -- start start 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 Processor -- start 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec481565d0 0x55ec48160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48157b40 0x55ec4815e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48161370 0x55ec4815e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ec48164070 con 0x55ec48157b40 2024-09-19T07:23:52.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ec48077060 con 0x55ec48161370 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ec481641f0 con 0x55ec481565d0 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f167136d740 10 client.0 _ll_register_callbacks cb 0x55ec47dca8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.955+0000 7f1667fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48157b40 0x55ec4815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f1667fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48157b40 0x55ec4815e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39062/0 (socket says 172.21.15.98:39062) 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f1667fff640 1 -- 172.21.15.98:0/1895700523 learned_addr learned my addr 172.21.15.98:0/1895700523 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f166cd30640 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec481565d0 0x55ec48160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f166d531640 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48161370 0x55ec4815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f1667fff640 1 -- 172.21.15.98:0/1895700523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec481565d0 msgr2=0x55ec48160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f1667fff640 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec481565d0 0x55ec48160d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f1667fff640 1 -- 172.21.15.98:0/1895700523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48161370 msgr2=0x55ec4815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f1667fff640 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48161370 0x55ec4815e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f1667fff640 1 -- 172.21.15.98:0/1895700523 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec47e2d3c0 con 0x55ec48157b40 2024-09-19T07:23:52.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f1667fff640 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48157b40 0x55ec4815e020 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1654033000 tx=0x7f1654009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e7c7763c14638c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:52.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f1647fff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:52.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f1647fff640 1 -- 172.21.15.98:0/1895700523 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165404c020 con 0x55ec48157b40 2024-09-19T07:23:52.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f1647fff640 1 -- 172.21.15.98:0/1895700523 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f1654003a00 con 0x55ec48157b40 2024-09-19T07:23:52.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f167136d740 1 -- 172.21.15.98:0/1895700523 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f166009f990 con 0x55ec48157b40 2024-09-19T07:23:52.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f1647fff640 1 -- 172.21.15.98:0/1895700523 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1654035050 con 0x55ec48157b40 2024-09-19T07:23:52.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f167136d740 10 client.15900 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:52.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.956+0000 7f167136d740 1 -- 172.21.15.98:0/1895700523 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ec4816fb10 con 0x55ec48157b40 2024-09-19T07:23:52.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.957+0000 7f1647fff640 1 -- 172.21.15.98:0/1895700523 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f166009f990 con 0x55ec48157b40 2024-09-19T07:23:52.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.957+0000 7f1647fff640 1 -- 172.21.15.98:0/1895700523 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f165403d450 con 0x55ec48157b40 2024-09-19T07:23:52.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.957+0000 7f167136d740 10 client.15900 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:52.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.957+0000 7f167136d740 10 client.15900 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T07:23:52.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.958+0000 7f167136d740 20 client.15900 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:52.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.958+0000 7f167136d740 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55ec48170f70 0x55ec481733b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.958+0000 7f167136d740 4 client.15900 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:52.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.958+0000 7f167136d740 1 -- 172.21.15.98:0/1895700523 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec480c9860 con 0x55ec48170f70 2024-09-19T07:23:52.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.958+0000 7f166cd30640 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55ec48170f70 0x55ec481733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.958+0000 7f1647fff640 10 client.15900 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:23:52.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.958+0000 7f166cd30640 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55ec48170f70 0x55ec481733b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c068f05f515c822 server_cookie=4303002ce7f61db2 in_seq=0 out_seq=0 2024-09-19T07:23:52.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.959+0000 7f1647fff640 1 -- 172.21.15.98:0/1895700523 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec480c9860 con 0x55ec48170f70 2024-09-19T07:23:52.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.959+0000 7f1647fff640 10 client.15900 handle_command_reply: tid=0 2024-09-19T07:23:52.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.959+0000 7f167136d740 1 client.15900 shutdown 2024-09-19T07:23:52.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.959+0000 7f167136d740 1 -- 172.21.15.98:0/1895700523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48157b40 msgr2=0x55ec4815e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:52.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.959+0000 7f167136d740 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48157b40 0x55ec4815e020 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1654033000 tx=0x7f1654009260 comp rx=0 tx=0).stop 2024-09-19T07:23:52.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.959+0000 7f167136d740 1 -- 172.21.15.98:0/1895700523 shutdown_connections 2024-09-19T07:23:52.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.959+0000 7f167136d740 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48161370 0x55ec4815e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.959+0000 7f167136d740 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec48157b40 0x55ec4815e020 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.959+0000 7f167136d740 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55ec48170f70 0x55ec481733b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.959+0000 7f1647fff640 0 client.15900 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:23:52.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.959+0000 7f167136d740 1 --2- 172.21.15.98:0/1895700523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec481565d0 0x55ec48160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.959+0000 7f167136d740 1 -- 172.21.15.98:0/1895700523 >> 172.21.15.98:0/1895700523 conn(0x55ec4811f310 msgr2=0x55ec48158990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:52.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.960+0000 7f167136d740 1 -- 172.21.15.98:0/1895700523 shutdown_connections 2024-09-19T07:23:52.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.960+0000 7f167136d740 1 -- 172.21.15.98:0/1895700523 wait complete. 2024-09-19T07:23:52.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.960+0000 7f167136d740 20 client.15900 trim_cache size 0 max 16384 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.972+0000 7f167136d740 1 Processor -- start 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.972+0000 7f167136d740 1 -- start start 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f167136d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 0x55ec4816d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f167136d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48157b40 0x55ec4815d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f167136d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48161370 0x55ec48178c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f167136d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16681b25a0 con 0x55ec481565d0 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f167136d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f16681afe70 con 0x55ec48161370 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f167136d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16681adcc0 con 0x55ec48157b40 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f166cd30640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 0x55ec4816d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f166cd30640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 0x55ec4816d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39078/0 (socket says 172.21.15.98:39078) 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f166cd30640 1 -- 172.21.15.98:0/1907466897 learned_addr learned my addr 172.21.15.98:0/1907466897 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f1667fff640 1 --2- 172.21.15.98:0/1907466897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48157b40 0x55ec4815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f166d531640 1 --2- 172.21.15.98:0/1907466897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48161370 0x55ec48178c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f166cd30640 1 -- 172.21.15.98:0/1907466897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48157b40 msgr2=0x55ec4815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f166cd30640 1 --2- 172.21.15.98:0/1907466897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48157b40 0x55ec4815d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f166cd30640 1 -- 172.21.15.98:0/1907466897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48161370 msgr2=0x55ec48178c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f166cd30640 1 --2- 172.21.15.98:0/1907466897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48161370 0x55ec48178c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f166cd30640 1 -- 172.21.15.98:0/1907466897 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec4815c570 con 0x55ec481565d0 2024-09-19T07:23:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f166d531640 1 --2- 172.21.15.98:0/1907466897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48161370 0x55ec48178c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f166cd30640 1 --2- 172.21.15.98:0/1907466897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 0x55ec4816d310 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f165c000c00 tx=0x7f165c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51353590b3cbc72a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.973+0000 7f16527fc640 1 -- 172.21.15.98:0/1907466897 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c00bc40 con 0x55ec481565d0 2024-09-19T07:23:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.974+0000 7f16527fc640 1 -- 172.21.15.98:0/1907466897 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f165c020030 con 0x55ec481565d0 2024-09-19T07:23:52.975 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.974+0000 7f16527fc640 1 -- 172.21.15.98:0/1907466897 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c01c250 con 0x55ec481565d0 2024-09-19T07:23:52.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.974+0000 7f167136d740 1 -- 172.21.15.98:0/1907466897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 msgr2=0x55ec4816d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:52.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.974+0000 7f167136d740 1 --2- 172.21.15.98:0/1907466897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 0x55ec4816d310 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f165c000c00 tx=0x7f165c008040 comp rx=0 tx=0).stop 2024-09-19T07:23:52.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.974+0000 7f167136d740 1 -- 172.21.15.98:0/1907466897 shutdown_connections 2024-09-19T07:23:52.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.974+0000 7f167136d740 1 --2- 172.21.15.98:0/1907466897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48161370 0x55ec48178c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.974+0000 7f167136d740 1 --2- 172.21.15.98:0/1907466897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48157b40 0x55ec4815d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.974+0000 7f167136d740 1 --2- 172.21.15.98:0/1907466897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 0x55ec4816d310 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.974+0000 7f167136d740 1 -- 172.21.15.98:0/1907466897 >> 172.21.15.98:0/1907466897 conn(0x55ec4811f310 msgr2=0x55ec4815c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.974+0000 7f167136d740 1 -- 172.21.15.98:0/1907466897 shutdown_connections 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.974+0000 7f167136d740 1 -- 172.21.15.98:0/1907466897 wait complete. 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.974+0000 7f167136d740 1 -- start start 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f167136d740 1 Processor -- start 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f167136d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 0x55ec48169d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f167136d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48157b40 0x55ec481650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f167136d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48161370 0x55ec481657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f167136d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16681ae330 con 0x55ec481565d0 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f167136d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f16681af7a0 con 0x55ec48157b40 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f167136d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16681aea00 con 0x55ec48161370 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f167136d740 10 client.0 _ll_register_callbacks cb 0x7f1654041070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f166cd30640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 0x55ec48169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f166cd30640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 0x55ec48169d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39080/0 (socket says 172.21.15.98:39080) 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f166cd30640 1 -- 172.21.15.98:0/2088184571 learned_addr learned my addr 172.21.15.98:0/2088184571 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f166d531640 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48161370 0x55ec481657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f1667fff640 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48157b40 0x55ec481650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f166cd30640 1 -- 172.21.15.98:0/2088184571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48161370 msgr2=0x55ec481657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f166cd30640 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48161370 0x55ec481657e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f166cd30640 1 -- 172.21.15.98:0/2088184571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48157b40 msgr2=0x55ec481650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f166cd30640 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48157b40 0x55ec481650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f166cd30640 1 -- 172.21.15.98:0/2088184571 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec481dac50 con 0x55ec481565d0 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.975+0000 7f1667fff640 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48157b40 0x55ec481650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.976+0000 7f166cd30640 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 0x55ec48169d70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f165c00b940 tx=0x7f165c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdadd61ec8d7224 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.976+0000 7f1647fff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.976+0000 7f1647fff640 1 -- 172.21.15.98:0/2088184571 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f165c029020 con 0x55ec481565d0 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.976+0000 7f1647fff640 1 -- 172.21.15.98:0/2088184571 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f165c0248e0 con 0x55ec481565d0 2024-09-19T07:23:52.982 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.976+0000 7f167136d740 1 -- 172.21.15.98:0/2088184571 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f165c020030 con 0x55ec481565d0 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.976+0000 7f1647fff640 1 -- 172.21.15.98:0/2088184571 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f165c024ae0 con 0x55ec481565d0 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.976+0000 7f167136d740 10 client.15906 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.976+0000 7f167136d740 1 -- 172.21.15.98:0/2088184571 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ec481dbdf0 con 0x55ec481565d0 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.976+0000 7f1647fff640 1 -- 172.21.15.98:0/2088184571 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f165c020030 con 0x55ec481565d0 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.976+0000 7f1647fff640 1 -- 172.21.15.98:0/2088184571 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f165c013670 con 0x55ec481565d0 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.977+0000 7f167136d740 10 client.15906 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.977+0000 7f167136d740 10 client.15906 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.977+0000 7f167136d740 20 client.15906 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.977+0000 7f167136d740 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55ec481dc530 0x55ec481de950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.977+0000 7f167136d740 4 client.15906 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.977+0000 7f167136d740 1 -- 172.21.15.98:0/2088184571 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec480c3d70 con 0x55ec481dc530 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.977+0000 7f1667fff640 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55ec481dc530 0x55ec481de950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:52.983 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.977+0000 7f1667fff640 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55ec481dc530 0x55ec481de950 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ce008500d0395916 server_cookie=958a4e5100107b59 in_seq=0 out_seq=0 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.977+0000 7f1647fff640 10 client.15906 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.977+0000 7f1647fff640 1 -- 172.21.15.98:0/2088184571 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec480c3d70 con 0x55ec481dc530 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f1647fff640 10 client.15906 handle_command_reply: tid=0 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f167136d740 1 client.15906 shutdown 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f167136d740 1 -- 172.21.15.98:0/2088184571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 msgr2=0x55ec48169d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f167136d740 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 0x55ec48169d70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f165c00b940 tx=0x7f165c00beb0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f167136d740 1 -- 172.21.15.98:0/2088184571 shutdown_connections 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f167136d740 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55ec481dc530 0x55ec481de950 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f167136d740 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ec48161370 0x55ec481657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f167136d740 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec48157b40 0x55ec481650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f167136d740 1 --2- 172.21.15.98:0/2088184571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ec481565d0 0x55ec48169d70 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f167136d740 1 -- 172.21.15.98:0/2088184571 >> 172.21.15.98:0/2088184571 conn(0x55ec4811f310 msgr2=0x55ec4815d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f1647fff640 0 client.15906 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:23:52.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f167136d740 1 -- 172.21.15.98:0/2088184571 shutdown_connections 2024-09-19T07:23:52.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f167136d740 1 -- 172.21.15.98:0/2088184571 wait complete. 2024-09-19T07:23:52.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.978+0000 7f167136d740 20 client.15906 trim_cache size 0 max 16384 2024-09-19T07:23:52.985 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:23:52.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.979+0000 7f166ef94640 1 -- 172.21.15.98:0/3099612077 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16580a3430 msgr2=0x7f16580a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.979+0000 7f166ef94640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16580a3430 0x7f16580a58f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f16680fff10 tx=0x7f16540315b0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.979+0000 7f166ef94640 1 -- 172.21.15.98:0/3099612077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f20 msgr2=0x7f1668074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.979+0000 7f166ef94640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f20 0x7f1668074f70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f166000b970 tx=0x7f166000be30 comp rx=0 tx=0).stop 2024-09-19T07:23:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.979+0000 7f166ef94640 1 -- 172.21.15.98:0/3099612077 shutdown_connections 2024-09-19T07:23:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.979+0000 7f166ef94640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16580a3430 0x7f16580a58f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.979+0000 7f166ef94640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1668106f20 0x7f1668074f70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.979+0000 7f166ef94640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16681027a0 0x7f1668074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.979+0000 7f166ef94640 1 --2- 172.21.15.98:0/3099612077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1668101df0 0x7f16680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.979+0000 7f166ef94640 1 -- 172.21.15.98:0/3099612077 >> 172.21.15.98:0/3099612077 conn(0x7f16680fd8f0 msgr2=0x7f16680fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.979+0000 7f166ef94640 1 -- 172.21.15.98:0/3099612077 shutdown_connections 2024-09-19T07:23:52.986 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:52.979+0000 7f166ef94640 1 -- 172.21.15.98:0/3099612077 wait complete. 2024-09-19T07:23:53.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:52 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2528271359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:53.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:52 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2528271359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:23:53.622 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:23:53.701 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:54.006 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:53 smithi098 ceph-mon[30950]: pgmap v58: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T07:23:54.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:53 smithi162 ceph-mon[35726]: pgmap v58: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T07:23:54.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.222+0000 7f8217b66640 1 -- 172.21.15.98:0/470618148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8210100cc0 msgr2=0x7f8210106800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:54.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.222+0000 7f8217b66640 1 --2- 172.21.15.98:0/470618148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8210100cc0 0x7f8210106800 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8200009900 tx=0x7f820002a410 comp rx=0 tx=0).stop 2024-09-19T07:23:54.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.222+0000 7f8217b66640 1 -- 172.21.15.98:0/470618148 shutdown_connections 2024-09-19T07:23:54.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.222+0000 7f8217b66640 1 --2- 172.21.15.98:0/470618148 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8210106f30 0x7f821010eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.222+0000 7f8217b66640 1 --2- 172.21.15.98:0/470618148 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8210100cc0 0x7f8210106800 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.222+0000 7f8217b66640 1 --2- 172.21.15.98:0/470618148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8210100310 0x7f82101006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.222+0000 7f8217b66640 1 -- 172.21.15.98:0/470618148 >> 172.21.15.98:0/470618148 conn(0x7f8210077210 msgr2=0x7f82100fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:54.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.222+0000 7f8217b66640 1 -- 172.21.15.98:0/470618148 shutdown_connections 2024-09-19T07:23:54.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.222+0000 7f8217b66640 1 -- 172.21.15.98:0/470618148 wait complete. 2024-09-19T07:23:54.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.223+0000 7f8217b66640 1 Processor -- start 2024-09-19T07:23:54.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.223+0000 7f8217b66640 1 -- start start 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.223+0000 7f8217b66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8210100310 0x7f8210101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.223+0000 7f8217b66640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8210100cc0 0x7f82101017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.223+0000 7f8217b66640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8210106f30 0x7f8210101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.223+0000 7f8217b66640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8210111fd0 con 0x7f8210106f30 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.223+0000 7f8217b66640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8210111e50 con 0x7f8210100cc0 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.223+0000 7f8217b66640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8210112150 con 0x7f8210100310 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.223+0000 7f8216103640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8210106f30 0x7f8210101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.223+0000 7f8216103640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8210106f30 0x7f8210101d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39106/0 (socket says 172.21.15.98:39106) 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.223+0000 7f8215902640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8210100310 0x7f8210101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.223+0000 7f8216103640 1 -- 172.21.15.98:0/3853265581 learned_addr learned my addr 172.21.15.98:0/3853265581 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.224+0000 7f8215902640 1 -- 172.21.15.98:0/3853265581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8210100cc0 msgr2=0x7f82101017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.224+0000 7f8215902640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8210100cc0 0x7f82101017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.224+0000 7f8215902640 1 -- 172.21.15.98:0/3853265581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8210106f30 msgr2=0x7f8210101d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:54.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.224+0000 7f8215902640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8210106f30 0x7f8210101d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.224+0000 7f8215902640 1 -- 172.21.15.98:0/3853265581 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82101a69b0 con 0x7f8210100310 2024-09-19T07:23:54.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.224+0000 7f8216103640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8210106f30 0x7f8210101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:23:54.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.224+0000 7f8215902640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8210100310 0x7f8210101290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f820c00d720 tx=0x7f820c00dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:54.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.224+0000 7f8206ffd640 1 -- 172.21.15.98:0/3853265581 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c017070 con 0x7f8210100310 2024-09-19T07:23:54.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.224+0000 7f8217b66640 1 -- 172.21.15.98:0/3853265581 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82101a6ca0 con 0x7f8210100310 2024-09-19T07:23:54.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.224+0000 7f8206ffd640 1 -- 172.21.15.98:0/3853265581 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f820c00de30 con 0x7f8210100310 2024-09-19T07:23:54.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.224+0000 7f8206ffd640 1 -- 172.21.15.98:0/3853265581 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c0047a0 con 0x7f8210100310 2024-09-19T07:23:54.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.224+0000 7f8217b66640 1 -- 172.21.15.98:0/3853265581 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82101a7190 con 0x7f8210100310 2024-09-19T07:23:54.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.227+0000 7f8206ffd640 1 -- 172.21.15.98:0/3853265581 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f820c004940 con 0x7f8210100310 2024-09-19T07:23:54.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.227+0000 7f8219f3f740 1 Processor -- start 2024-09-19T07:23:54.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.227+0000 7f8219f3f740 1 -- start start 2024-09-19T07:23:54.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.227+0000 7f8219f3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707e850 0x5593b707ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.227+0000 7f8219f3f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707f170 0x5593b70894f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.227+0000 7f8219f3f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b708be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.227+0000 7f8219f3f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5593b6fe3160 con 0x5593b7089a30 2024-09-19T07:23:54.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.227+0000 7f8219f3f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5593b6f8a720 con 0x5593b707f170 2024-09-19T07:23:54.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.227+0000 7f8219f3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5593b6fdf120 con 0x5593b707e850 2024-09-19T07:23:54.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8216103640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707e850 0x5593b707ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8215101640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b708be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8216103640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707e850 0x5593b707ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:56758/0 (socket says 172.21.15.98:56758) 2024-09-19T07:23:54.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8215101640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b708be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39116/0 (socket says 172.21.15.98:39116) 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8216103640 1 -- 172.21.15.98:0/1890812534 learned_addr learned my addr 172.21.15.98:0/1890812534 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8215902640 1 --2- 172.21.15.98:0/1890812534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707f170 0x5593b70894f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8215101640 1 -- 172.21.15.98:0/1890812534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707e850 msgr2=0x5593b707ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8215101640 1 --2- 172.21.15.98:0/1890812534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707e850 0x5593b707ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8215101640 1 -- 172.21.15.98:0/1890812534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707f170 msgr2=0x5593b70894f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8215101640 1 --2- 172.21.15.98:0/1890812534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707f170 0x5593b70894f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8215101640 1 -- 172.21.15.98:0/1890812534 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593b6d54ba0 con 0x5593b7089a30 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8206ffd640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f81fc0a33b0 0x7f81fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8215101640 1 --2- 172.21.15.98:0/1890812534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b708be20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8210102d20 tx=0x7f8200005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7550ce0e451f1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8216103640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f81fc0a33b0 0x7f81fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f8206ffd640 1 -- 172.21.15.98:0/3853265581 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f820c0cfa40 con 0x7f8210100310 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.228+0000 7f81fbfff640 1 -- 172.21.15.98:0/1890812534 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200040020 con 0x5593b7089a30 2024-09-19T07:23:54.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.229+0000 7f81fbfff640 1 -- 172.21.15.98:0/1890812534 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8200004040 con 0x5593b7089a30 2024-09-19T07:23:54.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.229+0000 7f81fbfff640 1 -- 172.21.15.98:0/1890812534 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200035040 con 0x5593b7089a30 2024-09-19T07:23:54.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.229+0000 7f8219f3f740 1 -- 172.21.15.98:0/1890812534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 msgr2=0x5593b708be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.229+0000 7f8216103640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f81fc0a33b0 0x7f81fc0a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8208009500 tx=0x7f820800b040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.229+0000 7f8219f3f740 1 --2- 172.21.15.98:0/1890812534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b708be20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8210102d20 tx=0x7f8200005d50 comp rx=0 tx=0).stop 2024-09-19T07:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.229+0000 7f8219f3f740 1 -- 172.21.15.98:0/1890812534 shutdown_connections 2024-09-19T07:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.229+0000 7f8219f3f740 1 --2- 172.21.15.98:0/1890812534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b708be20 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.229+0000 7f8219f3f740 1 --2- 172.21.15.98:0/1890812534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707f170 0x5593b70894f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.229+0000 7f8219f3f740 1 --2- 172.21.15.98:0/1890812534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707e850 0x5593b707ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.229+0000 7f8219f3f740 1 -- 172.21.15.98:0/1890812534 >> 172.21.15.98:0/1890812534 conn(0x5593b707ade0 msgr2=0x5593b707b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.230+0000 7f8219f3f740 1 -- 172.21.15.98:0/1890812534 shutdown_connections 2024-09-19T07:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.230+0000 7f8219f3f740 1 -- 172.21.15.98:0/1890812534 wait complete. 2024-09-19T07:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.230+0000 7f8219f3f740 1 -- start start 2024-09-19T07:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.230+0000 7f8219f3f740 1 Processor -- start 2024-09-19T07:23:54.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8219f3f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707e850 0x5593b7086880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8219f3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707f170 0x5593b7086dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8219f3f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b7087300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8219f3f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5593b708c600 con 0x5593b7089a30 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8219f3f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5593b6f6b900 con 0x5593b707e850 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8219f3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5593b708c780 con 0x5593b707f170 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8219f3f740 10 client.0 _ll_register_callbacks cb 0x5593b6f69780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8216103640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b7087300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8216103640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b7087300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39124/0 (socket says 172.21.15.98:39124) 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8215902640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707e850 0x5593b7086880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8216103640 1 -- 172.21.15.98:0/1599321189 learned_addr learned my addr 172.21.15.98:0/1599321189 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8215101640 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707f170 0x5593b7086dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8216103640 1 -- 172.21.15.98:0/1599321189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707f170 msgr2=0x5593b7086dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:54.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8216103640 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707f170 0x5593b7086dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8216103640 1 -- 172.21.15.98:0/1599321189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707e850 msgr2=0x5593b7086880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8216103640 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707e850 0x5593b7086880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8216103640 1 -- 172.21.15.98:0/1599321189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593b6fabc50 con 0x5593b7089a30 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8215101640 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707f170 0x5593b7086dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f8216103640 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b7087300 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f82080156d0 tx=0x7f8208004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ce067c52e15278 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.231+0000 7f81f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f81f97fa640 1 -- 172.21.15.98:0/1599321189 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820801d050 con 0x5593b7089a30 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f8219f3f740 1 -- 172.21.15.98:0/1599321189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8200004040 con 0x5593b7089a30 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f81f97fa640 1 -- 172.21.15.98:0/1599321189 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f8208017a10 con 0x5593b7089a30 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f81f97fa640 1 -- 172.21.15.98:0/1599321189 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8208030050 con 0x5593b7089a30 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f8219f3f740 10 client.15918 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f8219f3f740 1 -- 172.21.15.98:0/1599321189 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5593b70982c0 con 0x5593b7089a30 2024-09-19T07:23:54.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f81f97fa640 1 -- 172.21.15.98:0/1599321189 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8200004040 con 0x5593b7089a30 2024-09-19T07:23:54.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f81f97fa640 1 -- 172.21.15.98:0/1599321189 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f820802b3b0 con 0x5593b7089a30 2024-09-19T07:23:54.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f8219f3f740 10 client.15918 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:54.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f8219f3f740 10 client.15918 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:23:54.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f8219f3f740 20 client.15918 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:54.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f8219f3f740 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5593b7099780 0x5593b709bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f8219f3f740 4 client.15918 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:54.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.232+0000 7f8219f3f740 1 -- 172.21.15.98:0/1599321189 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593b6ff0890 con 0x5593b7099780 2024-09-19T07:23:54.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.233+0000 7f8215902640 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5593b7099780 0x5593b709bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.233+0000 7f8215902640 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5593b7099780 0x5593b709bbf0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50a4b3731771118f server_cookie=93ddc37d39259ac in_seq=0 out_seq=0 2024-09-19T07:23:54.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.233+0000 7f81f97fa640 10 client.15918 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:54.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.234+0000 7f81f97fa640 1 -- 172.21.15.98:0/1599321189 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593b6ff0890 con 0x5593b7099780 2024-09-19T07:23:54.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.234+0000 7f81f97fa640 10 client.15918 handle_command_reply: tid=0 2024-09-19T07:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.234+0000 7f8219f3f740 1 client.15918 shutdown 2024-09-19T07:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.234+0000 7f8219f3f740 1 -- 172.21.15.98:0/1599321189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 msgr2=0x5593b7087300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.234+0000 7f8219f3f740 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b7087300 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f82080156d0 tx=0x7f8208004a40 comp rx=0 tx=0).stop 2024-09-19T07:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.234+0000 7f8219f3f740 1 -- 172.21.15.98:0/1599321189 shutdown_connections 2024-09-19T07:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.234+0000 7f8219f3f740 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5593b7099780 0x5593b709bbf0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.234+0000 7f8219f3f740 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b7087300 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.234+0000 7f8219f3f740 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707f170 0x5593b7086dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.234+0000 7f8219f3f740 1 --2- 172.21.15.98:0/1599321189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707e850 0x5593b7086880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.234+0000 7f8219f3f740 1 -- 172.21.15.98:0/1599321189 >> 172.21.15.98:0/1599321189 conn(0x5593b707ade0 msgr2=0x5593b7080ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.234+0000 7f81f97fa640 0 client.15918 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.235+0000 7f8219f3f740 1 -- 172.21.15.98:0/1599321189 shutdown_connections 2024-09-19T07:23:54.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.235+0000 7f8219f3f740 1 -- 172.21.15.98:0/1599321189 wait complete. 2024-09-19T07:23:54.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.235+0000 7f8219f3f740 20 client.15918 trim_cache size 0 max 16384 2024-09-19T07:23:54.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.252+0000 7f8219f3f740 1 Processor -- start 2024-09-19T07:23:54.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.252+0000 7f8219f3f740 1 -- start start 2024-09-19T07:23:54.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8219f3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707e850 0x5593b70a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.253 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8219f3f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b707f170 0x5593b70a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8219f3f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b7089a30 0x5593b7083b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8219f3f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f82101b23d0 con 0x5593b707f170 2024-09-19T07:23:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8219f3f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f82101afca0 con 0x5593b7089a30 2024-09-19T07:23:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8219f3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82101adaf0 con 0x5593b707e850 2024-09-19T07:23:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8215101640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b707f170 0x5593b70a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8215101640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b707f170 0x5593b70a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39136/0 (socket says 172.21.15.98:39136) 2024-09-19T07:23:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8215101640 1 -- 172.21.15.98:0/4294911571 learned_addr learned my addr 172.21.15.98:0/4294911571 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8216103640 1 --2- 172.21.15.98:0/4294911571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b7089a30 0x5593b7083b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8215902640 1 --2- 172.21.15.98:0/4294911571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707e850 0x5593b70a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8215101640 1 -- 172.21.15.98:0/4294911571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707e850 msgr2=0x5593b70a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8215101640 1 --2- 172.21.15.98:0/4294911571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707e850 0x5593b70a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.254 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8215101640 1 -- 172.21.15.98:0/4294911571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b7089a30 msgr2=0x5593b7083b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:54.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8215101640 1 --2- 172.21.15.98:0/4294911571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b7089a30 0x5593b7083b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8215101640 1 -- 172.21.15.98:0/4294911571 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593b707ac10 con 0x5593b707f170 2024-09-19T07:23:54.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8216103640 1 --2- 172.21.15.98:0/4294911571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b7089a30 0x5593b7083b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:54.255 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.253+0000 7f8215101640 1 --2- 172.21.15.98:0/4294911571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b707f170 0x5593b70a1a50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f82000057c0 tx=0x7f8200009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb39e7e5408574d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:54.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.254+0000 7f81fb7fe640 1 -- 172.21.15.98:0/4294911571 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200040030 con 0x5593b707f170 2024-09-19T07:23:54.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.254+0000 7f81fb7fe640 1 -- 172.21.15.98:0/4294911571 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f820003e040 con 0x5593b707f170 2024-09-19T07:23:54.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.254+0000 7f81fb7fe640 1 -- 172.21.15.98:0/4294911571 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8200035040 con 0x5593b707f170 2024-09-19T07:23:54.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.255+0000 7f8219f3f740 1 -- 172.21.15.98:0/4294911571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b707f170 msgr2=0x5593b70a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:54.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.255+0000 7f8219f3f740 1 --2- 172.21.15.98:0/4294911571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b707f170 0x5593b70a1a50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f82000057c0 tx=0x7f8200009520 comp rx=0 tx=0).stop 2024-09-19T07:23:54.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.255+0000 7f8219f3f740 1 -- 172.21.15.98:0/4294911571 shutdown_connections 2024-09-19T07:23:54.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.255+0000 7f8219f3f740 1 --2- 172.21.15.98:0/4294911571 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b7089a30 0x5593b7083b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.255+0000 7f8219f3f740 1 --2- 172.21.15.98:0/4294911571 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b707f170 0x5593b70a1a50 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.255+0000 7f8219f3f740 1 --2- 172.21.15.98:0/4294911571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707e850 0x5593b70a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.255+0000 7f8219f3f740 1 -- 172.21.15.98:0/4294911571 >> 172.21.15.98:0/4294911571 conn(0x5593b707ade0 msgr2=0x5593b7088900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:54.256 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.255+0000 7f8219f3f740 1 -- 172.21.15.98:0/4294911571 shutdown_connections 2024-09-19T07:23:54.257 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.255+0000 7f8219f3f740 1 -- 172.21.15.98:0/4294911571 wait complete. 2024-09-19T07:23:54.257 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:54.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.255+0000 7f8219f3f740 1 -- start start 2024-09-19T07:23:54.259 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.255+0000 7f8219f3f740 1 Processor -- start 2024-09-19T07:23:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8219f3f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707e850 0x5593b70919d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8219f3f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707f170 0x5593b7091f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8219f3f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b708e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8219f3f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f82101ae160 con 0x5593b7089a30 2024-09-19T07:23:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8219f3f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f82101af5d0 con 0x5593b707e850 2024-09-19T07:23:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8219f3f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82101ae830 con 0x5593b707f170 2024-09-19T07:23:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8219f3f740 10 client.0 _ll_register_callbacks cb 0x7f8208007590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8215902640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707e850 0x5593b70919d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8216103640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b708e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8215902640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707e850 0x5593b70919d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:37850/0 (socket says 172.21.15.98:37850) 2024-09-19T07:23:54.260 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8215902640 1 -- 172.21.15.98:0/2395290537 learned_addr learned my addr 172.21.15.98:0/2395290537 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8215101640 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707f170 0x5593b7091f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8215902640 1 -- 172.21.15.98:0/2395290537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707f170 msgr2=0x5593b7091f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8215902640 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707f170 0x5593b7091f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8215902640 1 -- 172.21.15.98:0/2395290537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 msgr2=0x5593b708e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8215902640 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b708e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8215902640 1 -- 172.21.15.98:0/2395290537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593b70763f0 con 0x5593b707e850 2024-09-19T07:23:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.256+0000 7f8216103640 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b708e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:23:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.257+0000 7f8215902640 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707e850 0x5593b70919d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f820c09bc80 tx=0x7f820c0d3590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13e42e38039c5a3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.257+0000 7f81f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-19T07:23:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.257+0000 7f81f97fa640 1 -- 172.21.15.98:0/2395290537 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c004220 con 0x5593b707e850 2024-09-19T07:23:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.257+0000 7f81f97fa640 1 -- 172.21.15.98:0/2395290537 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f820c0cd3e0 con 0x5593b707e850 2024-09-19T07:23:54.261 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.257+0000 7f8219f3f740 1 -- 172.21.15.98:0/2395290537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f820003e040 con 0x5593b707e850 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.257+0000 7f81f97fa640 1 -- 172.21.15.98:0/2395290537 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f820c09c3f0 con 0x5593b707e850 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.257+0000 7f8219f3f740 10 client.25322 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.257+0000 7f8219f3f740 1 -- 172.21.15.98:0/2395290537 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5593b710cfd0 con 0x5593b707e850 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.257+0000 7f81f97fa640 1 -- 172.21.15.98:0/2395290537 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f820003e040 con 0x5593b707e850 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.258+0000 7f81f97fa640 1 -- 172.21.15.98:0/2395290537 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f820c098360 con 0x5593b707e850 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.258+0000 7f8219f3f740 10 client.25322 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.258+0000 7f8219f3f740 10 client.25322 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.258+0000 7f8219f3f740 20 client.25322 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.258+0000 7f8219f3f740 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5593b710d6c0 0x5593b710fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.258+0000 7f8219f3f740 4 client.25322 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.258+0000 7f8219f3f740 1 -- 172.21.15.98:0/2395290537 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x5593b6feabe0 con 0x5593b710d6c0 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.258+0000 7f8215101640 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5593b710d6c0 0x5593b710fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.259+0000 7f8215101640 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5593b710d6c0 0x5593b710fae0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c74fd7757862c5b server_cookie=5868f38ac2f7e877 in_seq=0 out_seq=0 2024-09-19T07:23:54.262 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.259+0000 7f81f97fa640 10 client.25322 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:54.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.269+0000 7f81f97fa640 1 -- 172.21.15.98:0/2395290537 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5593b6feabe0 con 0x5593b710d6c0 2024-09-19T07:23:54.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.269+0000 7f81f97fa640 10 client.25322 handle_command_reply: tid=0 2024-09-19T07:23:54.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.269+0000 7f8219f3f740 1 client.25322 shutdown 2024-09-19T07:23:54.270 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.270+0000 7f8219f3f740 1 -- 172.21.15.98:0/2395290537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707e850 msgr2=0x5593b70919d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:54.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.270+0000 7f8219f3f740 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707e850 0x5593b70919d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f820c09bc80 tx=0x7f820c0d3590 comp rx=0 tx=0).stop 2024-09-19T07:23:54.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.270+0000 7f8219f3f740 1 -- 172.21.15.98:0/2395290537 shutdown_connections 2024-09-19T07:23:54.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.270+0000 7f8219f3f740 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5593b710d6c0 0x5593b710fae0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.270+0000 7f8219f3f740 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593b7089a30 0x5593b708e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.270+0000 7f81f97fa640 0 client.25322 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:54.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.270+0000 7f8219f3f740 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5593b707f170 0x5593b7091f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.270+0000 7f8219f3f740 1 --2- 172.21.15.98:0/2395290537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593b707e850 0x5593b70919d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.270+0000 7f8219f3f740 1 -- 172.21.15.98:0/2395290537 >> 172.21.15.98:0/2395290537 conn(0x5593b707ade0 msgr2=0x5593b7086820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:54.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.270+0000 7f8219f3f740 1 -- 172.21.15.98:0/2395290537 shutdown_connections 2024-09-19T07:23:54.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.270+0000 7f8219f3f740 1 -- 172.21.15.98:0/2395290537 wait complete. 2024-09-19T07:23:54.271 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.270+0000 7f8219f3f740 20 client.25322 trim_cache size 0 max 16384 2024-09-19T07:23:54.272 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:23:54.272 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 24, 2024-09-19T07:23:54.272 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:23:54.272 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 10, 2024-09-19T07:23:54.272 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": { 2024-09-19T07:23:54.272 INFO:teuthology.orchestra.run.smithi098.stdout: "262599e": { 2024-09-19T07:23:54.272 INFO:teuthology.orchestra.run.smithi098.stdout: "version": 10, 2024-09-19T07:23:54.272 INFO:teuthology.orchestra.run.smithi098.stdout: "age_ref": 0.0, 2024-09-19T07:23:54.272 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:23:54.272 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "QUIESCED", 2024-09-19T07:23:54.272 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: "timeout": 90.0, 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: "expiration": 140.3, 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: "members": { 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: "file:/": { 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: "excluded": false, 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "QUIESCED", 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:54.273 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:23:54.274 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:23:54.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.271+0000 7f8217b66640 1 -- 172.21.15.98:0/3853265581 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f81fc0a33b0 msgr2=0x7f81fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:54.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.271+0000 7f8217b66640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f81fc0a33b0 0x7f81fc0a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8208009500 tx=0x7f820800b040 comp rx=0 tx=0).stop 2024-09-19T07:23:54.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.271+0000 7f8217b66640 1 -- 172.21.15.98:0/3853265581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8210100310 msgr2=0x7f8210101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:54.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.271+0000 7f8217b66640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8210100310 0x7f8210101290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f820c00d720 tx=0x7f820c00dbe0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.274 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.271+0000 7f8217b66640 1 -- 172.21.15.98:0/3853265581 shutdown_connections 2024-09-19T07:23:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.271+0000 7f8217b66640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f81fc0a33b0 0x7f81fc0a5870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.271+0000 7f8217b66640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8210106f30 0x7f8210101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.271+0000 7f8217b66640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8210100cc0 0x7f82101017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.271+0000 7f8217b66640 1 --2- 172.21.15.98:0/3853265581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8210100310 0x7f8210101290 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.271+0000 7f8217b66640 1 -- 172.21.15.98:0/3853265581 >> 172.21.15.98:0/3853265581 conn(0x7f8210077210 msgr2=0x7f82101057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.271+0000 7f8217b66640 1 -- 172.21.15.98:0/3853265581 shutdown_connections 2024-09-19T07:23:54.275 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:54.271+0000 7f8217b66640 1 -- 172.21.15.98:0/3853265581 wait complete. 2024-09-19T07:23:54.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:53 smithi139 ceph-mon[35039]: pgmap v58: 97 pgs: 97 active+clean; 1.4 MiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-19T07:23:55.141 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '262599e', quiesce took 4.7 seconds. Will release after: 15.650000000000002 2024-09-19T07:23:55.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 -- 172.21.15.98:0/349171181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c00101420 msgr2=0x7f3c0010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:55.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 --2- 172.21.15.98:0/349171181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c00101420 0x7f3c0010d950 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009cd0 tx=0x7f3bf802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 -- 172.21.15.98:0/349171181 shutdown_connections 2024-09-19T07:23:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 --2- 172.21.15.98:0/349171181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c00101420 0x7f3c0010d950 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 --2- 172.21.15.98:0/349171181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c00100a80 0x7f3c00100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 --2- 172.21.15.98:0/349171181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c00106a80 0x7f3c00106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 -- 172.21.15.98:0/349171181 >> 172.21.15.98:0/349171181 conn(0x7f3c000fc7a0 msgr2=0x7f3c000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 -- 172.21.15.98:0/349171181 shutdown_connections 2024-09-19T07:23:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 -- 172.21.15.98:0/349171181 wait complete. 2024-09-19T07:23:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 Processor -- start 2024-09-19T07:23:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 -- start start 2024-09-19T07:23:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c00100a80 0x7f3c00198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c00101420 0x7f3c001989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.363+0000 7f3c07072640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c00106a80 0x7f3c0019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3c07072640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3c00111fa0 con 0x7f3c00101420 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3c07072640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3c00111e20 con 0x7f3c00106a80 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3c07072640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c00112120 con 0x7f3c00100a80 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c00101420 0x7f3c001989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c00101420 0x7f3c001989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39168/0 (socket says 172.21.15.98:39168) 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3bfffff640 1 -- 172.21.15.98:0/401779880 learned_addr learned my addr 172.21.15.98:0/401779880 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3c0560f640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c00106a80 0x7f3c0019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c00100a80 0x7f3c00198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3bfffff640 1 -- 172.21.15.98:0/401779880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c00100a80 msgr2=0x7f3c00198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3bfffff640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c00100a80 0x7f3c00198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3bfffff640 1 -- 172.21.15.98:0/401779880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c00106a80 msgr2=0x7f3c0019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:55.367 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3bfffff640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c00106a80 0x7f3c0019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3bfffff640 1 -- 172.21.15.98:0/401779880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0019d430 con 0x7f3c00101420 2024-09-19T07:23:55.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3bfffff640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c00101420 0x7f3c001989c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00d950 tx=0x7f3bec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:55.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3bfdffb640 1 -- 172.21.15.98:0/401779880 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec017070 con 0x7f3c00101420 2024-09-19T07:23:55.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3bfdffb640 1 -- 172.21.15.98:0/401779880 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bec009c30 con 0x7f3c00101420 2024-09-19T07:23:55.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3c07072640 1 -- 172.21.15.98:0/401779880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0019d720 con 0x7f3c00101420 2024-09-19T07:23:55.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.364+0000 7f3bfdffb640 1 -- 172.21.15.98:0/401779880 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00f6b0 con 0x7f3c00101420 2024-09-19T07:23:55.368 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.365+0000 7f3c07072640 1 -- 172.21.15.98:0/401779880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c001a5000 con 0x7f3c00101420 2024-09-19T07:23:55.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3bfdffb640 1 -- 172.21.15.98:0/401779880 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3bec0109d0 con 0x7f3c00101420 2024-09-19T07:23:55.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3c0944b740 1 Processor -- start 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3c0944b740 1 -- start start 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3bfdffb640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3bf00a33b0 0x7f3bf00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3c0944b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7dc8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3c0944b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dc8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3c0944b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dd3370 0x55a3e7dd5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3c0944b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a3e7d2e2f0 con 0x55a3e7dc9b40 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3c0944b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a3e7cd5cf0 con 0x55a3e7dd3370 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3c0944b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a3e7d2a2b0 con 0x55a3e7dc85d0 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3c0560f640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3bf00a33b0 0x7f3bf00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3bfdffb640 1 -- 172.21.15.98:0/401779880 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f3bec0cf9e0 con 0x7f3c00101420 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.367+0000 7f3c04e0e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7dc8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3c04e0e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7dc8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39182/0 (socket says 172.21.15.98:39182) 2024-09-19T07:23:55.373 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3c04e0e640 1 -- 172.21.15.98:0/1581925229 learned_addr learned my addr 172.21.15.98:0/1581925229 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3c0560f640 1 --2- 172.21.15.98:0/1581925229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dd3370 0x55a3e7dd5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3c04e0e640 1 -- 172.21.15.98:0/1581925229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dc85d0 msgr2=0x55a3e7dc8a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/1581925229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dc8a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3c04e0e640 1 -- 172.21.15.98:0/1581925229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dd3370 msgr2=0x55a3e7dd5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/1581925229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dd3370 0x55a3e7dd5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3c04e0e640 1 -- 172.21.15.98:0/1581925229 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e7cba3a0 con 0x55a3e7dc9b40 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3c0560f640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3bf00a33b0 0x7f3bf00a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8004ab0 tx=0x7f3bf80317a0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/1581925229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7dc8090 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400b820 tx=0x7f3bf400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf49c29eaa0fe45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3beaffd640 1 -- 172.21.15.98:0/1581925229 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf400d8d0 con 0x55a3e7dc9b40 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3beaffd640 1 -- 172.21.15.98:0/1581925229 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf4019070 con 0x55a3e7dc9b40 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.368+0000 7f3beaffd640 1 -- 172.21.15.98:0/1581925229 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40123e0 con 0x55a3e7dc9b40 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.369+0000 7f3c0944b740 1 -- 172.21.15.98:0/1581925229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 msgr2=0x55a3e7dc8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.369+0000 7f3c0944b740 1 --2- 172.21.15.98:0/1581925229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7dc8090 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400b820 tx=0x7f3bf400bce0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.374 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.369+0000 7f3c0944b740 1 -- 172.21.15.98:0/1581925229 shutdown_connections 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.369+0000 7f3c0944b740 1 --2- 172.21.15.98:0/1581925229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dd3370 0x55a3e7dd5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.369+0000 7f3c0944b740 1 --2- 172.21.15.98:0/1581925229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dc8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.369+0000 7f3c0944b740 1 --2- 172.21.15.98:0/1581925229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7dc8090 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.369+0000 7f3c0944b740 1 -- 172.21.15.98:0/1581925229 >> 172.21.15.98:0/1581925229 conn(0x55a3e7d91310 msgr2=0x55a3e7dc4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.369+0000 7f3c0944b740 1 -- 172.21.15.98:0/1581925229 shutdown_connections 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.369+0000 7f3c0944b740 1 -- 172.21.15.98:0/1581925229 wait complete. 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.369+0000 7f3c0944b740 1 -- start start 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.369+0000 7f3c0944b740 1 Processor -- start 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3c0944b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dd2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3c0944b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7dd0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3c0944b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dd3370 0x55a3e7dd0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3c0944b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a3e7dd6070 con 0x55a3e7dc9b40 2024-09-19T07:23:55.375 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3c0944b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a3e7ce9060 con 0x55a3e7dc85d0 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3c0944b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a3e7dd61f0 con 0x55a3e7dd3370 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3c0944b740 10 client.0 _ll_register_callbacks cb 0x55a3e7a3c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7dd0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7dd0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39186/0 (socket says 172.21.15.98:39186) 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3bfffff640 1 -- 172.21.15.98:0/3478265211 learned_addr learned my addr 172.21.15.98:0/3478265211 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3c0560f640 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dd3370 0x55a3e7dd0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dd2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3bfffff640 1 -- 172.21.15.98:0/3478265211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dd3370 msgr2=0x55a3e7dd0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3bfffff640 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dd3370 0x55a3e7dd0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3bfffff640 1 -- 172.21.15.98:0/3478265211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dc85d0 msgr2=0x55a3e7dd2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3bfffff640 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dd2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3bfffff640 1 -- 172.21.15.98:0/3478265211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3e7a9f3c0 con 0x55a3e7dc9b40 2024-09-19T07:23:55.376 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dd2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3bfffff640 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7dd0020 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0cd160 tx=0x7f3bec09a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50271fcb30956a7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.370+0000 7f3bdffff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3bdffff640 1 -- 172.21.15.98:0/3478265211 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec020040 con 0x55a3e7dc9b40 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3bdffff640 1 -- 172.21.15.98:0/3478265211 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f3bec098300 con 0x55a3e7dc9b40 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3c0944b740 1 -- 172.21.15.98:0/3478265211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bf4019070 con 0x55a3e7dc9b40 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3bdffff640 1 -- 172.21.15.98:0/3478265211 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3bec09c390 con 0x55a3e7dc9b40 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3c0944b740 10 client.15936 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3c0944b740 1 -- 172.21.15.98:0/3478265211 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a3e7de1b10 con 0x55a3e7dc9b40 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3bdffff640 1 -- 172.21.15.98:0/3478265211 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf4019070 con 0x55a3e7dc9b40 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3bdffff640 1 -- 172.21.15.98:0/3478265211 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3bec018d30 con 0x55a3e7dc9b40 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3c0944b740 10 client.15936 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3c0944b740 10 client.15936 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3c0944b740 20 client.15936 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:55.377 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3c0944b740 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55a3e7de2f10 0x55a3e7de5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3c0944b740 4 client.15936 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:55.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.371+0000 7f3c0944b740 1 -- 172.21.15.98:0/3478265211 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3e7d3b860 con 0x55a3e7de2f10 2024-09-19T07:23:55.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.372+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55a3e7de2f10 0x55a3e7de5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.372+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55a3e7de2f10 0x55a3e7de5320 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=734f2dbfd94e3806 server_cookie=dd97e2a046e317af in_seq=0 out_seq=0 2024-09-19T07:23:55.378 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.372+0000 7f3bdffff640 10 client.15936 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:23:55.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3bdffff640 1 -- 172.21.15.98:0/3478265211 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3e7d3b860 con 0x55a3e7de2f10 2024-09-19T07:23:55.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3bdffff640 10 client.15936 handle_command_reply: tid=0 2024-09-19T07:23:55.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3c0944b740 1 client.15936 shutdown 2024-09-19T07:23:55.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3c0944b740 1 -- 172.21.15.98:0/3478265211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 msgr2=0x55a3e7dd0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:55.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3c0944b740 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7dd0020 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0cd160 tx=0x7f3bec09a1a0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3c0944b740 1 -- 172.21.15.98:0/3478265211 shutdown_connections 2024-09-19T07:23:55.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3c0944b740 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55a3e7de2f10 0x55a3e7de5320 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.379 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3c0944b740 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dd3370 0x55a3e7dd0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3c0944b740 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7dd0020 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3c0944b740 1 --2- 172.21.15.98:0/3478265211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dd2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3c0944b740 1 -- 172.21.15.98:0/3478265211 >> 172.21.15.98:0/3478265211 conn(0x55a3e7d91310 msgr2=0x55a3e7dca960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:55.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3bdffff640 0 client.15936 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:23:55.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3c0944b740 1 -- 172.21.15.98:0/3478265211 shutdown_connections 2024-09-19T07:23:55.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3c0944b740 1 -- 172.21.15.98:0/3478265211 wait complete. 2024-09-19T07:23:55.380 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.373+0000 7f3c0944b740 20 client.15936 trim_cache size 0 max 16384 2024-09-19T07:23:55.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.386+0000 7f3c0944b740 1 Processor -- start 2024-09-19T07:23:55.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.386+0000 7f3c0944b740 1 -- start start 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.386+0000 7f3c0944b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dc4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.386+0000 7f3c0944b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7ddf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.386+0000 7f3c0944b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dd3370 0x55a3e7dcf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.386+0000 7f3c0944b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3c001b0210 con 0x55a3e7dc9b40 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.386+0000 7f3c0944b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3c001adae0 con 0x55a3e7dc85d0 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.386+0000 7f3c0944b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c001ab930 con 0x55a3e7dd3370 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.386+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7ddf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.386+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7ddf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39188/0 (socket says 172.21.15.98:39188) 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.386+0000 7f3bfffff640 1 -- 172.21.15.98:0/794926221 learned_addr learned my addr 172.21.15.98:0/794926221 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.386+0000 7f3c0560f640 1 --2- 172.21.15.98:0/794926221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dd3370 0x55a3e7dcf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.387+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/794926221 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dc4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.387+0000 7f3bfffff640 1 -- 172.21.15.98:0/794926221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dd3370 msgr2=0x55a3e7dcf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:55.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.387+0000 7f3bfffff640 1 --2- 172.21.15.98:0/794926221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dd3370 0x55a3e7dcf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.387+0000 7f3bfffff640 1 -- 172.21.15.98:0/794926221 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dc85d0 msgr2=0x55a3e7dc4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:55.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.387+0000 7f3bfffff640 1 --2- 172.21.15.98:0/794926221 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dc4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.387+0000 7f3bfffff640 1 -- 172.21.15.98:0/794926221 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3e7dcefd0 con 0x55a3e7dc9b40 2024-09-19T07:23:55.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.387+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/794926221 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dc4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:23:55.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.387+0000 7f3bfffff640 1 --2- 172.21.15.98:0/794926221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7ddf310 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0980f0 tx=0x7f3bec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0043ecdad8a721 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:55.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.387+0000 7f3bea7fc640 1 -- 172.21.15.98:0/794926221 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec020070 con 0x55a3e7dc9b40 2024-09-19T07:23:55.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.387+0000 7f3bea7fc640 1 -- 172.21.15.98:0/794926221 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bec09bc90 con 0x55a3e7dc9b40 2024-09-19T07:23:55.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.387+0000 7f3bea7fc640 1 -- 172.21.15.98:0/794926221 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec021260 con 0x55a3e7dc9b40 2024-09-19T07:23:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 -- 172.21.15.98:0/794926221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 msgr2=0x55a3e7ddf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 --2- 172.21.15.98:0/794926221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7ddf310 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0980f0 tx=0x7f3bec005880 comp rx=0 tx=0).stop 2024-09-19T07:23:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 -- 172.21.15.98:0/794926221 shutdown_connections 2024-09-19T07:23:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 --2- 172.21.15.98:0/794926221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dd3370 0x55a3e7dcf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 --2- 172.21.15.98:0/794926221 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7ddf310 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 --2- 172.21.15.98:0/794926221 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dc4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 -- 172.21.15.98:0/794926221 >> 172.21.15.98:0/794926221 conn(0x55a3e7d91310 msgr2=0x55a3e7dc4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 -- 172.21.15.98:0/794926221 shutdown_connections 2024-09-19T07:23:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 -- 172.21.15.98:0/794926221 wait complete. 2024-09-19T07:23:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 -- start start 2024-09-19T07:23:55.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 Processor -- start 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dea980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7deaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dd3370 0x55a3e7e49110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3c001abfa0 con 0x55a3e7dc9b40 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3c001ad410 con 0x55a3e7dd3370 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c001ac670 con 0x55a3e7dc85d0 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.388+0000 7f3c0944b740 10 client.0 _ll_register_callbacks cb 0x7f3bec00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7deaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7deaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39202/0 (socket says 172.21.15.98:39202) 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3bfffff640 1 -- 172.21.15.98:0/1731630440 learned_addr learned my addr 172.21.15.98:0/1731630440 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3c0560f640 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dd3370 0x55a3e7e49110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3c04e0e640 1 -- 172.21.15.98:0/1731630440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dd3370 msgr2=0x55a3e7e49110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:55.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dd3370 0x55a3e7e49110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3c04e0e640 1 -- 172.21.15.98:0/1731630440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 msgr2=0x55a3e7deaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7deaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3c04e0e640 1 -- 172.21.15.98:0/1731630440 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3e7e49750 con 0x55a3e7dc85d0 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3bfffff640 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7deaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3c04e0e640 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dea980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400d530 tx=0x7f3bf400bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c56f44dc0269d69a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3bdffff640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3bdffff640 1 -- 172.21.15.98:0/1731630440 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf402b060 con 0x55a3e7dc85d0 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3c0944b740 1 -- 172.21.15.98:0/1731630440 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bec09bc90 con 0x55a3e7dc85d0 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.389+0000 7f3bdffff640 1 -- 172.21.15.98:0/1731630440 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f3bf400dad0 con 0x55a3e7dc85d0 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.390+0000 7f3bdffff640 1 -- 172.21.15.98:0/1731630440 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3bf4023070 con 0x55a3e7dc85d0 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.390+0000 7f3c0944b740 10 client.25294 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.390+0000 7f3c0944b740 1 -- 172.21.15.98:0/1731630440 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a3e7e51cd0 con 0x55a3e7dc85d0 2024-09-19T07:23:55.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.390+0000 7f3bdffff640 1 -- 172.21.15.98:0/1731630440 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bec09bc90 con 0x55a3e7dc85d0 2024-09-19T07:23:55.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.390+0000 7f3bdffff640 1 -- 172.21.15.98:0/1731630440 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3bf4013070 con 0x55a3e7dc85d0 2024-09-19T07:23:55.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.390+0000 7f3c0944b740 10 client.25294 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:55.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.390+0000 7f3c0944b740 10 client.25294 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T07:23:55.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.390+0000 7f3c0944b740 20 client.25294 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:55.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.390+0000 7f3c0944b740 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55a3e7e522c0 0x55a3e7e546e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:55.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.390+0000 7f3c0944b740 4 client.25294 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:23:55.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.390+0000 7f3c0944b740 1 -- 172.21.15.98:0/1731630440 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a3e7d35d70 con 0x55a3e7e522c0 2024-09-19T07:23:55.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3bfffff640 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55a3e7e522c0 0x55a3e7e546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:55.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3bfffff640 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55a3e7e522c0 0x55a3e7e546e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f35f931dc1ecac73 server_cookie=ddc4b4a1c34e90cc in_seq=0 out_seq=0 2024-09-19T07:23:55.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3bdffff640 10 client.25294 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:23:55.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3bdffff640 1 -- 172.21.15.98:0/1731630440 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a3e7d35d70 con 0x55a3e7e522c0 2024-09-19T07:23:55.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3bdffff640 10 client.25294 handle_command_reply: tid=0 2024-09-19T07:23:55.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3c0944b740 1 client.25294 shutdown 2024-09-19T07:23:55.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3c0944b740 1 -- 172.21.15.98:0/1731630440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dc85d0 msgr2=0x55a3e7dea980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:55.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3c0944b740 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dea980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3bf400d530 tx=0x7f3bf400bf30 comp rx=0 tx=0).stop 2024-09-19T07:23:55.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3c0944b740 1 -- 172.21.15.98:0/1731630440 shutdown_connections 2024-09-19T07:23:55.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3c0944b740 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x55a3e7e522c0 0x55a3e7e546e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3c0944b740 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3e7dd3370 0x55a3e7e49110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3c0944b740 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3e7dc9b40 0x55a3e7deaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3c0944b740 1 --2- 172.21.15.98:0/1731630440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3e7dc85d0 0x55a3e7dea980 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3c0944b740 1 -- 172.21.15.98:0/1731630440 >> 172.21.15.98:0/1731630440 conn(0x55a3e7d91310 msgr2=0x55a3e7dca110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:55.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3bdffff640 0 client.25294 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:23:55.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.391+0000 7f3c0944b740 1 -- 172.21.15.98:0/1731630440 shutdown_connections 2024-09-19T07:23:55.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.392+0000 7f3c0944b740 1 -- 172.21.15.98:0/1731630440 wait complete. 2024-09-19T07:23:55.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.392+0000 7f3c0944b740 20 client.25294 trim_cache size 0 max 16384 2024-09-19T07:23:55.399 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:23:55.399 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.392+0000 7f3c07072640 1 -- 172.21.15.98:0/401779880 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3bf00a33b0 msgr2=0x7f3bf00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:55.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.392+0000 7f3c07072640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3bf00a33b0 0x7f3bf00a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8004ab0 tx=0x7f3bf80317a0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.392+0000 7f3c07072640 1 -- 172.21.15.98:0/401779880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c00101420 msgr2=0x7f3c001989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:55.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.392+0000 7f3c07072640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c00101420 0x7f3c001989c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00d950 tx=0x7f3bec00de10 comp rx=0 tx=0).stop 2024-09-19T07:23:55.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.392+0000 7f3c07072640 1 -- 172.21.15.98:0/401779880 shutdown_connections 2024-09-19T07:23:55.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.392+0000 7f3c07072640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3bf00a33b0 0x7f3bf00a5870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.392+0000 7f3c07072640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c00106a80 0x7f3c0019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.392+0000 7f3c07072640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c00101420 0x7f3c001989c0 secure :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00d950 tx=0x7f3bec00de10 comp rx=0 tx=0).stop 2024-09-19T07:23:55.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.392+0000 7f3c07072640 1 --2- 172.21.15.98:0/401779880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c00100a80 0x7f3c00198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:55.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.392+0000 7f3c07072640 1 -- 172.21.15.98:0/401779880 >> 172.21.15.98:0/401779880 conn(0x7f3c000fc7a0 msgr2=0x7f3c000fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:55.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.393+0000 7f3c07072640 1 -- 172.21.15.98:0/401779880 shutdown_connections 2024-09-19T07:23:55.400 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:55.393+0000 7f3c07072640 1 -- 172.21.15.98:0/401779880 wait complete. 2024-09-19T07:23:56.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:55 smithi098 ceph-mon[30950]: pgmap v59: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T07:23:56.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:55 smithi162 ceph-mon[35726]: pgmap v59: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T07:23:56.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:55 smithi139 ceph-mon[35039]: pgmap v59: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.7 KiB/s wr, 9 op/s 2024-09-19T07:23:57.281 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:23:57.535 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:23:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:57 smithi098 ceph-mon[30950]: pgmap v60: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-09-19T07:23:58.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:57 smithi162 ceph-mon[35726]: pgmap v60: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-09-19T07:23:58.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:57 smithi139 ceph-mon[35039]: pgmap v60: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-09-19T07:23:58.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.659+0000 7f42ad63e640 1 -- 172.21.15.98:0/2430932659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42a8101de0 msgr2=0x7f42a81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:58.660 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.659+0000 7f42ad63e640 1 --2- 172.21.15.98:0/2430932659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42a8101de0 0x7f42a81021c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4298009900 tx=0x7f429802a410 comp rx=0 tx=0).stop 2024-09-19T07:23:58.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.659+0000 7f42ad63e640 1 -- 172.21.15.98:0/2430932659 shutdown_connections 2024-09-19T07:23:58.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.659+0000 7f42ad63e640 1 --2- 172.21.15.98:0/2430932659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42a8106f10 0x7f42a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.659+0000 7f42ad63e640 1 --2- 172.21.15.98:0/2430932659 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42a8102790 0x7f42a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.659+0000 7f42ad63e640 1 --2- 172.21.15.98:0/2430932659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42a8101de0 0x7f42a81021c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.659+0000 7f42ad63e640 1 -- 172.21.15.98:0/2430932659 >> 172.21.15.98:0/2430932659 conn(0x7f42a80fd8c0 msgr2=0x7f42a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:58.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.659+0000 7f42ad63e640 1 -- 172.21.15.98:0/2430932659 shutdown_connections 2024-09-19T07:23:58.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.660+0000 7f42ad63e640 1 -- 172.21.15.98:0/2430932659 wait complete. 2024-09-19T07:23:58.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.660+0000 7f42ad63e640 1 Processor -- start 2024-09-19T07:23:58.661 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.660+0000 7f42ad63e640 1 -- start start 2024-09-19T07:23:58.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.660+0000 7f42ad63e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42a8101de0 0x7f42a8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.662 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.660+0000 7f42ad63e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42a8102790 0x7f42a8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.660+0000 7f42ad63e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42a8106f10 0x7f42a819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.660+0000 7f42ad63e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42a8111fb0 con 0x7f42a8102790 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.660+0000 7f42ad63e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f42a8111e30 con 0x7f42a8106f10 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.660+0000 7f42ad63e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42a8112130 con 0x7f42a8101de0 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42a67fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42a8102790 0x7f42a8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42a6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42a8101de0 0x7f42a8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42a6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42a8101de0 0x7f42a8198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:56824/0 (socket says 172.21.15.98:56824) 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42a67fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42a8102790 0x7f42a8198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39214/0 (socket says 172.21.15.98:39214) 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42a6ffd640 1 -- 172.21.15.98:0/33720981 learned_addr learned my addr 172.21.15.98:0/33720981 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42a77fe640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42a8106f10 0x7f42a819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42a67fc640 1 -- 172.21.15.98:0/33720981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42a8101de0 msgr2=0x7f42a8198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42a67fc640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42a8101de0 0x7f42a8198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.663 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42a67fc640 1 -- 172.21.15.98:0/33720981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42a8106f10 msgr2=0x7f42a819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:58.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42a67fc640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42a8106f10 0x7f42a819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42a67fc640 1 -- 172.21.15.98:0/33720981 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a819d4c0 con 0x7f42a8102790 2024-09-19T07:23:58.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42a67fc640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42a8102790 0x7f42a8198a50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f429c00b3f0 tx=0x7f429c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:58.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f428ffff640 1 -- 172.21.15.98:0/33720981 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c015020 con 0x7f42a8102790 2024-09-19T07:23:58.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42ad63e640 1 -- 172.21.15.98:0/33720981 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a819d7b0 con 0x7f42a8102790 2024-09-19T07:23:58.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f428ffff640 1 -- 172.21.15.98:0/33720981 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f429c011d10 con 0x7f42a8102790 2024-09-19T07:23:58.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f428ffff640 1 -- 172.21.15.98:0/33720981 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c00f2e0 con 0x7f42a8102790 2024-09-19T07:23:58.664 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.661+0000 7f42ad63e640 1 -- 172.21.15.98:0/33720981 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a81a5090 con 0x7f42a8102790 2024-09-19T07:23:58.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f428ffff640 1 -- 172.21.15.98:0/33720981 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f429c018020 con 0x7f42a8102790 2024-09-19T07:23:58.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f42afa17740 1 Processor -- start 2024-09-19T07:23:58.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f42afa17740 1 -- start start 2024-09-19T07:23:58.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f42afa17740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 0x56491ae0b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f42afa17740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0b9e0 0x56491ae0be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f42afa17740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae18b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f42afa17740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56491ad6d2f0 con 0x56491ae0cf50 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f42afa17740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56491ad14cf0 con 0x56491ae16780 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f42afa17740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56491ad692b0 con 0x56491ae0b9e0 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f42a77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 0x56491ae0b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f42a77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 0x56491ae0b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39228/0 (socket says 172.21.15.98:39228) 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f42a6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0b9e0 0x56491ae0be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.664+0000 7f42a77fe640 1 -- 172.21.15.98:0/4022843941 learned_addr learned my addr 172.21.15.98:0/4022843941 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f428ffff640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42900a33b0 0x7f42900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f42a67fc640 1 --2- 172.21.15.98:0/4022843941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae18b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f42a77fe640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42900a33b0 0x7f42900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f42a6ffd640 1 -- 172.21.15.98:0/4022843941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 msgr2=0x56491ae18b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f42a6ffd640 1 --2- 172.21.15.98:0/4022843941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae18b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f42a6ffd640 1 -- 172.21.15.98:0/4022843941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 msgr2=0x56491ae0b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f42a6ffd640 1 --2- 172.21.15.98:0/4022843941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 0x56491ae0b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f42a6ffd640 1 -- 172.21.15.98:0/4022843941 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56491acf93a0 con 0x56491ae0b9e0 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f42a67fc640 1 --2- 172.21.15.98:0/4022843941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae18b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f428ffff640 1 -- 172.21.15.98:0/33720981 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f429c0cf3f0 con 0x7f42a8102790 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f42a6ffd640 1 --2- 172.21.15.98:0/4022843941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0b9e0 0x56491ae0be20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4298009230 tx=0x7f4298032d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc33fc0c81040f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f42a77fe640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42900a33b0 0x7f42900a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009fd0 tx=0x7f42a0004ab0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f428d7fa640 1 -- 172.21.15.98:0/4022843941 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298040070 con 0x56491ae0b9e0 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f428d7fa640 1 -- 172.21.15.98:0/4022843941 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4298031870 con 0x56491ae0b9e0 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.665+0000 7f428d7fa640 1 -- 172.21.15.98:0/4022843941 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298035040 con 0x56491ae0b9e0 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.666+0000 7f42afa17740 1 -- 172.21.15.98:0/4022843941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0b9e0 msgr2=0x56491ae0be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:58.671 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.666+0000 7f42afa17740 1 --2- 172.21.15.98:0/4022843941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0b9e0 0x56491ae0be20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4298009230 tx=0x7f4298032d60 comp rx=0 tx=0).stop 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.666+0000 7f42afa17740 1 -- 172.21.15.98:0/4022843941 shutdown_connections 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.666+0000 7f42afa17740 1 --2- 172.21.15.98:0/4022843941 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae18b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.666+0000 7f42afa17740 1 --2- 172.21.15.98:0/4022843941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0b9e0 0x56491ae0be20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.666+0000 7f42afa17740 1 --2- 172.21.15.98:0/4022843941 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 0x56491ae0b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.666+0000 7f42afa17740 1 -- 172.21.15.98:0/4022843941 >> 172.21.15.98:0/4022843941 conn(0x56491add0310 msgr2=0x56491ae08070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.666+0000 7f42afa17740 1 -- 172.21.15.98:0/4022843941 shutdown_connections 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.666+0000 7f42afa17740 1 -- 172.21.15.98:0/4022843941 wait complete. 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.666+0000 7f42afa17740 1 -- start start 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.666+0000 7f42afa17740 1 Processor -- start 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42afa17740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0b9e0 0x56491ae16150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42afa17740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0cf50 0x56491ae13400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42afa17740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.672 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42afa17740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56491ae19420 con 0x56491ae0b9e0 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42afa17740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56491ad28060 con 0x56491ae16780 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42afa17740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56491ae195a0 con 0x56491ae0cf50 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42afa17740 10 client.0 _ll_register_callbacks cb 0x56491aa7b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42a6ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0b9e0 0x56491ae16150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42a6ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0b9e0 0x56491ae16150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39240/0 (socket says 172.21.15.98:39240) 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42a6ffd640 1 -- 172.21.15.98:0/2388814366 learned_addr learned my addr 172.21.15.98:0/2388814366 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42a67fc640 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0cf50 0x56491ae13400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42a77fe640 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42a6ffd640 1 -- 172.21.15.98:0/2388814366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0cf50 msgr2=0x56491ae13400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42a6ffd640 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0cf50 0x56491ae13400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42a6ffd640 1 -- 172.21.15.98:0/2388814366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 msgr2=0x56491ae139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42a6ffd640 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.673 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42a6ffd640 1 -- 172.21.15.98:0/2388814366 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56491aade3c0 con 0x56491ae0b9e0 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42a67fc640 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0cf50 0x56491ae13400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f42a6ffd640 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0b9e0 0x56491ae16150 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4298031aa0 tx=0x7f4298009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cdb6d2540482d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.667+0000 7f428aff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f428aff5640 1 -- 172.21.15.98:0/2388814366 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298035070 con 0x56491ae0b9e0 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f428aff5640 1 -- 172.21.15.98:0/2388814366 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f4298004450 con 0x56491ae0b9e0 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f42afa17740 1 -- 172.21.15.98:0/2388814366 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4298031870 con 0x56491ae0b9e0 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f428aff5640 1 -- 172.21.15.98:0/2388814366 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4298056050 con 0x56491ae0b9e0 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f42afa17740 10 client.15954 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f42afa17740 1 -- 172.21.15.98:0/2388814366 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56491ae24e90 con 0x56491ae0b9e0 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f428aff5640 1 -- 172.21.15.98:0/2388814366 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4298031870 con 0x56491ae0b9e0 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f428aff5640 1 -- 172.21.15.98:0/2388814366 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f429803c850 con 0x56491ae0b9e0 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f42afa17740 10 client.15954 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f42afa17740 10 client.15954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:58.674 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f42afa17740 20 client.15954 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:58.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f42afa17740 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56491ae261e0 0x56491ae285d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f42afa17740 4 client.15954 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:23:58.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f42afa17740 1 -- 172.21.15.98:0/2388814366 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56491ad7a860 con 0x56491ae261e0 2024-09-19T07:23:58.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.668+0000 7f42a67fc640 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56491ae261e0 0x56491ae285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.669+0000 7f428aff5640 10 client.15954 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:58.675 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.669+0000 7f42a67fc640 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56491ae261e0 0x56491ae285d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4222d68e71ddf97b server_cookie=a38f7720b170c5db in_seq=0 out_seq=0 2024-09-19T07:23:58.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f428aff5640 1 -- 172.21.15.98:0/2388814366 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56491ad7a860 con 0x56491ae261e0 2024-09-19T07:23:58.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f428aff5640 10 client.15954 handle_command_reply: tid=0 2024-09-19T07:23:58.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f42afa17740 1 client.15954 shutdown 2024-09-19T07:23:58.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f42afa17740 1 -- 172.21.15.98:0/2388814366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0b9e0 msgr2=0x56491ae16150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:58.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f42afa17740 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0b9e0 0x56491ae16150 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4298031aa0 tx=0x7f4298009260 comp rx=0 tx=0).stop 2024-09-19T07:23:58.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f42afa17740 1 -- 172.21.15.98:0/2388814366 shutdown_connections 2024-09-19T07:23:58.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f42afa17740 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f42afa17740 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0cf50 0x56491ae13400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f42afa17740 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56491ae261e0 0x56491ae285d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f428aff5640 0 client.15954 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:58.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f42afa17740 1 --2- 172.21.15.98:0/2388814366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0b9e0 0x56491ae16150 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f42afa17740 1 -- 172.21.15.98:0/2388814366 >> 172.21.15.98:0/2388814366 conn(0x56491add0310 msgr2=0x56491ae0dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:58.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f42afa17740 1 -- 172.21.15.98:0/2388814366 shutdown_connections 2024-09-19T07:23:58.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f42afa17740 1 -- 172.21.15.98:0/2388814366 wait complete. 2024-09-19T07:23:58.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.670+0000 7f42afa17740 20 client.15954 trim_cache size 0 max 16384 2024-09-19T07:23:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42afa17740 1 Processor -- start 2024-09-19T07:23:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42afa17740 1 -- start start 2024-09-19T07:23:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42afa17740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae0b9e0 0x56491ae226c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42afa17740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0cf50 0x56491adfead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42afa17740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae16780 0x56491ae17b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42afa17740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81ae020 con 0x56491ae16780 2024-09-19T07:23:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42afa17740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81ab8f0 con 0x56491ae0b9e0 2024-09-19T07:23:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42afa17740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81a9740 con 0x56491ae0cf50 2024-09-19T07:23:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42a77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae16780 0x56491ae17b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42a77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae16780 0x56491ae17b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39242/0 (socket says 172.21.15.98:39242) 2024-09-19T07:23:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42a77fe640 1 -- 172.21.15.98:0/4007249128 learned_addr learned my addr 172.21.15.98:0/4007249128 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:58.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42a67fc640 1 --2- 172.21.15.98:0/4007249128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0cf50 0x56491adfead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42a6ffd640 1 --2- 172.21.15.98:0/4007249128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae0b9e0 0x56491ae226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42a77fe640 1 -- 172.21.15.98:0/4007249128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0cf50 msgr2=0x56491adfead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42a77fe640 1 --2- 172.21.15.98:0/4007249128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0cf50 0x56491adfead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42a77fe640 1 -- 172.21.15.98:0/4007249128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae0b9e0 msgr2=0x56491ae226c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42a77fe640 1 --2- 172.21.15.98:0/4007249128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae0b9e0 0x56491ae226c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42a77fe640 1 -- 172.21.15.98:0/4007249128 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56491ae13d60 con 0x56491ae16780 2024-09-19T07:23:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.683+0000 7f42a77fe640 1 --2- 172.21.15.98:0/4007249128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae16780 0x56491ae17b70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f42a00141c0 tx=0x7f42a0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c57c44bbb1061b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f428cff9640 1 -- 172.21.15.98:0/4007249128 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0027070 con 0x56491ae16780 2024-09-19T07:23:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f428cff9640 1 -- 172.21.15.98:0/4007249128 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42a001b040 con 0x56491ae16780 2024-09-19T07:23:58.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f428cff9640 1 -- 172.21.15.98:0/4007249128 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a001a070 con 0x56491ae16780 2024-09-19T07:23:58.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f42afa17740 1 -- 172.21.15.98:0/4007249128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae16780 msgr2=0x56491ae17b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:58.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f42afa17740 1 --2- 172.21.15.98:0/4007249128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae16780 0x56491ae17b70 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f42a00141c0 tx=0x7f42a0009ca0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f42afa17740 1 -- 172.21.15.98:0/4007249128 shutdown_connections 2024-09-19T07:23:58.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f42afa17740 1 --2- 172.21.15.98:0/4007249128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae16780 0x56491ae17b70 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f42afa17740 1 --2- 172.21.15.98:0/4007249128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0cf50 0x56491adfead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f42afa17740 1 --2- 172.21.15.98:0/4007249128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae0b9e0 0x56491ae226c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f42afa17740 1 -- 172.21.15.98:0/4007249128 >> 172.21.15.98:0/4007249128 conn(0x56491add0310 msgr2=0x56491ae124f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f42afa17740 1 -- 172.21.15.98:0/4007249128 shutdown_connections 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f42afa17740 1 -- 172.21.15.98:0/4007249128 wait complete. 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.684+0000 7f42afa17740 1 -- start start 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42afa17740 1 Processor -- start 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42afa17740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0b9e0 0x56491ae1eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42afa17740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 0x56491ae1f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42afa17740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae108d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42afa17740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81a9db0 con 0x56491ae0cf50 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42afa17740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81ab220 con 0x56491ae16780 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42afa17740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42a81aa480 con 0x56491ae0b9e0 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42afa17740 10 client.0 _ll_register_callbacks cb 0x7f42a0009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:23:58.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42a67fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 0x56491ae1f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42a67fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 0x56491ae1f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39250/0 (socket says 172.21.15.98:39250) 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42a67fc640 1 -- 172.21.15.98:0/405807183 learned_addr learned my addr 172.21.15.98:0/405807183 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42a6ffd640 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0b9e0 0x56491ae1eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42a77fe640 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae108d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42a67fc640 1 -- 172.21.15.98:0/405807183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0b9e0 msgr2=0x56491ae1eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42a67fc640 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0b9e0 0x56491ae1eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42a67fc640 1 -- 172.21.15.98:0/405807183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 msgr2=0x56491ae108d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42a67fc640 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae108d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42a67fc640 1 -- 172.21.15.98:0/405807183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56491ae11100 con 0x56491ae0cf50 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f42a67fc640 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 0x56491ae1f0e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f429c097bc0 tx=0x7f429c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1fa664734d3db4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.685+0000 7f428aff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f428aff5640 1 -- 172.21.15.98:0/405807183 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0a4420 con 0x56491ae0cf50 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f428aff5640 1 -- 172.21.15.98:0/405807183 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f429c010510 con 0x56491ae0cf50 2024-09-19T07:23:58.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f42afa17740 1 -- 172.21.15.98:0/405807183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42a001b040 con 0x56491ae0cf50 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f428aff5640 1 -- 172.21.15.98:0/405807183 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f429c0ccd90 con 0x56491ae0cf50 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f42afa17740 10 client.15960 fetch_fsmap learned FSMap version 24 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f42afa17740 1 -- 172.21.15.98:0/405807183 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56491ae2de40 con 0x56491ae0cf50 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f428aff5640 1 -- 172.21.15.98:0/405807183 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42a001b040 con 0x56491ae0cf50 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f428aff5640 1 -- 172.21.15.98:0/405807183 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f429c09cae0 con 0x56491ae0cf50 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f42afa17740 10 client.15960 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f42afa17740 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f42afa17740 20 client.15960 populate_metadata read hostname 'smithi098' 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f42afa17740 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56491ae90f10 0x56491ae93330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f42afa17740 4 client.15960 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f42afa17740 1 -- 172.21.15.98:0/405807183 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56491ad74d70 con 0x56491ae90f10 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.686+0000 7f42a6ffd640 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56491ae90f10 0x56491ae93330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:23:58.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f428aff5640 10 client.15960 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42a6ffd640 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56491ae90f10 0x56491ae93330 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dfe5317900b166c server_cookie=df5651403a8af3b9 in_seq=0 out_seq=0 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f428aff5640 1 -- 172.21.15.98:0/405807183 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56491ad74d70 con 0x56491ae90f10 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f428aff5640 10 client.15960 handle_command_reply: tid=0 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42afa17740 1 client.15960 shutdown 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42afa17740 1 -- 172.21.15.98:0/405807183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 msgr2=0x56491ae1f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42afa17740 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 0x56491ae1f0e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f429c097bc0 tx=0x7f429c0046c0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42afa17740 1 -- 172.21.15.98:0/405807183 shutdown_connections 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42afa17740 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56491ae16780 0x56491ae108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42afa17740 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56491ae90f10 0x56491ae93330 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42afa17740 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56491ae0cf50 0x56491ae1f0e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42afa17740 1 --2- 172.21.15.98:0/405807183 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56491ae0b9e0 0x56491ae1eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42afa17740 1 -- 172.21.15.98:0/405807183 >> 172.21.15.98:0/405807183 conn(0x56491add0310 msgr2=0x56491ae024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:58.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f428aff5640 0 client.15960 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:23:58.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42afa17740 1 -- 172.21.15.98:0/405807183 shutdown_connections 2024-09-19T07:23:58.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42afa17740 1 -- 172.21.15.98:0/405807183 wait complete. 2024-09-19T07:23:58.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.687+0000 7f42afa17740 20 client.15960 trim_cache size 0 max 16384 2024-09-19T07:23:58.694 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:23:58.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.688+0000 7f42ad63e640 1 -- 172.21.15.98:0/33720981 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42900a33b0 msgr2=0x7f42900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:58.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.688+0000 7f42ad63e640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42900a33b0 0x7f42900a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009fd0 tx=0x7f42a0004ab0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.688+0000 7f42ad63e640 1 -- 172.21.15.98:0/33720981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42a8102790 msgr2=0x7f42a8198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:23:58.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.688+0000 7f42ad63e640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42a8102790 0x7f42a8198a50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f429c00b3f0 tx=0x7f429c00b8b0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.688+0000 7f42ad63e640 1 -- 172.21.15.98:0/33720981 shutdown_connections 2024-09-19T07:23:58.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.688+0000 7f42ad63e640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42900a33b0 0x7f42900a5870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.688+0000 7f42ad63e640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42a8106f10 0x7f42a819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.688+0000 7f42ad63e640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42a8102790 0x7f42a8198a50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.688+0000 7f42ad63e640 1 --2- 172.21.15.98:0/33720981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42a8101de0 0x7f42a8198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:23:58.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.688+0000 7f42ad63e640 1 -- 172.21.15.98:0/33720981 >> 172.21.15.98:0/33720981 conn(0x7f42a80fd8c0 msgr2=0x7f42a80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:23:58.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.688+0000 7f42ad63e640 1 -- 172.21.15.98:0/33720981 shutdown_connections 2024-09-19T07:23:58.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:23:58.688+0000 7f42ad63e640 1 -- 172.21.15.98:0/33720981 wait complete. 2024-09-19T07:24:00.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:23:59 smithi162 ceph-mon[35726]: pgmap v61: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 465 KiB/s wr, 10 op/s 2024-09-19T07:24:00.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:23:59 smithi098 ceph-mon[30950]: pgmap v61: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 465 KiB/s wr, 10 op/s 2024-09-19T07:24:00.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:23:59 smithi139 ceph-mon[35039]: pgmap v61: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 465 KiB/s wr, 10 op/s 2024-09-19T07:24:00.419 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:24:00.420 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:24:00.426 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.426+0000 7f353b074640 1 -- 172.21.15.98:0/3627477742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35341009b0 msgr2=0x7f3534100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.426+0000 7f353b074640 1 --2- 172.21.15.98:0/3627477742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35341009b0 0x7f3534100e10 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f351c009930 tx=0x7f351c02a420 comp rx=0 tx=0).stop 2024-09-19T07:24:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.426+0000 7f353b074640 1 -- 172.21.15.98:0/3627477742 shutdown_connections 2024-09-19T07:24:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.426+0000 7f353b074640 1 --2- 172.21.15.98:0/3627477742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3534101350 0x7f353410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.426+0000 7f353b074640 1 --2- 172.21.15.98:0/3627477742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f35341009b0 0x7f3534100e10 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.426+0000 7f353b074640 1 --2- 172.21.15.98:0/3627477742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35341069c0 0x7f3534106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.426+0000 7f353b074640 1 -- 172.21.15.98:0/3627477742 >> 172.21.15.98:0/3627477742 conn(0x7f3534077990 msgr2=0x7f35340fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.426+0000 7f353b074640 1 -- 172.21.15.98:0/3627477742 shutdown_connections 2024-09-19T07:24:00.427 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.426+0000 7f353b074640 1 -- 172.21.15.98:0/3627477742 wait complete. 2024-09-19T07:24:00.429 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f353b074640 1 Processor -- start 2024-09-19T07:24:00.429 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f353b074640 1 -- start start 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f353b074640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35341009b0 0x7f353419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f353b074640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3534101350 0x7f353419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f353b074640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35341069c0 0x7f353419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f353b074640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3534110e00 con 0x7f3534101350 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f353b074640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3534110c80 con 0x7f35341069c0 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f353b074640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3534110f80 con 0x7f35341009b0 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f3533fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3534101350 0x7f353419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f3533fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3534101350 0x7f353419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39270/0 (socket says 172.21.15.98:39270) 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f3533fff640 1 -- 172.21.15.98:0/4100698331 learned_addr learned my addr 172.21.15.98:0/4100698331 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f3539611640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35341069c0 0x7f353419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.427+0000 7f3538e10640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35341009b0 0x7f353419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.428+0000 7f3533fff640 1 -- 172.21.15.98:0/4100698331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35341009b0 msgr2=0x7f353419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:00.430 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.428+0000 7f3533fff640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35341009b0 0x7f353419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.428+0000 7f3533fff640 1 -- 172.21.15.98:0/4100698331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35341069c0 msgr2=0x7f353419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.428+0000 7f3533fff640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35341069c0 0x7f353419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.428+0000 7f3533fff640 1 -- 172.21.15.98:0/4100698331 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353419f5e0 con 0x7f3534101350 2024-09-19T07:24:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.428+0000 7f3533fff640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3534101350 0x7f353419ab30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f351c009230 tx=0x7f351c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.428+0000 7f3531ffb640 1 -- 172.21.15.98:0/4100698331 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c03f030 con 0x7f3534101350 2024-09-19T07:24:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.428+0000 7f3531ffb640 1 -- 172.21.15.98:0/4100698331 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f351c003ad0 con 0x7f3534101350 2024-09-19T07:24:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.428+0000 7f353b074640 1 -- 172.21.15.98:0/4100698331 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353419f870 con 0x7f3534101350 2024-09-19T07:24:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.428+0000 7f3531ffb640 1 -- 172.21.15.98:0/4100698331 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c035070 con 0x7f3534101350 2024-09-19T07:24:00.431 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.428+0000 7f353b074640 1 -- 172.21.15.98:0/4100698331 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35341a7160 con 0x7f3534101350 2024-09-19T07:24:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.431+0000 7f3531ffb640 1 -- 172.21.15.98:0/4100698331 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f351c042030 con 0x7f3534101350 2024-09-19T07:24:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.431+0000 7f353de15740 1 Processor -- start 2024-09-19T07:24:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.431+0000 7f353de15740 1 -- start start 2024-09-19T07:24:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f353de15740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10560af0 0x557f10560ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f353de15740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10561410 0x557f1056b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f353de15740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f1056bcb0 0x557f1056e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f353de15740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557f104c52f0 con 0x557f10561410 2024-09-19T07:24:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f353de15740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557f1046d270 con 0x557f1056bcb0 2024-09-19T07:24:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f353de15740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557f104c12b0 con 0x557f10560af0 2024-09-19T07:24:00.434 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3538e10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10561410 0x557f1056b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3538e10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10561410 0x557f1056b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39280/0 (socket says 172.21.15.98:39280) 2024-09-19T07:24:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3531ffb640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f35200a3460 0x7f35200a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3538e10640 1 -- 172.21.15.98:0/2433642145 learned_addr learned my addr 172.21.15.98:0/2433642145 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3533fff640 1 --2- 172.21.15.98:0/2433642145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f1056bcb0 0x557f1056e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3539611640 1 --2- 172.21.15.98:0/2433642145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10560af0 0x557f10560ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3539611640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f35200a3460 0x7f35200a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3538e10640 1 -- 172.21.15.98:0/2433642145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10560af0 msgr2=0x557f10560ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3538e10640 1 --2- 172.21.15.98:0/2433642145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10560af0 0x557f10560ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3538e10640 1 -- 172.21.15.98:0/2433642145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f1056bcb0 msgr2=0x557f1056e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3538e10640 1 --2- 172.21.15.98:0/2433642145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f1056bcb0 0x557f1056e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3531ffb640 1 -- 172.21.15.98:0/4100698331 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f351c0f0160 con 0x7f3534101350 2024-09-19T07:24:00.435 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3538e10640 1 -- 172.21.15.98:0/2433642145 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1046c340 con 0x557f10561410 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3533fff640 1 --2- 172.21.15.98:0/2433642145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f1056bcb0 0x557f1056e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3538e10640 1 --2- 172.21.15.98:0/2433642145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10561410 0x557f1056b770 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f352400ac90 tx=0x7f352400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312fc56d29d68e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.432+0000 7f3539611640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f35200a3460 0x7f35200a5920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f352c009fd0 tx=0x7f352c009600 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.433+0000 7f352affd640 1 -- 172.21.15.98:0/2433642145 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352401d070 con 0x557f10561410 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.433+0000 7f352affd640 1 -- 172.21.15.98:0/2433642145 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3524018b20 con 0x557f10561410 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.433+0000 7f352affd640 1 -- 172.21.15.98:0/2433642145 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524010b40 con 0x557f10561410 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.433+0000 7f353de15740 1 -- 172.21.15.98:0/2433642145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10561410 msgr2=0x557f1056b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.433+0000 7f353de15740 1 --2- 172.21.15.98:0/2433642145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10561410 0x557f1056b770 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f352400ac90 tx=0x7f352400f790 comp rx=0 tx=0).stop 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.433+0000 7f353de15740 1 -- 172.21.15.98:0/2433642145 shutdown_connections 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.433+0000 7f353de15740 1 --2- 172.21.15.98:0/2433642145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f1056bcb0 0x557f1056e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.433+0000 7f353de15740 1 --2- 172.21.15.98:0/2433642145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10561410 0x557f1056b770 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.433+0000 7f353de15740 1 --2- 172.21.15.98:0/2433642145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10560af0 0x557f10560ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.433+0000 7f353de15740 1 -- 172.21.15.98:0/2433642145 >> 172.21.15.98:0/2433642145 conn(0x557f1055d060 msgr2=0x557f1055d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:00.436 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.434+0000 7f353de15740 1 -- 172.21.15.98:0/2433642145 shutdown_connections 2024-09-19T07:24:00.437 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.434+0000 7f353de15740 1 -- 172.21.15.98:0/2433642145 wait complete. 2024-09-19T07:24:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.434+0000 7f353de15740 1 -- start start 2024-09-19T07:24:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.434+0000 7f353de15740 1 Processor -- start 2024-09-19T07:24:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f353de15740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 0x557f10568b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.440 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f353de15740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10561410 0x557f10569090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f353de15740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f1056bcb0 0x557f105695d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f353de15740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557f1056e880 con 0x557f10560af0 2024-09-19T07:24:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f353de15740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557f1044e290 con 0x557f1056bcb0 2024-09-19T07:24:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f353de15740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557f1056ea00 con 0x557f10561410 2024-09-19T07:24:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f353de15740 10 client.0 _ll_register_callbacks cb 0x557f1047f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3538e10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 0x557f10568b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3538e10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 0x557f10568b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39294/0 (socket says 172.21.15.98:39294) 2024-09-19T07:24:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3538e10640 1 -- 172.21.15.98:0/3894076786 learned_addr learned my addr 172.21.15.98:0/3894076786 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3533fff640 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10561410 0x557f10569090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3539611640 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f1056bcb0 0x557f105695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3538e10640 1 -- 172.21.15.98:0/3894076786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10561410 msgr2=0x557f10569090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:00.441 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3538e10640 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10561410 0x557f10569090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3538e10640 1 -- 172.21.15.98:0/3894076786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f1056bcb0 msgr2=0x557f105695d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3538e10640 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f1056bcb0 0x557f105695d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3538e10640 1 -- 172.21.15.98:0/3894076786 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f101d8210 con 0x557f10560af0 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3538e10640 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 0x557f10568b50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3524000c00 tx=0x7f35240186f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec20dd1112a35e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3513fff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.435+0000 7f3513fff640 1 -- 172.21.15.98:0/3894076786 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352401d040 con 0x557f10560af0 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f3513fff640 1 -- 172.21.15.98:0/3894076786 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f35240108e0 con 0x557f10560af0 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f353de15740 1 -- 172.21.15.98:0/3894076786 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3524018b20 con 0x557f10560af0 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f3513fff640 1 -- 172.21.15.98:0/3894076786 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3524031050 con 0x557f10560af0 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f353de15740 10 client.15972 fetch_fsmap learned FSMap version 24 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f353de15740 1 -- 172.21.15.98:0/3894076786 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557f102a4620 con 0x557f10560af0 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f3513fff640 1 -- 172.21.15.98:0/3894076786 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3524018b20 con 0x557f10560af0 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f3513fff640 1 -- 172.21.15.98:0/3894076786 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3524020030 con 0x557f10560af0 2024-09-19T07:24:00.442 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f353de15740 10 client.15972 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f353de15740 10 client.15972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f353de15740 20 client.15972 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f353de15740 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557f1057bb60 0x557f1057df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f353de15740 4 client.15972 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f353de15740 1 -- 172.21.15.98:0/3894076786 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f104d2a20 con 0x557f1057bb60 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.436+0000 7f3533fff640 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557f1057bb60 0x557f1057df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.437+0000 7f3533fff640 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557f1057bb60 0x557f1057df50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2410686e522f2216 server_cookie=19380e337978d0e8 in_seq=0 out_seq=0 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.437+0000 7f3513fff640 10 client.15972 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f3513fff640 1 -- 172.21.15.98:0/3894076786 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f104d2a20 con 0x557f1057bb60 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f3513fff640 10 client.15972 handle_command_reply: tid=0 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f353de15740 1 client.15972 shutdown 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f353de15740 1 -- 172.21.15.98:0/3894076786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 msgr2=0x557f10568b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:00.443 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f353de15740 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 0x557f10568b50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3524000c00 tx=0x7f35240186f0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.444 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f353de15740 1 -- 172.21.15.98:0/3894076786 shutdown_connections 2024-09-19T07:24:00.444 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f353de15740 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f1056bcb0 0x557f105695d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.444 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f353de15740 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10561410 0x557f10569090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.444 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f353de15740 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557f1057bb60 0x557f1057df50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.444 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f353de15740 1 --2- 172.21.15.98:0/3894076786 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 0x557f10568b50 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.444 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f3513fff640 0 client.15972 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:00.444 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f353de15740 1 -- 172.21.15.98:0/3894076786 >> 172.21.15.98:0/3894076786 conn(0x557f1055d060 msgr2=0x557f10562d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:00.444 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f353de15740 1 -- 172.21.15.98:0/3894076786 shutdown_connections 2024-09-19T07:24:00.444 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f353de15740 1 -- 172.21.15.98:0/3894076786 wait complete. 2024-09-19T07:24:00.444 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.438+0000 7f353de15740 20 client.15972 trim_cache size 0 max 16384 2024-09-19T07:24:00.456 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.453+0000 7f353de15740 1 Processor -- start 2024-09-19T07:24:00.456 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.453+0000 7f353de15740 1 -- start start 2024-09-19T07:24:00.456 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.453+0000 7f353de15740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 0x557f1055d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.456 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.453+0000 7f353de15740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f10561410 0x557f10583520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.456 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.453+0000 7f353de15740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f1056bcb0 0x557f10583a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.456 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.453+0000 7f353de15740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f35341b22a0 con 0x557f10560af0 2024-09-19T07:24:00.456 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.453+0000 7f353de15740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f35341afb70 con 0x557f10561410 2024-09-19T07:24:00.456 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.453+0000 7f353de15740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f35341ad9c0 con 0x557f1056bcb0 2024-09-19T07:24:00.456 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.453+0000 7f3538e10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 0x557f1055d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.456 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.453+0000 7f3538e10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 0x557f1055d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39310/0 (socket says 172.21.15.98:39310) 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.453+0000 7f3538e10640 1 -- 172.21.15.98:0/2632967244 learned_addr learned my addr 172.21.15.98:0/2632967244 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f3539611640 1 --2- 172.21.15.98:0/2632967244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f1056bcb0 0x557f10583a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f3533fff640 1 --2- 172.21.15.98:0/2632967244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f10561410 0x557f10583520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f3538e10640 1 -- 172.21.15.98:0/2632967244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f1056bcb0 msgr2=0x557f10583a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f3538e10640 1 --2- 172.21.15.98:0/2632967244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f1056bcb0 0x557f10583a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f3538e10640 1 -- 172.21.15.98:0/2632967244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f10561410 msgr2=0x557f10583520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f3538e10640 1 --2- 172.21.15.98:0/2632967244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f10561410 0x557f10583520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f3538e10640 1 -- 172.21.15.98:0/2632967244 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1055ce90 con 0x557f10560af0 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f3539611640 1 --2- 172.21.15.98:0/2632967244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f1056bcb0 0x557f10583a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f3533fff640 1 --2- 172.21.15.98:0/2632967244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f10561410 0x557f10583520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f3538e10640 1 --2- 172.21.15.98:0/2632967244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 0x557f1055d440 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3524004870 tx=0x7f352400a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2cb80dfb1fc205 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f352a7fc640 1 -- 172.21.15.98:0/2632967244 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352401d070 con 0x557f10560af0 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f352a7fc640 1 -- 172.21.15.98:0/2632967244 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3524028070 con 0x557f10560af0 2024-09-19T07:24:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.454+0000 7f352a7fc640 1 -- 172.21.15.98:0/2632967244 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524018bc0 con 0x557f10560af0 2024-09-19T07:24:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.455+0000 7f353de15740 1 -- 172.21.15.98:0/2632967244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 msgr2=0x557f1055d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.455+0000 7f353de15740 1 --2- 172.21.15.98:0/2632967244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 0x557f1055d440 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3524004870 tx=0x7f352400a2d0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.455+0000 7f353de15740 1 -- 172.21.15.98:0/2632967244 shutdown_connections 2024-09-19T07:24:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.455+0000 7f353de15740 1 --2- 172.21.15.98:0/2632967244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f1056bcb0 0x557f10583a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.455+0000 7f353de15740 1 --2- 172.21.15.98:0/2632967244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f10561410 0x557f10583520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.455+0000 7f353de15740 1 --2- 172.21.15.98:0/2632967244 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f10560af0 0x557f1055d440 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.455+0000 7f353de15740 1 -- 172.21.15.98:0/2632967244 >> 172.21.15.98:0/2632967244 conn(0x557f1055d060 msgr2=0x557f1056abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.455+0000 7f353de15740 1 -- 172.21.15.98:0/2632967244 shutdown_connections 2024-09-19T07:24:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.455+0000 7f353de15740 1 -- 172.21.15.98:0/2632967244 wait complete. 2024-09-19T07:24:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.455+0000 7f353de15740 1 -- start start 2024-09-19T07:24:00.458 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f353de15740 1 Processor -- start 2024-09-19T07:24:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f353de15740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f10560af0 0x557f105740a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f353de15740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10561410 0x557f105745e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f353de15740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f1056bcb0 0x557f10571630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f353de15740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f35341ae030 con 0x557f1056bcb0 2024-09-19T07:24:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f353de15740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f35341af4a0 con 0x557f10560af0 2024-09-19T07:24:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f353de15740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f35341ae700 con 0x557f10561410 2024-09-19T07:24:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f353de15740 10 client.0 _ll_register_callbacks cb 0x7f352401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f3539611640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f1056bcb0 0x557f10571630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f3539611640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f1056bcb0 0x557f10571630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39312/0 (socket says 172.21.15.98:39312) 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f3539611640 1 -- 172.21.15.98:0/2476293799 learned_addr learned my addr 172.21.15.98:0/2476293799 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f3533fff640 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10561410 0x557f105745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f3538e10640 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f10560af0 0x557f105740a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f3539611640 1 -- 172.21.15.98:0/2476293799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10561410 msgr2=0x557f105745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f3539611640 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10561410 0x557f105745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f3539611640 1 -- 172.21.15.98:0/2476293799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f10560af0 msgr2=0x557f105740a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f3539611640 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f10560af0 0x557f105740a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.456+0000 7f3539611640 1 -- 172.21.15.98:0/2476293799 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f10571e60 con 0x557f1056bcb0 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f3539611640 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f1056bcb0 0x557f10571630 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f352c013010 tx=0x7f352c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4484f014d549304e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f3513fff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f3513fff640 1 -- 172.21.15.98:0/2476293799 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c023ba0 con 0x557f1056bcb0 2024-09-19T07:24:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f3513fff640 1 -- 172.21.15.98:0/2476293799 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f352c023d40 con 0x557f1056bcb0 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f353de15740 1 -- 172.21.15.98:0/2476293799 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3524028070 con 0x557f1056bcb0 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f3513fff640 1 -- 172.21.15.98:0/2476293799 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f352c02c440 con 0x557f1056bcb0 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f353de15740 10 client.15978 fetch_fsmap learned FSMap version 24 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f353de15740 1 -- 172.21.15.98:0/2476293799 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557f105e6220 con 0x557f1056bcb0 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f3513fff640 1 -- 172.21.15.98:0/2476293799 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3524028070 con 0x557f1056bcb0 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f3513fff640 1 -- 172.21.15.98:0/2476293799 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f352c02a070 con 0x557f1056bcb0 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f353de15740 10 client.15978 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f353de15740 10 client.15978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f353de15740 20 client.15978 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f353de15740 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557f105e69f0 0x557f105e8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f353de15740 4 client.15978 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.457+0000 7f353de15740 1 -- 172.21.15.98:0/2476293799 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f104ccd70 con 0x557f105e69f0 2024-09-19T07:24:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.458+0000 7f3538e10640 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557f105e69f0 0x557f105e8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.458+0000 7f3513fff640 10 client.15978 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.458+0000 7f3538e10640 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557f105e69f0 0x557f105e8e10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0f3307e781f30b4 server_cookie=444934eb333ed992 in_seq=0 out_seq=0 2024-09-19T07:24:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.469+0000 7f3513fff640 1 -- 172.21.15.98:0/2476293799 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f104ccd70 con 0x557f105e69f0 2024-09-19T07:24:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.469+0000 7f3513fff640 10 client.15978 handle_command_reply: tid=0 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f353de15740 1 client.15978 shutdown 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f353de15740 1 -- 172.21.15.98:0/2476293799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f1056bcb0 msgr2=0x557f10571630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f353de15740 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f1056bcb0 0x557f10571630 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f352c013010 tx=0x7f352c004a40 comp rx=0 tx=0).stop 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f353de15740 1 -- 172.21.15.98:0/2476293799 shutdown_connections 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f353de15740 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557f105e69f0 0x557f105e8e10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f353de15740 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557f1056bcb0 0x557f10571630 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f353de15740 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557f10561410 0x557f105745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f3513fff640 0 client.15978 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f353de15740 1 --2- 172.21.15.98:0/2476293799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f10560af0 0x557f105740a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f353de15740 1 -- 172.21.15.98:0/2476293799 >> 172.21.15.98:0/2476293799 conn(0x557f1055d060 msgr2=0x557f1055b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f353de15740 1 -- 172.21.15.98:0/2476293799 shutdown_connections 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f353de15740 1 -- 172.21.15.98:0/2476293799 wait complete. 2024-09-19T07:24:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.470+0000 7f353de15740 20 client.15978 trim_cache size 0 max 16384 2024-09-19T07:24:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:24:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:24:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:24:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:24:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.471+0000 7f353b074640 1 -- 172.21.15.98:0/4100698331 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f35200a3460 msgr2=0x7f35200a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.471+0000 7f353b074640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f35200a3460 0x7f35200a5920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f352c009fd0 tx=0x7f352c009600 comp rx=0 tx=0).stop 2024-09-19T07:24:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.471+0000 7f353b074640 1 -- 172.21.15.98:0/4100698331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3534101350 msgr2=0x7f353419ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.471+0000 7f353b074640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3534101350 0x7f353419ab30 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f351c009230 tx=0x7f351c004270 comp rx=0 tx=0).stop 2024-09-19T07:24:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.471+0000 7f353b074640 1 -- 172.21.15.98:0/4100698331 shutdown_connections 2024-09-19T07:24:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.471+0000 7f353b074640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f35200a3460 0x7f35200a5920 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.471+0000 7f353b074640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f35341069c0 0x7f353419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.471+0000 7f353b074640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3534101350 0x7f353419ab30 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.471+0000 7f353b074640 1 --2- 172.21.15.98:0/4100698331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35341009b0 0x7f353419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.471+0000 7f353b074640 1 -- 172.21.15.98:0/4100698331 >> 172.21.15.98:0/4100698331 conn(0x7f3534077990 msgr2=0x7f3534069da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.471+0000 7f353b074640 1 -- 172.21.15.98:0/4100698331 shutdown_connections 2024-09-19T07:24:00.474 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:00.471+0000 7f353b074640 1 -- 172.21.15.98:0/4100698331 wait complete. 2024-09-19T07:24:00.688 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:01.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.192+0000 7f9d340e7640 1 -- 172.21.15.98:0/1268220727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d2c101ba0 msgr2=0x7f9d2c10d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.192+0000 7f9d340e7640 1 --2- 172.21.15.98:0/1268220727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d2c101ba0 0x7f9d2c10d970 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009ca0 tx=0x7f9d2402a8c0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.192+0000 7f9d340e7640 1 -- 172.21.15.98:0/1268220727 shutdown_connections 2024-09-19T07:24:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.192+0000 7f9d340e7640 1 --2- 172.21.15.98:0/1268220727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d2c101ba0 0x7f9d2c10d970 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.192+0000 7f9d340e7640 1 --2- 172.21.15.98:0/1268220727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c101200 0x7f9d2c101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.192+0000 7f9d340e7640 1 --2- 172.21.15.98:0/1268220727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c105ad0 0x7f9d2c105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.192+0000 7f9d340e7640 1 -- 172.21.15.98:0/1268220727 >> 172.21.15.98:0/1268220727 conn(0x7f9d2c077210 msgr2=0x7f9d2c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.192+0000 7f9d340e7640 1 -- 172.21.15.98:0/1268220727 shutdown_connections 2024-09-19T07:24:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.192+0000 7f9d340e7640 1 -- 172.21.15.98:0/1268220727 wait complete. 2024-09-19T07:24:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d340e7640 1 Processor -- start 2024-09-19T07:24:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d340e7640 1 -- start start 2024-09-19T07:24:01.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d340e7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d2c101200 0x7f9d2c196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d340e7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c101ba0 0x7f9d2c197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d340e7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c105ad0 0x7f9d2c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d340e7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c110ef0 con 0x7f9d2c101200 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d340e7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c110d70 con 0x7f9d2c105ad0 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d340e7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c111070 con 0x7f9d2c101ba0 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d31e83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d2c101200 0x7f9d2c196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d31e83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d2c101200 0x7f9d2c196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39332/0 (socket says 172.21.15.98:39332) 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d31e83640 1 -- 172.21.15.98:0/1542638347 learned_addr learned my addr 172.21.15.98:0/1542638347 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d31682640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c101ba0 0x7f9d2c197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d31e83640 1 -- 172.21.15.98:0/1542638347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c101ba0 msgr2=0x7f9d2c197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d31e83640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c101ba0 0x7f9d2c197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d31e83640 1 -- 172.21.15.98:0/1542638347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c105ad0 msgr2=0x7f9d2c197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:01.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d31e83640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c105ad0 0x7f9d2c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d31e83640 1 -- 172.21.15.98:0/1542638347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c1a6860 con 0x7f9d2c101200 2024-09-19T07:24:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.193+0000 7f9d31682640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c101ba0 0x7f9d2c197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.194+0000 7f9d31e83640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d2c101200 0x7f9d2c196ff0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800d950 tx=0x7f9d2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.194+0000 7f9d1effd640 1 -- 172.21.15.98:0/1542638347 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28017070 con 0x7f9d2c101200 2024-09-19T07:24:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.194+0000 7f9d1effd640 1 -- 172.21.15.98:0/1542638347 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d28009c30 con 0x7f9d2c101200 2024-09-19T07:24:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.194+0000 7f9d340e7640 1 -- 172.21.15.98:0/1542638347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2c1a6b50 con 0x7f9d2c101200 2024-09-19T07:24:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.194+0000 7f9d1effd640 1 -- 172.21.15.98:0/1542638347 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800f6b0 con 0x7f9d2c101200 2024-09-19T07:24:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.194+0000 7f9d340e7640 1 -- 172.21.15.98:0/1542638347 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2c1a70e0 con 0x7f9d2c101200 2024-09-19T07:24:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d364c0740 1 Processor -- start 2024-09-19T07:24:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d1effd640 1 -- 172.21.15.98:0/1542638347 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9d280109d0 con 0x7f9d2c101200 2024-09-19T07:24:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d364c0740 1 -- start start 2024-09-19T07:24:01.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d364c0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f134b60 0x55932f134f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d364c0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f135480 0x55932f13f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d364c0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f142130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d364c0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55932f09a280 con 0x55932f13fd40 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d364c0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55932f041b10 con 0x55932f135480 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d364c0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55932f096240 con 0x55932f134b60 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d31682640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d31682640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f142130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39348/0 (socket says 172.21.15.98:39348) 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d31682640 1 -- 172.21.15.98:0/3517493749 learned_addr learned my addr 172.21.15.98:0/3517493749 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.197+0000 7f9d32684640 1 --2- 172.21.15.98:0/3517493749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f134b60 0x55932f134f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d31e83640 1 --2- 172.21.15.98:0/3517493749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f135480 0x55932f13f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d31682640 1 -- 172.21.15.98:0/3517493749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f134b60 msgr2=0x55932f134f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d31682640 1 --2- 172.21.15.98:0/3517493749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f134b60 0x55932f134f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d31682640 1 -- 172.21.15.98:0/3517493749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f135480 msgr2=0x55932f13f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d31682640 1 --2- 172.21.15.98:0/3517493749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f135480 0x55932f13f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d31682640 1 -- 172.21.15.98:0/3517493749 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55932f04e1f0 con 0x55932f13fd40 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d1effd640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9d180a3430 0x7f9d180a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d31682640 1 --2- 172.21.15.98:0/3517493749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f142130 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009ca0 tx=0x7f9d2000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0048c11d511f58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d32684640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9d180a3430 0x7f9d180a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d1effd640 1 -- 172.21.15.98:0/1542638347 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f9d280cf920 con 0x7f9d2c101200 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d17fff640 1 -- 172.21.15.98:0/3517493749 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20016070 con 0x55932f13fd40 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d17fff640 1 -- 172.21.15.98:0/3517493749 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d20005500 con 0x55932f13fd40 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.198+0000 7f9d17fff640 1 -- 172.21.15.98:0/3517493749 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d200116d0 con 0x55932f13fd40 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.199+0000 7f9d364c0740 1 -- 172.21.15.98:0/3517493749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 msgr2=0x55932f142130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.199+0000 7f9d32684640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9d180a3430 0x7f9d180a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9d24006010 tx=0x7f9d24005c50 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.199+0000 7f9d364c0740 1 --2- 172.21.15.98:0/3517493749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f142130 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009ca0 tx=0x7f9d2000e6c0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.199+0000 7f9d364c0740 1 -- 172.21.15.98:0/3517493749 shutdown_connections 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.199+0000 7f9d364c0740 1 --2- 172.21.15.98:0/3517493749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f142130 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.199+0000 7f9d364c0740 1 --2- 172.21.15.98:0/3517493749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f135480 0x55932f13f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.199+0000 7f9d364c0740 1 --2- 172.21.15.98:0/3517493749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f134b60 0x55932f134f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.199+0000 7f9d364c0740 1 -- 172.21.15.98:0/3517493749 >> 172.21.15.98:0/3517493749 conn(0x55932f1310f0 msgr2=0x55932f1314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.199+0000 7f9d364c0740 1 -- 172.21.15.98:0/3517493749 shutdown_connections 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.199+0000 7f9d364c0740 1 -- 172.21.15.98:0/3517493749 wait complete. 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.199+0000 7f9d364c0740 1 -- start start 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.199+0000 7f9d364c0740 1 Processor -- start 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d364c0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f134b60 0x55932f13cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d364c0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f135480 0x55932f13d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d364c0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f13d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d364c0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55932f142910 con 0x55932f13fd40 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d364c0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55932f054f10 con 0x55932f134b60 2024-09-19T07:24:01.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d364c0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55932f142a90 con 0x55932f135480 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d364c0740 10 client.0 _ll_register_callbacks cb 0x55932f01da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d32684640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f13d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d32684640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f13d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39362/0 (socket says 172.21.15.98:39362) 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d32684640 1 -- 172.21.15.98:0/2585075742 learned_addr learned my addr 172.21.15.98:0/2585075742 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d31e83640 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f134b60 0x55932f13cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d31682640 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f135480 0x55932f13d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d32684640 1 -- 172.21.15.98:0/2585075742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f135480 msgr2=0x55932f13d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d32684640 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f135480 0x55932f13d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d32684640 1 -- 172.21.15.98:0/2585075742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f134b60 msgr2=0x55932f13cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d32684640 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f134b60 0x55932f13cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d32684640 1 -- 172.21.15.98:0/2585075742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55932ee0b6a0 con 0x55932f13fd40 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.200+0000 7f9d31682640 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f135480 0x55932f13d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d32684640 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f13d5f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c106710 tx=0x7f9d240095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91810b8e183961d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:01.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d157fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d157fa640 1 -- 172.21.15.98:0/2585075742 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2404e070 con 0x55932f13fd40 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d157fa640 1 -- 172.21.15.98:0/2585075742 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f9d24004450 con 0x55932f13fd40 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d364c0740 1 -- 172.21.15.98:0/2585075742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d20005500 con 0x55932f13fd40 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d157fa640 1 -- 172.21.15.98:0/2585075742 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9d2405a050 con 0x55932f13fd40 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d364c0740 10 client.15990 fetch_fsmap learned FSMap version 24 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d364c0740 1 -- 172.21.15.98:0/2585075742 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55932f14e460 con 0x55932f13fd40 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d157fa640 1 -- 172.21.15.98:0/2585075742 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d20005500 con 0x55932f13fd40 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d157fa640 1 -- 172.21.15.98:0/2585075742 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9d24043040 con 0x55932f13fd40 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d364c0740 10 client.15990 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d364c0740 10 client.15990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d364c0740 20 client.15990 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d364c0740 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55932f14f8c0 0x55932f151d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d364c0740 4 client.15990 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:01.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.201+0000 7f9d364c0740 1 -- 172.21.15.98:0/2585075742 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55932f0a77f0 con 0x55932f14f8c0 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.202+0000 7f9d31e83640 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55932f14f8c0 0x55932f151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.202+0000 7f9d157fa640 10 client.15990 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.202+0000 7f9d31e83640 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55932f14f8c0 0x55932f151d30 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b9510d0e0b27f6b server_cookie=bbc0b55ee286d83d in_seq=0 out_seq=0 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d157fa640 1 -- 172.21.15.98:0/2585075742 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55932f0a77f0 con 0x55932f14f8c0 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d157fa640 10 client.15990 handle_command_reply: tid=0 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d364c0740 1 client.15990 shutdown 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d364c0740 1 -- 172.21.15.98:0/2585075742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 msgr2=0x55932f13d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d364c0740 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f13d5f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c106710 tx=0x7f9d240095c0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d364c0740 1 -- 172.21.15.98:0/2585075742 shutdown_connections 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d364c0740 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55932f14f8c0 0x55932f151d30 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d364c0740 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f13d5f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d157fa640 0 client.15990 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d364c0740 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f135480 0x55932f13d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d364c0740 1 --2- 172.21.15.98:0/2585075742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f134b60 0x55932f13cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d364c0740 1 -- 172.21.15.98:0/2585075742 >> 172.21.15.98:0/2585075742 conn(0x55932f1310f0 msgr2=0x55932f136dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:01.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d364c0740 1 -- 172.21.15.98:0/2585075742 shutdown_connections 2024-09-19T07:24:01.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d364c0740 1 -- 172.21.15.98:0/2585075742 wait complete. 2024-09-19T07:24:01.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.203+0000 7f9d364c0740 20 client.15990 trim_cache size 0 max 16384 2024-09-19T07:24:01.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d364c0740 1 Processor -- start 2024-09-19T07:24:01.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d364c0740 1 -- start start 2024-09-19T07:24:01.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d364c0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f134b60 0x55932f157600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d364c0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f135480 0x55932f157b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d364c0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f13fd40 0x55932f139e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d364c0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1b2430 con 0x55932f134b60 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d364c0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1afd00 con 0x55932f13fd40 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d364c0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1adb50 con 0x55932f135480 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d31e83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f134b60 0x55932f157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d31e83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f134b60 0x55932f157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39376/0 (socket says 172.21.15.98:39376) 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d31e83640 1 -- 172.21.15.98:0/1381341661 learned_addr learned my addr 172.21.15.98:0/1381341661 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d31682640 1 --2- 172.21.15.98:0/1381341661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f135480 0x55932f157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d32684640 1 --2- 172.21.15.98:0/1381341661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f13fd40 0x55932f139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d31e83640 1 -- 172.21.15.98:0/1381341661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f135480 msgr2=0x55932f157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d31e83640 1 --2- 172.21.15.98:0/1381341661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f135480 0x55932f157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d31e83640 1 -- 172.21.15.98:0/1381341661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f13fd40 msgr2=0x55932f139e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d31e83640 1 --2- 172.21.15.98:0/1381341661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f13fd40 0x55932f139e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.220+0000 7f9d31e83640 1 -- 172.21.15.98:0/1381341661 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55932f1352b0 con 0x55932f134b60 2024-09-19T07:24:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.221+0000 7f9d31682640 1 --2- 172.21.15.98:0/1381341661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f135480 0x55932f157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.221+0000 7f9d32684640 1 --2- 172.21.15.98:0/1381341661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f13fd40 0x55932f139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.221+0000 7f9d31e83640 1 --2- 172.21.15.98:0/1381341661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f134b60 0x55932f157600 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9d280985a0 tx=0x7f9d28086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233ee937e18777fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.221+0000 7f9d177fe640 1 -- 172.21.15.98:0/1381341661 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28020040 con 0x55932f134b60 2024-09-19T07:24:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.221+0000 7f9d177fe640 1 -- 172.21.15.98:0/1381341661 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d28009de0 con 0x55932f134b60 2024-09-19T07:24:01.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.221+0000 7f9d177fe640 1 -- 172.21.15.98:0/1381341661 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d280cd2c0 con 0x55932f134b60 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.221+0000 7f9d364c0740 1 -- 172.21.15.98:0/1381341661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f134b60 msgr2=0x55932f157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.221+0000 7f9d364c0740 1 --2- 172.21.15.98:0/1381341661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f134b60 0x55932f157600 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9d280985a0 tx=0x7f9d28086040 comp rx=0 tx=0).stop 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.222+0000 7f9d364c0740 1 -- 172.21.15.98:0/1381341661 shutdown_connections 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.222+0000 7f9d364c0740 1 --2- 172.21.15.98:0/1381341661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f13fd40 0x55932f139e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.222+0000 7f9d364c0740 1 --2- 172.21.15.98:0/1381341661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f135480 0x55932f157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.222+0000 7f9d364c0740 1 --2- 172.21.15.98:0/1381341661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f134b60 0x55932f157600 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.222+0000 7f9d364c0740 1 -- 172.21.15.98:0/1381341661 >> 172.21.15.98:0/1381341661 conn(0x55932f1310f0 msgr2=0x55932f130270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.222+0000 7f9d364c0740 1 -- 172.21.15.98:0/1381341661 shutdown_connections 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.222+0000 7f9d364c0740 1 -- 172.21.15.98:0/1381341661 wait complete. 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.222+0000 7f9d364c0740 1 -- start start 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.222+0000 7f9d364c0740 1 Processor -- start 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.222+0000 7f9d364c0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f134b60 0x55932f147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d364c0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f135480 0x55932f148220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d364c0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d364c0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1ae1c0 con 0x55932f13fd40 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d364c0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1af630 con 0x55932f135480 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d364c0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1ae890 con 0x55932f134b60 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d364c0740 10 client.0 _ll_register_callbacks cb 0x7f9d24009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d32684640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d32684640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39382/0 (socket says 172.21.15.98:39382) 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d32684640 1 -- 172.21.15.98:0/1984138550 learned_addr learned my addr 172.21.15.98:0/1984138550 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d31e83640 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f134b60 0x55932f147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d31682640 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f135480 0x55932f148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d32684640 1 -- 172.21.15.98:0/1984138550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f134b60 msgr2=0x55932f147ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d32684640 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f134b60 0x55932f147ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d32684640 1 -- 172.21.15.98:0/1984138550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f135480 msgr2=0x55932f148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d32684640 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f135480 0x55932f148220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d32684640 1 -- 172.21.15.98:0/1984138550 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55932f145220 con 0x55932f13fd40 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d31682640 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f135480 0x55932f148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d32684640 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f144cb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9d24005cc0 tx=0x7f9d2402fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5feff5f08638d3ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d157fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d157fa640 1 -- 172.21.15.98:0/1984138550 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2404e040 con 0x55932f13fd40 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d157fa640 1 -- 172.21.15.98:0/1984138550 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f9d24004b40 con 0x55932f13fd40 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.223+0000 7f9d364c0740 1 -- 172.21.15.98:0/1984138550 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d28009de0 con 0x55932f13fd40 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.224+0000 7f9d157fa640 1 -- 172.21.15.98:0/1984138550 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9d2402af40 con 0x55932f13fd40 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.224+0000 7f9d364c0740 10 client.15996 fetch_fsmap learned FSMap version 24 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.224+0000 7f9d364c0740 1 -- 172.21.15.98:0/1984138550 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55932f1bae80 con 0x55932f13fd40 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.224+0000 7f9d157fa640 1 -- 172.21.15.98:0/1984138550 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d28009de0 con 0x55932f13fd40 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.224+0000 7f9d157fa640 1 -- 172.21.15.98:0/1984138550 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9d24043070 con 0x55932f13fd40 2024-09-19T07:24:01.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.224+0000 7f9d364c0740 10 client.15996 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.224+0000 7f9d364c0740 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.224+0000 7f9d364c0740 20 client.15996 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.224+0000 7f9d364c0740 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55932f1bb570 0x55932f1bd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.224+0000 7f9d364c0740 4 client.15996 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.224+0000 7f9d364c0740 1 -- 172.21.15.98:0/1984138550 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55932f0a1d00 con 0x55932f1bb570 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.224+0000 7f9d31e83640 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55932f1bb570 0x55932f1bd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.225+0000 7f9d31e83640 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55932f1bb570 0x55932f1bd990 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48caf756e73e556a server_cookie=77db37ff5307b18b in_seq=0 out_seq=0 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.225+0000 7f9d157fa640 10 client.15996 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d157fa640 1 -- 172.21.15.98:0/1984138550 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55932f0a1d00 con 0x55932f1bb570 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d157fa640 10 client.15996 handle_command_reply: tid=0 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d364c0740 1 client.15996 shutdown 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d364c0740 1 -- 172.21.15.98:0/1984138550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 msgr2=0x55932f144cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d364c0740 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f144cb0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9d24005cc0 tx=0x7f9d2402fb00 comp rx=0 tx=0).stop 2024-09-19T07:24:01.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d364c0740 1 -- 172.21.15.98:0/1984138550 shutdown_connections 2024-09-19T07:24:01.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d364c0740 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55932f1bb570 0x55932f1bd990 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d364c0740 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55932f13fd40 0x55932f144cb0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d364c0740 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55932f135480 0x55932f148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d364c0740 1 --2- 172.21.15.98:0/1984138550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55932f134b60 0x55932f147ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d157fa640 0 client.15996 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:01.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d364c0740 1 -- 172.21.15.98:0/1984138550 >> 172.21.15.98:0/1984138550 conn(0x55932f1310f0 msgr2=0x55932f13cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:01.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d364c0740 1 -- 172.21.15.98:0/1984138550 shutdown_connections 2024-09-19T07:24:01.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d364c0740 1 -- 172.21.15.98:0/1984138550 wait complete. 2024-09-19T07:24:01.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.226+0000 7f9d364c0740 20 client.15996 trim_cache size 0 max 16384 2024-09-19T07:24:01.231 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:24:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "return_code": 0, 2024-09-19T07:24:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_tag": "0509d12c-3d4f-418c-be83-b23d1717fce9", 2024-09-19T07:24:01.232 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": "asynchronous" 2024-09-19T07:24:01.232 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:24:01.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.227+0000 7f9d340e7640 1 -- 172.21.15.98:0/1542638347 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9d180a3430 msgr2=0x7f9d180a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.227+0000 7f9d340e7640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9d180a3430 0x7f9d180a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9d24006010 tx=0x7f9d24005c50 comp rx=0 tx=0).stop 2024-09-19T07:24:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.227+0000 7f9d340e7640 1 -- 172.21.15.98:0/1542638347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d2c101200 msgr2=0x7f9d2c196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.227+0000 7f9d340e7640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d2c101200 0x7f9d2c196ff0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800d950 tx=0x7f9d2800de10 comp rx=0 tx=0).stop 2024-09-19T07:24:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.227+0000 7f9d340e7640 1 -- 172.21.15.98:0/1542638347 shutdown_connections 2024-09-19T07:24:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.227+0000 7f9d340e7640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9d180a3430 0x7f9d180a58f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.227+0000 7f9d340e7640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d2c105ad0 0x7f9d2c197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.227+0000 7f9d340e7640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c101ba0 0x7f9d2c197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.227+0000 7f9d340e7640 1 --2- 172.21.15.98:0/1542638347 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d2c101200 0x7f9d2c196ff0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.227+0000 7f9d340e7640 1 -- 172.21.15.98:0/1542638347 >> 172.21.15.98:0/1542638347 conn(0x7f9d2c077210 msgr2=0x7f9d2c103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:01.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.227+0000 7f9d340e7640 1 -- 172.21.15.98:0/1542638347 shutdown_connections 2024-09-19T07:24:01.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:01.227+0000 7f9d340e7640 1 -- 172.21.15.98:0/1542638347 wait complete. 2024-09-19T07:24:01.962 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:24:02.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:01 smithi162 ceph-mon[35726]: pgmap v62: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 465 KiB/s wr, 6 op/s 2024-09-19T07:24:02.248 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:02.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:01 smithi098 ceph-mon[30950]: pgmap v62: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 465 KiB/s wr, 6 op/s 2024-09-19T07:24:02.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:01 smithi139 ceph-mon[35039]: pgmap v62: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 465 KiB/s wr, 6 op/s 2024-09-19T07:24:02.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.683+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1595825867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b44101bc0 msgr2=0x7f0b4410d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.683+0000 7f0b48a6e640 1 --2- 172.21.15.98:0/1595825867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b44101bc0 0x7f0b4410d910 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009ca0 tx=0x7f0b3c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.683+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1595825867 shutdown_connections 2024-09-19T07:24:02.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.683+0000 7f0b48a6e640 1 --2- 172.21.15.98:0/1595825867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b44101bc0 0x7f0b4410d910 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.683+0000 7f0b48a6e640 1 --2- 172.21.15.98:0/1595825867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b44101240 0x7f0b44101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.683+0000 7f0b48a6e640 1 --2- 172.21.15.98:0/1595825867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b44105a90 0x7f0b44105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.683+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1595825867 >> 172.21.15.98:0/1595825867 conn(0x7f0b44077210 msgr2=0x7f0b440fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:02.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.683+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1595825867 shutdown_connections 2024-09-19T07:24:02.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.683+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1595825867 wait complete. 2024-09-19T07:24:02.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.684+0000 7f0b48a6e640 1 Processor -- start 2024-09-19T07:24:02.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.684+0000 7f0b48a6e640 1 -- start start 2024-09-19T07:24:02.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.684+0000 7f0b48a6e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b44101240 0x7f0b44198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.684+0000 7f0b48a6e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b44101bc0 0x7f0b44198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.684+0000 7f0b48a6e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b44105a90 0x7f0b4419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.684+0000 7f0b48a6e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441120d0 con 0x7f0b44101240 2024-09-19T07:24:02.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.684+0000 7f0b48a6e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0b44111f50 con 0x7f0b44101bc0 2024-09-19T07:24:02.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.684+0000 7f0b48a6e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0b44112250 con 0x7f0b44105a90 2024-09-19T07:24:02.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.684+0000 7f0b4259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b44101240 0x7f0b44198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.684+0000 7f0b4259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b44101240 0x7f0b44198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59408/0 (socket says 172.21.15.98:59408) 2024-09-19T07:24:02.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.684+0000 7f0b4259c640 1 -- 172.21.15.98:0/1864168952 learned_addr learned my addr 172.21.15.98:0/1864168952 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:02.747 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b44101bc0 0x7f0b44198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b42d9d640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b44105a90 0x7f0b4419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b4259c640 1 -- 172.21.15.98:0/1864168952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b44105a90 msgr2=0x7f0b4419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b4259c640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b44105a90 0x7f0b4419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b4259c640 1 -- 172.21.15.98:0/1864168952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b44101bc0 msgr2=0x7f0b44198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b4259c640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b44101bc0 0x7f0b44198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b4259c640 1 -- 172.21.15.98:0/1864168952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4419d5c0 con 0x7f0b44101240 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b44101bc0 0x7f0b44198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b4259c640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b44101240 0x7f0b44198610 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400d770 tx=0x7f0b3400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b3b7fe640 1 -- 172.21.15.98:0/1864168952 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34017070 con 0x7f0b44101240 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b3b7fe640 1 -- 172.21.15.98:0/1864168952 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b34005500 con 0x7f0b44101240 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1864168952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4419d8b0 con 0x7f0b44101240 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b3b7fe640 1 -- 172.21.15.98:0/1864168952 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34004e00 con 0x7f0b44101240 2024-09-19T07:24:02.748 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.685+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1864168952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b441a5190 con 0x7f0b44101240 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.687+0000 7f0b3b7fe640 1 -- 172.21.15.98:0/1864168952 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0b34004fa0 con 0x7f0b44101240 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.688+0000 7f0b3b7fe640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0b300a3430 0x7f0b300a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.688+0000 7f0b4ae47740 1 Processor -- start 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.688+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0b300a3430 0x7f0b300a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.688+0000 7f0b3b7fe640 1 -- 172.21.15.98:0/1864168952 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0b340cf7d0 con 0x7f0b44101240 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.688+0000 7f0b4ae47740 1 -- start start 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4ae47740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd414880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4ae47740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 0x563acd41f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4ae47740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd41f680 0x563acd421a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4ae47740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563acd37a2e0 con 0x563acd4144a0 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4ae47740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563acd321ce0 con 0x563acd41f680 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4ae47740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563acd3762a0 con 0x563acd414dc0 2024-09-19T07:24:02.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0b300a3430 0x7f0b300a58f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b440ff770 tx=0x7f0b2c008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd414880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd414880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59416/0 (socket says 172.21.15.98:59416) 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4259c640 1 -- 172.21.15.98:0/3429802036 learned_addr learned my addr 172.21.15.98:0/3429802036 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b42d9d640 1 --2- 172.21.15.98:0/3429802036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd41f680 0x563acd421a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4259c640 1 -- 172.21.15.98:0/3429802036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 msgr2=0x563acd41f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4259c640 1 --2- 172.21.15.98:0/3429802036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 0x563acd41f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4259c640 1 -- 172.21.15.98:0/3429802036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd41f680 msgr2=0x563acd421a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4259c640 1 --2- 172.21.15.98:0/3429802036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd41f680 0x563acd421a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4259c640 1 -- 172.21.15.98:0/3429802036 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563acd306440 con 0x563acd4144a0 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b4259c640 1 --2- 172.21.15.98:0/3429802036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd414880 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0b34098450 tx=0x7f0b3409b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83dbcdde97e4b09d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.689+0000 7f0b38ff9640 1 -- 172.21.15.98:0/3429802036 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34020070 con 0x563acd4144a0 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.690+0000 7f0b38ff9640 1 -- 172.21.15.98:0/3429802036 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b3409fe30 con 0x563acd4144a0 2024-09-19T07:24:02.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.690+0000 7f0b38ff9640 1 -- 172.21.15.98:0/3429802036 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b340860b0 con 0x563acd4144a0 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.690+0000 7f0b4ae47740 1 -- 172.21.15.98:0/3429802036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 msgr2=0x563acd414880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.690+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/3429802036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd414880 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0b34098450 tx=0x7f0b3409b980 comp rx=0 tx=0).stop 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.690+0000 7f0b4ae47740 1 -- 172.21.15.98:0/3429802036 shutdown_connections 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.690+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/3429802036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd41f680 0x563acd421a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.690+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/3429802036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 0x563acd41f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.690+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/3429802036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd414880 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.690+0000 7f0b4ae47740 1 -- 172.21.15.98:0/3429802036 >> 172.21.15.98:0/3429802036 conn(0x563acd410a30 msgr2=0x563acd410e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.690+0000 7f0b4ae47740 1 -- 172.21.15.98:0/3429802036 shutdown_connections 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.690+0000 7f0b4ae47740 1 -- 172.21.15.98:0/3429802036 wait complete. 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4ae47740 1 -- start start 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4ae47740 1 Processor -- start 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4ae47740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd41f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4ae47740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 0x563acd41c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4ae47740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd41f680 0x563acd41c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4ae47740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563acd422250 con 0x563acd4144a0 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4ae47740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563acd335050 con 0x563acd41f680 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4ae47740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563acd4223d0 con 0x563acd414dc0 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4ae47740 10 client.0 _ll_register_callbacks cb 0x563acd375160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd41f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd41f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59424/0 (socket says 172.21.15.98:59424) 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4259c640 1 -- 172.21.15.98:0/451282925 learned_addr learned my addr 172.21.15.98:0/451282925 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 0x563acd41c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b42d9d640 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd41f680 0x563acd41c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4259c640 1 -- 172.21.15.98:0/451282925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 msgr2=0x563acd41c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4259c640 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 0x563acd41c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4259c640 1 -- 172.21.15.98:0/451282925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd41f680 msgr2=0x563acd41c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4259c640 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd41f680 0x563acd41c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b4259c640 1 -- 172.21.15.98:0/451282925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563acd0eb3c0 con 0x563acd4144a0 2024-09-19T07:24:02.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.691+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 0x563acd41c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:02.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b4259c640 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd41f020 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0b340a41c0 tx=0x7f0b3409bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f00d81824d3c482 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:02.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:02.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b29ffb640 1 -- 172.21.15.98:0/451282925 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34020030 con 0x563acd4144a0 2024-09-19T07:24:02.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b29ffb640 1 -- 172.21.15.98:0/451282925 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0b34009cc0 con 0x563acd4144a0 2024-09-19T07:24:02.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b4ae47740 1 -- 172.21.15.98:0/451282925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b3409fe30 con 0x563acd4144a0 2024-09-19T07:24:02.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b29ffb640 1 -- 172.21.15.98:0/451282925 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0b340860b0 con 0x563acd4144a0 2024-09-19T07:24:02.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b4ae47740 10 client.16008 fetch_fsmap learned FSMap version 24 2024-09-19T07:24:02.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b4ae47740 1 -- 172.21.15.98:0/451282925 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563acd42dc60 con 0x563acd4144a0 2024-09-19T07:24:02.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b29ffb640 1 -- 172.21.15.98:0/451282925 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b3409fe30 con 0x563acd4144a0 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b29ffb640 1 -- 172.21.15.98:0/451282925 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0b3409aed0 con 0x563acd4144a0 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b4ae47740 10 client.16008 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b4ae47740 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b4ae47740 20 client.16008 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563acd42efb0 0x563acd4313a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b4ae47740 4 client.16008 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.692+0000 7f0b4ae47740 1 -- 172.21.15.98:0/451282925 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563acd387850 con 0x563acd42efb0 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.693+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563acd42efb0 0x563acd4313a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.693+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563acd42efb0 0x563acd4313a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26dfbea6bb3cfacd server_cookie=67238f7d02b664e in_seq=0 out_seq=0 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.693+0000 7f0b29ffb640 10 client.16008 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b29ffb640 1 -- 172.21.15.98:0/451282925 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563acd387850 con 0x563acd42efb0 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b29ffb640 10 client.16008 handle_command_reply: tid=0 2024-09-19T07:24:02.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b4ae47740 1 client.16008 shutdown 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b4ae47740 1 -- 172.21.15.98:0/451282925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 msgr2=0x563acd41f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd41f020 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0b340a41c0 tx=0x7f0b3409bc00 comp rx=0 tx=0).stop 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b4ae47740 1 -- 172.21.15.98:0/451282925 shutdown_connections 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd41f680 0x563acd41c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 0x563acd41c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563acd42efb0 0x563acd4313a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/451282925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd41f020 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b29ffb640 0 client.16008 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b4ae47740 1 -- 172.21.15.98:0/451282925 >> 172.21.15.98:0/451282925 conn(0x563acd410a30 msgr2=0x563acd40fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b4ae47740 1 -- 172.21.15.98:0/451282925 shutdown_connections 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b4ae47740 1 -- 172.21.15.98:0/451282925 wait complete. 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.694+0000 7f0b4ae47740 20 client.16008 trim_cache size 0 max 16384 2024-09-19T07:24:02.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b4ae47740 1 Processor -- start 2024-09-19T07:24:02.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b4ae47740 1 -- start start 2024-09-19T07:24:02.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b4ae47740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd4144a0 0x563acd4343c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b4ae47740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 0x563acd434900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b4ae47740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd41f680 0x563acd419550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b4ae47740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441b0230 con 0x563acd41f680 2024-09-19T07:24:02.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b4ae47740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441adb00 con 0x563acd4144a0 2024-09-19T07:24:02.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b4ae47740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441ab950 con 0x563acd414dc0 2024-09-19T07:24:02.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b42d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd41f680 0x563acd419550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b42d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd41f680 0x563acd419550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59440/0 (socket says 172.21.15.98:59440) 2024-09-19T07:24:02.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b42d9d640 1 -- 172.21.15.98:0/3032483324 learned_addr learned my addr 172.21.15.98:0/3032483324 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:02.757 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:24:02.757 INFO:teuthology.orchestra.run.smithi098.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T07:24:02.757 INFO:teuthology.orchestra.run.smithi098.stdout: "scrubs": { 2024-09-19T07:24:02.757 INFO:teuthology.orchestra.run.smithi098.stdout: "0509d12c-3d4f-418c-be83-b23d1717fce9": { 2024-09-19T07:24:02.757 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-19T07:24:02.757 INFO:teuthology.orchestra.run.smithi098.stdout: "tag": "0509d12c-3d4f-418c-be83-b23d1717fce9", 2024-09-19T07:24:02.757 INFO:teuthology.orchestra.run.smithi098.stdout: "options": "recursive,force" 2024-09-19T07:24:02.757 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:24:02.757 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:24:02.757 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:24:02.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b4259c640 1 --2- 172.21.15.98:0/3032483324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd4144a0 0x563acd4343c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.711+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/3032483324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 0x563acd434900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.712+0000 7f0b42d9d640 1 -- 172.21.15.98:0/3032483324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 msgr2=0x563acd434900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.712+0000 7f0b42d9d640 1 --2- 172.21.15.98:0/3032483324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 0x563acd434900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.712+0000 7f0b42d9d640 1 -- 172.21.15.98:0/3032483324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd4144a0 msgr2=0x563acd4343c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.712+0000 7f0b42d9d640 1 --2- 172.21.15.98:0/3032483324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd4144a0 0x563acd4343c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.712+0000 7f0b42d9d640 1 -- 172.21.15.98:0/3032483324 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563acd414290 con 0x563acd41f680 2024-09-19T07:24:02.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.712+0000 7f0b42d9d640 1 --2- 172.21.15.98:0/3032483324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd41f680 0x563acd419550 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009ca0 tx=0x7f0b3c0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455a5cc5c9992f53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:02.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.712+0000 7f0b2bfff640 1 -- 172.21.15.98:0/3032483324 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c04a070 con 0x563acd41f680 2024-09-19T07:24:02.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.712+0000 7f0b2bfff640 1 -- 172.21.15.98:0/3032483324 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b3c036040 con 0x563acd41f680 2024-09-19T07:24:02.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.712+0000 7f0b2bfff640 1 -- 172.21.15.98:0/3032483324 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c031910 con 0x563acd41f680 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 -- 172.21.15.98:0/3032483324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd41f680 msgr2=0x563acd419550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/3032483324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd41f680 0x563acd419550 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c009ca0 tx=0x7f0b3c0098b0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 -- 172.21.15.98:0/3032483324 shutdown_connections 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/3032483324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd41f680 0x563acd419550 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/3032483324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd414dc0 0x563acd434900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/3032483324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd4144a0 0x563acd4343c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 -- 172.21.15.98:0/3032483324 >> 172.21.15.98:0/3032483324 conn(0x563acd410a30 msgr2=0x563acd417870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 -- 172.21.15.98:0/3032483324 shutdown_connections 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 -- 172.21.15.98:0/3032483324 wait complete. 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 -- start start 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 Processor -- start 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd4328c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd414dc0 0x563acd432e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd41f680 0x563acd4988f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441abfc0 con 0x563acd4144a0 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441ad430 con 0x563acd414dc0 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0b441ac690 con 0x563acd41f680 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4ae47740 10 client.0 _ll_register_callbacks cb 0x7f0b3409f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd4328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd4328c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59452/0 (socket says 172.21.15.98:59452) 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b4259c640 1 -- 172.21.15.98:0/1606329597 learned_addr learned my addr 172.21.15.98:0/1606329597 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.713+0000 7f0b42d9d640 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd41f680 0x563acd4988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd414dc0 0x563acd432e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b4259c640 1 -- 172.21.15.98:0/1606329597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd41f680 msgr2=0x563acd4988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b4259c640 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd41f680 0x563acd4988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b4259c640 1 -- 172.21.15.98:0/1606329597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd414dc0 msgr2=0x563acd432e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:02.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b4259c640 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd414dc0 0x563acd432e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b4259c640 1 -- 172.21.15.98:0/1606329597 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563acd498eb0 con 0x563acd4144a0 2024-09-19T07:24:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd414dc0 0x563acd432e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b4259c640 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd4328c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0b340ba590 tx=0x7f0b3400df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991319e705c91a55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b29ffb640 1 -- 172.21.15.98:0/1606329597 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34020070 con 0x563acd4144a0 2024-09-19T07:24:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b29ffb640 1 -- 172.21.15.98:0/1606329597 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0b340ba170 con 0x563acd4144a0 2024-09-19T07:24:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b4ae47740 1 -- 172.21.15.98:0/1606329597 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b3c036040 con 0x563acd4144a0 2024-09-19T07:24:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b29ffb640 1 -- 172.21.15.98:0/1606329597 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0b34097d20 con 0x563acd4144a0 2024-09-19T07:24:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b4ae47740 10 client.16014 fetch_fsmap learned FSMap version 24 2024-09-19T07:24:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b4ae47740 1 -- 172.21.15.98:0/1606329597 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563acd49a180 con 0x563acd4144a0 2024-09-19T07:24:02.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b29ffb640 1 -- 172.21.15.98:0/1606329597 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b3c036040 con 0x563acd4144a0 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b29ffb640 1 -- 172.21.15.98:0/1606329597 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0b340a0fc0 con 0x563acd4144a0 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b4ae47740 10 client.16014 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b4ae47740 10 client.16014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.714+0000 7f0b4ae47740 20 client.16014 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563acd49a600 0x563acd49c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b4ae47740 4 client.16014 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b4ae47740 1 -- 172.21.15.98:0/1606329597 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563acd381d60 con 0x563acd49a600 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563acd49a600 0x563acd49c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b29ffb640 10 client.16014 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b41d9b640 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563acd49a600 0x563acd49c9f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fedd3d52e2590a8e server_cookie=733fd4f07a6c5d7b in_seq=0 out_seq=0 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b29ffb640 1 -- 172.21.15.98:0/1606329597 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563acd381d60 con 0x563acd49a600 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b29ffb640 10 client.16014 handle_command_reply: tid=0 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b4ae47740 1 client.16014 shutdown 2024-09-19T07:24:02.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b4ae47740 1 -- 172.21.15.98:0/1606329597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 msgr2=0x563acd4328c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd4328c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0b340ba590 tx=0x7f0b3400df60 comp rx=0 tx=0).stop 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b4ae47740 1 -- 172.21.15.98:0/1606329597 shutdown_connections 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563acd41f680 0x563acd4988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563acd414dc0 0x563acd432e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563acd49a600 0x563acd49c9f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b4ae47740 1 --2- 172.21.15.98:0/1606329597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563acd4144a0 0x563acd4328c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b4ae47740 1 -- 172.21.15.98:0/1606329597 >> 172.21.15.98:0/1606329597 conn(0x563acd410a30 msgr2=0x563acd417050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.715+0000 7f0b29ffb640 0 client.16014 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b4ae47740 1 -- 172.21.15.98:0/1606329597 shutdown_connections 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b4ae47740 1 -- 172.21.15.98:0/1606329597 wait complete. 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b4ae47740 20 client.16014 trim_cache size 0 max 16384 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1864168952 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0b300a3430 msgr2=0x7f0b300a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b48a6e640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0b300a3430 0x7f0b300a58f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b440ff770 tx=0x7f0b2c008040 comp rx=0 tx=0).stop 2024-09-19T07:24:02.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1864168952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b44101240 msgr2=0x7f0b44198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b48a6e640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b44101240 0x7f0b44198610 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400d770 tx=0x7f0b3400dc30 comp rx=0 tx=0).stop 2024-09-19T07:24:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1864168952 shutdown_connections 2024-09-19T07:24:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b48a6e640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0b300a3430 0x7f0b300a58f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b48a6e640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b44105a90 0x7f0b4419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b48a6e640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b44101bc0 0x7f0b44198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b48a6e640 1 --2- 172.21.15.98:0/1864168952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b44101240 0x7f0b44198610 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1864168952 >> 172.21.15.98:0/1864168952 conn(0x7f0b44077210 msgr2=0x7f0b44103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1864168952 shutdown_connections 2024-09-19T07:24:02.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:02.716+0000 7f0b48a6e640 1 -- 172.21.15.98:0/1864168952 wait complete. 2024-09-19T07:24:03.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:02 smithi098 ceph-mon[30950]: scrub queued for path: / 2024-09-19T07:24:03.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:02 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:03.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:02 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:03.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:02 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:03.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:02 smithi162 ceph-mon[35726]: scrub queued for path: / 2024-09-19T07:24:03.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:02 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:03.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:02 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:03.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:02 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:03.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:02 smithi139 ceph-mon[35039]: scrub queued for path: / 2024-09-19T07:24:03.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:02 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:03.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:02 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:03.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:02 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:03.479 INFO:tasks.cephfs.filesystem:scrub status for tag:0509d12c-3d4f-418c-be83-b23d1717fce9 - {'path': '/', 'tag': '0509d12c-3d4f-418c-be83-b23d1717fce9', 'options': 'recursive,force'} 2024-09-19T07:24:04.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:03 smithi162 ceph-mon[35726]: pgmap v63: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 465 KiB/s wr, 6 op/s 2024-09-19T07:24:04.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:03 smithi098 ceph-mon[30950]: pgmap v63: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 465 KiB/s wr, 6 op/s 2024-09-19T07:24:04.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:03 smithi139 ceph-mon[35039]: pgmap v63: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 465 KiB/s wr, 6 op/s 2024-09-19T07:24:06.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:05 smithi162 ceph-mon[35726]: pgmap v64: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 489 KiB/s wr, 28 op/s 2024-09-19T07:24:06.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:05 smithi098 ceph-mon[30950]: pgmap v64: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 489 KiB/s wr, 28 op/s 2024-09-19T07:24:06.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:05 smithi139 ceph-mon[35039]: pgmap v64: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 489 KiB/s wr, 28 op/s 2024-09-19T07:24:07.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:06 smithi162 ceph-mon[35726]: scrub summary: idle 2024-09-19T07:24:07.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:06 smithi098 ceph-mon[30950]: scrub summary: idle 2024-09-19T07:24:07.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:06 smithi139 ceph-mon[35039]: scrub summary: idle 2024-09-19T07:24:08.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:07 smithi162 ceph-mon[35726]: pgmap v65: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 486 KiB/s wr, 24 op/s 2024-09-19T07:24:08.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:07 smithi098 ceph-mon[30950]: pgmap v65: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 486 KiB/s wr, 24 op/s 2024-09-19T07:24:08.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:07 smithi139 ceph-mon[35039]: pgmap v65: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 486 KiB/s wr, 24 op/s 2024-09-19T07:24:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:09 smithi162 ceph-mon[35726]: pgmap v66: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 486 KiB/s wr, 27 op/s 2024-09-19T07:24:10.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:09 smithi098 ceph-mon[30950]: pgmap v66: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 486 KiB/s wr, 27 op/s 2024-09-19T07:24:10.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:09 smithi139 ceph-mon[35039]: pgmap v66: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 486 KiB/s wr, 27 op/s 2024-09-19T07:24:10.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:24:11.055 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:11.528 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.501+0000 7f25e518e640 1 -- 172.21.15.98:0/1195089919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e0100e20 msgr2=0x7f25e0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.501+0000 7f25e518e640 1 --2- 172.21.15.98:0/1195089919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e0100e20 0x7f25e0101200 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009900 tx=0x7f25d802a480 comp rx=0 tx=0).stop 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.501+0000 7f25e518e640 1 -- 172.21.15.98:0/1195089919 shutdown_connections 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.501+0000 7f25e518e640 1 --2- 172.21.15.98:0/1195089919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e0102ef0 0x7f25e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.501+0000 7f25e518e640 1 --2- 172.21.15.98:0/1195089919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25e0102570 0x7f25e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.501+0000 7f25e518e640 1 --2- 172.21.15.98:0/1195089919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e0100e20 0x7f25e0101200 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.501+0000 7f25e518e640 1 -- 172.21.15.98:0/1195089919 >> 172.21.15.98:0/1195089919 conn(0x7f25e00fc7d0 msgr2=0x7f25e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.501+0000 7f25e518e640 1 -- 172.21.15.98:0/1195089919 shutdown_connections 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.501+0000 7f25e518e640 1 -- 172.21.15.98:0/1195089919 wait complete. 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.501+0000 7f25e518e640 1 Processor -- start 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25e518e640 1 -- start start 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25e518e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25e0100e20 0x7f25e01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25e518e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e0102570 0x7f25e0198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:11.529 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25e518e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e0102ef0 0x7f25e019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25e518e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01120a0 con 0x7f25e0102ef0 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25e518e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0111f20 con 0x7f25e0100e20 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25e518e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0112220 con 0x7f25e0102570 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25df59e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e0102ef0 0x7f25e019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25df59e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e0102ef0 0x7f25e019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59478/0 (socket says 172.21.15.98:59478) 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25df59e640 1 -- 172.21.15.98:0/3264184931 learned_addr learned my addr 172.21.15.98:0/3264184931 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25ded9d640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25e0100e20 0x7f25e01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25de59c640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e0102570 0x7f25e0198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25df59e640 1 -- 172.21.15.98:0/3264184931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e0102570 msgr2=0x7f25e0198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25df59e640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e0102570 0x7f25e0198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25df59e640 1 -- 172.21.15.98:0/3264184931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25e0100e20 msgr2=0x7f25e01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25df59e640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25e0100e20 0x7f25e01984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25df59e640 1 -- 172.21.15.98:0/3264184931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e019d480 con 0x7f25e0102ef0 2024-09-19T07:24:11.530 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.502+0000 7f25de59c640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e0102570 0x7f25e0198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.503+0000 7f25df59e640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e0102ef0 0x7f25e019cda0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f25d000eaa0 tx=0x7f25d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.503+0000 7f25d7fff640 1 -- 172.21.15.98:0/3264184931 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d000cdb0 con 0x7f25e0102ef0 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.503+0000 7f25e518e640 1 -- 172.21.15.98:0/3264184931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e019d770 con 0x7f25e0102ef0 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.503+0000 7f25d7fff640 1 -- 172.21.15.98:0/3264184931 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25d0005020 con 0x7f25e0102ef0 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.503+0000 7f25d7fff640 1 -- 172.21.15.98:0/3264184931 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d00116b0 con 0x7f25e0102ef0 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.503+0000 7f25e518e640 1 -- 172.21.15.98:0/3264184931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e01a5050 con 0x7f25e0102ef0 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.504+0000 7f25e518e640 1 -- 172.21.15.98:0/3264184931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e0101200 con 0x7f25e0102ef0 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.505+0000 7f25d7fff640 1 -- 172.21.15.98:0/3264184931 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f25d0005560 con 0x7f25e0102ef0 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.506+0000 7f25d7fff640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f25cc0a33b0 0x7f25cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.506+0000 7f25ded9d640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f25cc0a33b0 0x7f25cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.506+0000 7f25d7fff640 1 -- 172.21.15.98:0/3264184931 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f25d00cffc0 con 0x7f25e0102ef0 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.506+0000 7f25ded9d640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f25cc0a33b0 0x7f25cc0a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009230 tx=0x7f25d80058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:11.531 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.510+0000 7f25d7fff640 1 -- 172.21.15.98:0/3264184931 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25d0016030 con 0x7f25e0102ef0 2024-09-19T07:24:11.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.713+0000 7f25e518e640 1 -- 172.21.15.98:0/3264184931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25e0109090 con 0x7f25e0102ef0 2024-09-19T07:24:11.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.714+0000 7f25d7fff640 1 -- 172.21.15.98:0/3264184931 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f25d009c970 con 0x7f25e0102ef0 2024-09-19T07:24:11.715 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:24:11.715 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":24,"btime":"2024-09-19T07:22:04:762071+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:22:04.561701+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:24:11.715 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 24 2024-09-19T07:24:11.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.716+0000 7f25e518e640 1 -- 172.21.15.98:0/3264184931 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f25cc0a33b0 msgr2=0x7f25cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:11.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.716+0000 7f25e518e640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f25cc0a33b0 0x7f25cc0a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009230 tx=0x7f25d80058d0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.716+0000 7f25e518e640 1 -- 172.21.15.98:0/3264184931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e0102ef0 msgr2=0x7f25e019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:11.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.716+0000 7f25e518e640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e0102ef0 0x7f25e019cda0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f25d000eaa0 tx=0x7f25d000ef60 comp rx=0 tx=0).stop 2024-09-19T07:24:11.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.716+0000 7f25e518e640 1 -- 172.21.15.98:0/3264184931 shutdown_connections 2024-09-19T07:24:11.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.716+0000 7f25e518e640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f25cc0a33b0 0x7f25cc0a5870 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.716+0000 7f25e518e640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e0102ef0 0x7f25e019cda0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.716+0000 7f25e518e640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e0102570 0x7f25e0198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.716+0000 7f25e518e640 1 --2- 172.21.15.98:0/3264184931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25e0100e20 0x7f25e01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:11.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.716+0000 7f25e518e640 1 -- 172.21.15.98:0/3264184931 >> 172.21.15.98:0/3264184931 conn(0x7f25e00fc7d0 msgr2=0x7f25e00fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:11.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.716+0000 7f25e518e640 1 -- 172.21.15.98:0/3264184931 shutdown_connections 2024-09-19T07:24:11.718 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:11.716+0000 7f25e518e640 1 -- 172.21.15.98:0/3264184931 wait complete. 2024-09-19T07:24:12.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:11 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3264184931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:12.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:11 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3264184931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:12.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:11 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3264184931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:12.361 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db --set-id 262599e --release --await' 2024-09-19T07:24:12.361 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db --set-id 262599e --release --await 2024-09-19T07:24:12.606 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:12.995 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:12 smithi098 ceph-mon[30950]: pgmap v67: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-09-19T07:24:13.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:12 smithi139 ceph-mon[35039]: pgmap v67: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-09-19T07:24:13.087 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.080+0000 7f45fb751640 1 -- 172.21.15.98:0/299559413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45f4100a80 msgr2=0x7f45f4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.080+0000 7f45fb751640 1 --2- 172.21.15.98:0/299559413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45f4100a80 0x7f45f4100ee0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009930 tx=0x7f45f002a420 comp rx=0 tx=0).stop 2024-09-19T07:24:13.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.080+0000 7f45fb751640 1 -- 172.21.15.98:0/299559413 shutdown_connections 2024-09-19T07:24:13.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.080+0000 7f45fb751640 1 --2- 172.21.15.98:0/299559413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f4101420 0x7f45f410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.080+0000 7f45fb751640 1 --2- 172.21.15.98:0/299559413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45f4100a80 0x7f45f4100ee0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.080+0000 7f45fb751640 1 --2- 172.21.15.98:0/299559413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f4106a80 0x7f45f4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.080+0000 7f45fb751640 1 -- 172.21.15.98:0/299559413 >> 172.21.15.98:0/299559413 conn(0x7f45f40fc7a0 msgr2=0x7f45f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.080+0000 7f45fb751640 1 -- 172.21.15.98:0/299559413 shutdown_connections 2024-09-19T07:24:13.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.080+0000 7f45fb751640 1 -- 172.21.15.98:0/299559413 wait complete. 2024-09-19T07:24:13.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.081+0000 7f45fb751640 1 Processor -- start 2024-09-19T07:24:13.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.081+0000 7f45fb751640 1 -- start start 2024-09-19T07:24:13.088 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.081+0000 7f45fb751640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f4100a80 0x7f45f41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.081+0000 7f45fb751640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45f4101420 0x7f45f41989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.081+0000 7f45fb751640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f4106a80 0x7f45f419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.081+0000 7f45fb751640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f45f4110e80 con 0x7f45f4101420 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.081+0000 7f45fb751640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f45f4110d00 con 0x7f45f4100a80 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.081+0000 7f45fb751640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45f4111000 con 0x7f45f4106a80 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.081+0000 7f45f8cec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45f4101420 0x7f45f41989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.081+0000 7f45f8cec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45f4101420 0x7f45f41989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44144/0 (socket says 172.21.15.98:44144) 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.081+0000 7f45f8cec640 1 -- 172.21.15.98:0/473234108 learned_addr learned my addr 172.21.15.98:0/473234108 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.081+0000 7f45f9cee640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f4106a80 0x7f45f419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45f94ed640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f4100a80 0x7f45f41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45f8cec640 1 -- 172.21.15.98:0/473234108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f4106a80 msgr2=0x7f45f419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45f8cec640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f4106a80 0x7f45f419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45f8cec640 1 -- 172.21.15.98:0/473234108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f4100a80 msgr2=0x7f45f41984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45f8cec640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f4100a80 0x7f45f41984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45f8cec640 1 -- 172.21.15.98:0/473234108 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f419d460 con 0x7f45f4101420 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45f94ed640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f4100a80 0x7f45f41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45f8cec640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45f4101420 0x7f45f41989f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009a50 tx=0x7f45f0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45ea7fc640 1 -- 172.21.15.98:0/473234108 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f003f030 con 0x7f45f4101420 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45ea7fc640 1 -- 172.21.15.98:0/473234108 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f0003ce0 con 0x7f45f4101420 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45fb751640 1 -- 172.21.15.98:0/473234108 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f419d6f0 con 0x7f45f4101420 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45ea7fc640 1 -- 172.21.15.98:0/473234108 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0035070 con 0x7f45f4101420 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.082+0000 7f45fb751640 1 -- 172.21.15.98:0/473234108 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f41a5030 con 0x7f45f4101420 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.084+0000 7f45ea7fc640 1 -- 172.21.15.98:0/473234108 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f45f0042030 con 0x7f45f4101420 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45fdb2a740 1 Processor -- start 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45fdb2a740 1 -- start start 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45fdb2a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f060 0x557b6157f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45fdb2a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6157f980 0x557b61589d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45fdb2a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 0x557b6158c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45fdb2a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557b614e4620 con 0x557b6158a240 2024-09-19T07:24:13.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45fdb2a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b6148be50 con 0x557b6157f060 2024-09-19T07:24:13.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45fdb2a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557b614e05e0 con 0x557b6157f980 2024-09-19T07:24:13.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45ea7fc640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f45e00a33b0 0x7f45e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45f8cec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 0x557b6158c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45f8cec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 0x557b6158c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44154/0 (socket says 172.21.15.98:44154) 2024-09-19T07:24:13.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45f8cec640 1 -- 172.21.15.98:0/708624294 learned_addr learned my addr 172.21.15.98:0/708624294 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:13.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45f9cee640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f45e00a33b0 0x7f45e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45f9cee640 1 --2- 172.21.15.98:0/708624294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f060 0x557b6157f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45f94ed640 1 --2- 172.21.15.98:0/708624294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6157f980 0x557b61589d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.085+0000 7f45ea7fc640 1 -- 172.21.15.98:0/473234108 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f45f00f03c0 con 0x7f45f4101420 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.086+0000 7f45f8cec640 1 -- 172.21.15.98:0/708624294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6157f980 msgr2=0x557b61589d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.086+0000 7f45f8cec640 1 --2- 172.21.15.98:0/708624294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6157f980 0x557b61589d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.086+0000 7f45f8cec640 1 -- 172.21.15.98:0/708624294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f060 msgr2=0x557b6157f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.086+0000 7f45f8cec640 1 --2- 172.21.15.98:0/708624294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f060 0x557b6157f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.086+0000 7f45f8cec640 1 -- 172.21.15.98:0/708624294 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b6147cd40 con 0x557b6158a240 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.086+0000 7f45f9cee640 1 --2- 172.21.15.98:0/708624294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f060 0x557b6157f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.086+0000 7f45f9cee640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f45e00a33b0 0x7f45e00a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f45ec005c40 tx=0x7f45ec012a10 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.086+0000 7f45f8cec640 1 --2- 172.21.15.98:0/708624294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 0x557b6158c630 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f45f00eda50 tx=0x7f45f00314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929775fbe12a70c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.086+0000 7f45df7fe640 1 -- 172.21.15.98:0/708624294 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0049030 con 0x557b6158a240 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.086+0000 7f45df7fe640 1 -- 172.21.15.98:0/708624294 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f00c52e0 con 0x557b6158a240 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.086+0000 7f45df7fe640 1 -- 172.21.15.98:0/708624294 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f00d3e60 con 0x557b6158a240 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.087+0000 7f45fdb2a740 1 -- 172.21.15.98:0/708624294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 msgr2=0x557b6158c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.087+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/708624294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 0x557b6158c630 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f45f00eda50 tx=0x7f45f00314b0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.087+0000 7f45fdb2a740 1 -- 172.21.15.98:0/708624294 shutdown_connections 2024-09-19T07:24:13.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.087+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/708624294 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 0x557b6158c630 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.087+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/708624294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6157f980 0x557b61589d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.087+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/708624294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f060 0x557b6157f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.087+0000 7f45fdb2a740 1 -- 172.21.15.98:0/708624294 >> 172.21.15.98:0/708624294 conn(0x557b6157b5f0 msgr2=0x557b6157b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.087+0000 7f45fdb2a740 1 -- 172.21.15.98:0/708624294 shutdown_connections 2024-09-19T07:24:13.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.087+0000 7f45fdb2a740 1 -- 172.21.15.98:0/708624294 wait complete. 2024-09-19T07:24:13.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.087+0000 7f45fdb2a740 1 -- start start 2024-09-19T07:24:13.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.087+0000 7f45fdb2a740 1 Processor -- start 2024-09-19T07:24:13.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45fdb2a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f060 0x557b615871a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45fdb2a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f980 0x557b615876e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45fdb2a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6158a240 0x557b61587c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45fdb2a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557b61590fe0 con 0x557b6157f060 2024-09-19T07:24:13.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45fdb2a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b6146cf10 con 0x557b6157f980 2024-09-19T07:24:13.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45fdb2a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557b61591160 con 0x557b6158a240 2024-09-19T07:24:13.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45f94ed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f060 0x557b615871a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45fdb2a740 10 client.0 _ll_register_callbacks cb 0x557b61490db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:13.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45f94ed640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f060 0x557b615871a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44164/0 (socket says 172.21.15.98:44164) 2024-09-19T07:24:13.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45f94ed640 1 -- 172.21.15.98:0/1013370283 learned_addr learned my addr 172.21.15.98:0/1013370283 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:13.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45f9cee640 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6158a240 0x557b61587c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45f8cec640 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f980 0x557b615876e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45f94ed640 1 -- 172.21.15.98:0/1013370283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6158a240 msgr2=0x557b61587c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45f94ed640 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6158a240 0x557b61587c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45f94ed640 1 -- 172.21.15.98:0/1013370283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f980 msgr2=0x557b615876e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45f94ed640 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f980 0x557b615876e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45f94ed640 1 -- 172.21.15.98:0/1013370283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b611f3580 con 0x557b6157f060 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45f9cee640 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6158a240 0x557b61587c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.088+0000 7f45f8cec640 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f980 0x557b615876e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45f94ed640 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f060 0x557b615871a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f45e4010780 tx=0x7f45e4010c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebb17109ee2bf17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45dcff9640 1 -- 172.21.15.98:0/1013370283 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e401d060 con 0x557b6157f060 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45dcff9640 1 -- 172.21.15.98:0/1013370283 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f45e400eda0 con 0x557b6157f060 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1013370283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45f00c52e0 con 0x557b6157f060 2024-09-19T07:24:13.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45dcff9640 1 -- 172.21.15.98:0/1013370283 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f45e4021440 con 0x557b6157f060 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45fdb2a740 10 client.16032 fetch_fsmap learned FSMap version 24 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1013370283 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557b612bd960 con 0x557b6157f060 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45dcff9640 1 -- 172.21.15.98:0/1013370283 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f00c52e0 con 0x557b6157f060 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45dcff9640 1 -- 172.21.15.98:0/1013370283 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f45e400d580 con 0x557b6157f060 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45fdb2a740 10 client.16032 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45fdb2a740 10 client.16032 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45fdb2a740 20 client.16032 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b6159e010 0x557b615a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45fdb2a740 4 client.16032 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.089+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1013370283 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b614f1b90 con 0x557b6159e010 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.090+0000 7f45f8cec640 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b6159e010 0x557b615a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.090+0000 7f45f8cec640 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b6159e010 0x557b615a04d0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e132291fc3914b4 server_cookie=4625761c7246084a in_seq=0 out_seq=0 2024-09-19T07:24:13.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.090+0000 7f45dcff9640 10 client.16032 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:13.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45dcff9640 1 -- 172.21.15.98:0/1013370283 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b614f1b90 con 0x557b6159e010 2024-09-19T07:24:13.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45dcff9640 10 client.16032 handle_command_reply: tid=0 2024-09-19T07:24:13.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45fdb2a740 1 client.16032 shutdown 2024-09-19T07:24:13.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1013370283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f060 msgr2=0x557b615871a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f060 0x557b615871a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f45e4010780 tx=0x7f45e4010c40 comp rx=0 tx=0).stop 2024-09-19T07:24:13.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1013370283 shutdown_connections 2024-09-19T07:24:13.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6158a240 0x557b61587c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f980 0x557b615876e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b6159e010 0x557b615a04d0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45dcff9640 0 client.16032 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:13.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/1013370283 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f060 0x557b615871a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1013370283 >> 172.21.15.98:0/1013370283 conn(0x557b6157b5f0 msgr2=0x557b615812d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1013370283 shutdown_connections 2024-09-19T07:24:13.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1013370283 wait complete. 2024-09-19T07:24:13.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.091+0000 7f45fdb2a740 20 client.16032 trim_cache size 0 max 16384 2024-09-19T07:24:13.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.108+0000 7f45fdb2a740 1 Processor -- start 2024-09-19T07:24:13.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.108+0000 7f45fdb2a740 1 -- start start 2024-09-19T07:24:13.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.108+0000 7f45fdb2a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f060 0x557b615826f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.108+0000 7f45fdb2a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f980 0x557b61589110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.108+0000 7f45fdb2a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6158a240 0x557b615a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.108+0000 7f45fdb2a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41adff0 con 0x557b6157f980 2024-09-19T07:24:13.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.108+0000 7f45fdb2a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41ab8c0 con 0x557b6157f060 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.108+0000 7f45fdb2a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41a9710 con 0x557b6158a240 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.108+0000 7f45f8cec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f980 0x557b61589110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.108+0000 7f45f8cec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f980 0x557b61589110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44178/0 (socket says 172.21.15.98:44178) 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.108+0000 7f45f8cec640 1 -- 172.21.15.98:0/2982079780 learned_addr learned my addr 172.21.15.98:0/2982079780 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45f8cec640 1 -- 172.21.15.98:0/2982079780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6158a240 msgr2=0x557b615a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45f9cee640 1 --2- 172.21.15.98:0/2982079780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6158a240 0x557b615a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45f8cec640 1 --2- 172.21.15.98:0/2982079780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6158a240 0x557b615a5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45f8cec640 1 -- 172.21.15.98:0/2982079780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f060 msgr2=0x557b615826f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45f94ed640 1 --2- 172.21.15.98:0/2982079780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f060 0x557b615826f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45f8cec640 1 --2- 172.21.15.98:0/2982079780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f060 0x557b615826f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45f8cec640 1 -- 172.21.15.98:0/2982079780 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b61581190 con 0x557b6157f980 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45f9cee640 1 --2- 172.21.15.98:0/2982079780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6158a240 0x557b615a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:13.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45f94ed640 1 --2- 172.21.15.98:0/2982079780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f060 0x557b615826f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45f8cec640 1 --2- 172.21.15.98:0/2982079780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f980 0x557b61589110 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f45f00b8350 tx=0x7f45f00bc0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbaa9fa50f066262 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45deffd640 1 -- 172.21.15.98:0/2982079780 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f00d4070 con 0x557b6157f980 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45deffd640 1 -- 172.21.15.98:0/2982079780 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f00c0a20 con 0x557b6157f980 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.109+0000 7f45deffd640 1 -- 172.21.15.98:0/2982079780 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0049040 con 0x557b6157f980 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 -- 172.21.15.98:0/2982079780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f980 msgr2=0x557b61589110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/2982079780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f980 0x557b61589110 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f45f00b8350 tx=0x7f45f00bc0d0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 -- 172.21.15.98:0/2982079780 shutdown_connections 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/2982079780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6158a240 0x557b615a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/2982079780 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6157f980 0x557b61589110 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/2982079780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f060 0x557b615826f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 -- 172.21.15.98:0/2982079780 >> 172.21.15.98:0/2982079780 conn(0x557b6157b5f0 msgr2=0x557b61588a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 -- 172.21.15.98:0/2982079780 shutdown_connections 2024-09-19T07:24:13.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 -- 172.21.15.98:0/2982079780 wait complete. 2024-09-19T07:24:13.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 -- start start 2024-09-19T07:24:13.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 Processor -- start 2024-09-19T07:24:13.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6157f060 0x557b615964b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f980 0x557b615969f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 0x557b615932a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41a9d80 con 0x557b6158a240 2024-09-19T07:24:13.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41ab1f0 con 0x557b6157f980 2024-09-19T07:24:13.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.110+0000 7f45fdb2a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45f41aa450 con 0x557b6157f060 2024-09-19T07:24:13.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45fdb2a740 10 client.0 _ll_register_callbacks cb 0x7f45e400bef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:13.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45f9cee640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 0x557b615932a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45f9cee640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 0x557b615932a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44190/0 (socket says 172.21.15.98:44190) 2024-09-19T07:24:13.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45f9cee640 1 -- 172.21.15.98:0/1383224232 learned_addr learned my addr 172.21.15.98:0/1383224232 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:13.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45f94ed640 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6157f060 0x557b615964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45f8cec640 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f980 0x557b615969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45f9cee640 1 -- 172.21.15.98:0/1383224232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6157f060 msgr2=0x557b615964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45f9cee640 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6157f060 0x557b615964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45f9cee640 1 -- 172.21.15.98:0/1383224232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f980 msgr2=0x557b615969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45f9cee640 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f980 0x557b615969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45f9cee640 1 -- 172.21.15.98:0/1383224232 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b61593ad0 con 0x557b6158a240 2024-09-19T07:24:13.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45f9cee640 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 0x557b615932a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f45ec010de0 tx=0x7f45ec005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71aede51587abcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:13.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45dcff9640 1 -- 172.21.15.98:0/1383224232 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec025070 con 0x557b6158a240 2024-09-19T07:24:13.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45dcff9640 1 -- 172.21.15.98:0/1383224232 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f45ec003b70 con 0x557b6158a240 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1383224232 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557b614ec0a0 con 0x557b6158a240 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45dcff9640 1 -- 172.21.15.98:0/1383224232 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f45ec010e10 con 0x557b6158a240 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45fdb2a740 10 client.16038 fetch_fsmap learned FSMap version 24 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.111+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1383224232 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557b61609850 con 0x557b6158a240 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.112+0000 7f45dcff9640 1 -- 172.21.15.98:0/1383224232 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557b614ec0a0 con 0x557b6158a240 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.112+0000 7f45dcff9640 1 -- 172.21.15.98:0/1383224232 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f45ec0314c0 con 0x557b6158a240 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.112+0000 7f45fdb2a740 10 client.16038 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.112+0000 7f45fdb2a740 10 client.16038 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.112+0000 7f45fdb2a740 20 client.16038 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.112+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b6159e010 0x557b6160c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.112+0000 7f45fdb2a740 4 client.16038 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "262599e", "release": true, "await": true}] 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.112+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1383224232 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "set_id": "262599e", "release": true, "await": true}) -- 0x557b614685a0 con 0x557b6159e010 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.112+0000 7f45f94ed640 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b6159e010 0x557b6160c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.113+0000 7f45f94ed640 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b6159e010 0x557b6160c060 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69f4b177578ce653 server_cookie=41ab6ea3352cae13 in_seq=0 out_seq=0 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.113+0000 7f45dcff9640 10 client.16038 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.115+0000 7f45dcff9640 1 -- 172.21.15.98:0/1383224232 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x557b614685a0 con 0x557b6159e010 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.115+0000 7f45dcff9640 10 client.16038 handle_command_reply: tid=0 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.115+0000 7f45fdb2a740 1 client.16038 shutdown 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.115+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1383224232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 msgr2=0x557b615932a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.115+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 0x557b615932a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f45ec010de0 tx=0x7f45ec005bd0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.115+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1383224232 shutdown_connections 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.115+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x557b6159e010 0x557b6160c060 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.115+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557b6158a240 0x557b615932a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.115+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b6157f980 0x557b615969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.115+0000 7f45fdb2a740 1 --2- 172.21.15.98:0/1383224232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557b6157f060 0x557b615964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.115+0000 7f45dcff9640 0 client.16038 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.115+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1383224232 >> 172.21.15.98:0/1383224232 conn(0x557b6157b5f0 msgr2=0x557b6157a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1383224232 shutdown_connections 2024-09-19T07:24:13.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fdb2a740 1 -- 172.21.15.98:0/1383224232 wait complete. 2024-09-19T07:24:13.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fdb2a740 20 client.16038 trim_cache size 0 max 16384 2024-09-19T07:24:13.120 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:24:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 24, 2024-09-19T07:24:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:24:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 12, 2024-09-19T07:24:13.120 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": { 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "262599e": { 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "version": 12, 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "age_ref": 0.0, 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RELEASED", 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "timeout": 90.0, 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "expiration": 140.3, 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "members": { 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "file:/": { 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "excluded": false, 2024-09-19T07:24:13.121 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:24:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RELEASED", 2024-09-19T07:24:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:24:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:24:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:24:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:24:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:24:13.122 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:24:13.122 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:24:13.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fb751640 1 -- 172.21.15.98:0/473234108 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f45e00a33b0 msgr2=0x7f45e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fb751640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f45e00a33b0 0x7f45e00a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f45ec005c40 tx=0x7f45ec012a10 comp rx=0 tx=0).stop 2024-09-19T07:24:13.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fb751640 1 -- 172.21.15.98:0/473234108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45f4101420 msgr2=0x7f45f41989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fb751640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45f4101420 0x7f45f41989f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009a50 tx=0x7f45f0004270 comp rx=0 tx=0).stop 2024-09-19T07:24:13.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fb751640 1 -- 172.21.15.98:0/473234108 shutdown_connections 2024-09-19T07:24:13.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fb751640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f45e00a33b0 0x7f45e00a5870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fb751640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f4106a80 0x7f45f419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fb751640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45f4101420 0x7f45f41989f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fb751640 1 --2- 172.21.15.98:0/473234108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45f4100a80 0x7f45f41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fb751640 1 -- 172.21.15.98:0/473234108 >> 172.21.15.98:0/473234108 conn(0x7f45f40fc7a0 msgr2=0x7f45f406aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fb751640 1 -- 172.21.15.98:0/473234108 shutdown_connections 2024-09-19T07:24:13.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:13.116+0000 7f45fb751640 1 -- 172.21.15.98:0/473234108 wait complete. 2024-09-19T07:24:13.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:12 smithi162 ceph-mon[35726]: pgmap v67: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-09-19T07:24:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.557+0000 7f949a591640 1 -- 172.21.15.98:0/298725238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94941009f0 msgr2=0x7f9494100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.557+0000 7f949a591640 1 --2- 172.21.15.98:0/298725238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94941009f0 0x7f9494100e50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f947c009930 tx=0x7f947c02a420 comp rx=0 tx=0).stop 2024-09-19T07:24:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.557+0000 7f949a591640 1 -- 172.21.15.98:0/298725238 shutdown_connections 2024-09-19T07:24:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.557+0000 7f949a591640 1 --2- 172.21.15.98:0/298725238 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9494101390 0x7f949410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.557+0000 7f949a591640 1 --2- 172.21.15.98:0/298725238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94941009f0 0x7f9494100e50 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.557+0000 7f949a591640 1 --2- 172.21.15.98:0/298725238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9494106a00 0x7f9494106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.557+0000 7f949a591640 1 -- 172.21.15.98:0/298725238 >> 172.21.15.98:0/298725238 conn(0x7f94940fc6b0 msgr2=0x7f94940fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.557+0000 7f949a591640 1 -- 172.21.15.98:0/298725238 shutdown_connections 2024-09-19T07:24:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.557+0000 7f949a591640 1 -- 172.21.15.98:0/298725238 wait complete. 2024-09-19T07:24:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.558+0000 7f949a591640 1 Processor -- start 2024-09-19T07:24:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.558+0000 7f949a591640 1 -- start start 2024-09-19T07:24:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.558+0000 7f949a591640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94941009f0 0x7f94941991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.558+0000 7f949a591640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9494101390 0x7f94941996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.558+0000 7f949a591640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9494106a00 0x7f94941a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.558+0000 7f949a591640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9494110e00 con 0x7f94941009f0 2024-09-19T07:24:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.558+0000 7f949a591640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9494110c80 con 0x7f9494106a00 2024-09-19T07:24:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.558+0000 7f949a591640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9494110f80 con 0x7f9494101390 2024-09-19T07:24:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.558+0000 7f9493fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94941009f0 0x7f94941991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.558+0000 7f9493fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94941009f0 0x7f94941991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44216/0 (socket says 172.21.15.98:44216) 2024-09-19T07:24:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.558+0000 7f9493fff640 1 -- 172.21.15.98:0/1284086418 learned_addr learned my addr 172.21.15.98:0/1284086418 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.558+0000 7f94937fe640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9494101390 0x7f94941996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.559+0000 7f9493fff640 1 -- 172.21.15.98:0/1284086418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9494101390 msgr2=0x7f94941996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.559+0000 7f9493fff640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9494101390 0x7f94941996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.559+0000 7f9493fff640 1 -- 172.21.15.98:0/1284086418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9494106a00 msgr2=0x7f94941a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.559+0000 7f9493fff640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9494106a00 0x7f94941a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.559+0000 7f9493fff640 1 -- 172.21.15.98:0/1284086418 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94941a4770 con 0x7f94941009f0 2024-09-19T07:24:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.559+0000 7f9493fff640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94941009f0 0x7f94941991b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f948400c920 tx=0x7f948400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.559+0000 7f94917fa640 1 -- 172.21.15.98:0/1284086418 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9484007c70 con 0x7f94941009f0 2024-09-19T07:24:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.559+0000 7f949a591640 1 -- 172.21.15.98:0/1284086418 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94941a4940 con 0x7f94941009f0 2024-09-19T07:24:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.559+0000 7f94917fa640 1 -- 172.21.15.98:0/1284086418 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9484007e10 con 0x7f94941009f0 2024-09-19T07:24:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.559+0000 7f94917fa640 1 -- 172.21.15.98:0/1284086418 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9484018890 con 0x7f94941009f0 2024-09-19T07:24:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.559+0000 7f949a591640 1 -- 172.21.15.98:0/1284086418 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94941a4eb0 con 0x7f94941009f0 2024-09-19T07:24:13.568 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.561+0000 7f94917fa640 1 -- 172.21.15.98:0/1284086418 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9484018b30 con 0x7f94941009f0 2024-09-19T07:24:13.568 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.561+0000 7f949d40a740 1 Processor -- start 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.561+0000 7f949d40a740 1 -- start start 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f949d40a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11989b0 0x55bce1198d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f949d40a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11992d0 0x55bce11a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f949d40a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f949d40a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bce10fd2f0 con 0x55bce11989b0 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f949d40a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bce10a5270 con 0x55bce11a80c0 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f949d40a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bce10f92b0 con 0x55bce11992d0 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f9498b2e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11989b0 0x55bce1198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f9498b2e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11989b0 0x55bce1198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44230/0 (socket says 172.21.15.98:44230) 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f9498b2e640 1 -- 172.21.15.98:0/2242396622 learned_addr learned my addr 172.21.15.98:0/2242396622 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f94917fa640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f94800a3460 0x7f94800a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f94937fe640 1 --2- 172.21.15.98:0/2242396622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.569 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f9498b2e640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f94800a3460 0x7f94800a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f94917fa640 1 -- 172.21.15.98:0/1284086418 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f94840cfeb0 con 0x7f94941009f0 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f9493fff640 1 --2- 172.21.15.98:0/2242396622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11992d0 0x55bce11a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f9498b2e640 1 -- 172.21.15.98:0/2242396622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11992d0 msgr2=0x55bce11a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f9498b2e640 1 --2- 172.21.15.98:0/2242396622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11992d0 0x55bce11a7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f9498b2e640 1 -- 172.21.15.98:0/2242396622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 msgr2=0x55bce11aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f9498b2e640 1 --2- 172.21.15.98:0/2242396622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11aa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f9498b2e640 1 -- 172.21.15.98:0/2242396622 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce10a4340 con 0x55bce11989b0 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f9493fff640 1 --2- 172.21.15.98:0/2242396622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11992d0 0x55bce11a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f94937fe640 1 --2- 172.21.15.98:0/2242396622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.562+0000 7f9498b2e640 1 --2- 172.21.15.98:0/2242396622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11989b0 0x55bce1198d90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f948c015900 tx=0x7f948c015dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5c9a17d3a13189 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f948a7fc640 1 -- 172.21.15.98:0/2242396622 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c022070 con 0x55bce11989b0 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f948a7fc640 1 -- 172.21.15.98:0/2242396622 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f948c015270 con 0x55bce11989b0 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f948a7fc640 1 -- 172.21.15.98:0/2242396622 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c0058c0 con 0x55bce11989b0 2024-09-19T07:24:13.570 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f9498b2e640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f94800a3460 0x7f94800a5920 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f948c01f000 tx=0x7f948c01b000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f949d40a740 1 -- 172.21.15.98:0/2242396622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11989b0 msgr2=0x55bce1198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f949d40a740 1 --2- 172.21.15.98:0/2242396622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11989b0 0x55bce1198d90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f948c015900 tx=0x7f948c015dc0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f949d40a740 1 -- 172.21.15.98:0/2242396622 shutdown_connections 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f949d40a740 1 --2- 172.21.15.98:0/2242396622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f949d40a740 1 --2- 172.21.15.98:0/2242396622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11992d0 0x55bce11a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f949d40a740 1 --2- 172.21.15.98:0/2242396622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11989b0 0x55bce1198d90 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f949d40a740 1 -- 172.21.15.98:0/2242396622 >> 172.21.15.98:0/2242396622 conn(0x55bce1195060 msgr2=0x55bce1195440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f949d40a740 1 -- 172.21.15.98:0/2242396622 shutdown_connections 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.563+0000 7f949d40a740 1 -- 172.21.15.98:0/2242396622 wait complete. 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f949d40a740 1 -- start start 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f949d40a740 1 Processor -- start 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f949d40a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11a5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f949d40a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11992d0 0x55bce11a5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.571 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f949d40a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11a80c0 0x55bce11a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f949d40a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bce11aac90 con 0x55bce11a80c0 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f949d40a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bce1086290 con 0x55bce11992d0 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f949d40a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bce11aae10 con 0x55bce11989b0 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f949d40a740 10 client.0 _ll_register_callbacks cb 0x55bce10b7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f9498b2e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11a80c0 0x55bce11a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f9498b2e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11a80c0 0x55bce11a5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44234/0 (socket says 172.21.15.98:44234) 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f9498b2e640 1 -- 172.21.15.98:0/1597095599 learned_addr learned my addr 172.21.15.98:0/1597095599 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f9493fff640 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.564+0000 7f94937fe640 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11992d0 0x55bce11a5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f9498b2e640 1 -- 172.21.15.98:0/1597095599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 msgr2=0x55bce11a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f9498b2e640 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f9498b2e640 1 -- 172.21.15.98:0/1597095599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11992d0 msgr2=0x55bce11a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.572 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f9498b2e640 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11992d0 0x55bce11a5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f9498b2e640 1 -- 172.21.15.98:0/1597095599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce0e10210 con 0x55bce11a80c0 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f9498b2e640 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11a80c0 0x55bce11a5ac0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f948c005c20 tx=0x7f948c015f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599cbf901d57b3ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f94737fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f94737fe640 1 -- 172.21.15.98:0/1597095599 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c022030 con 0x55bce11a80c0 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f94737fe640 1 -- 172.21.15.98:0/1597095599 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f948c004b20 con 0x55bce11a80c0 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f949d40a740 1 -- 172.21.15.98:0/1597095599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f948c015270 con 0x55bce11a80c0 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f94737fe640 1 -- 172.21.15.98:0/1597095599 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f948c004d20 con 0x55bce11a80c0 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f949d40a740 10 client.16050 fetch_fsmap learned FSMap version 24 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f949d40a740 1 -- 172.21.15.98:0/1597095599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bce0edc620 con 0x55bce11a80c0 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f94737fe640 1 -- 172.21.15.98:0/1597095599 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f948c015270 con 0x55bce11a80c0 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f94737fe640 1 -- 172.21.15.98:0/1597095599 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f948c02e070 con 0x55bce11a80c0 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f949d40a740 10 client.16050 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.565+0000 7f949d40a740 10 client.16050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:13.573 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.566+0000 7f949d40a740 20 client.16050 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.566+0000 7f949d40a740 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bce11b7ed0 0x55bce11ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.566+0000 7f949d40a740 4 client.16050 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.566+0000 7f949d40a740 1 -- 172.21.15.98:0/1597095599 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bce110aa20 con 0x55bce11b7ed0 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.566+0000 7f9493fff640 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bce11b7ed0 0x55bce11ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.566+0000 7f94737fe640 10 client.16050 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.566+0000 7f9493fff640 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bce11b7ed0 0x55bce11ba2c0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa8178ecaa7bdb5 server_cookie=239749e8b491540 in_seq=0 out_seq=0 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f94737fe640 1 -- 172.21.15.98:0/1597095599 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bce110aa20 con 0x55bce11b7ed0 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f94737fe640 10 client.16050 handle_command_reply: tid=0 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f949d40a740 1 client.16050 shutdown 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f949d40a740 1 -- 172.21.15.98:0/1597095599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11a80c0 msgr2=0x55bce11a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f949d40a740 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11a80c0 0x55bce11a5ac0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f948c005c20 tx=0x7f948c015f50 comp rx=0 tx=0).stop 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f949d40a740 1 -- 172.21.15.98:0/1597095599 shutdown_connections 2024-09-19T07:24:13.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f949d40a740 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bce11b7ed0 0x55bce11ba2c0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f949d40a740 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11a80c0 0x55bce11a5ac0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f94737fe640 0 client.16050 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f949d40a740 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11992d0 0x55bce11a5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f949d40a740 1 --2- 172.21.15.98:0/1597095599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f949d40a740 1 -- 172.21.15.98:0/1597095599 >> 172.21.15.98:0/1597095599 conn(0x55bce1195060 msgr2=0x55bce119ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f949d40a740 1 -- 172.21.15.98:0/1597095599 shutdown_connections 2024-09-19T07:24:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f949d40a740 1 -- 172.21.15.98:0/1597095599 wait complete. 2024-09-19T07:24:13.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.567+0000 7f949d40a740 20 client.16050 trim_cache size 0 max 16384 2024-09-19T07:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.581+0000 7f949d40a740 1 Processor -- start 2024-09-19T07:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.581+0000 7f949d40a740 1 -- start start 2024-09-19T07:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.581+0000 7f949d40a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11a7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.581+0000 7f949d40a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 0x55bce11a5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.581+0000 7f949d40a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.586 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.581+0000 7f949d40a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f94941adf00 con 0x55bce11992d0 2024-09-19T07:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.581+0000 7f949d40a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f94941ab7d0 con 0x55bce11a80c0 2024-09-19T07:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.581+0000 7f949d40a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94941a9620 con 0x55bce11989b0 2024-09-19T07:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.581+0000 7f94937fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 0x55bce11a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f94937fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 0x55bce11a5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44248/0 (socket says 172.21.15.98:44248) 2024-09-19T07:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f94937fe640 1 -- 172.21.15.98:0/2940822803 learned_addr learned my addr 172.21.15.98:0/2940822803 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f9493fff640 1 --2- 172.21.15.98:0/2940822803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f94937fe640 1 -- 172.21.15.98:0/2940822803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 msgr2=0x55bce11a7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f9498b2e640 1 --2- 172.21.15.98:0/2940822803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f94937fe640 1 --2- 172.21.15.98:0/2940822803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11a7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f94937fe640 1 -- 172.21.15.98:0/2940822803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 msgr2=0x55bce11a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f94937fe640 1 --2- 172.21.15.98:0/2940822803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11a5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.587 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f94937fe640 1 -- 172.21.15.98:0/2940822803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce11b4aa0 con 0x55bce11992d0 2024-09-19T07:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f9493fff640 1 --2- 172.21.15.98:0/2940822803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f94937fe640 1 --2- 172.21.15.98:0/2940822803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 0x55bce11a5590 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f947c02a940 tx=0x7f947c032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b469b984c08175b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f9489ffb640 1 -- 172.21.15.98:0/2940822803 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c035050 con 0x55bce11992d0 2024-09-19T07:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f9489ffb640 1 -- 172.21.15.98:0/2940822803 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947c0317b0 con 0x55bce11992d0 2024-09-19T07:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.582+0000 7f9489ffb640 1 -- 172.21.15.98:0/2940822803 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c0046c0 con 0x55bce11992d0 2024-09-19T07:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.583+0000 7f949d40a740 1 -- 172.21.15.98:0/2940822803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 msgr2=0x55bce11a5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.583+0000 7f949d40a740 1 --2- 172.21.15.98:0/2940822803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 0x55bce11a5590 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f947c02a940 tx=0x7f947c032d70 comp rx=0 tx=0).stop 2024-09-19T07:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.583+0000 7f949d40a740 1 -- 172.21.15.98:0/2940822803 shutdown_connections 2024-09-19T07:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.583+0000 7f949d40a740 1 --2- 172.21.15.98:0/2940822803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.583+0000 7f949d40a740 1 --2- 172.21.15.98:0/2940822803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 0x55bce11a5590 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.583+0000 7f949d40a740 1 --2- 172.21.15.98:0/2940822803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11a7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.588 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.583+0000 7f949d40a740 1 -- 172.21.15.98:0/2940822803 >> 172.21.15.98:0/2940822803 conn(0x55bce1195060 msgr2=0x55bce11941c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.583+0000 7f949d40a740 1 -- 172.21.15.98:0/2940822803 shutdown_connections 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.583+0000 7f949d40a740 1 -- 172.21.15.98:0/2940822803 wait complete. 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.583+0000 7f949d40a740 1 -- start start 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.583+0000 7f949d40a740 1 Processor -- start 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f949d40a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f949d40a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 0x55bce11b0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f949d40a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f949d40a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f94941a9c90 con 0x55bce11992d0 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f949d40a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f94941ab100 con 0x55bce11a80c0 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f949d40a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94941aa360 con 0x55bce11989b0 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f949d40a740 10 client.0 _ll_register_callbacks cb 0x7f948c020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94937fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 0x55bce11b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.589 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94937fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 0x55bce11b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:44258/0 (socket says 172.21.15.98:44258) 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94937fe640 1 -- 172.21.15.98:0/671088136 learned_addr learned my addr 172.21.15.98:0/671088136 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f9498b2e640 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f9493fff640 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94937fe640 1 -- 172.21.15.98:0/671088136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 msgr2=0x55bce11b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94937fe640 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94937fe640 1 -- 172.21.15.98:0/671088136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 msgr2=0x55bce11ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94937fe640 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94937fe640 1 -- 172.21.15.98:0/671088136 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce11b0c80 con 0x55bce11992d0 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f9493fff640 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94937fe640 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 0x55bce11b0610 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f947c043000 tx=0x7f947c032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca85599ac7854a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94737fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94737fe640 1 -- 172.21.15.98:0/671088136 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c0035f0 con 0x55bce11992d0 2024-09-19T07:24:13.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94737fe640 1 -- 172.21.15.98:0/671088136 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f947c003790 con 0x55bce11992d0 2024-09-19T07:24:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f949d40a740 1 -- 172.21.15.98:0/671088136 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f947c0317b0 con 0x55bce11992d0 2024-09-19T07:24:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f94737fe640 1 -- 172.21.15.98:0/671088136 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f947c035030 con 0x55bce11992d0 2024-09-19T07:24:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f949d40a740 10 client.16056 fetch_fsmap learned FSMap version 24 2024-09-19T07:24:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.584+0000 7f949d40a740 1 -- 172.21.15.98:0/671088136 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bce1222fa0 con 0x55bce11992d0 2024-09-19T07:24:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.585+0000 7f94737fe640 1 -- 172.21.15.98:0/671088136 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f947c0317b0 con 0x55bce11992d0 2024-09-19T07:24:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.585+0000 7f94737fe640 1 -- 172.21.15.98:0/671088136 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f947c044be0 con 0x55bce11992d0 2024-09-19T07:24:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.585+0000 7f949d40a740 10 client.16056 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T07:24:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.585+0000 7f949d40a740 10 client.16056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.585+0000 7f949d40a740 20 client.16056 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.585+0000 7f949d40a740 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bce12236d0 0x55bce1225af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.585+0000 7f949d40a740 4 client.16056 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:24:13.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.585+0000 7f949d40a740 1 -- 172.21.15.98:0/671088136 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bce1104d70 con 0x55bce12236d0 2024-09-19T07:24:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.585+0000 7f9493fff640 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bce12236d0 0x55bce1225af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.585+0000 7f94737fe640 10 client.16056 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:13.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.585+0000 7f9493fff640 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bce12236d0 0x55bce1225af0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d421e0c927d53f2f server_cookie=3c65f7622311ab3a in_seq=0 out_seq=0 2024-09-19T07:24:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f94737fe640 1 -- 172.21.15.98:0/671088136 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bce1104d70 con 0x55bce12236d0 2024-09-19T07:24:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f94737fe640 10 client.16056 handle_command_reply: tid=0 2024-09-19T07:24:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f949d40a740 1 client.16056 shutdown 2024-09-19T07:24:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f949d40a740 1 -- 172.21.15.98:0/671088136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 msgr2=0x55bce11b0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f949d40a740 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 0x55bce11b0610 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f947c043000 tx=0x7f947c032f60 comp rx=0 tx=0).stop 2024-09-19T07:24:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f949d40a740 1 -- 172.21.15.98:0/671088136 shutdown_connections 2024-09-19T07:24:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f949d40a740 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bce11a80c0 0x55bce11ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f949d40a740 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bce12236d0 0x55bce1225af0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f949d40a740 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bce11992d0 0x55bce11b0610 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f949d40a740 1 --2- 172.21.15.98:0/671088136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce11989b0 0x55bce11b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f94737fe640 0 client.16056 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f949d40a740 1 -- 172.21.15.98:0/671088136 >> 172.21.15.98:0/671088136 conn(0x55bce1195060 msgr2=0x55bce11b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f949d40a740 1 -- 172.21.15.98:0/671088136 shutdown_connections 2024-09-19T07:24:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f949d40a740 1 -- 172.21.15.98:0/671088136 wait complete. 2024-09-19T07:24:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.593+0000 7f949d40a740 20 client.16056 trim_cache size 0 max 16384 2024-09-19T07:24:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:24:13.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:24:13.596 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:24:13.596 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:24:13.596 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.594+0000 7f949a591640 1 -- 172.21.15.98:0/1284086418 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f94800a3460 msgr2=0x7f94800a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.596 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.594+0000 7f949a591640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f94800a3460 0x7f94800a5920 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f948c01f000 tx=0x7f948c01b000 comp rx=0 tx=0).stop 2024-09-19T07:24:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.594+0000 7f949a591640 1 -- 172.21.15.98:0/1284086418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94941009f0 msgr2=0x7f94941991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.594+0000 7f949a591640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94941009f0 0x7f94941991b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f948400c920 tx=0x7f948400cde0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.594+0000 7f949a591640 1 -- 172.21.15.98:0/1284086418 shutdown_connections 2024-09-19T07:24:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.594+0000 7f949a591640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f94800a3460 0x7f94800a5920 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.594+0000 7f949a591640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9494106a00 0x7f94941a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.594+0000 7f949a591640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9494101390 0x7f94941996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.594+0000 7f949a591640 1 --2- 172.21.15.98:0/1284086418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94941009f0 0x7f94941991b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.594+0000 7f949a591640 1 -- 172.21.15.98:0/1284086418 >> 172.21.15.98:0/1284086418 conn(0x7f94940fc6b0 msgr2=0x7f94940fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.594+0000 7f949a591640 1 -- 172.21.15.98:0/1284086418 shutdown_connections 2024-09-19T07:24:13.597 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:13.594+0000 7f949a591640 1 -- 172.21.15.98:0/1284086418 wait complete. 2024-09-19T07:24:13.802 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '262599e', total seconds elapsed: 23.3 2024-09-19T07:24:14.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:13 smithi162 ceph-mon[35726]: pgmap v68: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-09-19T07:24:14.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:13 smithi098 ceph-mon[30950]: pgmap v68: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-09-19T07:24:14.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:13 smithi139 ceph-mon[35039]: pgmap v68: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-09-19T07:24:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:24:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:14 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:24:15.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:14 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:24:15.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:15.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:14 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:16.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:15 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:24:16.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:15 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:24:16.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:15 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:16.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:15 smithi162 ceph-mon[35726]: pgmap v69: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 29 op/s 2024-09-19T07:24:16.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:15 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:24:16.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:15 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:24:16.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:15 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:16.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:15 smithi098 ceph-mon[30950]: pgmap v69: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 29 op/s 2024-09-19T07:24:16.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:15 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:24:16.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:15 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:24:16.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:15 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:24:16.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:15 smithi139 ceph-mon[35039]: pgmap v69: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 26 KiB/s wr, 29 op/s 2024-09-19T07:24:16.927 INFO:tasks.workunit.client.0.smithi098.stderr:+ tar xzf ltp-full.tgz 2024-09-19T07:24:18.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:17 smithi162 ceph-mon[35726]: pgmap v70: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T07:24:18.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:17 smithi098 ceph-mon[30950]: pgmap v70: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T07:24:18.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:17 smithi139 ceph-mon[35039]: pgmap v70: 97 pgs: 97 active+clean; 6.8 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T07:24:20.118 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:19 smithi139 ceph-mon[35039]: pgmap v71: 97 pgs: 97 active+clean; 19 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 1.1 MiB/s wr, 90 op/s 2024-09-19T07:24:20.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:19 smithi162 ceph-mon[35726]: pgmap v71: 97 pgs: 97 active+clean; 19 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 1.1 MiB/s wr, 90 op/s 2024-09-19T07:24:20.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:19 smithi098 ceph-mon[30950]: pgmap v71: 97 pgs: 97 active+clean; 19 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 1.1 MiB/s wr, 90 op/s 2024-09-19T07:24:22.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:21 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:22.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:21 smithi098 ceph-mon[30950]: pgmap v72: 97 pgs: 97 active+clean; 19 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 1.1 MiB/s wr, 87 op/s 2024-09-19T07:24:22.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:21 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:22.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:21 smithi139 ceph-mon[35039]: pgmap v72: 97 pgs: 97 active+clean; 19 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 1.1 MiB/s wr, 87 op/s 2024-09-19T07:24:22.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:21 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:22.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:21 smithi162 ceph-mon[35726]: pgmap v72: 97 pgs: 97 active+clean; 19 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 1.1 MiB/s wr, 87 op/s 2024-09-19T07:24:24.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:23 smithi162 ceph-mon[35726]: pgmap v73: 97 pgs: 97 active+clean; 19 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 1.1 MiB/s wr, 87 op/s 2024-09-19T07:24:24.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:23 smithi098 ceph-mon[30950]: pgmap v73: 97 pgs: 97 active+clean; 19 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 1.1 MiB/s wr, 87 op/s 2024-09-19T07:24:24.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:23 smithi139 ceph-mon[35039]: pgmap v73: 97 pgs: 97 active+clean; 19 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 1.1 MiB/s wr, 87 op/s 2024-09-19T07:24:26.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:25 smithi162 ceph-mon[35726]: pgmap v74: 97 pgs: 97 active+clean; 24 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 1.5 MiB/s wr, 106 op/s 2024-09-19T07:24:26.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:25 smithi098 ceph-mon[30950]: pgmap v74: 97 pgs: 97 active+clean; 24 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 1.5 MiB/s wr, 106 op/s 2024-09-19T07:24:26.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:25 smithi139 ceph-mon[35039]: pgmap v74: 97 pgs: 97 active+clean; 24 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 1.5 MiB/s wr, 106 op/s 2024-09-19T07:24:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.689+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/4191804866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f94074eb0 msgr2=0x7f7f941125a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.689+0000 7f7f9c4ba640 1 --2- 172.21.15.98:0/4191804866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f94074eb0 0x7f7f941125a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009900 tx=0x7f7f8402a480 comp rx=0 tx=0).stop 2024-09-19T07:24:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.689+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/4191804866 shutdown_connections 2024-09-19T07:24:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.689+0000 7f7f9c4ba640 1 --2- 172.21.15.98:0/4191804866 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f94112ae0 0x7f7f94114ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.689+0000 7f7f9c4ba640 1 --2- 172.21.15.98:0/4191804866 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f94074eb0 0x7f7f941125a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.689+0000 7f7f9c4ba640 1 --2- 172.21.15.98:0/4191804866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f94074590 0x7f7f94074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.689+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/4191804866 >> 172.21.15.98:0/4191804866 conn(0x7f7f940fd7d0 msgr2=0x7f7f940ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.689+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/4191804866 shutdown_connections 2024-09-19T07:24:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.689+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/4191804866 wait complete. 2024-09-19T07:24:26.692 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.689+0000 7f7f9c4ba640 1 Processor -- start 2024-09-19T07:24:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9c4ba640 1 -- start start 2024-09-19T07:24:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9c4ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f94074590 0x7f7f941a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9c4ba640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f94074eb0 0x7f7f941a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9c4ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f94112ae0 0x7f7f9419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9c4ba640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941184b0 con 0x7f7f94074eb0 2024-09-19T07:24:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9c4ba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7f94118330 con 0x7f7f94074590 2024-09-19T07:24:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9c4ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f94118630 con 0x7f7f94112ae0 2024-09-19T07:24:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f99a55640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f94074eb0 0x7f7f941a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9a256640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f94074590 0x7f7f941a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f99a55640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f94074eb0 0x7f7f941a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47880/0 (socket says 172.21.15.98:47880) 2024-09-19T07:24:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f99a55640 1 -- 172.21.15.98:0/1662503622 learned_addr learned my addr 172.21.15.98:0/1662503622 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:26.693 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9aa57640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f94112ae0 0x7f7f9419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9a256640 1 -- 172.21.15.98:0/1662503622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f94112ae0 msgr2=0x7f7f9419e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9a256640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f94112ae0 0x7f7f9419e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9a256640 1 -- 172.21.15.98:0/1662503622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f94074eb0 msgr2=0x7f7f941a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9a256640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f94074eb0 0x7f7f941a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9a256640 1 -- 172.21.15.98:0/1662503622 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9419eff0 con 0x7f7f94074590 2024-09-19T07:24:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.690+0000 7f7f9a256640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f94074590 0x7f7f941a46b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000d720 tx=0x7f7f9000db20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.691+0000 7f7f8b7fe640 1 -- 172.21.15.98:0/1662503622 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f90017070 con 0x7f7f94074590 2024-09-19T07:24:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.691+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/1662503622 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9419f2e0 con 0x7f7f94074590 2024-09-19T07:24:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.691+0000 7f7f8b7fe640 1 -- 172.21.15.98:0/1662503622 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f90005500 con 0x7f7f94074590 2024-09-19T07:24:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.691+0000 7f7f8b7fe640 1 -- 172.21.15.98:0/1662503622 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f900047a0 con 0x7f7f94074590 2024-09-19T07:24:26.694 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.691+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/1662503622 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f941ab500 con 0x7f7f94074590 2024-09-19T07:24:26.701 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.693+0000 7f7f9f259740 1 Processor -- start 2024-09-19T07:24:26.701 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.693+0000 7f7f8b7fe640 1 -- 172.21.15.98:0/1662503622 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7f90005020 con 0x7f7f94074590 2024-09-19T07:24:26.701 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9f259740 1 -- start start 2024-09-19T07:24:26.701 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9f259740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ab1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.701 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9f259740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951abc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.701 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9f259740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951abf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9f259740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560951a162f0 con 0x560951abccb0 2024-09-19T07:24:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9f259740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5609519be270 con 0x560951ab2410 2024-09-19T07:24:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9f259740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560951a122b0 con 0x560951ab1af0 2024-09-19T07:24:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f99a55640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951abf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9a256640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951abc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f99a55640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951abf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47894/0 (socket says 172.21.15.98:47894) 2024-09-19T07:24:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f99a55640 1 -- 172.21.15.98:0/204097572 learned_addr learned my addr 172.21.15.98:0/204097572 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9aa57640 1 --2- 172.21.15.98:0/204097572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ab1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f8b7fe640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7f800a3460 0x7f7f800a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9a256640 1 -- 172.21.15.98:0/204097572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 msgr2=0x560951ab1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9a256640 1 --2- 172.21.15.98:0/204097572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ab1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.702 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9a256640 1 -- 172.21.15.98:0/204097572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 msgr2=0x560951abf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9a256640 1 --2- 172.21.15.98:0/204097572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951abf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9a256640 1 -- 172.21.15.98:0/204097572 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609519bd340 con 0x560951ab2410 2024-09-19T07:24:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.694+0000 7f7f9aa57640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7f800a3460 0x7f7f800a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.695+0000 7f7f8b7fe640 1 -- 172.21.15.98:0/1662503622 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f7f900cf9e0 con 0x7f7f94074590 2024-09-19T07:24:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.695+0000 7f7f9a256640 1 --2- 172.21.15.98:0/204097572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951abc770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f900cd100 tx=0x7f7f9006a980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3aa72aba7f6b426 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.695+0000 7f7f9aa57640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7f800a3460 0x7f7f800a5920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c005fd0 tx=0x7f7f8c014040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.695+0000 7f7f88bfe640 1 -- 172.21.15.98:0/204097572 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9009b7d0 con 0x560951ab2410 2024-09-19T07:24:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.695+0000 7f7f88bfe640 1 -- 172.21.15.98:0/204097572 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f90004440 con 0x560951ab2410 2024-09-19T07:24:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.695+0000 7f7f88bfe640 1 -- 172.21.15.98:0/204097572 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f900056b0 con 0x560951ab2410 2024-09-19T07:24:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 -- 172.21.15.98:0/204097572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 msgr2=0x560951abc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 --2- 172.21.15.98:0/204097572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951abc770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f900cd100 tx=0x7f7f9006a980 comp rx=0 tx=0).stop 2024-09-19T07:24:26.703 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 -- 172.21.15.98:0/204097572 shutdown_connections 2024-09-19T07:24:26.704 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 --2- 172.21.15.98:0/204097572 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951abf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.704 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 --2- 172.21.15.98:0/204097572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951abc770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.704 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 --2- 172.21.15.98:0/204097572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ab1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.704 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 -- 172.21.15.98:0/204097572 >> 172.21.15.98:0/204097572 conn(0x560951aae060 msgr2=0x560951aae440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:26.704 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 -- 172.21.15.98:0/204097572 shutdown_connections 2024-09-19T07:24:26.704 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 -- 172.21.15.98:0/204097572 wait complete. 2024-09-19T07:24:26.704 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 -- start start 2024-09-19T07:24:26.704 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 Processor -- start 2024-09-19T07:24:26.704 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab1af0 0x560951ab9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab2410 0x560951aba0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951aba620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560951abf820 con 0x560951abccb0 2024-09-19T07:24:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56095199f290 con 0x560951ab1af0 2024-09-19T07:24:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560951abf9a0 con 0x560951ab2410 2024-09-19T07:24:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.696+0000 7f7f9f259740 10 client.0 _ll_register_callbacks cb 0x5609519d0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9a256640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab1af0 0x560951ab9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9aa57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951aba620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9a256640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab1af0 0x560951ab9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:34752/0 (socket says 172.21.15.98:34752) 2024-09-19T07:24:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9a256640 1 -- 172.21.15.98:0/4151376053 learned_addr learned my addr 172.21.15.98:0/4151376053 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f99a55640 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab2410 0x560951aba0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.705 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9a256640 1 -- 172.21.15.98:0/4151376053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab2410 msgr2=0x560951aba0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9a256640 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab2410 0x560951aba0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9a256640 1 -- 172.21.15.98:0/4151376053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 msgr2=0x560951aba620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9a256640 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951aba620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9a256640 1 -- 172.21.15.98:0/4151376053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560951729210 con 0x560951ab1af0 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9aa57640 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951aba620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9a256640 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab1af0 0x560951ab9ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f900980f0 tx=0x7f7f90009980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4454a9d513626342 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f7dffb640 1 -- 172.21.15.98:0/4151376053 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9009b5f0 con 0x560951ab1af0 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9f259740 1 -- 172.21.15.98:0/4151376053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560951a23a20 con 0x560951ab1af0 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f7dffb640 1 -- 172.21.15.98:0/4151376053 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f7f900d31c0 con 0x560951ab1af0 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f7dffb640 1 -- 172.21.15.98:0/4151376053 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7f900056b0 con 0x560951ab1af0 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9f259740 10 client.25421 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:26.706 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.697+0000 7f7f9f259740 1 -- 172.21.15.98:0/4151376053 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5609517f5620 con 0x560951ab1af0 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.698+0000 7f7f7dffb640 1 -- 172.21.15.98:0/4151376053 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x560951a23a20 con 0x560951ab1af0 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.698+0000 7f7f7dffb640 1 -- 172.21.15.98:0/4151376053 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7f900cd380 con 0x560951ab1af0 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.698+0000 7f7f9f259740 10 client.25421 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.698+0000 7f7f9f259740 10 client.25421 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.698+0000 7f7f9f259740 20 client.25421 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.698+0000 7f7f9f259740 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x560951acca30 0x560951acee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.698+0000 7f7f9f259740 4 client.25421 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.698+0000 7f7f9f259740 1 -- 172.21.15.98:0/4151376053 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560951a1dd70 con 0x560951acca30 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.698+0000 7f7f99a55640 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x560951acca30 0x560951acee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.698+0000 7f7f7dffb640 10 client.25421 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.698+0000 7f7f99a55640 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x560951acca30 0x560951acee20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b93763d6e220437 server_cookie=a693238d71bfbcf in_seq=0 out_seq=0 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.699+0000 7f7f7dffb640 1 -- 172.21.15.98:0/4151376053 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560951a1dd70 con 0x560951acca30 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.699+0000 7f7f7dffb640 10 client.25421 handle_command_reply: tid=0 2024-09-19T07:24:26.707 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.699+0000 7f7f9f259740 1 client.25421 shutdown 2024-09-19T07:24:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.699+0000 7f7f9f259740 1 -- 172.21.15.98:0/4151376053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab1af0 msgr2=0x560951ab9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.699+0000 7f7f9f259740 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab1af0 0x560951ab9ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f900980f0 tx=0x7f7f90009980 comp rx=0 tx=0).stop 2024-09-19T07:24:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.699+0000 7f7f9f259740 1 -- 172.21.15.98:0/4151376053 shutdown_connections 2024-09-19T07:24:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.699+0000 7f7f9f259740 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x560951acca30 0x560951acee20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.700+0000 7f7f9f259740 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951aba620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.700+0000 7f7f9f259740 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab2410 0x560951aba0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.700+0000 7f7f9f259740 1 --2- 172.21.15.98:0/4151376053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab1af0 0x560951ab9ba0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.700+0000 7f7f9f259740 1 -- 172.21.15.98:0/4151376053 >> 172.21.15.98:0/4151376053 conn(0x560951aae060 msgr2=0x560951ab3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.700+0000 7f7f7dffb640 0 client.25421 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.700+0000 7f7f9f259740 1 -- 172.21.15.98:0/4151376053 shutdown_connections 2024-09-19T07:24:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.700+0000 7f7f9f259740 1 -- 172.21.15.98:0/4151376053 wait complete. 2024-09-19T07:24:26.708 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.700+0000 7f7f9f259740 20 client.25421 trim_cache size 0 max 16384 2024-09-19T07:24:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9f259740 1 Processor -- start 2024-09-19T07:24:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9f259740 1 -- start start 2024-09-19T07:24:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9f259740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ab8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9f259740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951aba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9f259740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951ad1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9f259740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941b67e0 con 0x560951abccb0 2024-09-19T07:24:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9f259740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941b40b0 con 0x560951ab2410 2024-09-19T07:24:26.719 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9f259740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941b1f00 con 0x560951ab1af0 2024-09-19T07:24:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9aa57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951ad1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9aa57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951ad1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47920/0 (socket says 172.21.15.98:47920) 2024-09-19T07:24:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9aa57640 1 -- 172.21.15.98:0/2222576337 learned_addr learned my addr 172.21.15.98:0/2222576337 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f99a55640 1 --2- 172.21.15.98:0/2222576337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951aba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9a256640 1 --2- 172.21.15.98:0/2222576337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ab8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9aa57640 1 -- 172.21.15.98:0/2222576337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 msgr2=0x560951ab8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.714+0000 7f7f9aa57640 1 --2- 172.21.15.98:0/2222576337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ab8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.715+0000 7f7f9aa57640 1 -- 172.21.15.98:0/2222576337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 msgr2=0x560951aba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.715+0000 7f7f9aa57640 1 --2- 172.21.15.98:0/2222576337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951aba450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.715+0000 7f7f9aa57640 1 -- 172.21.15.98:0/2222576337 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560951ab8b30 con 0x560951abccb0 2024-09-19T07:24:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.715+0000 7f7f9aa57640 1 --2- 172.21.15.98:0/2222576337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951ad1a60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0108a0 tx=0x7f7f8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca6223e4b8f5463 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:26.720 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.715+0000 7f7f7ffff640 1 -- 172.21.15.98:0/2222576337 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c01c740 con 0x560951abccb0 2024-09-19T07:24:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.715+0000 7f7f7ffff640 1 -- 172.21.15.98:0/2222576337 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8c01cdc0 con 0x560951abccb0 2024-09-19T07:24:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.715+0000 7f7f7ffff640 1 -- 172.21.15.98:0/2222576337 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0273d0 con 0x560951abccb0 2024-09-19T07:24:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.715+0000 7f7f9f259740 1 -- 172.21.15.98:0/2222576337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 msgr2=0x560951ad1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.715+0000 7f7f9f259740 1 --2- 172.21.15.98:0/2222576337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951ad1a60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0108a0 tx=0x7f7f8c017000 comp rx=0 tx=0).stop 2024-09-19T07:24:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 -- 172.21.15.98:0/2222576337 shutdown_connections 2024-09-19T07:24:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 --2- 172.21.15.98:0/2222576337 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951ad1a60 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 --2- 172.21.15.98:0/2222576337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951aba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 --2- 172.21.15.98:0/2222576337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ab8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 -- 172.21.15.98:0/2222576337 >> 172.21.15.98:0/2222576337 conn(0x560951aae060 msgr2=0x560951abbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:26.721 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 -- 172.21.15.98:0/2222576337 shutdown_connections 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 -- 172.21.15.98:0/2222576337 wait complete. 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 -- start start 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 Processor -- start 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ad22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951acf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951acfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941b2570 con 0x560951abccb0 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941b39e0 con 0x560951ab2410 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941b2c40 con 0x560951ab1af0 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9f259740 10 client.0 _ll_register_callbacks cb 0x7f7f84009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9aa57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951acfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9aa57640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951acfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47922/0 (socket says 172.21.15.98:47922) 2024-09-19T07:24:26.722 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f99a55640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951acf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.716+0000 7f7f9aa57640 1 -- 172.21.15.98:0/2051117014 learned_addr learned my addr 172.21.15.98:0/2051117014 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9a256640 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ad22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9aa57640 1 -- 172.21.15.98:0/2051117014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 msgr2=0x560951ad22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9aa57640 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ad22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9aa57640 1 -- 172.21.15.98:0/2051117014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 msgr2=0x560951acf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9aa57640 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951acf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9aa57640 1 -- 172.21.15.98:0/2051117014 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560951ab2240 con 0x560951abccb0 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9a256640 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ad22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9aa57640 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951acfc10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c010d60 tx=0x7f7f8c01ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3add6826d04ccff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f7dffb640 1 -- 172.21.15.98:0/2051117014 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c02d040 con 0x560951abccb0 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9f259740 1 -- 172.21.15.98:0/2051117014 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f8c01cdc0 con 0x560951abccb0 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f7dffb640 1 -- 172.21.15.98:0/2051117014 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f7f8c01d610 con 0x560951abccb0 2024-09-19T07:24:26.723 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f7dffb640 1 -- 172.21.15.98:0/2051117014 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7f8c01d810 con 0x560951abccb0 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9f259740 10 client.16074 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9f259740 1 -- 172.21.15.98:0/2051117014 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560951b372c0 con 0x560951abccb0 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f7dffb640 1 -- 172.21.15.98:0/2051117014 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8c01cdc0 con 0x560951abccb0 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f7dffb640 1 -- 172.21.15.98:0/2051117014 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7f8c028840 con 0x560951abccb0 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9f259740 10 client.16074 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9f259740 10 client.16074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.717+0000 7f7f9f259740 20 client.16074 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.718+0000 7f7f9f259740 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x560951b37a10 0x560951b39e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.718+0000 7f7f9f259740 4 client.16074 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.718+0000 7f7f9f259740 1 -- 172.21.15.98:0/2051117014 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56095199a900 con 0x560951b37a10 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.718+0000 7f7f9a256640 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x560951b37a10 0x560951b39e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.718+0000 7f7f9a256640 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x560951b37a10 0x560951b39e30 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7af574c425b614ac server_cookie=e4e0098ccda96504 in_seq=0 out_seq=0 2024-09-19T07:24:26.724 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:26.718+0000 7f7f7dffb640 10 client.16074 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f7dffb640 1 -- 172.21.15.98:0/2051117014 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56095199a900 con 0x560951b37a10 2024-09-19T07:24:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f7dffb640 10 client.16074 handle_command_reply: tid=0 2024-09-19T07:24:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f9f259740 1 client.16074 shutdown 2024-09-19T07:24:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f9f259740 1 -- 172.21.15.98:0/2051117014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 msgr2=0x560951acfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f9f259740 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951acfc10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c010d60 tx=0x7f7f8c01ddc0 comp rx=0 tx=0).stop 2024-09-19T07:24:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f9f259740 1 -- 172.21.15.98:0/2051117014 shutdown_connections 2024-09-19T07:24:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f9f259740 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x560951b37a10 0x560951b39e30 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f9f259740 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560951abccb0 0x560951acfc10 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f9f259740 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560951ab2410 0x560951acf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f9f259740 1 --2- 172.21.15.98:0/2051117014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560951ab1af0 0x560951ad22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f7dffb640 0 client.16074 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f9f259740 1 -- 172.21.15.98:0/2051117014 >> 172.21.15.98:0/2051117014 conn(0x560951aae060 msgr2=0x560951abbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f9f259740 1 -- 172.21.15.98:0/2051117014 shutdown_connections 2024-09-19T07:24:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f9f259740 1 -- 172.21.15.98:0/2051117014 wait complete. 2024-09-19T07:24:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.522+0000 7f7f9f259740 20 client.16074 trim_cache size 0 max 16384 2024-09-19T07:24:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:24:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:24:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:24:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:24:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.523+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/1662503622 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7f800a3460 msgr2=0x7f7f800a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.523+0000 7f7f9c4ba640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7f800a3460 0x7f7f800a5920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c005fd0 tx=0x7f7f8c014040 comp rx=0 tx=0).stop 2024-09-19T07:24:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.523+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/1662503622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f94074590 msgr2=0x7f7f941a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.523+0000 7f7f9c4ba640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f94074590 0x7f7f941a46b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000d720 tx=0x7f7f9000db20 comp rx=0 tx=0).stop 2024-09-19T07:24:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.523+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/1662503622 shutdown_connections 2024-09-19T07:24:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.523+0000 7f7f9c4ba640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7f800a3460 0x7f7f800a5920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.523+0000 7f7f9c4ba640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f94112ae0 0x7f7f9419e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:27.526 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.523+0000 7f7f9c4ba640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f94074eb0 0x7f7f941a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.523+0000 7f7f9c4ba640 1 --2- 172.21.15.98:0/1662503622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f94074590 0x7f7f941a46b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.523+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/1662503622 >> 172.21.15.98:0/1662503622 conn(0x7f7f940fd7d0 msgr2=0x7f7f940feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.523+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/1662503622 shutdown_connections 2024-09-19T07:24:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:27.523+0000 7f7f9c4ba640 1 -- 172.21.15.98:0/1662503622 wait complete. 2024-09-19T07:24:28.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:27 smithi162 ceph-mon[35726]: pgmap v75: 97 pgs: 97 active+clean; 24 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 1.5 MiB/s wr, 101 op/s 2024-09-19T07:24:28.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:27 smithi098 ceph-mon[30950]: pgmap v75: 97 pgs: 97 active+clean; 24 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 1.5 MiB/s wr, 101 op/s 2024-09-19T07:24:28.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:27 smithi139 ceph-mon[35039]: pgmap v75: 97 pgs: 97 active+clean; 24 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 1.5 MiB/s wr, 101 op/s 2024-09-19T07:24:30.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:29 smithi162 ceph-mon[35726]: pgmap v76: 97 pgs: 97 active+clean; 22 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 686 op/s 2024-09-19T07:24:30.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:29 smithi098 ceph-mon[30950]: pgmap v76: 97 pgs: 97 active+clean; 22 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 686 op/s 2024-09-19T07:24:30.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:29 smithi139 ceph-mon[35039]: pgmap v76: 97 pgs: 97 active+clean; 22 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 686 op/s 2024-09-19T07:24:32.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:31 smithi162 ceph-mon[35726]: pgmap v77: 97 pgs: 97 active+clean; 22 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 1.1 MiB/s wr, 604 op/s 2024-09-19T07:24:32.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:31 smithi098 ceph-mon[30950]: pgmap v77: 97 pgs: 97 active+clean; 22 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 1.1 MiB/s wr, 604 op/s 2024-09-19T07:24:32.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:31 smithi139 ceph-mon[35039]: pgmap v77: 97 pgs: 97 active+clean; 22 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 1.1 MiB/s wr, 604 op/s 2024-09-19T07:24:33.480 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:24:33.786 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:34.129 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:33 smithi098 ceph-mon[30950]: pgmap v78: 97 pgs: 97 active+clean; 22 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 1.1 MiB/s wr, 604 op/s 2024-09-19T07:24:34.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:33 smithi162 ceph-mon[35726]: pgmap v78: 97 pgs: 97 active+clean; 22 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 1.1 MiB/s wr, 604 op/s 2024-09-19T07:24:34.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:33 smithi139 ceph-mon[35039]: pgmap v78: 97 pgs: 97 active+clean; 22 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 1.1 MiB/s wr, 604 op/s 2024-09-19T07:24:34.381 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.376+0000 7fc9a76e8640 1 -- 172.21.15.98:0/2982634463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a0103fe0 msgr2=0x7fc9a01043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:34.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.376+0000 7fc9a76e8640 1 --2- 172.21.15.98:0/2982634463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a0103fe0 0x7fc9a01043c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009900 tx=0x7fc99c02a410 comp rx=0 tx=0).stop 2024-09-19T07:24:34.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.376+0000 7fc9a76e8640 1 -- 172.21.15.98:0/2982634463 shutdown_connections 2024-09-19T07:24:34.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.376+0000 7fc9a76e8640 1 --2- 172.21.15.98:0/2982634463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9a0109110 0x7fc9a0110c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.376+0000 7fc9a76e8640 1 --2- 172.21.15.98:0/2982634463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a0104990 0x7fc9a01089e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.376+0000 7fc9a76e8640 1 --2- 172.21.15.98:0/2982634463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a0103fe0 0x7fc9a01043c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.376+0000 7fc9a76e8640 1 -- 172.21.15.98:0/2982634463 >> 172.21.15.98:0/2982634463 conn(0x7fc9a00ffa40 msgr2=0x7fc9a0101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:34.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.376+0000 7fc9a76e8640 1 -- 172.21.15.98:0/2982634463 shutdown_connections 2024-09-19T07:24:34.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.376+0000 7fc9a76e8640 1 -- 172.21.15.98:0/2982634463 wait complete. 2024-09-19T07:24:34.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.378+0000 7fc9a76e8640 1 Processor -- start 2024-09-19T07:24:34.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.378+0000 7fc9a76e8640 1 -- start start 2024-09-19T07:24:34.382 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.378+0000 7fc9a76e8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9a0103fe0 0x7fc9a019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.378+0000 7fc9a76e8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a0104990 0x7fc9a019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.378+0000 7fc9a76e8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a0109110 0x7fc9a019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.378+0000 7fc9a76e8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a0114160 con 0x7fc9a0104990 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.378+0000 7fc9a76e8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a0113fe0 con 0x7fc9a0109110 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.378+0000 7fc9a4c83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a0104990 0x7fc9a019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.378+0000 7fc9a4c83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a0104990 0x7fc9a019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36140/0 (socket says 172.21.15.98:36140) 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.378+0000 7fc9a4c83640 1 -- 172.21.15.98:0/297016209 learned_addr learned my addr 172.21.15.98:0/297016209 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.378+0000 7fc9a5484640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9a0103fe0 0x7fc9a019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.378+0000 7fc9a76e8640 1 -- 172.21.15.98:0/297016209 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01142e0 con 0x7fc9a0103fe0 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.379+0000 7fc9a5c85640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a0109110 0x7fc9a019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.379+0000 7fc9a4c83640 1 -- 172.21.15.98:0/297016209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9a0103fe0 msgr2=0x7fc9a019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.379+0000 7fc9a4c83640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9a0103fe0 0x7fc9a019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.383 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.379+0000 7fc9a4c83640 1 -- 172.21.15.98:0/297016209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a0109110 msgr2=0x7fc9a019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:34.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.379+0000 7fc9a4c83640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a0109110 0x7fc9a019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.379+0000 7fc9a4c83640 1 -- 172.21.15.98:0/297016209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a019f5f0 con 0x7fc9a0104990 2024-09-19T07:24:34.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.379+0000 7fc9a4c83640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a0104990 0x7fc9a019ab80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc99000e9f0 tx=0x7fc99000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:34.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.379+0000 7fc9967fc640 1 -- 172.21.15.98:0/297016209 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99000cd80 con 0x7fc9a0104990 2024-09-19T07:24:34.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.379+0000 7fc9967fc640 1 -- 172.21.15.98:0/297016209 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc990005500 con 0x7fc9a0104990 2024-09-19T07:24:34.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.380+0000 7fc9a76e8640 1 -- 172.21.15.98:0/297016209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a019f8e0 con 0x7fc9a0104990 2024-09-19T07:24:34.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.380+0000 7fc9967fc640 1 -- 172.21.15.98:0/297016209 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990010690 con 0x7fc9a0104990 2024-09-19T07:24:34.384 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.380+0000 7fc9a76e8640 1 -- 172.21.15.98:0/297016209 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a01a71c0 con 0x7fc9a0104990 2024-09-19T07:24:34.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.382+0000 7fc9967fc640 1 -- 172.21.15.98:0/297016209 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc990010830 con 0x7fc9a0104990 2024-09-19T07:24:34.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.383+0000 7fc9a9ac1740 1 Processor -- start 2024-09-19T07:24:34.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.383+0000 7fc9a9ac1740 1 -- start start 2024-09-19T07:24:34.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.383+0000 7fc9a9ac1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab134a0 0x55ca3ab13880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.383+0000 7fc9a9ac1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.383+0000 7fc9a9ac1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab1e680 0x55ca3ab20a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.383+0000 7fc9a9ac1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ca3aa792e0 con 0x55ca3ab13dc0 2024-09-19T07:24:34.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.383+0000 7fc9a9ac1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ca3aa20ce0 con 0x55ca3ab134a0 2024-09-19T07:24:34.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.383+0000 7fc9a9ac1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ca3aa752a0 con 0x55ca3ab1e680 2024-09-19T07:24:34.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.384+0000 7fc9a5484640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.384+0000 7fc9a5484640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36150/0 (socket says 172.21.15.98:36150) 2024-09-19T07:24:34.386 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.384+0000 7fc9a4c83640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab1e680 0x55ca3ab20a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.384+0000 7fc9a5484640 1 -- 172.21.15.98:0/3718937920 learned_addr learned my addr 172.21.15.98:0/3718937920 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:34.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.384+0000 7fc9a5c85640 1 --2- 172.21.15.98:0/3718937920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab134a0 0x55ca3ab13880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.384+0000 7fc9967fc640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc98c0a3430 0x7fc98c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.384+0000 7fc9a5484640 1 -- 172.21.15.98:0/3718937920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab1e680 msgr2=0x55ca3ab20a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:34.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.384+0000 7fc9a5484640 1 --2- 172.21.15.98:0/3718937920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab1e680 0x55ca3ab20a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.384+0000 7fc9a5484640 1 -- 172.21.15.98:0/3718937920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab134a0 msgr2=0x55ca3ab13880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:34.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.384+0000 7fc9a5484640 1 --2- 172.21.15.98:0/3718937920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab134a0 0x55ca3ab13880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.384+0000 7fc9a5484640 1 -- 172.21.15.98:0/3718937920 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3aa05440 con 0x55ca3ab13dc0 2024-09-19T07:24:34.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.384+0000 7fc9967fc640 1 -- 172.21.15.98:0/297016209 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc9900d0140 con 0x7fc9a0104990 2024-09-19T07:24:34.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.385+0000 7fc9a5c85640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc98c0a3430 0x7fc98c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.388 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.385+0000 7fc9a5484640 1 --2- 172.21.15.98:0/3718937920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1e140 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009900 tx=0x7fc99c005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb1cc48a4f0d774 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:34.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.385+0000 7fc9a5c85640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc98c0a3430 0x7fc98c0a58f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc998005c40 tx=0x7fc998004ab0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:34.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.385+0000 7fc98b7fe640 1 -- 172.21.15.98:0/3718937920 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c040070 con 0x55ca3ab13dc0 2024-09-19T07:24:34.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.385+0000 7fc98b7fe640 1 -- 172.21.15.98:0/3718937920 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc99c031870 con 0x55ca3ab13dc0 2024-09-19T07:24:34.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.385+0000 7fc98b7fe640 1 -- 172.21.15.98:0/3718937920 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c035040 con 0x55ca3ab13dc0 2024-09-19T07:24:34.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.386+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3718937920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 msgr2=0x55ca3ab1e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:34.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.386+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/3718937920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1e140 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009900 tx=0x7fc99c005be0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.386+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3718937920 shutdown_connections 2024-09-19T07:24:34.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.386+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/3718937920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab1e680 0x55ca3ab20a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.386+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/3718937920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1e140 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.386+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/3718937920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab134a0 0x55ca3ab13880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.386+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3718937920 >> 172.21.15.98:0/3718937920 conn(0x55ca3ab0fa30 msgr2=0x55ca3ab0fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:34.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.387+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3718937920 shutdown_connections 2024-09-19T07:24:34.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.387+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3718937920 wait complete. 2024-09-19T07:24:34.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.387+0000 7fc9a9ac1740 1 -- start start 2024-09-19T07:24:34.390 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.387+0000 7fc9a9ac1740 1 Processor -- start 2024-09-19T07:24:34.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a9ac1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab134a0 0x55ca3ab1df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a9ac1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a9ac1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab1e680 0x55ca3ab1b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a9ac1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ca3ab21250 con 0x55ca3ab134a0 2024-09-19T07:24:34.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a9ac1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ca3aa34050 con 0x55ca3ab1e680 2024-09-19T07:24:34.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a9ac1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ca3ab213d0 con 0x55ca3ab13dc0 2024-09-19T07:24:34.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a4c83640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a9ac1740 10 client.0 _ll_register_callbacks cb 0x55ca3aa74160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:34.393 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a4c83640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:32912/0 (socket says 172.21.15.98:32912) 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a4c83640 1 -- 172.21.15.98:0/1320036380 learned_addr learned my addr 172.21.15.98:0/1320036380 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a5c85640 1 --2- 172.21.15.98:0/1320036380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab1e680 0x55ca3ab1b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a4c83640 1 -- 172.21.15.98:0/1320036380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab1e680 msgr2=0x55ca3ab1b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a4c83640 1 --2- 172.21.15.98:0/1320036380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab1e680 0x55ca3ab1b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a4c83640 1 -- 172.21.15.98:0/1320036380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab134a0 msgr2=0x55ca3ab1df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a4c83640 1 --2- 172.21.15.98:0/1320036380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab134a0 0x55ca3ab1df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a4c83640 1 -- 172.21.15.98:0/1320036380 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3a7ea3c0 con 0x55ca3ab13dc0 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc9a4c83640 1 --2- 172.21.15.98:0/1320036380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1b230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c6a0 tx=0x7fc990004ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9c2e4cb2d6db52f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.388+0000 7fc988ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.389+0000 7fc988ff9640 1 -- 172.21.15.98:0/1320036380 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99009bcf0 con 0x55ca3ab13dc0 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.389+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/1320036380 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc99c031870 con 0x55ca3ab13dc0 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.389+0000 7fc988ff9640 1 -- 172.21.15.98:0/1320036380 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc9900cda80 con 0x55ca3ab13dc0 2024-09-19T07:24:34.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.389+0000 7fc988ff9640 1 -- 172.21.15.98:0/1320036380 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc9900cdc80 con 0x55ca3ab13dc0 2024-09-19T07:24:34.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.389+0000 7fc9a9ac1740 10 client.25411 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:34.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.389+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/1320036380 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ca3ab2cc40 con 0x55ca3ab13dc0 2024-09-19T07:24:34.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.389+0000 7fc988ff9640 1 -- 172.21.15.98:0/1320036380 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc99c031870 con 0x55ca3ab13dc0 2024-09-19T07:24:34.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.389+0000 7fc988ff9640 1 -- 172.21.15.98:0/1320036380 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fc9900a4b70 con 0x55ca3ab13dc0 2024-09-19T07:24:34.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.389+0000 7fc9a9ac1740 10 client.25411 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:34.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.389+0000 7fc9a9ac1740 10 client.25411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:34.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.389+0000 7fc9a9ac1740 20 client.25411 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:34.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.389+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/1320036380 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ca3ab2e5e0 0x55ca3ab30aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.390+0000 7fc9a9ac1740 4 client.25411 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:34.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.390+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/1320036380 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca3aa86850 con 0x55ca3ab2e5e0 2024-09-19T07:24:34.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.390+0000 7fc9a5484640 1 --2- 172.21.15.98:0/1320036380 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ca3ab2e5e0 0x55ca3ab30aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.391+0000 7fc988ff9640 10 client.25411 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:34.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.391+0000 7fc9a5484640 1 --2- 172.21.15.98:0/1320036380 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ca3ab2e5e0 0x55ca3ab30aa0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65393ea18d9c7c8 server_cookie=777e251b97758f43 in_seq=0 out_seq=0 2024-09-19T07:24:34.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc988ff9640 1 -- 172.21.15.98:0/1320036380 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca3aa86850 con 0x55ca3ab2e5e0 2024-09-19T07:24:34.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc988ff9640 10 client.25411 handle_command_reply: tid=0 2024-09-19T07:24:34.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc9a9ac1740 1 client.25411 shutdown 2024-09-19T07:24:34.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/1320036380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab13dc0 msgr2=0x55ca3ab1b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:34.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/1320036380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1b230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c6a0 tx=0x7fc990004ba0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/1320036380 shutdown_connections 2024-09-19T07:24:34.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/1320036380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab1e680 0x55ca3ab1b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/1320036380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1b230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/1320036380 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ca3ab2e5e0 0x55ca3ab30aa0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/1320036380 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab134a0 0x55ca3ab1df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/1320036380 >> 172.21.15.98:0/1320036380 conn(0x55ca3ab0fa30 msgr2=0x55ca3ab15760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:34.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc988ff9640 0 client.25411 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:34.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/1320036380 shutdown_connections 2024-09-19T07:24:34.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.394+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/1320036380 wait complete. 2024-09-19T07:24:34.398 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.395+0000 7fc9a9ac1740 20 client.25411 trim_cache size 0 max 16384 2024-09-19T07:24:34.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.415+0000 7fc9a9ac1740 1 Processor -- start 2024-09-19T07:24:34.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.415+0000 7fc9a9ac1740 1 -- start start 2024-09-19T07:24:34.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.415+0000 7fc9a9ac1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab134a0 0x55ca3ab19b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a9ac1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.424 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a9ac1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab1e680 0x55ca3ab363b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a9ac1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01b2370 con 0x55ca3ab13dc0 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a9ac1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01afc40 con 0x55ca3ab1e680 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a9ac1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01ada90 con 0x55ca3ab134a0 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a4c83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a4c83640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36170/0 (socket says 172.21.15.98:36170) 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a4c83640 1 -- 172.21.15.98:0/2998308357 learned_addr learned my addr 172.21.15.98:0/2998308357 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a5c85640 1 --2- 172.21.15.98:0/2998308357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab1e680 0x55ca3ab363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a5484640 1 --2- 172.21.15.98:0/2998308357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab134a0 0x55ca3ab19b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a4c83640 1 -- 172.21.15.98:0/2998308357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab134a0 msgr2=0x55ca3ab19b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a4c83640 1 --2- 172.21.15.98:0/2998308357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab134a0 0x55ca3ab19b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a4c83640 1 -- 172.21.15.98:0/2998308357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab1e680 msgr2=0x55ca3ab363b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a4c83640 1 --2- 172.21.15.98:0/2998308357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab1e680 0x55ca3ab363b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.425 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a4c83640 1 -- 172.21.15.98:0/2998308357 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3ab1a1e0 con 0x55ca3ab13dc0 2024-09-19T07:24:34.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc9a4c83640 1 --2- 172.21.15.98:0/2998308357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1d1a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc99009a640 tx=0x7fc9900b5370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ad9b47b2a52f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:34.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc98affd640 1 -- 172.21.15.98:0/2998308357 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99009c160 con 0x55ca3ab13dc0 2024-09-19T07:24:34.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc98affd640 1 -- 172.21.15.98:0/2998308357 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9900a5000 con 0x55ca3ab13dc0 2024-09-19T07:24:34.426 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.416+0000 7fc98affd640 1 -- 172.21.15.98:0/2998308357 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99009b7e0 con 0x55ca3ab13dc0 2024-09-19T07:24:34.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.417+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/2998308357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 msgr2=0x55ca3ab1d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:34.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.417+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/2998308357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1d1a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc99009a640 tx=0x7fc9900b5370 comp rx=0 tx=0).stop 2024-09-19T07:24:34.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.417+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/2998308357 shutdown_connections 2024-09-19T07:24:34.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.417+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/2998308357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab1e680 0x55ca3ab363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.417+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/2998308357 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab1d1a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.417+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/2998308357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab134a0 0x55ca3ab19b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.417+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/2998308357 >> 172.21.15.98:0/2998308357 conn(0x55ca3ab0fa30 msgr2=0x55ca3ab1ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:34.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.417+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/2998308357 shutdown_connections 2024-09-19T07:24:34.430 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.417+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/2998308357 wait complete. 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.418+0000 7fc9a9ac1740 1 -- start start 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.418+0000 7fc9a9ac1740 1 Processor -- start 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.418+0000 7fc9a9ac1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab134a0 0x55ca3ab26a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.418+0000 7fc9a9ac1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab26f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.418+0000 7fc9a9ac1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab1e680 0x55ca3ab23fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.418+0000 7fc9a9ac1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01ae100 con 0x55ca3ab1e680 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.418+0000 7fc9a9ac1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01af570 con 0x55ca3ab13dc0 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.418+0000 7fc9a9ac1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a01ae7d0 con 0x55ca3ab134a0 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.418+0000 7fc9a9ac1740 10 client.0 _ll_register_callbacks cb 0x7fc9900d38e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a5c85640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab1e680 0x55ca3ab23fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a5c85640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab1e680 0x55ca3ab23fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36178/0 (socket says 172.21.15.98:36178) 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a4c83640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab26f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.431 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a5c85640 1 -- 172.21.15.98:0/3955253542 learned_addr learned my addr 172.21.15.98:0/3955253542 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a5484640 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab134a0 0x55ca3ab26a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a5484640 1 -- 172.21.15.98:0/3955253542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab13dc0 msgr2=0x55ca3ab26f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a5484640 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab26f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a5484640 1 -- 172.21.15.98:0/3955253542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab1e680 msgr2=0x55ca3ab23fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a5484640 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab1e680 0x55ca3ab23fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a5484640 1 -- 172.21.15.98:0/3955253542 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3ab13bf0 con 0x55ca3ab134a0 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a4c83640 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab26f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a5c85640 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab1e680 0x55ca3ab23fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a5484640 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab134a0 0x55ca3ab26a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc99c02a930 tx=0x7fc99c005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72eb703eb2802bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc988ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc988ff9640 1 -- 172.21.15.98:0/3955253542 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c051070 con 0x55ca3ab134a0 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc988ff9640 1 -- 172.21.15.98:0/3955253542 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc99c004040 con 0x55ca3ab134a0 2024-09-19T07:24:34.432 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.419+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3955253542 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ca3aa80d60 con 0x55ca3ab134a0 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.420+0000 7fc988ff9640 1 -- 172.21.15.98:0/3955253542 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc99c05d050 con 0x55ca3ab134a0 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.420+0000 7fc9a9ac1740 10 client.25417 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.420+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3955253542 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ca3ab98e80 con 0x55ca3ab134a0 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.420+0000 7fc988ff9640 1 -- 172.21.15.98:0/3955253542 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ca3aa80d60 con 0x55ca3ab134a0 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.420+0000 7fc988ff9640 1 -- 172.21.15.98:0/3955253542 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fc99c003c60 con 0x55ca3ab134a0 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.420+0000 7fc9a9ac1740 10 client.25417 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.420+0000 7fc9a9ac1740 10 client.25417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.420+0000 7fc9a9ac1740 20 client.25417 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.420+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ca3ab99110 0x55ca3ab9b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.420+0000 7fc9a9ac1740 4 client.25417 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.420+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3955253542 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ca3a9fd210 con 0x55ca3ab99110 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.420+0000 7fc9a4c83640 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ca3ab99110 0x55ca3ab9b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:34.433 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.421+0000 7fc988ff9640 10 client.25417 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.421+0000 7fc9a4c83640 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ca3ab99110 0x55ca3ab9b500 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=405e5462e075e03 server_cookie=2d99b1f8d4808f0d in_seq=0 out_seq=0 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.422+0000 7fc988ff9640 1 -- 172.21.15.98:0/3955253542 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ca3a9fd210 con 0x55ca3ab99110 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.422+0000 7fc988ff9640 10 client.25417 handle_command_reply: tid=0 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.422+0000 7fc9a9ac1740 1 client.25417 shutdown 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.422+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3955253542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab134a0 msgr2=0x55ca3ab26a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab134a0 0x55ca3ab26a30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc99c02a930 tx=0x7fc99c005be0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3955253542 shutdown_connections 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ca3ab99110 0x55ca3ab9b500 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ca3ab1e680 0x55ca3ab23fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ca3ab13dc0 0x55ca3ab26f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc988ff9640 0 client.25417 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a9ac1740 1 --2- 172.21.15.98:0/3955253542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca3ab134a0 0x55ca3ab26a30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.434 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3955253542 >> 172.21.15.98:0/3955253542 conn(0x55ca3ab0fa30 msgr2=0x55ca3ab0e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:34.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3955253542 shutdown_connections 2024-09-19T07:24:34.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a9ac1740 1 -- 172.21.15.98:0/3955253542 wait complete. 2024-09-19T07:24:34.435 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a9ac1740 20 client.25417 trim_cache size 0 max 16384 2024-09-19T07:24:34.435 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:24:34.435 INFO:teuthology.orchestra.run.smithi098.stdout: "status": "no active scrubs running", 2024-09-19T07:24:34.435 INFO:teuthology.orchestra.run.smithi098.stdout: "scrubs": {} 2024-09-19T07:24:34.436 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:24:34.436 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a76e8640 1 -- 172.21.15.98:0/297016209 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc98c0a3430 msgr2=0x7fc98c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:34.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a76e8640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc98c0a3430 0x7fc98c0a58f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc998005c40 tx=0x7fc998004ab0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a76e8640 1 -- 172.21.15.98:0/297016209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a0104990 msgr2=0x7fc9a019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:34.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.423+0000 7fc9a76e8640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a0104990 0x7fc9a019ab80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc99000e9f0 tx=0x7fc99000edf0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.424+0000 7fc9a76e8640 1 -- 172.21.15.98:0/297016209 shutdown_connections 2024-09-19T07:24:34.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.424+0000 7fc9a76e8640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc98c0a3430 0x7fc98c0a58f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.424+0000 7fc9a76e8640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc9a0109110 0x7fc9a019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.424+0000 7fc9a76e8640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc9a0104990 0x7fc9a019ab80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.424+0000 7fc9a76e8640 1 --2- 172.21.15.98:0/297016209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9a0103fe0 0x7fc9a019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:34.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.424+0000 7fc9a76e8640 1 -- 172.21.15.98:0/297016209 >> 172.21.15.98:0/297016209 conn(0x7fc9a00ffa40 msgr2=0x7fc9a0100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:34.437 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.424+0000 7fc9a76e8640 1 -- 172.21.15.98:0/297016209 shutdown_connections 2024-09-19T07:24:34.438 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:34.424+0000 7fc9a76e8640 1 -- 172.21.15.98:0/297016209 wait complete. 2024-09-19T07:24:35.162 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:24:35.162 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:24:35.413 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:35.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.910+0000 7f1ba14b8640 1 -- 172.21.15.98:0/2340330478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b9c102ef0 msgr2=0x7f1b9c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:35.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.910+0000 7f1ba14b8640 1 --2- 172.21.15.98:0/2340330478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b9c102ef0 0x7f1b9c10da40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c009900 tx=0x7f1b8c02a480 comp rx=0 tx=0).stop 2024-09-19T07:24:35.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.910+0000 7f1ba14b8640 1 -- 172.21.15.98:0/2340330478 shutdown_connections 2024-09-19T07:24:35.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.910+0000 7f1ba14b8640 1 --2- 172.21.15.98:0/2340330478 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b9c102ef0 0x7f1b9c10da40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.910+0000 7f1ba14b8640 1 --2- 172.21.15.98:0/2340330478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b9c102570 0x7f1b9c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.910+0000 7f1ba14b8640 1 --2- 172.21.15.98:0/2340330478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b9c100e20 0x7f1b9c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.910+0000 7f1ba14b8640 1 -- 172.21.15.98:0/2340330478 >> 172.21.15.98:0/2340330478 conn(0x7f1b9c0fc7d0 msgr2=0x7f1b9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:35.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.910+0000 7f1ba14b8640 1 -- 172.21.15.98:0/2340330478 shutdown_connections 2024-09-19T07:24:35.957 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.910+0000 7f1ba14b8640 1 -- 172.21.15.98:0/2340330478 wait complete. 2024-09-19T07:24:35.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.910+0000 7f1ba14b8640 1 Processor -- start 2024-09-19T07:24:35.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.910+0000 7f1ba14b8640 1 -- start start 2024-09-19T07:24:35.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1ba14b8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b9c100e20 0x7f1b9c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1ba14b8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b9c102570 0x7f1b9c197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1ba14b8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b9c102ef0 0x7f1b9c197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1ba14b8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c110f80 con 0x7f1b9c100e20 2024-09-19T07:24:35.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1ba14b8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c110e00 con 0x7f1b9c102570 2024-09-19T07:24:35.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1ba14b8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c111100 con 0x7f1b9c102ef0 2024-09-19T07:24:35.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b9affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b9c100e20 0x7f1b9c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b9affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b9c100e20 0x7f1b9c1971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36192/0 (socket says 172.21.15.98:36192) 2024-09-19T07:24:35.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b9affd640 1 -- 172.21.15.98:0/1299721875 learned_addr learned my addr 172.21.15.98:0/1299721875 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:35.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b9a7fc640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b9c102570 0x7f1b9c197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b9b7fe640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b9c102ef0 0x7f1b9c197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b9affd640 1 -- 172.21.15.98:0/1299721875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b9c102ef0 msgr2=0x7f1b9c197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:35.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b9affd640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b9c102ef0 0x7f1b9c197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b9affd640 1 -- 172.21.15.98:0/1299721875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b9c102570 msgr2=0x7f1b9c197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:35.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b9affd640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b9c102570 0x7f1b9c197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:35.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b9affd640 1 -- 172.21.15.98:0/1299721875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9c1a6a30 con 0x7f1b9c100e20 2024-09-19T07:24:35.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b9b7fe640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b9c102ef0 0x7f1b9c197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:35.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b9affd640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b9c100e20 0x7f1b9c1971c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400eb90 tx=0x7f1b9400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:35.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b83fff640 1 -- 172.21.15.98:0/1299721875 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94004d20 con 0x7f1b9c100e20 2024-09-19T07:24:35.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1ba14b8640 1 -- 172.21.15.98:0/1299721875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b9c1a6d20 con 0x7f1b9c100e20 2024-09-19T07:24:35.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b83fff640 1 -- 172.21.15.98:0/1299721875 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b9400ee90 con 0x7f1b9c100e20 2024-09-19T07:24:35.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1b83fff640 1 -- 172.21.15.98:0/1299721875 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b94010830 con 0x7f1b9c100e20 2024-09-19T07:24:35.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.911+0000 7f1ba14b8640 1 -- 172.21.15.98:0/1299721875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b9c1a7200 con 0x7f1b9c100e20 2024-09-19T07:24:35.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.913+0000 7f1ba14b8640 1 -- 172.21.15.98:0/1299721875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b9c101200 con 0x7f1b9c100e20 2024-09-19T07:24:35.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.914+0000 7f1b83fff640 1 -- 172.21.15.98:0/1299721875 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1b94005020 con 0x7f1b9c100e20 2024-09-19T07:24:35.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.915+0000 7f1b83fff640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f1b840a33b0 0x7f1b840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:35.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.915+0000 7f1b9a7fc640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f1b840a33b0 0x7f1b840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:35.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.915+0000 7f1b83fff640 1 -- 172.21.15.98:0/1299721875 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f1b940d0490 con 0x7f1b9c100e20 2024-09-19T07:24:35.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.915+0000 7f1b9a7fc640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f1b840a33b0 0x7f1b840a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c06a7f0 tx=0x7f1b90005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:35.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:35.919+0000 7f1b83fff640 1 -- 172.21.15.98:0/1299721875 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b9409cde0 con 0x7f1b9c100e20 2024-09-19T07:24:36.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.129+0000 7f1ba14b8640 1 -- 172.21.15.98:0/1299721875 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b9c02d7c0 con 0x7f1b9c100e20 2024-09-19T07:24:36.131 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:35 smithi098 ceph-mon[30950]: pgmap v79: 97 pgs: 97 active+clean; 49 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 932 op/s 2024-09-19T07:24:36.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.129+0000 7f1b83fff640 1 -- 172.21.15.98:0/1299721875 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11920 (secure 0 0 0) 0x7f1b9409c6e0 con 0x7f1b9c100e20 2024-09-19T07:24:36.132 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:24:36.132 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":25,"btime":"2024-09-19T07:24:20:946183+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:24:20.895949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24442,24458,24479]},"id":1}]} 2024-09-19T07:24:36.132 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 25 2024-09-19T07:24:36.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:35 smithi162 ceph-mon[35726]: pgmap v79: 97 pgs: 97 active+clean; 49 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 932 op/s 2024-09-19T07:24:36.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.132+0000 7f1ba14b8640 1 -- 172.21.15.98:0/1299721875 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f1b840a33b0 msgr2=0x7f1b840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:36.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.133+0000 7f1ba14b8640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f1b840a33b0 0x7f1b840a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c06a7f0 tx=0x7f1b90005f90 comp rx=0 tx=0).stop 2024-09-19T07:24:36.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.133+0000 7f1ba14b8640 1 -- 172.21.15.98:0/1299721875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b9c100e20 msgr2=0x7f1b9c1971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:36.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.133+0000 7f1ba14b8640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b9c100e20 0x7f1b9c1971c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1b9400eb90 tx=0x7f1b9400c6a0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.133+0000 7f1ba14b8640 1 -- 172.21.15.98:0/1299721875 shutdown_connections 2024-09-19T07:24:36.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.133+0000 7f1ba14b8640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f1b840a33b0 0x7f1b840a5870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.133+0000 7f1ba14b8640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1b9c102ef0 0x7f1b9c197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.133+0000 7f1ba14b8640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b9c102570 0x7f1b9c197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.133+0000 7f1ba14b8640 1 --2- 172.21.15.98:0/1299721875 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1b9c100e20 0x7f1b9c1971c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:36.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.133+0000 7f1ba14b8640 1 -- 172.21.15.98:0/1299721875 >> 172.21.15.98:0/1299721875 conn(0x7f1b9c0fc7d0 msgr2=0x7f1b9c1068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:36.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.133+0000 7f1ba14b8640 1 -- 172.21.15.98:0/1299721875 shutdown_connections 2024-09-19T07:24:36.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:36.133+0000 7f1ba14b8640 1 -- 172.21.15.98:0/1299721875 wait complete. 2024-09-19T07:24:36.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:35 smithi139 ceph-mon[35039]: pgmap v79: 97 pgs: 97 active+clean; 49 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 932 op/s 2024-09-19T07:24:37.005 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:24:37.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:36 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1299721875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:37.257 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:37.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:36 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1299721875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:37.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:36 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1299721875' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:24:37.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.707+0000 7f7eeafd8640 1 -- 172.21.15.98:0/546825409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ee4109120 msgr2=0x7f7ee4110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.707+0000 7f7eeafd8640 1 --2- 172.21.15.98:0/546825409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ee4109120 0x7f7ee4110ca0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009900 tx=0x7f7edc02a410 comp rx=0 tx=0).stop 2024-09-19T07:24:37.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.707+0000 7f7eeafd8640 1 -- 172.21.15.98:0/546825409 shutdown_connections 2024-09-19T07:24:37.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.707+0000 7f7eeafd8640 1 --2- 172.21.15.98:0/546825409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ee4109120 0x7f7ee4110ca0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.707+0000 7f7eeafd8640 1 --2- 172.21.15.98:0/546825409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee41049a0 0x7f7ee41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.707+0000 7f7eeafd8640 1 --2- 172.21.15.98:0/546825409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ee4103ff0 0x7f7ee41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.707+0000 7f7eeafd8640 1 -- 172.21.15.98:0/546825409 >> 172.21.15.98:0/546825409 conn(0x7f7ee40ffab0 msgr2=0x7f7ee4101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.707+0000 7f7eeafd8640 1 -- 172.21.15.98:0/546825409 shutdown_connections 2024-09-19T07:24:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.707+0000 7f7eeafd8640 1 -- 172.21.15.98:0/546825409 wait complete. 2024-09-19T07:24:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.708+0000 7f7eeafd8640 1 Processor -- start 2024-09-19T07:24:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.708+0000 7f7eeafd8640 1 -- start start 2024-09-19T07:24:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.708+0000 7f7eeafd8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee4103ff0 0x7f7ee419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.708+0000 7f7eeafd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ee41049a0 0x7f7ee419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.708+0000 7f7eeafd8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ee4109120 0x7f7ee419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.708+0000 7f7eeafd8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee4114150 con 0x7f7ee4109120 2024-09-19T07:24:37.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.708+0000 7f7eeafd8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee4113fd0 con 0x7f7ee4103ff0 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.708+0000 7f7eeafd8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41142d0 con 0x7f7ee41049a0 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.708+0000 7f7ee8d74640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee4103ff0 0x7f7ee419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ee9575640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ee4109120 0x7f7ee419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ee9575640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ee4109120 0x7f7ee419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36208/0 (socket says 172.21.15.98:36208) 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ee9575640 1 -- 172.21.15.98:0/1184182452 learned_addr learned my addr 172.21.15.98:0/1184182452 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ee8d74640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee4103ff0 0x7f7ee419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:60346/0 (socket says 172.21.15.98:60346) 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7edbfff640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ee41049a0 0x7f7ee419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ee8d74640 1 -- 172.21.15.98:0/1184182452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ee41049a0 msgr2=0x7f7ee419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ee8d74640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ee41049a0 0x7f7ee419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ee8d74640 1 -- 172.21.15.98:0/1184182452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ee4109120 msgr2=0x7f7ee419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ee8d74640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ee4109120 0x7f7ee419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ee8d74640 1 -- 172.21.15.98:0/1184182452 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee419f660 con 0x7f7ee4103ff0 2024-09-19T07:24:37.733 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ee9575640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ee4109120 0x7f7ee419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ee8d74640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee4103ff0 0x7f7ee419a6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000cad0 tx=0x7f7ee000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ed9ffb640 1 -- 172.21.15.98:0/1184182452 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0007df0 con 0x7f7ee4103ff0 2024-09-19T07:24:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ed9ffb640 1 -- 172.21.15.98:0/1184182452 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ee0005020 con 0x7f7ee4103ff0 2024-09-19T07:24:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7ed9ffb640 1 -- 172.21.15.98:0/1184182452 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000f780 con 0x7f7ee4103ff0 2024-09-19T07:24:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.709+0000 7f7eeafd8640 1 -- 172.21.15.98:0/1184182452 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee419f950 con 0x7f7ee4103ff0 2024-09-19T07:24:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.710+0000 7f7eeafd8640 1 -- 172.21.15.98:0/1184182452 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee41a7230 con 0x7f7ee4103ff0 2024-09-19T07:24:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.712+0000 7f7ed9ffb640 1 -- 172.21.15.98:0/1184182452 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7ee00051d0 con 0x7f7ee4103ff0 2024-09-19T07:24:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.712+0000 7f7eed3b1740 1 Processor -- start 2024-09-19T07:24:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.712+0000 7f7eed3b1740 1 -- start start 2024-09-19T07:24:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.712+0000 7f7eed3b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d70212a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.712+0000 7f7eed3b1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212a5d0 0x55d70212aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.734 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.712+0000 7f7eed3b1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d702135370 0x55d702137760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.712+0000 7f7eed3b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d7020902f0 con 0x55d70212bb40 2024-09-19T07:24:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.712+0000 7f7eed3b1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d702037cf0 con 0x55d70212a5d0 2024-09-19T07:24:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.712+0000 7f7eed3b1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d70208c2b0 con 0x55d702135370 2024-09-19T07:24:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.712+0000 7f7ee9575640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d70212a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ee9575640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d70212a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36210/0 (socket says 172.21.15.98:36210) 2024-09-19T07:24:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ee9575640 1 -- 172.21.15.98:0/239790105 learned_addr learned my addr 172.21.15.98:0/239790105 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ee8d74640 1 --2- 172.21.15.98:0/239790105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212a5d0 0x55d70212aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7edbfff640 1 --2- 172.21.15.98:0/239790105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d702135370 0x55d702137760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ed9ffb640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7ecc0a33b0 0x7f7ecc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ee9575640 1 -- 172.21.15.98:0/239790105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d702135370 msgr2=0x55d702137760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:37.735 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ee9575640 1 --2- 172.21.15.98:0/239790105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d702135370 0x55d702137760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ee9575640 1 -- 172.21.15.98:0/239790105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212a5d0 msgr2=0x55d70212aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:37.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ee9575640 1 --2- 172.21.15.98:0/239790105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212a5d0 0x55d70212aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ee9575640 1 -- 172.21.15.98:0/239790105 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d70201c3a0 con 0x55d70212bb40 2024-09-19T07:24:37.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ee8d74640 1 --2- 172.21.15.98:0/239790105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212a5d0 0x55d70212aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:37.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ed9ffb640 1 -- 172.21.15.98:0/1184182452 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f7ee00cfff0 con 0x7f7ee4103ff0 2024-09-19T07:24:37.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7edbfff640 1 --2- 172.21.15.98:0/239790105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d702135370 0x55d702137760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:37.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ee9575640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7ecc0a33b0 0x7f7ecc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ee9575640 1 --2- 172.21.15.98:0/239790105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d70212a090 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7edc031680 tx=0x7f7edc0316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2ec5089e5c6571 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:37.736 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ecaffd640 1 -- 172.21.15.98:0/239790105 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc04d070 con 0x55d70212bb40 2024-09-19T07:24:37.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ecaffd640 1 -- 172.21.15.98:0/239790105 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7edc003ad0 con 0x55d70212bb40 2024-09-19T07:24:37.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.713+0000 7f7ecaffd640 1 -- 172.21.15.98:0/239790105 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc035040 con 0x55d70212bb40 2024-09-19T07:24:37.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.714+0000 7f7eed3b1740 1 -- 172.21.15.98:0/239790105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 msgr2=0x55d70212a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.714+0000 7f7ee9575640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7ecc0a33b0 0x7f7ecc0a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7edc04a000 tx=0x7f7edc047000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:37.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.714+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/239790105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d70212a090 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7edc031680 tx=0x7f7edc0316b0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.714+0000 7f7eed3b1740 1 -- 172.21.15.98:0/239790105 shutdown_connections 2024-09-19T07:24:37.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.714+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/239790105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d702135370 0x55d702137760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.714+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/239790105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212a5d0 0x55d70212aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.714+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/239790105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d70212a090 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.714+0000 7f7eed3b1740 1 -- 172.21.15.98:0/239790105 >> 172.21.15.98:0/239790105 conn(0x55d7020f3310 msgr2=0x55d702126c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:37.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.714+0000 7f7eed3b1740 1 -- 172.21.15.98:0/239790105 shutdown_connections 2024-09-19T07:24:37.737 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.714+0000 7f7eed3b1740 1 -- 172.21.15.98:0/239790105 wait complete. 2024-09-19T07:24:37.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7eed3b1740 1 -- start start 2024-09-19T07:24:37.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7eed3b1740 1 Processor -- start 2024-09-19T07:24:37.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7eed3b1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 0x55d702134d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7eed3b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d702132000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7eed3b1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d702135370 0x55d7021325d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7eed3b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d702138070 con 0x55d70212bb40 2024-09-19T07:24:37.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7eed3b1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d70204b060 con 0x55d702135370 2024-09-19T07:24:37.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7eed3b1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d7021381f0 con 0x55d70212a5d0 2024-09-19T07:24:37.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7eed3b1740 10 client.0 _ll_register_callbacks cb 0x55d701d9e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:37.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7edbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d702132000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7ee9575640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d702135370 0x55d7021325d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7edbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d702132000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36224/0 (socket says 172.21.15.98:36224) 2024-09-19T07:24:37.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7edbfff640 1 -- 172.21.15.98:0/1604724235 learned_addr learned my addr 172.21.15.98:0/1604724235 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:37.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.715+0000 7f7ee8d74640 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 0x55d702134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7ee9575640 1 -- 172.21.15.98:0/1604724235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 msgr2=0x55d702134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:37.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7ee9575640 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 0x55d702134d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7ee9575640 1 -- 172.21.15.98:0/1604724235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 msgr2=0x55d702132000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:37.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7ee9575640 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d702132000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7ee9575640 1 -- 172.21.15.98:0/1604724235 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d701e013c0 con 0x55d702135370 2024-09-19T07:24:37.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7edbfff640 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d702132000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:37.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7ee9575640 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d702135370 0x55d7021325d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7edc031960 tx=0x7f7edc047690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2dfcb7399e670e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:37.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7ec3fff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-19T07:24:37.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7ec3fff640 1 -- 172.21.15.98:0/1604724235 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc04d070 con 0x55d702135370 2024-09-19T07:24:37.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7ec3fff640 1 -- 172.21.15.98:0/1604724235 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f7edc0035f0 con 0x55d702135370 2024-09-19T07:24:37.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7eed3b1740 1 -- 172.21.15.98:0/1604724235 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7edc003ad0 con 0x55d702135370 2024-09-19T07:24:37.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7ec3fff640 1 -- 172.21.15.98:0/1604724235 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7edc003e90 con 0x55d702135370 2024-09-19T07:24:37.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7eed3b1740 10 client.25463 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:37.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7eed3b1740 1 -- 172.21.15.98:0/1604724235 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d702138070 con 0x55d702135370 2024-09-19T07:24:37.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.716+0000 7f7ec3fff640 1 -- 172.21.15.98:0/1604724235 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7edc003ad0 con 0x55d702135370 2024-09-19T07:24:37.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.717+0000 7f7ec3fff640 1 -- 172.21.15.98:0/1604724235 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7edc061070 con 0x55d702135370 2024-09-19T07:24:37.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.717+0000 7f7eed3b1740 10 client.25463 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:37.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.717+0000 7f7eed3b1740 10 client.25463 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T07:24:37.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.717+0000 7f7eed3b1740 20 client.25463 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:37.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.717+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55d702144c70 0x55d702147060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.717+0000 7f7eed3b1740 4 client.25463 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:37.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.717+0000 7f7eed3b1740 1 -- 172.21.15.98:0/1604724235 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d70209d860 con 0x55d702144c70 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.717+0000 7f7ee8d74640 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55d702144c70 0x55d702147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.717+0000 7f7ec3fff640 10 client.25463 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.717+0000 7f7ee8d74640 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55d702144c70 0x55d702147060 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6fe06b28adb66e35 server_cookie=d615b20e7c664fc7 in_seq=0 out_seq=0 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7ec3fff640 1 -- 172.21.15.98:0/1604724235 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d70209d860 con 0x55d702144c70 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7ec3fff640 10 client.25463 handle_command_reply: tid=0 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7eed3b1740 1 client.25463 shutdown 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7eed3b1740 1 -- 172.21.15.98:0/1604724235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d702135370 msgr2=0x55d7021325d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d702135370 0x55d7021325d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7edc031960 tx=0x7f7edc047690 comp rx=0 tx=0).stop 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7eed3b1740 1 -- 172.21.15.98:0/1604724235 shutdown_connections 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d702135370 0x55d7021325d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d702132000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55d702144c70 0x55d702147060 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/1604724235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 0x55d702134d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.744 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7ec3fff640 0 client.25463 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:24:37.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7eed3b1740 1 -- 172.21.15.98:0/1604724235 >> 172.21.15.98:0/1604724235 conn(0x55d7020f3310 msgr2=0x55d70212c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:37.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7eed3b1740 1 -- 172.21.15.98:0/1604724235 shutdown_connections 2024-09-19T07:24:37.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7eed3b1740 1 -- 172.21.15.98:0/1604724235 wait complete. 2024-09-19T07:24:37.745 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.718+0000 7f7eed3b1740 20 client.25463 trim_cache size 0 max 16384 2024-09-19T07:24:37.749 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.735+0000 7f7eed3b1740 1 Processor -- start 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7eed3b1740 1 -- start start 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7eed3b1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 0x55d702141310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7eed3b1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212bb40 0x55d702130fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7eed3b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d702135370 0x55d70212d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7eed3b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41b23b0 con 0x55d702135370 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7eed3b1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41afc80 con 0x55d70212bb40 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7eed3b1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41adad0 con 0x55d70212a5d0 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7edbfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212bb40 0x55d702130fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7ee9575640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d702135370 0x55d70212d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7ee9575640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d702135370 0x55d70212d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36228/0 (socket says 172.21.15.98:36228) 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7edbfff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212bb40 0x55d702130fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:60356/0 (socket says 172.21.15.98:60356) 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7ee9575640 1 -- 172.21.15.98:0/2812547898 learned_addr learned my addr 172.21.15.98:0/2812547898 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:37.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7ee8d74640 1 --2- 172.21.15.98:0/2812547898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 0x55d702141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7ee9575640 1 -- 172.21.15.98:0/2812547898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 msgr2=0x55d702141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7ee9575640 1 --2- 172.21.15.98:0/2812547898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 0x55d702141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7ee9575640 1 -- 172.21.15.98:0/2812547898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212bb40 msgr2=0x55d702130fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7ee9575640 1 --2- 172.21.15.98:0/2812547898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212bb40 0x55d702130fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7ee9575640 1 -- 172.21.15.98:0/2812547898 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d702147290 con 0x55d702135370 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.736+0000 7f7edbfff640 1 --2- 172.21.15.98:0/2812547898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212bb40 0x55d702130fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.737+0000 7f7ee9575640 1 --2- 172.21.15.98:0/2812547898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d702135370 0x55d70212d120 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009800 tx=0x7f7edc005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabc26d1a2442ff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.737+0000 7f7eca7fc640 1 -- 172.21.15.98:0/2812547898 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc04d070 con 0x55d702135370 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.737+0000 7f7eca7fc640 1 -- 172.21.15.98:0/2812547898 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7edc055070 con 0x55d702135370 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.737+0000 7f7eca7fc640 1 -- 172.21.15.98:0/2812547898 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc003830 con 0x55d702135370 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.737+0000 7f7eed3b1740 1 -- 172.21.15.98:0/2812547898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d702135370 msgr2=0x55d70212d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.737+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/2812547898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d702135370 0x55d70212d120 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009800 tx=0x7f7edc005de0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 -- 172.21.15.98:0/2812547898 shutdown_connections 2024-09-19T07:24:37.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/2812547898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d702135370 0x55d70212d120 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/2812547898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d70212bb40 0x55d702130fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/2812547898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 0x55d702141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 -- 172.21.15.98:0/2812547898 >> 172.21.15.98:0/2812547898 conn(0x55d7020f3310 msgr2=0x55d7021308d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 -- 172.21.15.98:0/2812547898 shutdown_connections 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 -- 172.21.15.98:0/2812547898 wait complete. 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 -- start start 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 Processor -- start 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 0x55d70213d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d70213dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d702135370 0x55d702138b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41ae140 con 0x55d70212bb40 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41af5b0 con 0x55d702135370 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.738+0000 7f7eed3b1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41ae810 con 0x55d70212a5d0 2024-09-19T07:24:37.752 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7eed3b1740 10 client.0 _ll_register_callbacks cb 0x7f7edc04b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7edbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d70213dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7edbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d70213dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36238/0 (socket says 172.21.15.98:36238) 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7edbfff640 1 -- 172.21.15.98:0/790308771 learned_addr learned my addr 172.21.15.98:0/790308771 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7ee8d74640 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 0x55d70213d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7ee9575640 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d702135370 0x55d702138b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7edbfff640 1 -- 172.21.15.98:0/790308771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 msgr2=0x55d70213d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7edbfff640 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 0x55d70213d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7edbfff640 1 -- 172.21.15.98:0/790308771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d702135370 msgr2=0x55d702138b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7edbfff640 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d702135370 0x55d702138b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7edbfff640 1 -- 172.21.15.98:0/790308771 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d702139380 con 0x55d70212bb40 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7edbfff640 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d70213dc90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x55d702133640 tx=0x7f7ed400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e712091505e01e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7ec3fff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:37.753 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7ec3fff640 1 -- 172.21.15.98:0/790308771 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4023060 con 0x55d70212bb40 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7ec3fff640 1 -- 172.21.15.98:0/790308771 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f7ed4004230 con 0x55d70212bb40 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7eed3b1740 1 -- 172.21.15.98:0/790308771 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7edc055070 con 0x55d70212bb40 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.739+0000 7f7ec3fff640 1 -- 172.21.15.98:0/790308771 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7ed4004430 con 0x55d70212bb40 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.740+0000 7f7eed3b1740 10 client.16113 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.740+0000 7f7eed3b1740 1 -- 172.21.15.98:0/790308771 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d7021af350 con 0x55d70212bb40 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.740+0000 7f7ec3fff640 1 -- 172.21.15.98:0/790308771 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7edc055070 con 0x55d70212bb40 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.740+0000 7f7ec3fff640 1 -- 172.21.15.98:0/790308771 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7ed4010530 con 0x55d70212bb40 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.740+0000 7f7eed3b1740 10 client.16113 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.740+0000 7f7eed3b1740 10 client.16113 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.740+0000 7f7eed3b1740 20 client.16113 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.740+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55d7021afb30 0x55d7021b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.740+0000 7f7eed3b1740 4 client.16113 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.740+0000 7f7eed3b1740 1 -- 172.21.15.98:0/790308771 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d702097d70 con 0x55d7021afb30 2024-09-19T07:24:37.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.740+0000 7f7ee8d74640 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55d7021afb30 0x55d7021b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7ee8d74640 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55d7021afb30 0x55d7021b1f50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3791f6ab416bcc60 server_cookie=89bd062f8ad0710f in_seq=0 out_seq=0 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7ec3fff640 10 client.16113 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7ec3fff640 1 -- 172.21.15.98:0/790308771 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d702097d70 con 0x55d7021afb30 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7ec3fff640 10 client.16113 handle_command_reply: tid=0 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7eed3b1740 1 client.16113 shutdown 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7eed3b1740 1 -- 172.21.15.98:0/790308771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 msgr2=0x55d70213dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d70213dc90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x55d702133640 tx=0x7f7ed400f790 comp rx=0 tx=0).stop 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7eed3b1740 1 -- 172.21.15.98:0/790308771 shutdown_connections 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d702135370 0x55d702138b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d70212bb40 0x55d70213dc90 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x55d7021afb30 0x55d7021b1f50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7eed3b1740 1 --2- 172.21.15.98:0/790308771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d70212a5d0 0x55d70213d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7eed3b1740 1 -- 172.21.15.98:0/790308771 >> 172.21.15.98:0/790308771 conn(0x55d7020f3310 msgr2=0x55d7021310f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7ec3fff640 0 client.16113 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:24:37.755 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7eed3b1740 1 -- 172.21.15.98:0/790308771 shutdown_connections 2024-09-19T07:24:37.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7eed3b1740 1 -- 172.21.15.98:0/790308771 wait complete. 2024-09-19T07:24:37.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.741+0000 7f7eed3b1740 20 client.16113 trim_cache size 0 max 16384 2024-09-19T07:24:37.756 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:24:37.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.742+0000 7f7eeafd8640 1 -- 172.21.15.98:0/1184182452 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7ecc0a33b0 msgr2=0x7f7ecc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.742+0000 7f7eeafd8640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7ecc0a33b0 0x7f7ecc0a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7edc04a000 tx=0x7f7edc047000 comp rx=0 tx=0).stop 2024-09-19T07:24:37.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.742+0000 7f7eeafd8640 1 -- 172.21.15.98:0/1184182452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee4103ff0 msgr2=0x7f7ee419a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:37.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.742+0000 7f7eeafd8640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee4103ff0 0x7f7ee419a6b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000cad0 tx=0x7f7ee000cf90 comp rx=0 tx=0).stop 2024-09-19T07:24:37.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.742+0000 7f7eeafd8640 1 -- 172.21.15.98:0/1184182452 shutdown_connections 2024-09-19T07:24:37.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.742+0000 7f7eeafd8640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7ecc0a33b0 0x7f7ecc0a5870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.742+0000 7f7eeafd8640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ee4109120 0x7f7ee419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.742+0000 7f7eeafd8640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ee41049a0 0x7f7ee419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.742+0000 7f7eeafd8640 1 --2- 172.21.15.98:0/1184182452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7ee4103ff0 0x7f7ee419a6b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:37.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.742+0000 7f7eeafd8640 1 -- 172.21.15.98:0/1184182452 >> 172.21.15.98:0/1184182452 conn(0x7f7ee40ffab0 msgr2=0x7f7ee4100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:37.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.742+0000 7f7eeafd8640 1 -- 172.21.15.98:0/1184182452 shutdown_connections 2024-09-19T07:24:37.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:37.742+0000 7f7eeafd8640 1 -- 172.21.15.98:0/1184182452 wait complete. 2024-09-19T07:24:38.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:37 smithi098 ceph-mon[30950]: pgmap v80: 97 pgs: 97 active+clean; 49 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 3.2 MiB/s wr, 913 op/s 2024-09-19T07:24:38.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:37 smithi162 ceph-mon[35726]: pgmap v80: 97 pgs: 97 active+clean; 49 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 3.2 MiB/s wr, 913 op/s 2024-09-19T07:24:38.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:37 smithi139 ceph-mon[35039]: pgmap v80: 97 pgs: 97 active+clean; 49 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 897 KiB/s rd, 3.2 MiB/s wr, 913 op/s 2024-09-19T07:24:38.430 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:24:38.687 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:39.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.203+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3990323104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d98106a80 msgr2=0x7f9d98106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.203+0000 7f9d9d0f4640 1 --2- 172.21.15.98:0/3990323104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d98106a80 0x7f9d98106e60 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009930 tx=0x7f9d8802a420 comp rx=0 tx=0).stop 2024-09-19T07:24:39.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.203+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3990323104 shutdown_connections 2024-09-19T07:24:39.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.203+0000 7f9d9d0f4640 1 --2- 172.21.15.98:0/3990323104 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d98101420 0x7f9d9810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.203+0000 7f9d9d0f4640 1 --2- 172.21.15.98:0/3990323104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d98100a80 0x7f9d98100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.203+0000 7f9d9d0f4640 1 --2- 172.21.15.98:0/3990323104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d98106a80 0x7f9d98106e60 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.203+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3990323104 >> 172.21.15.98:0/3990323104 conn(0x7f9d980fc7a0 msgr2=0x7f9d980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:39.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.203+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3990323104 shutdown_connections 2024-09-19T07:24:39.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.203+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3990323104 wait complete. 2024-09-19T07:24:39.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.204+0000 7f9d9d0f4640 1 Processor -- start 2024-09-19T07:24:39.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.204+0000 7f9d9d0f4640 1 -- start start 2024-09-19T07:24:39.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.204+0000 7f9d9d0f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d98100a80 0x7f9d980fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.204+0000 7f9d9d0f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d98101420 0x7f9d980fd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.204+0000 7f9d9d0f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d98106a80 0x7f9d980fd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.204+0000 7f9d9d0f4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d98110ea0 con 0x7f9d98101420 2024-09-19T07:24:39.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.204+0000 7f9d9d0f4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d98110d20 con 0x7f9d98106a80 2024-09-19T07:24:39.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.204+0000 7f9d9d0f4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d98111020 con 0x7f9d98100a80 2024-09-19T07:24:39.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.204+0000 7f9d9659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d98101420 0x7f9d980fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.204+0000 7f9d9659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d98101420 0x7f9d980fd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36256/0 (socket says 172.21.15.98:36256) 2024-09-19T07:24:39.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.204+0000 7f9d9659c640 1 -- 172.21.15.98:0/3517113917 learned_addr learned my addr 172.21.15.98:0/3517113917 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:39.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.204+0000 7f9d9759e640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d98106a80 0x7f9d980fd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.205+0000 7f9d96d9d640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d98100a80 0x7f9d980fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.205+0000 7f9d9659c640 1 -- 172.21.15.98:0/3517113917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d98100a80 msgr2=0x7f9d980fcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.205+0000 7f9d9659c640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d98100a80 0x7f9d980fcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.205+0000 7f9d9659c640 1 -- 172.21.15.98:0/3517113917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d98106a80 msgr2=0x7f9d980fd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.205+0000 7f9d9659c640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d98106a80 0x7f9d980fd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.205+0000 7f9d9659c640 1 -- 172.21.15.98:0/3517113917 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d981a6940 con 0x7f9d98101420 2024-09-19T07:24:39.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.205+0000 7f9d9659c640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d98101420 0x7f9d980fd300 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00b4a0 tx=0x7f9d8c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:39.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.205+0000 7f9d7ffff640 1 -- 172.21.15.98:0/3517113917 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c014070 con 0x7f9d98101420 2024-09-19T07:24:39.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.205+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3517113917 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d981a6c30 con 0x7f9d98101420 2024-09-19T07:24:39.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.205+0000 7f9d7ffff640 1 -- 172.21.15.98:0/3517113917 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d8c010af0 con 0x7f9d98101420 2024-09-19T07:24:39.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.205+0000 7f9d7ffff640 1 -- 172.21.15.98:0/3517113917 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c017d10 con 0x7f9d98101420 2024-09-19T07:24:39.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.205+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3517113917 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d981a71c0 con 0x7f9d98101420 2024-09-19T07:24:39.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.207+0000 7f9d7ffff640 1 -- 172.21.15.98:0/3517113917 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9d8c017070 con 0x7f9d98101420 2024-09-19T07:24:39.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.207+0000 7f9d9f4cd740 1 Processor -- start 2024-09-19T07:24:39.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9f4cd740 1 -- start start 2024-09-19T07:24:39.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9f4cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1eb40 0x5581d9f1d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9f4cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1d5d0 0x5581d9f1da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9f4cd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f28370 0x5581d9f2a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9f4cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5581d9e832f0 con 0x5581d9f1d5d0 2024-09-19T07:24:39.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9f4cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5581d9e2acf0 con 0x5581d9f1eb40 2024-09-19T07:24:39.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9f4cd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5581d9e7f2b0 con 0x5581d9f28370 2024-09-19T07:24:39.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9759e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1eb40 0x5581d9f1d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d96d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1d5d0 0x5581d9f1da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9759e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1eb40 0x5581d9f1d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:60398/0 (socket says 172.21.15.98:60398) 2024-09-19T07:24:39.219 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9759e640 1 -- 172.21.15.98:0/2855621275 learned_addr learned my addr 172.21.15.98:0/2855621275 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:39.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9659c640 1 --2- 172.21.15.98:0/2855621275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f28370 0x5581d9f2a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9759e640 1 -- 172.21.15.98:0/2855621275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f28370 msgr2=0x5581d9f2a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d7ffff640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9d800a33b0 0x7f9d800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9759e640 1 --2- 172.21.15.98:0/2855621275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f28370 0x5581d9f2a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9759e640 1 -- 172.21.15.98:0/2855621275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1d5d0 msgr2=0x5581d9f1da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9759e640 1 --2- 172.21.15.98:0/2855621275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1d5d0 0x5581d9f1da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d9759e640 1 -- 172.21.15.98:0/2855621275 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581d9e0f3a0 con 0x5581d9f1eb40 2024-09-19T07:24:39.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.208+0000 7f9d7ffff640 1 -- 172.21.15.98:0/3517113917 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f9d8c0ceff0 con 0x7f9d98101420 2024-09-19T07:24:39.220 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.209+0000 7f9d9759e640 1 --2- 172.21.15.98:0/2855621275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1eb40 0x5581d9f1d090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d90007f40 tx=0x7f9d9000f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c927f7d999655032 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:39.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.209+0000 7f9d9759e640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9d800a33b0 0x7f9d800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.209+0000 7f9d7d7fa640 1 -- 172.21.15.98:0/2855621275 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90010b20 con 0x5581d9f1eb40 2024-09-19T07:24:39.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.209+0000 7f9d7d7fa640 1 -- 172.21.15.98:0/2855621275 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d9001ae00 con 0x5581d9f1eb40 2024-09-19T07:24:39.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.209+0000 7f9d7d7fa640 1 -- 172.21.15.98:0/2855621275 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90019c90 con 0x5581d9f1eb40 2024-09-19T07:24:39.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.209+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/2855621275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1eb40 msgr2=0x5581d9f1d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.209+0000 7f9d9759e640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9d800a33b0 0x7f9d800a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d9001e000 tx=0x7f9d9001f000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:39.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.209+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/2855621275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1eb40 0x5581d9f1d090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9d90007f40 tx=0x7f9d9000f850 comp rx=0 tx=0).stop 2024-09-19T07:24:39.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/2855621275 shutdown_connections 2024-09-19T07:24:39.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/2855621275 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f28370 0x5581d9f2a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/2855621275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1d5d0 0x5581d9f1da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/2855621275 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1eb40 0x5581d9f1d090 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/2855621275 >> 172.21.15.98:0/2855621275 conn(0x5581d9ee6310 msgr2=0x5581d9f19c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:39.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/2855621275 shutdown_connections 2024-09-19T07:24:39.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/2855621275 wait complete. 2024-09-19T07:24:39.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 -- start start 2024-09-19T07:24:39.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 Processor -- start 2024-09-19T07:24:39.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1d5d0 0x5581d9f27d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 0x5581d9f24fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f28370 0x5581d9f25560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5581d9f2b070 con 0x5581d9f1eb40 2024-09-19T07:24:39.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5581d9e3e060 con 0x5581d9f1d5d0 2024-09-19T07:24:39.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5581d9f2b1f0 con 0x5581d9f28370 2024-09-19T07:24:39.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9f4cd740 10 client.0 _ll_register_callbacks cb 0x5581d9b918c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:39.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d9659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 0x5581d9f24fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.223 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d96d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1d5d0 0x5581d9f27d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d96d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1d5d0 0x5581d9f27d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:60400/0 (socket says 172.21.15.98:60400) 2024-09-19T07:24:39.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.210+0000 7f9d96d9d640 1 -- 172.21.15.98:0/540538898 learned_addr learned my addr 172.21.15.98:0/540538898 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:39.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d9759e640 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f28370 0x5581d9f25560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d9659c640 1 -- 172.21.15.98:0/540538898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f28370 msgr2=0x5581d9f25560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d9659c640 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f28370 0x5581d9f25560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d9659c640 1 -- 172.21.15.98:0/540538898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1d5d0 msgr2=0x5581d9f27d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d9659c640 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1d5d0 0x5581d9f27d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d9659c640 1 -- 172.21.15.98:0/540538898 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581d9bf43c0 con 0x5581d9f1eb40 2024-09-19T07:24:39.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d96d9d640 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1d5d0 0x5581d9f27d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:39.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d9659c640 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 0x5581d9f24fc0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0cc7e0 tx=0x7f9d8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f101f974ad3c8286 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:39.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d7aff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:39.224 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d7aff5640 1 -- 172.21.15.98:0/540538898 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c01e070 con 0x5581d9f1eb40 2024-09-19T07:24:39.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d7aff5640 1 -- 172.21.15.98:0/540538898 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f9d8c0979e0 con 0x5581d9f1eb40 2024-09-19T07:24:39.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/540538898 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d9001ae00 con 0x5581d9f1eb40 2024-09-19T07:24:39.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d7aff5640 1 -- 172.21.15.98:0/540538898 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9d8c09ba70 con 0x5581d9f1eb40 2024-09-19T07:24:39.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d9f4cd740 10 client.16125 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:39.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/540538898 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5581d9f36af0 con 0x5581d9f1eb40 2024-09-19T07:24:39.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.211+0000 7f9d7aff5640 1 -- 172.21.15.98:0/540538898 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d9001ae00 con 0x5581d9f1eb40 2024-09-19T07:24:39.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.212+0000 7f9d7aff5640 1 -- 172.21.15.98:0/540538898 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f9d8c0d10d0 con 0x5581d9f1eb40 2024-09-19T07:24:39.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.212+0000 7f9d9f4cd740 10 client.16125 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:39.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.212+0000 7f9d9f4cd740 10 client.16125 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T07:24:39.225 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.212+0000 7f9d9f4cd740 20 client.16125 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:39.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.212+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5581d9f37fb0 0x5581d9f3a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.212+0000 7f9d9f4cd740 4 client.16125 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:39.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.212+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/540538898 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581d9e90860 con 0x5581d9f37fb0 2024-09-19T07:24:39.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.212+0000 7f9d96d9d640 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5581d9f37fb0 0x5581d9f3a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.212+0000 7f9d96d9d640 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5581d9f37fb0 0x5581d9f3a3a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e4c23a4f03ff049f server_cookie=59468680e5384676 in_seq=0 out_seq=0 2024-09-19T07:24:39.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.212+0000 7f9d7aff5640 10 client.16125 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:24:39.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d7aff5640 1 -- 172.21.15.98:0/540538898 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5581d9e90860 con 0x5581d9f37fb0 2024-09-19T07:24:39.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d7aff5640 10 client.16125 handle_command_reply: tid=0 2024-09-19T07:24:39.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d9f4cd740 1 client.16125 shutdown 2024-09-19T07:24:39.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/540538898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 msgr2=0x5581d9f24fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 0x5581d9f24fc0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c0cc7e0 tx=0x7f9d8c0046c0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/540538898 shutdown_connections 2024-09-19T07:24:39.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5581d9f37fb0 0x5581d9f3a3a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f28370 0x5581d9f25560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 0x5581d9f24fc0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/540538898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f1d5d0 0x5581d9f27d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/540538898 >> 172.21.15.98:0/540538898 conn(0x5581d9ee6310 msgr2=0x5581d9f1f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:39.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d7aff5640 0 client.16125 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:24:39.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/540538898 shutdown_connections 2024-09-19T07:24:39.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/540538898 wait complete. 2024-09-19T07:24:39.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.213+0000 7f9d9f4cd740 20 client.16125 trim_cache size 0 max 16384 2024-09-19T07:24:39.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.226+0000 7f9d9f4cd740 1 Processor -- start 2024-09-19T07:24:39.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.226+0000 7f9d9f4cd740 1 -- start start 2024-09-19T07:24:39.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.226+0000 7f9d9f4cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1d5d0 0x5581d9f24880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.226+0000 7f9d9f4cd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f1eb40 0x5581d9f26f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.226+0000 7f9d9f4cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f28370 0x5581d9f20120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.226+0000 7f9d9f4cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981b2480 con 0x5581d9f1d5d0 2024-09-19T07:24:39.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.226+0000 7f9d9f4cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981afd50 con 0x5581d9f28370 2024-09-19T07:24:39.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.226+0000 7f9d9f4cd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981adba0 con 0x5581d9f1eb40 2024-09-19T07:24:39.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.226+0000 7f9d96d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1d5d0 0x5581d9f24880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.226+0000 7f9d96d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1d5d0 0x5581d9f24880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36278/0 (socket says 172.21.15.98:36278) 2024-09-19T07:24:39.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.226+0000 7f9d96d9d640 1 -- 172.21.15.98:0/916187145 learned_addr learned my addr 172.21.15.98:0/916187145 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:39.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.226+0000 7f9d9759e640 1 --2- 172.21.15.98:0/916187145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f28370 0x5581d9f20120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d9659c640 1 --2- 172.21.15.98:0/916187145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f1eb40 0x5581d9f26f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d96d9d640 1 -- 172.21.15.98:0/916187145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f1eb40 msgr2=0x5581d9f26f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d96d9d640 1 --2- 172.21.15.98:0/916187145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f1eb40 0x5581d9f26f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d96d9d640 1 -- 172.21.15.98:0/916187145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f28370 msgr2=0x5581d9f20120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d96d9d640 1 --2- 172.21.15.98:0/916187145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f28370 0x5581d9f20120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d96d9d640 1 -- 172.21.15.98:0/916187145 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581d9f23f70 con 0x5581d9f1d5d0 2024-09-19T07:24:39.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d9759e640 1 --2- 172.21.15.98:0/916187145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f28370 0x5581d9f20120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:39.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d96d9d640 1 --2- 172.21.15.98:0/916187145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1d5d0 0x5581d9f24880 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f9d8802a940 tx=0x7f9d88031ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7b43dea55e304f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:39.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d7cff9640 1 -- 172.21.15.98:0/916187145 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d88035040 con 0x5581d9f1d5d0 2024-09-19T07:24:39.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d7cff9640 1 -- 172.21.15.98:0/916187145 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d88004480 con 0x5581d9f1d5d0 2024-09-19T07:24:39.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d7cff9640 1 -- 172.21.15.98:0/916187145 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d880035f0 con 0x5581d9f1d5d0 2024-09-19T07:24:39.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/916187145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1d5d0 msgr2=0x5581d9f24880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.238 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.227+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/916187145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1d5d0 0x5581d9f24880 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f9d8802a940 tx=0x7f9d88031ac0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/916187145 shutdown_connections 2024-09-19T07:24:39.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/916187145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f28370 0x5581d9f20120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/916187145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f1eb40 0x5581d9f26f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/916187145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1d5d0 0x5581d9f24880 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/916187145 >> 172.21.15.98:0/916187145 conn(0x5581d9ee6310 msgr2=0x5581d9f26820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:39.239 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/916187145 shutdown_connections 2024-09-19T07:24:39.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/916187145 wait complete. 2024-09-19T07:24:39.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 -- start start 2024-09-19T07:24:39.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 Processor -- start 2024-09-19T07:24:39.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f1d5d0 0x5581d9f30690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.240 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 0x5581d9f30bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f28370 0x5581d9f217d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981ae210 con 0x5581d9f1eb40 2024-09-19T07:24:39.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981af680 con 0x5581d9f28370 2024-09-19T07:24:39.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d981ae8e0 con 0x5581d9f1d5d0 2024-09-19T07:24:39.241 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9f4cd740 10 client.0 _ll_register_callbacks cb 0x7f9d8c017630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:39.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 0x5581d9f30bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 0x5581d9f30bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36286/0 (socket says 172.21.15.98:36286) 2024-09-19T07:24:39.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.228+0000 7f9d9659c640 1 -- 172.21.15.98:0/141311806 learned_addr learned my addr 172.21.15.98:0/141311806 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:39.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d96d9d640 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f1d5d0 0x5581d9f30690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d9759e640 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f28370 0x5581d9f217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.242 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d9659c640 1 -- 172.21.15.98:0/141311806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f1d5d0 msgr2=0x5581d9f30690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d9659c640 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f1d5d0 0x5581d9f30690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d9659c640 1 -- 172.21.15.98:0/141311806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f28370 msgr2=0x5581d9f217d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:39.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d9659c640 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f28370 0x5581d9f217d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d9659c640 1 -- 172.21.15.98:0/141311806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581d9f21f10 con 0x5581d9f1eb40 2024-09-19T07:24:39.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d9659c640 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 0x5581d9f30bd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00be60 tx=0x7f9d8c097670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeea9a3e9cc1522d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:39.243 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d7aff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:39.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d7aff5640 1 -- 172.21.15.98:0/141311806 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c01e070 con 0x5581d9f1eb40 2024-09-19T07:24:39.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d7aff5640 1 -- 172.21.15.98:0/141311806 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f9d8c09a9c0 con 0x5581d9f1eb40 2024-09-19T07:24:39.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/141311806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d88004480 con 0x5581d9f1eb40 2024-09-19T07:24:39.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d7aff5640 1 -- 172.21.15.98:0/141311806 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9d8c09aeb0 con 0x5581d9f1eb40 2024-09-19T07:24:39.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d9f4cd740 10 client.16131 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:39.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/141311806 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5581d9fa2660 con 0x5581d9f1eb40 2024-09-19T07:24:39.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.229+0000 7f9d7aff5640 1 -- 172.21.15.98:0/141311806 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d88004480 con 0x5581d9f1eb40 2024-09-19T07:24:39.244 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d7aff5640 1 -- 172.21.15.98:0/141311806 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f9d8c0971c0 con 0x5581d9f1eb40 2024-09-19T07:24:39.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d9f4cd740 10 client.16131 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:39.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d9f4cd740 10 client.16131 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T07:24:39.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d9f4cd740 20 client.16131 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:39.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5581d9fa2b40 0x5581d9fa4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:39.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d9f4cd740 4 client.16131 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:24:39.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/141311806 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5581d9e8ad70 con 0x5581d9fa2b40 2024-09-19T07:24:39.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d96d9d640 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5581d9fa2b40 0x5581d9fa4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:39.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d96d9d640 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5581d9fa2b40 0x5581d9fa4f30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d0ec66be5cec955c server_cookie=da42094961dabc1d in_seq=0 out_seq=0 2024-09-19T07:24:39.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d7aff5640 10 client.16131 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:24:39.245 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d7aff5640 1 -- 172.21.15.98:0/141311806 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5581d9e8ad70 con 0x5581d9fa2b40 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d7aff5640 10 client.16131 handle_command_reply: tid=0 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.230+0000 7f9d9f4cd740 1 client.16131 shutdown 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/141311806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 msgr2=0x5581d9f30bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 0x5581d9f30bd0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00be60 tx=0x7f9d8c097670 comp rx=0 tx=0).stop 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/141311806 shutdown_connections 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5581d9fa2b40 0x5581d9fa4f30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5581d9f28370 0x5581d9f217d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5581d9f1eb40 0x5581d9f30bd0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d7aff5640 0 client.16131 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9f4cd740 1 --2- 172.21.15.98:0/141311806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5581d9f1d5d0 0x5581d9f30690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/141311806 >> 172.21.15.98:0/141311806 conn(0x5581d9ee6310 msgr2=0x5581d9f27040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/141311806 shutdown_connections 2024-09-19T07:24:39.246 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9f4cd740 1 -- 172.21.15.98:0/141311806 wait complete. 2024-09-19T07:24:39.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9f4cd740 20 client.16131 trim_cache size 0 max 16384 2024-09-19T07:24:39.247 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:24:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3517113917 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9d800a33b0 msgr2=0x7f9d800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9d0f4640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9d800a33b0 0x7f9d800a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d9001e000 tx=0x7f9d9001f000 comp rx=0 tx=0).stop 2024-09-19T07:24:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3517113917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d98101420 msgr2=0x7f9d980fd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9d0f4640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d98101420 0x7f9d980fd300 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00b4a0 tx=0x7f9d8c00b960 comp rx=0 tx=0).stop 2024-09-19T07:24:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3517113917 shutdown_connections 2024-09-19T07:24:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9d0f4640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9d800a33b0 0x7f9d800a5870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9d0f4640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d98106a80 0x7f9d980fd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9d0f4640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9d98101420 0x7f9d980fd300 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9d0f4640 1 --2- 172.21.15.98:0/3517113917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d98100a80 0x7f9d980fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3517113917 >> 172.21.15.98:0/3517113917 conn(0x7f9d980fc7a0 msgr2=0x7f9d9806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3517113917 shutdown_connections 2024-09-19T07:24:39.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:39.231+0000 7f9d9d0f4640 1 -- 172.21.15.98:0/3517113917 wait complete. 2024-09-19T07:24:39.975 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:24:40.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:39 smithi162 ceph-mon[35726]: pgmap v81: 97 pgs: 97 active+clean; 65 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 1.05k op/s 2024-09-19T07:24:40.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:39 smithi098 ceph-mon[30950]: pgmap v81: 97 pgs: 97 active+clean; 65 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 1.05k op/s 2024-09-19T07:24:40.279 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:40.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:39 smithi139 ceph-mon[35039]: pgmap v81: 97 pgs: 97 active+clean; 65 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.5 MiB/s wr, 1.05k op/s 2024-09-19T07:24:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.613+0000 7f0db8ee6640 1 -- 172.21.15.98:0/3432396499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db41009b0 msgr2=0x7f0db4100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.613+0000 7f0db8ee6640 1 --2- 172.21.15.98:0/3432396499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db41009b0 0x7f0db4100e10 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009930 tx=0x7f0da802a420 comp rx=0 tx=0).stop 2024-09-19T07:24:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.614+0000 7f0db8ee6640 1 -- 172.21.15.98:0/3432396499 shutdown_connections 2024-09-19T07:24:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.614+0000 7f0db8ee6640 1 --2- 172.21.15.98:0/3432396499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0db4101350 0x7f0db410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.614+0000 7f0db8ee6640 1 --2- 172.21.15.98:0/3432396499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db41009b0 0x7f0db4100e10 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.614+0000 7f0db8ee6640 1 --2- 172.21.15.98:0/3432396499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db41069c0 0x7f0db4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.614+0000 7f0db8ee6640 1 -- 172.21.15.98:0/3432396499 >> 172.21.15.98:0/3432396499 conn(0x7f0db4077990 msgr2=0x7f0db40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.614+0000 7f0db8ee6640 1 -- 172.21.15.98:0/3432396499 shutdown_connections 2024-09-19T07:24:40.615 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.614+0000 7f0db8ee6640 1 -- 172.21.15.98:0/3432396499 wait complete. 2024-09-19T07:24:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.614+0000 7f0db8ee6640 1 Processor -- start 2024-09-19T07:24:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.614+0000 7f0db8ee6640 1 -- start start 2024-09-19T07:24:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db8ee6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db41009b0 0x7f0db4199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db8ee6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0db4101350 0x7f0db41997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db8ee6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db41069c0 0x7f0db41a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db8ee6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4110e50 con 0x7f0db41009b0 2024-09-19T07:24:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db8ee6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4110cd0 con 0x7f0db4101350 2024-09-19T07:24:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db8ee6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0db4110fd0 con 0x7f0db41069c0 2024-09-19T07:24:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db41009b0 0x7f0db4199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.617 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db41009b0 0x7f0db4199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36298/0 (socket says 172.21.15.98:36298) 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db1d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0db4101350 0x7f0db41997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db259c640 1 -- 172.21.15.98:0/512737039 learned_addr learned my addr 172.21.15.98:0/512737039 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db2d9d640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db41069c0 0x7f0db41a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db259c640 1 -- 172.21.15.98:0/512737039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db41069c0 msgr2=0x7f0db41a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db259c640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db41069c0 0x7f0db41a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db259c640 1 -- 172.21.15.98:0/512737039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0db4101350 msgr2=0x7f0db41997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db259c640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0db4101350 0x7f0db41997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db259c640 1 -- 172.21.15.98:0/512737039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0db41a4840 con 0x7f0db41009b0 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db259c640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db41009b0 0x7f0db4199280 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0da400d770 tx=0x7f0da400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0da37fe640 1 -- 172.21.15.98:0/512737039 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4017070 con 0x7f0db41009b0 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db8ee6640 1 -- 172.21.15.98:0/512737039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0db41a4a10 con 0x7f0db41009b0 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0da37fe640 1 -- 172.21.15.98:0/512737039 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da4005500 con 0x7f0db41009b0 2024-09-19T07:24:40.618 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0da37fe640 1 -- 172.21.15.98:0/512737039 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da4004e00 con 0x7f0db41009b0 2024-09-19T07:24:40.619 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.615+0000 7f0db8ee6640 1 -- 172.21.15.98:0/512737039 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0db41a4ee0 con 0x7f0db41009b0 2024-09-19T07:24:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.617+0000 7f0da37fe640 1 -- 172.21.15.98:0/512737039 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0da4004fa0 con 0x7f0db41009b0 2024-09-19T07:24:40.625 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.618+0000 7f0dbbc7e740 1 Processor -- start 2024-09-19T07:24:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.618+0000 7f0da37fe640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0d9c0a3460 0x7f0d9c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.618+0000 7f0dbbc7e740 1 -- start start 2024-09-19T07:24:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.618+0000 7f0dbbc7e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e949eded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.618+0000 7f0dbbc7e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.618+0000 7f0db2d9d640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0d9c0a3460 0x7f0d9c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.618+0000 7f0dbbc7e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0dbbc7e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562e949522f0 con 0x562e949f8cb0 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0dbbc7e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562e948fa270 con 0x562e949ee410 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0dbbc7e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562e9494e2b0 con 0x562e949edaf0 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0da37fe640 1 -- 172.21.15.98:0/512737039 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0da40cf670 con 0x7f0db41009b0 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db2d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db2d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949fb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36308/0 (socket says 172.21.15.98:36308) 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db1d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db2d9d640 1 -- 172.21.15.98:0/1127548840 learned_addr learned my addr 172.21.15.98:0/1127548840 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db259c640 1 --2- 172.21.15.98:0/1127548840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e949eded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db1d9b640 1 -- 172.21.15.98:0/1127548840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 msgr2=0x562e949eded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db1d9b640 1 --2- 172.21.15.98:0/1127548840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e949eded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db1d9b640 1 -- 172.21.15.98:0/1127548840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 msgr2=0x562e949fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db1d9b640 1 --2- 172.21.15.98:0/1127548840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949fb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db1d9b640 1 -- 172.21.15.98:0/1127548840 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e948f9340 con 0x562e949ee410 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db259c640 1 --2- 172.21.15.98:0/1127548840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e949eded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db2d9d640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0d9c0a3460 0x7f0d9c0a5920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0dac013cf0 tx=0x7f0dac009f10 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0db1d9b640 1 --2- 172.21.15.98:0/1127548840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f8770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0da802a940 tx=0x7f0da8005bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3973ed82ee0d6f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0da0ff9640 1 -- 172.21.15.98:0/1127548840 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da8035040 con 0x562e949ee410 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0da0ff9640 1 -- 172.21.15.98:0/1127548840 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da8004400 con 0x562e949ee410 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.619+0000 7f0da0ff9640 1 -- 172.21.15.98:0/1127548840 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da80035f0 con 0x562e949ee410 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.620+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/1127548840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 msgr2=0x562e949f8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.620+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/1127548840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f8770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0da802a940 tx=0x7f0da8005bf0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.620+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/1127548840 shutdown_connections 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.620+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/1127548840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.620+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/1127548840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f8770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.620+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/1127548840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e949eded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.620+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/1127548840 >> 172.21.15.98:0/1127548840 conn(0x562e949ea060 msgr2=0x562e949ea440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.620+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/1127548840 shutdown_connections 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.620+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/1127548840 wait complete. 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0dbbc7e740 1 -- start start 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0dbbc7e740 1 Processor -- start 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0dbbc7e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e949f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0dbbc7e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0dbbc7e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949f6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0dbbc7e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562e949fb880 con 0x562e949f8cb0 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0dbbc7e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562e948db290 con 0x562e949ee410 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0dbbc7e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562e949fba00 con 0x562e949edaf0 2024-09-19T07:24:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0dbbc7e740 10 client.0 _ll_register_callbacks cb 0x562e9490c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0db2d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0db1d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0db2d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949f6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36320/0 (socket says 172.21.15.98:36320) 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0db1d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:60454/0 (socket says 172.21.15.98:60454) 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0db2d9d640 1 -- 172.21.15.98:0/161822955 learned_addr learned my addr 172.21.15.98:0/161822955 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0db259c640 1 --2- 172.21.15.98:0/161822955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e949f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0db2d9d640 1 -- 172.21.15.98:0/161822955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 msgr2=0x562e949f5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0db2d9d640 1 --2- 172.21.15.98:0/161822955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e949f5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0db2d9d640 1 -- 172.21.15.98:0/161822955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 msgr2=0x562e949f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0db2d9d640 1 --2- 172.21.15.98:0/161822955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.621+0000 7f0db2d9d640 1 -- 172.21.15.98:0/161822955 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e94665210 con 0x562e949f8cb0 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0db2d9d640 1 --2- 172.21.15.98:0/161822955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949f6660 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009270 tx=0x7f0dac01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306effefcd0e805b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0d99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0d99ffb640 1 -- 172.21.15.98:0/161822955 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0217a0 con 0x562e949f8cb0 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/161822955 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0da8004400 con 0x562e949f8cb0 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0d99ffb640 1 -- 172.21.15.98:0/161822955 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0dac021940 con 0x562e949f8cb0 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0d99ffb640 1 -- 172.21.15.98:0/161822955 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0dac021b40 con 0x562e949f8cb0 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0dbbc7e740 10 client.16143 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/161822955 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562e94731620 con 0x562e949f8cb0 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0d99ffb640 1 -- 172.21.15.98:0/161822955 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da8004400 con 0x562e949f8cb0 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0d99ffb640 1 -- 172.21.15.98:0/161822955 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f0dac020050 con 0x562e949f8cb0 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0dbbc7e740 10 client.16143 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0dbbc7e740 10 client.16143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0dbbc7e740 20 client.16143 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/161822955 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x562e94a08d00 0x562e94a0b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0dbbc7e740 4 client.16143 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.622+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/161822955 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e9495fa20 con 0x562e94a08d00 2024-09-19T07:24:40.631 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.623+0000 7f0db259c640 1 --2- 172.21.15.98:0/161822955 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x562e94a08d00 0x562e94a0b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.623+0000 7f0d99ffb640 10 client.16143 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.623+0000 7f0db259c640 1 --2- 172.21.15.98:0/161822955 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x562e94a08d00 0x562e94a0b110 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=304cace632a46153 server_cookie=c70689afe05bf7de in_seq=0 out_seq=0 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0d99ffb640 1 -- 172.21.15.98:0/161822955 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e9495fa20 con 0x562e94a08d00 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0d99ffb640 10 client.16143 handle_command_reply: tid=0 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0dbbc7e740 1 client.16143 shutdown 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/161822955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 msgr2=0x562e949f6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/161822955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949f6660 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009270 tx=0x7f0dac01d000 comp rx=0 tx=0).stop 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/161822955 shutdown_connections 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/161822955 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x562e94a08d00 0x562e94a0b110 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/161822955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949f6660 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/161822955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/161822955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e949f5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.632 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0d99ffb640 0 client.16143 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/161822955 >> 172.21.15.98:0/161822955 conn(0x562e949ea060 msgr2=0x562e949efd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/161822955 shutdown_connections 2024-09-19T07:24:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/161822955 wait complete. 2024-09-19T07:24:40.633 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.624+0000 7f0dbbc7e740 20 client.16143 trim_cache size 0 max 16384 2024-09-19T07:24:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.638+0000 7f0dbbc7e740 1 Processor -- start 2024-09-19T07:24:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.638+0000 7f0dbbc7e740 1 -- start start 2024-09-19T07:24:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0dbbc7e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949edaf0 0x562e949f6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0dbbc7e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0dbbc7e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949f8cb0 0x562e94a10a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0dbbc7e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41b0150 con 0x562e949edaf0 2024-09-19T07:24:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0dbbc7e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41ada20 con 0x562e949ee410 2024-09-19T07:24:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0dbbc7e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41ab870 con 0x562e949f8cb0 2024-09-19T07:24:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0db259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949edaf0 0x562e949f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0db259c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949edaf0 0x562e949f6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36324/0 (socket says 172.21.15.98:36324) 2024-09-19T07:24:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0db259c640 1 -- 172.21.15.98:0/1049304229 learned_addr learned my addr 172.21.15.98:0/1049304229 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0db1d9b640 1 --2- 172.21.15.98:0/1049304229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0db2d9d640 1 --2- 172.21.15.98:0/1049304229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949f8cb0 0x562e94a10a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0db259c640 1 -- 172.21.15.98:0/1049304229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949f8cb0 msgr2=0x562e94a10a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0db259c640 1 --2- 172.21.15.98:0/1049304229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949f8cb0 0x562e94a10a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0db259c640 1 -- 172.21.15.98:0/1049304229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 msgr2=0x562e949f7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0db259c640 1 --2- 172.21.15.98:0/1049304229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0db259c640 1 -- 172.21.15.98:0/1049304229 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e949ed870 con 0x562e949edaf0 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0db259c640 1 --2- 172.21.15.98:0/1049304229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949edaf0 0x562e949f6490 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f0da409b6d0 tx=0x7f0da4086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a321266b9e40d218 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0d9bfff640 1 -- 172.21.15.98:0/1049304229 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da40b9070 con 0x562e949edaf0 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0d9bfff640 1 -- 172.21.15.98:0/1049304229 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da4005290 con 0x562e949edaf0 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.639+0000 7f0d9bfff640 1 -- 172.21.15.98:0/1049304229 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da40b4070 con 0x562e949edaf0 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/1049304229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949edaf0 msgr2=0x562e949f6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:40.644 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/1049304229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949edaf0 0x562e949f6490 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f0da409b6d0 tx=0x7f0da4086040 comp rx=0 tx=0).stop 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/1049304229 shutdown_connections 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/1049304229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949f8cb0 0x562e94a10a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/1049304229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e949f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/1049304229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949edaf0 0x562e949f6490 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/1049304229 >> 172.21.15.98:0/1049304229 conn(0x562e949ea060 msgr2=0x562e949f7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/1049304229 shutdown_connections 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/1049304229 wait complete. 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 -- start start 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 Processor -- start 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e94a00e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e94a013c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41abee0 con 0x562e949f8cb0 2024-09-19T07:24:40.645 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41ad350 con 0x562e949ee410 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0db41ac5b0 con 0x562e949edaf0 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.640+0000 7f0dbbc7e740 10 client.0 _ll_register_callbacks cb 0x7f0dac013760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0db2d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0db2d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36338/0 (socket says 172.21.15.98:36338) 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0db2d9d640 1 -- 172.21.15.98:0/3930957772 learned_addr learned my addr 172.21.15.98:0/3930957772 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0db1d9b640 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e94a013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0db259c640 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e94a00e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0db2d9d640 1 -- 172.21.15.98:0/3930957772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 msgr2=0x562e94a00e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0db2d9d640 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e94a00e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0db2d9d640 1 -- 172.21.15.98:0/3930957772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 msgr2=0x562e94a013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0db2d9d640 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e94a013c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0db2d9d640 1 -- 172.21.15.98:0/3930957772 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e949fe2f0 con 0x562e949f8cb0 2024-09-19T07:24:40.646 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0db2d9d640 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949fdc60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0dac011c40 tx=0x7f0dac011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec0e412387a670 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0d99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0d99ffb640 1 -- 172.21.15.98:0/3930957772 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0139f0 con 0x562e949f8cb0 2024-09-19T07:24:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0d99ffb640 1 -- 172.21.15.98:0/3930957772 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0dac0217a0 con 0x562e949f8cb0 2024-09-19T07:24:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/3930957772 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0da4005290 con 0x562e949f8cb0 2024-09-19T07:24:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0d99ffb640 1 -- 172.21.15.98:0/3930957772 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0dac0219a0 con 0x562e949f8cb0 2024-09-19T07:24:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0dbbc7e740 10 client.16149 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/3930957772 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562e94a74390 con 0x562e949f8cb0 2024-09-19T07:24:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.641+0000 7f0d99ffb640 1 -- 172.21.15.98:0/3930957772 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0da4005290 con 0x562e949f8cb0 2024-09-19T07:24:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.642+0000 7f0d99ffb640 1 -- 172.21.15.98:0/3930957772 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f0dac021ce0 con 0x562e949f8cb0 2024-09-19T07:24:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.642+0000 7f0dbbc7e740 10 client.16149 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.642+0000 7f0dbbc7e740 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:40.647 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.642+0000 7f0dbbc7e740 20 client.16149 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:40.648 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.642+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x562e94a74ad0 0x562e94a76ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.648 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.642+0000 7f0dbbc7e740 4 client.16149 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:24:40.648 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.642+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/3930957772 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562e94959d70 con 0x562e94a74ad0 2024-09-19T07:24:40.648 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.642+0000 7f0db259c640 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x562e94a74ad0 0x562e94a76ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.648 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.642+0000 7f0db259c640 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x562e94a74ad0 0x562e94a76ef0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68f5f6e2b470f8e1 server_cookie=4f79ff6166f40ece in_seq=0 out_seq=0 2024-09-19T07:24:40.648 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:40.642+0000 7f0d99ffb640 10 client.16149 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:40.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.793+0000 7f8702186640 1 -- 172.21.15.98:0/1855213298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86fc102570 msgr2=0x7f86fc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:40.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.793+0000 7f8702186640 1 --2- 172.21.15.98:0/1855213298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86fc102570 0x7f86fc1029b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009900 tx=0x7f86e402a480 comp rx=0 tx=0).stop 2024-09-19T07:24:40.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.793+0000 7f8702186640 1 -- 172.21.15.98:0/1855213298 shutdown_connections 2024-09-19T07:24:40.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.793+0000 7f8702186640 1 --2- 172.21.15.98:0/1855213298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc102ef0 0x7f86fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.794 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.793+0000 7f8702186640 1 --2- 172.21.15.98:0/1855213298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86fc102570 0x7f86fc1029b0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.793+0000 7f8702186640 1 --2- 172.21.15.98:0/1855213298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86fc100e20 0x7f86fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.793+0000 7f8702186640 1 -- 172.21.15.98:0/1855213298 >> 172.21.15.98:0/1855213298 conn(0x7f86fc0fc7d0 msgr2=0x7f86fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:40.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.793+0000 7f8702186640 1 -- 172.21.15.98:0/1855213298 shutdown_connections 2024-09-19T07:24:40.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.793+0000 7f8702186640 1 -- 172.21.15.98:0/1855213298 wait complete. 2024-09-19T07:24:40.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f8702186640 1 Processor -- start 2024-09-19T07:24:40.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f8702186640 1 -- start start 2024-09-19T07:24:40.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f8702186640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc100e20 0x7f86fc1973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f8702186640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86fc102570 0x7f86fc197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f8702186640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86fc102ef0 0x7f86fc19bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f8702186640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc110f80 con 0x7f86fc102570 2024-09-19T07:24:40.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f8702186640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc110e00 con 0x7f86fc102ef0 2024-09-19T07:24:40.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f8702186640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc111100 con 0x7f86fc100e20 2024-09-19T07:24:40.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f86f3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86fc102570 0x7f86fc197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f86f3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86fc102570 0x7f86fc197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36342/0 (socket says 172.21.15.98:36342) 2024-09-19T07:24:40.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f86f3fff640 1 -- 172.21.15.98:0/2571237324 learned_addr learned my addr 172.21.15.98:0/2571237324 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:40.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f86fb7fe640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc100e20 0x7f86fc1973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.794+0000 7f86fbfff640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86fc102ef0 0x7f86fc19bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.795+0000 7f86f3fff640 1 -- 172.21.15.98:0/2571237324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc100e20 msgr2=0x7f86fc1973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:40.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.795+0000 7f86f3fff640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc100e20 0x7f86fc1973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.795+0000 7f86f3fff640 1 -- 172.21.15.98:0/2571237324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86fc102ef0 msgr2=0x7f86fc19bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:40.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.795+0000 7f86f3fff640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86fc102ef0 0x7f86fc19bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.795+0000 7f86f3fff640 1 -- 172.21.15.98:0/2571237324 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc19c390 con 0x7f86fc102570 2024-09-19T07:24:40.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.795+0000 7f86fbfff640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86fc102ef0 0x7f86fc19bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:40.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.795+0000 7f86f3fff640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86fc102570 0x7f86fc197920 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f86e4006010 tx=0x7f86e4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:40.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.795+0000 7f86f97fa640 1 -- 172.21.15.98:0/2571237324 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e403f070 con 0x7f86fc102570 2024-09-19T07:24:40.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.795+0000 7f8702186640 1 -- 172.21.15.98:0/2571237324 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86fc19c620 con 0x7f86fc102570 2024-09-19T07:24:40.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.795+0000 7f86f97fa640 1 -- 172.21.15.98:0/2571237324 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86e4031c30 con 0x7f86fc102570 2024-09-19T07:24:40.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.795+0000 7f86f97fa640 1 -- 172.21.15.98:0/2571237324 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4035030 con 0x7f86fc102570 2024-09-19T07:24:40.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.795+0000 7f8702186640 1 -- 172.21.15.98:0/2571237324 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86fc1a3f60 con 0x7f86fc102570 2024-09-19T07:24:40.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f86f97fa640 1 -- 172.21.15.98:0/2571237324 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f86e4042070 con 0x7f86fc102570 2024-09-19T07:24:40.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f870455f740 1 Processor -- start 2024-09-19T07:24:40.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f870455f740 1 -- start start 2024-09-19T07:24:40.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f870455f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08123fb40 0x55d08123e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f870455f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08123ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f870455f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08124b580 0x55d08124d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.803 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f870455f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d0811a42f0 con 0x55d08123e5d0 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f870455f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d08114bcf0 con 0x55d08123fb40 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f870455f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d0811a02b0 con 0x55d08124b580 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f86fb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08123ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f86fb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08123ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36352/0 (socket says 172.21.15.98:36352) 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f86fb7fe640 1 -- 172.21.15.98:0/3320648661 learned_addr learned my addr 172.21.15.98:0/3320648661 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f86fbfff640 1 --2- 172.21.15.98:0/3320648661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08123fb40 0x55d08123e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f86f97fa640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f86e80a33b0 0x7f86e80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f86f3fff640 1 --2- 172.21.15.98:0/3320648661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08124b580 0x55d08124d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f86fb7fe640 1 -- 172.21.15.98:0/3320648661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08124b580 msgr2=0x55d08124d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f86fb7fe640 1 --2- 172.21.15.98:0/3320648661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08124b580 0x55d08124d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f86fb7fe640 1 -- 172.21.15.98:0/3320648661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08123fb40 msgr2=0x55d08123e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.798+0000 7f86fb7fe640 1 --2- 172.21.15.98:0/3320648661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08123fb40 0x55d08123e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.804 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.799+0000 7f86fb7fe640 1 -- 172.21.15.98:0/3320648661 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0811303a0 con 0x55d08123e5d0 2024-09-19T07:24:40.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.799+0000 7f86f3fff640 1 --2- 172.21.15.98:0/3320648661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08124b580 0x55d08124d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:40.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.799+0000 7f86f97fa640 1 -- 172.21.15.98:0/2571237324 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f86e40f05c0 con 0x7f86fc102570 2024-09-19T07:24:40.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.799+0000 7f86fbfff640 1 --2- 172.21.15.98:0/3320648661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08123fb40 0x55d08123e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:40.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.799+0000 7f86fbfff640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f86e80a33b0 0x7f86e80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.799+0000 7f86fb7fe640 1 --2- 172.21.15.98:0/3320648661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08123ea10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00bd50 tx=0x7f86ec0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77555d8b2d8d2f7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:40.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.799+0000 7f86f1ffb640 1 -- 172.21.15.98:0/3320648661 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec005220 con 0x55d08123e5d0 2024-09-19T07:24:40.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.799+0000 7f86f1ffb640 1 -- 172.21.15.98:0/3320648661 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ec00be40 con 0x55d08123e5d0 2024-09-19T07:24:40.805 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.799+0000 7f86f1ffb640 1 -- 172.21.15.98:0/3320648661 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec011860 con 0x55d08123e5d0 2024-09-19T07:24:40.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.800+0000 7f870455f740 1 -- 172.21.15.98:0/3320648661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 msgr2=0x55d08123ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:40.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.800+0000 7f86fbfff640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f86e80a33b0 0x7f86e80a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86f4005fd0 tx=0x7f86f4004a40 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:40.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.800+0000 7f870455f740 1 --2- 172.21.15.98:0/3320648661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08123ea10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00bd50 tx=0x7f86ec0107a0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.800+0000 7f870455f740 1 -- 172.21.15.98:0/3320648661 shutdown_connections 2024-09-19T07:24:40.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.800+0000 7f870455f740 1 --2- 172.21.15.98:0/3320648661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08124b580 0x55d08124d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.800+0000 7f870455f740 1 --2- 172.21.15.98:0/3320648661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08123ea10 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.800+0000 7f870455f740 1 --2- 172.21.15.98:0/3320648661 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08123fb40 0x55d08123e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.800+0000 7f870455f740 1 -- 172.21.15.98:0/3320648661 >> 172.21.15.98:0/3320648661 conn(0x55d081207310 msgr2=0x55d08123ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:40.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.800+0000 7f870455f740 1 -- 172.21.15.98:0/3320648661 shutdown_connections 2024-09-19T07:24:40.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.800+0000 7f870455f740 1 -- 172.21.15.98:0/3320648661 wait complete. 2024-09-19T07:24:40.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.800+0000 7f870455f740 1 -- start start 2024-09-19T07:24:40.806 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.800+0000 7f870455f740 1 Processor -- start 2024-09-19T07:24:40.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f870455f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08124af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f870455f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08123fb40 0x55d081248210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f870455f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08124b580 0x55d0812487e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f870455f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d08124e280 con 0x55d08123e5d0 2024-09-19T07:24:40.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f870455f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d08115f060 con 0x55d08123fb40 2024-09-19T07:24:40.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f870455f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d08124e400 con 0x55d08124b580 2024-09-19T07:24:40.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f870455f740 10 client.0 _ll_register_callbacks cb 0x55d080eb28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:40.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86fb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08124af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86fb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08124af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36366/0 (socket says 172.21.15.98:36366) 2024-09-19T07:24:40.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86f3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08123fb40 0x55d081248210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.807 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86fb7fe640 1 -- 172.21.15.98:0/171266381 learned_addr learned my addr 172.21.15.98:0/171266381 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86fbfff640 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08124b580 0x55d0812487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86f3fff640 1 -- 172.21.15.98:0/171266381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08124b580 msgr2=0x55d0812487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86f3fff640 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08124b580 0x55d0812487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86f3fff640 1 -- 172.21.15.98:0/171266381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 msgr2=0x55d08124af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86f3fff640 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08124af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86f3fff640 1 -- 172.21.15.98:0/171266381 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d080f153c0 con 0x55d08123fb40 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86fb7fe640 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08124af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86f3fff640 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08123fb40 0x55d081248210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f86e40edce0 tx=0x7f86e40bc700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac4e71e0f2f5cbf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86daffd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86daffd640 1 -- 172.21.15.98:0/171266381 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4049050 con 0x55d08123fb40 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f86daffd640 1 -- 172.21.15.98:0/171266381 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f86e40bcad0 con 0x55d08123fb40 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.801+0000 7f870455f740 1 -- 172.21.15.98:0/171266381 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d0811b1860 con 0x55d08123fb40 2024-09-19T07:24:40.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.802+0000 7f86daffd640 1 -- 172.21.15.98:0/171266381 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86e40bcf70 con 0x55d08123fb40 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.802+0000 7f870455f740 10 client.25514 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.802+0000 7f870455f740 1 -- 172.21.15.98:0/171266381 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d081259c70 con 0x55d08123fb40 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.802+0000 7f86daffd640 1 -- 172.21.15.98:0/171266381 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d0811b1860 con 0x55d08123fb40 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.802+0000 7f86daffd640 1 -- 172.21.15.98:0/171266381 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f86e40c5050 con 0x55d08123fb40 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.802+0000 7f870455f740 10 client.25514 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.802+0000 7f870455f740 10 client.25514 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.802+0000 7f870455f740 20 client.25514 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.802+0000 7f870455f740 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d08125b120 0x55d08125d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.802+0000 7f870455f740 4 client.25514 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.802+0000 7f870455f740 1 -- 172.21.15.98:0/171266381 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0811abd70 con 0x55d08125b120 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.802+0000 7f86fb7fe640 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d08125b120 0x55d08125d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.803+0000 7f86daffd640 10 client.25514 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:40.809 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:40.803+0000 7f86fb7fe640 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d08125b120 0x55d08125d540 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc092f4f2de07b9d server_cookie=c304571b97d798fa in_seq=0 out_seq=0 2024-09-19T07:24:41.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f86daffd640 1 -- 172.21.15.98:0/171266381 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0811abd70 con 0x55d08125b120 2024-09-19T07:24:41.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f86daffd640 10 client.25514 handle_command_reply: tid=0 2024-09-19T07:24:41.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f870455f740 1 client.25514 shutdown 2024-09-19T07:24:41.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f870455f740 1 -- 172.21.15.98:0/171266381 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08123fb40 msgr2=0x55d081248210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:41.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f870455f740 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08123fb40 0x55d081248210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f86e40edce0 tx=0x7f86e40bc700 comp rx=0 tx=0).stop 2024-09-19T07:24:41.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f870455f740 1 -- 172.21.15.98:0/171266381 shutdown_connections 2024-09-19T07:24:41.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f870455f740 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08124b580 0x55d0812487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f870455f740 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08123fb40 0x55d081248210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f870455f740 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d08125b120 0x55d08125d540 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f870455f740 1 --2- 172.21.15.98:0/171266381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08124af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f86daffd640 0 client.25514 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:41.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f870455f740 1 -- 172.21.15.98:0/171266381 >> 172.21.15.98:0/171266381 conn(0x55d081207310 msgr2=0x55d081240930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:41.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f870455f740 1 -- 172.21.15.98:0/171266381 shutdown_connections 2024-09-19T07:24:41.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f870455f740 1 -- 172.21.15.98:0/171266381 wait complete. 2024-09-19T07:24:41.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.066+0000 7f870455f740 20 client.25514 trim_cache size 0 max 16384 2024-09-19T07:24:41.089 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.085+0000 7f870455f740 1 Processor -- start 2024-09-19T07:24:41.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.088+0000 7f870455f740 1 -- start start 2024-09-19T07:24:41.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.088+0000 7f870455f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08124a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:41.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.088+0000 7f870455f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08123fb40 0x55d081262e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:41.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.088+0000 7f870455f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08124b580 0x55d081263350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:41.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.088+0000 7f870455f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1ae000 con 0x55d08123e5d0 2024-09-19T07:24:41.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.088+0000 7f870455f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1ab8d0 con 0x55d08124b580 2024-09-19T07:24:41.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.088+0000 7f870455f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1a9720 con 0x55d08123fb40 2024-09-19T07:24:41.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.089+0000 7f86fb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08124a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:41.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.089+0000 7f86fb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08124a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36376/0 (socket says 172.21.15.98:36376) 2024-09-19T07:24:41.090 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.089+0000 7f86fb7fe640 1 -- 172.21.15.98:0/1291530072 learned_addr learned my addr 172.21.15.98:0/1291530072 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:41.091 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.090+0000 7f86fbfff640 1 --2- 172.21.15.98:0/1291530072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08124b580 0x55d081263350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:41.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.090+0000 7f86f3fff640 1 --2- 172.21.15.98:0/1291530072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08123fb40 0x55d081262e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:41.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.091+0000 7f86fb7fe640 1 -- 172.21.15.98:0/1291530072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08123fb40 msgr2=0x55d081262e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:41.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.091+0000 7f86fb7fe640 1 --2- 172.21.15.98:0/1291530072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08123fb40 0x55d081262e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.091+0000 7f86fb7fe640 1 -- 172.21.15.98:0/1291530072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08124b580 msgr2=0x55d081263350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:41.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.091+0000 7f86fb7fe640 1 --2- 172.21.15.98:0/1291530072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08124b580 0x55d081263350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.091+0000 7f86fb7fe640 1 -- 172.21.15.98:0/1291530072 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d081241120 con 0x55d08123e5d0 2024-09-19T07:24:41.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.092+0000 7f86fb7fe640 1 --2- 172.21.15.98:0/1291530072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08124a180 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f86ec005d00 tx=0x7f86ec005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6e2d7a99228927 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:41.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.093+0000 7f86f17fa640 1 -- 172.21.15.98:0/1291530072 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec012300 con 0x55d08123e5d0 2024-09-19T07:24:41.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.093+0000 7f86f17fa640 1 -- 172.21.15.98:0/1291530072 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ec012670 con 0x55d08123e5d0 2024-09-19T07:24:41.094 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.094+0000 7f86f17fa640 1 -- 172.21.15.98:0/1291530072 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec003850 con 0x55d08123e5d0 2024-09-19T07:24:41.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.094+0000 7f870455f740 1 -- 172.21.15.98:0/1291530072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 msgr2=0x55d08124a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:41.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.094+0000 7f870455f740 1 --2- 172.21.15.98:0/1291530072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08124a180 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f86ec005d00 tx=0x7f86ec005fb0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.095+0000 7f870455f740 1 -- 172.21.15.98:0/1291530072 shutdown_connections 2024-09-19T07:24:41.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.095+0000 7f870455f740 1 --2- 172.21.15.98:0/1291530072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08124b580 0x55d081263350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.095+0000 7f870455f740 1 --2- 172.21.15.98:0/1291530072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08123fb40 0x55d081262e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.095+0000 7f870455f740 1 --2- 172.21.15.98:0/1291530072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123e5d0 0x55d08124a180 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.095+0000 7f870455f740 1 -- 172.21.15.98:0/1291530072 >> 172.21.15.98:0/1291530072 conn(0x55d081207310 msgr2=0x55d081249a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:41.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.095+0000 7f870455f740 1 -- 172.21.15.98:0/1291530072 shutdown_connections 2024-09-19T07:24:41.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.095+0000 7f870455f740 1 -- 172.21.15.98:0/1291530072 wait complete. 2024-09-19T07:24:41.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.095+0000 7f870455f740 1 -- start start 2024-09-19T07:24:41.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.095+0000 7f870455f740 1 Processor -- start 2024-09-19T07:24:41.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.096+0000 7f870455f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08123e5d0 0x55d081253910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:41.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.096+0000 7f870455f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123fb40 0x55d081253e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:41.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.096+0000 7f870455f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08124b580 0x55d081244c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:41.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.096+0000 7f870455f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1a9d90 con 0x55d08123fb40 2024-09-19T07:24:41.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.096+0000 7f870455f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1ab200 con 0x55d08124b580 2024-09-19T07:24:41.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.096+0000 7f870455f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc1aa460 con 0x55d08123e5d0 2024-09-19T07:24:41.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.096+0000 7f870455f740 10 client.0 _ll_register_callbacks cb 0x7f86e4005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:41.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.097+0000 7f86f3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123fb40 0x55d081253e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:41.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.097+0000 7f86f3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123fb40 0x55d081253e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:36390/0 (socket says 172.21.15.98:36390) 2024-09-19T07:24:41.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.097+0000 7f86f3fff640 1 -- 172.21.15.98:0/1908892225 learned_addr learned my addr 172.21.15.98:0/1908892225 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:41.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.098+0000 7f86f3fff640 1 -- 172.21.15.98:0/1908892225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08123e5d0 msgr2=0x55d081253910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:24:41.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.098+0000 7f86f3fff640 1 --2- 172.21.15.98:0/1908892225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08123e5d0 0x55d081253910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.098+0000 7f86f3fff640 1 -- 172.21.15.98:0/1908892225 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08124b580 msgr2=0x55d081244c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:41.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.098+0000 7f86f3fff640 1 --2- 172.21.15.98:0/1908892225 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08124b580 0x55d081244c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.098+0000 7f86f3fff640 1 -- 172.21.15.98:0/1908892225 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0812454a0 con 0x55d08123fb40 2024-09-19T07:24:41.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.099+0000 7f86f3fff640 1 --2- 172.21.15.98:0/1908892225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123fb40 0x55d081253e50 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f86e40bc800 tx=0x7f86e4009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475e5fffec690fce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:41.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.099+0000 7f86daffd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:41.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.100+0000 7f86daffd640 1 -- 172.21.15.98:0/1908892225 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4049070 con 0x55d08123fb40 2024-09-19T07:24:41.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.100+0000 7f870455f740 1 -- 172.21.15.98:0/1908892225 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86ec012670 con 0x55d08123fb40 2024-09-19T07:24:41.100 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.100+0000 7f86daffd640 1 -- 172.21.15.98:0/1908892225 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f86e40bccd0 con 0x55d08123fb40 2024-09-19T07:24:41.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.100+0000 7f86daffd640 1 -- 172.21.15.98:0/1908892225 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86e40bdba0 con 0x55d08123fb40 2024-09-19T07:24:41.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.101+0000 7f870455f740 10 client.16167 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:41.101 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.101+0000 7f870455f740 1 -- 172.21.15.98:0/1908892225 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d0812454a0 con 0x55d08123fb40 2024-09-19T07:24:41.102 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.102+0000 7f86daffd640 1 -- 172.21.15.98:0/1908892225 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86ec012670 con 0x55d08123fb40 2024-09-19T07:24:41.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.102+0000 7f86daffd640 1 -- 172.21.15.98:0/1908892225 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f86e40a5c90 con 0x55d08123fb40 2024-09-19T07:24:41.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.102+0000 7f870455f740 10 client.16167 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:41.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.102+0000 7f870455f740 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:41.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.102+0000 7f870455f740 20 client.16167 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:41.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.102+0000 7f870455f740 1 --2- 172.21.15.98:0/1908892225 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d0812dd640 0x55d0812dfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:41.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.102+0000 7f870455f740 4 client.16167 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:24:41.103 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.102+0000 7f870455f740 1 -- 172.21.15.98:0/1908892225 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d081128170 con 0x55d0812dd640 2024-09-19T07:24:41.107 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.107+0000 7f86fb7fe640 1 --2- 172.21.15.98:0/1908892225 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d0812dd640 0x55d0812dfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:41.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.113+0000 7f86daffd640 10 client.16167 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:41.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.113+0000 7f86fb7fe640 1 --2- 172.21.15.98:0/1908892225 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d0812dd640 0x55d0812dfb00 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d0582cb95884d85 server_cookie=4ce49727337192e in_seq=0 out_seq=0 2024-09-19T07:24:41.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.117+0000 7f86daffd640 1 -- 172.21.15.98:0/1908892225 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d081128170 con 0x55d0812dd640 2024-09-19T07:24:41.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.117+0000 7f86daffd640 10 client.16167 handle_command_reply: tid=0 2024-09-19T07:24:41.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.117+0000 7f870455f740 1 client.16167 shutdown 2024-09-19T07:24:41.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.117+0000 7f870455f740 1 -- 172.21.15.98:0/1908892225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123fb40 msgr2=0x55d081253e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:41.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.117+0000 7f870455f740 1 --2- 172.21.15.98:0/1908892225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123fb40 0x55d081253e50 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f86e40bc800 tx=0x7f86e4009560 comp rx=0 tx=0).stop 2024-09-19T07:24:41.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.119+0000 7f870455f740 1 -- 172.21.15.98:0/1908892225 shutdown_connections 2024-09-19T07:24:41.119 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.119+0000 7f870455f740 1 --2- 172.21.15.98:0/1908892225 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d08124b580 0x55d081244c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.119+0000 7f870455f740 1 --2- 172.21.15.98:0/1908892225 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55d0812dd640 0x55d0812dfb00 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.119+0000 7f870455f740 1 --2- 172.21.15.98:0/1908892225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d08123fb40 0x55d081253e50 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.119+0000 7f870455f740 1 --2- 172.21.15.98:0/1908892225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d08123e5d0 0x55d081253910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.119+0000 7f86daffd640 0 client.16167 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:41.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.119+0000 7f870455f740 1 -- 172.21.15.98:0/1908892225 >> 172.21.15.98:0/1908892225 conn(0x55d081207310 msgr2=0x55d081240930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:41.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.119+0000 7f870455f740 1 -- 172.21.15.98:0/1908892225 shutdown_connections 2024-09-19T07:24:41.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.119+0000 7f870455f740 1 -- 172.21.15.98:0/1908892225 wait complete. 2024-09-19T07:24:41.120 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.119+0000 7f870455f740 20 client.16167 trim_cache size 0 max 16384 2024-09-19T07:24:41.121 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:24:41.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.121+0000 7f8702186640 1 -- 172.21.15.98:0/2571237324 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f86e80a33b0 msgr2=0x7f86e80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:41.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.121+0000 7f8702186640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f86e80a33b0 0x7f86e80a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86f4005fd0 tx=0x7f86f4004a40 comp rx=0 tx=0).stop 2024-09-19T07:24:41.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.121+0000 7f8702186640 1 -- 172.21.15.98:0/2571237324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86fc102570 msgr2=0x7f86fc197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:41.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.121+0000 7f8702186640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86fc102570 0x7f86fc197920 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f86e4006010 tx=0x7f86e4003c10 comp rx=0 tx=0).stop 2024-09-19T07:24:41.121 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.121+0000 7f8702186640 1 -- 172.21.15.98:0/2571237324 shutdown_connections 2024-09-19T07:24:41.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.121+0000 7f8702186640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f86e80a33b0 0x7f86e80a5870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.121+0000 7f8702186640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f86fc102ef0 0x7f86fc19bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.121+0000 7f8702186640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86fc102570 0x7f86fc197920 secure :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f86e4006010 tx=0x7f86e4003c10 comp rx=0 tx=0).stop 2024-09-19T07:24:41.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.121+0000 7f8702186640 1 --2- 172.21.15.98:0/2571237324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86fc100e20 0x7f86fc1973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.121+0000 7f8702186640 1 -- 172.21.15.98:0/2571237324 >> 172.21.15.98:0/2571237324 conn(0x7f86fc0fc7d0 msgr2=0x7f86fc1068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:41.122 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.122+0000 7f8702186640 1 -- 172.21.15.98:0/2571237324 shutdown_connections 2024-09-19T07:24:41.123 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:41.122+0000 7f8702186640 1 -- 172.21.15.98:0/2571237324 wait complete. 2024-09-19T07:24:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.903+0000 7f0d99ffb640 1 -- 172.21.15.98:0/3930957772 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562e94959d70 con 0x562e94a74ad0 2024-09-19T07:24:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.903+0000 7f0d99ffb640 10 client.16149 handle_command_reply: tid=0 2024-09-19T07:24:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.903+0000 7f0dbbc7e740 1 client.16149 shutdown 2024-09-19T07:24:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.904+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/3930957772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 msgr2=0x562e949fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.904+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949fdc60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0dac011c40 tx=0x7f0dac011d30 comp rx=0 tx=0).stop 2024-09-19T07:24:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.904+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/3930957772 shutdown_connections 2024-09-19T07:24:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.904+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x562e94a74ad0 0x562e94a76ef0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.904+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562e949f8cb0 0x562e949fdc60 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.904+0000 7f0d99ffb640 0 client.16149 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.904+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562e949ee410 0x562e94a013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.904+0000 7f0dbbc7e740 1 --2- 172.21.15.98:0/3930957772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e949edaf0 0x562e94a00e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.904+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/3930957772 >> 172.21.15.98:0/3930957772 conn(0x562e949ea060 msgr2=0x562e949f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.904+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/3930957772 shutdown_connections 2024-09-19T07:24:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.904+0000 7f0dbbc7e740 1 -- 172.21.15.98:0/3930957772 wait complete. 2024-09-19T07:24:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.904+0000 7f0dbbc7e740 20 client.16149 trim_cache size 0 max 16384 2024-09-19T07:24:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:24:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:24:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:24:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:24:41.907 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.905+0000 7f0db8ee6640 1 -- 172.21.15.98:0/512737039 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0d9c0a3460 msgr2=0x7f0d9c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.905+0000 7f0db8ee6640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0d9c0a3460 0x7f0d9c0a5920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0dac013cf0 tx=0x7f0dac009f10 comp rx=0 tx=0).stop 2024-09-19T07:24:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.905+0000 7f0db8ee6640 1 -- 172.21.15.98:0/512737039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db41009b0 msgr2=0x7f0db4199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.905+0000 7f0db8ee6640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db41009b0 0x7f0db4199280 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0da400d770 tx=0x7f0da400dc30 comp rx=0 tx=0).stop 2024-09-19T07:24:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.905+0000 7f0db8ee6640 1 -- 172.21.15.98:0/512737039 shutdown_connections 2024-09-19T07:24:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.905+0000 7f0db8ee6640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0d9c0a3460 0x7f0d9c0a5920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.905+0000 7f0db8ee6640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0db41069c0 0x7f0db41a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.905+0000 7f0db8ee6640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0db4101350 0x7f0db41997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.905+0000 7f0db8ee6640 1 --2- 172.21.15.98:0/512737039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0db41009b0 0x7f0db4199280 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.905+0000 7f0db8ee6640 1 -- 172.21.15.98:0/512737039 >> 172.21.15.98:0/512737039 conn(0x7f0db4077990 msgr2=0x7f0db4103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.905+0000 7f0db8ee6640 1 -- 172.21.15.98:0/512737039 shutdown_connections 2024-09-19T07:24:41.908 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:41.905+0000 7f0db8ee6640 1 -- 172.21.15.98:0/512737039 wait complete. 2024-09-19T07:24:42.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:41 smithi162 ceph-mon[35726]: pgmap v82: 97 pgs: 97 active+clean; 65 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 470 op/s 2024-09-19T07:24:42.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:41 smithi098 ceph-mon[30950]: pgmap v82: 97 pgs: 97 active+clean; 65 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 470 op/s 2024-09-19T07:24:42.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:41 smithi139 ceph-mon[35039]: pgmap v82: 97 pgs: 97 active+clean; 65 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 470 op/s 2024-09-19T07:24:42.985 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T07:24:42.986 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T07:24:43.252 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:43.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.760+0000 7f53a30f6640 1 -- 172.21.15.98:0/592655748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539c102d30 msgr2=0x7f539c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:43.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.760+0000 7f53a30f6640 1 --2- 172.21.15.98:0/592655748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539c102d30 0x7f539c103110 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5398009930 tx=0x7f539802a420 comp rx=0 tx=0).stop 2024-09-19T07:24:43.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.760+0000 7f53a30f6640 1 -- 172.21.15.98:0/592655748 shutdown_connections 2024-09-19T07:24:43.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.760+0000 7f53a30f6640 1 --2- 172.21.15.98:0/592655748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f539c1082a0 0x7f539c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.760+0000 7f53a30f6640 1 --2- 172.21.15.98:0/592655748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c1036e0 0x7f539c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.760+0000 7f53a30f6640 1 --2- 172.21.15.98:0/592655748 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539c102d30 0x7f539c103110 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.760+0000 7f53a30f6640 1 -- 172.21.15.98:0/592655748 >> 172.21.15.98:0/592655748 conn(0x7f539c0fc7d0 msgr2=0x7f539c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:43.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.760+0000 7f53a30f6640 1 -- 172.21.15.98:0/592655748 shutdown_connections 2024-09-19T07:24:43.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.760+0000 7f53a30f6640 1 -- 172.21.15.98:0/592655748 wait complete. 2024-09-19T07:24:43.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.760+0000 7f53a30f6640 1 Processor -- start 2024-09-19T07:24:43.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.760+0000 7f53a30f6640 1 -- start start 2024-09-19T07:24:43.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a30f6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f539c102d30 0x7f539c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a30f6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c1036e0 0x7f539c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a30f6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539c1082a0 0x7f539c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a30f6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1120a0 con 0x7f539c1082a0 2024-09-19T07:24:43.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a30f6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f539c111f20 con 0x7f539c1036e0 2024-09-19T07:24:43.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a30f6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f539c112220 con 0x7f539c102d30 2024-09-19T07:24:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f5393fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c1036e0 0x7f539c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a1693640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539c1082a0 0x7f539c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a1693640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539c1082a0 0x7f539c101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41894/0 (socket says 172.21.15.98:41894) 2024-09-19T07:24:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a1693640 1 -- 172.21.15.98:0/2328298744 learned_addr learned my addr 172.21.15.98:0/2328298744 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f5393fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c1036e0 0x7f539c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:37246/0 (socket says 172.21.15.98:37246) 2024-09-19T07:24:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a0e92640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f539c102d30 0x7f539c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a1693640 1 -- 172.21.15.98:0/2328298744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f539c102d30 msgr2=0x7f539c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a1693640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f539c102d30 0x7f539c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a1693640 1 -- 172.21.15.98:0/2328298744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c1036e0 msgr2=0x7f539c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a1693640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c1036e0 0x7f539c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a1693640 1 -- 172.21.15.98:0/2328298744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539c1a6a80 con 0x7f539c1082a0 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f5393fff640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c1036e0 0x7f539c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a1693640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539c1082a0 0x7f539c101410 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f539400eaa0 tx=0x7f539400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f5391ffb640 1 -- 172.21.15.98:0/2328298744 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539400cdb0 con 0x7f539c1082a0 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f5391ffb640 1 -- 172.21.15.98:0/2328298744 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5394005020 con 0x7f539c1082a0 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.761+0000 7f53a30f6640 1 -- 172.21.15.98:0/2328298744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539c1a6d70 con 0x7f539c1082a0 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.762+0000 7f5391ffb640 1 -- 172.21.15.98:0/2328298744 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53940116b0 con 0x7f539c1082a0 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.762+0000 7f53a30f6640 1 -- 172.21.15.98:0/2328298744 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f539c1a72b0 con 0x7f539c1082a0 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.764+0000 7f5391ffb640 1 -- 172.21.15.98:0/2328298744 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5394005560 con 0x7f539c1082a0 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.764+0000 7f53a54cf740 1 Processor -- start 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.764+0000 7f53a54cf740 1 -- start start 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.764+0000 7f53a54cf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df736b60 0x5592df736f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.764+0000 7f53a54cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df741800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a54cf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df741d40 0x5592df744130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a54cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5592df69c280 con 0x5592df737480 2024-09-19T07:24:43.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a54cf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5592df643b10 con 0x5592df741d40 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a54cf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5592df698240 con 0x5592df736b60 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a0e92640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df741800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a0e92640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df741800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41898/0 (socket says 172.21.15.98:41898) 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a0e92640 1 -- 172.21.15.98:0/4196545077 learned_addr learned my addr 172.21.15.98:0/4196545077 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f5391ffb640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f53840a3430 0x7f53840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f5393fff640 1 --2- 172.21.15.98:0/4196545077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df741d40 0x5592df744130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a1693640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f53840a3430 0x7f53840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f5393fff640 1 --2- 172.21.15.98:0/4196545077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df736b60 0x5592df736f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a0e92640 1 -- 172.21.15.98:0/4196545077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df736b60 msgr2=0x5592df736f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a0e92640 1 --2- 172.21.15.98:0/4196545077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df736b60 0x5592df736f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a0e92640 1 -- 172.21.15.98:0/4196545077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df741d40 msgr2=0x5592df744130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a0e92640 1 --2- 172.21.15.98:0/4196545077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df741d40 0x5592df744130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a0e92640 1 -- 172.21.15.98:0/4196545077 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592df6501f0 con 0x5592df737480 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f5393fff640 1 --2- 172.21.15.98:0/4196545077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df736b60 0x5592df736f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f5391ffb640 1 -- 172.21.15.98:0/2328298744 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f53940cfe30 con 0x7f539c1082a0 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a0e92640 1 --2- 172.21.15.98:0/4196545077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df741800 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f539802a940 tx=0x7f5398005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c43e6000a68759 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f5382ffd640 1 -- 172.21.15.98:0/4196545077 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398040070 con 0x5592df737480 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f53a1693640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f53840a3430 0x7f53840a58f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f53940985f0 tx=0x7f53940bc040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f5382ffd640 1 -- 172.21.15.98:0/4196545077 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53980318f0 con 0x5592df737480 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.765+0000 7f5382ffd640 1 -- 172.21.15.98:0/4196545077 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398035040 con 0x5592df737480 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.766+0000 7f53a54cf740 1 -- 172.21.15.98:0/4196545077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 msgr2=0x5592df741800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.766+0000 7f53a54cf740 1 --2- 172.21.15.98:0/4196545077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df741800 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f539802a940 tx=0x7f5398005c00 comp rx=0 tx=0).stop 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.766+0000 7f53a54cf740 1 -- 172.21.15.98:0/4196545077 shutdown_connections 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.766+0000 7f53a54cf740 1 --2- 172.21.15.98:0/4196545077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df741d40 0x5592df744130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.766+0000 7f53a54cf740 1 --2- 172.21.15.98:0/4196545077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df741800 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.766+0000 7f53a54cf740 1 --2- 172.21.15.98:0/4196545077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df736b60 0x5592df736f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.766+0000 7f53a54cf740 1 -- 172.21.15.98:0/4196545077 >> 172.21.15.98:0/4196545077 conn(0x5592df7330f0 msgr2=0x5592df7334d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:43.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.766+0000 7f53a54cf740 1 -- 172.21.15.98:0/4196545077 shutdown_connections 2024-09-19T07:24:43.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.766+0000 7f53a54cf740 1 -- 172.21.15.98:0/4196545077 wait complete. 2024-09-19T07:24:43.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.767+0000 7f53a54cf740 1 -- start start 2024-09-19T07:24:43.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.767+0000 7f53a54cf740 1 Processor -- start 2024-09-19T07:24:43.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.767+0000 7f53a54cf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df736b60 0x5592df741800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.767+0000 7f53a54cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df73eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.767+0000 7f53a54cf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df741d40 0x5592df73f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.767+0000 7f53a54cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5592df744910 con 0x5592df737480 2024-09-19T07:24:43.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.767+0000 7f53a54cf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5592df656f10 con 0x5592df741d40 2024-09-19T07:24:43.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.767+0000 7f53a54cf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5592df744a90 con 0x5592df736b60 2024-09-19T07:24:43.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.767+0000 7f53a54cf740 10 client.0 _ll_register_callbacks cb 0x5592df61fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f53a0e92640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df73eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f53a0e92640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df73eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41906/0 (socket says 172.21.15.98:41906) 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f53a0e92640 1 -- 172.21.15.98:0/1457036932 learned_addr learned my addr 172.21.15.98:0/1457036932 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f5393fff640 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df741d40 0x5592df73f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f5393fff640 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df736b60 0x5592df741800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f53a0e92640 1 -- 172.21.15.98:0/1457036932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df736b60 msgr2=0x5592df741800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f53a0e92640 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df736b60 0x5592df741800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f53a0e92640 1 -- 172.21.15.98:0/1457036932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df741d40 msgr2=0x5592df73f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f53a0e92640 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df741d40 0x5592df73f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f53a0e92640 1 -- 172.21.15.98:0/1457036932 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592df40d6a0 con 0x5592df737480 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f53a0e92640 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df73eb50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f53980052d0 tx=0x7f53980054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717873006fac3c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f537bfff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:43.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f537bfff640 1 -- 172.21.15.98:0/1457036932 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398040030 con 0x5592df737480 2024-09-19T07:24:43.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f537bfff640 1 -- 172.21.15.98:0/1457036932 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f5398004260 con 0x5592df737480 2024-09-19T07:24:43.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f53a54cf740 1 -- 172.21.15.98:0/1457036932 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53980318f0 con 0x5592df737480 2024-09-19T07:24:43.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f537bfff640 1 -- 172.21.15.98:0/1457036932 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5398056050 con 0x5592df737480 2024-09-19T07:24:43.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f53a54cf740 10 client.16179 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:43.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.768+0000 7f53a54cf740 1 -- 172.21.15.98:0/1457036932 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5592df7503e0 con 0x5592df737480 2024-09-19T07:24:43.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.769+0000 7f537bfff640 1 -- 172.21.15.98:0/1457036932 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53980318f0 con 0x5592df737480 2024-09-19T07:24:43.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.769+0000 7f537bfff640 1 -- 172.21.15.98:0/1457036932 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f53980038c0 con 0x5592df737480 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.769+0000 7f53a54cf740 10 client.16179 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.769+0000 7f53a54cf740 10 client.16179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.769+0000 7f53a54cf740 20 client.16179 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.769+0000 7f53a54cf740 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5592df751730 0x5592df753b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.769+0000 7f53a54cf740 4 client.16179 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.769+0000 7f53a54cf740 1 -- 172.21.15.98:0/1457036932 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592df6a97f0 con 0x5592df751730 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.769+0000 7f5393fff640 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5592df751730 0x5592df753b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.769+0000 7f537bfff640 10 client.16179 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.769+0000 7f5393fff640 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5592df751730 0x5592df753b20 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fda6cd51ad4c2606 server_cookie=be6ff58a57066f1 in_seq=0 out_seq=0 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.770+0000 7f537bfff640 1 -- 172.21.15.98:0/1457036932 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5592df6a97f0 con 0x5592df751730 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.770+0000 7f537bfff640 10 client.16179 handle_command_reply: tid=0 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.770+0000 7f53a54cf740 1 client.16179 shutdown 2024-09-19T07:24:43.778 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.771+0000 7f53a54cf740 1 -- 172.21.15.98:0/1457036932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 msgr2=0x5592df73eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:43.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.771+0000 7f53a54cf740 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df73eb50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f53980052d0 tx=0x7f53980054b0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.771+0000 7f53a54cf740 1 -- 172.21.15.98:0/1457036932 shutdown_connections 2024-09-19T07:24:43.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.771+0000 7f53a54cf740 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df741d40 0x5592df73f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.771+0000 7f53a54cf740 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5592df751730 0x5592df753b20 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.771+0000 7f53a54cf740 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df73eb50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.771+0000 7f53a54cf740 1 --2- 172.21.15.98:0/1457036932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df736b60 0x5592df741800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.771+0000 7f537bfff640 0 client.16179 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:43.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.771+0000 7f53a54cf740 1 -- 172.21.15.98:0/1457036932 >> 172.21.15.98:0/1457036932 conn(0x5592df7330f0 msgr2=0x5592df732270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:43.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.771+0000 7f53a54cf740 1 -- 172.21.15.98:0/1457036932 shutdown_connections 2024-09-19T07:24:43.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.771+0000 7f53a54cf740 1 -- 172.21.15.98:0/1457036932 wait complete. 2024-09-19T07:24:43.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.771+0000 7f53a54cf740 20 client.16179 trim_cache size 0 max 16384 2024-09-19T07:24:43.791 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.790+0000 7f53a54cf740 1 Processor -- start 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.790+0000 7f53a54cf740 1 -- start start 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.790+0000 7f53a54cf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df736b60 0x5592df756b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.790+0000 7f53a54cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df757080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.790+0000 7f53a54cf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df741d40 0x5592df73bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.790+0000 7f53a54cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1b2460 con 0x5592df737480 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.790+0000 7f53a54cf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1afd30 con 0x5592df736b60 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.790+0000 7f53a54cf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1adb80 con 0x5592df741d40 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.790+0000 7f53a0e92640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df757080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f53a0e92640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df757080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41916/0 (socket says 172.21.15.98:41916) 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f53a0e92640 1 -- 172.21.15.98:0/2501142990 learned_addr learned my addr 172.21.15.98:0/2501142990 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f5393fff640 1 --2- 172.21.15.98:0/2501142990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df736b60 0x5592df756b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f5393fff640 1 --2- 172.21.15.98:0/2501142990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df741d40 0x5592df73bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.792 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f53a0e92640 1 -- 172.21.15.98:0/2501142990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df741d40 msgr2=0x5592df73bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:43.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f53a0e92640 1 --2- 172.21.15.98:0/2501142990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df741d40 0x5592df73bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f53a0e92640 1 -- 172.21.15.98:0/2501142990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df736b60 msgr2=0x5592df756b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:43.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f53a0e92640 1 --2- 172.21.15.98:0/2501142990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df736b60 0x5592df756b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f53a0e92640 1 -- 172.21.15.98:0/2501142990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592df732f20 con 0x5592df737480 2024-09-19T07:24:43.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f5393fff640 1 --2- 172.21.15.98:0/2501142990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df741d40 0x5592df73bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:24:43.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f53a0e92640 1 --2- 172.21.15.98:0/2501142990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df757080 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5398001eb0 tx=0x7f539802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204f7892057b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:43.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f53827fc640 1 -- 172.21.15.98:0/2501142990 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539805f070 con 0x5592df737480 2024-09-19T07:24:43.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f53827fc640 1 -- 172.21.15.98:0/2501142990 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f539804d070 con 0x5592df737480 2024-09-19T07:24:43.793 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.791+0000 7f53827fc640 1 -- 172.21.15.98:0/2501142990 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398040070 con 0x5592df737480 2024-09-19T07:24:43.796 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.792+0000 7f53a54cf740 1 -- 172.21.15.98:0/2501142990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 msgr2=0x5592df757080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.792+0000 7f53a54cf740 1 --2- 172.21.15.98:0/2501142990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df757080 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5398001eb0 tx=0x7f539802a420 comp rx=0 tx=0).stop 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.792+0000 7f53a54cf740 1 -- 172.21.15.98:0/2501142990 shutdown_connections 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.792+0000 7f53a54cf740 1 --2- 172.21.15.98:0/2501142990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df741d40 0x5592df73bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.792+0000 7f53a54cf740 1 --2- 172.21.15.98:0/2501142990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df737480 0x5592df757080 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.792+0000 7f53a54cf740 1 --2- 172.21.15.98:0/2501142990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df736b60 0x5592df756b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.792+0000 7f53a54cf740 1 -- 172.21.15.98:0/2501142990 >> 172.21.15.98:0/2501142990 conn(0x5592df7330f0 msgr2=0x5592df73dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.792+0000 7f53a54cf740 1 -- 172.21.15.98:0/2501142990 shutdown_connections 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.792+0000 7f53a54cf740 1 -- 172.21.15.98:0/2501142990 wait complete. 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.792+0000 7f53a54cf740 1 -- start start 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.792+0000 7f53a54cf740 1 Processor -- start 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f53a54cf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df736b60 0x5592df756eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f53a54cf740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df737480 0x5592df7573f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f53a54cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df741d40 0x5592df7554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f53a54cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1ae1f0 con 0x5592df741d40 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f53a54cf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1af660 con 0x5592df736b60 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f53a54cf740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1ae8c0 con 0x5592df737480 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f53a54cf740 10 client.0 _ll_register_callbacks cb 0x7f5398005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f5393fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df741d40 0x5592df7554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f5393fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df741d40 0x5592df7554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41924/0 (socket says 172.21.15.98:41924) 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f5393fff640 1 -- 172.21.15.98:0/1176784117 learned_addr learned my addr 172.21.15.98:0/1176784117 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f5393fff640 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df736b60 0x5592df756eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f53a0e92640 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df737480 0x5592df7573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f5393fff640 1 -- 172.21.15.98:0/1176784117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df737480 msgr2=0x5592df7573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f5393fff640 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df737480 0x5592df7573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f5393fff640 1 -- 172.21.15.98:0/1176784117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df736b60 msgr2=0x5592df756eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:43.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f5393fff640 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df736b60 0x5592df756eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f5393fff640 1 -- 172.21.15.98:0/1176784117 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592df755cb0 con 0x5592df741d40 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f5393fff640 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df741d40 0x5592df7554b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f539c102420 tx=0x7f538c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a4e30e49dd7d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.793+0000 7f537bfff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f537bfff640 1 -- 172.21.15.98:0/1176784117 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c026070 con 0x5592df741d40 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f537bfff640 1 -- 172.21.15.98:0/1176784117 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f538c004030 con 0x5592df741d40 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f53a54cf740 1 -- 172.21.15.98:0/1176784117 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f539804d070 con 0x5592df741d40 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f537bfff640 1 -- 172.21.15.98:0/1176784117 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f538c004230 con 0x5592df741d40 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f53a54cf740 10 client.16185 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f53a54cf740 1 -- 172.21.15.98:0/1176784117 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5592df7bccd0 con 0x5592df741d40 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f537bfff640 1 -- 172.21.15.98:0/1176784117 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f539804d070 con 0x5592df741d40 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f537bfff640 1 -- 172.21.15.98:0/1176784117 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f538c003680 con 0x5592df741d40 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f53a54cf740 10 client.16185 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:43.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f53a54cf740 10 client.16185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:43.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f53a54cf740 20 client.16185 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:43.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f53a54cf740 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5592df7bd380 0x5592df7bf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:43.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f53a54cf740 4 client.16185 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T07:24:43.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f53a54cf740 1 -- 172.21.15.98:0/1176784117 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5592df6a3d00 con 0x5592df7bd380 2024-09-19T07:24:43.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.794+0000 7f53a0e92640 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5592df7bd380 0x5592df7bf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:43.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.795+0000 7f537bfff640 10 client.16185 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:43.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.795+0000 7f53a0e92640 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5592df7bd380 0x5592df7bf7a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa565cd26e794843 server_cookie=7bfb92439292db14 in_seq=0 out_seq=0 2024-09-19T07:24:43.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f537bfff640 1 -- 172.21.15.98:0/1176784117 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5592df6a3d00 con 0x5592df7bd380 2024-09-19T07:24:43.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f537bfff640 10 client.16185 handle_command_reply: tid=0 2024-09-19T07:24:43.930 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f53a54cf740 1 client.16185 shutdown 2024-09-19T07:24:43.931 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:43 smithi098 ceph-mon[30950]: pgmap v83: 97 pgs: 97 active+clean; 65 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 470 op/s 2024-09-19T07:24:43.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f53a54cf740 1 -- 172.21.15.98:0/1176784117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df741d40 msgr2=0x5592df7554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:43.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f53a54cf740 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df741d40 0x5592df7554b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f539c102420 tx=0x7f538c005f90 comp rx=0 tx=0).stop 2024-09-19T07:24:43.934 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f53a54cf740 1 -- 172.21.15.98:0/1176784117 shutdown_connections 2024-09-19T07:24:43.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f53a54cf740 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5592df7bd380 0x5592df7bf7a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f53a54cf740 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5592df741d40 0x5592df7554b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f53a54cf740 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592df737480 0x5592df7573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f53a54cf740 1 --2- 172.21.15.98:0/1176784117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592df736b60 0x5592df756eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f53a54cf740 1 -- 172.21.15.98:0/1176784117 >> 172.21.15.98:0/1176784117 conn(0x5592df7330f0 msgr2=0x5592df74cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:43.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f537bfff640 0 client.16185 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:43.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f53a54cf740 1 -- 172.21.15.98:0/1176784117 shutdown_connections 2024-09-19T07:24:43.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f53a54cf740 1 -- 172.21.15.98:0/1176784117 wait complete. 2024-09-19T07:24:43.935 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.930+0000 7f53a54cf740 20 client.16185 trim_cache size 0 max 16384 2024-09-19T07:24:43.935 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:24:43.936 INFO:teuthology.orchestra.run.smithi098.stdout: "return_code": 0, 2024-09-19T07:24:43.936 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_tag": "24d01d2c-d989-4974-baee-7bc9d460d802", 2024-09-19T07:24:43.936 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": "asynchronous" 2024-09-19T07:24:43.936 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:24:43.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.931+0000 7f53a30f6640 1 -- 172.21.15.98:0/2328298744 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f53840a3430 msgr2=0x7f53840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:43.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.931+0000 7f53a30f6640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f53840a3430 0x7f53840a58f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f53940985f0 tx=0x7f53940bc040 comp rx=0 tx=0).stop 2024-09-19T07:24:43.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.931+0000 7f53a30f6640 1 -- 172.21.15.98:0/2328298744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539c1082a0 msgr2=0x7f539c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:43.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.931+0000 7f53a30f6640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539c1082a0 0x7f539c101410 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f539400eaa0 tx=0x7f539400ef60 comp rx=0 tx=0).stop 2024-09-19T07:24:43.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.931+0000 7f53a30f6640 1 -- 172.21.15.98:0/2328298744 shutdown_connections 2024-09-19T07:24:43.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.931+0000 7f53a30f6640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f53840a3430 0x7f53840a58f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.931+0000 7f53a30f6640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f539c1082a0 0x7f539c101410 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.931+0000 7f53a30f6640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f539c1036e0 0x7f539c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.931+0000 7f53a30f6640 1 --2- 172.21.15.98:0/2328298744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f539c102d30 0x7f539c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:43.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.931+0000 7f53a30f6640 1 -- 172.21.15.98:0/2328298744 >> 172.21.15.98:0/2328298744 conn(0x7f539c0fc7d0 msgr2=0x7f539c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:43.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.931+0000 7f53a30f6640 1 -- 172.21.15.98:0/2328298744 shutdown_connections 2024-09-19T07:24:43.938 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:43.931+0000 7f53a30f6640 1 -- 172.21.15.98:0/2328298744 wait complete. 2024-09-19T07:24:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:43 smithi162 ceph-mon[35726]: pgmap v83: 97 pgs: 97 active+clean; 65 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 470 op/s 2024-09-19T07:24:44.132 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.011+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e9c [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/ auth v40 ap=1 f(v0 m2024-09-19T07:24:36.425921+0000 2=2+0) n(v0 rc2024-09-19T07:24:36.425921+0000 3=2+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed3ee1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e9c:[<0x10000001e8a/timers v40>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001e9c:[<0x10000001e8a/timers v40>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.425921+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.425921+0000 3=2+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.425921+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.425921+0000 3=2+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.132 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.012+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e9f [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/ auth v87 ap=1 f(v0 m2024-09-19T07:24:36.614919+0000 19=2+17) n(v1 rc2024-09-19T07:24:36.619919+0000 134=116+18) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed524b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e9f:[<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001e9f:[<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.614919+0000 19=2+17)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.619919+0000 134=116+18)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.614919+0000 19=2+17)","memory_value.rstat":"n(v1 rc2024-09-19T07:24:36.619919+0000 134=116+18)","error_str":""},"return_code":0} 2024-09-19T07:24:44.133 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.012+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e95 [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/ auth v34 ap=1 f(v0 m2024-09-19T07:24:36.422921+0000 6=6+0) n(v0 rc2024-09-19T07:24:36.422921+0000 7=6+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e95:[<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001e95:[<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.422921+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.422921+0000 7=6+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.422921+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.422921+0000 7=6+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.133 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.012+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e8d [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/ auth v20 ap=1 f(v0 m2024-09-19T07:24:36.414921+0000 7=7+0) n(v0 rc2024-09-19T07:24:36.414921+0000 8=7+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e8d:[<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001e8d:[<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.414921+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.414921+0000 8=7+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.414921+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.414921+0000 8=7+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.133 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.012+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e9e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/plan.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e9e:[<0x10000001e9c/plan.txt v4>,<0x10000001e8a/timers v40>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e9e:[<0x10000001e9c/plan.txt v4>,<0x10000001e8a/timers v40>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.133 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.013+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eec [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/ auth v166 ap=1 f(v0 m2024-09-19T07:24:36.556919+0000 6=6+0) n(v0 rc2024-09-19T07:24:36.556919+0000 7=6+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001eec:[<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001eec:[<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.556919+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.556919+0000 7=6+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.556919+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.556919+0000 7=6+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.139 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.013+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f14 [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/ auth v250 ap=1 f(v0 m2024-09-19T07:24:36.613919+0000 8=8+0) n(v0 rc2024-09-19T07:24:36.613919+0000 9=8+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001f14:[<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001f14:[<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.613919+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.613919+0000 9=8+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.613919+0000 8=8+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.613919+0000 9=8+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.139 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.014+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e9d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/keytests.sh auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e9d:[<0x10000001e9c/keytests.sh v2>,<0x10000001e8a/timers v40>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e9d:[<0x10000001e9c/keytests.sh v2>,<0x10000001e8a/timers v40>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.139 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.014+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed5 [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/ auth v124 ap=1 f(v0 m2024-09-19T07:24:36.517920+0000 8=8+0) n(v0 rc2024-09-19T07:24:36.517920+0000 9=8+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001ed5:[<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001ed5:[<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.517920+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.517920+0000 9=8+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.517920+0000 8=8+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.517920+0000 9=8+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.140 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.015+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea0 [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/ auth v16 ap=1 f(v0 m2024-09-19T07:24:36.435921+0000 7=7+0) n(v0 rc2024-09-19T07:24:36.435921+0000 8=7+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001ea0:[<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001ea0:[<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.435921+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.435921+0000 8=7+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.435921+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.435921+0000 8=7+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.140 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.015+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea8 [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/ auth v30 ap=1 f(v0 m2024-09-19T07:24:36.445921+0000 6=6+0) n(v0 rc2024-09-19T07:24:36.445921+0000 7=6+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001ea8:[<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001ea8:[<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.445921+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.445921+0000 7=6+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.445921+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.445921+0000 7=6+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.140 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.016+0000 7fc7600c2640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e8b [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals/ auth{0=1,1=1} v88 ap=2 RANDEPHEMERALPIN f(v0 m2024-09-19T07:24:36.404921+0000 1=1+0) n(v0 rc2024-09-19T07:24:36.406921+0000 2=1+1) (inest sync->mix g=0,1) caps={24761=pAsLsXsFs/pAsLsXsFsx@2} | lock=0 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 randepin 0x557ed524b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e8b:[<0x10000001e8a/signals v4>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001e8b:[<0x10000001e8a/signals v88>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.404921+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.404921+0000 2=1+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.404921+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.406921+0000 2=1+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.140 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.016+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef3 [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/ auth v180 ap=1 f(v0 m2024-09-19T07:24:36.568919+0000 6=6+0) n(v0 rc2024-09-19T07:24:36.568919+0000 7=6+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001ef3:[<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001ef3:[<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.568919+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.568919+0000 7=6+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.568919+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.568919+0000 7=6+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.140 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.016+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb7 [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/ auth v60 ap=1 f(v0 m2024-09-19T07:24:36.465921+0000 6=6+0) n(v0 rc2024-09-19T07:24:36.465921+0000 7=6+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001eb7:[<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001eb7:[<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.465921+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.465921+0000 7=6+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.465921+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.465921+0000 7=6+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.141 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.017+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f0a [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/ auth v230 ap=1 f(v0 m2024-09-19T07:24:36.604919+0000 8=8+0) n(v0 rc2024-09-19T07:24:36.604919+0000 9=8+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001f0a:[<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001f0a:[<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.604919+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.604919+0000 9=8+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.604919+0000 8=8+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.604919+0000 9=8+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.142 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.017+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee6 [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/ auth v152 ap=1 f(v0 m2024-09-19T07:24:36.543920+0000 5=5+0) n(v0 rc2024-09-19T07:24:36.543920+0000 6=5+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001ee6:[<0x10000001e9f/pthread_cond_wait v152>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001ee6:[<0x10000001e9f/pthread_cond_wait v152>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.543920+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.543920+0000 6=5+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.543920+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.543920+0000 6=5+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.142 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.017+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f13 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/helper.c auth v232 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f13:[<0x10000001e9f/helper.c v232>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f13:[<0x10000001e9f/helper.c v232>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.142 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.018+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ecd [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/ auth v106 ap=1 f(v0 m2024-09-19T07:24:36.501920+0000 7=7+0) n(v0 rc2024-09-19T07:24:36.501920+0000 8=7+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001ecd:[<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001ecd:[<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.501920+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.501920+0000 8=7+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.501920+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.501920+0000 8=7+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.142 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.018+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eaf [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/ auth v46 ap=1 f(v0 m2024-09-19T07:24:36.456921+0000 7=7+0) n(v0 rc2024-09-19T07:24:36.456921+0000 8=7+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001eaf:[<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001eaf:[<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.456921+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.456921+0000 8=7+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.456921+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.456921+0000 8=7+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.142 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.018+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f03 [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/ auth v212 ap=1 f(v0 m2024-09-19T07:24:36.596919+0000 6=6+0) n(v0 rc2024-09-19T07:24:36.596919+0000 7=6+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50d9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001f03:[<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001f03:[<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.596919+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.596919+0000 7=6+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.596919+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.596919+0000 7=6+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.142 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.019+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec6 [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/ auth v90 ap=1 f(v0 m2024-09-19T07:24:36.488920+0000 6=6+0) n(v0 rc2024-09-19T07:24:36.488920+0000 7=6+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50da100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001ec6:[<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001ec6:[<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.488920+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.488920+0000 7=6+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.488920+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.488920+0000 7=6+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.142 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.019+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ede [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/ auth v140 ap=1 f(v0 m2024-09-19T07:24:36.533920+0000 7=7+0) n(v0 rc2024-09-19T07:24:36.533920+0000 8=7+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50da680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001ede:[<0x10000001e9f/fork v140>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001ede:[<0x10000001e9f/fork v140>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.533920+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.533920+0000 8=7+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.533920+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.533920+0000 8=7+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.142 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.019+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ebe [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/ auth v76 ap=1 f(v0 m2024-09-19T07:24:36.476920+0000 7=7+0) n(v0 rc2024-09-19T07:24:36.476920+0000 8=7+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001ebe:[<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001ebe:[<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.476920+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.476920+0000 8=7+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.476920+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.476920+0000 8=7+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.142 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.019+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f1d [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/ auth v266 ap=1 f(v0 m2024-09-19T07:24:36.619919+0000 7=7+0) n(v0 rc2024-09-19T07:24:36.619919+0000 8=7+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50db180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001f1d:[<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001f1d:[<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.619919+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.619919+0000 8=7+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.619919+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.619919+0000 8=7+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.142 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.020+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efa [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/assertions.xml auth v182 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed53ae000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001efa:[<0x10000001e9f/assertions.xml v182>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001efa:[<0x10000001e9f/assertions.xml v182>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.143 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.020+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e9b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/plan.txt auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e9b:[<0x10000001e95/plan.txt v12>,<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e9b:[<0x10000001e95/plan.txt v12>,<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.143 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.020+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efb [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/ auth v198 ap=1 f(v0 m2024-09-19T07:24:36.585919+0000 7=7+0) n(v0 rc2024-09-19T07:24:36.585919+0000 8=7+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed50db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001efb:[<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000001efb:[<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:36.585919+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:36.585919+0000 8=7+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:36.585919+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:36.585919+0000 8=7+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.143 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.020+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e9a [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/run.sh auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e9a:[<0x10000001e95/run.sh v10>,<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e9a:[<0x10000001e95/run.sh v10>,<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.143 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.020+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e99 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/multi_con_pro.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54fc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e99:[<0x10000001e95/multi_con_pro.c v8>,<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e99:[<0x10000001e95/multi_con_pro.c v8>,<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.143 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.020+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e96 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/coverage.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e96:[<0x10000001e95/coverage.txt v2>,<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e96:[<0x10000001e95/coverage.txt v2>,<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.143 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.020+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e97 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e97:[<0x10000001e95/Makefile v4>,<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e97:[<0x10000001e95/Makefile v4>,<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.143 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.021+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e98 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/assertions.xml auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e98:[<0x10000001e95/assertions.xml v6>,<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e98:[<0x10000001e95/assertions.xml v6>,<0x10000001e8a/semaphores v34>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.143 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.021+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e94 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/plan.txt auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5504000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e94:[<0x10000001e8d/plan.txt v14>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e94:[<0x10000001e8d/plan.txt v14>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.143 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.021+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e93 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/run.sh auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5504580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e93:[<0x10000001e8d/run.sh v12>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e93:[<0x10000001e8d/run.sh v12>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.143 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.021+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e8f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/coverage.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5504b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e8f:[<0x10000001e8d/coverage.txt v4>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e8f:[<0x10000001e8d/coverage.txt v4>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.145 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.021+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e90 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/Makefile auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5505080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e90:[<0x10000001e8d/Makefile v6>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e90:[<0x10000001e8d/Makefile v6>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.145 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.022+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e8e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/multi_send_rev_1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5505600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e8e:[<0x10000001e8d/multi_send_rev_1.c v2>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e8e:[<0x10000001e8d/multi_send_rev_1.c v2>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.145 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.022+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e92 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/multi_send_rev_2.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5505b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e92:[<0x10000001e8d/multi_send_rev_2.c v10>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e92:[<0x10000001e8d/multi_send_rev_2.c v10>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.145 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.022+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e91 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/assertions.xml auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5506100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e91:[<0x10000001e8d/assertions.xml v8>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e91:[<0x10000001e8d/assertions.xml v8>,<0x10000001e8a/mqueues v20>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.145 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.022+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eed [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/stress.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed53ae580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eed:[<0x10000001eec/stress.c v2>,<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eed:[<0x10000001eec/stress.c v2>,<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.145 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.022+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef0 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed53aeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef0:[<0x10000001eec/testfrmw.h v8>,<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ef0:[<0x10000001eec/testfrmw.h v8>,<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.146 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.022+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eee [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed53af080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eee:[<0x10000001eec/Makefile v4>,<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eee:[<0x10000001eec/Makefile v4>,<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.146 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.023+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef1 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/NOTES auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed53af600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef1:[<0x10000001eec/NOTES v10>,<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ef1:[<0x10000001eec/NOTES v10>,<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.146 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.023+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef2 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/LICENCE auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed53afb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef2:[<0x10000001eec/LICENCE v12>,<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ef2:[<0x10000001eec/LICENCE v12>,<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.146 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.024+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eef [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed53b0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eef:[<0x10000001eec/testfrmw.c v6>,<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eef:[<0x10000001eec/testfrmw.c v6>,<0x10000001e9f/pthread_kill v166>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.146 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.024+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f1c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/threads_scenarii.c auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed53b0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f1c:[<0x10000001f14/threads_scenarii.c v16>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f1c:[<0x10000001f14/threads_scenarii.c v16>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.146 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.024+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f19 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/do-plot auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed53b0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f19:[<0x10000001f14/do-plot v10>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f19:[<0x10000001f14/do-plot v10>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.146 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.024+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f15 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/s-c1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed53b1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f15:[<0x10000001f14/s-c1.c v2>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f15:[<0x10000001f14/s-c1.c v2>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.146 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.024+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f16 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5322000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f16:[<0x10000001f14/Makefile v4>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f16:[<0x10000001f14/Makefile v4>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.146 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.024+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f18 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed53b1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f18:[<0x10000001f14/testfrmw.h v8>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f18:[<0x10000001f14/testfrmw.h v8>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.146 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.024+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f1b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/LICENCE auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5322b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f1b:[<0x10000001f14/LICENCE v14>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f1b:[<0x10000001f14/LICENCE v14>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.146 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.025+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f1a [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/NOTES auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5322580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f1a:[<0x10000001f14/NOTES v12>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f1a:[<0x10000001f14/NOTES v12>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.147 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.025+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f17 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5323080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f17:[<0x10000001f14/testfrmw.c v6>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f17:[<0x10000001f14/testfrmw.c v6>,<0x10000001e9f/pthread_create v250>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.147 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.025+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed6 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/stress.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5323600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed6:[<0x10000001ed5/stress.c v2>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ed6:[<0x10000001ed5/stress.c v2>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.147 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.025+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed7 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/s-c1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5323b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed7:[<0x10000001ed5/s-c1.c v4>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ed7:[<0x10000001ed5/s-c1.c v4>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.147 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.025+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001edb [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/testfrmw.h auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5324100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001edb:[<0x10000001ed5/testfrmw.h v12>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001edb:[<0x10000001ed5/testfrmw.h v12>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.148 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.025+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed9 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/Makefile auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5324680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed9:[<0x10000001ed5/Makefile v8>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ed9:[<0x10000001ed5/Makefile v8>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.148 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.025+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed8 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/s-c2.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5324c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed8:[<0x10000001ed5/s-c2.c v6>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ed8:[<0x10000001ed5/s-c2.c v6>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.148 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.026+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001edc [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/NOTES auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5325180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001edc:[<0x10000001ed5/NOTES v14>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001edc:[<0x10000001ed5/NOTES v14>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.149 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.026+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001edd [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/LICENCE auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5325700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001edd:[<0x10000001ed5/LICENCE v16>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001edd:[<0x10000001ed5/LICENCE v16>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.149 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.026+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eda [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/testfrmw.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed532c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eda:[<0x10000001ed5/testfrmw.c v10>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eda:[<0x10000001ed5/testfrmw.c v10>,<0x10000001e9f/pthread_mutex_lock v124>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.149 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.026+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea5 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/do-plot auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed532c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ea5:[<0x10000001ea0/do-plot v10>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ea5:[<0x10000001ea0/do-plot v10>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.149 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.026+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea1 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/s-c1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed532cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ea1:[<0x10000001ea0/s-c1.c v2>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ea1:[<0x10000001ea0/s-c1.c v2>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.149 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.026+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea4 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed532d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ea4:[<0x10000001ea0/testfrmw.h v8>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ea4:[<0x10000001ea0/testfrmw.h v8>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.149 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.026+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea2 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed532d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ea2:[<0x10000001ea0/Makefile v4>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ea2:[<0x10000001ea0/Makefile v4>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.149 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.027+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea6 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/NOTES auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed532db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ea6:[<0x10000001ea0/NOTES v12>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ea6:[<0x10000001ea0/NOTES v12>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.149 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.027+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea7 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/LICENCE auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed532e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ea7:[<0x10000001ea0/LICENCE v14>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ea7:[<0x10000001ea0/LICENCE v14>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.149 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.027+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea3 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed532e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ea3:[<0x10000001ea0/testfrmw.c v6>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ea3:[<0x10000001ea0/testfrmw.c v6>,<0x10000001e9f/sem_init v16>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.149 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.027+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea9 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/stress.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed532ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ea9:[<0x10000001ea8/stress.c v2>,<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ea9:[<0x10000001ea8/stress.c v2>,<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.149 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.027+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eac [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed532f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eac:[<0x10000001ea8/testfrmw.h v8>,<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eac:[<0x10000001ea8/testfrmw.h v8>,<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.150 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.027+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eaa [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed532f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eaa:[<0x10000001ea8/Makefile v4>,<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eaa:[<0x10000001ea8/Makefile v4>,<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.150 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.027+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ead [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/NOTES auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5398000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ead:[<0x10000001ea8/NOTES v10>,<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ead:[<0x10000001ea8/NOTES v10>,<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.150 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.028+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eae [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/LICENCE auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5398580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eae:[<0x10000001ea8/LICENCE v12>,<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eae:[<0x10000001ea8/LICENCE v12>,<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.151 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.028+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eab [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5398b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eab:[<0x10000001ea8/testfrmw.c v6>,<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eab:[<0x10000001ea8/testfrmw.c v6>,<0x10000001e9f/pthread_getschedparam v30>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.151 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.028+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef4 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/stress.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5399080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef4:[<0x10000001ef3/stress.c v2>,<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ef4:[<0x10000001ef3/stress.c v2>,<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.152 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.028+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef7 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5399600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef7:[<0x10000001ef3/testfrmw.h v8>,<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ef7:[<0x10000001ef3/testfrmw.h v8>,<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.152 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.028+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef5 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5399b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef5:[<0x10000001ef3/Makefile v4>,<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ef5:[<0x10000001ef3/Makefile v4>,<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.152 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.028+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef8 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/NOTES auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed539a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef8:[<0x10000001ef3/NOTES v10>,<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ef8:[<0x10000001ef3/NOTES v10>,<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.152 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.028+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef9 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/LICENCE auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed539a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef9:[<0x10000001ef3/LICENCE v12>,<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ef9:[<0x10000001ef3/LICENCE v12>,<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.152 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.028+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef6 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed539ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef6:[<0x10000001ef3/testfrmw.c v6>,<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ef6:[<0x10000001ef3/testfrmw.c v6>,<0x10000001e9f/pthread_cancel v180>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.152 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.028+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb8 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/stress.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed539b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb8:[<0x10000001eb7/stress.c v2>,<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eb8:[<0x10000001eb7/stress.c v2>,<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.152 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.028+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ebb [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed539b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ebb:[<0x10000001eb7/testfrmw.h v8>,<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ebb:[<0x10000001eb7/testfrmw.h v8>,<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.152 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.029+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb9 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5150000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb9:[<0x10000001eb7/Makefile v4>,<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eb9:[<0x10000001eb7/Makefile v4>,<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.152 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.029+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ebc [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/NOTES auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5150580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ebc:[<0x10000001eb7/NOTES v10>,<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ebc:[<0x10000001eb7/NOTES v10>,<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.152 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.029+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ebd [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/LICENCE auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5150b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ebd:[<0x10000001eb7/LICENCE v12>,<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ebd:[<0x10000001eb7/LICENCE v12>,<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.152 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.029+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eba [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5151080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eba:[<0x10000001eb7/testfrmw.c v6>,<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eba:[<0x10000001eb7/testfrmw.c v6>,<0x10000001e9f/sem_getvalue v60>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.153 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.029+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f11 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/do-plot auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5151600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f11:[<0x10000001f0a/do-plot v14>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f11:[<0x10000001f0a/do-plot v14>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.153 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.029+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f10 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/stress2.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5151b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f10:[<0x10000001f0a/stress2.c v12>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f10:[<0x10000001f0a/stress2.c v12>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.153 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.029+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f0f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/testfrmw.h auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5152100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f0f:[<0x10000001f0a/testfrmw.h v10>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f0f:[<0x10000001f0a/testfrmw.h v10>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.153 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.030+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f0d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/Makefile auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5152680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f0d:[<0x10000001f0a/Makefile v6>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f0d:[<0x10000001f0a/Makefile v6>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.153 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.030+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f12 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/NOTES auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5152c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f12:[<0x10000001f0a/NOTES v16>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f12:[<0x10000001f0a/NOTES v16>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.153 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.030+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f0b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/s-c.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5153180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f0b:[<0x10000001f0a/s-c.c v2>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f0b:[<0x10000001f0a/s-c.c v2>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.153 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.030+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f0c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/stress1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5153700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f0c:[<0x10000001f0a/stress1.c v4>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f0c:[<0x10000001f0a/stress1.c v4>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.153 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.030+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f0e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/testfrmw.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5158000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f0e:[<0x10000001f0a/testfrmw.c v8>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f0e:[<0x10000001f0a/testfrmw.c v8>,<0x10000001e9f/pthread_cond_timedwait v230>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.153 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.030+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eeb [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress2.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5158580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eeb:[<0x10000001ee6/stress2.c v10>,<0x10000001e9f/pthread_cond_wait v152>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eeb:[<0x10000001ee6/stress2.c v10>,<0x10000001e9f/pthread_cond_wait v152>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.153 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.031+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee7 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5158b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee7:[<0x10000001ee6/stress.c v2>,<0x10000001e9f/pthread_cond_wait v152>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ee7:[<0x10000001ee6/stress.c v2>,<0x10000001e9f/pthread_cond_wait v152>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.154 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.031+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eea [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5159080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eea:[<0x10000001ee6/testfrmw.h v8>,<0x10000001e9f/pthread_cond_wait v152>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eea:[<0x10000001ee6/testfrmw.h v8>,<0x10000001e9f/pthread_cond_wait v152>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.154 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.031+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee8 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5159600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee8:[<0x10000001ee6/stress1.c v4>,<0x10000001e9f/pthread_cond_wait v152>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ee8:[<0x10000001ee6/stress1.c v4>,<0x10000001e9f/pthread_cond_wait v152>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.154 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.031+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee9 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5159b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee9:[<0x10000001ee6/testfrmw.c v6>,<0x10000001e9f/pthread_cond_wait v152>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ee9:[<0x10000001ee6/testfrmw.c v6>,<0x10000001e9f/pthread_cond_wait v152>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.154 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.031+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ece [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/stress.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed515a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ece:[<0x10000001ecd/stress.c v2>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ece:[<0x10000001ecd/stress.c v2>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.154 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.031+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed2 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/testfrmw.h auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed515a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed2:[<0x10000001ecd/testfrmw.h v10>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ed2:[<0x10000001ecd/testfrmw.h v10>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.155 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.031+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed0 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/Makefile auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed515ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed0:[<0x10000001ecd/Makefile v6>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ed0:[<0x10000001ecd/Makefile v6>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.155 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.032+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed3 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/NOTES auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed515b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed3:[<0x10000001ecd/NOTES v12>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ed3:[<0x10000001ecd/NOTES v12>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.155 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.032+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed4 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/LICENCE auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed515b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed4:[<0x10000001ecd/LICENCE v14>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ed4:[<0x10000001ecd/LICENCE v14>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.155 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.032+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ecf [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/s-c.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54c4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ecf:[<0x10000001ecd/s-c.c v4>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ecf:[<0x10000001ecd/s-c.c v4>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.156 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.032+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed1 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/testfrmw.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54c4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed1:[<0x10000001ecd/testfrmw.c v8>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ed1:[<0x10000001ecd/testfrmw.c v8>,<0x10000001e9f/pthread_mutex_init v106>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.156 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.032+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb4 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/do-plot auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54c4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb4:[<0x10000001eaf/do-plot v10>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eb4:[<0x10000001eaf/do-plot v10>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.156 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.032+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb0 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/s-c1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54c5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb0:[<0x10000001eaf/s-c1.c v2>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eb0:[<0x10000001eaf/s-c1.c v2>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.156 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.032+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb3 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54c5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb3:[<0x10000001eaf/testfrmw.h v8>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eb3:[<0x10000001eaf/testfrmw.h v8>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.156 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.033+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb1 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54c5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb1:[<0x10000001eaf/Makefile v4>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eb1:[<0x10000001eaf/Makefile v4>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.156 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.033+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb5 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/NOTES auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54c6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb5:[<0x10000001eaf/NOTES v12>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eb5:[<0x10000001eaf/NOTES v12>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.157 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.033+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb6 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/LICENCE auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54c6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb6:[<0x10000001eaf/LICENCE v14>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eb6:[<0x10000001eaf/LICENCE v14>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.157 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.033+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb2 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54c6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb2:[<0x10000001eaf/testfrmw.c v6>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eb2:[<0x10000001eaf/testfrmw.c v6>,<0x10000001e9f/sem_open v46>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.157 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.033+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f04 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/stress.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54c7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f04:[<0x10000001f03/stress.c v2>,<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f04:[<0x10000001f03/stress.c v2>,<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.157 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.033+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f07 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f07:[<0x10000001f03/testfrmw.h v8>,<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f07:[<0x10000001f03/testfrmw.h v8>,<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.157 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.033+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f05 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54ce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f05:[<0x10000001f03/Makefile v4>,<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f05:[<0x10000001f03/Makefile v4>,<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.157 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.033+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f08 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/NOTES auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54ce580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f08:[<0x10000001f03/NOTES v10>,<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f08:[<0x10000001f03/NOTES v10>,<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.157 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.034+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f09 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/LICENCE auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54ceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f09:[<0x10000001f03/LICENCE v12>,<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f09:[<0x10000001f03/LICENCE v12>,<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.159 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.034+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f06 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f06:[<0x10000001f03/testfrmw.c v6>,<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f06:[<0x10000001f03/testfrmw.c v6>,<0x10000001e9f/pthread_once v212>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.160 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.034+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec7 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/stress.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec7:[<0x10000001ec6/stress.c v2>,<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ec7:[<0x10000001ec6/stress.c v2>,<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.160 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.034+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eca [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54cfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eca:[<0x10000001ec6/testfrmw.h v8>,<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eca:[<0x10000001ec6/testfrmw.h v8>,<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.160 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.034+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec8 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54d0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec8:[<0x10000001ec6/Makefile v4>,<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ec8:[<0x10000001ec6/Makefile v4>,<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.160 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.034+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ecb [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/NOTES auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54d0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ecb:[<0x10000001ec6/NOTES v10>,<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ecb:[<0x10000001ec6/NOTES v10>,<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.160 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.034+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ecc [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/LICENCE auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54d0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ecc:[<0x10000001ec6/LICENCE v12>,<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ecc:[<0x10000001ec6/LICENCE v12>,<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.160 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.034+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec9 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54d1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec9:[<0x10000001ec6/testfrmw.c v6>,<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ec9:[<0x10000001ec6/testfrmw.c v6>,<0x10000001e9f/pthread_mutex_trylock v90>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.160 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.035+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001edf [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/s-c1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54de000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001edf:[<0x10000001ede/s-c1.c v2>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001edf:[<0x10000001ede/s-c1.c v2>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.160 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.035+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee3 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/do-plot auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54d1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee3:[<0x10000001ede/do-plot v10>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ee3:[<0x10000001ede/do-plot v10>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.160 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.035+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee2 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee2:[<0x10000001ede/testfrmw.h v8>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ee2:[<0x10000001ede/testfrmw.h v8>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.161 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.035+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee0 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54deb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee0:[<0x10000001ede/Makefile v4>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ee0:[<0x10000001ede/Makefile v4>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.161 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.035+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee4 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/NOTES auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54df080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee4:[<0x10000001ede/NOTES v12>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ee4:[<0x10000001ede/NOTES v12>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.161 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.035+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee5 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/LICENCE auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54df600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee5:[<0x10000001ede/LICENCE v14>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ee5:[<0x10000001ede/LICENCE v14>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.161 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.035+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee1 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54dfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee1:[<0x10000001ede/testfrmw.c v6>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ee1:[<0x10000001ede/testfrmw.c v6>,<0x10000001e9f/fork v140>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.161 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.035+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec5 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/threads_scenarii.c auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54e0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec5:[<0x10000001ebe/threads_scenarii.c v14>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ec5:[<0x10000001ebe/threads_scenarii.c v14>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.161 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.036+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ebf [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/stress.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54e0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ebf:[<0x10000001ebe/stress.c v2>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ebf:[<0x10000001ebe/stress.c v2>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.161 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.036+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec2 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54e0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec2:[<0x10000001ebe/testfrmw.h v8>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ec2:[<0x10000001ebe/testfrmw.h v8>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.161 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.036+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec0 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54e1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec0:[<0x10000001ebe/Makefile v4>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ec0:[<0x10000001ebe/Makefile v4>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.161 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.036+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec3 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/NOTES auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54e1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec3:[<0x10000001ebe/NOTES v10>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ec3:[<0x10000001ebe/NOTES v10>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.161 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.036+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec4 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/LICENCE auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54ea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec4:[<0x10000001ebe/LICENCE v12>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ec4:[<0x10000001ebe/LICENCE v12>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.162 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.036+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec1 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54ea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec1:[<0x10000001ebe/testfrmw.c v6>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001ec1:[<0x10000001ebe/testfrmw.c v6>,<0x10000001e9f/pthread_exit v76>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.162 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.036+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f24 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/threads_scenarii.c auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54eab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f24:[<0x10000001f1d/threads_scenarii.c v14>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f24:[<0x10000001f1d/threads_scenarii.c v14>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.162 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.036+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f1e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/stress.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54eb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f1e:[<0x10000001f1d/stress.c v2>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f1e:[<0x10000001f1d/stress.c v2>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.162 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.037+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f21 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/testfrmw.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54eb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f21:[<0x10000001f1d/testfrmw.h v8>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f21:[<0x10000001f1d/testfrmw.h v8>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.162 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.037+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f1f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54ebb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f1f:[<0x10000001f1d/Makefile v4>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f1f:[<0x10000001f1d/Makefile v4>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.162 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.037+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f22 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/NOTES auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54ec100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f22:[<0x10000001f1d/NOTES v10>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f22:[<0x10000001f1d/NOTES v10>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.162 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.037+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f23 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/LICENCE auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54ec680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f23:[<0x10000001f1d/LICENCE v12>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f23:[<0x10000001f1d/LICENCE v12>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.162 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.037+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f20 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/testfrmw.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54ecc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f20:[<0x10000001f1d/testfrmw.c v6>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f20:[<0x10000001f1d/testfrmw.c v6>,<0x10000001e9f/pthread_self v266>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.162 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.037+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efc [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/stress.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54ed180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001efc:[<0x10000001efb/stress.c v2>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001efc:[<0x10000001efb/stress.c v2>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.162 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.037+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f00 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/testfrmw.h auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54ed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f00:[<0x10000001efb/testfrmw.h v10>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f00:[<0x10000001efb/testfrmw.h v10>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.162 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.038+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f01 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/NOTES auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f01:[<0x10000001efb/NOTES v12>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f01:[<0x10000001efb/NOTES v12>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.163 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.038+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efe [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/Makefile auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001efe:[<0x10000001efb/Makefile v6>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001efe:[<0x10000001efb/Makefile v6>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.163 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.038+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f02 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/LICENCE auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f02:[<0x10000001efb/LICENCE v14>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f02:[<0x10000001efb/LICENCE v14>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.163 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.038+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efd [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/s-c.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001efd:[<0x10000001efb/s-c.c v4>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001efd:[<0x10000001efb/s-c.c v4>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.163 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.038+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eff [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/testfrmw.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed54fb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eff:[<0x10000001efb/testfrmw.c v8>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v80>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001eff:[<0x10000001efb/testfrmw.c v8>,<0x10000001e9f/pthread_cond_init v198>,<0x10000001e8a/threads v87>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.011+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e8c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals/sigismember_stress_1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd530580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e8c:[<0x10000001e8b/sigismember_stress_1.c v2>,<0x10000001e8a/signals v4>,<0x100000012ea/stress v110>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e8c:[<0x10000001e8b/sigismember_stress_1.c v2>,<0x10000001e8a/signals v4>,<0x100000012ea/stress v150>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:43 smithi139 ceph-mon[35039]: pgmap v83: 97 pgs: 97 active+clean; 65 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.9 MiB/s wr, 470 op/s 2024-09-19T07:24:44.432 INFO:tasks.workunit.client.0.smithi098.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-19T07:24:44.433 INFO:tasks.workunit.client.0.smithi098.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T07:24:44.434 INFO:tasks.workunit.client.0.smithi098.stderr:+ make 2024-09-19T07:24:44.557 INFO:tasks.workunit.client.0.smithi098.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-19T07:24:44.646 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.388+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb2 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/scripts/test/coverage_report.pl auth v36 ap=1 s=1204 n(v0 rc2024-09-19T07:24:26.719042+0000 b1204 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca57180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb2:[<0x10000000fb0/coverage_report.pl v4>,<0x10000000fac/test v20>,<0x10000000c2e/scripts v124>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000fb2:[<0x10000000fb0/coverage_report.pl v36>,<0x10000000fac/test v41>,<0x10000000c2e/scripts v1080>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.646 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.388+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb1 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/scripts/test/generate_index.pl auth v34 ap=1 s=2402 n(v0 rc2024-09-19T07:24:26.718042+0000 b2402 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc9ac000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb1:[<0x10000000fb0/generate_index.pl v2>,<0x10000000fac/test v20>,<0x10000000c2e/scripts v124>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000fb1:[<0x10000000fb0/generate_index.pl v34>,<0x10000000fac/test v41>,<0x10000000c2e/scripts v1080>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.646 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.606+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002376 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/Makefile auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd51f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002376:[<0x10000002373/Makefile v6>,<0x1000000223a/include v88>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002376:[<0x10000002373/Makefile v6>,<0x1000000223a/include v88>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.647 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.606+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002377 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/userBlockInclude.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd51f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002377:[<0x10000002373/userBlockInclude.c v8>,<0x1000000223a/include v88>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002377:[<0x10000002373/userBlockInclude.c v8>,<0x1000000223a/include v88>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.647 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.606+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002374 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/includeTest.h auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd520100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002374:[<0x10000002373/includeTest.h v2>,<0x1000000223a/include v88>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002374:[<0x10000002373/includeTest.h v2>,<0x1000000223a/include v88>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.647 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.606+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002375 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/includeTest.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd51fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002375:[<0x10000002373/includeTest.c v4>,<0x1000000223a/include v88>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002375:[<0x10000002373/includeTest.c v4>,<0x1000000223a/include v88>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.647 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.624+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002016 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/openfile/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd54a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002016:[<0x10000002014/Makefile v4>,<0x10000001fa6/openfile v48>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002016:[<0x10000002014/Makefile v4>,<0x10000001fa6/openfile v48>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.647 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.624+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002015 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/openfile/openfile.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd54ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002015:[<0x10000002014/openfile.c v2>,<0x10000001fa6/openfile v48>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002015:[<0x10000002014/openfile.c v2>,<0x10000001fa6/openfile v48>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.648 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.637+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f70 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/shm_test.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd542000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f70:[<0x10000001f6d/shm_test.c v6>,<0x10000001f2d/mtest07 v84>,<0x10000001f2c/mem v28>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f70:[<0x10000001f6d/shm_test.c v6>,<0x10000001f2d/mtest07 v84>,<0x10000001f2c/mem v650>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.648 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.637+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f6f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/mallocstress.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd542b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f6f:[<0x10000001f6d/mallocstress.c v4>,<0x10000001f2d/mtest07 v84>,<0x10000001f2c/mem v28>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f6f:[<0x10000001f6d/mallocstress.c v4>,<0x10000001f2d/mtest07 v84>,<0x10000001f2c/mem v650>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.648 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.637+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f6e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd542580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f6e:[<0x10000001f6d/Makefile v2>,<0x10000001f2d/mtest07 v84>,<0x10000001f2c/mem v28>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f6e:[<0x10000001f6d/Makefile v2>,<0x10000001f2d/mtest07 v84>,<0x10000001f2c/mem v650>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.648 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.645+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002802 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_destroy/io_destroy01.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd52ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002802:[<0x10000002801/io_destroy01.c v2>,<0x1000000261a/io_destroy v978>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002802:[<0x10000002801/io_destroy01.c v2>,<0x1000000261a/io_destroy v978>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.648 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.645+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002803 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_destroy/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd52a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002803:[<0x10000002801/Makefile v4>,<0x1000000261a/io_destroy v978>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002803:[<0x10000002801/Makefile v4>,<0x1000000261a/io_destroy v978>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.711 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.434+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpipower.pod.1 auth v56 ap=1 s=609 n(v0 rc2024-09-19T07:24:22.611094+0000 b609 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed523c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3d:[<0x10000000c31/hpipower.pod.1 v24>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c3d:[<0x10000000c31/hpipower.pod.1 v56>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.711 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.434+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c32 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpireset.pod.1 auth v44 ap=1 s=667 n(v0 rc2008-11-20T11:32:26.000000+0000 b667 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed523cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c32:[<0x10000000c31/hpireset.pod.1 v2>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c32:[<0x10000000c31/hpireset.pod.1 v44>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.712 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.435+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiel.pod.1 auth v48 ap=1 s=1901 n(v0 rc2024-09-19T07:24:22.612094+0000 b1901 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed523d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3e:[<0x10000000c31/hpiel.pod.1 v26>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c3e:[<0x10000000c31/hpiel.pod.1 v48>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.712 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.435+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpialarms.pod.1 auth v64 ap=1 s=1491 n(v0 rc2024-09-19T07:24:22.613094+0000 b1491 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed524e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3f:[<0x10000000c31/hpialarms.pod.1 v28>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c3f:[<0x10000000c31/hpialarms.pod.1 v64>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.712 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.435+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c41 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpitree.pod.1 auth v46 ap=1 s=1024 n(v0 rc2024-09-19T07:24:22.614094+0000 b1024 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed523d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c41:[<0x10000000c31/hpitree.pod.1 v32>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c41:[<0x10000000c31/hpitree.pod.1 v46>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.712 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.435+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c39 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpifan.pod.1 auth v58 ap=1 s=505 n(v0 rc2024-09-19T07:24:22.607094+0000 b505 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed524e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c39:[<0x10000000c31/hpifan.pod.1 v16>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c39:[<0x10000000c31/hpifan.pod.1 v58>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.712 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.435+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/Makefile.in auth v54 ap=1 s=18257 n(v0 rc2024-09-19T07:24:22.609094+0000 b18257 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed524eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3b:[<0x10000000c31/Makefile.in v20>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c3b:[<0x10000000c31/Makefile.in v54>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.712 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.435+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c38 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/openhpi.pod.7 auth v66 ap=1 s=2327 n(v0 rc2007-06-25T15:36:02.000000+0000 b2327 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed524f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c38:[<0x10000000c31/openhpi.pod.7 v14>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c38:[<0x10000000c31/openhpi.pod.7 v66>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.712 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.435+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c36 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiinv.pod.1 auth v72 ap=1 s=803 n(v0 rc2024-09-19T07:24:22.605094+0000 b803 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed524f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c36:[<0x10000000c31/hpiinv.pod.1 v10>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c36:[<0x10000000c31/hpiinv.pod.1 v72>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.712 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.436+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c42 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpitop.pod.1 auth v68 ap=1 s=746 n(v0 rc2024-09-19T07:24:22.615094+0000 b746 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed524fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c42:[<0x10000000c31/hpitop.pod.1 v34>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c42:[<0x10000000c31/hpitop.pod.1 v68>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.712 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.436+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c43 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/Makefile.am auth v70 ap=1 s=3021 n(v0 rc2024-09-19T07:24:22.616094+0000 b3021 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5250100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c43:[<0x10000000c31/Makefile.am v36>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c43:[<0x10000000c31/Makefile.am v70>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.712 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.436+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c37 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpionIBMblade.pod.1 auth v60 ap=1 s=1404 n(v0 rc2024-09-19T07:24:22.606094+0000 b1404 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5250680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c37:[<0x10000000c31/hpionIBMblade.pod.1 v12>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c37:[<0x10000000c31/hpionIBMblade.pod.1 v60>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.712 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.436+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c34 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpievents.pod.1 auth v62 ap=1 s=1277 n(v0 rc2024-09-19T07:24:22.603094+0000 b1277 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5250c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c34:[<0x10000000c31/hpievents.pod.1 v6>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c34:[<0x10000000c31/hpievents.pod.1 v62>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.713 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.436+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/openhpid.pod.8 auth v38 ap=1 s=4271 n(v0 rc2024-09-19T07:24:22.610094+0000 b4271 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5251180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3c:[<0x10000000c31/openhpid.pod.8 v22>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c3c:[<0x10000000c31/openhpid.pod.8 v38>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.713 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.436+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c35 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpisettime.pod.1 auth v40 ap=1 s=469 n(v0 rc2024-09-19T07:24:22.604094+0000 b469 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5251700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c35:[<0x10000000c31/hpisettime.pod.1 v8>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c35:[<0x10000000c31/hpisettime.pod.1 v40>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.713 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.436+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c40 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiwdt.pod.1 auth v42 ap=1 s=515 n(v0 rc2008-11-20T11:32:26.000000+0000 b515 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5256000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c40:[<0x10000000c31/hpiwdt.pod.1 v30>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c40:[<0x10000000c31/hpiwdt.pod.1 v42>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.713 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.436+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3a [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpisensor.pod.1 auth v50 ap=1 s=557 n(v0 rc2024-09-19T07:24:22.608094+0000 b557 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5256580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3a:[<0x10000000c31/hpisensor.pod.1 v18>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c3a:[<0x10000000c31/hpisensor.pod.1 v50>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.713 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.437+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c33 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpithres.pod.1 auth v52 ap=1 s=474 n(v0 rc2024-09-19T07:24:22.602094+0000 b474 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5256b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c33:[<0x10000000c31/hpithres.pod.1 v4>,<0x10000000c30/man v38>,<0x10000000c2e/docs v12>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000c33:[<0x10000000c31/hpithres.pod.1 v52>,<0x10000000c30/man v140>,<0x10000000c2e/docs v1098>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.713 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.607+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002543 [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/ auth v20 ap=1 f(v0 m2024-09-19T07:24:38.065901+0000 6=6+0) n(v0 rc2024-09-19T07:24:38.065901+0000 7=6+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5335b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002543:[<0x10000002349/kernel_space v20>,<0x1000000223a/drm v52>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x10000002543:[<0x10000002349/kernel_space v20>,<0x1000000223a/drm v110>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:38.065901+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:38.065901+0000 7=6+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:38.065901+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:38.065901+0000 7=6+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.713 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.607+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002351 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/load_tdrm.sh auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5336680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002351:[<0x10000002543/load_tdrm.sh v8>,<0x10000002349/kernel_space v20>,<0x1000000223a/drm v52>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002351:[<0x10000002543/load_tdrm.sh v8>,<0x10000002349/kernel_space v20>,<0x1000000223a/drm v110>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.713 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.607+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002350 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/str_drm.h auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5336c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002350:[<0x10000002543/str_drm.h v6>,<0x10000002349/kernel_space v20>,<0x1000000223a/drm v52>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002350:[<0x10000002543/str_drm.h v6>,<0x10000002349/kernel_space v20>,<0x1000000223a/drm v110>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.713 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.608+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000234e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5337180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000234e:[<0x10000002543/Makefile v2>,<0x10000002349/kernel_space v20>,<0x1000000223a/drm v52>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000234e:[<0x10000002543/Makefile v2>,<0x10000002349/kernel_space v20>,<0x1000000223a/drm v110>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.713 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.608+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000234a [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/ auth v6 ap=1 f(v0 m2024-09-19T07:24:37.847903+0000 2=2+0) n(v0 rc2024-09-19T07:24:37.847903+0000 3=2+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5336100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000234a:[<0x10000002349/user_space v6>,<0x1000000223a/drm v52>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x1000000234a:[<0x10000002349/user_space v6>,<0x1000000223a/drm v110>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:37.847903+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:37.847903+0000 3=2+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:37.847903+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:37.847903+0000 3=2+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.713 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.608+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000234f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/tdrm.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5337700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000234f:[<0x10000002543/tdrm.c v4>,<0x10000002349/kernel_space v20>,<0x1000000223a/drm v52>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000234f:[<0x10000002543/tdrm.c v4>,<0x10000002349/kernel_space v20>,<0x1000000223a/drm v110>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.714 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.608+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002353 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/tdrm.h auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51a6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002353:[<0x10000002543/tdrm.h v12>,<0x10000002349/kernel_space v20>,<0x1000000223a/drm v52>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002353:[<0x10000002543/tdrm.h v12>,<0x10000002349/kernel_space v20>,<0x1000000223a/drm v110>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.714 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.608+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002352 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/README auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51a6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002352:[<0x10000002543/README v10>,<0x10000002349/kernel_space v20>,<0x1000000223a/drm v52>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002352:[<0x10000002543/README v10>,<0x10000002349/kernel_space v20>,<0x1000000223a/drm v110>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.714 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.608+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000234b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/user_tdrm.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51a6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000234b:[<0x1000000234a/user_tdrm.c v2>,<0x10000002349/user_space v6>,<0x1000000223a/drm v52>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000234b:[<0x1000000234a/user_tdrm.c v2>,<0x10000002349/user_space v6>,<0x1000000223a/drm v110>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.714 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.608+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000234c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51a7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000234c:[<0x1000000234a/Makefile v4>,<0x10000002349/user_space v6>,<0x1000000223a/drm v52>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000234c:[<0x1000000234a/Makefile v4>,<0x10000002349/user_space v6>,<0x1000000223a/drm v110>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.714 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.623+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000243e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/run_io_throttle_test.sh auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51a8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000243e:[<0x1000000243b/run_io_throttle_test.sh v6>,<0x1000000238f/io-throttle v252>,<0x10000001f2c/controllers v242>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000243e:[<0x1000000243b/run_io_throttle_test.sh v6>,<0x1000000238f/io-throttle v252>,<0x10000001f2c/controllers v656>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.714 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.623+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000243c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/io_throttle_testplan.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51a9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000243c:[<0x1000000243b/io_throttle_testplan.txt v2>,<0x1000000238f/io-throttle v252>,<0x10000001f2c/controllers v242>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000243c:[<0x1000000243b/io_throttle_testplan.txt v2>,<0x1000000238f/io-throttle v252>,<0x10000001f2c/controllers v656>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.714 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.623+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002440 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/myfunctions-io.sh auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51a8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002440:[<0x1000000243b/myfunctions-io.sh v10>,<0x1000000238f/io-throttle v252>,<0x10000001f2c/controllers v242>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002440:[<0x1000000243b/myfunctions-io.sh v10>,<0x1000000238f/io-throttle v252>,<0x10000001f2c/controllers v656>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.714 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.623+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000243d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51a9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000243d:[<0x1000000243b/Makefile v4>,<0x1000000238f/io-throttle v252>,<0x10000001f2c/controllers v242>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000243d:[<0x1000000243b/Makefile v4>,<0x1000000238f/io-throttle v252>,<0x10000001f2c/controllers v656>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.714 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.623+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000243f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/README auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51aa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000243f:[<0x1000000243b/README v8>,<0x1000000238f/io-throttle v252>,<0x10000001f2c/controllers v242>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000243f:[<0x1000000243b/README v8>,<0x1000000238f/io-throttle v252>,<0x10000001f2c/controllers v656>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.714 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.623+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002441 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/iobw.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51aa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002441:[<0x1000000243b/iobw.c v12>,<0x1000000238f/io-throttle v252>,<0x10000001f2c/controllers v242>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002441:[<0x1000000243b/iobw.c v12>,<0x1000000238f/io-throttle v252>,<0x10000001f2c/controllers v656>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.714 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.627+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002027 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed534f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002027:[<0x10000002025/Makefile v4>,<0x10000001fa6/fs_inod v84>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002027:[<0x10000002025/Makefile v4>,<0x10000001fa6/fs_inod v84>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.714 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.627+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002026 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/fs_inod auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed534f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002026:[<0x10000002025/fs_inod v2>,<0x10000001fa6/fs_inod v84>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002026:[<0x10000002025/fs_inod v2>,<0x10000001fa6/fs_inod v84>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.715 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.628+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002028 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/fs_inod_readme.txt auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5334000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002028:[<0x10000002025/fs_inod_readme.txt v6>,<0x10000001fa6/fs_inod v84>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002028:[<0x10000002025/fs_inod_readme.txt v6>,<0x10000001fa6/fs_inod v84>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.715 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.629+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000203e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/README auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5335600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000203e:[<0x1000000203a/README v8>,<0x10000001fa6/fs_maim v128>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000203e:[<0x1000000203a/README v8>,<0x10000001fa6/fs_maim v128>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.715 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.629+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000203b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/backbeat auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5334580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000203b:[<0x1000000203a/backbeat v2>,<0x10000001fa6/fs_maim v128>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000203b:[<0x1000000203a/backbeat v2>,<0x10000001fa6/fs_maim v128>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.715 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.629+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000203c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/partbeat auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5335080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000203c:[<0x1000000203a/partbeat v4>,<0x10000001fa6/fs_maim v128>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000203c:[<0x1000000203a/partbeat v4>,<0x10000001fa6/fs_maim v128>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.715 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.629+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000203d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/maimparts auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5334b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000203d:[<0x1000000203a/maimparts v6>,<0x10000001fa6/fs_maim v128>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000203d:[<0x1000000203a/maimparts v6>,<0x10000001fa6/fs_maim v128>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.715 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.656+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002670 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups03.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5248b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002670:[<0x1000000266d/setgroups03.c v6>,<0x1000000261a/setgroups v178>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002670:[<0x1000000266d/setgroups03.c v6>,<0x1000000261a/setgroups v178>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.715 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.656+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000266e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups04.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5248580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000266e:[<0x1000000266d/setgroups04.c v2>,<0x1000000261a/setgroups v178>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000266e:[<0x1000000266d/setgroups04.c v2>,<0x1000000261a/setgroups v178>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.715 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.656+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002671 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/Makefile auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5249080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002671:[<0x1000000266d/Makefile v8>,<0x1000000261a/setgroups v178>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002671:[<0x1000000266d/Makefile v8>,<0x1000000261a/setgroups v178>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.715 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.656+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002673 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups02.c auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5249600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002673:[<0x1000000266d/setgroups02.c v12>,<0x1000000261a/setgroups v178>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002673:[<0x1000000266d/setgroups02.c v12>,<0x1000000261a/setgroups v178>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.715 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.657+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000266f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/compat_16.h auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5249b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000266f:[<0x1000000266d/compat_16.h v4>,<0x1000000261a/setgroups v178>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000266f:[<0x1000000266d/compat_16.h v4>,<0x1000000261a/setgroups v178>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.715 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.657+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002672 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups01.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed524a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002672:[<0x1000000266d/setgroups01.c v10>,<0x1000000261a/setgroups v178>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002672:[<0x1000000266d/setgroups01.c v10>,<0x1000000261a/setgroups v178>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.715 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.668+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000261e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid02.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5239180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000261e:[<0x1000000261b/waitid02.c v6>,<0x1000000261a/waitid v8>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000261e:[<0x1000000261b/waitid02.c v6>,<0x1000000261a/waitid v8>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.716 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.668+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000261c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid01.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5239700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000261c:[<0x1000000261b/waitid01.c v2>,<0x1000000261a/waitid v8>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000261c:[<0x1000000261b/waitid01.c v2>,<0x1000000261a/waitid v8>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.716 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.668+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000261d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5248000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000261d:[<0x1000000261b/Makefile v4>,<0x1000000261a/waitid v8>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000261d:[<0x1000000261b/Makefile v4>,<0x1000000261a/waitid v8>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.716 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.708+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000276f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/keyctl/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed524a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000276f:[<0x1000000276d/Makefile v4>,<0x1000000261a/keyctl v682>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000276f:[<0x1000000276d/Makefile v4>,<0x1000000261a/keyctl v682>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.716 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.708+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000276e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/keyctl/keyctl01.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed524ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000276e:[<0x1000000276d/keyctl01.c v2>,<0x1000000261a/keyctl v682>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000276e:[<0x1000000276d/keyctl01.c v2>,<0x1000000261a/keyctl v682>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.772 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:24:44.909 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:44.909 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:44.909 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:44.909 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:44.909 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:44.910 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e8c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals/sigismember_stress_1.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:44.910 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:44.910 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:44.910 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:44.910 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:44.910 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:44.910 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:44.910 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000fb2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/scripts/test/coverage_report.pl) see mds.h log and `damage ls` output for details 2024-09-19T07:24:44.910 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000fb1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/scripts/test/generate_index.pl) see mds.h log and `damage ls` output for details 2024-09-19T07:24:44.910 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:44.913 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.663+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002854 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect03.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd52b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002854:[<0x10000002850/mprotect03.c v8>,<0x1000000261a/mprotect v1140>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002854:[<0x10000002850/mprotect03.c v8>,<0x1000000261a/mprotect v1140>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.913 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.663+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002852 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect02.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd52b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002852:[<0x10000002850/mprotect02.c v4>,<0x1000000261a/mprotect v1140>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002852:[<0x10000002850/mprotect02.c v4>,<0x1000000261a/mprotect v1140>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.913 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.663+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002851 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect01.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd52c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002851:[<0x10000002850/mprotect01.c v2>,<0x1000000261a/mprotect v1140>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002851:[<0x10000002850/mprotect01.c v2>,<0x1000000261a/mprotect v1140>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.913 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.664+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002853 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/Makefile auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd52bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002853:[<0x10000002850/Makefile v6>,<0x1000000261a/mprotect v1140>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002853:[<0x10000002850/Makefile v6>,<0x1000000261a/mprotect v1140>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.913 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.668+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002711 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/sched_setscheduler02.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd526680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002711:[<0x1000000270f/sched_setscheduler02.c v4>,<0x1000000261a/sched_setscheduler v496>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002711:[<0x1000000270f/sched_setscheduler02.c v4>,<0x1000000261a/sched_setscheduler v496>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.914 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.668+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002710 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd526c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002710:[<0x1000000270f/Makefile v2>,<0x1000000261a/sched_setscheduler v496>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002710:[<0x1000000270f/Makefile v2>,<0x1000000261a/sched_setscheduler v496>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.914 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.668+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002712 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/sched_setscheduler01.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd527180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002712:[<0x1000000270f/sched_setscheduler01.c v6>,<0x1000000261a/sched_setscheduler v496>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002712:[<0x1000000270f/sched_setscheduler01.c v6>,<0x1000000261a/sched_setscheduler v496>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.914 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.678+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000028b3 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/brk/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd52c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000028b3:[<0x100000028b1/Makefile v4>,<0x1000000261a/brk v1330>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000028b3:[<0x100000028b1/Makefile v4>,<0x1000000261a/brk v1330>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.914 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.678+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000028b2 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/brk/brk01.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd52cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000028b2:[<0x100000028b1/brk01.c v2>,<0x1000000261a/brk v1330>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000028b2:[<0x100000028b1/brk01.c v2>,<0x1000000261a/brk v1330>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.914 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.686+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002637 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_getevents/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd525b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002637:[<0x10000002635/Makefile v4>,<0x1000000261a/io_getevents v58>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002637:[<0x10000002635/Makefile v4>,<0x1000000261a/io_getevents v58>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.914 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.686+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002636 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_getevents/io_getevents01.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd526100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002636:[<0x10000002635/io_getevents01.c v2>,<0x1000000261a/io_getevents v58>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002636:[<0x10000002635/io_getevents01.c v2>,<0x1000000261a/io_getevents v58>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.914 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.690+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002797 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getsockname/getsockname01.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd527700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002797:[<0x10000002795/getsockname01.c v4>,<0x1000000261a/getsockname v762>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002797:[<0x10000002795/getsockname01.c v4>,<0x1000000261a/getsockname v762>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.914 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.690+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002796 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getsockname/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd52a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002796:[<0x10000002795/Makefile v2>,<0x1000000261a/getsockname v762>,<0x10000001f2c/syscalls v576>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002796:[<0x10000002795/Makefile v2>,<0x1000000261a/getsockname v762>,<0x10000001f2c/syscalls v648>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.914 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.729+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd536b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4e:[<0x10000001e4c/Makefile v4>,<0x10000001e4b/condvar v8>,<0x10000001e29/threads v76>,<0x100000012ea/functional v48>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e4e:[<0x10000001e4c/Makefile v4>,<0x10000001e4b/condvar v8>,<0x10000001e29/threads v83>,<0x100000012ea/functional v152>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.915 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.729+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_2.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd536580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4d:[<0x10000001e4c/pthread_cond_wait_2.c v2>,<0x10000001e4b/condvar v8>,<0x10000001e29/threads v76>,<0x100000012ea/functional v48>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e4d:[<0x10000001e4c/pthread_cond_wait_2.c v2>,<0x10000001e4b/condvar v8>,<0x10000001e29/threads v83>,<0x100000012ea/functional v152>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.915 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.729+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_1.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd536000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4f:[<0x10000001e4c/pthread_cond_wait_1.c v6>,<0x10000001e4b/condvar v8>,<0x10000001e29/threads v76>,<0x100000012ea/functional v48>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001e4f:[<0x10000001e4c/pthread_cond_wait_1.c v6>,<0x10000001e4b/condvar v8>,<0x10000001e29/threads v83>,<0x100000012ea/functional v152>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.915 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.828+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be7 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/cases.sh auth v43 ap=1 s=2007 n(v0 rc2009-08-22T17:27:06.000000+0000 b2007 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc9ae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be7:[<0x10000000bda/cases.sh v26>,<0x10000000bb6/panic v34>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000be7:[<0x10000000bda/cases.sh v43>,<0x10000000bb6/panic v91>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.915 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.829+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bdd [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/ auth v47 ap=1 f(v0 m2024-09-19T07:24:22.537095+0000 9=9+0) n(v0 rc2024-09-19T07:24:22.538095+0000 b1205 10=9+1) (inest lock) (ifile excl) caps={24761=pAsLsXsFsx/pAsLsXsFsx@1},l=24761 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc9aec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000bdd:[<0x10000000bda/data v24>,<0x10000000bb6/panic v34>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(2)0x10000000bdd:[<0x10000000bda/data v47>,<0x10000000bb6/panic v91>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:22.537095+0000 9=9+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:22.538095+0000 b1205 10=9+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:22.537095+0000 9=9+0)","memory_value.rstat":"n(v0 rc2024-09-19T07:24:22.538095+0000 b1205 10=9+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.915 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.829+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be3 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout auth v28 ap=1 s=145 n(v0 rc2024-09-19T07:24:22.534095+0000 b145 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc9af700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be3:[<0x10000000bdd/fatal_timeout v12>,<0x10000000bda/data v24>,<0x10000000bb6/panic v34>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000be3:[<0x10000000bdd/fatal_timeout v28>,<0x10000000bda/data v47>,<0x10000000bb6/panic v91>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.915 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.829+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be6 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal auth v30 ap=1 s=125 n(v0 rc2024-09-19T07:24:22.538095+0000 b125 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc9af180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be6:[<0x10000000bdd/fatal v18>,<0x10000000bda/data v24>,<0x10000000bb6/panic v34>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000be6:[<0x10000000bdd/fatal v30>,<0x10000000bda/data v47>,<0x10000000bb6/panic v91>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.915 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.829+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be4 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout_ripv auth v26 ap=1 s=150 n(v0 rc2024-09-19T07:24:22.536095+0000 b150 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca5e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be4:[<0x10000000bdd/fatal_timeout_ripv v14>,<0x10000000bda/data v24>,<0x10000000bb6/panic v34>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000be4:[<0x10000000bdd/fatal_timeout_ripv v26>,<0x10000000bda/data v47>,<0x10000000bb6/panic v91>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.915 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.830+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bde [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_userspace auth v36 ap=1 s=129 n(v0 rc2024-09-19T07:24:22.526095+0000 b129 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca5e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bde:[<0x10000000bdd/fatal_userspace v2>,<0x10000000bda/data v24>,<0x10000000bb6/panic v34>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000bde:[<0x10000000bdd/fatal_userspace v36>,<0x10000000bda/data v47>,<0x10000000bb6/panic v91>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.915 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.830+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bdf [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_irq auth v24 ap=1 s=132 n(v0 rc2024-09-19T07:24:22.528095+0000 b132 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca5eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bdf:[<0x10000000bdd/fatal_irq v4>,<0x10000000bda/data v24>,<0x10000000bb6/panic v34>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000bdf:[<0x10000000bdd/fatal_irq v24>,<0x10000000bda/data v47>,<0x10000000bb6/panic v91>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.915 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.830+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be2 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_over auth v32 ap=1 s=131 n(v0 rc2024-09-19T07:24:22.533095+0000 b131 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca5f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be2:[<0x10000000bdd/fatal_over v10>,<0x10000000bda/data v24>,<0x10000000bb6/panic v34>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000be2:[<0x10000000bdd/fatal_over v32>,<0x10000000bda/data v47>,<0x10000000bb6/panic v91>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.916 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.830+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be0 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_eipv auth v34 ap=1 s=129 n(v0 rc2024-09-19T07:24:22.530095+0000 b129 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca5f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be0:[<0x10000000bdd/fatal_eipv v6>,<0x10000000bda/data v24>,<0x10000000bb6/panic v34>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000be0:[<0x10000000bdd/fatal_eipv v34>,<0x10000000bda/data v47>,<0x10000000bb6/panic v91>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.916 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.830+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be1 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_no_en auth v20 ap=1 s=135 n(v0 rc2024-09-19T07:24:22.531095+0000 b135 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca5fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be1:[<0x10000000bdd/fatal_no_en v8>,<0x10000000bda/data v24>,<0x10000000bb6/panic v34>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000be1:[<0x10000000bdd/fatal_no_en v20>,<0x10000000bda/data v47>,<0x10000000bb6/panic v91>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.916 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.830+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be5 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_ripv auth v22 ap=1 s=129 n(v0 rc2024-09-19T07:24:22.537095+0000 b129 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca60100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be5:[<0x10000000bdd/fatal_ripv v16>,<0x10000000bda/data v24>,<0x10000000bb6/panic v34>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000be5:[<0x10000000bdd/fatal_ripv v22>,<0x10000000bda/data v47>,<0x10000000bb6/panic v91>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.916 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.834+0000 7f24a1df3640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bdb [...4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/refer/ auth{0=1} v52 ap=2 RANDEPHEMERALPIN f(v0 m2024-09-19T07:24:22.521095+0000 1=1+0) n(v1 rc2024-09-19T07:24:22.523095+0000 b15 2=1+1) (inest sync->mix g=0) caps={24761=pAsLsXsFs/pAsLsXsFsx@2} | ptrwaiter=0 dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 randepin 0x5563cca22580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000bdb:[<0x10000000bda/refer v4>,<0x10000000bb6/panic v34>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(2)0x10000000bdb:[<0x10000000bda/refer v50>,<0x10000000bb6/panic v91>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T07:24:22.521095+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T07:24:22.523095+0000 b15 2=1+1)","memory_value.dirstat":"f(v0 m2024-09-19T07:24:22.521095+0000 1=1+0)","memory_value.rstat":"n(v1 rc2024-09-19T07:24:22.523095+0000 b15 2=1+1)","error_str":""},"return_code":0} 2024-09-19T07:24:44.916 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.908+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f48 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrarea_test.c auth v46 ap=1 s=3010 n(v0 rc2024-09-19T07:24:26.634043+0000 b3010 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc847080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f48:[<0x10000000f41/sahpi_struct_idrarea_test.c v14>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f48:[<0x10000000f41/sahpi_struct_idrarea_test.c v46>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.916 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.908+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f4c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_event_utils_test.c auth v30 ap=1 s=13550 n(v0 rc2007-06-25T15:53:26.000000+0000 b13550 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc846b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f4c:[<0x10000000f41/sahpi_event_utils_test.c v22>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f4c:[<0x10000000f41/sahpi_event_utils_test.c v30>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.916 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.908+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f49 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_event_encode_test.c auth v52 ap=1 s=123361 n(v0 rc2024-09-19T07:24:26.635043+0000 b123361 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc847600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f49:[<0x10000000f41/sahpi_event_encode_test.c v16>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f49:[<0x10000000f41/sahpi_event_encode_test.c v52>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.916 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.908+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f43 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_utils_test.c auth v44 ap=1 s=75195 n(v0 rc2024-09-19T07:24:26.630043+0000 b75195 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc847b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f43:[<0x10000000f41/sahpi_struct_utils_test.c v4>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f43:[<0x10000000f41/sahpi_struct_utils_test.c v44>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.916 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.909+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f4b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpiatca_enum_utils_test.c auth v34 ap=1 s=41548 n(v0 rc2024-09-19T07:24:26.637043+0000 b41548 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc848100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f4b:[<0x10000000f41/sahpiatca_enum_utils_test.c v20>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f4b:[<0x10000000f41/sahpiatca_enum_utils_test.c v34>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.916 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.909+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f4e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_rdr_test.c auth v54 ap=1 s=8183 n(v0 rc2024-09-19T07:24:26.639043+0000 b8183 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc848680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f4e:[<0x10000000f41/sahpi_struct_rdr_test.c v26>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f4e:[<0x10000000f41/sahpi_struct_rdr_test.c v54>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.916 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.909+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f4a [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/Makefile.in auth v50 ap=1 s=29973 n(v0 rc2024-09-19T07:24:26.636043+0000 b29973 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc848c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f4a:[<0x10000000f41/Makefile.in v18>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f4a:[<0x10000000f41/Makefile.in v50>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.917 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.909+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f4d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/Makefile.am auth v32 ap=1 s=3037 n(v0 rc2024-09-19T07:24:26.638043+0000 b3037 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca54000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f4d:[<0x10000000f41/Makefile.am v24>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f4d:[<0x10000000f41/Makefile.am v32>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.917 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.909+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f45 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_text_utils_test.c auth v48 ap=1 s=6339 n(v0 rc2024-09-19T07:24:26.631043+0000 b6339 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca54580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f45:[<0x10000000f41/sahpi_text_utils_test.c v8>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f45:[<0x10000000f41/sahpi_text_utils_test.c v48>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.917 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.910+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f46 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_rptentry_test.c auth v42 ap=1 s=4337 n(v0 rc2024-09-19T07:24:26.632043+0000 b4337 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc849180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f46:[<0x10000000f41/sahpi_struct_rptentry_test.c v10>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f46:[<0x10000000f41/sahpi_struct_rptentry_test.c v42>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.917 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.910+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f4f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_enum_utils_test.c auth v38 ap=1 s=672130 n(v0 rc2024-09-19T07:24:26.642043+0000 b672130 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca54b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f4f:[<0x10000000f41/sahpi_enum_utils_test.c v28>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f4f:[<0x10000000f41/sahpi_enum_utils_test.c v38>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.917 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.910+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f44 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrfield_test.c auth v36 ap=1 s=3243 n(v0 rc2007-06-25T15:53:26.000000+0000 b3243 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cc849700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f44:[<0x10000000f41/sahpi_struct_idrfield_test.c v6>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f44:[<0x10000000f41/sahpi_struct_idrfield_test.c v36>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.917 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.910+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f47 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_time_utils_test.c auth v56 ap=1 s=3489 n(v0 rc2024-09-19T07:24:26.633043+0000 b3489 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca55080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f47:[<0x10000000f41/sahpi_time_utils_test.c v12>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f47:[<0x10000000f41/sahpi_time_utils_test.c v56>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.917 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.911+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f42 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrinfo_test.c auth v40 ap=1 s=2982 n(v0 rc2024-09-19T07:24:26.629043+0000 b2982 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cca55600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f42:[<0x10000000f41/sahpi_struct_idrinfo_test.c v2>,<0x10000000c86/sahpi v1428>,<0x10000000c6c/t v70>,<0x10000000c2e/utils v92>,<0x10000000204/open_hpi_testsuite v273>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000f42:[<0x10000000f41/sahpi_struct_idrinfo_test.c v40>,<0x10000000c86/sahpi v3139>,<0x10000000c6c/t v142>,<0x10000000c2e/utils v1100>,<0x10000000204/open_hpi_testsuite v621>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:44.974 INFO:tasks.workunit.client.0.smithi098.stderr:++ readlink -f fsstress 2024-09-19T07:24:44.975 INFO:tasks.workunit.client.0.smithi098.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-19T07:24:44.975 INFO:tasks.workunit.client.0.smithi098.stderr:+ popd 2024-09-19T07:24:44.975 INFO:tasks.workunit.client.0.smithi098.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T07:24:44.976 INFO:tasks.workunit.client.0.smithi098.stderr:+ popd 2024-09-19T07:24:44.976 INFO:tasks.workunit.client.0.smithi098.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-19T07:24:44.976 INFO:tasks.workunit.client.0.smithi098.stderr:++ mktemp -d -p . 2024-09-19T07:24:44.979 INFO:tasks.workunit.client.0.smithi098.stderr:+ T=./tmp.lagndhNYO2 2024-09-19T07:24:44.979 INFO:tasks.workunit.client.0.smithi098.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.lagndhNYO2 -l 1 -n 1000 -p 10 -v 2024-09-19T07:24:44.981 INFO:tasks.workunit.client.0.smithi098.stdout:seed = 1726295085 2024-09-19T07:24:44.985 INFO:tasks.workunit.client.0.smithi098.stdout:0/0: unlink - no file 2024-09-19T07:24:44.986 INFO:tasks.workunit.client.0.smithi098.stdout:1/0: chown . 1913 1 2024-09-19T07:24:44.986 INFO:tasks.workunit.client.0.smithi098.stdout:1/1: rename - no filename 2024-09-19T07:24:44.987 INFO:tasks.workunit.client.0.smithi098.stdout:0/1: creat f0 x:0 0 0 2024-09-19T07:24:44.988 INFO:tasks.workunit.client.0.smithi098.stdout:2/0: chown . 7186631 1 2024-09-19T07:24:44.988 INFO:tasks.workunit.client.0.smithi098.stdout:2/1: unlink - no file 2024-09-19T07:24:44.989 INFO:tasks.workunit.client.0.smithi098.stdout:1/2: symlink l0 0 2024-09-19T07:24:44.989 INFO:tasks.workunit.client.0.smithi098.stdout:1/3: dwrite - no filename 2024-09-19T07:24:44.989 INFO:tasks.workunit.client.0.smithi098.stdout:1/4: dread - no filename 2024-09-19T07:24:44.990 INFO:tasks.workunit.client.0.smithi098.stdout:0/2: creat f1 x:0 0 0 2024-09-19T07:24:44.990 INFO:tasks.workunit.client.0.smithi098.stdout:0/3: read - f1 zero size 2024-09-19T07:24:44.992 INFO:tasks.workunit.client.0.smithi098.stdout:3/0: dread - no filename 2024-09-19T07:24:44.998 INFO:tasks.workunit.client.0.smithi098.stdout:1/5: creat f1 x:0 0 0 2024-09-19T07:24:44.998 INFO:tasks.workunit.client.0.smithi098.stdout:1/6: dread - f1 zero size 2024-09-19T07:24:44.998 INFO:tasks.workunit.client.0.smithi098.stdout:1/7: stat f1 0 2024-09-19T07:24:44.998 INFO:tasks.workunit.client.0.smithi098.stdout:2/2: mknod c0 0 2024-09-19T07:24:44.998 INFO:tasks.workunit.client.0.smithi098.stdout:2/3: chown c0 3821857 1 2024-09-19T07:24:44.998 INFO:tasks.workunit.client.0.smithi098.stdout:4/0: write - no filename 2024-09-19T07:24:44.998 INFO:tasks.workunit.client.0.smithi098.stdout:3/1: creat f0 x:0 0 0 2024-09-19T07:24:44.999 INFO:tasks.workunit.client.0.smithi098.stdout:5/0: dwrite - no filename 2024-09-19T07:24:44.999 INFO:tasks.workunit.client.0.smithi098.stdout:5/1: dread - no filename 2024-09-19T07:24:44.999 INFO:tasks.workunit.client.0.smithi098.stdout:2/4: unlink c0 0 2024-09-19T07:24:45.001 INFO:tasks.workunit.client.0.smithi098.stdout:1/8: rename l0 to l2 0 2024-09-19T07:24:45.001 INFO:tasks.workunit.client.0.smithi098.stdout:4/1: mknod c0 0 2024-09-19T07:24:45.001 INFO:tasks.workunit.client.0.smithi098.stdout:4/2: dwrite - no filename 2024-09-19T07:24:45.001 INFO:tasks.workunit.client.0.smithi098.stdout:4/3: readlink - no filename 2024-09-19T07:24:45.002 INFO:tasks.workunit.client.0.smithi098.stdout:4/4: dread - no filename 2024-09-19T07:24:45.002 INFO:tasks.workunit.client.0.smithi098.stdout:4/5: chown c0 122935769 1 2024-09-19T07:24:45.002 INFO:tasks.workunit.client.0.smithi098.stdout:4/6: dwrite - no filename 2024-09-19T07:24:45.004 INFO:tasks.workunit.client.0.smithi098.stdout:3/2: symlink l1 0 2024-09-19T07:24:45.004 INFO:tasks.workunit.client.0.smithi098.stdout:5/2: creat f0 x:0 0 0 2024-09-19T07:24:45.004 INFO:tasks.workunit.client.0.smithi098.stdout:6/0: getdents . 0 2024-09-19T07:24:45.004 INFO:tasks.workunit.client.0.smithi098.stdout:6/1: unlink - no file 2024-09-19T07:24:45.004 INFO:tasks.workunit.client.0.smithi098.stdout:6/2: link - no file 2024-09-19T07:24:45.004 INFO:tasks.workunit.client.0.smithi098.stdout:6/3: chown . 789176 1 2024-09-19T07:24:45.004 INFO:tasks.workunit.client.0.smithi098.stdout:6/4: getdents . 0 2024-09-19T07:24:45.004 INFO:tasks.workunit.client.0.smithi098.stdout:6/5: write - no filename 2024-09-19T07:24:45.005 INFO:tasks.workunit.client.0.smithi098.stdout:1/9: mknod c3 0 2024-09-19T07:24:45.005 INFO:tasks.workunit.client.0.smithi098.stdout:1/10: stat c3 0 2024-09-19T07:24:45.006 INFO:tasks.workunit.client.0.smithi098.stdout:4/7: unlink c0 0 2024-09-19T07:24:45.006 INFO:tasks.workunit.client.0.smithi098.stdout:4/8: truncate - no filename 2024-09-19T07:24:45.006 INFO:tasks.workunit.client.0.smithi098.stdout:4/9: rename - no filename 2024-09-19T07:24:45.006 INFO:tasks.workunit.client.0.smithi098.stdout:4/10: read - no filename 2024-09-19T07:24:45.006 INFO:tasks.workunit.client.0.smithi098.stdout:4/11: chown . 180906956 1 2024-09-19T07:24:45.006 INFO:tasks.workunit.client.0.smithi098.stdout:4/12: dread - no filename 2024-09-19T07:24:45.008 INFO:tasks.workunit.client.0.smithi098.stdout:5/3: creat f1 x:0 0 0 2024-09-19T07:24:45.008 INFO:tasks.workunit.client.0.smithi098.stdout:5/4: truncate f1 996868 0 2024-09-19T07:24:45.008 INFO:tasks.workunit.client.0.smithi098.stdout:5/5: fdatasync f0 0 2024-09-19T07:24:45.011 INFO:tasks.workunit.client.0.smithi098.stdout:1/11: creat f4 x:0 0 0 2024-09-19T07:24:45.011 INFO:tasks.workunit.client.0.smithi098.stdout:6/6: mknod c0 0 2024-09-19T07:24:45.014 INFO:tasks.workunit.client.0.smithi098.stdout:5/6: mknod c2 0 2024-09-19T07:24:45.014 INFO:tasks.workunit.client.0.smithi098.stdout:5/7: stat f1 0 2024-09-19T07:24:45.014 INFO:tasks.workunit.client.0.smithi098.stdout:5/8: read - f0 zero size 2024-09-19T07:24:45.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/0: mkdir d0 0 2024-09-19T07:24:45.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/1: write - no filename 2024-09-19T07:24:45.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/2: write - no filename 2024-09-19T07:24:45.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/3: chown d0 0 1 2024-09-19T07:24:45.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/4: dwrite - no filename 2024-09-19T07:24:45.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/5: truncate - no filename 2024-09-19T07:24:45.015 INFO:tasks.workunit.client.0.smithi098.stdout:7/6: write - no filename 2024-09-19T07:24:45.015 INFO:tasks.workunit.client.0.smithi098.stdout:4/13: symlink l1 0 2024-09-19T07:24:45.015 INFO:tasks.workunit.client.0.smithi098.stdout:4/14: dwrite - no filename 2024-09-19T07:24:45.015 INFO:tasks.workunit.client.0.smithi098.stdout:1/12: mknod c5 0 2024-09-19T07:24:45.016 INFO:tasks.workunit.client.0.smithi098.stdout:8/0: dwrite - no filename 2024-09-19T07:24:45.016 INFO:tasks.workunit.client.0.smithi098.stdout:8/1: chown . 106649589 1 2024-09-19T07:24:45.016 INFO:tasks.workunit.client.0.smithi098.stdout:8/2: rename - no filename 2024-09-19T07:24:45.016 INFO:tasks.workunit.client.0.smithi098.stdout:8/3: read - no filename 2024-09-19T07:24:45.016 INFO:tasks.workunit.client.0.smithi098.stdout:8/4: rename - no filename 2024-09-19T07:24:45.016 INFO:tasks.workunit.client.0.smithi098.stdout:8/5: fsync - no filename 2024-09-19T07:24:45.016 INFO:tasks.workunit.client.0.smithi098.stdout:8/6: read - no filename 2024-09-19T07:24:45.016 INFO:tasks.workunit.client.0.smithi098.stdout:8/7: truncate - no filename 2024-09-19T07:24:45.016 INFO:tasks.workunit.client.0.smithi098.stdout:8/8: dread - no filename 2024-09-19T07:24:45.017 INFO:tasks.workunit.client.0.smithi098.stdout:8/9: dread - no filename 2024-09-19T07:24:45.024 INFO:tasks.workunit.client.0.smithi098.stdout:6/7: unlink c0 0 2024-09-19T07:24:45.024 INFO:tasks.workunit.client.0.smithi098.stdout:6/8: chown . 175210 1 2024-09-19T07:24:45.024 INFO:tasks.workunit.client.0.smithi098.stdout:6/9: rmdir - no directory 2024-09-19T07:24:45.024 INFO:tasks.workunit.client.0.smithi098.stdout:5/9: creat f3 x:0 0 0 2024-09-19T07:24:45.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:45.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:45.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:45.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:45.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:45.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e8c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals/sigismember_stress_1.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:45.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:45.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:45.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:45.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:45.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:45.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:45.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000fb2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/scripts/test/coverage_report.pl) see mds.h log and `damage ls` output for details 2024-09-19T07:24:45.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000fb1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/scripts/test/generate_index.pl) see mds.h log and `damage ls` output for details 2024-09-19T07:24:45.026 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:44 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:45.026 INFO:tasks.workunit.client.0.smithi098.stdout:7/7: rmdir d0 0 2024-09-19T07:24:45.026 INFO:tasks.workunit.client.0.smithi098.stdout:7/8: dread - no filename 2024-09-19T07:24:45.026 INFO:tasks.workunit.client.0.smithi098.stdout:7/9: truncate - no filename 2024-09-19T07:24:45.027 INFO:tasks.workunit.client.0.smithi098.stdout:4/15: symlink l2 0 2024-09-19T07:24:45.027 INFO:tasks.workunit.client.0.smithi098.stdout:8/10: mkdir d0 0 2024-09-19T07:24:45.029 INFO:tasks.workunit.client.0.smithi098.stdout:9/0: stat - no entries 2024-09-19T07:24:45.039 INFO:tasks.workunit.client.0.smithi098.stdout:6/10: creat f1 x:0 0 0 2024-09-19T07:24:45.039 INFO:tasks.workunit.client.0.smithi098.stdout:6/11: truncate f1 693602 0 2024-09-19T07:24:45.047 INFO:tasks.workunit.client.0.smithi098.stdout:8/11: symlink d0/l1 0 2024-09-19T07:24:45.047 INFO:tasks.workunit.client.0.smithi098.stdout:7/10: creat f1 x:0 0 0 2024-09-19T07:24:45.047 INFO:tasks.workunit.client.0.smithi098.stdout:4/16: creat f3 x:0 0 0 2024-09-19T07:24:45.047 INFO:tasks.workunit.client.0.smithi098.stdout:4/17: chown l1 7456 1 2024-09-19T07:24:45.051 INFO:tasks.workunit.client.0.smithi098.stdout:9/1: creat f0 x:0 0 0 2024-09-19T07:24:45.051 INFO:tasks.workunit.client.0.smithi098.stdout:9/2: read - f0 zero size 2024-09-19T07:24:45.051 INFO:tasks.workunit.client.0.smithi098.stdout:9/3: chown f0 1 1 2024-09-19T07:24:45.052 INFO:tasks.workunit.client.0.smithi098.stdout:9/4: dread - f0 zero size 2024-09-19T07:24:45.064 INFO:tasks.workunit.client.0.smithi098.stdout:8/12: mknod d0/c2 0 2024-09-19T07:24:45.065 INFO:tasks.workunit.client.0.smithi098.stdout:7/11: symlink l2 0 2024-09-19T07:24:45.065 INFO:tasks.workunit.client.0.smithi098.stdout:7/12: dread - f1 zero size 2024-09-19T07:24:45.065 INFO:tasks.workunit.client.0.smithi098.stdout:7/13: chown l2 2080349 1 2024-09-19T07:24:45.069 INFO:tasks.workunit.client.0.smithi098.stdout:3/3: getdents . 0 2024-09-19T07:24:45.072 INFO:tasks.workunit.client.0.smithi098.stdout:0/4: dwrite f1 [0,4194304] 0 2024-09-19T07:24:45.072 INFO:tasks.workunit.client.0.smithi098.stdout:0/5: stat f1 0 2024-09-19T07:24:45.080 INFO:tasks.workunit.client.0.smithi098.stdout:9/5: mknod c1 0 2024-09-19T07:24:45.080 INFO:tasks.workunit.client.0.smithi098.stdout:9/6: stat f0 0 2024-09-19T07:24:45.080 INFO:tasks.workunit.client.0.smithi098.stdout:9/7: dread - f0 zero size 2024-09-19T07:24:45.104 INFO:tasks.workunit.client.0.smithi098.stdout:8/13: symlink d0/l3 0 2024-09-19T07:24:45.106 INFO:tasks.workunit.client.0.smithi098.stdout:7/14: rename l2 to l3 0 2024-09-19T07:24:45.109 INFO:tasks.workunit.client.0.smithi098.stdout:3/4: creat f2 x:0 0 0 2024-09-19T07:24:45.109 INFO:tasks.workunit.client.0.smithi098.stdout:3/5: stat f2 0 2024-09-19T07:24:45.109 INFO:tasks.workunit.client.0.smithi098.stdout:3/6: dread - f0 zero size 2024-09-19T07:24:45.124 INFO:tasks.workunit.client.0.smithi098.stdout:0/6: symlink l2 0 2024-09-19T07:24:45.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:45.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:45.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:45.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:45.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:45.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e8c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals/sigismember_stress_1.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:45.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:45.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:45.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:45.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:45.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:45.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:45.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000fb2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/scripts/test/coverage_report.pl) see mds.h log and `damage ls` output for details 2024-09-19T07:24:45.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000fb1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/scripts/test/generate_index.pl) see mds.h log and `damage ls` output for details 2024-09-19T07:24:45.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:45.134 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.745+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d7f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/7-1.c auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed536c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d7f:[<0x10000001d73/7-1.c v24>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d7f:[<0x10000001d73/7-1.c v24>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.134 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.745+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d76 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/4-2.c auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed505f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d76:[<0x10000001d73/4-2.c v6>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d76:[<0x10000001d73/4-2.c v6>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.135 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.745+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d80 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/2-2.c auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5356c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d80:[<0x10000001d73/2-2.c v26>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d80:[<0x10000001d73/2-2.c v26>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.135 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.745+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d7d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/1-1.c auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5356680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d7d:[<0x10000001d73/1-1.c v20>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d7d:[<0x10000001d73/1-1.c v20>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.135 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.746+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d77 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/coverage.txt auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5357180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d77:[<0x10000001d73/coverage.txt v8>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d77:[<0x10000001d73/coverage.txt v8>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.135 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.746+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d79 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/testfrmw.h auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5357700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d79:[<0x10000001d73/testfrmw.h v12>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d79:[<0x10000001d73/testfrmw.h v12>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.135 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.746+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d7a [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/2-1.c auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed534c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d7a:[<0x10000001d73/2-1.c v14>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d7a:[<0x10000001d73/2-1.c v14>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.135 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.746+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d81 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/4-1.c auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed534c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d81:[<0x10000001d73/4-1.c v28>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d81:[<0x10000001d73/4-1.c v28>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.135 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.746+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d7c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/6-1.c auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed534cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d7c:[<0x10000001d73/6-1.c v18>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d7c:[<0x10000001d73/6-1.c v18>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.135 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.746+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d74 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/3-1.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed534d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d74:[<0x10000001d73/3-1.c v2>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d74:[<0x10000001d73/3-1.c v2>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.135 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.746+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d7b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/5-1.c auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed534d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d7b:[<0x10000001d73/5-1.c v16>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d7b:[<0x10000001d73/5-1.c v16>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.135 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.746+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d75 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/9-1.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed534db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d75:[<0x10000001d73/9-1.c v4>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d75:[<0x10000001d73/9-1.c v4>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.135 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.746+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d78 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/testfrmw.c auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed534e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d78:[<0x10000001d73/testfrmw.c v10>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d78:[<0x10000001d73/testfrmw.c v10>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.135 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.747+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d82 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/cln.sh auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed534e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d82:[<0x10000001d73/cln.sh v30>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d82:[<0x10000001d73/cln.sh v30>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.136 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:44.747+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d7e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/assertions.xml auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed534ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d7e:[<0x10000001d73/assertions.xml v22>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v431>,<0x100000012ea/conformance v128>,<0x10000000204/open_posix_testsuite v573>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001d7e:[<0x10000001d73/assertions.xml v22>,<0x10000001413/sem_unlink v4374>,<0x100000012ee/interfaces v543>,<0x100000012ea/conformance v146>,<0x10000000204/open_posix_testsuite v632>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.141 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:24:45.191 INFO:tasks.workunit.client.0.smithi098.stdout:8/14: rmdir d0 39 2024-09-19T07:24:45.191 INFO:tasks.workunit.client.0.smithi098.stdout:8/15: truncate - no filename 2024-09-19T07:24:45.191 INFO:tasks.workunit.client.0.smithi098.stdout:8/16: dwrite - no filename 2024-09-19T07:24:45.191 INFO:tasks.workunit.client.0.smithi098.stdout:8/17: fdatasync - no filename 2024-09-19T07:24:45.211 INFO:tasks.workunit.client.0.smithi098.stdout:7/15: stat l3 0 2024-09-19T07:24:45.212 INFO:tasks.workunit.client.0.smithi098.stdout:7/16: truncate f1 940233 0 2024-09-19T07:24:45.220 INFO:tasks.workunit.client.0.smithi098.stdout:3/7: symlink l3 0 2024-09-19T07:24:45.220 INFO:tasks.workunit.client.0.smithi098.stdout:3/8: stat l1 0 2024-09-19T07:24:45.220 INFO:tasks.workunit.client.0.smithi098.stdout:3/9: dread - f0 zero size 2024-09-19T07:24:45.224 INFO:tasks.workunit.client.0.smithi098.stdout:5/10: dwrite f0 [0,4194304] 0 2024-09-19T07:24:45.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.977+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002264 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.h auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd54cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002264:[<0x10000002260/tbase.h v8>,<0x1000000225a/tbase v24>,<0x1000000223a/base v30>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002264:[<0x10000002260/tbase.h v8>,<0x1000000225a/tbase v24>,<0x1000000223a/base v136>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.977+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002261 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.mod.c auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd54d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002261:[<0x10000002260/tbase.mod.c v2>,<0x1000000225a/tbase v24>,<0x1000000223a/base v30>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002261:[<0x10000002260/tbase.mod.c v2>,<0x1000000225a/tbase v24>,<0x1000000223a/base v136>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.977+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002263 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/Makefile auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd54d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002263:[<0x10000002260/Makefile v6>,<0x1000000225a/tbase v24>,<0x1000000223a/base v30>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002263:[<0x10000002260/Makefile v6>,<0x1000000225a/tbase v24>,<0x1000000223a/base v136>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.977+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002265 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/load_tbase.sh auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd51e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002265:[<0x10000002260/load_tbase.sh v10>,<0x1000000225a/tbase v24>,<0x1000000223a/base v30>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002265:[<0x10000002260/load_tbase.sh v10>,<0x1000000225a/tbase v24>,<0x1000000223a/base v136>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.977+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002266 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/str_mod.h auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd51e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002266:[<0x10000002260/str_mod.h v12>,<0x1000000225a/tbase v24>,<0x1000000223a/base v30>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002266:[<0x10000002260/str_mod.h v12>,<0x1000000225a/tbase v24>,<0x1000000223a/base v136>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:44.978+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002262 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.c auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24761=0-4194304@3} caps={24761=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24761 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd51eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002262:[<0x10000002260/tbase.c v4>,<0x1000000225a/tbase v24>,<0x1000000223a/base v30>,<0x10000001f2c/device-drivers v200>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002262:[<0x10000002260/tbase.c v4>,<0x1000000225a/tbase v24>,<0x1000000223a/base v136>,<0x10000001f2c/device-drivers v652>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:45.445 INFO:tasks.workunit.client.0.smithi098.stdout:8/18: mknod d0/c4 0 2024-09-19T07:24:45.446 INFO:tasks.workunit.client.0.smithi098.stdout:8/19: write - no filename 2024-09-19T07:24:45.446 INFO:tasks.workunit.client.0.smithi098.stdout:8/20: chown d0/l1 63 1 2024-09-19T07:24:45.446 INFO:tasks.workunit.client.0.smithi098.stdout:8/21: dread - no filename 2024-09-19T07:24:45.522 INFO:tasks.workunit.client.0.smithi098.stdout:7/17: creat f4 x:0 0 0 2024-09-19T07:24:45.543 INFO:tasks.workunit.client.0.smithi098.stdout:3/10: creat f4 x:0 0 0 2024-09-19T07:24:45.544 INFO:tasks.workunit.client.0.smithi098.stdout:3/11: write f2 [267291,95800] 0 2024-09-19T07:24:45.549 INFO:tasks.workunit.client.0.smithi098.stdout:5/11: creat f4 x:0 0 0 2024-09-19T07:24:45.549 INFO:tasks.workunit.client.0.smithi098.stdout:5/12: chown c2 1166480505 1 2024-09-19T07:24:45.557 INFO:tasks.workunit.client.0.smithi098.stdout:9/8: dwrite f0 [0,4194304] 0 2024-09-19T07:24:45.568 INFO:tasks.workunit.client.0.smithi098.stdout:9/9: dread f0 [0,4194304] 0 2024-09-19T07:24:45.574 INFO:tasks.workunit.client.0.smithi098.stdout:9/10: write f0 [1088574,76340] 0 2024-09-19T07:24:45.615 INFO:tasks.workunit.client.0.smithi098.stdout:4/18: dwrite f3 [0,4194304] 0 2024-09-19T07:24:45.618 INFO:tasks.workunit.client.0.smithi098.stdout:3/12: dwrite f2 [0,4194304] 0 2024-09-19T07:24:45.712 INFO:tasks.workunit.client.0.smithi098.stdout:0/7: dwrite f1 [0,4194304] 0 2024-09-19T07:24:45.712 INFO:tasks.workunit.client.0.smithi098.stdout:0/8: rmdir - no directory 2024-09-19T07:24:45.833 INFO:tasks.workunit.client.0.smithi098.stdout:3/13: dwrite f4 [0,4194304] 0 2024-09-19T07:24:45.842 INFO:tasks.workunit.client.0.smithi098.stdout:3/14: write f2 [1663054,84388] 0 2024-09-19T07:24:45.861 INFO:tasks.workunit.client.0.smithi098.stdout:3/15: dwrite f0 [0,4194304] 0 2024-09-19T07:24:45.869 INFO:tasks.workunit.client.0.smithi098.stdout:3/16: dread f4 [0,4194304] 0 2024-09-19T07:24:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub queued for path: / 2024-09-19T07:24:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e9c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e9f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e95 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e8d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e9e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/plan.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eec (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f14 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e9d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/keytests.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ed5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ea0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ea8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e8b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ef3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eb7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f0a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ee6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f13 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/helper.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ecd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eaf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.134 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f03 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ec6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ede (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ebe (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f1d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001efa (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/assertions.xml) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e9b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/plan.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001efb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.135 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e9a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/run.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e99 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/multi_con_pro.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e96 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/coverage.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e97 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e98 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/assertions.xml) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e94 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/plan.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e93 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/run.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e8f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/coverage.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e90 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e8e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/multi_send_rev_1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e92 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/multi_send_rev_2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e91 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/assertions.xml) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eed (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ef0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eee (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ef1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ef2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.139 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eef (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f1c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/threads_scenarii.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f19 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f15 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f16 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f18 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f1b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f1a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f17 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ed6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ed7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001edb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.140 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ed9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ed8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/s-c2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001edc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001edd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eda (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ea5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ea1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ea4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ea2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ea6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.141 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ea7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ea3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ea9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eac (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eaa (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ead (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eae (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eab (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ef4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ef7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ef5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ef8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ef9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.142 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ef6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eb8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ebb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eb9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ebc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ebd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eba (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f11 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f10 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/stress2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f0f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f0d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f12 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f0b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/s-c.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.143 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f0c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/stress1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f0e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eeb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ee7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eea (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ee8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ee9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ece (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ed2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ed0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ed3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ed4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.144 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ecf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/s-c.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ed1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eb4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eb0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eb3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eb1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eb5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eb6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eb2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f04 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f07 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f05 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f08 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f09 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f06 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ec7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eca (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ec8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ecb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ecc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ec9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001edf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ee3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ee2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ee0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ee4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ee5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ee1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ec5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/threads_scenarii.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ebf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ec2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ec0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ec3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.147 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ec4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001ec1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f24 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/threads_scenarii.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f1e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f21 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f1f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f22 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f23 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f20 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001efc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.148 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f00 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f01 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001efe (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f02 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001efd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/s-c.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001eff (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.149 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c3d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpipower.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c32 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpireset.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c3e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiel.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c3f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpialarms.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c41 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpitree.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c39 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpifan.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c3b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/Makefile.in) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c38 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/openhpi.pod.7) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.150 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c36 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiinv.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c42 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpitop.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c43 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/Makefile.am) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c37 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpionIBMblade.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c34 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpievents.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c3c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/openhpid.pod.8) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c35 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpisettime.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c40 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiwdt.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c3a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpisensor.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000c33 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpithres.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.151 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.152 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.153 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.153 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.153 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.153 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.153 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002376 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.153 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002377 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/userBlockInclude.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.153 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002374 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/includeTest.h) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.154 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002375 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/includeTest.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.154 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.154 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.154 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002543 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.154 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002351 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/load_tdrm.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.155 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002350 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/str_drm.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.155 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000234e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.155 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000234a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.155 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000234f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/tdrm.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.155 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002353 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/tdrm.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.155 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002352 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/README) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.155 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000234b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/user_tdrm.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.155 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000234c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.155 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.155 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.155 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000243e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/run_io_throttle_test.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.155 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000243c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/io_throttle_testplan.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.156 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002440 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/myfunctions-io.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.156 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000243d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.156 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000243f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/README) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.156 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002441 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/iobw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.156 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.156 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.156 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002016 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/openfile/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.156 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002015 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/openfile/openfile.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002027 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002026 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/fs_inod) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002028 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/fs_inod_readme.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000203e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/README) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000203b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/backbeat) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.157 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000203c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/partbeat) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000203d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/maimparts) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f70 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/shm_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f6f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/mallocstress.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f6e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002802 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_destroy/io_destroy01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002803 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_destroy/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.158 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002670 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups03.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000266e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups04.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002671 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002673 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups02.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000266f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/compat_16.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002672 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups01.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002854 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect03.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002852 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect02.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002851 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002853 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.159 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002711 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/sched_setscheduler02.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000261e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid02.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000261c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid01.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002710 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000261d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002712 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/sched_setscheduler01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000028b3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/brk/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000028b2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/brk/brk01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002637 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_getevents/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002636 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_getevents/io_getevents01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002797 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getsockname/getsockname01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002796 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getsockname/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000276f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/keyctl/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000276e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/keyctl/keyctl01.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e4e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e4d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_2.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001e4f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_1.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d7f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/7-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d76 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/4-2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d80 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/2-2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.162 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d7d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/1-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d77 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/coverage.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d79 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d7a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/2-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d81 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/4-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d7c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/6-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d74 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/3-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d7b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/5-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d75 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/9-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d78 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d82 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/cln.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.163 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001d7e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/assertions.xml) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.164 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.165 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000be7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/cases.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000bdd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000be3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000be6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000be4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout_ripv) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000bde (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_userspace) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000bdf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_irq) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000be2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_over) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000be0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_eipv) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000be1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_no_en) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000be5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_ripv) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000bdb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/refer) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.166 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f48 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrarea_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f4c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_event_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f49 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_event_encode_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f43 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f4b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpiatca_enum_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f4e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_rdr_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f4a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/Makefile.in) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f4d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/Makefile.am) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f45 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_text_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f46 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_rptentry_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f4f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_enum_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f44 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrfield_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.167 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f47 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_time_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000f42 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrinfo_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:46.168 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002264 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.h) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002261 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.mod.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002263 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002265 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/load_tbase.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002266 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/str_mod.h) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002262 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.169 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:45 smithi162 ceph-mon[35726]: pgmap v84: 97 pgs: 97 active+clean; 48 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 1.77k op/s 2024-09-19T07:24:46.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub queued for path: / 2024-09-19T07:24:46.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e9c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e9f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e95 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e8d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e9e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/plan.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eec (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f14 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e9d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/keytests.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ed5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ea0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ea8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e8b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ef3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.277 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eb7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.277 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f0a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.277 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ee6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.277 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f13 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/helper.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.277 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ecd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.277 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eaf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.277 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f03 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.278 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ec6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.278 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ede (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.278 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ebe (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.278 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f1d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.278 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001efa (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/assertions.xml) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.278 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e9b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/plan.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.278 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001efb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.278 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e9a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/run.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.278 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e99 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/multi_con_pro.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.278 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e96 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/coverage.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.279 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e97 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.279 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e98 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/assertions.xml) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.279 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e94 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/plan.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.279 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e93 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/run.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.279 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e8f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/coverage.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.279 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e90 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.279 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e8e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/multi_send_rev_1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.279 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e92 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/multi_send_rev_2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.279 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e91 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/assertions.xml) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.279 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eed (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.280 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ef0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.280 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eee (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.280 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ef1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.280 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ef2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.280 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eef (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.280 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f1c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/threads_scenarii.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.280 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f19 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.280 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f15 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.280 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f16 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.281 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f18 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.281 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f1b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.281 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f1a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.281 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f17 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.281 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ed6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.281 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ed7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.281 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001edb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.281 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ed9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.281 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ed8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/s-c2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.281 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001edc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.282 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001edd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.282 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eda (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.282 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ea5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.282 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ea1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.282 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ea4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.282 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ea2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.282 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ea6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.282 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ea7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.282 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ea3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.282 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ea9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.282 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eac (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eaa (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ead (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eae (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eab (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ef4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ef7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ef5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ef8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ef9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ef6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eb8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ebb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.283 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eb9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ebc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ebd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eba (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f11 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f10 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/stress2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f0f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f0d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f12 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f0b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/s-c.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f0c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/stress1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f0e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eeb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.284 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ee7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.285 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eea (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.285 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ee8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.285 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ee9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.285 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ece (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.285 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ed2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.285 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ed0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.285 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ed3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.285 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ed4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.285 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ecf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/s-c.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.286 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ed1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.286 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eb4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.286 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eb0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.286 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eb3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.286 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eb1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.286 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eb5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.286 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eb6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.286 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eb2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.286 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f04 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.286 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f07 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.287 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f05 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.287 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f08 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.287 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f09 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.287 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f06 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.287 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ec7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.287 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eca (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.287 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ec8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.287 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ecb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.287 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ecc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.287 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ec9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.287 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001edf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.287 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ee3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.288 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ee2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.288 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ee0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.288 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ee4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.288 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ee5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.288 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ee1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.288 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ec5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/threads_scenarii.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.288 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ebf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.288 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ec2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.289 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ec0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.289 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ec3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.289 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ec4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.289 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001ec1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.289 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f24 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/threads_scenarii.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.289 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f1e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.289 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f21 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.289 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f1f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.289 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f22 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.289 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f23 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.289 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f20 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.289 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001efc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.290 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f00 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.290 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f01 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.290 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001efe (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.290 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f02 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.290 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001efd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/s-c.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.290 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001eff (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.290 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.290 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.290 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.290 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.290 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.290 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c3d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpipower.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c32 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpireset.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c3e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiel.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c3f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpialarms.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c41 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpitree.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c39 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpifan.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c3b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/Makefile.in) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c38 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/openhpi.pod.7) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c36 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiinv.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c42 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpitop.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c43 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/Makefile.am) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c37 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpionIBMblade.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.291 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c34 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpievents.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.292 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c3c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/openhpid.pod.8) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.292 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c35 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpisettime.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.292 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c40 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiwdt.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.292 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c3a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpisensor.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.292 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000c33 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpithres.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.292 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.292 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.292 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.292 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.292 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.292 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.292 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.293 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.293 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.293 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.293 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.293 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.293 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.293 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.294 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002376 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.294 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002377 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/userBlockInclude.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.294 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002374 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/includeTest.h) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.294 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002375 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/includeTest.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.294 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.294 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.294 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002543 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.294 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002351 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/load_tdrm.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.294 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002350 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/str_drm.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.294 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000234e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.294 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000234a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.294 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000234f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/tdrm.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.295 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002353 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/tdrm.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.295 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002352 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/README) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.295 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000234b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/user_tdrm.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.295 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000234c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.295 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.295 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.295 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000243e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/run_io_throttle_test.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.295 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000243c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/io_throttle_testplan.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.295 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002440 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/myfunctions-io.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.295 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000243d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.295 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000243f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/README) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.296 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002441 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/iobw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.296 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.296 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.296 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002016 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/openfile/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.296 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002015 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/openfile/openfile.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.296 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.296 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.296 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002027 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.296 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002026 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/fs_inod) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.296 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002028 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/fs_inod_readme.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.296 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.296 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.297 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000203e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/README) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.297 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000203b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/backbeat) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.297 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000203c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/partbeat) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.297 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000203d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/maimparts) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.297 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.297 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.297 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f70 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/shm_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.297 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f6f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/mallocstress.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.298 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f6e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.298 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.298 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.298 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002802 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_destroy/io_destroy01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.298 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002803 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_destroy/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.298 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.298 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.298 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002670 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups03.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.298 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000266e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups04.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.298 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002671 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.298 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002673 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups02.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.299 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000266f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/compat_16.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.299 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002672 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups01.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.299 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.299 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.299 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002854 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect03.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.299 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002852 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect02.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.299 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002851 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.299 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002853 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.299 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.299 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.299 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.299 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002711 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/sched_setscheduler02.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.300 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000261e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid02.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.300 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000261c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid01.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.300 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002710 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.300 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000261d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.300 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002712 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/sched_setscheduler01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.300 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.300 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.300 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.300 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000028b3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/brk/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.300 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000028b2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/brk/brk01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.301 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.301 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.301 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002637 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_getevents/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.301 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002636 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_getevents/io_getevents01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.301 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.301 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.301 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002797 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getsockname/getsockname01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.301 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002796 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getsockname/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.301 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.301 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.301 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000276f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/keyctl/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.302 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000276e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/keyctl/keyctl01.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.302 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.302 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.302 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e4e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.302 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e4d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_2.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.302 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001e4f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_1.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.302 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.302 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.302 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d7f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/7-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.302 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d76 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/4-2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.303 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d80 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/2-2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.303 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d7d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/1-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.303 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d77 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/coverage.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.303 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d79 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.303 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d7a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/2-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.303 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d81 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/4-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.303 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d7c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/6-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.303 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d74 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/3-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.304 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d7b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/5-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.304 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d75 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/9-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.304 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d78 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.305 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d82 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/cln.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.305 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001d7e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/assertions.xml) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.305 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.305 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.305 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.305 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.305 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.305 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.305 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.305 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.305 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.306 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.306 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.306 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.306 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.306 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.306 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.306 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.306 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.306 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.306 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000be7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/cases.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.306 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000bdd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.307 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000be3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.307 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000be6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.307 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000be4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout_ripv) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.307 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000bde (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_userspace) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.307 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000bdf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_irq) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.307 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000be2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_over) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.307 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000be0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_eipv) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.307 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000be1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_no_en) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.307 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000be5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_ripv) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.307 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000bdb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/refer) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.308 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.308 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.308 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f48 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrarea_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.308 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f4c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_event_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.308 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f49 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_event_encode_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.308 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f43 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.308 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f4b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpiatca_enum_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.308 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f4e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_rdr_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.308 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f4a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/Makefile.in) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.308 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f4d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/Makefile.am) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.309 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f45 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_text_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.309 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f46 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_rptentry_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.309 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f4f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_enum_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.309 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f44 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrfield_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.309 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f47 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_time_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.309 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000f42 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrinfo_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.309 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.309 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.309 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.309 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.309 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.309 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.310 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.310 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.310 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.310 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:46.310 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002264 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.h) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.310 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002261 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.mod.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.310 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002263 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.310 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002265 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/load_tbase.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.310 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002266 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/str_mod.h) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.311 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002262 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.311 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.311 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:45 smithi098 ceph-mon[30950]: pgmap v84: 97 pgs: 97 active+clean; 48 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 1.77k op/s 2024-09-19T07:24:46.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:46.067+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002171 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_affinity.c auth v4 pv14 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2009-10-09T17:55:50.000000+0000 b5803 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd54b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002171:[<0x1000000216f/ht_affinity.c v4>,<0x1000000216e/ht_affinity v12>,<0x10000002142/hyperthreading v98>,<0x10000001f2c/sched v126>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002171:[<0x1000000216f/ht_affinity.c v4>,<0x1000000216e/ht_affinity v12>,<0x10000002142/hyperthreading v105>,<0x10000001f2c/sched v638>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:46.067+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002173 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_utils.c auth v8 pv12 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:37.436908+0000 b2272 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd54bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002173:[<0x1000000216f/ht_utils.c v8>,<0x1000000216e/ht_affinity v12>,<0x10000002142/hyperthreading v98>,<0x10000001f2c/sched v126>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002173:[<0x1000000216f/ht_utils.c v8>,<0x1000000216e/ht_affinity v12>,<0x10000002142/hyperthreading v105>,<0x10000001f2c/sched v638>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:46.068+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002174 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_utils.h auth v10 pv20 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2009-10-09T17:55:50.000000+0000 b273 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd54b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002174:[<0x1000000216f/ht_utils.h v10>,<0x1000000216e/ht_affinity v12>,<0x10000002142/hyperthreading v98>,<0x10000001f2c/sched v126>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002174:[<0x1000000216f/ht_utils.h v10>,<0x1000000216e/ht_affinity v12>,<0x10000002142/hyperthreading v105>,<0x10000001f2c/sched v638>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:46.068+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002170 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/Makefile auth v2 pv16 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:37.434908+0000 b1165 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd54c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002170:[<0x1000000216f/Makefile v2>,<0x1000000216e/ht_affinity v12>,<0x10000002142/hyperthreading v98>,<0x10000001f2c/sched v126>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002170:[<0x1000000216f/Makefile v2>,<0x1000000216e/ht_affinity v12>,<0x10000002142/hyperthreading v105>,<0x10000001f2c/sched v638>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:46.068+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002172 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/smt_smp_affinity.sh auth v6 pv18 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:37.435908+0000 b2890 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5563cd54c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002172:[<0x1000000216f/smt_smp_affinity.sh v6>,<0x1000000216e/ht_affinity v12>,<0x10000002142/hyperthreading v98>,<0x10000001f2c/sched v126>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002172:[<0x1000000216f/smt_smp_affinity.sh v6>,<0x1000000216e/ht_affinity v12>,<0x10000002142/hyperthreading v105>,<0x10000001f2c/sched v638>,<0x10000000204/kernel v654>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub queued for path: / 2024-09-19T07:24:46.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e9c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e9f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e95 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e8d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e9e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/plan.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eec (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f14 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e9d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/keytests.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ed5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ea0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ea8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e8b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ef3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eb7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f0a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ee6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f13 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/helper.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ecd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eaf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f03 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ec6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ede (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ebe (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f1d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001efa (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/assertions.xml) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e9b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/plan.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001efb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e9a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/run.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e99 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/multi_con_pro.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e96 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/coverage.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.321 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e97 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e98 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/assertions.xml) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e94 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/plan.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e93 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/run.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e8f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/coverage.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e90 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e8e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/multi_send_rev_1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e92 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/multi_send_rev_2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e91 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/assertions.xml) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eed (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ef0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eee (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ef1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ef2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.323 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eef (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.323 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f1c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/threads_scenarii.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.323 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f19 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.323 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f15 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.323 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f16 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.323 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f18 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.323 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f1b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.323 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f1a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.323 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f17 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.323 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ed6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.323 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ed7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.323 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001edb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.324 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ed9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.324 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ed8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/s-c2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.324 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001edc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.324 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001edd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.324 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eda (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.324 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ea5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.324 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ea1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.324 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ea4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.324 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ea2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.324 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ea6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.324 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ea7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.325 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ea3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.325 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ea9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.325 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eac (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.325 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eaa (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.325 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ead (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.325 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eae (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.325 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eab (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.325 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ef4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.325 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ef7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.325 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ef5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.325 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ef8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.326 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ef9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.326 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ef6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.326 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eb8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.326 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ebb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.326 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eb9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.326 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ebc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.326 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ebd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.326 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eba (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.326 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f11 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.327 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f10 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/stress2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.327 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f0f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.327 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f0d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.327 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f12 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.327 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f0b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/s-c.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.327 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f0c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/stress1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.327 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f0e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.327 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eeb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.327 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ee7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.327 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eea (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.327 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ee8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.327 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ee9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.328 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ece (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.328 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ed2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.328 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ed0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.328 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ed3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.328 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ed4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.328 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ecf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/s-c.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.328 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ed1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.328 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eb4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.328 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eb0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.328 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eb3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.328 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eb1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.328 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eb5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eb6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eb2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f04 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f07 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f05 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f08 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f09 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f06 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ec7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eca (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ec8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ecb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ecc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ec9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001edf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/s-c1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.331 INFO:tasks.workunit.client.0.smithi098.stdout:8/22: creat d0/f5 x:0 0 0 2024-09-19T07:24:46.331 INFO:tasks.workunit.client.0.smithi098.stdout:8/23: truncate d0/f5 243227 0 2024-09-19T07:24:46.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ee3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/do-plot) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.333 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ee2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.333 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ee0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.333 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ee4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.333 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ee5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.333 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ee1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.333 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ec5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/threads_scenarii.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.333 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ebf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.333 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ec2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.333 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ec0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.333 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ec3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.333 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ec4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.334 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001ec1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.334 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f24 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/threads_scenarii.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.334 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f1e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.334 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f21 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.334 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f1f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.334 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f22 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.334 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f23 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.334 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f20 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.334 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001efc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.334 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f00 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.335 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f01 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/NOTES) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.335 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001efe (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.335 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f02 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/LICENCE) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.335 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001efd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/s-c.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.335 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001eff (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.335 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.335 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.335 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.335 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.335 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.335 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.335 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c3d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpipower.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c32 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpireset.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c3e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiel.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c3f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpialarms.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c41 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpitree.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c39 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpifan.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c3b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/Makefile.in) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c38 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/openhpi.pod.7) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c36 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiinv.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c42 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpitop.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c43 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/Makefile.am) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c37 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpionIBMblade.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c34 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpievents.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.336 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c3c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/openhpid.pod.8) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.337 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c35 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpisettime.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.337 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c40 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiwdt.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.337 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c3a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpisensor.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.337 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000c33 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpithres.pod.1) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.337 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.337 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.337 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.337 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.337 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.337 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.338 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.338 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.338 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.338 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.338 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.338 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.338 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.338 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.338 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002376 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.338 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002377 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/userBlockInclude.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.338 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002374 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/includeTest.h) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.338 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002375 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/includeTest.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.339 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.339 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.339 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002543 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.339 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002351 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/load_tdrm.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.339 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002350 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/str_drm.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.339 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000234e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.339 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000234a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.339 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000234f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/tdrm.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.339 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002353 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/tdrm.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.339 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002352 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/README) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.339 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000234b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/user_tdrm.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.339 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000234c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.340 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.340 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.340 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000243e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/run_io_throttle_test.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.340 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000243c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/io_throttle_testplan.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.340 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002440 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/myfunctions-io.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.340 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000243d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.340 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000243f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/README) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.340 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002441 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/iobw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.340 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.340 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.340 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002016 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/openfile/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.341 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002015 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/openfile/openfile.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.341 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.341 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.341 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002027 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.341 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002026 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/fs_inod) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.341 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002028 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/fs_inod_readme.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.341 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.341 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.341 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000203e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/README) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.341 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000203b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/backbeat) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000203c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/partbeat) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000203d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/maimparts) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f70 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/shm_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f6f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/mallocstress.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f6e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002802 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_destroy/io_destroy01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002803 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_destroy/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.342 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.343 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002670 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups03.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.343 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000266e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups04.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.343 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002671 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.343 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002673 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups02.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.343 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000266f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/compat_16.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.343 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002672 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups01.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.343 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.343 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.343 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002854 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect03.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.343 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002852 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect02.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.343 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002851 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.343 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002853 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.344 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.344 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.344 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.344 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002711 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/sched_setscheduler02.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.344 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000261e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid02.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.344 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000261c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid01.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.344 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002710 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.344 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000261d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.344 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002712 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/sched_setscheduler01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.344 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.344 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.344 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000028b3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/brk/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000028b2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/brk/brk01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002637 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_getevents/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002636 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_getevents/io_getevents01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002797 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getsockname/getsockname01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002796 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getsockname/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.345 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000276f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/keyctl/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.346 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000276e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/keyctl/keyctl01.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.346 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.346 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.346 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e4e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.346 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e4d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_2.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.346 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001e4f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_1.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.346 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.346 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.346 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d7f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/7-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.346 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d76 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/4-2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.346 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d80 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/2-2.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d7d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/1-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d77 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/coverage.txt) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d79 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/testfrmw.h) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d7a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/2-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d81 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/4-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d7c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/6-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d74 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/3-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d7b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/5-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d75 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/9-1.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d78 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/testfrmw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d82 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/cln.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001d7e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/assertions.xml) see mds.i log and `damage ls` output for details 2024-09-19T07:24:46.347 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.348 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.348 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.348 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.348 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.348 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.348 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.348 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.348 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.348 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.348 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.348 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.348 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000be7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/cases.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000bdd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000be3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000be6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000be4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout_ripv) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000bde (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_userspace) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000bdf (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_irq) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.349 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000be2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_over) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.350 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000be0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_eipv) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.350 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000be1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_no_en) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.350 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000be5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_ripv) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.350 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000bdb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/refer) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.350 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.350 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.350 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f48 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrarea_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.350 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f4c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_event_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.351 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f49 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_event_encode_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.351 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f43 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.351 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f4b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpiatca_enum_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.351 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f4e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_rdr_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.351 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f4a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/Makefile.in) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.351 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f4d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/Makefile.am) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.351 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f45 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_text_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.351 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f46 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_rptentry_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.351 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f4f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_enum_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.351 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f44 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrfield_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.351 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f47 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_time_utils_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.351 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000f42 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrinfo_test.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002264 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.h) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002261 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.mod.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.352 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002263 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.353 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002265 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/load_tbase.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.353 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002266 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/str_mod.h) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.353 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002262 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:46.353 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:46.353 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:45 smithi139 ceph-mon[35039]: pgmap v84: 97 pgs: 97 active+clean; 48 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.9 MiB/s wr, 1.77k op/s 2024-09-19T07:24:46.626 INFO:tasks.workunit.client.0.smithi098.stdout:7/18: mkdir d5 0 2024-09-19T07:24:46.783 INFO:tasks.workunit.client.0.smithi098.stdout:5/13: creat f5 x:0 0 0 2024-09-19T07:24:46.783 INFO:tasks.workunit.client.0.smithi098.stdout:5/14: dread - f5 zero size 2024-09-19T07:24:46.793 INFO:tasks.workunit.client.0.smithi098.stdout:5/15: dread f0 [0,4194304] 0 2024-09-19T07:24:46.882 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.555+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002474 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-interleaved auth v26 pv64 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.316897+0000 b311 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51aab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002474:[<0x10000002467/test-lazy-anon-1g-interleaved v26>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002474:[<0x10000002467/test-lazy-anon-1g-interleaved v26>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.882 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.555+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002476 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g-interleaved auth v30 pv44 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.318897+0000 b286 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51ab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002476:[<0x10000002467/test-mpm-anon-1g-interleaved v30>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002476:[<0x10000002467/test-mpm-anon-1g-interleaved v30>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.882 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.555+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002468 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m auth v2 pv66 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.305898+0000 b301 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51ab600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002468:[<0x10000002467/test-lazy-file-1m v2>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002468:[<0x10000002467/test-lazy-file-1m v2>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.882 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.555+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002469 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-2shm-1m auth v4 pv80 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.306898+0000 b428 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51ac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002469:[<0x10000002467/test-lazy-2shm-1m v4>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002469:[<0x10000002467/test-lazy-2shm-1m v4>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.882 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.556+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002477 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-16m auth v32 pv68 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-06-03T12:08:46.000000+0000 b264 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51abb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002477:[<0x10000002467/test-mpm-file-16m v32>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002477:[<0x10000002467/test-mpm-file-16m v32>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.882 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.556+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000247c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1p auth v42 pv70 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.323897+0000 b257 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51ac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000247c:[<0x10000002467/test-lazy-anon-1p v42>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000247c:[<0x10000002467/test-lazy-anon-1p v42>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.882 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.556+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000247b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g auth v40 pv50 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.322897+0000 b226 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51acc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000247b:[<0x10000002467/test-lazy-anon-1g v40>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000247b:[<0x10000002467/test-lazy-anon-1g v40>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.882 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.556+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000247a [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-2shm-1m auth v38 pv84 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.321897+0000 b339 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51ad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000247a:[<0x10000002467/test-mpm-2shm-1m v38>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000247a:[<0x10000002467/test-mpm-2shm-1m v38>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.883 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.556+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002478 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-1m auth v34 pv74 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.319897+0000 b253 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed51ad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002478:[<0x10000002467/test-mpm-file-1m v34>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002478:[<0x10000002467/test-mpm-file-1m v34>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.883 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.556+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000246e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-nomig auth v14 pv82 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2008-06-03T12:08:45.000000+0000 b299 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5232000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000246e:[<0x10000002467/test-lazy-anon-8p-nomig v14>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000246e:[<0x10000002467/test-lazy-anon-8p-nomig v14>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.883 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.557+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000246a [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1p auth v6 pv56 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.307897+0000 b215 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5232580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000246a:[<0x10000002467/test-mpm-anon-1p v6>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000246a:[<0x10000002467/test-mpm-anon-1p v6>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.883 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.557+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000246f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g auth v16 pv62 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.311897+0000 b193 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5232b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000246f:[<0x10000002467/test-mpm-anon-1g v16>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000246f:[<0x10000002467/test-mpm-anon-1g v16>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.883 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.557+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002471 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m-touch auth v20 pv46 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.313897+0000 b394 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5233080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002471:[<0x10000002467/test-lazy-file-16m-touch v20>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002471:[<0x10000002467/test-lazy-file-16m-touch v20>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.883 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.557+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002473 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-8p auth v24 pv48 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.315897+0000 b304 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5233600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002473:[<0x10000002467/test-lazy-file-8p v24>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002473:[<0x10000002467/test-lazy-file-8p v24>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.884 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.557+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002475 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-touch auth v28 pv58 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.317897+0000 b406 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5233b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002475:[<0x10000002467/test-lazy-anon-8p-touch v28>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002475:[<0x10000002467/test-lazy-anon-8p-touch v28>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.884 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.557+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000246b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-shm-8p auth v8 pv60 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.308897+0000 b285 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5234100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000246b:[<0x10000002467/test-lazy-shm-8p v8>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000246b:[<0x10000002467/test-lazy-shm-8p v8>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.884 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.557+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000246d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-touch auth v12 pv52 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.310897+0000 b324 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5234680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000246d:[<0x10000002467/test-lazy-anon-1g-touch v12>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000246d:[<0x10000002467/test-lazy-anon-1g-touch v12>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.884 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.558+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002470 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p auth v18 pv76 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.312897+0000 b248 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5234c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002470:[<0x10000002467/test-lazy-anon-8p v18>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002470:[<0x10000002467/test-lazy-anon-8p v18>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.884 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.558+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000246c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m auth v10 pv78 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.309897+0000 b316 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5235180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000246c:[<0x10000002467/test-lazy-file-16m v10>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000246c:[<0x10000002467/test-lazy-file-16m v10>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.884 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.558+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002479 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-8p auth v36 pv54 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.320897+0000 b196 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5235700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002479:[<0x10000002467/test-mpm-anon-8p v36>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002479:[<0x10000002467/test-mpm-anon-8p v36>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:46.884 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:46.558+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002472 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m-touch auth v22 pv72 ap=2 s=0 n(v0 1=1+0)->n(v0 rc2024-09-19T07:24:38.314897+0000 b472 1=1+0) (ifile excl w=1) cr={24761=0-4194304@3} caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=1 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x557ed5236000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002472:[<0x10000002467/test-lazy-file-1m-touch v22>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v48>,<0x10000001f2c/hotplug v250>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002472:[<0x10000002467/test-lazy-file-1m-touch v22>,<0x10000002463/Xpm-tests v50>,<0x10000002443/memory_hotplug v55>,<0x10000001f2c/hotplug v658>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:47.057 INFO:tasks.workunit.client.0.smithi098.stdout:4/19: symlink l4 0 2024-09-19T07:24:47.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002171 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_affinity.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002173 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_utils.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002174 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_utils.h) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002170 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002172 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/smt_smp_affinity.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:46 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:47.199 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:46 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:47.199 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:46 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002171 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_affinity.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.199 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:46 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002173 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_utils.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.199 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:46 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002174 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_utils.h) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.199 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:46 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002170 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.199 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:46 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002172 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/smt_smp_affinity.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.199 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:46 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:47.316 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:47.120+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023bb [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_memory_spread_testset.sh auth v8 ap=1 s=7694 n(v0 rc2024-09-19T07:24:38.157899+0000 b7694 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd520680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023bb:[<0x100000023b8/cpuset_memory_spread_testset.sh v6>,<0x10000002398/cpuset_memory_spread_test v70>,<0x1000000238f/cpuset v50>,<0x10000001f2c/controllers v242>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000023bb:[<0x100000023b8/cpuset_memory_spread_testset.sh v8>,<0x10000002398/cpuset_memory_spread_test v70>,<0x1000000238f/cpuset v266>,<0x10000001f2c/controllers v656>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:47.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:47.120+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023ba [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_mem_hog.c auth v12 ap=1 s=3365 n(v0 rc2024-09-19T07:24:38.156899+0000 b3365 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd520c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023ba:[<0x100000023b8/cpuset_mem_hog.c v4>,<0x10000002398/cpuset_memory_spread_test v70>,<0x1000000238f/cpuset v50>,<0x10000001f2c/controllers v242>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000023ba:[<0x100000023b8/cpuset_mem_hog.c v12>,<0x10000002398/cpuset_memory_spread_test v70>,<0x1000000238f/cpuset v266>,<0x10000001f2c/controllers v656>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:47.317 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:47.120+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023b9 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/Makefile auth v10 ap=1 s=1079 n(v0 rc2009-10-09T17:55:47.000000+0000 b1079 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd521180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023b9:[<0x100000023b8/Makefile v2>,<0x10000002398/cpuset_memory_spread_test v70>,<0x1000000238f/cpuset v50>,<0x10000001f2c/controllers v242>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000023b9:[<0x100000023b8/Makefile v10>,<0x10000002398/cpuset_memory_spread_test v70>,<0x1000000238f/cpuset v266>,<0x10000001f2c/controllers v656>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:47.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:46 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:47.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:46 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002171 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_affinity.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:46 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002173 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_utils.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:46 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002174 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_utils.h) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:46 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002170 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:46 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002172 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/smt_smp_affinity.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:47.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:46 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:47.363 INFO:tasks.workunit.client.0.smithi098.stdout:3/17: dwrite f2 [4194304,4194304] 0 2024-09-19T07:24:47.363 INFO:tasks.workunit.client.0.smithi098.stdout:3/18: readlink l1 0 2024-09-19T07:24:47.363 INFO:tasks.workunit.client.0.smithi098.stdout:3/19: fsync f4 0 2024-09-19T07:24:47.501 INFO:tasks.workunit.client.0.smithi098.stdout:0/9: mknod c3 0 2024-09-19T07:24:47.501 INFO:tasks.workunit.client.0.smithi098.stdout:0/10: read - f0 zero size 2024-09-19T07:24:47.632 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:47.355+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_process_stress.c auth v8 ap=1 s=3277 n(v0 rc2024-09-19T07:24:38.240898+0000 b3277 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed51a8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241d:[<0x1000000241a/memcg_process_stress.c v6>,<0x1000000240b/stress v36>,<0x1000000238f/memcg v180>,<0x10000001f2c/controllers v242>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000241d:[<0x1000000241a/memcg_process_stress.c v8>,<0x1000000240b/stress v36>,<0x1000000238f/memcg v264>,<0x10000001f2c/controllers v656>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:47.632 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:47.355+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_stress_test.sh auth v12 ap=1 s=3544 n(v0 rc2009-12-03T14:56:39.000000+0000 b3544 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed51a7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241b:[<0x1000000241a/memcg_stress_test.sh v2>,<0x1000000240b/stress v36>,<0x1000000238f/memcg v180>,<0x10000001f2c/controllers v242>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000241b:[<0x1000000241a/memcg_stress_test.sh v12>,<0x1000000240b/stress v36>,<0x1000000238f/memcg v264>,<0x10000001f2c/controllers v656>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:47.632 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:47.355+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/Makefile auth v10 ap=1 s=1115 n(v0 rc2024-09-19T07:24:38.239898+0000 b1115 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed51a7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241c:[<0x1000000241a/Makefile v4>,<0x1000000240b/stress v36>,<0x1000000238f/memcg v180>,<0x10000001f2c/controllers v242>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000241c:[<0x1000000241a/Makefile v10>,<0x1000000240b/stress v36>,<0x1000000238f/memcg v264>,<0x10000001f2c/controllers v656>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:47.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.655+0000 7f004f36c640 1 -- 172.21.15.98:0/3110840313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048106a80 msgr2=0x7f0048106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.655+0000 7f004f36c640 1 --2- 172.21.15.98:0/3110840313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048106a80 0x7f0048106e60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0044009930 tx=0x7f004402a420 comp rx=0 tx=0).stop 2024-09-19T07:24:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.655+0000 7f004f36c640 1 -- 172.21.15.98:0/3110840313 shutdown_connections 2024-09-19T07:24:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.655+0000 7f004f36c640 1 --2- 172.21.15.98:0/3110840313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0048101420 0x7f004810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.655+0000 7f004f36c640 1 --2- 172.21.15.98:0/3110840313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0048100a80 0x7f0048100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.655+0000 7f004f36c640 1 --2- 172.21.15.98:0/3110840313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048106a80 0x7f0048106e60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.655+0000 7f004f36c640 1 -- 172.21.15.98:0/3110840313 >> 172.21.15.98:0/3110840313 conn(0x7f00480fc7a0 msgr2=0x7f00480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.655+0000 7f004f36c640 1 -- 172.21.15.98:0/3110840313 shutdown_connections 2024-09-19T07:24:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.655+0000 7f004f36c640 1 -- 172.21.15.98:0/3110840313 wait complete. 2024-09-19T07:24:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004f36c640 1 Processor -- start 2024-09-19T07:24:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004f36c640 1 -- start start 2024-09-19T07:24:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004f36c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0048100a80 0x7f00481992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004f36c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048101420 0x7f0048199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004f36c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0048106a80 0x7f00481a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004f36c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0048110e80 con 0x7f0048101420 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004f36c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0048110d00 con 0x7f0048106a80 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004f36c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0048111000 con 0x7f0048100a80 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004d909640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0048106a80 0x7f00481a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004c907640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048101420 0x7f0048199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004d108640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0048100a80 0x7f00481992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004d909640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0048106a80 0x7f00481a4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:37278/0 (socket says 172.21.15.98:37278) 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004d909640 1 -- 172.21.15.98:0/3629256964 learned_addr learned my addr 172.21.15.98:0/3629256964 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004d909640 1 -- 172.21.15.98:0/3629256964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0048100a80 msgr2=0x7f00481992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004d909640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0048100a80 0x7f00481992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004d909640 1 -- 172.21.15.98:0/3629256964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048101420 msgr2=0x7f0048199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:47.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004d909640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048101420 0x7f0048199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004d909640 1 -- 172.21.15.98:0/3629256964 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00481a48b0 con 0x7f0048106a80 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.656+0000 7f004c907640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048101420 0x7f0048199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.657+0000 7f004d909640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0048106a80 0x7f00481a4370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0040009fd0 tx=0x7f004000b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.657+0000 7f003e7fc640 1 -- 172.21.15.98:0/3629256964 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0040017070 con 0x7f0048106a80 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.657+0000 7f004f36c640 1 -- 172.21.15.98:0/3629256964 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00481a4a80 con 0x7f0048106a80 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.657+0000 7f003e7fc640 1 -- 172.21.15.98:0/3629256964 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0040003e50 con 0x7f0048106a80 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.657+0000 7f003e7fc640 1 -- 172.21.15.98:0/3629256964 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00400106c0 con 0x7f0048106a80 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.657+0000 7f004f36c640 1 -- 172.21.15.98:0/3629256964 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00481a4f90 con 0x7f0048106a80 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.659+0000 7f0051745740 1 Processor -- start 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f003e7fc640 1 -- 172.21.15.98:0/3629256964 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0040003970 con 0x7f0048106a80 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f0051745740 1 -- start start 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f0051745740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4d93880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f0051745740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d93dc0 0x55bbf4d9e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f0051745740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d9e680 0x55bbf4da0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f0051745740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bbf4cf92e0 con 0x55bbf4d9e680 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f0051745740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bbf4ca0ce0 con 0x55bbf4d934a0 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f0051745740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bbf4cf52a0 con 0x55bbf4d93dc0 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f004c907640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4d93880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f004c907640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4d93880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:37286/0 (socket says 172.21.15.98:37286) 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f004c907640 1 -- 172.21.15.98:0/1371995828 learned_addr learned my addr 172.21.15.98:0/1371995828 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f004d108640 1 --2- 172.21.15.98:0/1371995828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d93dc0 0x55bbf4d9e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f004c907640 1 --2- 172.21.15.98:0/1371995828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d9e680 0x55bbf4da0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.660+0000 7f003e7fc640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f00340a33b0 0x7f00340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.661+0000 7f004d108640 1 -- 172.21.15.98:0/1371995828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 msgr2=0x55bbf4d93880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.661+0000 7f004d108640 1 --2- 172.21.15.98:0/1371995828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4d93880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.661+0000 7f004d108640 1 -- 172.21.15.98:0/1371995828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d9e680 msgr2=0x55bbf4da0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.661+0000 7f004d108640 1 --2- 172.21.15.98:0/1371995828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d9e680 0x55bbf4da0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.661+0000 7f004d909640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f00340a33b0 0x7f00340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.661+0000 7f004d108640 1 -- 172.21.15.98:0/1371995828 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbf4c85440 con 0x55bbf4d93dc0 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.661+0000 7f004d108640 1 --2- 172.21.15.98:0/1371995828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d93dc0 0x55bbf4d9e140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0044005940 tx=0x7f0044005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed5e45e95b0a779d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.661+0000 7f003e7fc640 1 -- 172.21.15.98:0/3629256964 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f00400cfa10 con 0x7f0048106a80 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.661+0000 7f004d909640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f00340a33b0 0x7f00340a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f00400981d0 tx=0x7f004006b990 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.661+0000 7f00337fe640 1 -- 172.21.15.98:0/1371995828 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044040070 con 0x55bbf4d93dc0 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.661+0000 7f00337fe640 1 -- 172.21.15.98:0/1371995828 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00440318f0 con 0x55bbf4d93dc0 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.661+0000 7f00337fe640 1 -- 172.21.15.98:0/1371995828 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044035040 con 0x55bbf4d93dc0 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.662+0000 7f0051745740 1 -- 172.21.15.98:0/1371995828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d93dc0 msgr2=0x55bbf4d9e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.662+0000 7f0051745740 1 --2- 172.21.15.98:0/1371995828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d93dc0 0x55bbf4d9e140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0044005940 tx=0x7f0044005c00 comp rx=0 tx=0).stop 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.662+0000 7f0051745740 1 -- 172.21.15.98:0/1371995828 shutdown_connections 2024-09-19T07:24:47.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.662+0000 7f0051745740 1 --2- 172.21.15.98:0/1371995828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d9e680 0x55bbf4da0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.662+0000 7f0051745740 1 --2- 172.21.15.98:0/1371995828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d93dc0 0x55bbf4d9e140 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.662+0000 7f0051745740 1 --2- 172.21.15.98:0/1371995828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4d93880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.662+0000 7f0051745740 1 -- 172.21.15.98:0/1371995828 >> 172.21.15.98:0/1371995828 conn(0x55bbf4d8fa30 msgr2=0x55bbf4d8fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.662+0000 7f0051745740 1 -- 172.21.15.98:0/1371995828 shutdown_connections 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.662+0000 7f0051745740 1 -- 172.21.15.98:0/1371995828 wait complete. 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.662+0000 7f0051745740 1 -- start start 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.662+0000 7f0051745740 1 Processor -- start 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.663+0000 7f0051745740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4d9df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.663+0000 7f0051745740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d93dc0 0x55bbf4d9b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.663+0000 7f0051745740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d9e680 0x55bbf4d9b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.663+0000 7f0051745740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bbf4da1250 con 0x55bbf4d9e680 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.663+0000 7f0051745740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55bbf4cb4050 con 0x55bbf4d934a0 2024-09-19T07:24:47.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.663+0000 7f0051745740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55bbf4da13d0 con 0x55bbf4d93dc0 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.663+0000 7f0051745740 10 client.0 _ll_register_callbacks cb 0x55bbf4cf4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.663+0000 7f004c907640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4d9df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.663+0000 7f004c907640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d9e680 0x55bbf4d9b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.663+0000 7f004d108640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d93dc0 0x55bbf4d9b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.663+0000 7f004c907640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d9e680 0x55bbf4d9b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41956/0 (socket says 172.21.15.98:41956) 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.663+0000 7f004c907640 1 -- 172.21.15.98:0/284647804 learned_addr learned my addr 172.21.15.98:0/284647804 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f004c907640 1 -- 172.21.15.98:0/284647804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d93dc0 msgr2=0x55bbf4d9b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f004c907640 1 --2- 172.21.15.98:0/284647804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d93dc0 0x55bbf4d9b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f004c907640 1 -- 172.21.15.98:0/284647804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 msgr2=0x55bbf4d9df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f004c907640 1 --2- 172.21.15.98:0/284647804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4d9df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f004c907640 1 -- 172.21.15.98:0/284647804 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbf4a6a3c0 con 0x55bbf4d9e680 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f004c907640 1 --2- 172.21.15.98:0/284647804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d9e680 0x55bbf4d9b720 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f003800f3c0 tx=0x7f0038005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ff65ac6ede74c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:47.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f0030ff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f0030ff9640 1 -- 172.21.15.98:0/284647804 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0038027060 con 0x55bbf4d9e680 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f0051745740 1 -- 172.21.15.98:0/284647804 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00440318f0 con 0x55bbf4d9e680 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f0030ff9640 1 -- 172.21.15.98:0/284647804 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f003800fe00 con 0x55bbf4d9e680 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f0030ff9640 1 -- 172.21.15.98:0/284647804 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f003800e5f0 con 0x55bbf4d9e680 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f0051745740 10 client.16197 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f0051745740 1 -- 172.21.15.98:0/284647804 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bbf4dacc00 con 0x55bbf4d9e680 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.664+0000 7f0030ff9640 1 -- 172.21.15.98:0/284647804 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00440318f0 con 0x55bbf4d9e680 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.665+0000 7f0030ff9640 1 -- 172.21.15.98:0/284647804 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f003802a7f0 con 0x55bbf4d9e680 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.665+0000 7f0051745740 10 client.16197 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.665+0000 7f0051745740 10 client.16197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.665+0000 7f0051745740 20 client.16197 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.665+0000 7f0051745740 1 --2- 172.21.15.98:0/284647804 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bbf4dae0c0 0x55bbf4db0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.665+0000 7f0051745740 4 client.16197 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:47.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.665+0000 7f0051745740 1 -- 172.21.15.98:0/284647804 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbf4d06850 con 0x55bbf4dae0c0 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.665+0000 7f004d108640 1 --2- 172.21.15.98:0/284647804 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bbf4dae0c0 0x55bbf4db0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.665+0000 7f004d108640 1 --2- 172.21.15.98:0/284647804 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bbf4dae0c0 0x55bbf4db0520 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34c77e25d738a26c server_cookie=6f9c338431852ae2 in_seq=0 out_seq=0 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.665+0000 7f0030ff9640 10 client.16197 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0030ff9640 1 -- 172.21.15.98:0/284647804 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bbf4d06850 con 0x55bbf4dae0c0 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0030ff9640 10 client.16197 handle_command_reply: tid=0 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0051745740 1 client.16197 shutdown 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0051745740 1 -- 172.21.15.98:0/284647804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d9e680 msgr2=0x55bbf4d9b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0051745740 1 --2- 172.21.15.98:0/284647804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d9e680 0x55bbf4d9b720 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f003800f3c0 tx=0x7f0038005f90 comp rx=0 tx=0).stop 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0051745740 1 -- 172.21.15.98:0/284647804 shutdown_connections 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0051745740 1 --2- 172.21.15.98:0/284647804 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bbf4dae0c0 0x55bbf4db0520 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0051745740 1 --2- 172.21.15.98:0/284647804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d9e680 0x55bbf4d9b720 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0051745740 1 --2- 172.21.15.98:0/284647804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d93dc0 0x55bbf4d9b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0051745740 1 --2- 172.21.15.98:0/284647804 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4d9df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0030ff9640 0 client.16197 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:47.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0051745740 1 -- 172.21.15.98:0/284647804 >> 172.21.15.98:0/284647804 conn(0x55bbf4d8fa30 msgr2=0x55bbf4d95710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:47.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0051745740 1 -- 172.21.15.98:0/284647804 shutdown_connections 2024-09-19T07:24:47.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0051745740 1 -- 172.21.15.98:0/284647804 wait complete. 2024-09-19T07:24:47.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.667+0000 7f0051745740 20 client.16197 trim_cache size 0 max 16384 2024-09-19T07:24:47.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f0051745740 1 Processor -- start 2024-09-19T07:24:47.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f0051745740 1 -- start start 2024-09-19T07:24:47.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f0051745740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4daa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f0051745740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 0x55bbf4db5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f0051745740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d9e680 0x55bbf4db6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f0051745740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f00481b0230 con 0x55bbf4d93dc0 2024-09-19T07:24:47.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f0051745740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f00481adb00 con 0x55bbf4d934a0 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f0051745740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00481ab950 con 0x55bbf4d9e680 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f004d108640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 0x55bbf4db5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f004d108640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 0x55bbf4db5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41970/0 (socket says 172.21.15.98:41970) 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f004d108640 1 -- 172.21.15.98:0/3931311303 learned_addr learned my addr 172.21.15.98:0/3931311303 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f004c907640 1 --2- 172.21.15.98:0/3931311303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d9e680 0x55bbf4db6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f004c907640 1 --2- 172.21.15.98:0/3931311303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4daa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f004d108640 1 -- 172.21.15.98:0/3931311303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d9e680 msgr2=0x55bbf4db6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f004d108640 1 --2- 172.21.15.98:0/3931311303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d9e680 0x55bbf4db6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f004d108640 1 -- 172.21.15.98:0/3931311303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 msgr2=0x55bbf4daa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f004d108640 1 --2- 172.21.15.98:0/3931311303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4daa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f004d108640 1 -- 172.21.15.98:0/3931311303 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbf4d8f860 con 0x55bbf4d93dc0 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.686+0000 7f004c907640 1 --2- 172.21.15.98:0/3931311303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4daa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:47.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.687+0000 7f004d108640 1 --2- 172.21.15.98:0/3931311303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 0x55bbf4db5e30 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0044005440 tx=0x7f0044005510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c03b9fa0148086 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.687+0000 7f0032ffd640 1 -- 172.21.15.98:0/3931311303 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044054020 con 0x55bbf4d93dc0 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.687+0000 7f0032ffd640 1 -- 172.21.15.98:0/3931311303 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00440035f0 con 0x55bbf4d93dc0 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.687+0000 7f0032ffd640 1 -- 172.21.15.98:0/3931311303 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044040070 con 0x55bbf4d93dc0 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.687+0000 7f0051745740 1 -- 172.21.15.98:0/3931311303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 msgr2=0x55bbf4db5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.687+0000 7f0051745740 1 --2- 172.21.15.98:0/3931311303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 0x55bbf4db5e30 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0044005440 tx=0x7f0044005510 comp rx=0 tx=0).stop 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.687+0000 7f0051745740 1 -- 172.21.15.98:0/3931311303 shutdown_connections 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.687+0000 7f0051745740 1 --2- 172.21.15.98:0/3931311303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d9e680 0x55bbf4db6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.687+0000 7f0051745740 1 --2- 172.21.15.98:0/3931311303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 0x55bbf4db5e30 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.687+0000 7f0051745740 1 --2- 172.21.15.98:0/3931311303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d934a0 0x55bbf4daa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.687+0000 7f0051745740 1 -- 172.21.15.98:0/3931311303 >> 172.21.15.98:0/3931311303 conn(0x55bbf4d8fa30 msgr2=0x55bbf4d96850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f0051745740 1 -- 172.21.15.98:0/3931311303 shutdown_connections 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f0051745740 1 -- 172.21.15.98:0/3931311303 wait complete. 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f0051745740 1 -- start start 2024-09-19T07:24:47.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f0051745740 1 Processor -- start 2024-09-19T07:24:47.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f0051745740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d934a0 0x55bbf4da27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f0051745740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 0x55bbf4da2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f0051745740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d9e680 0x55bbf4e17e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f0051745740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f00481abfc0 con 0x55bbf4d93dc0 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f0051745740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f00481ad430 con 0x55bbf4d9e680 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f0051745740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00481ac690 con 0x55bbf4d934a0 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f0051745740 10 client.0 _ll_register_callbacks cb 0x7f00380119b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f004d108640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 0x55bbf4da2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f004d108640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 0x55bbf4da2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41978/0 (socket says 172.21.15.98:41978) 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.688+0000 7f004d108640 1 -- 172.21.15.98:0/2242847873 learned_addr learned my addr 172.21.15.98:0/2242847873 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f004c907640 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d934a0 0x55bbf4da27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f004c907640 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d9e680 0x55bbf4e17e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f004d108640 1 -- 172.21.15.98:0/2242847873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d934a0 msgr2=0x55bbf4da27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f004d108640 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d934a0 0x55bbf4da27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f004d108640 1 -- 172.21.15.98:0/2242847873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d9e680 msgr2=0x55bbf4e17e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f004d108640 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d9e680 0x55bbf4e17e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f004d108640 1 -- 172.21.15.98:0/2242847873 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbf4d94640 con 0x55bbf4d93dc0 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f004d108640 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 0x55bbf4da2ce0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f004402a940 tx=0x7f004402aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174fda5b99d24a83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f0030ff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f0030ff9640 1 -- 172.21.15.98:0/2242847873 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0044040070 con 0x55bbf4d93dc0 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f0030ff9640 1 -- 172.21.15.98:0/2242847873 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0044004230 con 0x55bbf4d93dc0 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f0051745740 1 -- 172.21.15.98:0/2242847873 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00440035f0 con 0x55bbf4d93dc0 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f0030ff9640 1 -- 172.21.15.98:0/2242847873 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0044066050 con 0x55bbf4d93dc0 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f0051745740 10 client.16203 fetch_fsmap learned FSMap version 25 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.689+0000 7f0051745740 1 -- 172.21.15.98:0/2242847873 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bbf4e19320 con 0x55bbf4d93dc0 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.690+0000 7f0030ff9640 1 -- 172.21.15.98:0/2242847873 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00440035f0 con 0x55bbf4d93dc0 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.690+0000 7f0030ff9640 1 -- 172.21.15.98:0/2242847873 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f004403c560 con 0x55bbf4d93dc0 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.690+0000 7f0051745740 10 client.16203 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T07:24:47.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.690+0000 7f0051745740 10 client.16203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:47.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.690+0000 7f0051745740 20 client.16203 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:47.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.690+0000 7f0051745740 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bbf4e195f0 0x55bbf4e1b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:47.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.690+0000 7f0051745740 4 client.16203 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:24:47.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.690+0000 7f0051745740 1 -- 172.21.15.98:0/2242847873 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bbf4d9bab0 con 0x55bbf4e195f0 2024-09-19T07:24:47.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.690+0000 7f004c907640 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bbf4e195f0 0x55bbf4e1b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:47.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.690+0000 7f0030ff9640 10 client.16203 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:47.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.690+0000 7f004c907640 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bbf4e195f0 0x55bbf4e1b9e0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38f5b13bb0b7ad12 server_cookie=46d3ac0fca3cfa3a in_seq=0 out_seq=0 2024-09-19T07:24:47.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0030ff9640 1 -- 172.21.15.98:0/2242847873 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55bbf4d9bab0 con 0x55bbf4e195f0 2024-09-19T07:24:47.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0030ff9640 10 client.16203 handle_command_reply: tid=0 2024-09-19T07:24:47.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0051745740 1 client.16203 shutdown 2024-09-19T07:24:47.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0051745740 1 -- 172.21.15.98:0/2242847873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 msgr2=0x55bbf4da2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:47.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0051745740 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 0x55bbf4da2ce0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f004402a940 tx=0x7f004402aae0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0051745740 1 -- 172.21.15.98:0/2242847873 shutdown_connections 2024-09-19T07:24:47.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0051745740 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55bbf4d9e680 0x55bbf4e17e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0051745740 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55bbf4e195f0 0x55bbf4e1b9e0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0051745740 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbf4d93dc0 0x55bbf4da2ce0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0051745740 1 --2- 172.21.15.98:0/2242847873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf4d934a0 0x55bbf4da27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0051745740 1 -- 172.21.15.98:0/2242847873 >> 172.21.15.98:0/2242847873 conn(0x55bbf4d8fa30 msgr2=0x55bbf4d8e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:47.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0030ff9640 0 client.16203 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:47.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0051745740 1 -- 172.21.15.98:0/2242847873 shutdown_connections 2024-09-19T07:24:47.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0051745740 1 -- 172.21.15.98:0/2242847873 wait complete. 2024-09-19T07:24:47.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.694+0000 7f0051745740 20 client.16203 trim_cache size 0 max 16384 2024-09-19T07:24:47.697 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:24:47.697 INFO:teuthology.orchestra.run.smithi098.stdout: "status": "scrub active (6068 inodes in the stack)", 2024-09-19T07:24:47.698 INFO:teuthology.orchestra.run.smithi098.stdout: "scrubs": { 2024-09-19T07:24:47.698 INFO:teuthology.orchestra.run.smithi098.stdout: "24d01d2c-d989-4974-baee-7bc9d460d802": { 2024-09-19T07:24:47.698 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/", 2024-09-19T07:24:47.698 INFO:teuthology.orchestra.run.smithi098.stdout: "tag": "24d01d2c-d989-4974-baee-7bc9d460d802", 2024-09-19T07:24:47.698 INFO:teuthology.orchestra.run.smithi098.stdout: "options": "recursive,force" 2024-09-19T07:24:47.698 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:24:47.698 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:24:47.698 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:24:47.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.695+0000 7f004f36c640 1 -- 172.21.15.98:0/3629256964 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f00340a33b0 msgr2=0x7f00340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:47.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.695+0000 7f004f36c640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f00340a33b0 0x7f00340a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f00400981d0 tx=0x7f004006b990 comp rx=0 tx=0).stop 2024-09-19T07:24:47.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.695+0000 7f004f36c640 1 -- 172.21.15.98:0/3629256964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0048106a80 msgr2=0x7f00481a4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:47.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.695+0000 7f004f36c640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0048106a80 0x7f00481a4370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0040009fd0 tx=0x7f004000b260 comp rx=0 tx=0).stop 2024-09-19T07:24:47.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.695+0000 7f004f36c640 1 -- 172.21.15.98:0/3629256964 shutdown_connections 2024-09-19T07:24:47.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.695+0000 7f004f36c640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f00340a33b0 0x7f00340a5870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.695+0000 7f004f36c640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0048106a80 0x7f00481a4370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.695+0000 7f004f36c640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0048101420 0x7f0048199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.695+0000 7f004f36c640 1 --2- 172.21.15.98:0/3629256964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0048100a80 0x7f00481992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:47.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.695+0000 7f004f36c640 1 -- 172.21.15.98:0/3629256964 >> 172.21.15.98:0/3629256964 conn(0x7f00480fc7a0 msgr2=0x7f00480fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:47.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.695+0000 7f004f36c640 1 -- 172.21.15.98:0/3629256964 shutdown_connections 2024-09-19T07:24:47.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:24:47.695+0000 7f004f36c640 1 -- 172.21.15.98:0/3629256964 wait complete. 2024-09-19T07:24:47.817 INFO:tasks.workunit.client.0.smithi098.stdout:8/24: symlink d0/l6 0 2024-09-19T07:24:47.818 INFO:tasks.workunit.client.0.smithi098.stdout:7/19: symlink d5/l6 0 2024-09-19T07:24:47.819 INFO:tasks.workunit.client.0.smithi098.stdout:7/20: chown l3 188149378 1 2024-09-19T07:24:47.819 INFO:tasks.workunit.client.0.smithi098.stdout:5/16: creat f6 x:0 0 0 2024-09-19T07:24:47.821 INFO:tasks.workunit.client.0.smithi098.stdout:4/20: mknod c5 0 2024-09-19T07:24:47.838 INFO:tasks.workunit.client.0.smithi098.stdout:8/25: dwrite d0/f5 [0,4194304] 0 2024-09-19T07:24:48.067 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:47.684+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000200b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config3 auth v28 ap=1 s=390 n(v0 rc2024-09-19T07:24:36.843916+0000 b390 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd543080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000200b:[<0x10000002005/ffsb-config3 v12>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v42>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000200b:[<0x10000002005/ffsb-config3 v28>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v380>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:48.067 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:47.685+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002006 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config1 auth v34 ap=1 s=297 n(v0 rc2024-09-19T07:24:36.839916+0000 b297 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd543600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002006:[<0x10000002005/ffsb-config1 v2>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v42>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002006:[<0x10000002005/ffsb-config1 v34>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v380>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:48.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:48.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002474 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-interleaved) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002476 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g-interleaved) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002468 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002469 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-2shm-1m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002477 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-16m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000247c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000247b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000247a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-2shm-1m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002478 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-1m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000246e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-nomig) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000246a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000246f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002471 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m-touch) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.071 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:47.685+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000200c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config4 auth v22 ap=1 s=390 n(v0 rc2024-09-19T07:24:36.844916+0000 b390 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd543b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000200c:[<0x10000002005/ffsb-config4 v14>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v42>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000200c:[<0x10000002005/ffsb-config4 v22>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v380>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:48.071 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:47.685+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002008 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config7 auth v36 ap=1 s=390 n(v0 rc2009-10-26T11:25:55.000000+0000 b390 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd544100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002008:[<0x10000002005/ffsb-config7 v6>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v42>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002008:[<0x10000002005/ffsb-config7 v36>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v380>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:48.071 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:47.685+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000200a [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config5 auth v24 ap=1 s=390 n(v0 rc2024-09-19T07:24:36.842916+0000 b390 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd544680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000200a:[<0x10000002005/ffsb-config5 v10>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v42>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000200a:[<0x10000002005/ffsb-config5 v24>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v380>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:48.072 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:47.685+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002009 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/Makefile auth v30 ap=1 s=984 n(v0 rc2024-09-19T07:24:36.841916+0000 b984 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd544c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002009:[<0x10000002005/Makefile v8>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v42>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002009:[<0x10000002005/Makefile v30>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v380>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:48.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002473 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-8p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002475 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-touch) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000246b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-shm-8p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000246d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-touch) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002470 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000246c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002479 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-8p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002472 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m-touch) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:48.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:48.075 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000023bb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_memory_spread_testset.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:48.075 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000023ba (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_mem_hog.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:48.075 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000023b9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:48.075 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:48.075 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-mon[35039]: pgmap v85: 97 pgs: 97 active+clean; 48 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 1.44k op/s 2024-09-19T07:24:48.076 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:47.685+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000200d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config6 auth v20 ap=1 s=390 n(v0 rc2024-09-19T07:24:36.845916+0000 b390 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd545180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000200d:[<0x10000002005/ffsb-config6 v16>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v42>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000200d:[<0x10000002005/ffsb-config6 v20>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v380>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:48.076 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:47.685+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000200e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config0 auth v32 ap=1 s=298 n(v0 rc2009-10-26T11:25:55.000000+0000 b298 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd545700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000200e:[<0x10000002005/ffsb-config0 v18>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v42>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x1000000200e:[<0x10000002005/ffsb-config0 v32>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v380>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:48.076 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:47.685+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002007 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config2 auth v26 ap=1 s=298 n(v0 rc2024-09-19T07:24:36.840916+0000 b298 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd54a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002007:[<0x10000002005/ffsb-config2 v4>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v42>,<0x10000001f2c/fs v106>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000002007:[<0x10000002005/ffsb-config2 v26>,<0x10000001fac/ext4-ffsb-config v194>,<0x10000001fa6/ext4-new-features v380>,<0x10000001f2c/fs v654>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:48.193 INFO:tasks.workunit.client.0.smithi098.stdout:9/11: truncate f0 592659 0 2024-09-19T07:24:48.193 INFO:tasks.workunit.client.0.smithi098.stdout:9/12: chown f0 453888 1 2024-09-19T07:24:48.202 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a[30946]: 2024-09-19T07:24:47.879+0000 7efcdf868640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:24:48.202 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002474 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-interleaved) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002476 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g-interleaved) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002468 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002469 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-2shm-1m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002477 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-16m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000247c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000247b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000247a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-2shm-1m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002478 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-1m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000246e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-nomig) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000246a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000246f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.203 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002471 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m-touch) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002473 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-8p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002475 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-touch) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000246b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-shm-8p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000246d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-touch) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002470 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000246c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002479 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-8p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002472 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m-touch) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.204 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:48.205 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:48.205 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000023bb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_memory_spread_testset.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:48.205 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000023ba (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_mem_hog.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:48.205 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000023b9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:48.205 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:48.205 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:47 smithi098 ceph-mon[30950]: pgmap v85: 97 pgs: 97 active+clean; 48 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 1.44k op/s 2024-09-19T07:24:48.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:48.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002474 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-interleaved) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002476 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g-interleaved) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002468 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002469 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-2shm-1m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002477 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-16m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000247c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000247b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000247a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-2shm-1m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002478 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-1m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000246e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-nomig) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000246a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000246f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002471 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m-touch) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002473 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-8p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002475 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-touch) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000246b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-shm-8p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000246d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-touch) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002470 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000246c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002479 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-8p) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002472 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m-touch) see mds.i log and `damage ls` output for details 2024-09-19T07:24:48.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:48.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:48.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000023bb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_memory_spread_testset.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:48.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000023ba (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_mem_hog.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:48.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000023b9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:48.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:48.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:47 smithi162 ceph-mon[35726]: pgmap v85: 97 pgs: 97 active+clean; 48 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 1.44k op/s 2024-09-19T07:24:48.478 INFO:tasks.workunit.client.0.smithi098.stdout:0/11: creat f4 x:0 0 0 2024-09-19T07:24:48.479 INFO:tasks.cephfs.filesystem:scrub status for tag:24d01d2c-d989-4974-baee-7bc9d460d802 - {'path': '/', 'tag': '24d01d2c-d989-4974-baee-7bc9d460d802', 'options': 'recursive,force'} 2024-09-19T07:24:48.483 INFO:tasks.workunit.client.0.smithi098.stdout:7/21: rename f1 to d5/f7 0 2024-09-19T07:24:48.484 INFO:tasks.workunit.client.0.smithi098.stdout:5/17: symlink l7 0 2024-09-19T07:24:48.484 INFO:tasks.workunit.client.0.smithi098.stdout:5/18: dread - f4 zero size 2024-09-19T07:24:48.484 INFO:tasks.workunit.client.0.smithi098.stdout:5/19: write f1 [1970132,1484] 0 2024-09-19T07:24:48.486 INFO:tasks.workunit.client.0.smithi098.stdout:4/21: unlink f3 0 2024-09-19T07:24:48.486 INFO:tasks.workunit.client.0.smithi098.stdout:4/22: write - no filename 2024-09-19T07:24:48.487 INFO:tasks.workunit.client.0.smithi098.stdout:8/26: creat d0/f7 x:0 0 0 2024-09-19T07:24:48.488 INFO:tasks.workunit.client.0.smithi098.stdout:8/27: write d0/f7 [304594,37547] 0 2024-09-19T07:24:48.490 INFO:tasks.workunit.client.0.smithi098.stdout:3/20: truncate f0 1946514 0 2024-09-19T07:24:48.492 INFO:tasks.workunit.client.0.smithi098.stdout:7/22: mkdir d5/d8 0 2024-09-19T07:24:48.492 INFO:tasks.workunit.client.0.smithi098.stdout:7/23: fdatasync d5/f7 0 2024-09-19T07:24:48.494 INFO:tasks.workunit.client.0.smithi098.stdout:4/23: symlink l6 0 2024-09-19T07:24:48.495 INFO:tasks.workunit.client.0.smithi098.stdout:3/21: getdents . 0 2024-09-19T07:24:48.496 INFO:tasks.workunit.client.0.smithi098.stdout:7/24: link f4 d5/d8/f9 0 2024-09-19T07:24:48.496 INFO:tasks.workunit.client.0.smithi098.stdout:7/25: write d5/d8/f9 [137991,66926] 0 2024-09-19T07:24:48.498 INFO:tasks.workunit.client.0.smithi098.stdout:4/24: mknod c7 0 2024-09-19T07:24:48.498 INFO:tasks.workunit.client.0.smithi098.stdout:4/25: stat c5 0 2024-09-19T07:24:48.499 INFO:tasks.workunit.client.0.smithi098.stdout:3/22: rename f2 to f5 0 2024-09-19T07:24:48.501 INFO:tasks.workunit.client.0.smithi098.stdout:7/26: creat d5/d8/fa x:0 0 0 2024-09-19T07:24:48.503 INFO:tasks.workunit.client.0.smithi098.stdout:3/23: symlink l6 0 2024-09-19T07:24:48.505 INFO:tasks.workunit.client.0.smithi098.stdout:3/24: truncate f4 3224377 0 2024-09-19T07:24:48.505 INFO:tasks.workunit.client.0.smithi098.stdout:3/25: fdatasync f0 0 2024-09-19T07:24:48.505 INFO:tasks.workunit.client.0.smithi098.stdout:3/26: stat l6 0 2024-09-19T07:24:48.507 INFO:tasks.workunit.client.0.smithi098.stdout:3/27: symlink l7 0 2024-09-19T07:24:48.507 INFO:tasks.workunit.client.0.smithi098.stdout:3/28: chown f4 24980 1 2024-09-19T07:24:48.507 INFO:tasks.workunit.client.0.smithi098.stdout:8/28: dwrite d0/f7 [0,4194304] 0 2024-09-19T07:24:48.507 INFO:tasks.workunit.client.0.smithi098.stdout:8/29: chown d0/c4 4 1 2024-09-19T07:24:48.508 INFO:tasks.workunit.client.0.smithi098.stdout:8/30: rmdir d0 39 2024-09-19T07:24:48.509 INFO:tasks.workunit.client.0.smithi098.stdout:7/27: dread d5/d8/f9 [0,4194304] 0 2024-09-19T07:24:48.519 INFO:tasks.workunit.client.0.smithi098.stdout:9/13: write f0 [829940,15968] 0 2024-09-19T07:24:48.520 INFO:tasks.workunit.client.0.smithi098.stdout:9/14: stat c1 0 2024-09-19T07:24:48.520 INFO:tasks.workunit.client.0.smithi098.stdout:9/15: chown c1 481712581 1 2024-09-19T07:24:48.520 INFO:tasks.workunit.client.0.smithi098.stdout:8/31: write d0/f7 [2888777,39243] 0 2024-09-19T07:24:48.521 INFO:tasks.workunit.client.0.smithi098.stdout:9/16: link c1 c2 0 2024-09-19T07:24:48.522 INFO:tasks.workunit.client.0.smithi098.stdout:8/32: mknod d0/c8 0 2024-09-19T07:24:48.523 INFO:tasks.workunit.client.0.smithi098.stdout:8/33: symlink d0/l9 0 2024-09-19T07:24:48.524 INFO:tasks.workunit.client.0.smithi098.stdout:8/34: creat d0/fa x:0 0 0 2024-09-19T07:24:48.533 INFO:tasks.workunit.client.0.smithi098.stdout:3/29: dwrite f5 [4194304,4194304] 0 2024-09-19T07:24:48.533 INFO:tasks.workunit.client.0.smithi098.stdout:8/35: read d0/f5 [2781792,31611] 0 2024-09-19T07:24:48.535 INFO:tasks.workunit.client.0.smithi098.stdout:3/30: creat f8 x:0 0 0 2024-09-19T07:24:48.536 INFO:tasks.workunit.client.0.smithi098.stdout:8/36: symlink d0/lb 0 2024-09-19T07:24:48.538 INFO:tasks.workunit.client.0.smithi098.stdout:8/37: creat d0/fc x:0 0 0 2024-09-19T07:24:48.546 INFO:tasks.workunit.client.0.smithi098.stdout:3/31: write f5 [7374204,123396] 0 2024-09-19T07:24:48.547 INFO:tasks.workunit.client.0.smithi098.stdout:3/32: creat f9 x:0 0 0 2024-09-19T07:24:48.549 INFO:tasks.workunit.client.0.smithi098.stdout:9/17: dwrite f0 [0,4194304] 0 2024-09-19T07:24:48.549 INFO:tasks.workunit.client.0.smithi098.stdout:7/28: dwrite d5/d8/f9 [0,4194304] 0 2024-09-19T07:24:48.550 INFO:tasks.workunit.client.0.smithi098.stdout:9/18: mkdir d3 0 2024-09-19T07:24:48.552 INFO:tasks.workunit.client.0.smithi098.stdout:9/19: rename c1 to d3/c4 0 2024-09-19T07:24:48.553 INFO:tasks.workunit.client.0.smithi098.stdout:9/20: fdatasync f0 0 2024-09-19T07:24:48.554 INFO:tasks.workunit.client.0.smithi098.stdout:9/21: rename c2 to d3/c5 0 2024-09-19T07:24:48.557 INFO:tasks.workunit.client.0.smithi098.stdout:3/33: dread f5 [4194304,4194304] 0 2024-09-19T07:24:48.557 INFO:tasks.workunit.client.0.smithi098.stdout:3/34: dread - f8 zero size 2024-09-19T07:24:48.557 INFO:tasks.workunit.client.0.smithi098.stdout:3/35: fdatasync f8 0 2024-09-19T07:24:48.560 INFO:tasks.workunit.client.0.smithi098.stdout:3/36: symlink la 0 2024-09-19T07:24:48.567 INFO:tasks.workunit.client.0.smithi098.stdout:7/29: dwrite d5/f7 [0,4194304] 0 2024-09-19T07:24:48.569 INFO:tasks.workunit.client.0.smithi098.stdout:7/30: rename d5/l6 to d5/lb 0 2024-09-19T07:24:48.622 INFO:tasks.workunit.client.0.smithi098.stdout:5/20: getdents . 0 2024-09-19T07:24:48.625 INFO:tasks.workunit.client.0.smithi098.stdout:5/21: write f1 [1853016,88472] 0 2024-09-19T07:24:48.625 INFO:tasks.workunit.client.0.smithi098.stdout:5/22: chown f1 28887 1 2024-09-19T07:24:48.625 INFO:tasks.workunit.client.0.smithi098.stdout:5/23: getdents . 0 2024-09-19T07:24:48.625 INFO:tasks.workunit.client.0.smithi098.stdout:5/24: chown f4 4018 1 2024-09-19T07:24:48.626 INFO:tasks.workunit.client.0.smithi098.stdout:5/25: symlink l8 0 2024-09-19T07:24:48.627 INFO:tasks.workunit.client.0.smithi098.stdout:5/26: creat f9 x:0 0 0 2024-09-19T07:24:48.628 INFO:tasks.workunit.client.0.smithi098.stdout:5/27: unlink f9 0 2024-09-19T07:24:48.629 INFO:tasks.workunit.client.0.smithi098.stdout:4/26: getdents . 0 2024-09-19T07:24:48.629 INFO:tasks.workunit.client.0.smithi098.stdout:4/27: dread - no filename 2024-09-19T07:24:48.629 INFO:tasks.workunit.client.0.smithi098.stdout:4/28: dwrite - no filename 2024-09-19T07:24:48.631 INFO:tasks.workunit.client.0.smithi098.stdout:7/31: fsync d5/d8/fa 0 2024-09-19T07:24:48.632 INFO:tasks.workunit.client.0.smithi098.stdout:4/29: creat f8 x:0 0 0 2024-09-19T07:24:48.632 INFO:tasks.workunit.client.0.smithi098.stdout:4/30: truncate f8 668387 0 2024-09-19T07:24:48.634 INFO:tasks.workunit.client.0.smithi098.stdout:7/32: mkdir d5/d8/dc 0 2024-09-19T07:24:48.634 INFO:tasks.workunit.client.0.smithi098.stdout:7/33: chown d5/d8/dc 18764 1 2024-09-19T07:24:48.635 INFO:tasks.workunit.client.0.smithi098.stdout:7/34: symlink d5/ld 0 2024-09-19T07:24:48.636 INFO:tasks.workunit.client.0.smithi098.stdout:7/35: unlink l3 0 2024-09-19T07:24:48.637 INFO:tasks.workunit.client.0.smithi098.stdout:7/36: readlink d5/lb 0 2024-09-19T07:24:48.637 INFO:tasks.workunit.client.0.smithi098.stdout:7/37: truncate d5/d8/fa 365936 0 2024-09-19T07:24:48.639 INFO:tasks.workunit.client.0.smithi098.stdout:7/38: creat d5/d8/dc/fe x:0 0 0 2024-09-19T07:24:48.641 INFO:tasks.workunit.client.0.smithi098.stdout:7/39: creat d5/ff x:0 0 0 2024-09-19T07:24:48.653 INFO:tasks.workunit.client.0.smithi098.stdout:8/38: getdents d0 0 2024-09-19T07:24:48.658 INFO:tasks.workunit.client.0.smithi098.stdout:3/37: truncate f5 6667162 0 2024-09-19T07:24:48.658 INFO:tasks.workunit.client.0.smithi098.stdout:3/38: truncate f8 370889 0 2024-09-19T07:24:48.660 INFO:tasks.workunit.client.0.smithi098.stdout:7/40: dwrite d5/f7 [0,4194304] 0 2024-09-19T07:24:48.661 INFO:tasks.workunit.client.0.smithi098.stdout:3/39: truncate f4 1976947 0 2024-09-19T07:24:48.664 INFO:tasks.workunit.client.0.smithi098.stdout:7/41: mkdir d5/d10 0 2024-09-19T07:24:48.665 INFO:tasks.workunit.client.0.smithi098.stdout:5/28: getdents . 0 2024-09-19T07:24:48.667 INFO:tasks.workunit.client.0.smithi098.stdout:4/31: getdents . 0 2024-09-19T07:24:48.670 INFO:tasks.workunit.client.0.smithi098.stdout:8/39: dwrite d0/fa [0,4194304] 0 2024-09-19T07:24:48.674 INFO:tasks.workunit.client.0.smithi098.stdout:7/42: mkdir d5/d10/d11 0 2024-09-19T07:24:48.675 INFO:tasks.workunit.client.0.smithi098.stdout:5/29: creat fa x:0 0 0 2024-09-19T07:24:48.678 INFO:tasks.workunit.client.0.smithi098.stdout:4/32: creat f9 x:0 0 0 2024-09-19T07:24:48.678 INFO:tasks.workunit.client.0.smithi098.stdout:4/33: dread - f9 zero size 2024-09-19T07:24:48.680 INFO:tasks.workunit.client.0.smithi098.stdout:8/40: rename d0/c4 to d0/cd 0 2024-09-19T07:24:48.682 INFO:tasks.workunit.client.0.smithi098.stdout:7/43: rmdir d5/d10 39 2024-09-19T07:24:48.684 INFO:tasks.workunit.client.0.smithi098.stdout:5/30: fsync f5 0 2024-09-19T07:24:48.684 INFO:tasks.workunit.client.0.smithi098.stdout:5/31: stat f5 0 2024-09-19T07:24:48.690 INFO:tasks.workunit.client.0.smithi098.stdout:4/34: mkdir da 0 2024-09-19T07:24:48.690 INFO:tasks.workunit.client.0.smithi098.stdout:4/35: read - f9 zero size 2024-09-19T07:24:48.690 INFO:tasks.workunit.client.0.smithi098.stdout:4/36: read - f9 zero size 2024-09-19T07:24:48.692 INFO:tasks.workunit.client.0.smithi098.stdout:5/32: mknod cb 0 2024-09-19T07:24:48.692 INFO:tasks.workunit.client.0.smithi098.stdout:8/41: write d0/fa [1638163,102230] 0 2024-09-19T07:24:48.694 INFO:tasks.workunit.client.0.smithi098.stdout:8/42: mkdir d0/de 0 2024-09-19T07:24:48.694 INFO:tasks.workunit.client.0.smithi098.stdout:8/43: write d0/fa [969101,37845] 0 2024-09-19T07:24:48.694 INFO:tasks.workunit.client.0.smithi098.stdout:7/44: dread d5/f7 [0,4194304] 0 2024-09-19T07:24:48.697 INFO:tasks.workunit.client.0.smithi098.stdout:8/44: creat d0/ff x:0 0 0 2024-09-19T07:24:48.697 INFO:tasks.workunit.client.0.smithi098.stdout:8/45: dread - d0/fc zero size 2024-09-19T07:24:48.699 INFO:tasks.workunit.client.0.smithi098.stdout:7/45: creat d5/f12 x:0 0 0 2024-09-19T07:24:48.699 INFO:tasks.workunit.client.0.smithi098.stdout:7/46: chown d5/d10 118133 1 2024-09-19T07:24:48.699 INFO:tasks.workunit.client.0.smithi098.stdout:7/47: fsync f4 0 2024-09-19T07:24:48.705 INFO:tasks.workunit.client.0.smithi098.stdout:5/33: mkdir dc 0 2024-09-19T07:24:48.705 INFO:tasks.workunit.client.0.smithi098.stdout:5/34: getdents dc 0 2024-09-19T07:24:48.706 INFO:tasks.workunit.client.0.smithi098.stdout:5/35: chown f3 0 1 2024-09-19T07:24:48.708 INFO:tasks.workunit.client.0.smithi098.stdout:4/37: dwrite f9 [0,4194304] 0 2024-09-19T07:24:48.709 INFO:tasks.workunit.client.0.smithi098.stdout:5/36: dread - f4 zero size 2024-09-19T07:24:48.709 INFO:tasks.workunit.client.0.smithi098.stdout:5/37: write fa [820981,90028] 0 2024-09-19T07:24:48.710 INFO:tasks.workunit.client.0.smithi098.stdout:3/40: write f4 [167865,8357] 0 2024-09-19T07:24:48.715 INFO:tasks.workunit.client.0.smithi098.stdout:4/38: creat da/fb x:0 0 0 2024-09-19T07:24:48.720 INFO:tasks.workunit.client.0.smithi098.stdout:4/39: stat c7 0 2024-09-19T07:24:48.721 INFO:tasks.workunit.client.0.smithi098.stdout:5/38: rename l8 to dc/ld 0 2024-09-19T07:24:48.722 INFO:tasks.workunit.client.0.smithi098.stdout:4/40: creat da/fc x:0 0 0 2024-09-19T07:24:48.723 INFO:tasks.workunit.client.0.smithi098.stdout:7/48: dwrite f4 [0,4194304] 0 2024-09-19T07:24:48.723 INFO:tasks.workunit.client.0.smithi098.stdout:7/49: read d5/d8/fa [185601,64746] 0 2024-09-19T07:24:48.728 INFO:tasks.workunit.client.0.smithi098.stdout:5/39: unlink f6 0 2024-09-19T07:24:48.729 INFO:tasks.workunit.client.0.smithi098.stdout:5/40: mkdir dc/de 0 2024-09-19T07:24:48.730 INFO:tasks.workunit.client.0.smithi098.stdout:5/41: mknod dc/cf 0 2024-09-19T07:24:48.736 INFO:tasks.workunit.client.0.smithi098.stdout:3/41: dwrite f9 [0,4194304] 0 2024-09-19T07:24:48.736 INFO:tasks.workunit.client.0.smithi098.stdout:3/42: fsync f9 0 2024-09-19T07:24:48.740 INFO:tasks.workunit.client.0.smithi098.stdout:3/43: symlink lb 0 2024-09-19T07:24:48.743 INFO:tasks.workunit.client.0.smithi098.stdout:5/42: link dc/ld dc/de/l10 0 2024-09-19T07:24:48.744 INFO:tasks.workunit.client.0.smithi098.stdout:5/43: write f0 [5170185,27288] 0 2024-09-19T07:24:48.753 INFO:tasks.workunit.client.0.smithi098.stdout:4/41: dwrite f8 [0,4194304] 0 2024-09-19T07:24:48.753 INFO:tasks.workunit.client.0.smithi098.stdout:4/42: truncate da/fc 305034 0 2024-09-19T07:24:48.755 INFO:tasks.workunit.client.0.smithi098.stdout:4/43: creat da/fd x:0 0 0 2024-09-19T07:24:48.755 INFO:tasks.workunit.client.0.smithi098.stdout:4/44: write da/fc [326855,66875] 0 2024-09-19T07:24:48.757 INFO:tasks.workunit.client.0.smithi098.stdout:4/45: fsync da/fc 0 2024-09-19T07:24:48.757 INFO:tasks.workunit.client.0.smithi098.stdout:4/46: chown da/fb 185620 1 2024-09-19T07:24:48.760 INFO:tasks.workunit.client.0.smithi098.stdout:4/47: read da/fc [154383,10908] 0 2024-09-19T07:24:48.765 INFO:tasks.workunit.client.0.smithi098.stdout:3/44: dwrite f9 [0,4194304] 0 2024-09-19T07:24:48.766 INFO:tasks.workunit.client.0.smithi098.stdout:3/45: creat fc x:0 0 0 2024-09-19T07:24:48.767 INFO:tasks.workunit.client.0.smithi098.stdout:3/46: write f5 [746603,10482] 0 2024-09-19T07:24:48.767 INFO:tasks.workunit.client.0.smithi098.stdout:3/47: chown f9 38309925 1 2024-09-19T07:24:48.768 INFO:tasks.workunit.client.0.smithi098.stdout:3/48: link l1 ld 0 2024-09-19T07:24:48.768 INFO:tasks.workunit.client.0.smithi098.stdout:3/49: fdatasync f8 0 2024-09-19T07:24:48.770 INFO:tasks.workunit.client.0.smithi098.stdout:4/48: write f8 [2110761,67795] 0 2024-09-19T07:24:48.770 INFO:tasks.workunit.client.0.smithi098.stdout:4/49: read - da/fb zero size 2024-09-19T07:24:48.770 INFO:tasks.workunit.client.0.smithi098.stdout:3/50: mkdir de 0 2024-09-19T07:24:48.771 INFO:tasks.workunit.client.0.smithi098.stdout:3/51: dread - fc zero size 2024-09-19T07:24:48.771 INFO:tasks.workunit.client.0.smithi098.stdout:3/52: write f4 [2256573,114248] 0 2024-09-19T07:24:48.773 INFO:tasks.workunit.client.0.smithi098.stdout:3/53: mkdir de/df 0 2024-09-19T07:24:48.773 INFO:tasks.workunit.client.0.smithi098.stdout:3/54: truncate f9 4643959 0 2024-09-19T07:24:48.773 INFO:tasks.workunit.client.0.smithi098.stdout:3/55: mknod de/df/c10 0 2024-09-19T07:24:48.774 INFO:tasks.workunit.client.0.smithi098.stdout:3/56: rmdir de/df 39 2024-09-19T07:24:48.781 INFO:tasks.workunit.client.0.smithi098.stdout:3/57: truncate f9 1012109 0 2024-09-19T07:24:48.781 INFO:tasks.workunit.client.0.smithi098.stdout:3/58: rmdir de/df 39 2024-09-19T07:24:48.788 INFO:tasks.workunit.client.0.smithi098.stdout:4/50: dwrite da/fb [0,4194304] 0 2024-09-19T07:24:48.790 INFO:tasks.workunit.client.0.smithi098.stdout:4/51: fdatasync f8 0 2024-09-19T07:24:48.809 INFO:tasks.workunit.client.0.smithi098.stdout:3/59: dwrite f8 [0,4194304] 0 2024-09-19T07:24:48.809 INFO:tasks.workunit.client.0.smithi098.stdout:3/60: chown de/df 176137315 1 2024-09-19T07:24:48.809 INFO:tasks.workunit.client.0.smithi098.stdout:4/52: dwrite da/fd [0,4194304] 0 2024-09-19T07:24:48.810 INFO:tasks.workunit.client.0.smithi098.stdout:3/61: rename ld to de/l11 0 2024-09-19T07:24:48.812 INFO:tasks.workunit.client.0.smithi098.stdout:4/53: symlink da/le 0 2024-09-19T07:24:48.813 INFO:tasks.workunit.client.0.smithi098.stdout:3/62: truncate f0 1019844 0 2024-09-19T07:24:48.813 INFO:tasks.workunit.client.0.smithi098.stdout:4/54: symlink da/lf 0 2024-09-19T07:24:48.813 INFO:tasks.workunit.client.0.smithi098.stdout:4/55: chown da/fc 327 1 2024-09-19T07:24:48.814 INFO:tasks.workunit.client.0.smithi098.stdout:3/63: link la de/l12 0 2024-09-19T07:24:48.815 INFO:tasks.workunit.client.0.smithi098.stdout:3/64: truncate f8 4500754 0 2024-09-19T07:24:48.815 INFO:tasks.workunit.client.0.smithi098.stdout:4/56: mknod da/c10 0 2024-09-19T07:24:48.818 INFO:tasks.workunit.client.0.smithi098.stdout:4/57: dread da/fc [0,4194304] 0 2024-09-19T07:24:48.818 INFO:tasks.workunit.client.0.smithi098.stdout:3/65: read f9 [859960,124744] 0 2024-09-19T07:24:48.818 INFO:tasks.workunit.client.0.smithi098.stdout:3/66: fsync f9 0 2024-09-19T07:24:48.819 INFO:tasks.workunit.client.0.smithi098.stdout:4/58: creat da/f11 x:0 0 0 2024-09-19T07:24:48.819 INFO:tasks.workunit.client.0.smithi098.stdout:4/59: write da/f11 [691173,111820] 0 2024-09-19T07:24:48.819 INFO:tasks.workunit.client.0.smithi098.stdout:3/67: getdents de/df 0 2024-09-19T07:24:48.820 INFO:tasks.workunit.client.0.smithi098.stdout:3/68: chown fc 61518 1 2024-09-19T07:24:48.821 INFO:tasks.workunit.client.0.smithi098.stdout:3/69: creat de/df/f13 x:0 0 0 2024-09-19T07:24:48.821 INFO:tasks.workunit.client.0.smithi098.stdout:3/70: write f5 [2237948,31605] 0 2024-09-19T07:24:48.829 INFO:tasks.workunit.client.0.smithi098.stdout:4/60: write da/fb [586635,97604] 0 2024-09-19T07:24:48.830 INFO:tasks.workunit.client.0.smithi098.stdout:4/61: mknod da/c12 0 2024-09-19T07:24:48.846 INFO:tasks.workunit.client.0.smithi098.stdout:3/71: dwrite f5 [4194304,4194304] 0 2024-09-19T07:24:48.846 INFO:tasks.workunit.client.0.smithi098.stdout:3/72: dread - de/df/f13 zero size 2024-09-19T07:24:48.847 INFO:tasks.workunit.client.0.smithi098.stdout:3/73: rename f8 to de/f14 0 2024-09-19T07:24:48.849 INFO:tasks.workunit.client.0.smithi098.stdout:3/74: unlink de/df/f13 0 2024-09-19T07:24:48.850 INFO:tasks.workunit.client.0.smithi098.stdout:3/75: truncate f9 46369 0 2024-09-19T07:24:48.851 INFO:tasks.workunit.client.0.smithi098.stdout:3/76: creat de/df/f15 x:0 0 0 2024-09-19T07:24:48.852 INFO:tasks.workunit.client.0.smithi098.stdout:4/62: dwrite f9 [0,4194304] 0 2024-09-19T07:24:48.853 INFO:tasks.workunit.client.0.smithi098.stdout:3/77: mkdir de/df/d16 0 2024-09-19T07:24:48.856 INFO:tasks.workunit.client.0.smithi098.stdout:4/63: getdents da 0 2024-09-19T07:24:48.859 INFO:tasks.workunit.client.0.smithi098.stdout:3/78: dread f5 [0,4194304] 0 2024-09-19T07:24:48.865 INFO:tasks.workunit.client.0.smithi098.stdout:4/64: write f9 [1660173,5758] 0 2024-09-19T07:24:48.866 INFO:tasks.workunit.client.0.smithi098.stdout:4/65: rmdir da 39 2024-09-19T07:24:48.870 INFO:tasks.workunit.client.0.smithi098.stdout:3/79: write f5 [5867731,27215] 0 2024-09-19T07:24:48.872 INFO:tasks.workunit.client.0.smithi098.stdout:3/80: mkdir de/df/d17 0 2024-09-19T07:24:48.873 INFO:tasks.workunit.client.0.smithi098.stdout:3/81: creat de/df/f18 x:0 0 0 2024-09-19T07:24:48.874 INFO:tasks.workunit.client.0.smithi098.stdout:3/82: creat de/f19 x:0 0 0 2024-09-19T07:24:48.876 INFO:tasks.workunit.client.0.smithi098.stdout:3/83: unlink de/df/f18 0 2024-09-19T07:24:48.876 INFO:tasks.workunit.client.0.smithi098.stdout:3/84: readlink la 0 2024-09-19T07:24:48.876 INFO:tasks.workunit.client.0.smithi098.stdout:3/85: write de/f19 [719858,1122] 0 2024-09-19T07:24:48.876 INFO:tasks.workunit.client.0.smithi098.stdout:3/86: stat de/l11 0 2024-09-19T07:24:48.876 INFO:tasks.workunit.client.0.smithi098.stdout:3/87: dread - fc zero size 2024-09-19T07:24:48.882 INFO:tasks.workunit.client.0.smithi098.stdout:3/88: read de/f14 [3302080,56166] 0 2024-09-19T07:24:48.883 INFO:tasks.workunit.client.0.smithi098.stdout:3/89: dread - de/df/f15 zero size 2024-09-19T07:24:48.883 INFO:tasks.workunit.client.0.smithi098.stdout:3/90: read f4 [85279,45936] 0 2024-09-19T07:24:48.883 INFO:tasks.workunit.client.0.smithi098.stdout:3/91: chown de/df/d16 1133014833 1 2024-09-19T07:24:48.903 INFO:tasks.workunit.client.0.smithi098.stdout:3/92: dwrite fc [0,4194304] 0 2024-09-19T07:24:48.905 INFO:tasks.workunit.client.0.smithi098.stdout:3/93: rmdir de/df/d17 0 2024-09-19T07:24:48.905 INFO:tasks.workunit.client.0.smithi098.stdout:3/94: write de/f14 [4013552,98558] 0 2024-09-19T07:24:49.067 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:48.756+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f62 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl03.c auth v14 ap=1 s=6129 n(v0 rc2024-09-19T07:24:36.671918+0000 b6129 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd532680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f62:[<0x10000001f61/hugeshmctl03.c v2>,<0x10000001f45/hugeshmctl v64>,<0x10000001f2d/hugetlb v64>,<0x10000001f2c/mem v28>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f62:[<0x10000001f61/hugeshmctl03.c v14>,<0x10000001f45/hugeshmctl v64>,<0x10000001f2d/hugetlb v142>,<0x10000001f2c/mem v650>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.067 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:48.756+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f64 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/Makefile auth v12 ap=1 s=1057 n(v0 rc2024-09-19T07:24:36.672918+0000 b1057 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd532c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f64:[<0x10000001f61/Makefile v6>,<0x10000001f45/hugeshmctl v64>,<0x10000001f2d/hugetlb v64>,<0x10000001f2c/mem v28>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f64:[<0x10000001f61/Makefile v12>,<0x10000001f45/hugeshmctl v64>,<0x10000001f2d/hugetlb v142>,<0x10000001f2c/mem v650>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000241d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_process_stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000241b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_stress_test.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000241c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:49.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:49.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000200b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config3) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002006 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config1) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000200c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config4) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002008 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config7) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000200a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config5) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002009 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000200d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config6) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Scrub error on inode 0x1000000200e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config0) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000002007 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config2) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:49.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:24:49.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] up:active 2024-09-19T07:24:49.069 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:48.756+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f63 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl02.c auth v16 ap=1 s=5767 n(v0 rc2009-02-26T12:14:53.000000+0000 b5767 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd533180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f63:[<0x10000001f61/hugeshmctl02.c v4>,<0x10000001f45/hugeshmctl v64>,<0x10000001f2d/hugetlb v64>,<0x10000001f2c/mem v28>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f63:[<0x10000001f61/hugeshmctl02.c v16>,<0x10000001f45/hugeshmctl v64>,<0x10000001f2d/hugetlb v142>,<0x10000001f2c/mem v650>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.069 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:48.756+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f65 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl01.c auth v10 ap=1 s=12608 n(v0 rc2024-09-19T07:24:36.673918+0000 b12608 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd533700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f65:[<0x10000001f61/hugeshmctl01.c v8>,<0x10000001f45/hugeshmctl v64>,<0x10000001f2d/hugetlb v64>,<0x10000001f2c/mem v28>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f65:[<0x10000001f61/hugeshmctl01.c v10>,<0x10000001f45/hugeshmctl v64>,<0x10000001f2d/hugetlb v142>,<0x10000001f2c/mem v650>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:49.070 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:48.756+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4d [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget01.c auth v14 ap=1 s=5352 n(v0 rc2009-11-19T16:05:21.000000+0000 b5352 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd530b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4d:[<0x10000001f4a/hugeshmget01.c v6>,<0x10000001f45/hugeshmget v20>,<0x10000001f2d/hugetlb v64>,<0x10000001f2c/mem v28>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f4d:[<0x10000001f4a/hugeshmget01.c v14>,<0x10000001f45/hugeshmget v20>,<0x10000001f2d/hugetlb v142>,<0x10000001f2c/mem v650>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.070 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:48.756+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4f [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget03.c auth v16 ap=1 s=5562 n(v0 rc2024-09-19T07:24:36.655918+0000 b5562 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd531080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4f:[<0x10000001f4a/hugeshmget03.c v10>,<0x10000001f45/hugeshmget v20>,<0x10000001f2d/hugetlb v64>,<0x10000001f2c/mem v28>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f4f:[<0x10000001f4a/hugeshmget03.c v16>,<0x10000001f45/hugeshmget v20>,<0x10000001f2d/hugetlb v142>,<0x10000001f2c/mem v650>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.070 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:48.757+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4c [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/Makefile auth v20 ap=1 s=964 n(v0 rc2024-09-19T07:24:36.653918+0000 b964 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd531b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4c:[<0x10000001f4a/Makefile v4>,<0x10000001f45/hugeshmget v20>,<0x10000001f2d/hugetlb v64>,<0x10000001f2c/mem v28>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f4c:[<0x10000001f4a/Makefile v20>,<0x10000001f45/hugeshmget v20>,<0x10000001f2d/hugetlb v142>,<0x10000001f2c/mem v650>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.070 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:48.757+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4b [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget05.c auth v12 ap=1 s=5604 n(v0 rc2024-09-19T07:24:36.652918+0000 b5604 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd531600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4b:[<0x10000001f4a/hugeshmget05.c v2>,<0x10000001f45/hugeshmget v20>,<0x10000001f2d/hugetlb v64>,<0x10000001f2c/mem v28>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f4b:[<0x10000001f4a/hugeshmget05.c v12>,<0x10000001f45/hugeshmget v20>,<0x10000001f2d/hugetlb v142>,<0x10000001f2c/mem v650>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.070 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:48.757+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4e [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget02.c auth v18 ap=1 s=5636 n(v0 rc2024-09-19T07:24:36.654918+0000 b5636 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd532100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4e:[<0x10000001f4a/hugeshmget02.c v8>,<0x10000001f45/hugeshmget v20>,<0x10000001f2d/hugetlb v64>,<0x10000001f2c/mem v28>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000001f4e:[<0x10000001f4a/hugeshmget02.c v18>,<0x10000001f45/hugeshmget v20>,<0x10000001f2d/hugetlb v142>,<0x10000001f2c/mem v650>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.206 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:49.206 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000241d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_process_stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:49.206 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000241b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_stress_test.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:49.206 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000241c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:49.206 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:49.206 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:49.207 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000200b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config3) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.207 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002006 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config1) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.207 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000200c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config4) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.207 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002008 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config7) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.207 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000200a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config5) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.207 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002009 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.207 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000200d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config6) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.207 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Scrub error on inode 0x1000000200e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config0) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.207 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000002007 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config2) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.207 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:49.207 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:24:49.208 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] up:active 2024-09-19T07:24:49.208 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:48 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:49.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:49.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000241d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_process_stress.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:49.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000241b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_stress_test.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:49.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000241c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:49.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:49.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:49.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000200b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config3) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002006 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config1) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000200c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config4) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002008 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config7) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000200a (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config5) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002009 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000200d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config6) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Scrub error on inode 0x1000000200e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config0) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000002007 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config2) see mds.h log and `damage ls` output for details 2024-09-19T07:24:49.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:49.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:24:49.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] up:active 2024-09-19T07:24:49.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:48 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:49.511 INFO:tasks.workunit.client.0.smithi098.stdout:1/13: sync 2024-09-19T07:24:49.511 INFO:tasks.workunit.client.0.smithi098.stdout:7/50: sync 2024-09-19T07:24:49.511 INFO:tasks.workunit.client.0.smithi098.stdout:9/22: sync 2024-09-19T07:24:49.511 INFO:tasks.workunit.client.0.smithi098.stdout:5/44: sync 2024-09-19T07:24:49.511 INFO:tasks.workunit.client.0.smithi098.stdout:6/12: sync 2024-09-19T07:24:49.512 INFO:tasks.workunit.client.0.smithi098.stdout:7/51: chown d5/d8/f9 1883009804 1 2024-09-19T07:24:49.512 INFO:tasks.workunit.client.0.smithi098.stdout:5/45: fdatasync f3 0 2024-09-19T07:24:49.512 INFO:tasks.workunit.client.0.smithi098.stdout:0/12: sync 2024-09-19T07:24:49.512 INFO:tasks.workunit.client.0.smithi098.stdout:7/52: write d5/d8/dc/fe [801000,63235] 0 2024-09-19T07:24:49.512 INFO:tasks.workunit.client.0.smithi098.stdout:2/5: sync 2024-09-19T07:24:49.512 INFO:tasks.workunit.client.0.smithi098.stdout:3/95: sync 2024-09-19T07:24:49.512 INFO:tasks.workunit.client.0.smithi098.stdout:4/66: sync 2024-09-19T07:24:49.512 INFO:tasks.workunit.client.0.smithi098.stdout:8/46: sync 2024-09-19T07:24:49.512 INFO:tasks.workunit.client.0.smithi098.stdout:9/23: mkdir d3/d6 0 2024-09-19T07:24:49.513 INFO:tasks.workunit.client.0.smithi098.stdout:6/13: mkdir d2 0 2024-09-19T07:24:49.513 INFO:tasks.workunit.client.0.smithi098.stdout:1/14: symlink l6 0 2024-09-19T07:24:49.514 INFO:tasks.workunit.client.0.smithi098.stdout:5/46: link dc/cf dc/c11 0 2024-09-19T07:24:49.514 INFO:tasks.workunit.client.0.smithi098.stdout:2/6: mkdir d1 0 2024-09-19T07:24:49.514 INFO:tasks.workunit.client.0.smithi098.stdout:2/7: stat d1 0 2024-09-19T07:24:49.515 INFO:tasks.workunit.client.0.smithi098.stdout:7/53: getdents d5/d10 0 2024-09-19T07:24:49.515 INFO:tasks.workunit.client.0.smithi098.stdout:7/54: chown d5/d8/dc 268052717 1 2024-09-19T07:24:49.516 INFO:tasks.workunit.client.0.smithi098.stdout:3/96: link f9 de/f1a 0 2024-09-19T07:24:49.517 INFO:tasks.workunit.client.0.smithi098.stdout:4/67: mknod da/c13 0 2024-09-19T07:24:49.518 INFO:tasks.workunit.client.0.smithi098.stdout:4/68: readlink da/lf 0 2024-09-19T07:24:49.518 INFO:tasks.workunit.client.0.smithi098.stdout:3/97: dread f9 [0,4194304] 0 2024-09-19T07:24:49.519 INFO:tasks.workunit.client.0.smithi098.stdout:9/24: rename f0 to d3/d6/f7 0 2024-09-19T07:24:49.519 INFO:tasks.workunit.client.0.smithi098.stdout:5/47: fsync f1 0 2024-09-19T07:24:49.521 INFO:tasks.workunit.client.0.smithi098.stdout:2/8: symlink d1/l2 0 2024-09-19T07:24:49.523 INFO:tasks.workunit.client.0.smithi098.stdout:5/48: dread f0 [4194304,4194304] 0 2024-09-19T07:24:49.523 INFO:tasks.workunit.client.0.smithi098.stdout:5/49: fdatasync f5 0 2024-09-19T07:24:49.523 INFO:tasks.workunit.client.0.smithi098.stdout:5/50: readlink dc/de/l10 0 2024-09-19T07:24:49.523 INFO:tasks.workunit.client.0.smithi098.stdout:7/55: symlink d5/d10/l13 0 2024-09-19T07:24:49.524 INFO:tasks.workunit.client.0.smithi098.stdout:4/69: creat da/f14 x:0 0 0 2024-09-19T07:24:49.527 INFO:tasks.workunit.client.0.smithi098.stdout:5/51: creat dc/f12 x:0 0 0 2024-09-19T07:24:49.527 INFO:tasks.workunit.client.0.smithi098.stdout:5/52: chown dc/ld 812 1 2024-09-19T07:24:49.527 INFO:tasks.workunit.client.0.smithi098.stdout:5/53: chown dc/f12 1929246 1 2024-09-19T07:24:49.527 INFO:tasks.workunit.client.0.smithi098.stdout:5/54: dread - f5 zero size 2024-09-19T07:24:49.527 INFO:tasks.workunit.client.0.smithi098.stdout:5/55: chown dc/de 227 1 2024-09-19T07:24:49.527 INFO:tasks.workunit.client.0.smithi098.stdout:5/56: chown f0 20308806 1 2024-09-19T07:24:49.528 INFO:tasks.workunit.client.0.smithi098.stdout:5/57: fsync f5 0 2024-09-19T07:24:49.529 INFO:tasks.workunit.client.0.smithi098.stdout:1/15: getdents . 0 2024-09-19T07:24:49.529 INFO:tasks.workunit.client.0.smithi098.stdout:1/16: readlink l2 0 2024-09-19T07:24:49.530 INFO:tasks.workunit.client.0.smithi098.stdout:1/17: rmdir - no directory 2024-09-19T07:24:49.532 INFO:tasks.workunit.client.0.smithi098.stdout:9/25: fsync d3/d6/f7 0 2024-09-19T07:24:49.534 INFO:tasks.workunit.client.0.smithi098.stdout:9/26: mkdir d3/d6/d8 0 2024-09-19T07:24:49.535 INFO:tasks.workunit.client.0.smithi098.stdout:0/13: dwrite f4 [0,4194304] 0 2024-09-19T07:24:49.536 INFO:tasks.workunit.client.0.smithi098.stdout:9/27: creat d3/d6/d8/f9 x:0 0 0 2024-09-19T07:24:49.537 INFO:tasks.workunit.client.0.smithi098.stdout:8/47: dwrite d0/fa [0,4194304] 0 2024-09-19T07:24:49.538 INFO:tasks.workunit.client.0.smithi098.stdout:0/14: getdents . 0 2024-09-19T07:24:49.539 INFO:tasks.workunit.client.0.smithi098.stdout:5/58: dread fa [0,4194304] 0 2024-09-19T07:24:49.540 INFO:tasks.workunit.client.0.smithi098.stdout:9/28: rename d3/c5 to d3/d6/d8/ca 0 2024-09-19T07:24:49.541 INFO:tasks.workunit.client.0.smithi098.stdout:8/48: symlink d0/l10 0 2024-09-19T07:24:49.542 INFO:tasks.workunit.client.0.smithi098.stdout:0/15: mkdir d5 0 2024-09-19T07:24:49.545 INFO:tasks.workunit.client.0.smithi098.stdout:9/29: rename d3/d6/f7 to d3/d6/fb 0 2024-09-19T07:24:49.545 INFO:tasks.workunit.client.0.smithi098.stdout:0/16: symlink d5/l6 0 2024-09-19T07:24:49.547 INFO:tasks.workunit.client.0.smithi098.stdout:0/17: creat d5/f7 x:0 0 0 2024-09-19T07:24:49.551 INFO:tasks.workunit.client.0.smithi098.stdout:8/49: dread d0/f7 [0,4194304] 0 2024-09-19T07:24:49.552 INFO:tasks.workunit.client.0.smithi098.stdout:8/50: stat d0 0 2024-09-19T07:24:49.557 INFO:tasks.workunit.client.0.smithi098.stdout:9/30: unlink d3/d6/fb 0 2024-09-19T07:24:49.557 INFO:tasks.workunit.client.0.smithi098.stdout:9/31: fsync d3/d6/d8/f9 0 2024-09-19T07:24:49.557 INFO:tasks.workunit.client.0.smithi098.stdout:9/32: readlink - no filename 2024-09-19T07:24:49.557 INFO:tasks.workunit.client.0.smithi098.stdout:9/33: write d3/d6/d8/f9 [459784,70558] 0 2024-09-19T07:24:49.558 INFO:tasks.workunit.client.0.smithi098.stdout:9/34: mkdir d3/dc 0 2024-09-19T07:24:49.559 INFO:tasks.workunit.client.0.smithi098.stdout:9/35: write d3/d6/d8/f9 [1385011,49859] 0 2024-09-19T07:24:49.562 INFO:tasks.workunit.client.0.smithi098.stdout:7/56: dwrite d5/f7 [0,4194304] 0 2024-09-19T07:24:49.564 INFO:tasks.workunit.client.0.smithi098.stdout:7/57: mknod d5/d8/c14 0 2024-09-19T07:24:49.566 INFO:tasks.workunit.client.0.smithi098.stdout:7/58: rename d5/ff to d5/d8/dc/f15 0 2024-09-19T07:24:49.568 INFO:tasks.workunit.client.0.smithi098.stdout:7/59: unlink d5/f12 0 2024-09-19T07:24:49.568 INFO:tasks.workunit.client.0.smithi098.stdout:7/60: truncate d5/f7 5159292 0 2024-09-19T07:24:49.569 INFO:tasks.workunit.client.0.smithi098.stdout:6/14: dwrite f1 [0,4194304] 0 2024-09-19T07:24:49.569 INFO:tasks.workunit.client.0.smithi098.stdout:3/98: dwrite de/f1a [0,4194304] 0 2024-09-19T07:24:49.569 INFO:tasks.workunit.client.0.smithi098.stdout:3/99: fdatasync de/f19 0 2024-09-19T07:24:49.573 INFO:tasks.workunit.client.0.smithi098.stdout:9/36: dread d3/d6/d8/f9 [0,4194304] 0 2024-09-19T07:24:49.575 INFO:tasks.workunit.client.0.smithi098.stdout:7/61: mkdir d5/d8/dc/d16 0 2024-09-19T07:24:49.576 INFO:tasks.workunit.client.0.smithi098.stdout:6/15: creat d2/f3 x:0 0 0 2024-09-19T07:24:49.576 INFO:tasks.workunit.client.0.smithi098.stdout:6/16: chown f1 1 1 2024-09-19T07:24:49.577 INFO:tasks.workunit.client.0.smithi098.stdout:8/51: write d0/fa [1839073,85075] 0 2024-09-19T07:24:49.577 INFO:tasks.workunit.client.0.smithi098.stdout:9/37: symlink d3/d6/ld 0 2024-09-19T07:24:49.578 INFO:tasks.workunit.client.0.smithi098.stdout:9/38: write d3/d6/d8/f9 [1561964,91532] 0 2024-09-19T07:24:49.578 INFO:tasks.workunit.client.0.smithi098.stdout:6/17: symlink d2/l4 0 2024-09-19T07:24:49.578 INFO:tasks.workunit.client.0.smithi098.stdout:6/18: truncate d2/f3 540197 0 2024-09-19T07:24:49.579 INFO:tasks.workunit.client.0.smithi098.stdout:0/18: write f4 [2769174,3397] 0 2024-09-19T07:24:49.579 INFO:tasks.workunit.client.0.smithi098.stdout:8/52: mknod d0/de/c11 0 2024-09-19T07:24:49.579 INFO:tasks.workunit.client.0.smithi098.stdout:8/53: chown d0/de/c11 0 1 2024-09-19T07:24:49.579 INFO:tasks.workunit.client.0.smithi098.stdout:8/54: readlink d0/l6 0 2024-09-19T07:24:49.579 INFO:tasks.workunit.client.0.smithi098.stdout:8/55: fdatasync d0/f5 0 2024-09-19T07:24:49.579 INFO:tasks.workunit.client.0.smithi098.stdout:6/19: dread d2/f3 [0,4194304] 0 2024-09-19T07:24:49.580 INFO:tasks.workunit.client.0.smithi098.stdout:9/39: mknod d3/ce 0 2024-09-19T07:24:49.581 INFO:tasks.workunit.client.0.smithi098.stdout:0/19: getdents d5 0 2024-09-19T07:24:49.581 INFO:tasks.workunit.client.0.smithi098.stdout:0/20: chown d5/f7 1796515435 1 2024-09-19T07:24:49.584 INFO:tasks.workunit.client.0.smithi098.stdout:5/59: dwrite fa [0,4194304] 0 2024-09-19T07:24:49.584 INFO:tasks.workunit.client.0.smithi098.stdout:5/60: write f5 [737253,15245] 0 2024-09-19T07:24:49.584 INFO:tasks.workunit.client.0.smithi098.stdout:5/61: dread - f4 zero size 2024-09-19T07:24:49.584 INFO:tasks.workunit.client.0.smithi098.stdout:0/21: symlink d5/l8 0 2024-09-19T07:24:49.587 INFO:tasks.workunit.client.0.smithi098.stdout:5/62: readlink l7 0 2024-09-19T07:24:49.587 INFO:tasks.workunit.client.0.smithi098.stdout:5/63: fdatasync f3 0 2024-09-19T07:24:49.587 INFO:tasks.workunit.client.0.smithi098.stdout:5/64: read - dc/f12 zero size 2024-09-19T07:24:49.588 INFO:tasks.workunit.client.0.smithi098.stdout:0/22: chown f0 119884 1 2024-09-19T07:24:49.589 INFO:tasks.workunit.client.0.smithi098.stdout:5/65: mkdir dc/de/d13 0 2024-09-19T07:24:49.590 INFO:tasks.workunit.client.0.smithi098.stdout:0/23: stat d5/l6 0 2024-09-19T07:24:49.591 INFO:tasks.workunit.client.0.smithi098.stdout:5/66: creat dc/de/d13/f14 x:0 0 0 2024-09-19T07:24:49.591 INFO:tasks.workunit.client.0.smithi098.stdout:5/67: readlink dc/de/l10 0 2024-09-19T07:24:49.593 INFO:tasks.workunit.client.0.smithi098.stdout:5/68: rename dc/cf to dc/de/d13/c15 0 2024-09-19T07:24:49.594 INFO:tasks.workunit.client.0.smithi098.stdout:3/100: dwrite f0 [0,4194304] 0 2024-09-19T07:24:49.595 INFO:tasks.workunit.client.0.smithi098.stdout:5/69: mknod dc/de/c16 0 2024-09-19T07:24:49.597 INFO:tasks.workunit.client.0.smithi098.stdout:5/70: creat dc/f17 x:0 0 0 2024-09-19T07:24:49.597 INFO:tasks.workunit.client.0.smithi098.stdout:5/71: dread - dc/f17 zero size 2024-09-19T07:24:49.603 INFO:tasks.workunit.client.0.smithi098.stdout:0/24: getdents d5 0 2024-09-19T07:24:49.603 INFO:tasks.workunit.client.0.smithi098.stdout:0/25: fdatasync f4 0 2024-09-19T07:24:49.604 INFO:tasks.workunit.client.0.smithi098.stdout:5/72: dread f1 [0,4194304] 0 2024-09-19T07:24:49.605 INFO:tasks.workunit.client.0.smithi098.stdout:0/26: mkdir d5/d9 0 2024-09-19T07:24:49.605 INFO:tasks.workunit.client.0.smithi098.stdout:7/62: dwrite d5/d8/dc/f15 [0,4194304] 0 2024-09-19T07:24:49.607 INFO:tasks.workunit.client.0.smithi098.stdout:5/73: mknod dc/c18 0 2024-09-19T07:24:49.609 INFO:tasks.workunit.client.0.smithi098.stdout:9/40: dwrite d3/d6/d8/f9 [0,4194304] 0 2024-09-19T07:24:49.610 INFO:tasks.workunit.client.0.smithi098.stdout:7/63: unlink f4 0 2024-09-19T07:24:49.611 INFO:tasks.workunit.client.0.smithi098.stdout:5/74: creat dc/de/d13/f19 x:0 0 0 2024-09-19T07:24:49.611 INFO:tasks.workunit.client.0.smithi098.stdout:5/75: dread - dc/f12 zero size 2024-09-19T07:24:49.613 INFO:tasks.workunit.client.0.smithi098.stdout:9/41: mkdir d3/dc/df 0 2024-09-19T07:24:49.614 INFO:tasks.workunit.client.0.smithi098.stdout:8/56: dwrite d0/fc [0,4194304] 0 2024-09-19T07:24:49.614 INFO:tasks.workunit.client.0.smithi098.stdout:8/57: chown d0/de/c11 13831 1 2024-09-19T07:24:49.614 INFO:tasks.workunit.client.0.smithi098.stdout:6/20: dwrite d2/f3 [0,4194304] 0 2024-09-19T07:24:49.614 INFO:tasks.workunit.client.0.smithi098.stdout:5/76: creat dc/de/d13/f1a x:0 0 0 2024-09-19T07:24:49.615 INFO:tasks.workunit.client.0.smithi098.stdout:9/42: mknod d3/d6/c10 0 2024-09-19T07:24:49.619 INFO:tasks.workunit.client.0.smithi098.stdout:8/58: mkdir d0/de/d12 0 2024-09-19T07:24:49.619 INFO:tasks.workunit.client.0.smithi098.stdout:8/59: write d0/ff [68676,4120] 0 2024-09-19T07:24:49.619 INFO:tasks.workunit.client.0.smithi098.stdout:0/27: dread f4 [0,4194304] 0 2024-09-19T07:24:49.621 INFO:tasks.workunit.client.0.smithi098.stdout:5/77: link dc/de/d13/f14 dc/de/f1b 0 2024-09-19T07:24:49.623 INFO:tasks.workunit.client.0.smithi098.stdout:0/28: truncate f4 2786941 0 2024-09-19T07:24:49.623 INFO:tasks.workunit.client.0.smithi098.stdout:0/29: getdents d5/d9 0 2024-09-19T07:24:49.623 INFO:tasks.workunit.client.0.smithi098.stdout:5/78: rmdir dc/de 39 2024-09-19T07:24:49.624 INFO:tasks.workunit.client.0.smithi098.stdout:8/60: dread d0/f5 [0,4194304] 0 2024-09-19T07:24:49.626 INFO:tasks.workunit.client.0.smithi098.stdout:5/79: mkdir dc/d1c 0 2024-09-19T07:24:49.627 INFO:tasks.workunit.client.0.smithi098.stdout:6/21: read d2/f3 [221487,101466] 0 2024-09-19T07:24:49.627 INFO:tasks.workunit.client.0.smithi098.stdout:0/30: mkdir d5/da 0 2024-09-19T07:24:49.630 INFO:tasks.workunit.client.0.smithi098.stdout:6/22: mkdir d2/d5 0 2024-09-19T07:24:49.632 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:49.204+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bcb [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected auth v16 ap=1 s=170 n(v0 rc2024-09-19T07:24:22.500095+0000 b170 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5225b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bcb:[<0x10000000bc9/corrected v4>,<0x10000000bc8/data v10>,<0x10000000bb6/non-panic v20>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000bcb:[<0x10000000bc9/corrected v16>,<0x10000000bc8/data v19>,<0x10000000bb6/non-panic v65>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.632 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:49.204+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bcc [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_hold auth v10 ap=1 s=131 n(v0 rc2024-09-19T07:24:22.501095+0000 b131 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5226100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bcc:[<0x10000000bc9/corrected_hold v6>,<0x10000000bc8/data v10>,<0x10000000bb6/non-panic v20>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000bcc:[<0x10000000bc9/corrected_hold v10>,<0x10000000bc8/data v19>,<0x10000000bb6/non-panic v65>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.632 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:49.205+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bca [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_over auth v12 ap=1 s=50 n(v0 rc2024-09-19T07:24:22.499095+0000 b50 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5226680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bca:[<0x10000000bc9/corrected_over v2>,<0x10000000bc8/data v10>,<0x10000000bb6/non-panic v20>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000bca:[<0x10000000bc9/corrected_over v12>,<0x10000000bc8/data v19>,<0x10000000bb6/non-panic v65>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.633 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:49.205+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bcd [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_no_en auth v14 ap=1 s=43 n(v0 rc2024-09-19T07:24:22.502095+0000 b43 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5226c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bcd:[<0x10000000bc9/corrected_no_en v8>,<0x10000000bc8/data v10>,<0x10000000bb6/non-panic v20>,<0x10000000bb5/soft-inj v16>,<0x10000000ba1/cases v26>,<0x10000000204/mce-test v220>,<0x10000000202/testcases v37>,<0x10000000007/ltp-full-20091231 v33>,<0x10000000006/fsstress v29>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v28>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v45>,<0x10000000001/sv_1 v68>,<0x10000000000/qa v62>,<0x1/volumes v58>]//[]","memoryvalue":"(3)0x10000000bcd:[<0x10000000bc9/corrected_no_en v14>,<0x10000000bc8/data v19>,<0x10000000bb6/non-panic v65>,<0x10000000bb5/soft-inj v49>,<0x10000000ba1/cases v221>,<0x10000000204/mce-test v615>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.633 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:49.372+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000024b4 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_boot_aggregate.c auth v14 ap=1 s=2835 n(v0 rc2024-09-19T07:24:38.384897+0000 b2835 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5236580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000024b4:[<0x100000024b2/ima_boot_aggregate.c v4>,<0x100000024ab/src v22>,<0x100000024aa/ima v12>,<0x10000002494/integrity v48>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000024b4:[<0x100000024b2/ima_boot_aggregate.c v14>,<0x100000024ab/src v22>,<0x100000024aa/ima v21>,<0x10000002494/integrity v150>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.633 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:49.372+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000024b3 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_measure.c auth v10 ap=1 s=5710 n(v0 rc2024-09-19T07:24:38.382897+0000 b5710 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5237080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000024b3:[<0x100000024b2/ima_measure.c v2>,<0x100000024ab/src v22>,<0x100000024aa/ima v12>,<0x10000002494/integrity v48>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000024b3:[<0x100000024b2/ima_measure.c v10>,<0x100000024ab/src v22>,<0x100000024aa/ima v21>,<0x10000002494/integrity v150>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.633 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:49.372+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000024b6 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_mmap.c auth v12 ap=1 s=1159 n(v0 rc2024-09-19T07:24:38.387896+0000 b1159 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5237600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000024b6:[<0x100000024b2/ima_mmap.c v8>,<0x100000024ab/src v22>,<0x100000024aa/ima v12>,<0x10000002494/integrity v48>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000024b6:[<0x100000024b2/ima_mmap.c v12>,<0x100000024ab/src v22>,<0x100000024aa/ima v21>,<0x10000002494/integrity v150>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.633 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:49.372+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000024b5 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/Makefile auth v16 ap=1 s=1048 n(v0 rc2024-09-19T07:24:38.385897+0000 b1048 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5236b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000024b5:[<0x100000024b2/Makefile v6>,<0x100000024ab/src v22>,<0x100000024aa/ima v12>,<0x10000002494/integrity v48>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000024b5:[<0x100000024b2/Makefile v16>,<0x100000024ab/src v22>,<0x100000024aa/ima v21>,<0x10000002494/integrity v150>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.633 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:49.387+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025a0 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_capable_net.sh auth v14 ap=1 s=2896 n(v0 rc2024-09-19T07:24:38.652893+0000 b2896 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5237b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025a0:[<0x1000000259f/selinux_capable_net.sh v2>,<0x10000002549/capable_net v180>,<0x100000024cb/tests v256>,<0x10000002494/selinux-testsuite v86>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000025a0:[<0x1000000259f/selinux_capable_net.sh v14>,<0x10000002549/capable_net v180>,<0x100000024cb/tests v268>,<0x10000002494/selinux-testsuite v156>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.633 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:49.387+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025a1 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/Makefile auth v16 ap=1 s=1075 n(v0 rc2024-09-19T07:24:38.653893+0000 b1075 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5238680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025a1:[<0x1000000259f/Makefile v4>,<0x10000002549/capable_net v180>,<0x100000024cb/tests v256>,<0x10000002494/selinux-testsuite v86>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000025a1:[<0x1000000259f/Makefile v16>,<0x10000002549/capable_net v180>,<0x100000024cb/tests v268>,<0x10000002494/selinux-testsuite v156>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.633 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:49.387+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025a2 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_bind.c auth v12 ap=1 s=670 n(v0 rc2024-09-19T07:24:38.654893+0000 b670 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5238100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025a2:[<0x1000000259f/selinux_bind.c v6>,<0x10000002549/capable_net v180>,<0x100000024cb/tests v256>,<0x10000002494/selinux-testsuite v86>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000025a2:[<0x1000000259f/selinux_bind.c v12>,<0x10000002549/capable_net v180>,<0x100000024cb/tests v268>,<0x10000002494/selinux-testsuite v156>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.633 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:24:49.387+0000 7fc7598b5640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025a3 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_raw.c auth v10 ap=1 s=620 n(v0 rc2024-09-19T07:24:38.655893+0000 b620 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x557ed5238c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025a3:[<0x1000000259f/selinux_raw.c v8>,<0x10000002549/capable_net v180>,<0x100000024cb/tests v256>,<0x10000002494/selinux-testsuite v86>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000025a3:[<0x1000000259f/selinux_raw.c v10>,<0x10000002549/capable_net v180>,<0x100000024cb/tests v268>,<0x10000002494/selinux-testsuite v156>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.634 INFO:tasks.workunit.client.0.smithi098.stdout:6/23: symlink d2/d5/l6 0 2024-09-19T07:24:49.634 INFO:tasks.workunit.client.0.smithi098.stdout:6/24: mknod d2/c7 0 2024-09-19T07:24:49.635 INFO:tasks.workunit.client.0.smithi098.stdout:6/25: mknod d2/c8 0 2024-09-19T07:24:49.635 INFO:tasks.workunit.client.0.smithi098.stdout:7/64: dwrite d5/d8/fa [0,4194304] 0 2024-09-19T07:24:49.635 INFO:tasks.workunit.client.0.smithi098.stdout:9/43: truncate d3/d6/d8/f9 3522244 0 2024-09-19T07:24:49.639 INFO:tasks.workunit.client.0.smithi098.stdout:0/31: dread f1 [0,4194304] 0 2024-09-19T07:24:49.640 INFO:tasks.workunit.client.0.smithi098.stdout:9/44: link d3/c4 d3/c11 0 2024-09-19T07:24:49.641 INFO:tasks.workunit.client.0.smithi098.stdout:0/32: fsync d5/f7 0 2024-09-19T07:24:49.643 INFO:tasks.workunit.client.0.smithi098.stdout:9/45: fsync d3/d6/d8/f9 0 2024-09-19T07:24:49.649 INFO:tasks.workunit.client.0.smithi098.stdout:8/61: dwrite d0/f7 [4194304,4194304] 0 2024-09-19T07:24:49.652 INFO:tasks.workunit.client.0.smithi098.stdout:9/46: write d3/d6/d8/f9 [1882388,59915] 0 2024-09-19T07:24:49.654 INFO:tasks.workunit.client.0.smithi098.stdout:9/47: getdents d3/d6/d8 0 2024-09-19T07:24:49.654 INFO:tasks.workunit.client.0.smithi098.stdout:9/48: chown d3/d6 1 1 2024-09-19T07:24:49.656 INFO:tasks.workunit.client.0.smithi098.stdout:9/49: rename d3/d6/d8/f9 to d3/d6/d8/f12 0 2024-09-19T07:24:49.658 INFO:tasks.workunit.client.0.smithi098.stdout:9/50: rmdir d3/d6 39 2024-09-19T07:24:49.658 INFO:tasks.workunit.client.0.smithi098.stdout:9/51: read d3/d6/d8/f12 [2518944,92837] 0 2024-09-19T07:24:49.658 INFO:tasks.workunit.client.0.smithi098.stdout:8/62: dread d0/f5 [0,4194304] 0 2024-09-19T07:24:49.658 INFO:tasks.workunit.client.0.smithi098.stdout:9/52: chown d3/d6/d8 10202597 1 2024-09-19T07:24:49.658 INFO:tasks.workunit.client.0.smithi098.stdout:9/53: chown d3/d6 24217423 1 2024-09-19T07:24:49.658 INFO:tasks.workunit.client.0.smithi098.stdout:8/63: readlink d0/l6 0 2024-09-19T07:24:49.658 INFO:tasks.workunit.client.0.smithi098.stdout:8/64: write d0/fc [4792041,59779] 0 2024-09-19T07:24:49.659 INFO:tasks.workunit.client.0.smithi098.stdout:8/65: stat d0/l10 0 2024-09-19T07:24:49.659 INFO:tasks.workunit.client.0.smithi098.stdout:8/66: chown d0/l1 1 1 2024-09-19T07:24:49.659 INFO:tasks.workunit.client.0.smithi098.stdout:8/67: readlink d0/l9 0 2024-09-19T07:24:49.660 INFO:tasks.workunit.client.0.smithi098.stdout:8/68: symlink d0/de/d12/l13 0 2024-09-19T07:24:49.661 INFO:tasks.workunit.client.0.smithi098.stdout:4/70: dwrite f8 [0,4194304] 0 2024-09-19T07:24:49.662 INFO:tasks.workunit.client.0.smithi098.stdout:8/69: mkdir d0/d14 0 2024-09-19T07:24:49.663 INFO:tasks.workunit.client.0.smithi098.stdout:9/54: link d3/d6/d8/ca d3/d6/d8/c13 0 2024-09-19T07:24:49.665 INFO:tasks.workunit.client.0.smithi098.stdout:4/71: mkdir da/d15 0 2024-09-19T07:24:49.667 INFO:tasks.workunit.client.0.smithi098.stdout:8/70: link d0/f7 d0/de/f15 0 2024-09-19T07:24:49.667 INFO:tasks.workunit.client.0.smithi098.stdout:4/72: creat da/f16 x:0 0 0 2024-09-19T07:24:49.668 INFO:tasks.workunit.client.0.smithi098.stdout:8/71: mkdir d0/d16 0 2024-09-19T07:24:49.670 INFO:tasks.workunit.client.0.smithi098.stdout:4/73: symlink da/l17 0 2024-09-19T07:24:49.670 INFO:tasks.workunit.client.0.smithi098.stdout:4/74: truncate f9 1051174 0 2024-09-19T07:24:49.677 INFO:tasks.workunit.client.0.smithi098.stdout:4/75: dread da/fc [0,4194304] 0 2024-09-19T07:24:49.678 INFO:tasks.workunit.client.0.smithi098.stdout:0/33: dwrite f1 [0,4194304] 0 2024-09-19T07:24:49.679 INFO:tasks.workunit.client.0.smithi098.stdout:4/76: mknod da/c18 0 2024-09-19T07:24:49.679 INFO:tasks.workunit.client.0.smithi098.stdout:6/26: dwrite d2/f3 [0,4194304] 0 2024-09-19T07:24:49.680 INFO:tasks.workunit.client.0.smithi098.stdout:0/34: readlink d5/l8 0 2024-09-19T07:24:49.680 INFO:tasks.workunit.client.0.smithi098.stdout:0/35: chown d5/l8 116 1 2024-09-19T07:24:49.681 INFO:tasks.workunit.client.0.smithi098.stdout:7/65: dwrite d5/d8/f9 [0,4194304] 0 2024-09-19T07:24:49.681 INFO:tasks.workunit.client.0.smithi098.stdout:6/27: creat d2/d5/f9 x:0 0 0 2024-09-19T07:24:49.681 INFO:tasks.workunit.client.0.smithi098.stdout:6/28: dread - d2/d5/f9 zero size 2024-09-19T07:24:49.681 INFO:tasks.workunit.client.0.smithi098.stdout:6/29: read - d2/d5/f9 zero size 2024-09-19T07:24:49.682 INFO:tasks.workunit.client.0.smithi098.stdout:0/36: creat d5/d9/fb x:0 0 0 2024-09-19T07:24:49.686 INFO:tasks.workunit.client.0.smithi098.stdout:0/37: rmdir d5/da 0 2024-09-19T07:24:49.687 INFO:tasks.workunit.client.0.smithi098.stdout:0/38: read f4 [323026,110028] 0 2024-09-19T07:24:49.691 INFO:tasks.workunit.client.0.smithi098.stdout:8/72: dwrite d0/ff [0,4194304] 0 2024-09-19T07:24:49.691 INFO:tasks.workunit.client.0.smithi098.stdout:8/73: readlink d0/l10 0 2024-09-19T07:24:49.693 INFO:tasks.workunit.client.0.smithi098.stdout:8/74: rmdir d0/d14 0 2024-09-19T07:24:49.693 INFO:tasks.workunit.client.0.smithi098.stdout:8/75: truncate d0/f5 4951918 0 2024-09-19T07:24:49.693 INFO:tasks.workunit.client.0.smithi098.stdout:8/76: write d0/fa [3852628,38166] 0 2024-09-19T07:24:49.693 INFO:tasks.workunit.client.0.smithi098.stdout:8/77: stat d0/d16 0 2024-09-19T07:24:49.694 INFO:tasks.workunit.client.0.smithi098.stdout:8/78: creat d0/d16/f17 x:0 0 0 2024-09-19T07:24:49.695 INFO:tasks.workunit.client.0.smithi098.stdout:8/79: creat d0/de/f18 x:0 0 0 2024-09-19T07:24:49.696 INFO:tasks.workunit.client.0.smithi098.stdout:8/80: symlink d0/de/d12/l19 0 2024-09-19T07:24:49.703 INFO:tasks.workunit.client.0.smithi098.stdout:9/55: dwrite d3/d6/d8/f12 [0,4194304] 0 2024-09-19T07:24:49.713 INFO:tasks.workunit.client.0.smithi098.stdout:7/66: dwrite d5/d8/dc/fe [0,4194304] 0 2024-09-19T07:24:49.713 INFO:tasks.workunit.client.0.smithi098.stdout:9/56: symlink d3/d6/d8/l14 0 2024-09-19T07:24:49.715 INFO:tasks.workunit.client.0.smithi098.stdout:9/57: unlink d3/d6/d8/l14 0 2024-09-19T07:24:49.716 INFO:tasks.workunit.client.0.smithi098.stdout:9/58: mkdir d3/dc/df/d15 0 2024-09-19T07:24:49.716 INFO:tasks.workunit.client.0.smithi098.stdout:9/59: getdents d3/dc/df/d15 0 2024-09-19T07:24:49.717 INFO:tasks.workunit.client.0.smithi098.stdout:0/39: dwrite f0 [0,4194304] 0 2024-09-19T07:24:49.720 INFO:tasks.workunit.client.0.smithi098.stdout:8/81: dwrite d0/fc [0,4194304] 0 2024-09-19T07:24:49.721 INFO:tasks.workunit.client.0.smithi098.stdout:7/67: dread d5/d8/dc/fe [0,4194304] 0 2024-09-19T07:24:49.722 INFO:tasks.workunit.client.0.smithi098.stdout:0/40: rename c3 to d5/cc 0 2024-09-19T07:24:49.722 INFO:tasks.workunit.client.0.smithi098.stdout:0/41: dread - d5/f7 zero size 2024-09-19T07:24:49.722 INFO:tasks.workunit.client.0.smithi098.stdout:8/82: mkdir d0/d1a 0 2024-09-19T07:24:49.723 INFO:tasks.workunit.client.0.smithi098.stdout:7/68: stat d5/d8/c14 0 2024-09-19T07:24:49.723 INFO:tasks.workunit.client.0.smithi098.stdout:7/69: readlink d5/lb 0 2024-09-19T07:24:49.724 INFO:tasks.workunit.client.0.smithi098.stdout:0/42: unlink f1 0 2024-09-19T07:24:49.725 INFO:tasks.workunit.client.0.smithi098.stdout:0/43: symlink d5/d9/ld 0 2024-09-19T07:24:49.735 INFO:tasks.workunit.client.0.smithi098.stdout:9/60: dwrite d3/d6/d8/f12 [0,4194304] 0 2024-09-19T07:24:49.746 INFO:tasks.workunit.client.0.smithi098.stdout:9/61: truncate d3/d6/d8/f12 645622 0 2024-09-19T07:24:49.747 INFO:tasks.workunit.client.0.smithi098.stdout:9/62: getdents d3/d6/d8 0 2024-09-19T07:24:49.747 INFO:tasks.workunit.client.0.smithi098.stdout:9/63: mkdir d3/d16 0 2024-09-19T07:24:49.753 INFO:tasks.workunit.client.0.smithi098.stdout:7/70: dwrite d5/f7 [0,4194304] 0 2024-09-19T07:24:49.753 INFO:tasks.workunit.client.0.smithi098.stdout:0/44: dwrite d5/f7 [0,4194304] 0 2024-09-19T07:24:49.755 INFO:tasks.workunit.client.0.smithi098.stdout:7/71: rename d5/ld to d5/d8/dc/l17 0 2024-09-19T07:24:49.755 INFO:tasks.workunit.client.0.smithi098.stdout:7/72: chown d5/d8/dc/d16 10199204 1 2024-09-19T07:24:49.756 INFO:tasks.workunit.client.0.smithi098.stdout:0/45: creat d5/fe x:0 0 0 2024-09-19T07:24:49.757 INFO:tasks.workunit.client.0.smithi098.stdout:7/73: truncate d5/d8/dc/f15 2858384 0 2024-09-19T07:24:49.757 INFO:tasks.workunit.client.0.smithi098.stdout:0/46: creat d5/ff x:0 0 0 2024-09-19T07:24:49.757 INFO:tasks.workunit.client.0.smithi098.stdout:9/64: dread d3/d6/d8/f12 [0,4194304] 0 2024-09-19T07:24:49.758 INFO:tasks.workunit.client.0.smithi098.stdout:9/65: read d3/d6/d8/f12 [282047,53583] 0 2024-09-19T07:24:49.759 INFO:tasks.workunit.client.0.smithi098.stdout:9/66: write d3/d6/d8/f12 [1084353,61229] 0 2024-09-19T07:24:49.759 INFO:tasks.workunit.client.0.smithi098.stdout:7/74: symlink d5/d8/l18 0 2024-09-19T07:24:49.759 INFO:tasks.workunit.client.0.smithi098.stdout:9/67: symlink d3/dc/df/d15/l17 0 2024-09-19T07:24:49.759 INFO:tasks.workunit.client.0.smithi098.stdout:9/68: truncate d3/d6/d8/f12 1765915 0 2024-09-19T07:24:49.760 INFO:tasks.workunit.client.0.smithi098.stdout:0/47: truncate d5/f7 1658459 0 2024-09-19T07:24:49.760 INFO:tasks.workunit.client.0.smithi098.stdout:0/48: write d5/ff [564992,92459] 0 2024-09-19T07:24:49.761 INFO:tasks.workunit.client.0.smithi098.stdout:7/75: chown d5/d10/d11 3378 1 2024-09-19T07:24:49.761 INFO:tasks.workunit.client.0.smithi098.stdout:7/76: chown d5/d8/dc/fe 51970634 1 2024-09-19T07:24:49.761 INFO:tasks.workunit.client.0.smithi098.stdout:7/77: readlink d5/d10/l13 0 2024-09-19T07:24:49.761 INFO:tasks.workunit.client.0.smithi098.stdout:7/78: symlink d5/d10/d11/l19 0 2024-09-19T07:24:49.764 INFO:tasks.workunit.client.0.smithi098.stdout:0/49: dread f4 [0,4194304] 0 2024-09-19T07:24:49.765 INFO:tasks.workunit.client.0.smithi098.stdout:0/50: creat d5/d9/f10 x:0 0 0 2024-09-19T07:24:49.766 INFO:tasks.workunit.client.0.smithi098.stdout:7/79: dread d5/d8/dc/fe [0,4194304] 0 2024-09-19T07:24:49.766 INFO:tasks.workunit.client.0.smithi098.stdout:7/80: getdents d5/d8/dc/d16 0 2024-09-19T07:24:49.770 INFO:tasks.workunit.client.0.smithi098.stdout:0/51: dread d5/f7 [0,4194304] 0 2024-09-19T07:24:49.771 INFO:tasks.workunit.client.0.smithi098.stdout:0/52: truncate f0 340582 0 2024-09-19T07:24:49.771 INFO:tasks.workunit.client.0.smithi098.stdout:0/53: fdatasync f4 0 2024-09-19T07:24:49.772 INFO:tasks.workunit.client.0.smithi098.stdout:0/54: symlink d5/l11 0 2024-09-19T07:24:49.776 INFO:tasks.workunit.client.0.smithi098.stdout:7/81: write d5/d8/f9 [1994627,57261] 0 2024-09-19T07:24:49.776 INFO:tasks.workunit.client.0.smithi098.stdout:7/82: fsync d5/d8/dc/f15 0 2024-09-19T07:24:49.776 INFO:tasks.workunit.client.0.smithi098.stdout:7/83: stat d5/d8/c14 0 2024-09-19T07:24:49.777 INFO:tasks.workunit.client.0.smithi098.stdout:7/84: creat d5/d8/f1a x:0 0 0 2024-09-19T07:24:49.780 INFO:tasks.workunit.client.0.smithi098.stdout:9/69: dwrite d3/d6/d8/f12 [0,4194304] 0 2024-09-19T07:24:49.780 INFO:tasks.workunit.client.0.smithi098.stdout:9/70: mknod d3/d16/c18 0 2024-09-19T07:24:49.788 INFO:tasks.workunit.client.0.smithi098.stdout:7/85: write d5/d8/fa [1518542,40403] 0 2024-09-19T07:24:49.788 INFO:tasks.workunit.client.0.smithi098.stdout:7/86: truncate d5/d8/f9 4964599 0 2024-09-19T07:24:49.788 INFO:tasks.workunit.client.0.smithi098.stdout:9/71: write d3/d6/d8/f12 [3457865,33124] 0 2024-09-19T07:24:49.794 INFO:tasks.workunit.client.0.smithi098.stdout:0/55: dwrite f4 [0,4194304] 0 2024-09-19T07:24:49.802 INFO:tasks.workunit.client.0.smithi098.stdout:0/56: dread f0 [0,4194304] 0 2024-09-19T07:24:49.804 INFO:tasks.workunit.client.0.smithi098.stdout:0/57: dread d5/f7 [0,4194304] 0 2024-09-19T07:24:49.804 INFO:tasks.workunit.client.0.smithi098.stdout:0/58: fsync d5/f7 0 2024-09-19T07:24:49.806 INFO:tasks.workunit.client.0.smithi098.stdout:7/87: dwrite d5/f7 [0,4194304] 0 2024-09-19T07:24:49.812 INFO:tasks.workunit.client.0.smithi098.stdout:7/88: dread d5/d8/fa [0,4194304] 0 2024-09-19T07:24:49.813 INFO:tasks.workunit.client.0.smithi098.stdout:7/89: unlink d5/d8/f1a 0 2024-09-19T07:24:49.815 INFO:tasks.workunit.client.0.smithi098.stdout:7/90: creat d5/d10/f1b x:0 0 0 2024-09-19T07:24:49.815 INFO:tasks.workunit.client.0.smithi098.stdout:7/91: chown d5/d8/dc/d16 657380 1 2024-09-19T07:24:49.817 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:49.383+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025ab [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_hostname.c auth v20 ap=1 s=795 n(v0 rc2024-09-19T07:24:38.664893+0000 b795 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd521700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025ab:[<0x100000025a5/selinux_hostname.c v12>,<0x10000002549/capable_sys v196>,<0x100000024cb/tests v256>,<0x10000002494/selinux-testsuite v86>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000025ab:[<0x100000025a5/selinux_hostname.c v20>,<0x10000002549/capable_sys v196>,<0x100000024cb/tests v268>,<0x10000002494/selinux-testsuite v156>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.817 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:49.383+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025a6 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_chroot.c auth v16 ap=1 s=752 n(v0 rc2024-09-19T07:24:38.659893+0000 b752 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd524000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025a6:[<0x100000025a5/selinux_chroot.c v2>,<0x10000002549/capable_sys v196>,<0x100000024cb/tests v256>,<0x10000002494/selinux-testsuite v86>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000025a6:[<0x100000025a5/selinux_chroot.c v16>,<0x10000002549/capable_sys v196>,<0x100000024cb/tests v268>,<0x10000002494/selinux-testsuite v156>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.817 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:49.384+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025a9 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_rawio.c auth v24 ap=1 s=976 n(v0 rc2024-09-19T07:24:38.662893+0000 b976 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd524580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025a9:[<0x100000025a5/selinux_rawio.c v8>,<0x10000002549/capable_sys v196>,<0x100000024cb/tests v256>,<0x10000002494/selinux-testsuite v86>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000025a9:[<0x100000025a5/selinux_rawio.c v24>,<0x10000002549/capable_sys v196>,<0x100000024cb/tests v268>,<0x10000002494/selinux-testsuite v156>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.817 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:49.384+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025a8 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/Makefile auth v22 ap=1 s=1075 n(v0 rc2024-09-19T07:24:38.661893+0000 b1075 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd524b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025a8:[<0x100000025a5/Makefile v6>,<0x10000002549/capable_sys v196>,<0x100000024cb/tests v256>,<0x10000002494/selinux-testsuite v86>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000025a8:[<0x100000025a5/Makefile v22>,<0x10000002549/capable_sys v196>,<0x100000024cb/tests v268>,<0x10000002494/selinux-testsuite v156>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.817 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:49.384+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025aa [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_nice.c auth v18 ap=1 s=624 n(v0 rc2024-09-19T07:24:38.663893+0000 b624 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd525080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025aa:[<0x100000025a5/selinux_nice.c v10>,<0x10000002549/capable_sys v196>,<0x100000024cb/tests v256>,<0x10000002494/selinux-testsuite v86>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000025aa:[<0x100000025a5/selinux_nice.c v18>,<0x10000002549/capable_sys v196>,<0x100000024cb/tests v268>,<0x10000002494/selinux-testsuite v156>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.817 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:24:49.384+0000 7f249b5e6640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025a7 [4,head] /volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_capable_sys.sh auth v14 ap=1 s=3840 n(v0 rc2024-09-19T07:24:38.660893+0000 b3840 1=1+0) caps={24761=pAsLsXsFsc/-@1},l=24761(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5563cd525600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025a7:[<0x100000025a5/selinux_capable_sys.sh v4>,<0x10000002549/capable_sys v196>,<0x100000024cb/tests v256>,<0x10000002494/selinux-testsuite v86>,<0x10000001f2c/security v270>,<0x10000000204/kernel v587>,<0x10000000202/testcases v80>,<0x10000000007/ltp-full-20091231 v59>,<0x10000000006/fsstress v53>,<0x10000000005/tmp v52>,<0x100000001fb/client.0 v50>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v65>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v82>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x100000025a7:[<0x100000025a5/selinux_capable_sys.sh v14>,<0x10000002549/capable_sys v196>,<0x100000024cb/tests v268>,<0x10000002494/selinux-testsuite v156>,<0x10000001f2c/security v1147>,<0x10000000204/kernel v848>,<0x10000000202/testcases v83>,<0x10000000007/ltp-full-20091231 v62>,<0x10000000006/fsstress v56>,<0x10000000005/tmp v55>,<0x100000001fb/client.0 v52>,<0x100000001fa/4730ffd1-fd85-4643-b1bb-bc536e5bfde4 v67>,<0x10000000001/sv_1 v56>,<0x10000000000/qa v43>,<0x1/volumes v46>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T07:24:49.822 INFO:tasks.workunit.client.0.smithi098.stdout:7/92: getdents d5/d8 0 2024-09-19T07:24:49.823 INFO:tasks.workunit.client.0.smithi098.stdout:7/93: creat d5/d8/f1c x:0 0 0 2024-09-19T07:24:49.824 INFO:tasks.workunit.client.0.smithi098.stdout:7/94: fsync d5/f7 0 2024-09-19T07:24:49.824 INFO:tasks.workunit.client.0.smithi098.stdout:7/95: chown d5/d8/dc/d16 209 1 2024-09-19T07:24:49.824 INFO:tasks.workunit.client.0.smithi098.stdout:7/96: write d5/d8/f1c [688335,34774] 0 2024-09-19T07:24:49.824 INFO:tasks.workunit.client.0.smithi098.stdout:7/97: rmdir d5/d8/dc 39 2024-09-19T07:24:49.829 INFO:tasks.workunit.client.0.smithi098.stdout:0/59: dwrite d5/f7 [0,4194304] 0 2024-09-19T07:24:49.837 INFO:tasks.workunit.client.0.smithi098.stdout:0/60: dread d5/f7 [0,4194304] 0 2024-09-19T07:24:49.838 INFO:tasks.workunit.client.0.smithi098.stdout:0/61: rename d5/ff to d5/d9/f12 0 2024-09-19T07:24:49.839 INFO:tasks.workunit.client.0.smithi098.stdout:0/62: unlink f0 0 2024-09-19T07:24:49.840 INFO:tasks.workunit.client.0.smithi098.stdout:0/63: dread - d5/d9/f10 zero size 2024-09-19T07:24:49.840 INFO:tasks.workunit.client.0.smithi098.stdout:0/64: truncate d5/d9/fb 1017696 0 2024-09-19T07:24:49.840 INFO:tasks.workunit.client.0.smithi098.stdout:0/65: write d5/d9/f12 [1688618,15559] 0 2024-09-19T07:24:49.841 INFO:tasks.workunit.client.0.smithi098.stdout:0/66: mknod d5/c13 0 2024-09-19T07:24:49.841 INFO:tasks.workunit.client.0.smithi098.stdout:0/67: rmdir d5 39 2024-09-19T07:24:49.847 INFO:tasks.workunit.client.0.smithi098.stdout:7/98: dwrite d5/d8/fa [0,4194304] 0 2024-09-19T07:24:49.859 INFO:tasks.workunit.client.0.smithi098.stdout:7/99: write d5/f7 [1263884,22492] 0 2024-09-19T07:24:49.860 INFO:tasks.workunit.client.0.smithi098.stdout:7/100: rmdir d5/d10/d11 39 2024-09-19T07:24:49.860 INFO:tasks.workunit.client.0.smithi098.stdout:7/101: fdatasync d5/d8/dc/f15 0 2024-09-19T07:24:49.860 INFO:tasks.workunit.client.0.smithi098.stdout:7/102: write d5/d10/f1b [782127,12341] 0 2024-09-19T07:24:49.862 INFO:tasks.workunit.client.0.smithi098.stdout:7/103: mkdir d5/d10/d1d 0 2024-09-19T07:24:49.862 INFO:tasks.workunit.client.0.smithi098.stdout:0/68: dwrite d5/d9/f12 [0,4194304] 0 2024-09-19T07:24:49.865 INFO:tasks.workunit.client.0.smithi098.stdout:0/69: mkdir d5/d9/d14 0 2024-09-19T07:24:49.866 INFO:tasks.workunit.client.0.smithi098.stdout:0/70: write d5/d9/fb [1717111,100071] 0 2024-09-19T07:24:49.866 INFO:tasks.workunit.client.0.smithi098.stdout:0/71: dread - d5/fe zero size 2024-09-19T07:24:49.884 INFO:tasks.workunit.client.0.smithi098.stdout:0/72: dwrite d5/d9/f10 [0,4194304] 0 2024-09-19T07:24:49.884 INFO:tasks.workunit.client.0.smithi098.stdout:7/104: dwrite d5/d8/fa [0,4194304] 0 2024-09-19T07:24:49.884 INFO:tasks.workunit.client.0.smithi098.stdout:7/105: chown d5/d8/dc/fe 7390 1 2024-09-19T07:24:49.885 INFO:tasks.workunit.client.0.smithi098.stdout:7/106: write d5/d10/f1b [1220209,59834] 0 2024-09-19T07:24:49.886 INFO:tasks.workunit.client.0.smithi098.stdout:7/107: write d5/d8/f9 [5549352,91830] 0 2024-09-19T07:24:49.886 INFO:tasks.workunit.client.0.smithi098.stdout:7/108: readlink d5/d10/l13 0 2024-09-19T07:24:49.913 INFO:tasks.workunit.client.0.smithi098.stdout:0/73: dwrite d5/fe [0,4194304] 0 2024-09-19T07:24:49.914 INFO:tasks.workunit.client.0.smithi098.stdout:0/74: chown d5/cc 336053099 1 2024-09-19T07:24:49.914 INFO:tasks.workunit.client.0.smithi098.stdout:7/109: dwrite d5/d8/f9 [4194304,4194304] 0 2024-09-19T07:24:49.914 INFO:tasks.workunit.client.0.smithi098.stdout:7/110: chown d5/d10/d11/l19 445531 1 2024-09-19T07:24:49.914 INFO:tasks.workunit.client.0.smithi098.stdout:7/111: truncate d5/d10/f1b 2304661 0 2024-09-19T07:24:49.917 INFO:tasks.workunit.client.0.smithi098.stdout:0/75: creat d5/d9/d14/f15 x:0 0 0 2024-09-19T07:24:49.923 INFO:tasks.workunit.client.0.smithi098.stdout:5/80: sync 2024-09-19T07:24:49.923 INFO:tasks.workunit.client.0.smithi098.stdout:9/72: sync 2024-09-19T07:24:49.923 INFO:tasks.workunit.client.0.smithi098.stdout:2/9: sync 2024-09-19T07:24:49.923 INFO:tasks.workunit.client.0.smithi098.stdout:6/30: sync 2024-09-19T07:24:49.923 INFO:tasks.workunit.client.0.smithi098.stdout:1/18: sync 2024-09-19T07:24:49.923 INFO:tasks.workunit.client.0.smithi098.stdout:3/101: sync 2024-09-19T07:24:49.923 INFO:tasks.workunit.client.0.smithi098.stdout:5/81: read - dc/de/f1b zero size 2024-09-19T07:24:49.923 INFO:tasks.workunit.client.0.smithi098.stdout:6/31: fdatasync f1 0 2024-09-19T07:24:49.923 INFO:tasks.workunit.client.0.smithi098.stdout:6/32: truncate d2/d5/f9 157712 0 2024-09-19T07:24:49.924 INFO:tasks.workunit.client.0.smithi098.stdout:8/83: sync 2024-09-19T07:24:49.924 INFO:tasks.workunit.client.0.smithi098.stdout:5/82: write f4 [561804,77468] 0 2024-09-19T07:24:49.924 INFO:tasks.workunit.client.0.smithi098.stdout:4/77: sync 2024-09-19T07:24:49.924 INFO:tasks.workunit.client.0.smithi098.stdout:9/73: chown d3/d6/d8 14331 1 2024-09-19T07:24:49.924 INFO:tasks.workunit.client.0.smithi098.stdout:2/10: rename d1/l2 to d1/l3 0 2024-09-19T07:24:49.925 INFO:tasks.workunit.client.0.smithi098.stdout:3/102: creat de/df/d16/f1b x:0 0 0 2024-09-19T07:24:49.925 INFO:tasks.workunit.client.0.smithi098.stdout:3/103: fsync f9 0 2024-09-19T07:24:49.925 INFO:tasks.workunit.client.0.smithi098.stdout:3/104: chown lb 6178055 1 2024-09-19T07:24:49.926 INFO:tasks.workunit.client.0.smithi098.stdout:5/83: rename dc/de/d13/f1a to dc/de/f1d 0 2024-09-19T07:24:49.926 INFO:tasks.workunit.client.0.smithi098.stdout:0/76: dread d5/d9/f12 [0,4194304] 0 2024-09-19T07:24:49.927 INFO:tasks.workunit.client.0.smithi098.stdout:4/78: rmdir da/d15 0 2024-09-19T07:24:49.927 INFO:tasks.workunit.client.0.smithi098.stdout:2/11: symlink d1/l4 0 2024-09-19T07:24:49.928 INFO:tasks.workunit.client.0.smithi098.stdout:3/105: symlink de/l1c 0 2024-09-19T07:24:49.929 INFO:tasks.workunit.client.0.smithi098.stdout:9/74: rename d3/d6/d8/f12 to d3/dc/f19 0 2024-09-19T07:24:49.930 INFO:tasks.workunit.client.0.smithi098.stdout:5/84: mknod dc/de/d13/c1e 0 2024-09-19T07:24:49.931 INFO:tasks.workunit.client.0.smithi098.stdout:5/85: truncate dc/f17 262447 0 2024-09-19T07:24:49.931 INFO:tasks.workunit.client.0.smithi098.stdout:0/77: mknod d5/d9/d14/c16 0 2024-09-19T07:24:49.931 INFO:tasks.workunit.client.0.smithi098.stdout:2/12: mkdir d1/d5 0 2024-09-19T07:24:49.932 INFO:tasks.workunit.client.0.smithi098.stdout:3/106: creat de/f1d x:0 0 0 2024-09-19T07:24:49.933 INFO:tasks.workunit.client.0.smithi098.stdout:9/75: mkdir d3/dc/df/d15/d1a 0 2024-09-19T07:24:49.934 INFO:tasks.workunit.client.0.smithi098.stdout:5/86: mknod dc/c1f 0 2024-09-19T07:24:49.935 INFO:tasks.workunit.client.0.smithi098.stdout:0/78: unlink d5/d9/d14/f15 0 2024-09-19T07:24:49.935 INFO:tasks.workunit.client.0.smithi098.stdout:0/79: chown d5/d9/ld 0 1 2024-09-19T07:24:49.935 INFO:tasks.workunit.client.0.smithi098.stdout:0/80: readlink d5/l11 0 2024-09-19T07:24:49.935 INFO:tasks.workunit.client.0.smithi098.stdout:3/107: symlink de/l1e 0 2024-09-19T07:24:49.936 INFO:tasks.workunit.client.0.smithi098.stdout:5/87: symlink dc/de/l20 0 2024-09-19T07:24:49.936 INFO:tasks.workunit.client.0.smithi098.stdout:5/88: fdatasync f3 0 2024-09-19T07:24:49.936 INFO:tasks.workunit.client.0.smithi098.stdout:0/81: rmdir d5 39 2024-09-19T07:24:49.938 INFO:tasks.workunit.client.0.smithi098.stdout:6/33: write d2/f3 [53907,21891] 0 2024-09-19T07:24:49.938 INFO:tasks.workunit.client.0.smithi098.stdout:9/76: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:49.938 INFO:tasks.workunit.client.0.smithi098.stdout:6/34: write d2/d5/f9 [216627,104986] 0 2024-09-19T07:24:49.938 INFO:tasks.workunit.client.0.smithi098.stdout:3/108: mkdir de/df/d1f 0 2024-09-19T07:24:49.939 INFO:tasks.workunit.client.0.smithi098.stdout:0/82: rmdir d5 39 2024-09-19T07:24:49.939 INFO:tasks.workunit.client.0.smithi098.stdout:0/83: fdatasync f4 0 2024-09-19T07:24:49.941 INFO:tasks.workunit.client.0.smithi098.stdout:6/35: unlink d2/d5/f9 0 2024-09-19T07:24:49.941 INFO:tasks.workunit.client.0.smithi098.stdout:9/77: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:49.941 INFO:tasks.workunit.client.0.smithi098.stdout:7/112: dwrite d5/d8/dc/f15 [0,4194304] 0 2024-09-19T07:24:49.943 INFO:tasks.workunit.client.0.smithi098.stdout:3/109: unlink de/df/d16/f1b 0 2024-09-19T07:24:49.944 INFO:tasks.workunit.client.0.smithi098.stdout:0/84: creat d5/f17 x:0 0 0 2024-09-19T07:24:49.948 INFO:tasks.workunit.client.0.smithi098.stdout:9/78: mkdir d3/dc/df/d15/d1b 0 2024-09-19T07:24:49.950 INFO:tasks.workunit.client.0.smithi098.stdout:7/113: creat d5/d8/dc/d16/f1e x:0 0 0 2024-09-19T07:24:49.951 INFO:tasks.workunit.client.0.smithi098.stdout:3/110: truncate fc 2197898 0 2024-09-19T07:24:49.952 INFO:tasks.workunit.client.0.smithi098.stdout:6/36: dread d2/f3 [0,4194304] 0 2024-09-19T07:24:49.954 INFO:tasks.workunit.client.0.smithi098.stdout:0/85: dread d5/d9/f10 [0,4194304] 0 2024-09-19T07:24:49.955 INFO:tasks.workunit.client.0.smithi098.stdout:7/114: rename d5/d10/l13 to d5/l1f 0 2024-09-19T07:24:49.956 INFO:tasks.workunit.client.0.smithi098.stdout:3/111: symlink de/df/d16/l20 0 2024-09-19T07:24:49.958 INFO:tasks.workunit.client.0.smithi098.stdout:0/86: creat d5/f18 x:0 0 0 2024-09-19T07:24:49.958 INFO:tasks.workunit.client.0.smithi098.stdout:0/87: fdatasync d5/f7 0 2024-09-19T07:24:49.959 INFO:tasks.workunit.client.0.smithi098.stdout:7/115: mknod d5/d10/d1d/c20 0 2024-09-19T07:24:49.959 INFO:tasks.workunit.client.0.smithi098.stdout:7/116: fsync d5/d8/f9 0 2024-09-19T07:24:49.960 INFO:tasks.workunit.client.0.smithi098.stdout:1/19: dwrite f4 [0,4194304] 0 2024-09-19T07:24:49.960 INFO:tasks.workunit.client.0.smithi098.stdout:8/84: dwrite d0/f5 [0,4194304] 0 2024-09-19T07:24:49.960 INFO:tasks.workunit.client.0.smithi098.stdout:4/79: dwrite da/fc [0,4194304] 0 2024-09-19T07:24:49.961 INFO:tasks.workunit.client.0.smithi098.stdout:5/89: getdents dc 0 2024-09-19T07:24:49.961 INFO:tasks.workunit.client.0.smithi098.stdout:5/90: write dc/de/d13/f14 [790622,88687] 0 2024-09-19T07:24:49.961 INFO:tasks.workunit.client.0.smithi098.stdout:3/112: truncate de/f1a 2366798 0 2024-09-19T07:24:49.967 INFO:tasks.workunit.client.0.smithi098.stdout:4/80: symlink da/l19 0 2024-09-19T07:24:49.968 INFO:tasks.workunit.client.0.smithi098.stdout:3/113: chown l3 126966 1 2024-09-19T07:24:49.971 INFO:tasks.workunit.client.0.smithi098.stdout:6/37: dread f1 [0,4194304] 0 2024-09-19T07:24:49.971 INFO:tasks.workunit.client.0.smithi098.stdout:6/38: write d2/f3 [5109606,5575] 0 2024-09-19T07:24:49.973 INFO:tasks.workunit.client.0.smithi098.stdout:1/20: dread f4 [0,4194304] 0 2024-09-19T07:24:49.974 INFO:tasks.workunit.client.0.smithi098.stdout:9/79: dwrite d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:49.974 INFO:tasks.workunit.client.0.smithi098.stdout:9/80: write d3/dc/f19 [4562668,22363] 0 2024-09-19T07:24:49.975 INFO:tasks.workunit.client.0.smithi098.stdout:9/81: readlink d3/d6/ld 0 2024-09-19T07:24:49.975 INFO:tasks.workunit.client.0.smithi098.stdout:3/114: truncate f5 1725147 0 2024-09-19T07:24:49.975 INFO:tasks.workunit.client.0.smithi098.stdout:1/21: rename c5 to c7 0 2024-09-19T07:24:49.976 INFO:tasks.workunit.client.0.smithi098.stdout:9/82: getdents d3/d6/d8 0 2024-09-19T07:24:49.977 INFO:tasks.workunit.client.0.smithi098.stdout:7/117: read d5/d8/dc/f15 [633146,71200] 0 2024-09-19T07:24:49.977 INFO:tasks.workunit.client.0.smithi098.stdout:7/118: chown d5 0 1 2024-09-19T07:24:49.979 INFO:tasks.workunit.client.0.smithi098.stdout:9/83: unlink d3/d16/c18 0 2024-09-19T07:24:49.982 INFO:tasks.workunit.client.0.smithi098.stdout:7/119: read d5/d8/dc/fe [369095,122309] 0 2024-09-19T07:24:49.989 INFO:tasks.workunit.client.0.smithi098.stdout:0/88: dwrite d5/f17 [0,4194304] 0 2024-09-19T07:24:49.989 INFO:tasks.workunit.client.0.smithi098.stdout:7/120: dread d5/d10/f1b [0,4194304] 0 2024-09-19T07:24:49.989 INFO:tasks.workunit.client.0.smithi098.stdout:7/121: stat d5/d10/d1d 0 2024-09-19T07:24:49.999 INFO:tasks.workunit.client.0.smithi098.stdout:1/22: link c7 c8 0 2024-09-19T07:24:49.999 INFO:tasks.workunit.client.0.smithi098.stdout:1/23: symlink l9 0 2024-09-19T07:24:50.000 INFO:tasks.workunit.client.0.smithi098.stdout:1/24: creat fa x:0 0 0 2024-09-19T07:24:50.000 INFO:tasks.workunit.client.0.smithi098.stdout:7/122: read d5/d8/f9 [6850477,67567] 0 2024-09-19T07:24:50.003 INFO:tasks.workunit.client.0.smithi098.stdout:8/85: dwrite d0/fc [0,4194304] 0 2024-09-19T07:24:50.004 INFO:tasks.workunit.client.0.smithi098.stdout:1/25: dread f4 [0,4194304] 0 2024-09-19T07:24:50.005 INFO:tasks.workunit.client.0.smithi098.stdout:7/123: dread d5/d8/f9 [4194304,4194304] 0 2024-09-19T07:24:50.006 INFO:tasks.workunit.client.0.smithi098.stdout:5/91: dwrite f0 [0,4194304] 0 2024-09-19T07:24:50.006 INFO:tasks.workunit.client.0.smithi098.stdout:9/84: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:50.007 INFO:tasks.workunit.client.0.smithi098.stdout:4/81: dwrite da/fd [0,4194304] 0 2024-09-19T07:24:50.007 INFO:tasks.workunit.client.0.smithi098.stdout:6/39: dwrite d2/f3 [0,4194304] 0 2024-09-19T07:24:50.007 INFO:tasks.workunit.client.0.smithi098.stdout:3/115: dread f5 [0,4194304] 0 2024-09-19T07:24:50.007 INFO:tasks.workunit.client.0.smithi098.stdout:3/116: readlink de/l1c 0 2024-09-19T07:24:50.008 INFO:tasks.workunit.client.0.smithi098.stdout:8/86: rename d0/l1 to d0/de/d12/l1b 0 2024-09-19T07:24:50.008 INFO:tasks.workunit.client.0.smithi098.stdout:1/26: mknod cb 0 2024-09-19T07:24:50.008 INFO:tasks.workunit.client.0.smithi098.stdout:1/27: write f1 [819066,29227] 0 2024-09-19T07:24:50.009 INFO:tasks.workunit.client.0.smithi098.stdout:1/28: write f1 [102468,74329] 0 2024-09-19T07:24:50.009 INFO:tasks.workunit.client.0.smithi098.stdout:9/85: dread d3/dc/f19 [4194304,4194304] 0 2024-09-19T07:24:50.010 INFO:tasks.workunit.client.0.smithi098.stdout:5/92: creat dc/de/d13/f21 x:0 0 0 2024-09-19T07:24:50.011 INFO:tasks.workunit.client.0.smithi098.stdout:6/40: rmdir d2/d5 39 2024-09-19T07:24:50.011 INFO:tasks.workunit.client.0.smithi098.stdout:8/87: creat d0/d1a/f1c x:0 0 0 2024-09-19T07:24:50.011 INFO:tasks.workunit.client.0.smithi098.stdout:3/117: rename la to de/df/d1f/l21 0 2024-09-19T07:24:50.012 INFO:tasks.workunit.client.0.smithi098.stdout:1/29: mkdir dc 0 2024-09-19T07:24:50.014 INFO:tasks.workunit.client.0.smithi098.stdout:9/86: mknod d3/dc/df/d15/d1a/c1c 0 2024-09-19T07:24:50.014 INFO:tasks.workunit.client.0.smithi098.stdout:9/87: chown d3/dc/f19 154008 1 2024-09-19T07:24:50.014 INFO:tasks.workunit.client.0.smithi098.stdout:9/88: truncate d3/dc/f19 5228345 0 2024-09-19T07:24:50.014 INFO:tasks.workunit.client.0.smithi098.stdout:6/41: rmdir d2/d5 39 2024-09-19T07:24:50.014 INFO:tasks.workunit.client.0.smithi098.stdout:3/118: dread f4 [0,4194304] 0 2024-09-19T07:24:50.015 INFO:tasks.workunit.client.0.smithi098.stdout:8/88: getdents d0/de/d12 0 2024-09-19T07:24:50.018 INFO:tasks.workunit.client.0.smithi098.stdout:1/30: rename c7 to dc/cd 0 2024-09-19T07:24:50.018 INFO:tasks.workunit.client.0.smithi098.stdout:1/31: write f1 [1425541,58635] 0 2024-09-19T07:24:50.018 INFO:tasks.workunit.client.0.smithi098.stdout:1/32: dread - fa zero size 2024-09-19T07:24:50.019 INFO:tasks.workunit.client.0.smithi098.stdout:3/119: creat de/df/f22 x:0 0 0 2024-09-19T07:24:50.019 INFO:tasks.workunit.client.0.smithi098.stdout:3/120: readlink l1 0 2024-09-19T07:24:50.019 INFO:tasks.workunit.client.0.smithi098.stdout:8/89: mknod d0/d16/c1d 0 2024-09-19T07:24:50.021 INFO:tasks.workunit.client.0.smithi098.stdout:9/89: rename d3/dc/df/d15/d1a/c1c to d3/dc/df/c1d 0 2024-09-19T07:24:50.022 INFO:tasks.workunit.client.0.smithi098.stdout:1/33: unlink l9 0 2024-09-19T07:24:50.022 INFO:tasks.workunit.client.0.smithi098.stdout:1/34: truncate f1 1816693 0 2024-09-19T07:24:50.023 INFO:tasks.workunit.client.0.smithi098.stdout:3/121: creat de/df/f23 x:0 0 0 2024-09-19T07:24:50.023 INFO:tasks.workunit.client.0.smithi098.stdout:3/122: chown de/f14 3480 1 2024-09-19T07:24:50.023 INFO:tasks.workunit.client.0.smithi098.stdout:7/124: dwrite d5/f7 [0,4194304] 0 2024-09-19T07:24:50.023 INFO:tasks.workunit.client.0.smithi098.stdout:7/125: chown d5/d10 3647 1 2024-09-19T07:24:50.024 INFO:tasks.workunit.client.0.smithi098.stdout:1/35: truncate f4 2902196 0 2024-09-19T07:24:50.025 INFO:tasks.workunit.client.0.smithi098.stdout:3/123: rename lb to de/l24 0 2024-09-19T07:24:50.028 INFO:tasks.workunit.client.0.smithi098.stdout:7/126: unlink d5/d10/f1b 0 2024-09-19T07:24:50.030 INFO:tasks.workunit.client.0.smithi098.stdout:7/127: rename d5/d8/f1c to d5/d8/f21 0 2024-09-19T07:24:50.033 INFO:tasks.workunit.client.0.smithi098.stdout:7/128: truncate d5/d8/f9 4759262 0 2024-09-19T07:24:50.037 INFO:tasks.workunit.client.0.smithi098.stdout:5/93: dwrite dc/f12 [0,4194304] 0 2024-09-19T07:24:50.040 INFO:tasks.workunit.client.0.smithi098.stdout:1/36: fsync f4 0 2024-09-19T07:24:50.041 INFO:tasks.workunit.client.0.smithi098.stdout:5/94: symlink dc/d1c/l22 0 2024-09-19T07:24:50.041 INFO:tasks.workunit.client.0.smithi098.stdout:5/95: dread - dc/de/d13/f21 zero size 2024-09-19T07:24:50.042 INFO:tasks.workunit.client.0.smithi098.stdout:1/37: mkdir dc/de 0 2024-09-19T07:24:50.042 INFO:tasks.workunit.client.0.smithi098.stdout:5/96: mkdir dc/d1c/d23 0 2024-09-19T07:24:50.043 INFO:tasks.workunit.client.0.smithi098.stdout:9/90: truncate d3/dc/f19 4291020 0 2024-09-19T07:24:50.044 INFO:tasks.workunit.client.0.smithi098.stdout:3/124: dwrite f4 [0,4194304] 0 2024-09-19T07:24:50.044 INFO:tasks.workunit.client.0.smithi098.stdout:3/125: write f5 [2561466,129136] 0 2024-09-19T07:24:50.044 INFO:tasks.workunit.client.0.smithi098.stdout:6/42: dwrite f1 [0,4194304] 0 2024-09-19T07:24:50.044 INFO:tasks.workunit.client.0.smithi098.stdout:5/97: getdents dc/de/d13 0 2024-09-19T07:24:50.045 INFO:tasks.workunit.client.0.smithi098.stdout:9/91: symlink d3/dc/df/d15/d1b/l1e 0 2024-09-19T07:24:50.045 INFO:tasks.workunit.client.0.smithi098.stdout:9/92: chown d3/d6/d8/ca 379 1 2024-09-19T07:24:50.046 INFO:tasks.workunit.client.0.smithi098.stdout:1/38: dread f4 [0,4194304] 0 2024-09-19T07:24:50.047 INFO:tasks.workunit.client.0.smithi098.stdout:3/126: truncate f9 1005982 0 2024-09-19T07:24:50.047 INFO:tasks.workunit.client.0.smithi098.stdout:3/127: fsync fc 0 2024-09-19T07:24:50.047 INFO:tasks.workunit.client.0.smithi098.stdout:3/128: truncate de/f19 839229 0 2024-09-19T07:24:50.050 INFO:tasks.workunit.client.0.smithi098.stdout:6/43: creat d2/d5/fa x:0 0 0 2024-09-19T07:24:50.051 INFO:tasks.workunit.client.0.smithi098.stdout:5/98: creat dc/d1c/f24 x:0 0 0 2024-09-19T07:24:50.052 INFO:tasks.workunit.client.0.smithi098.stdout:1/39: creat dc/ff x:0 0 0 2024-09-19T07:24:50.054 INFO:tasks.workunit.client.0.smithi098.stdout:7/129: link d5/d8/f9 d5/f22 0 2024-09-19T07:24:50.054 INFO:tasks.workunit.client.0.smithi098.stdout:7/130: chown d5/d8/fa 4988244 1 2024-09-19T07:24:50.055 INFO:tasks.workunit.client.0.smithi098.stdout:6/44: creat d2/fb x:0 0 0 2024-09-19T07:24:50.055 INFO:tasks.workunit.client.0.smithi098.stdout:6/45: write d2/d5/fa [951162,61127] 0 2024-09-19T07:24:50.056 INFO:tasks.workunit.client.0.smithi098.stdout:9/93: fsync d3/dc/f19 0 2024-09-19T07:24:50.056 INFO:tasks.workunit.client.0.smithi098.stdout:5/99: link dc/de/l10 dc/l25 0 2024-09-19T07:24:50.057 INFO:tasks.workunit.client.0.smithi098.stdout:3/129: write f0 [792904,130524] 0 2024-09-19T07:24:50.058 INFO:tasks.workunit.client.0.smithi098.stdout:1/40: unlink dc/ff 0 2024-09-19T07:24:50.060 INFO:tasks.workunit.client.0.smithi098.stdout:9/94: mkdir d3/d16/d1f 0 2024-09-19T07:24:50.061 INFO:tasks.workunit.client.0.smithi098.stdout:5/100: creat dc/d1c/f26 x:0 0 0 2024-09-19T07:24:50.062 INFO:tasks.workunit.client.0.smithi098.stdout:1/41: dread f1 [0,4194304] 0 2024-09-19T07:24:50.062 INFO:tasks.workunit.client.0.smithi098.stdout:1/42: fdatasync f4 0 2024-09-19T07:24:50.063 INFO:tasks.workunit.client.0.smithi098.stdout:3/130: creat de/f25 x:0 0 0 2024-09-19T07:24:50.063 INFO:tasks.workunit.client.0.smithi098.stdout:9/95: write d3/dc/f19 [3464095,107185] 0 2024-09-19T07:24:50.064 INFO:tasks.workunit.client.0.smithi098.stdout:5/101: creat dc/de/d13/f27 x:0 0 0 2024-09-19T07:24:50.066 INFO:tasks.workunit.client.0.smithi098.stdout:6/46: write f1 [1938923,12766] 0 2024-09-19T07:24:50.066 INFO:tasks.workunit.client.0.smithi098.stdout:1/43: write f4 [2565542,76006] 0 2024-09-19T07:24:50.066 INFO:tasks.workunit.client.0.smithi098.stdout:1/44: stat l6 0 2024-09-19T07:24:50.067 INFO:tasks.workunit.client.0.smithi098.stdout:5/102: mknod dc/de/c28 0 2024-09-19T07:24:50.069 INFO:tasks.workunit.client.0.smithi098.stdout:5/103: creat dc/f29 x:0 0 0 2024-09-19T07:24:50.071 INFO:tasks.workunit.client.0.smithi098.stdout:5/104: creat dc/de/f2a x:0 0 0 2024-09-19T07:24:50.071 INFO:tasks.workunit.client.0.smithi098.stdout:5/105: chown dc/l25 1126 1 2024-09-19T07:24:50.072 INFO:tasks.workunit.client.0.smithi098.stdout:5/106: mknod dc/de/d13/c2b 0 2024-09-19T07:24:50.072 INFO:tasks.workunit.client.0.smithi098.stdout:5/107: chown dc/de/d13 3945126 1 2024-09-19T07:24:50.072 INFO:tasks.workunit.client.0.smithi098.stdout:5/108: dread - dc/d1c/f26 zero size 2024-09-19T07:24:50.072 INFO:tasks.workunit.client.0.smithi098.stdout:7/131: dwrite d5/f7 [0,4194304] 0 2024-09-19T07:24:50.073 INFO:tasks.workunit.client.0.smithi098.stdout:5/109: creat dc/de/f2c x:0 0 0 2024-09-19T07:24:50.081 INFO:tasks.workunit.client.0.smithi098.stdout:5/110: getdents dc/de/d13 0 2024-09-19T07:24:50.081 INFO:tasks.workunit.client.0.smithi098.stdout:5/111: dread - dc/d1c/f26 zero size 2024-09-19T07:24:50.085 INFO:tasks.workunit.client.0.smithi098.stdout:3/131: truncate f9 456893 0 2024-09-19T07:24:50.085 INFO:tasks.workunit.client.0.smithi098.stdout:3/132: truncate de/df/f22 146626 0 2024-09-19T07:24:50.086 INFO:tasks.workunit.client.0.smithi098.stdout:5/112: mknod dc/de/d13/c2d 0 2024-09-19T07:24:50.087 INFO:tasks.workunit.client.0.smithi098.stdout:3/133: rename de/df/f23 to de/f26 0 2024-09-19T07:24:50.087 INFO:tasks.workunit.client.0.smithi098.stdout:3/134: truncate de/f25 829257 0 2024-09-19T07:24:50.087 INFO:tasks.workunit.client.0.smithi098.stdout:3/135: chown de 5571 1 2024-09-19T07:24:50.088 INFO:tasks.workunit.client.0.smithi098.stdout:3/136: write f0 [3776041,90698] 0 2024-09-19T07:24:50.088 INFO:tasks.workunit.client.0.smithi098.stdout:5/113: chown dc/de/d13/f19 313698 1 2024-09-19T07:24:50.088 INFO:tasks.workunit.client.0.smithi098.stdout:3/137: link de/f25 de/df/d1f/f27 0 2024-09-19T07:24:50.094 INFO:tasks.workunit.client.0.smithi098.stdout:9/96: dwrite d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:50.095 INFO:tasks.workunit.client.0.smithi098.stdout:9/97: symlink d3/d16/l20 0 2024-09-19T07:24:50.097 INFO:tasks.workunit.client.0.smithi098.stdout:1/45: dwrite f1 [0,4194304] 0 2024-09-19T07:24:50.097 INFO:tasks.workunit.client.0.smithi098.stdout:9/98: creat d3/dc/df/f21 x:0 0 0 2024-09-19T07:24:50.100 INFO:tasks.workunit.client.0.smithi098.stdout:9/99: mkdir d3/d16/d1f/d22 0 2024-09-19T07:24:50.100 INFO:tasks.workunit.client.0.smithi098.stdout:9/100: chown d3/d16/d1f 1 1 2024-09-19T07:24:50.103 INFO:tasks.workunit.client.0.smithi098.stdout:1/46: dread f4 [0,4194304] 0 2024-09-19T07:24:50.103 INFO:tasks.workunit.client.0.smithi098.stdout:9/101: link d3/d6/ld d3/d6/d8/l23 0 2024-09-19T07:24:50.104 INFO:tasks.workunit.client.0.smithi098.stdout:1/47: write fa [1011481,104846] 0 2024-09-19T07:24:50.105 INFO:tasks.workunit.client.0.smithi098.stdout:9/102: rename d3/ce to d3/dc/df/c24 0 2024-09-19T07:24:50.106 INFO:tasks.workunit.client.0.smithi098.stdout:1/48: mknod dc/de/c10 0 2024-09-19T07:24:50.113 INFO:tasks.workunit.client.0.smithi098.stdout:6/47: dwrite d2/f3 [0,4194304] 0 2024-09-19T07:24:50.114 INFO:tasks.workunit.client.0.smithi098.stdout:6/48: creat d2/fc x:0 0 0 2024-09-19T07:24:50.116 INFO:tasks.workunit.client.0.smithi098.stdout:6/49: rename d2/f3 to d2/d5/fd 0 2024-09-19T07:24:50.117 INFO:tasks.workunit.client.0.smithi098.stdout:1/49: write f1 [3620381,42466] 0 2024-09-19T07:24:50.120 INFO:tasks.workunit.client.0.smithi098.stdout:1/50: dread f4 [0,4194304] 0 2024-09-19T07:24:50.121 INFO:tasks.workunit.client.0.smithi098.stdout:1/51: symlink dc/l11 0 2024-09-19T07:24:50.121 INFO:tasks.workunit.client.0.smithi098.stdout:5/114: dwrite dc/d1c/f24 [0,4194304] 0 2024-09-19T07:24:50.122 INFO:tasks.workunit.client.0.smithi098.stdout:7/132: dwrite d5/d8/f9 [0,4194304] 0 2024-09-19T07:24:50.123 INFO:tasks.workunit.client.0.smithi098.stdout:1/52: rename f4 to dc/f12 0 2024-09-19T07:24:50.124 INFO:tasks.workunit.client.0.smithi098.stdout:3/138: dwrite f4 [0,4194304] 0 2024-09-19T07:24:50.124 INFO:tasks.workunit.client.0.smithi098.stdout:3/139: chown de/f19 5459 1 2024-09-19T07:24:50.128 INFO:tasks.workunit.client.0.smithi098.stdout:7/133: truncate d5/d8/fa 3268250 0 2024-09-19T07:24:50.128 INFO:tasks.workunit.client.0.smithi098.stdout:3/140: read fc [213313,41491] 0 2024-09-19T07:24:50.128 INFO:tasks.workunit.client.0.smithi098.stdout:3/141: chown de/l24 59914469 1 2024-09-19T07:24:50.130 INFO:tasks.workunit.client.0.smithi098.stdout:7/134: mknod d5/c23 0 2024-09-19T07:24:50.132 INFO:tasks.workunit.client.0.smithi098.stdout:3/142: getdents de 0 2024-09-19T07:24:50.132 INFO:tasks.workunit.client.0.smithi098.stdout:3/143: stat fc 0 2024-09-19T07:24:50.133 INFO:tasks.workunit.client.0.smithi098.stdout:7/135: creat d5/d8/f24 x:0 0 0 2024-09-19T07:24:50.136 INFO:tasks.workunit.client.0.smithi098.stdout:3/144: creat de/f28 x:0 0 0 2024-09-19T07:24:50.143 INFO:tasks.workunit.client.0.smithi098.stdout:3/145: dread fc [0,4194304] 0 2024-09-19T07:24:50.143 INFO:tasks.workunit.client.0.smithi098.stdout:2/13: sync 2024-09-19T07:24:50.143 INFO:tasks.workunit.client.0.smithi098.stdout:2/14: fdatasync - no filename 2024-09-19T07:24:50.143 INFO:tasks.workunit.client.0.smithi098.stdout:2/15: write - no filename 2024-09-19T07:24:50.143 INFO:tasks.workunit.client.0.smithi098.stdout:2/16: write - no filename 2024-09-19T07:24:50.144 INFO:tasks.workunit.client.0.smithi098.stdout:3/146: rmdir de 39 2024-09-19T07:24:50.146 INFO:tasks.workunit.client.0.smithi098.stdout:6/50: dwrite d2/fc [0,4194304] 0 2024-09-19T07:24:50.146 INFO:tasks.workunit.client.0.smithi098.stdout:6/51: chown d2/c8 48014964 1 2024-09-19T07:24:50.146 INFO:tasks.workunit.client.0.smithi098.stdout:3/147: creat de/df/f29 x:0 0 0 2024-09-19T07:24:50.147 INFO:tasks.workunit.client.0.smithi098.stdout:6/52: creat d2/fe x:0 0 0 2024-09-19T07:24:50.147 INFO:tasks.workunit.client.0.smithi098.stdout:6/53: dread - d2/fb zero size 2024-09-19T07:24:50.147 INFO:tasks.workunit.client.0.smithi098.stdout:6/54: dread - d2/fe zero size 2024-09-19T07:24:50.148 INFO:tasks.workunit.client.0.smithi098.stdout:1/53: dwrite f1 [0,4194304] 0 2024-09-19T07:24:50.148 INFO:tasks.workunit.client.0.smithi098.stdout:1/54: chown fa 80539527 1 2024-09-19T07:24:50.148 INFO:tasks.workunit.client.0.smithi098.stdout:1/55: fsync f1 0 2024-09-19T07:24:50.148 INFO:tasks.workunit.client.0.smithi098.stdout:3/148: symlink de/l2a 0 2024-09-19T07:24:50.150 INFO:tasks.workunit.client.0.smithi098.stdout:1/56: creat dc/de/f13 x:0 0 0 2024-09-19T07:24:50.150 INFO:tasks.workunit.client.0.smithi098.stdout:7/136: dwrite d5/d8/dc/d16/f1e [0,4194304] 0 2024-09-19T07:24:50.161 INFO:tasks.workunit.client.0.smithi098.stdout:7/137: write d5/d8/dc/d16/f1e [1542503,6570] 0 2024-09-19T07:24:50.163 INFO:tasks.workunit.client.0.smithi098.stdout:7/138: symlink d5/d8/dc/d16/l25 0 2024-09-19T07:24:50.164 INFO:tasks.workunit.client.0.smithi098.stdout:7/139: creat d5/d10/f26 x:0 0 0 2024-09-19T07:24:50.164 INFO:tasks.workunit.client.0.smithi098.stdout:1/57: write f1 [2968463,67363] 0 2024-09-19T07:24:50.165 INFO:tasks.workunit.client.0.smithi098.stdout:1/58: symlink dc/l14 0 2024-09-19T07:24:50.165 INFO:tasks.workunit.client.0.smithi098.stdout:1/59: chown l6 1 1 2024-09-19T07:24:50.166 INFO:tasks.workunit.client.0.smithi098.stdout:1/60: link cb dc/de/c15 0 2024-09-19T07:24:50.167 INFO:tasks.workunit.client.0.smithi098.stdout:1/61: truncate fa 551251 0 2024-09-19T07:24:50.167 INFO:tasks.workunit.client.0.smithi098.stdout:1/62: write dc/f12 [1613079,107168] 0 2024-09-19T07:24:50.171 INFO:tasks.workunit.client.0.smithi098.stdout:6/55: dwrite d2/fc [4194304,4194304] 0 2024-09-19T07:24:50.173 INFO:tasks.workunit.client.0.smithi098.stdout:1/63: dread dc/f12 [0,4194304] 0 2024-09-19T07:24:50.173 INFO:tasks.workunit.client.0.smithi098.stdout:1/64: dread - dc/de/f13 zero size 2024-09-19T07:24:50.174 INFO:tasks.workunit.client.0.smithi098.stdout:6/56: symlink d2/d5/lf 0 2024-09-19T07:24:50.175 INFO:tasks.workunit.client.0.smithi098.stdout:1/65: link l2 dc/l16 0 2024-09-19T07:24:50.176 INFO:tasks.workunit.client.0.smithi098.stdout:6/57: rename d2/c8 to d2/d5/c10 0 2024-09-19T07:24:50.178 INFO:tasks.workunit.client.0.smithi098.stdout:1/66: mkdir dc/d17 0 2024-09-19T07:24:50.179 INFO:tasks.workunit.client.0.smithi098.stdout:1/67: dread fa [0,4194304] 0 2024-09-19T07:24:50.179 INFO:tasks.workunit.client.0.smithi098.stdout:1/68: fsync fa 0 2024-09-19T07:24:50.180 INFO:tasks.workunit.client.0.smithi098.stdout:1/69: mknod dc/c18 0 2024-09-19T07:24:50.180 INFO:tasks.workunit.client.0.smithi098.stdout:1/70: chown dc/de/f13 2269 1 2024-09-19T07:24:50.180 INFO:tasks.workunit.client.0.smithi098.stdout:1/71: chown dc 81399217 1 2024-09-19T07:24:50.181 INFO:tasks.workunit.client.0.smithi098.stdout:1/72: truncate f1 52083 0 2024-09-19T07:24:50.181 INFO:tasks.workunit.client.0.smithi098.stdout:1/73: fdatasync fa 0 2024-09-19T07:24:50.198 INFO:tasks.workunit.client.0.smithi098.stdout:0/89: sync 2024-09-19T07:24:50.198 INFO:tasks.workunit.client.0.smithi098.stdout:0/90: stat d5/d9/f12 0 2024-09-19T07:24:50.199 INFO:tasks.workunit.client.0.smithi098.stdout:0/91: mknod d5/c19 0 2024-09-19T07:24:50.199 INFO:tasks.workunit.client.0.smithi098.stdout:0/92: write d5/f18 [969331,84504] 0 2024-09-19T07:24:50.201 INFO:tasks.workunit.client.0.smithi098.stdout:0/93: symlink d5/l1a 0 2024-09-19T07:24:50.201 INFO:tasks.workunit.client.0.smithi098.stdout:0/94: getdents d5/d9/d14 0 2024-09-19T07:24:50.202 INFO:tasks.workunit.client.0.smithi098.stdout:0/95: creat d5/d9/f1b x:0 0 0 2024-09-19T07:24:50.205 INFO:tasks.workunit.client.0.smithi098.stdout:0/96: dread d5/f7 [0,4194304] 0 2024-09-19T07:24:50.206 INFO:tasks.workunit.client.0.smithi098.stdout:0/97: mknod d5/d9/d14/c1c 0 2024-09-19T07:24:50.207 INFO:tasks.workunit.client.0.smithi098.stdout:0/98: unlink d5/d9/fb 0 2024-09-19T07:24:50.210 INFO:tasks.workunit.client.0.smithi098.stdout:0/99: getdents d5 0 2024-09-19T07:24:50.211 INFO:tasks.workunit.client.0.smithi098.stdout:0/100: mkdir d5/d1d 0 2024-09-19T07:24:50.216 INFO:tasks.workunit.client.0.smithi098.stdout:0/101: dread d5/f7 [0,4194304] 0 2024-09-19T07:24:50.216 INFO:tasks.workunit.client.0.smithi098.stdout:0/102: truncate d5/d9/f1b 646726 0 2024-09-19T07:24:50.217 INFO:tasks.workunit.client.0.smithi098.stdout:0/103: rmdir d5 39 2024-09-19T07:24:50.218 INFO:tasks.workunit.client.0.smithi098.stdout:0/104: creat d5/f1e x:0 0 0 2024-09-19T07:24:50.218 INFO:tasks.workunit.client.0.smithi098.stdout:0/105: chown d5/fe 2531 1 2024-09-19T07:24:50.218 INFO:tasks.workunit.client.0.smithi098.stdout:0/106: dread - d5/f1e zero size 2024-09-19T07:24:50.242 INFO:tasks.workunit.client.0.smithi098.stdout:0/107: dwrite d5/f1e [0,4194304] 0 2024-09-19T07:24:50.242 INFO:tasks.workunit.client.0.smithi098.stdout:0/108: write d5/d9/f10 [4630845,76787] 0 2024-09-19T07:24:50.258 INFO:tasks.workunit.client.0.smithi098.stdout:0/109: dwrite d5/d9/f12 [0,4194304] 0 2024-09-19T07:24:50.261 INFO:tasks.workunit.client.0.smithi098.stdout:8/90: sync 2024-09-19T07:24:50.261 INFO:tasks.workunit.client.0.smithi098.stdout:4/82: sync 2024-09-19T07:24:50.261 INFO:tasks.workunit.client.0.smithi098.stdout:9/103: sync 2024-09-19T07:24:50.261 INFO:tasks.workunit.client.0.smithi098.stdout:8/91: stat d0/d16/c1d 0 2024-09-19T07:24:50.261 INFO:tasks.workunit.client.0.smithi098.stdout:8/92: fdatasync d0/fc 0 2024-09-19T07:24:50.262 INFO:tasks.workunit.client.0.smithi098.stdout:4/83: symlink da/l1a 0 2024-09-19T07:24:50.262 INFO:tasks.workunit.client.0.smithi098.stdout:4/84: write f8 [4412523,84869] 0 2024-09-19T07:24:50.263 INFO:tasks.workunit.client.0.smithi098.stdout:9/104: creat d3/dc/df/d15/f25 x:0 0 0 2024-09-19T07:24:50.263 INFO:tasks.workunit.client.0.smithi098.stdout:9/105: write d3/dc/df/d15/f25 [409088,68030] 0 2024-09-19T07:24:50.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:50.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f62 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl03.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f64 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f63 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl02.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f65 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f4d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f4f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget03.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f4c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f4b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget05.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000001f4e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget02.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] up:active 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:50.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000025ab (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_hostname.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000025a6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_chroot.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000025a9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_rawio.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000025a8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000025aa (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_nice.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000025a7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_capable_sys.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:50.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:50.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:50.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:49 smithi098 ceph-mon[30950]: pgmap v86: 97 pgs: 97 active+clean; 212 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 25 MiB/s wr, 2.49k op/s 2024-09-19T07:24:50.278 INFO:tasks.workunit.client.0.smithi098.stdout:4/85: dwrite da/fd [0,4194304] 0 2024-09-19T07:24:50.294 INFO:tasks.workunit.client.0.smithi098.stdout:8/93: dwrite d0/de/f18 [0,4194304] 0 2024-09-19T07:24:50.294 INFO:tasks.workunit.client.0.smithi098.stdout:0/110: dwrite f4 [0,4194304] 0 2024-09-19T07:24:50.294 INFO:tasks.workunit.client.0.smithi098.stdout:0/111: chown d5/d9/f10 62206 1 2024-09-19T07:24:50.294 INFO:tasks.workunit.client.0.smithi098.stdout:8/94: truncate d0/d16/f17 787242 0 2024-09-19T07:24:50.294 INFO:tasks.workunit.client.0.smithi098.stdout:8/95: chown d0/de/d12/l1b 1894 1 2024-09-19T07:24:50.296 INFO:tasks.workunit.client.0.smithi098.stdout:9/106: dwrite d3/dc/df/d15/f25 [0,4194304] 0 2024-09-19T07:24:50.302 INFO:tasks.workunit.client.0.smithi098.stdout:4/86: dwrite da/f16 [0,4194304] 0 2024-09-19T07:24:50.305 INFO:tasks.workunit.client.0.smithi098.stdout:2/17: sync 2024-09-19T07:24:50.305 INFO:tasks.workunit.client.0.smithi098.stdout:5/115: sync 2024-09-19T07:24:50.306 INFO:tasks.workunit.client.0.smithi098.stdout:5/116: mkdir dc/d1c/d2e 0 2024-09-19T07:24:50.306 INFO:tasks.workunit.client.0.smithi098.stdout:2/18: mknod d1/c6 0 2024-09-19T07:24:50.307 INFO:tasks.workunit.client.0.smithi098.stdout:2/19: dwrite - no filename 2024-09-19T07:24:50.307 INFO:tasks.workunit.client.0.smithi098.stdout:2/20: write - no filename 2024-09-19T07:24:50.307 INFO:tasks.workunit.client.0.smithi098.stdout:2/21: read - no filename 2024-09-19T07:24:50.307 INFO:tasks.workunit.client.0.smithi098.stdout:2/22: dwrite - no filename 2024-09-19T07:24:50.307 INFO:tasks.workunit.client.0.smithi098.stdout:2/23: dwrite - no filename 2024-09-19T07:24:50.310 INFO:tasks.workunit.client.0.smithi098.stdout:2/24: mknod d1/d5/c7 0 2024-09-19T07:24:50.311 INFO:tasks.workunit.client.0.smithi098.stdout:9/107: dwrite d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:50.312 INFO:tasks.workunit.client.0.smithi098.stdout:2/25: creat d1/f8 x:0 0 0 2024-09-19T07:24:50.313 INFO:tasks.workunit.client.0.smithi098.stdout:2/26: mkdir d1/d9 0 2024-09-19T07:24:50.314 INFO:tasks.workunit.client.0.smithi098.stdout:0/112: dread d5/f1e [0,4194304] 0 2024-09-19T07:24:50.314 INFO:tasks.workunit.client.0.smithi098.stdout:2/27: mkdir d1/da 0 2024-09-19T07:24:50.315 INFO:tasks.workunit.client.0.smithi098.stdout:0/113: mkdir d5/d9/d1f 0 2024-09-19T07:24:50.316 INFO:tasks.workunit.client.0.smithi098.stdout:2/28: mkdir d1/da/db 0 2024-09-19T07:24:50.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:50.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f62 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl03.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f64 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f63 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl02.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f65 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f4d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f4f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget03.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f4c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f4b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget05.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000001f4e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget02.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:50.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] up:active 2024-09-19T07:24:50.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:50.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:50.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:50.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:50.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000025ab (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_hostname.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000025a6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_chroot.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000025a9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_rawio.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000025a8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000025aa (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_nice.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000025a7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_capable_sys.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:50.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:50.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:50.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.320 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:49 smithi139 ceph-mon[35039]: pgmap v86: 97 pgs: 97 active+clean; 212 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 25 MiB/s wr, 2.49k op/s 2024-09-19T07:24:50.321 INFO:tasks.workunit.client.0.smithi098.stdout:0/114: truncate d5/d9/f10 627737 0 2024-09-19T07:24:50.321 INFO:tasks.workunit.client.0.smithi098.stdout:2/29: creat d1/da/fc x:0 0 0 2024-09-19T07:24:50.321 INFO:tasks.workunit.client.0.smithi098.stdout:2/30: write d1/f8 [734025,47362] 0 2024-09-19T07:24:50.321 INFO:tasks.workunit.client.0.smithi098.stdout:4/87: read da/fc [1623890,60537] 0 2024-09-19T07:24:50.322 INFO:tasks.workunit.client.0.smithi098.stdout:0/115: rmdir d5/d1d 0 2024-09-19T07:24:50.322 INFO:tasks.workunit.client.0.smithi098.stdout:9/108: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:50.322 INFO:tasks.workunit.client.0.smithi098.stdout:9/109: fdatasync d3/dc/df/f21 0 2024-09-19T07:24:50.322 INFO:tasks.workunit.client.0.smithi098.stdout:2/31: unlink d1/da/fc 0 2024-09-19T07:24:50.322 INFO:tasks.workunit.client.0.smithi098.stdout:4/88: mknod da/c1b 0 2024-09-19T07:24:50.323 INFO:tasks.workunit.client.0.smithi098.stdout:4/89: stat da/f14 0 2024-09-19T07:24:50.323 INFO:tasks.workunit.client.0.smithi098.stdout:4/90: readlink da/lf 0 2024-09-19T07:24:50.323 INFO:tasks.workunit.client.0.smithi098.stdout:2/32: write d1/f8 [231153,59633] 0 2024-09-19T07:24:50.323 INFO:tasks.workunit.client.0.smithi098.stdout:2/33: chown d1/da 12 1 2024-09-19T07:24:50.324 INFO:tasks.workunit.client.0.smithi098.stdout:4/91: creat da/f1c x:0 0 0 2024-09-19T07:24:50.324 INFO:tasks.workunit.client.0.smithi098.stdout:2/34: creat d1/da/db/fd x:0 0 0 2024-09-19T07:24:50.324 INFO:tasks.workunit.client.0.smithi098.stdout:2/35: stat d1 0 2024-09-19T07:24:50.324 INFO:tasks.workunit.client.0.smithi098.stdout:2/36: write d1/f8 [1617255,41117] 0 2024-09-19T07:24:50.324 INFO:tasks.workunit.client.0.smithi098.stdout:2/37: readlink d1/l3 0 2024-09-19T07:24:50.325 INFO:tasks.workunit.client.0.smithi098.stdout:5/117: dwrite dc/d1c/f24 [0,4194304] 0 2024-09-19T07:24:50.325 INFO:tasks.workunit.client.0.smithi098.stdout:5/118: stat dc/f29 0 2024-09-19T07:24:50.325 INFO:tasks.workunit.client.0.smithi098.stdout:4/92: rename da/f14 to da/f1d 0 2024-09-19T07:24:50.329 INFO:tasks.workunit.client.0.smithi098.stdout:5/119: creat dc/d1c/d2e/f2f x:0 0 0 2024-09-19T07:24:50.333 INFO:tasks.workunit.client.0.smithi098.stdout:5/120: truncate fa 2619717 0 2024-09-19T07:24:50.333 INFO:tasks.workunit.client.0.smithi098.stdout:2/38: getdents d1/da 0 2024-09-19T07:24:50.333 INFO:tasks.workunit.client.0.smithi098.stdout:2/39: chown d1/da/db 21 1 2024-09-19T07:24:50.335 INFO:tasks.workunit.client.0.smithi098.stdout:2/40: creat d1/d5/fe x:0 0 0 2024-09-19T07:24:50.337 INFO:tasks.workunit.client.0.smithi098.stdout:2/41: mknod d1/cf 0 2024-09-19T07:24:50.338 INFO:tasks.workunit.client.0.smithi098.stdout:0/116: rename d5/d9 to d5/d20 0 2024-09-19T07:24:50.339 INFO:tasks.workunit.client.0.smithi098.stdout:0/117: symlink d5/d20/d1f/l21 0 2024-09-19T07:24:50.341 INFO:tasks.workunit.client.0.smithi098.stdout:9/110: dwrite d3/dc/df/f21 [0,4194304] 0 2024-09-19T07:24:50.341 INFO:tasks.workunit.client.0.smithi098.stdout:9/111: fdatasync d3/dc/df/f21 0 2024-09-19T07:24:50.352 INFO:tasks.workunit.client.0.smithi098.stdout:4/93: dwrite da/f1c [0,4194304] 0 2024-09-19T07:24:50.352 INFO:tasks.workunit.client.0.smithi098.stdout:9/112: write d3/dc/df/f21 [1004909,41129] 0 2024-09-19T07:24:50.353 INFO:tasks.workunit.client.0.smithi098.stdout:4/94: creat da/f1e x:0 0 0 2024-09-19T07:24:50.354 INFO:tasks.workunit.client.0.smithi098.stdout:4/95: stat l2 0 2024-09-19T07:24:50.355 INFO:tasks.workunit.client.0.smithi098.stdout:4/96: rename da/fc to da/f1f 0 2024-09-19T07:24:50.356 INFO:tasks.workunit.client.0.smithi098.stdout:4/97: rename da/c18 to da/c20 0 2024-09-19T07:24:50.356 INFO:tasks.workunit.client.0.smithi098.stdout:4/98: write da/f11 [1031849,87419] 0 2024-09-19T07:24:50.357 INFO:tasks.workunit.client.0.smithi098.stdout:5/121: dwrite f3 [0,4194304] 0 2024-09-19T07:24:50.357 INFO:tasks.workunit.client.0.smithi098.stdout:5/122: chown dc/d1c 428 1 2024-09-19T07:24:50.364 INFO:tasks.workunit.client.0.smithi098.stdout:9/113: dread d3/dc/df/f21 [0,4194304] 0 2024-09-19T07:24:50.364 INFO:tasks.workunit.client.0.smithi098.stdout:9/114: readlink d3/d6/ld 0 2024-09-19T07:24:50.365 INFO:tasks.workunit.client.0.smithi098.stdout:9/115: creat d3/d16/d1f/f26 x:0 0 0 2024-09-19T07:24:50.366 INFO:tasks.workunit.client.0.smithi098.stdout:9/116: rename d3/dc/df/c24 to d3/dc/df/d15/d1a/c27 0 2024-09-19T07:24:50.369 INFO:tasks.workunit.client.0.smithi098.stdout:0/118: dwrite d5/f18 [0,4194304] 0 2024-09-19T07:24:50.369 INFO:tasks.workunit.client.0.smithi098.stdout:2/42: dwrite d1/f8 [0,4194304] 0 2024-09-19T07:24:50.369 INFO:tasks.workunit.client.0.smithi098.stdout:9/117: write d3/dc/f19 [1096185,100179] 0 2024-09-19T07:24:50.372 INFO:tasks.workunit.client.0.smithi098.stdout:4/99: getdents da 0 2024-09-19T07:24:50.375 INFO:tasks.workunit.client.0.smithi098.stdout:9/118: creat d3/dc/df/d15/f28 x:0 0 0 2024-09-19T07:24:50.376 INFO:tasks.workunit.client.0.smithi098.stdout:0/119: write d5/f1e [504644,80314] 0 2024-09-19T07:24:50.376 INFO:tasks.workunit.client.0.smithi098.stdout:0/120: truncate d5/f18 4589686 0 2024-09-19T07:24:50.376 INFO:tasks.workunit.client.0.smithi098.stdout:9/119: creat d3/dc/df/d15/d1b/f29 x:0 0 0 2024-09-19T07:24:50.377 INFO:tasks.workunit.client.0.smithi098.stdout:0/121: creat d5/f22 x:0 0 0 2024-09-19T07:24:50.378 INFO:tasks.workunit.client.0.smithi098.stdout:9/120: creat d3/dc/df/f2a x:0 0 0 2024-09-19T07:24:50.378 INFO:tasks.workunit.client.0.smithi098.stdout:9/121: readlink d3/d6/d8/l23 0 2024-09-19T07:24:50.379 INFO:tasks.workunit.client.0.smithi098.stdout:9/122: mkdir d3/dc/df/d15/d1a/d2b 0 2024-09-19T07:24:50.381 INFO:tasks.workunit.client.0.smithi098.stdout:7/140: sync 2024-09-19T07:24:50.381 INFO:tasks.workunit.client.0.smithi098.stdout:3/149: sync 2024-09-19T07:24:50.381 INFO:tasks.workunit.client.0.smithi098.stdout:3/150: stat f0 0 2024-09-19T07:24:50.381 INFO:tasks.workunit.client.0.smithi098.stdout:5/123: dwrite dc/d1c/d2e/f2f [0,4194304] 0 2024-09-19T07:24:50.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:50.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f62 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl03.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f64 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f63 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl02.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f65 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f4d (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget01.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f4f (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget03.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f4c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f4b (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget05.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000001f4e (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget02.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] up:active 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:50.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000025ab (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_hostname.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000025a6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_chroot.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000025a9 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_rawio.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000025a8 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/Makefile) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000025aa (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_nice.c) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000025a7 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_capable_sys.sh) see mds.h log and `damage ls` output for details 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:50.385 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.385 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:50.385 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.385 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:50.385 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:50.385 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:49 smithi162 ceph-mon[35726]: pgmap v86: 97 pgs: 97 active+clean; 212 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 25 MiB/s wr, 2.49k op/s 2024-09-19T07:24:50.386 INFO:tasks.workunit.client.0.smithi098.stdout:7/141: link d5/f7 d5/d8/dc/d16/f27 0 2024-09-19T07:24:50.386 INFO:tasks.workunit.client.0.smithi098.stdout:6/58: sync 2024-09-19T07:24:50.386 INFO:tasks.workunit.client.0.smithi098.stdout:1/74: sync 2024-09-19T07:24:50.386 INFO:tasks.workunit.client.0.smithi098.stdout:6/59: write d2/fe [532744,120542] 0 2024-09-19T07:24:50.386 INFO:tasks.workunit.client.0.smithi098.stdout:4/100: write f8 [132696,33452] 0 2024-09-19T07:24:50.386 INFO:tasks.workunit.client.0.smithi098.stdout:7/142: rename d5/d8/f9 to d5/f28 0 2024-09-19T07:24:50.386 INFO:tasks.workunit.client.0.smithi098.stdout:1/75: stat l2 0 2024-09-19T07:24:50.387 INFO:tasks.workunit.client.0.smithi098.stdout:6/60: mkdir d2/d11 0 2024-09-19T07:24:50.387 INFO:tasks.workunit.client.0.smithi098.stdout:4/101: symlink da/l21 0 2024-09-19T07:24:50.388 INFO:tasks.workunit.client.0.smithi098.stdout:7/143: mkdir d5/d10/d11/d29 0 2024-09-19T07:24:50.388 INFO:tasks.workunit.client.0.smithi098.stdout:7/144: chown d5/lb 52930 1 2024-09-19T07:24:50.389 INFO:tasks.workunit.client.0.smithi098.stdout:1/76: symlink dc/d17/l19 0 2024-09-19T07:24:50.389 INFO:tasks.workunit.client.0.smithi098.stdout:1/77: fsync dc/de/f13 0 2024-09-19T07:24:50.389 INFO:tasks.workunit.client.0.smithi098.stdout:6/61: symlink d2/d11/l12 0 2024-09-19T07:24:50.389 INFO:tasks.workunit.client.0.smithi098.stdout:6/62: chown d2/d11 48 1 2024-09-19T07:24:50.391 INFO:tasks.workunit.client.0.smithi098.stdout:4/102: rename da/c13 to da/c22 0 2024-09-19T07:24:50.392 INFO:tasks.workunit.client.0.smithi098.stdout:7/145: creat d5/d10/d1d/f2a x:0 0 0 2024-09-19T07:24:50.396 INFO:tasks.workunit.client.0.smithi098.stdout:1/78: link dc/l16 dc/l1a 0 2024-09-19T07:24:50.396 INFO:tasks.workunit.client.0.smithi098.stdout:1/79: read - dc/de/f13 zero size 2024-09-19T07:24:50.396 INFO:tasks.workunit.client.0.smithi098.stdout:1/80: read dc/f12 [2454614,129832] 0 2024-09-19T07:24:50.397 INFO:tasks.workunit.client.0.smithi098.stdout:4/103: rmdir da 39 2024-09-19T07:24:50.397 INFO:tasks.workunit.client.0.smithi098.stdout:4/104: write da/f1e [247507,12654] 0 2024-09-19T07:24:50.397 INFO:tasks.workunit.client.0.smithi098.stdout:4/105: creat da/f23 x:0 0 0 2024-09-19T07:24:50.398 INFO:tasks.workunit.client.0.smithi098.stdout:4/106: link da/l17 da/l24 0 2024-09-19T07:24:50.403 INFO:tasks.workunit.client.0.smithi098.stdout:6/63: dread f1 [0,4194304] 0 2024-09-19T07:24:50.403 INFO:tasks.workunit.client.0.smithi098.stdout:6/64: rename d2 to d2/d11/d13 22 2024-09-19T07:24:50.405 INFO:tasks.workunit.client.0.smithi098.stdout:6/65: creat d2/d5/f14 x:0 0 0 2024-09-19T07:24:50.407 INFO:tasks.workunit.client.0.smithi098.stdout:6/66: mknod d2/d5/c15 0 2024-09-19T07:24:50.408 INFO:tasks.workunit.client.0.smithi098.stdout:9/123: dwrite d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:50.409 INFO:tasks.workunit.client.0.smithi098.stdout:9/124: truncate d3/dc/df/d15/f28 995418 0 2024-09-19T07:24:50.409 INFO:tasks.workunit.client.0.smithi098.stdout:6/67: link d2/fe d2/d5/f16 0 2024-09-19T07:24:50.409 INFO:tasks.workunit.client.0.smithi098.stdout:6/68: write f1 [2063904,93294] 0 2024-09-19T07:24:50.409 INFO:tasks.workunit.client.0.smithi098.stdout:6/69: write d2/d5/f14 [901680,47630] 0 2024-09-19T07:24:50.410 INFO:tasks.workunit.client.0.smithi098.stdout:6/70: write d2/fe [668927,31638] 0 2024-09-19T07:24:50.413 INFO:tasks.workunit.client.0.smithi098.stdout:3/151: dwrite fc [0,4194304] 0 2024-09-19T07:24:50.413 INFO:tasks.workunit.client.0.smithi098.stdout:3/152: write de/df/f15 [586070,12026] 0 2024-09-19T07:24:50.415 INFO:tasks.workunit.client.0.smithi098.stdout:3/153: mkdir de/df/d1f/d2b 0 2024-09-19T07:24:50.416 INFO:tasks.workunit.client.0.smithi098.stdout:3/154: creat de/df/f2c x:0 0 0 2024-09-19T07:24:50.418 INFO:tasks.workunit.client.0.smithi098.stdout:3/155: getdents de 0 2024-09-19T07:24:50.419 INFO:tasks.workunit.client.0.smithi098.stdout:3/156: unlink l1 0 2024-09-19T07:24:50.419 INFO:tasks.workunit.client.0.smithi098.stdout:5/124: dwrite f5 [0,4194304] 0 2024-09-19T07:24:50.420 INFO:tasks.workunit.client.0.smithi098.stdout:3/157: truncate f5 118392 0 2024-09-19T07:24:50.422 INFO:tasks.workunit.client.0.smithi098.stdout:1/81: dwrite fa [0,4194304] 0 2024-09-19T07:24:50.431 INFO:tasks.workunit.client.0.smithi098.stdout:5/125: write f5 [3878130,26620] 0 2024-09-19T07:24:50.436 INFO:tasks.workunit.client.0.smithi098.stdout:4/107: dwrite da/f1d [0,4194304] 0 2024-09-19T07:24:50.437 INFO:tasks.workunit.client.0.smithi098.stdout:9/125: dwrite d3/dc/df/d15/f25 [0,4194304] 0 2024-09-19T07:24:50.437 INFO:tasks.workunit.client.0.smithi098.stdout:9/126: chown d3/dc/df/d15/d1a/d2b 293100713 1 2024-09-19T07:24:50.437 INFO:tasks.workunit.client.0.smithi098.stdout:9/127: read - d3/d16/d1f/f26 zero size 2024-09-19T07:24:50.439 INFO:tasks.workunit.client.0.smithi098.stdout:9/128: rename d3/c4 to d3/dc/df/c2c 0 2024-09-19T07:24:50.445 INFO:tasks.workunit.client.0.smithi098.stdout:1/82: dwrite dc/f12 [0,4194304] 0 2024-09-19T07:24:50.446 INFO:tasks.workunit.client.0.smithi098.stdout:1/83: dread - dc/de/f13 zero size 2024-09-19T07:24:50.446 INFO:tasks.workunit.client.0.smithi098.stdout:9/129: mkdir d3/dc/df/d15/d1a/d2d 0 2024-09-19T07:24:50.446 INFO:tasks.workunit.client.0.smithi098.stdout:4/108: write da/f16 [41783,114941] 0 2024-09-19T07:24:50.446 INFO:tasks.workunit.client.0.smithi098.stdout:4/109: write da/f1f [94971,62299] 0 2024-09-19T07:24:50.448 INFO:tasks.workunit.client.0.smithi098.stdout:1/84: mkdir dc/d17/d1b 0 2024-09-19T07:24:50.450 INFO:tasks.workunit.client.0.smithi098.stdout:1/85: rename c8 to dc/d17/d1b/c1c 0 2024-09-19T07:24:50.451 INFO:tasks.workunit.client.0.smithi098.stdout:1/86: dread - dc/de/f13 zero size 2024-09-19T07:24:50.451 INFO:tasks.workunit.client.0.smithi098.stdout:4/110: rmdir da 39 2024-09-19T07:24:50.452 INFO:tasks.workunit.client.0.smithi098.stdout:4/111: chown da/f1e 3 1 2024-09-19T07:24:50.454 INFO:tasks.workunit.client.0.smithi098.stdout:1/87: mkdir dc/d17/d1b/d1d 0 2024-09-19T07:24:50.454 INFO:tasks.workunit.client.0.smithi098.stdout:1/88: dread - dc/de/f13 zero size 2024-09-19T07:24:50.454 INFO:tasks.workunit.client.0.smithi098.stdout:1/89: write fa [4373936,36268] 0 2024-09-19T07:24:50.455 INFO:tasks.workunit.client.0.smithi098.stdout:4/112: mknod da/c25 0 2024-09-19T07:24:50.458 INFO:tasks.workunit.client.0.smithi098.stdout:4/113: rename l6 to da/l26 0 2024-09-19T07:24:50.458 INFO:tasks.workunit.client.0.smithi098.stdout:4/114: stat c7 0 2024-09-19T07:24:50.458 INFO:tasks.workunit.client.0.smithi098.stdout:4/115: chown da/fb 3680451 1 2024-09-19T07:24:50.459 INFO:tasks.workunit.client.0.smithi098.stdout:4/116: rename da/l21 to da/l27 0 2024-09-19T07:24:50.461 INFO:tasks.workunit.client.0.smithi098.stdout:4/117: unlink l4 0 2024-09-19T07:24:50.462 INFO:tasks.workunit.client.0.smithi098.stdout:1/90: dread dc/f12 [0,4194304] 0 2024-09-19T07:24:50.462 INFO:tasks.workunit.client.0.smithi098.stdout:9/130: dread d3/dc/df/d15/f25 [0,4194304] 0 2024-09-19T07:24:50.463 INFO:tasks.workunit.client.0.smithi098.stdout:9/131: creat d3/d16/d1f/f2e x:0 0 0 2024-09-19T07:24:50.463 INFO:tasks.workunit.client.0.smithi098.stdout:9/132: getdents d3/dc/df/d15/d1a/d2b 0 2024-09-19T07:24:50.464 INFO:tasks.workunit.client.0.smithi098.stdout:9/133: chown d3/dc/df/f21 453954 1 2024-09-19T07:24:50.464 INFO:tasks.workunit.client.0.smithi098.stdout:5/126: dwrite dc/f12 [0,4194304] 0 2024-09-19T07:24:50.465 INFO:tasks.workunit.client.0.smithi098.stdout:6/71: dwrite d2/fe [0,4194304] 0 2024-09-19T07:24:50.465 INFO:tasks.workunit.client.0.smithi098.stdout:9/134: mkdir d3/dc/df/d15/d2f 0 2024-09-19T07:24:50.466 INFO:tasks.workunit.client.0.smithi098.stdout:5/127: rmdir dc/de/d13 39 2024-09-19T07:24:50.466 INFO:tasks.workunit.client.0.smithi098.stdout:5/128: fsync f3 0 2024-09-19T07:24:50.466 INFO:tasks.workunit.client.0.smithi098.stdout:1/91: dread dc/f12 [0,4194304] 0 2024-09-19T07:24:50.466 INFO:tasks.workunit.client.0.smithi098.stdout:1/92: chown cb 321 1 2024-09-19T07:24:50.467 INFO:tasks.workunit.client.0.smithi098.stdout:9/135: mkdir d3/d30 0 2024-09-19T07:24:50.469 INFO:tasks.workunit.client.0.smithi098.stdout:9/136: unlink d3/dc/df/d15/f25 0 2024-09-19T07:24:50.469 INFO:tasks.workunit.client.0.smithi098.stdout:9/137: truncate d3/d16/d1f/f2e 582631 0 2024-09-19T07:24:50.469 INFO:tasks.workunit.client.0.smithi098.stdout:1/93: dread dc/f12 [0,4194304] 0 2024-09-19T07:24:50.470 INFO:tasks.workunit.client.0.smithi098.stdout:5/129: unlink dc/de/d13/c15 0 2024-09-19T07:24:50.470 INFO:tasks.workunit.client.0.smithi098.stdout:9/138: mkdir d3/dc/df/d31 0 2024-09-19T07:24:50.471 INFO:tasks.workunit.client.0.smithi098.stdout:9/139: chown d3/dc/df/d15/d1b/f29 15366 1 2024-09-19T07:24:50.471 INFO:tasks.workunit.client.0.smithi098.stdout:1/94: link dc/l1a dc/d17/l1e 0 2024-09-19T07:24:50.472 INFO:tasks.workunit.client.0.smithi098.stdout:5/130: rename dc/de/l10 to dc/de/l30 0 2024-09-19T07:24:50.478 INFO:tasks.workunit.client.0.smithi098.stdout:8/96: sync 2024-09-19T07:24:50.479 INFO:tasks.workunit.client.0.smithi098.stdout:8/97: fdatasync d0/de/f15 0 2024-09-19T07:24:50.479 INFO:tasks.workunit.client.0.smithi098.stdout:8/98: rmdir d0/d16 39 2024-09-19T07:24:50.479 INFO:tasks.workunit.client.0.smithi098.stdout:6/72: dread d2/fe [0,4194304] 0 2024-09-19T07:24:50.480 INFO:tasks.workunit.client.0.smithi098.stdout:1/95: write fa [1723501,128601] 0 2024-09-19T07:24:50.480 INFO:tasks.workunit.client.0.smithi098.stdout:6/73: mknod d2/c17 0 2024-09-19T07:24:50.481 INFO:tasks.workunit.client.0.smithi098.stdout:6/74: write d2/d5/f14 [361786,2342] 0 2024-09-19T07:24:50.482 INFO:tasks.workunit.client.0.smithi098.stdout:1/96: getdents dc/de 0 2024-09-19T07:24:50.483 INFO:tasks.workunit.client.0.smithi098.stdout:6/75: symlink d2/d11/l18 0 2024-09-19T07:24:50.484 INFO:tasks.workunit.client.0.smithi098.stdout:1/97: link cb dc/d17/c1f 0 2024-09-19T07:24:50.484 INFO:tasks.workunit.client.0.smithi098.stdout:1/98: readlink dc/l11 0 2024-09-19T07:24:50.485 INFO:tasks.workunit.client.0.smithi098.stdout:6/76: getdents d2/d5 0 2024-09-19T07:24:50.485 INFO:tasks.workunit.client.0.smithi098.stdout:5/131: dread f0 [0,4194304] 0 2024-09-19T07:24:50.485 INFO:tasks.workunit.client.0.smithi098.stdout:1/99: mknod dc/c20 0 2024-09-19T07:24:50.486 INFO:tasks.workunit.client.0.smithi098.stdout:6/77: mknod d2/d11/c19 0 2024-09-19T07:24:50.487 INFO:tasks.workunit.client.0.smithi098.stdout:4/118: dwrite da/f1f [0,4194304] 0 2024-09-19T07:24:50.487 INFO:tasks.workunit.client.0.smithi098.stdout:1/100: creat dc/de/f21 x:0 0 0 2024-09-19T07:24:50.488 INFO:tasks.workunit.client.0.smithi098.stdout:5/132: symlink dc/de/d13/l31 0 2024-09-19T07:24:50.491 INFO:tasks.workunit.client.0.smithi098.stdout:4/119: link da/fb da/f28 0 2024-09-19T07:24:50.491 INFO:tasks.workunit.client.0.smithi098.stdout:4/120: write f9 [1139835,19656] 0 2024-09-19T07:24:50.491 INFO:tasks.workunit.client.0.smithi098.stdout:4/121: chown da/lf 4 1 2024-09-19T07:24:50.492 INFO:tasks.workunit.client.0.smithi098.stdout:1/101: getdents dc/d17/d1b 0 2024-09-19T07:24:50.493 INFO:tasks.workunit.client.0.smithi098.stdout:6/78: write d2/fc [4720612,23522] 0 2024-09-19T07:24:50.493 INFO:tasks.workunit.client.0.smithi098.stdout:9/140: dwrite d3/dc/df/f2a [0,4194304] 0 2024-09-19T07:24:50.494 INFO:tasks.workunit.client.0.smithi098.stdout:8/99: dread d0/de/f18 [0,4194304] 0 2024-09-19T07:24:50.494 INFO:tasks.workunit.client.0.smithi098.stdout:8/100: fdatasync d0/fc 0 2024-09-19T07:24:50.494 INFO:tasks.workunit.client.0.smithi098.stdout:5/133: creat dc/d1c/d23/f32 x:0 0 0 2024-09-19T07:24:50.495 INFO:tasks.workunit.client.0.smithi098.stdout:4/122: mknod da/c29 0 2024-09-19T07:24:50.498 INFO:tasks.workunit.client.0.smithi098.stdout:6/79: creat d2/f1a x:0 0 0 2024-09-19T07:24:50.498 INFO:tasks.workunit.client.0.smithi098.stdout:6/80: fdatasync d2/d5/fa 0 2024-09-19T07:24:50.499 INFO:tasks.workunit.client.0.smithi098.stdout:1/102: truncate fa 2899814 0 2024-09-19T07:24:50.500 INFO:tasks.workunit.client.0.smithi098.stdout:6/81: mkdir d2/d1b 0 2024-09-19T07:24:50.501 INFO:tasks.workunit.client.0.smithi098.stdout:5/134: dread - dc/de/d13/f27 zero size 2024-09-19T07:24:50.501 INFO:tasks.workunit.client.0.smithi098.stdout:5/135: read - dc/de/d13/f27 zero size 2024-09-19T07:24:50.502 INFO:tasks.workunit.client.0.smithi098.stdout:6/82: mknod d2/d11/c1c 0 2024-09-19T07:24:50.502 INFO:tasks.workunit.client.0.smithi098.stdout:8/101: read d0/f7 [7113054,111299] 0 2024-09-19T07:24:50.502 INFO:tasks.workunit.client.0.smithi098.stdout:8/102: dread - d0/d1a/f1c zero size 2024-09-19T07:24:50.503 INFO:tasks.workunit.client.0.smithi098.stdout:8/103: write d0/de/f18 [4520858,20450] 0 2024-09-19T07:24:50.503 INFO:tasks.workunit.client.0.smithi098.stdout:6/83: creat d2/d1b/f1d x:0 0 0 2024-09-19T07:24:50.503 INFO:tasks.workunit.client.0.smithi098.stdout:6/84: write d2/d5/f14 [1488002,34406] 0 2024-09-19T07:24:50.505 INFO:tasks.workunit.client.0.smithi098.stdout:8/104: truncate d0/fc 4728861 0 2024-09-19T07:24:50.506 INFO:tasks.workunit.client.0.smithi098.stdout:6/85: rmdir d2/d1b 39 2024-09-19T07:24:50.508 INFO:tasks.workunit.client.0.smithi098.stdout:8/105: symlink d0/d1a/l1e 0 2024-09-19T07:24:50.509 INFO:tasks.workunit.client.0.smithi098.stdout:6/86: rename d2/d5/fa to d2/f1e 0 2024-09-19T07:24:50.510 INFO:tasks.workunit.client.0.smithi098.stdout:6/87: mkdir d2/d5/d1f 0 2024-09-19T07:24:50.510 INFO:tasks.workunit.client.0.smithi098.stdout:6/88: stat d2/d11/c1c 0 2024-09-19T07:24:50.512 INFO:tasks.workunit.client.0.smithi098.stdout:9/141: dwrite d3/dc/df/d15/f28 [0,4194304] 0 2024-09-19T07:24:50.513 INFO:tasks.workunit.client.0.smithi098.stdout:1/103: write fa [3462322,86338] 0 2024-09-19T07:24:50.516 INFO:tasks.workunit.client.0.smithi098.stdout:1/104: mkdir dc/de/d22 0 2024-09-19T07:24:50.516 INFO:tasks.workunit.client.0.smithi098.stdout:1/105: write f1 [492034,25775] 0 2024-09-19T07:24:50.523 INFO:tasks.workunit.client.0.smithi098.stdout:4/123: dwrite da/f1f [0,4194304] 0 2024-09-19T07:24:50.523 INFO:tasks.workunit.client.0.smithi098.stdout:9/142: dread d3/dc/df/f2a [0,4194304] 0 2024-09-19T07:24:50.524 INFO:tasks.workunit.client.0.smithi098.stdout:6/89: write d2/fe [11650,86436] 0 2024-09-19T07:24:50.524 INFO:tasks.workunit.client.0.smithi098.stdout:5/136: dwrite dc/de/f2c [0,4194304] 0 2024-09-19T07:24:50.524 INFO:tasks.workunit.client.0.smithi098.stdout:5/137: chown fa 51 1 2024-09-19T07:24:50.524 INFO:tasks.workunit.client.0.smithi098.stdout:9/143: unlink d3/d6/d8/ca 0 2024-09-19T07:24:50.526 INFO:tasks.workunit.client.0.smithi098.stdout:6/90: getdents d2/d1b 0 2024-09-19T07:24:50.528 INFO:tasks.workunit.client.0.smithi098.stdout:5/138: dread - dc/de/d13/f21 zero size 2024-09-19T07:24:50.529 INFO:tasks.workunit.client.0.smithi098.stdout:4/124: write da/f1c [3920385,87423] 0 2024-09-19T07:24:50.529 INFO:tasks.workunit.client.0.smithi098.stdout:6/91: symlink d2/d1b/l20 0 2024-09-19T07:24:50.529 INFO:tasks.workunit.client.0.smithi098.stdout:6/92: readlink d2/d1b/l20 0 2024-09-19T07:24:50.529 INFO:tasks.workunit.client.0.smithi098.stdout:6/93: rename d2/d11 to d2/d11/d21 22 2024-09-19T07:24:50.530 INFO:tasks.workunit.client.0.smithi098.stdout:8/106: dwrite d0/de/f15 [0,4194304] 0 2024-09-19T07:24:50.532 INFO:tasks.workunit.client.0.smithi098.stdout:4/125: creat da/f2a x:0 0 0 2024-09-19T07:24:50.533 INFO:tasks.workunit.client.0.smithi098.stdout:8/107: dread d0/fc [4194304,4194304] 0 2024-09-19T07:24:50.534 INFO:tasks.workunit.client.0.smithi098.stdout:6/94: symlink d2/l22 0 2024-09-19T07:24:50.535 INFO:tasks.workunit.client.0.smithi098.stdout:5/139: creat dc/d1c/d2e/f33 x:0 0 0 2024-09-19T07:24:50.537 INFO:tasks.workunit.client.0.smithi098.stdout:4/126: symlink da/l2b 0 2024-09-19T07:24:50.537 INFO:tasks.workunit.client.0.smithi098.stdout:6/95: dread d2/fc [4194304,4194304] 0 2024-09-19T07:24:50.537 INFO:tasks.workunit.client.0.smithi098.stdout:6/96: write f1 [2992109,88264] 0 2024-09-19T07:24:50.538 INFO:tasks.workunit.client.0.smithi098.stdout:6/97: write d2/d5/fd [6134411,56852] 0 2024-09-19T07:24:50.538 INFO:tasks.workunit.client.0.smithi098.stdout:8/108: creat d0/f1f x:0 0 0 2024-09-19T07:24:50.539 INFO:tasks.workunit.client.0.smithi098.stdout:5/140: creat dc/de/f34 x:0 0 0 2024-09-19T07:24:50.539 INFO:tasks.workunit.client.0.smithi098.stdout:5/141: fsync dc/de/d13/f27 0 2024-09-19T07:24:50.539 INFO:tasks.workunit.client.0.smithi098.stdout:5/142: stat dc/d1c/f26 0 2024-09-19T07:24:50.540 INFO:tasks.workunit.client.0.smithi098.stdout:0/122: sync 2024-09-19T07:24:50.540 INFO:tasks.workunit.client.0.smithi098.stdout:2/43: sync 2024-09-19T07:24:50.540 INFO:tasks.workunit.client.0.smithi098.stdout:6/98: dread d2/fc [4194304,4194304] 0 2024-09-19T07:24:50.541 INFO:tasks.workunit.client.0.smithi098.stdout:8/109: mknod d0/d16/c20 0 2024-09-19T07:24:50.541 INFO:tasks.workunit.client.0.smithi098.stdout:8/110: write d0/fa [3541426,10332] 0 2024-09-19T07:24:50.542 INFO:tasks.workunit.client.0.smithi098.stdout:5/143: symlink dc/d1c/d2e/l35 0 2024-09-19T07:24:50.542 INFO:tasks.workunit.client.0.smithi098.stdout:9/144: dwrite d3/d16/d1f/f2e [0,4194304] 0 2024-09-19T07:24:50.543 INFO:tasks.workunit.client.0.smithi098.stdout:9/145: chown d3/dc/df/c2c 5 1 2024-09-19T07:24:50.543 INFO:tasks.workunit.client.0.smithi098.stdout:9/146: write d3/dc/df/d15/d1b/f29 [61600,9698] 0 2024-09-19T07:24:50.543 INFO:tasks.workunit.client.0.smithi098.stdout:4/127: rmdir da 39 2024-09-19T07:24:50.544 INFO:tasks.workunit.client.0.smithi098.stdout:0/123: chown l2 23601 1 2024-09-19T07:24:50.545 INFO:tasks.workunit.client.0.smithi098.stdout:2/44: mknod d1/c10 0 2024-09-19T07:24:50.545 INFO:tasks.workunit.client.0.smithi098.stdout:2/45: rename d1 to d1/d11 22 2024-09-19T07:24:50.547 INFO:tasks.workunit.client.0.smithi098.stdout:5/144: mkdir dc/de/d36 0 2024-09-19T07:24:50.549 INFO:tasks.workunit.client.0.smithi098.stdout:9/147: link d3/c11 d3/dc/df/d15/d1a/d2d/c32 0 2024-09-19T07:24:50.550 INFO:tasks.workunit.client.0.smithi098.stdout:4/128: unlink da/l19 0 2024-09-19T07:24:50.550 INFO:tasks.workunit.client.0.smithi098.stdout:4/129: readlink da/l24 0 2024-09-19T07:24:50.551 INFO:tasks.workunit.client.0.smithi098.stdout:0/124: chown d5/c13 494 1 2024-09-19T07:24:50.551 INFO:tasks.workunit.client.0.smithi098.stdout:0/125: fsync d5/f22 0 2024-09-19T07:24:50.551 INFO:tasks.workunit.client.0.smithi098.stdout:6/99: dread d2/d5/f16 [0,4194304] 0 2024-09-19T07:24:50.552 INFO:tasks.workunit.client.0.smithi098.stdout:2/46: creat d1/da/f12 x:0 0 0 2024-09-19T07:24:50.552 INFO:tasks.workunit.client.0.smithi098.stdout:2/47: write d1/d5/fe [25524,46536] 0 2024-09-19T07:24:50.552 INFO:tasks.workunit.client.0.smithi098.stdout:3/158: sync 2024-09-19T07:24:50.552 INFO:tasks.workunit.client.0.smithi098.stdout:7/146: sync 2024-09-19T07:24:50.553 INFO:tasks.workunit.client.0.smithi098.stdout:9/148: creat d3/dc/df/d15/d1a/d2b/f33 x:0 0 0 2024-09-19T07:24:50.553 INFO:tasks.workunit.client.0.smithi098.stdout:9/149: chown d3/dc/df/d31 4 1 2024-09-19T07:24:50.555 INFO:tasks.workunit.client.0.smithi098.stdout:0/126: creat d5/f23 x:0 0 0 2024-09-19T07:24:50.557 INFO:tasks.workunit.client.0.smithi098.stdout:2/48: unlink d1/l3 0 2024-09-19T07:24:50.562 INFO:tasks.workunit.client.0.smithi098.stdout:0/127: creat d5/d20/d14/f24 x:0 0 0 2024-09-19T07:24:50.562 INFO:tasks.workunit.client.0.smithi098.stdout:3/159: truncate de/df/d1f/f27 700686 0 2024-09-19T07:24:50.563 INFO:tasks.workunit.client.0.smithi098.stdout:3/160: mkdir de/df/d16/d2d 0 2024-09-19T07:24:50.566 INFO:tasks.workunit.client.0.smithi098.stdout:8/111: dread d0/fc [0,4194304] 0 2024-09-19T07:24:50.566 INFO:tasks.workunit.client.0.smithi098.stdout:7/147: symlink d5/d8/dc/d16/l2b 0 2024-09-19T07:24:50.566 INFO:tasks.workunit.client.0.smithi098.stdout:7/148: rename d5/d10/d1d to d5/d10/d1d/d2c 22 2024-09-19T07:24:50.566 INFO:tasks.workunit.client.0.smithi098.stdout:7/149: write d5/d10/f26 [594299,49431] 0 2024-09-19T07:24:50.568 INFO:tasks.workunit.client.0.smithi098.stdout:0/128: dread d5/f7 [0,4194304] 0 2024-09-19T07:24:50.576 INFO:tasks.workunit.client.0.smithi098.stdout:7/150: dread d5/d8/dc/f15 [0,4194304] 0 2024-09-19T07:24:50.576 INFO:tasks.workunit.client.0.smithi098.stdout:7/151: chown d5/d10/d11 1 1 2024-09-19T07:24:50.578 INFO:tasks.workunit.client.0.smithi098.stdout:7/152: rename d5/lb to d5/d8/dc/l2d 0 2024-09-19T07:24:50.581 INFO:tasks.workunit.client.0.smithi098.stdout:7/153: rmdir d5/d10/d11/d29 0 2024-09-19T07:24:50.581 INFO:tasks.workunit.client.0.smithi098.stdout:7/154: readlink d5/d8/dc/d16/l25 0 2024-09-19T07:24:50.587 INFO:tasks.workunit.client.0.smithi098.stdout:6/100: dwrite d2/f1e [0,4194304] 0 2024-09-19T07:24:50.587 INFO:tasks.workunit.client.0.smithi098.stdout:6/101: read d2/fc [6469192,58577] 0 2024-09-19T07:24:50.589 INFO:tasks.workunit.client.0.smithi098.stdout:2/49: dwrite d1/f8 [0,4194304] 0 2024-09-19T07:24:50.589 INFO:tasks.workunit.client.0.smithi098.stdout:6/102: rmdir d2/d5 39 2024-09-19T07:24:50.590 INFO:tasks.workunit.client.0.smithi098.stdout:2/50: mknod d1/da/c13 0 2024-09-19T07:24:50.590 INFO:tasks.workunit.client.0.smithi098.stdout:2/51: chown d1/da/db 13648 1 2024-09-19T07:24:50.590 INFO:tasks.workunit.client.0.smithi098.stdout:2/52: chown d1/da 23810861 1 2024-09-19T07:24:50.590 INFO:tasks.workunit.client.0.smithi098.stdout:2/53: write d1/da/f12 [620522,97065] 0 2024-09-19T07:24:50.591 INFO:tasks.workunit.client.0.smithi098.stdout:5/145: dwrite dc/de/f1b [0,4194304] 0 2024-09-19T07:24:50.591 INFO:tasks.workunit.client.0.smithi098.stdout:5/146: readlink l7 0 2024-09-19T07:24:50.591 INFO:tasks.workunit.client.0.smithi098.stdout:5/147: truncate dc/de/d13/f19 460564 0 2024-09-19T07:24:50.591 INFO:tasks.workunit.client.0.smithi098.stdout:5/148: dread - dc/de/f34 zero size 2024-09-19T07:24:50.594 INFO:tasks.workunit.client.0.smithi098.stdout:9/150: dwrite d3/dc/df/f2a [0,4194304] 0 2024-09-19T07:24:50.596 INFO:tasks.workunit.client.0.smithi098.stdout:6/103: getdents d2/d5 0 2024-09-19T07:24:50.596 INFO:tasks.workunit.client.0.smithi098.stdout:6/104: fdatasync d2/d5/fd 0 2024-09-19T07:24:50.596 INFO:tasks.workunit.client.0.smithi098.stdout:6/105: read - d2/f1a zero size 2024-09-19T07:24:50.597 INFO:tasks.workunit.client.0.smithi098.stdout:4/130: dwrite da/f16 [0,4194304] 0 2024-09-19T07:24:50.598 INFO:tasks.workunit.client.0.smithi098.stdout:9/151: unlink d3/dc/df/c2c 0 2024-09-19T07:24:50.604 INFO:tasks.workunit.client.0.smithi098.stdout:4/131: link da/c29 da/c2c 0 2024-09-19T07:24:50.604 INFO:tasks.workunit.client.0.smithi098.stdout:4/132: chown da/c20 191018979 1 2024-09-19T07:24:50.605 INFO:tasks.workunit.client.0.smithi098.stdout:2/54: truncate d1/f8 3767431 0 2024-09-19T07:24:50.606 INFO:tasks.workunit.client.0.smithi098.stdout:2/55: creat d1/d9/f14 x:0 0 0 2024-09-19T07:24:50.607 INFO:tasks.workunit.client.0.smithi098.stdout:2/56: readlink d1/l4 0 2024-09-19T07:24:50.608 INFO:tasks.workunit.client.0.smithi098.stdout:6/106: write d2/fc [1182369,53474] 0 2024-09-19T07:24:50.608 INFO:tasks.workunit.client.0.smithi098.stdout:6/107: readlink d2/l22 0 2024-09-19T07:24:50.609 INFO:tasks.workunit.client.0.smithi098.stdout:6/108: symlink d2/d1b/l23 0 2024-09-19T07:24:50.610 INFO:tasks.workunit.client.0.smithi098.stdout:6/109: creat d2/d11/f24 x:0 0 0 2024-09-19T07:24:50.610 INFO:tasks.workunit.client.0.smithi098.stdout:7/155: dwrite d5/d8/dc/d16/f27 [0,4194304] 0 2024-09-19T07:24:50.611 INFO:tasks.workunit.client.0.smithi098.stdout:9/152: write d3/dc/df/f2a [165702,57131] 0 2024-09-19T07:24:50.611 INFO:tasks.workunit.client.0.smithi098.stdout:0/129: dwrite d5/fe [0,4194304] 0 2024-09-19T07:24:50.611 INFO:tasks.workunit.client.0.smithi098.stdout:2/57: dread d1/da/f12 [0,4194304] 0 2024-09-19T07:24:50.612 INFO:tasks.workunit.client.0.smithi098.stdout:6/110: mknod d2/d5/c25 0 2024-09-19T07:24:50.613 INFO:tasks.workunit.client.0.smithi098.stdout:7/156: creat d5/d8/dc/d16/f2e x:0 0 0 2024-09-19T07:24:50.615 INFO:tasks.workunit.client.0.smithi098.stdout:6/111: mkdir d2/d5/d1f/d26 0 2024-09-19T07:24:50.616 INFO:tasks.workunit.client.0.smithi098.stdout:6/112: readlink d2/d11/l18 0 2024-09-19T07:24:50.616 INFO:tasks.workunit.client.0.smithi098.stdout:0/130: rmdir d5/d20/d14 39 2024-09-19T07:24:50.617 INFO:tasks.workunit.client.0.smithi098.stdout:6/113: symlink d2/d5/d1f/l27 0 2024-09-19T07:24:50.618 INFO:tasks.workunit.client.0.smithi098.stdout:7/157: symlink d5/d8/l2f 0 2024-09-19T07:24:50.618 INFO:tasks.workunit.client.0.smithi098.stdout:7/158: fdatasync d5/d10/d1d/f2a 0 2024-09-19T07:24:50.619 INFO:tasks.workunit.client.0.smithi098.stdout:6/114: mknod d2/d5/d1f/d26/c28 0 2024-09-19T07:24:50.620 INFO:tasks.workunit.client.0.smithi098.stdout:6/115: write d2/d11/f24 [686763,101560] 0 2024-09-19T07:24:50.620 INFO:tasks.workunit.client.0.smithi098.stdout:5/149: dwrite dc/de/f34 [0,4194304] 0 2024-09-19T07:24:50.620 INFO:tasks.workunit.client.0.smithi098.stdout:5/150: chown dc/d1c 118596557 1 2024-09-19T07:24:50.624 INFO:tasks.workunit.client.0.smithi098.stdout:5/151: mkdir dc/d1c/d2e/d37 0 2024-09-19T07:24:50.624 INFO:tasks.workunit.client.0.smithi098.stdout:5/152: dread - dc/d1c/d2e/f33 zero size 2024-09-19T07:24:50.624 INFO:tasks.workunit.client.0.smithi098.stdout:5/153: read - dc/d1c/f26 zero size 2024-09-19T07:24:50.625 INFO:tasks.workunit.client.0.smithi098.stdout:5/154: fdatasync dc/f29 0 2024-09-19T07:24:50.625 INFO:tasks.workunit.client.0.smithi098.stdout:5/155: chown dc/c18 2926 1 2024-09-19T07:24:50.626 INFO:tasks.workunit.client.0.smithi098.stdout:5/156: symlink dc/d1c/l38 0 2024-09-19T07:24:50.627 INFO:tasks.workunit.client.0.smithi098.stdout:5/157: truncate dc/d1c/d2e/f2f 4095123 0 2024-09-19T07:24:50.629 INFO:tasks.workunit.client.0.smithi098.stdout:5/158: link f3 dc/de/d36/f39 0 2024-09-19T07:24:50.631 INFO:tasks.workunit.client.0.smithi098.stdout:7/159: getdents d5/d8/dc/d16 0 2024-09-19T07:24:50.631 INFO:tasks.workunit.client.0.smithi098.stdout:7/160: fdatasync d5/d8/fa 0 2024-09-19T07:24:50.631 INFO:tasks.workunit.client.0.smithi098.stdout:7/161: write d5/d8/dc/d16/f2e [1040679,62678] 0 2024-09-19T07:24:50.633 INFO:tasks.workunit.client.0.smithi098.stdout:2/58: write d1/f8 [308509,3499] 0 2024-09-19T07:24:50.633 INFO:tasks.workunit.client.0.smithi098.stdout:2/59: dread - d1/d9/f14 zero size 2024-09-19T07:24:50.633 INFO:tasks.workunit.client.0.smithi098.stdout:2/60: truncate d1/d9/f14 564953 0 2024-09-19T07:24:50.633 INFO:tasks.workunit.client.0.smithi098.stdout:5/159: symlink dc/d1c/d2e/l3a 0 2024-09-19T07:24:50.633 INFO:tasks.workunit.client.0.smithi098.stdout:5/160: chown dc/d1c/d23 354555397 1 2024-09-19T07:24:50.633 INFO:tasks.workunit.client.0.smithi098.stdout:5/161: fdatasync dc/de/d13/f19 0 2024-09-19T07:24:50.633 INFO:tasks.workunit.client.0.smithi098.stdout:0/131: dread d5/fe [0,4194304] 0 2024-09-19T07:24:50.633 INFO:tasks.workunit.client.0.smithi098.stdout:0/132: dread - d5/f22 zero size 2024-09-19T07:24:50.635 INFO:tasks.workunit.client.0.smithi098.stdout:7/162: unlink d5/f7 0 2024-09-19T07:24:50.638 INFO:tasks.workunit.client.0.smithi098.stdout:7/163: dread d5/d8/f21 [0,4194304] 0 2024-09-19T07:24:50.638 INFO:tasks.workunit.client.0.smithi098.stdout:2/61: creat d1/da/db/f15 x:0 0 0 2024-09-19T07:24:50.640 INFO:tasks.workunit.client.0.smithi098.stdout:2/62: mknod d1/c16 0 2024-09-19T07:24:50.640 INFO:tasks.workunit.client.0.smithi098.stdout:0/133: truncate d5/fe 3181000 0 2024-09-19T07:24:50.643 INFO:tasks.workunit.client.0.smithi098.stdout:9/153: dwrite d3/dc/df/f2a [4194304,4194304] 0 2024-09-19T07:24:50.643 INFO:tasks.workunit.client.0.smithi098.stdout:1/106: sync 2024-09-19T07:24:50.645 INFO:tasks.workunit.client.0.smithi098.stdout:6/116: dwrite d2/f1e [0,4194304] 0 2024-09-19T07:24:50.646 INFO:tasks.workunit.client.0.smithi098.stdout:9/154: unlink d3/dc/df/d15/d1b/l1e 0 2024-09-19T07:24:50.646 INFO:tasks.workunit.client.0.smithi098.stdout:7/164: dread d5/d10/f26 [0,4194304] 0 2024-09-19T07:24:50.646 INFO:tasks.workunit.client.0.smithi098.stdout:7/165: stat d5/d10/d1d/c20 0 2024-09-19T07:24:50.647 INFO:tasks.workunit.client.0.smithi098.stdout:1/107: creat dc/f23 x:0 0 0 2024-09-19T07:24:50.649 INFO:tasks.workunit.client.0.smithi098.stdout:0/134: dread d5/f1e [0,4194304] 0 2024-09-19T07:24:50.650 INFO:tasks.workunit.client.0.smithi098.stdout:6/117: symlink d2/d5/d1f/l29 0 2024-09-19T07:24:50.651 INFO:tasks.workunit.client.0.smithi098.stdout:6/118: fsync d2/d5/f16 0 2024-09-19T07:24:50.651 INFO:tasks.workunit.client.0.smithi098.stdout:9/155: getdents d3 0 2024-09-19T07:24:50.652 INFO:tasks.workunit.client.0.smithi098.stdout:1/108: mknod dc/de/d22/c24 0 2024-09-19T07:24:50.654 INFO:tasks.workunit.client.0.smithi098.stdout:1/109: symlink dc/d17/l25 0 2024-09-19T07:24:50.661 INFO:tasks.workunit.client.0.smithi098.stdout:5/162: dwrite dc/de/d13/f19 [0,4194304] 0 2024-09-19T07:24:50.662 INFO:tasks.workunit.client.0.smithi098.stdout:2/63: dwrite d1/d9/f14 [0,4194304] 0 2024-09-19T07:24:50.662 INFO:tasks.workunit.client.0.smithi098.stdout:2/64: dread - d1/da/db/f15 zero size 2024-09-19T07:24:50.662 INFO:tasks.workunit.client.0.smithi098.stdout:2/65: dread - d1/da/db/fd zero size 2024-09-19T07:24:50.662 INFO:tasks.workunit.client.0.smithi098.stdout:2/66: write d1/da/db/f15 [278891,107403] 0 2024-09-19T07:24:50.665 INFO:tasks.workunit.client.0.smithi098.stdout:2/67: creat d1/d9/f17 x:0 0 0 2024-09-19T07:24:50.666 INFO:tasks.workunit.client.0.smithi098.stdout:2/68: creat d1/da/f18 x:0 0 0 2024-09-19T07:24:50.667 INFO:tasks.workunit.client.0.smithi098.stdout:2/69: mknod d1/d9/c19 0 2024-09-19T07:24:50.667 INFO:tasks.workunit.client.0.smithi098.stdout:0/135: read f4 [3425588,14111] 0 2024-09-19T07:24:50.668 INFO:tasks.workunit.client.0.smithi098.stdout:0/136: fsync f4 0 2024-09-19T07:24:50.668 INFO:tasks.workunit.client.0.smithi098.stdout:2/70: rename d1/d9/f17 to d1/da/f1a 0 2024-09-19T07:24:50.669 INFO:tasks.workunit.client.0.smithi098.stdout:2/71: dread - d1/da/db/fd zero size 2024-09-19T07:24:50.670 INFO:tasks.workunit.client.0.smithi098.stdout:7/166: dread d5/d8/dc/d16/f27 [0,4194304] 0 2024-09-19T07:24:50.670 INFO:tasks.workunit.client.0.smithi098.stdout:0/137: dread d5/d20/f10 [0,4194304] 0 2024-09-19T07:24:50.670 INFO:tasks.workunit.client.0.smithi098.stdout:7/167: chown d5/d10/d1d/f2a 240589377 1 2024-09-19T07:24:50.670 INFO:tasks.workunit.client.0.smithi098.stdout:2/72: link d1/da/f12 d1/d9/f1b 0 2024-09-19T07:24:50.672 INFO:tasks.workunit.client.0.smithi098.stdout:7/168: mknod d5/d10/c30 0 2024-09-19T07:24:50.672 INFO:tasks.workunit.client.0.smithi098.stdout:2/73: fdatasync d1/da/db/f15 0 2024-09-19T07:24:50.674 INFO:tasks.workunit.client.0.smithi098.stdout:7/169: write d5/d8/f21 [263860,121826] 0 2024-09-19T07:24:50.675 INFO:tasks.workunit.client.0.smithi098.stdout:0/138: dread d5/fe [0,4194304] 0 2024-09-19T07:24:50.677 INFO:tasks.workunit.client.0.smithi098.stdout:2/74: symlink d1/da/db/l1c 0 2024-09-19T07:24:50.677 INFO:tasks.workunit.client.0.smithi098.stdout:2/75: truncate d1/da/db/f15 996249 0 2024-09-19T07:24:50.678 INFO:tasks.workunit.client.0.smithi098.stdout:0/139: creat d5/f25 x:0 0 0 2024-09-19T07:24:50.678 INFO:tasks.workunit.client.0.smithi098.stdout:0/140: stat d5/d20/ld 0 2024-09-19T07:24:50.678 INFO:tasks.workunit.client.0.smithi098.stdout:6/119: dwrite d2/f1a [0,4194304] 0 2024-09-19T07:24:50.678 INFO:tasks.workunit.client.0.smithi098.stdout:6/120: write d2/fb [115887,60561] 0 2024-09-19T07:24:50.679 INFO:tasks.workunit.client.0.smithi098.stdout:7/170: link d5/d8/dc/fe d5/d8/dc/d16/f31 0 2024-09-19T07:24:50.679 INFO:tasks.workunit.client.0.smithi098.stdout:7/171: fdatasync d5/d8/dc/f15 0 2024-09-19T07:24:50.679 INFO:tasks.workunit.client.0.smithi098.stdout:0/141: mknod d5/d20/c26 0 2024-09-19T07:24:50.682 INFO:tasks.workunit.client.0.smithi098.stdout:6/121: creat d2/d11/f2a x:0 0 0 2024-09-19T07:24:50.683 INFO:tasks.workunit.client.0.smithi098.stdout:7/172: creat d5/d10/f32 x:0 0 0 2024-09-19T07:24:50.684 INFO:tasks.workunit.client.0.smithi098.stdout:0/142: creat d5/f27 x:0 0 0 2024-09-19T07:24:50.685 INFO:tasks.workunit.client.0.smithi098.stdout:7/173: rename d5/l1f to d5/l33 0 2024-09-19T07:24:50.685 INFO:tasks.workunit.client.0.smithi098.stdout:0/143: symlink d5/d20/d14/l28 0 2024-09-19T07:24:50.687 INFO:tasks.workunit.client.0.smithi098.stdout:1/110: dwrite dc/f23 [0,4194304] 0 2024-09-19T07:24:50.687 INFO:tasks.workunit.client.0.smithi098.stdout:1/111: fdatasync f1 0 2024-09-19T07:24:50.688 INFO:tasks.workunit.client.0.smithi098.stdout:7/174: link d5/d8/dc/d16/f2e d5/d8/f34 0 2024-09-19T07:24:50.693 INFO:tasks.workunit.client.0.smithi098.stdout:1/112: mknod dc/de/c26 0 2024-09-19T07:24:50.693 INFO:tasks.workunit.client.0.smithi098.stdout:1/113: readlink dc/l11 0 2024-09-19T07:24:50.698 INFO:tasks.workunit.client.0.smithi098.stdout:1/114: write dc/f23 [4374337,113010] 0 2024-09-19T07:24:50.698 INFO:tasks.workunit.client.0.smithi098.stdout:1/115: fdatasync f1 0 2024-09-19T07:24:50.702 INFO:tasks.workunit.client.0.smithi098.stdout:8/112: sync 2024-09-19T07:24:50.703 INFO:tasks.workunit.client.0.smithi098.stdout:4/133: sync 2024-09-19T07:24:50.703 INFO:tasks.workunit.client.0.smithi098.stdout:3/161: sync 2024-09-19T07:24:50.703 INFO:tasks.workunit.client.0.smithi098.stdout:4/134: write da/f1e [713702,128673] 0 2024-09-19T07:24:50.703 INFO:tasks.workunit.client.0.smithi098.stdout:7/175: dread d5/d8/dc/d16/f1e [0,4194304] 0 2024-09-19T07:24:50.704 INFO:tasks.workunit.client.0.smithi098.stdout:8/113: mkdir d0/de/d21 0 2024-09-19T07:24:50.704 INFO:tasks.workunit.client.0.smithi098.stdout:8/114: fsync d0/f1f 0 2024-09-19T07:24:50.704 INFO:tasks.workunit.client.0.smithi098.stdout:3/162: dread f5 [0,4194304] 0 2024-09-19T07:24:50.704 INFO:tasks.workunit.client.0.smithi098.stdout:4/135: mknod da/c2d 0 2024-09-19T07:24:50.705 INFO:tasks.workunit.client.0.smithi098.stdout:4/136: read f9 [1074009,119696] 0 2024-09-19T07:24:50.705 INFO:tasks.workunit.client.0.smithi098.stdout:8/115: creat d0/f22 x:0 0 0 2024-09-19T07:24:50.705 INFO:tasks.workunit.client.0.smithi098.stdout:3/163: truncate de/f1a 488582 0 2024-09-19T07:24:50.706 INFO:tasks.workunit.client.0.smithi098.stdout:4/137: mknod da/c2e 0 2024-09-19T07:24:50.706 INFO:tasks.workunit.client.0.smithi098.stdout:8/116: creat d0/d16/f23 x:0 0 0 2024-09-19T07:24:50.706 INFO:tasks.workunit.client.0.smithi098.stdout:8/117: write d0/f22 [140893,30247] 0 2024-09-19T07:24:50.707 INFO:tasks.workunit.client.0.smithi098.stdout:1/116: write dc/f23 [2447129,39897] 0 2024-09-19T07:24:50.707 INFO:tasks.workunit.client.0.smithi098.stdout:4/138: mknod da/c2f 0 2024-09-19T07:24:50.707 INFO:tasks.workunit.client.0.smithi098.stdout:4/139: fsync da/f16 0 2024-09-19T07:24:50.707 INFO:tasks.workunit.client.0.smithi098.stdout:4/140: chown da/c20 93306 1 2024-09-19T07:24:50.708 INFO:tasks.workunit.client.0.smithi098.stdout:1/117: symlink dc/l27 0 2024-09-19T07:24:50.708 INFO:tasks.workunit.client.0.smithi098.stdout:1/118: chown dc/de/c15 1656 1 2024-09-19T07:24:50.709 INFO:tasks.workunit.client.0.smithi098.stdout:4/141: creat da/f30 x:0 0 0 2024-09-19T07:24:50.709 INFO:tasks.workunit.client.0.smithi098.stdout:1/119: creat dc/f28 x:0 0 0 2024-09-19T07:24:50.711 INFO:tasks.workunit.client.0.smithi098.stdout:4/142: rmdir da 39 2024-09-19T07:24:50.712 INFO:tasks.workunit.client.0.smithi098.stdout:4/143: mkdir da/d31 0 2024-09-19T07:24:50.712 INFO:tasks.workunit.client.0.smithi098.stdout:4/144: readlink da/l24 0 2024-09-19T07:24:50.712 INFO:tasks.workunit.client.0.smithi098.stdout:4/145: getdents da/d31 0 2024-09-19T07:24:50.713 INFO:tasks.workunit.client.0.smithi098.stdout:4/146: symlink da/d31/l32 0 2024-09-19T07:24:50.714 INFO:tasks.workunit.client.0.smithi098.stdout:0/144: dwrite d5/f23 [0,4194304] 0 2024-09-19T07:24:50.714 INFO:tasks.workunit.client.0.smithi098.stdout:2/76: dwrite d1/da/f12 [0,4194304] 0 2024-09-19T07:24:50.714 INFO:tasks.workunit.client.0.smithi098.stdout:8/118: dread d0/de/f15 [4194304,4194304] 0 2024-09-19T07:24:50.715 INFO:tasks.workunit.client.0.smithi098.stdout:6/122: dwrite d2/d11/f24 [0,4194304] 0 2024-09-19T07:24:50.719 INFO:tasks.workunit.client.0.smithi098.stdout:0/145: symlink d5/d20/l29 0 2024-09-19T07:24:50.719 INFO:tasks.workunit.client.0.smithi098.stdout:0/146: write d5/d20/d14/f24 [909334,81116] 0 2024-09-19T07:24:50.721 INFO:tasks.workunit.client.0.smithi098.stdout:2/77: mkdir d1/d9/d1d 0 2024-09-19T07:24:50.722 INFO:tasks.workunit.client.0.smithi098.stdout:8/119: dread d0/fc [0,4194304] 0 2024-09-19T07:24:50.722 INFO:tasks.workunit.client.0.smithi098.stdout:3/164: truncate de/f1a 57949 0 2024-09-19T07:24:50.725 INFO:tasks.workunit.client.0.smithi098.stdout:6/123: mknod d2/d5/d1f/c2b 0 2024-09-19T07:24:50.725 INFO:tasks.workunit.client.0.smithi098.stdout:6/124: stat d2/fb 0 2024-09-19T07:24:50.727 INFO:tasks.workunit.client.0.smithi098.stdout:7/176: dwrite d5/f28 [0,4194304] 0 2024-09-19T07:24:50.728 INFO:tasks.workunit.client.0.smithi098.stdout:0/147: rename d5/d20/l29 to d5/d20/l2a 0 2024-09-19T07:24:50.729 INFO:tasks.workunit.client.0.smithi098.stdout:2/78: symlink d1/da/db/l1e 0 2024-09-19T07:24:50.729 INFO:tasks.workunit.client.0.smithi098.stdout:2/79: readlink d1/da/db/l1e 0 2024-09-19T07:24:50.730 INFO:tasks.workunit.client.0.smithi098.stdout:3/165: mkdir de/df/d16/d2e 0 2024-09-19T07:24:50.730 INFO:tasks.workunit.client.0.smithi098.stdout:3/166: stat f5 0 2024-09-19T07:24:50.730 INFO:tasks.workunit.client.0.smithi098.stdout:3/167: truncate f5 318298 0 2024-09-19T07:24:50.731 INFO:tasks.workunit.client.0.smithi098.stdout:6/125: symlink d2/d11/l2c 0 2024-09-19T07:24:50.731 INFO:tasks.workunit.client.0.smithi098.stdout:8/120: dread d0/fa [0,4194304] 0 2024-09-19T07:24:50.735 INFO:tasks.workunit.client.0.smithi098.stdout:2/80: rename d1/cf to d1/d9/d1d/c1f 0 2024-09-19T07:24:50.735 INFO:tasks.workunit.client.0.smithi098.stdout:2/81: write d1/f8 [4277397,15000] 0 2024-09-19T07:24:50.736 INFO:tasks.workunit.client.0.smithi098.stdout:2/82: readlink d1/da/db/l1e 0 2024-09-19T07:24:50.737 INFO:tasks.workunit.client.0.smithi098.stdout:6/126: symlink d2/d11/l2d 0 2024-09-19T07:24:50.737 INFO:tasks.workunit.client.0.smithi098.stdout:8/121: symlink d0/d1a/l24 0 2024-09-19T07:24:50.738 INFO:tasks.workunit.client.0.smithi098.stdout:0/148: write d5/f23 [511683,60927] 0 2024-09-19T07:24:50.738 INFO:tasks.workunit.client.0.smithi098.stdout:3/168: write f4 [3437033,82126] 0 2024-09-19T07:24:50.738 INFO:tasks.workunit.client.0.smithi098.stdout:4/147: dwrite da/f1e [0,4194304] 0 2024-09-19T07:24:50.740 INFO:tasks.workunit.client.0.smithi098.stdout:7/177: link d5/d10/f32 d5/d8/dc/d16/f35 0 2024-09-19T07:24:50.741 INFO:tasks.workunit.client.0.smithi098.stdout:2/83: rename d1/d9/c19 to d1/da/db/c20 0 2024-09-19T07:24:50.741 INFO:tasks.workunit.client.0.smithi098.stdout:2/84: truncate d1/da/db/fd 210367 0 2024-09-19T07:24:50.742 INFO:tasks.workunit.client.0.smithi098.stdout:6/127: fsync d2/d1b/f1d 0 2024-09-19T07:24:50.744 INFO:tasks.workunit.client.0.smithi098.stdout:0/149: getdents d5 0 2024-09-19T07:24:50.744 INFO:tasks.workunit.client.0.smithi098.stdout:0/150: fsync d5/f27 0 2024-09-19T07:24:50.745 INFO:tasks.workunit.client.0.smithi098.stdout:8/122: dread d0/fa [0,4194304] 0 2024-09-19T07:24:50.747 INFO:tasks.workunit.client.0.smithi098.stdout:9/156: sync 2024-09-19T07:24:50.747 INFO:tasks.workunit.client.0.smithi098.stdout:5/163: sync 2024-09-19T07:24:50.749 INFO:tasks.workunit.client.0.smithi098.stdout:3/169: creat de/f2f x:0 0 0 2024-09-19T07:24:50.749 INFO:tasks.workunit.client.0.smithi098.stdout:3/170: chown f5 2502 1 2024-09-19T07:24:50.749 INFO:tasks.workunit.client.0.smithi098.stdout:3/171: chown f9 476 1 2024-09-19T07:24:50.751 INFO:tasks.workunit.client.0.smithi098.stdout:2/85: mknod d1/d9/c21 0 2024-09-19T07:24:50.753 INFO:tasks.workunit.client.0.smithi098.stdout:6/128: creat d2/d5/d1f/d26/f2e x:0 0 0 2024-09-19T07:24:50.754 INFO:tasks.workunit.client.0.smithi098.stdout:0/151: rename d5/l8 to d5/d20/d1f/l2b 0 2024-09-19T07:24:50.756 INFO:tasks.workunit.client.0.smithi098.stdout:8/123: creat d0/f25 x:0 0 0 2024-09-19T07:24:50.756 INFO:tasks.workunit.client.0.smithi098.stdout:9/157: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:50.757 INFO:tasks.workunit.client.0.smithi098.stdout:3/172: symlink de/df/d1f/l30 0 2024-09-19T07:24:50.757 INFO:tasks.workunit.client.0.smithi098.stdout:0/152: fsync d5/f18 0 2024-09-19T07:24:50.758 INFO:tasks.workunit.client.0.smithi098.stdout:8/124: mknod d0/de/d21/c26 0 2024-09-19T07:24:50.758 INFO:tasks.workunit.client.0.smithi098.stdout:8/125: write d0/d16/f23 [68919,42784] 0 2024-09-19T07:24:50.759 INFO:tasks.workunit.client.0.smithi098.stdout:1/120: sync 2024-09-19T07:24:50.760 INFO:tasks.workunit.client.0.smithi098.stdout:1/121: mknod dc/de/c29 0 2024-09-19T07:24:50.760 INFO:tasks.workunit.client.0.smithi098.stdout:1/122: dread - dc/de/f21 zero size 2024-09-19T07:24:50.780 INFO:tasks.workunit.client.0.smithi098.stdout:8/126: write d0/f7 [1691327,66639] 0 2024-09-19T07:24:50.780 INFO:tasks.workunit.client.0.smithi098.stdout:8/127: readlink d0/de/d12/l13 0 2024-09-19T07:24:50.780 INFO:tasks.workunit.client.0.smithi098.stdout:8/128: fsync d0/f5 0 2024-09-19T07:24:50.780 INFO:tasks.workunit.client.0.smithi098.stdout:7/178: dwrite d5/d8/dc/d16/f1e [0,4194304] 0 2024-09-19T07:24:50.780 INFO:tasks.workunit.client.0.smithi098.stdout:2/86: dread d1/f8 [0,4194304] 0 2024-09-19T07:24:50.781 INFO:tasks.workunit.client.0.smithi098.stdout:5/164: dwrite dc/de/f2a [0,4194304] 0 2024-09-19T07:24:50.781 INFO:tasks.workunit.client.0.smithi098.stdout:2/87: dread d1/da/db/fd [0,4194304] 0 2024-09-19T07:24:50.781 INFO:tasks.workunit.client.0.smithi098.stdout:7/179: symlink d5/d10/d1d/l36 0 2024-09-19T07:24:50.783 INFO:tasks.workunit.client.0.smithi098.stdout:7/180: creat d5/f37 x:0 0 0 2024-09-19T07:24:50.783 INFO:tasks.workunit.client.0.smithi098.stdout:7/181: write d5/d8/dc/d16/f31 [3823133,46904] 0 2024-09-19T07:24:50.783 INFO:tasks.workunit.client.0.smithi098.stdout:4/148: dwrite da/fb [0,4194304] 0 2024-09-19T07:24:50.784 INFO:tasks.workunit.client.0.smithi098.stdout:9/158: dread d3/d16/d1f/f2e [0,4194304] 0 2024-09-19T07:24:50.784 INFO:tasks.workunit.client.0.smithi098.stdout:5/165: mkdir dc/de/d13/d3b 0 2024-09-19T07:24:50.784 INFO:tasks.workunit.client.0.smithi098.stdout:9/159: rename d3/dc/df to d3/dc/df/d15/d1a/d2b/d34 22 2024-09-19T07:24:50.784 INFO:tasks.workunit.client.0.smithi098.stdout:7/182: creat d5/d10/d11/f38 x:0 0 0 2024-09-19T07:24:50.785 INFO:tasks.workunit.client.0.smithi098.stdout:5/166: creat dc/de/d13/d3b/f3c x:0 0 0 2024-09-19T07:24:50.785 INFO:tasks.workunit.client.0.smithi098.stdout:5/167: chown dc/de/d13/d3b 0 1 2024-09-19T07:24:50.786 INFO:tasks.workunit.client.0.smithi098.stdout:5/168: creat dc/de/d36/f3d x:0 0 0 2024-09-19T07:24:50.787 INFO:tasks.workunit.client.0.smithi098.stdout:9/160: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:50.788 INFO:tasks.workunit.client.0.smithi098.stdout:8/129: read d0/de/f18 [3793818,1188] 0 2024-09-19T07:24:50.791 INFO:tasks.workunit.client.0.smithi098.stdout:8/130: dread d0/f22 [0,4194304] 0 2024-09-19T07:24:50.792 INFO:tasks.workunit.client.0.smithi098.stdout:2/88: read d1/da/f12 [1982294,125489] 0 2024-09-19T07:24:50.792 INFO:tasks.workunit.client.0.smithi098.stdout:9/161: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:50.793 INFO:tasks.workunit.client.0.smithi098.stdout:6/129: dwrite d2/fb [0,4194304] 0 2024-09-19T07:24:50.793 INFO:tasks.workunit.client.0.smithi098.stdout:6/130: chown d2/c17 353901980 1 2024-09-19T07:24:50.793 INFO:tasks.workunit.client.0.smithi098.stdout:0/153: dwrite d5/f7 [0,4194304] 0 2024-09-19T07:24:50.793 INFO:tasks.workunit.client.0.smithi098.stdout:2/89: creat d1/da/f22 x:0 0 0 2024-09-19T07:24:50.796 INFO:tasks.workunit.client.0.smithi098.stdout:9/162: unlink d3/dc/df/f2a 0 2024-09-19T07:24:50.796 INFO:tasks.workunit.client.0.smithi098.stdout:5/169: write f3 [3753769,3735] 0 2024-09-19T07:24:50.797 INFO:tasks.workunit.client.0.smithi098.stdout:5/170: chown fa 69280 1 2024-09-19T07:24:50.798 INFO:tasks.workunit.client.0.smithi098.stdout:7/183: dread d5/f28 [0,4194304] 0 2024-09-19T07:24:50.799 INFO:tasks.workunit.client.0.smithi098.stdout:1/123: dwrite f1 [0,4194304] 0 2024-09-19T07:24:50.799 INFO:tasks.workunit.client.0.smithi098.stdout:4/149: write da/f28 [3012490,108906] 0 2024-09-19T07:24:50.800 INFO:tasks.workunit.client.0.smithi098.stdout:2/90: creat d1/d5/f23 x:0 0 0 2024-09-19T07:24:50.800 INFO:tasks.workunit.client.0.smithi098.stdout:2/91: write d1/da/f1a [366238,74837] 0 2024-09-19T07:24:50.800 INFO:tasks.workunit.client.0.smithi098.stdout:2/92: truncate d1/d5/fe 89089 0 2024-09-19T07:24:50.803 INFO:tasks.workunit.client.0.smithi098.stdout:8/131: write d0/fc [213015,18358] 0 2024-09-19T07:24:50.804 INFO:tasks.workunit.client.0.smithi098.stdout:0/154: creat d5/d20/d14/f2c x:0 0 0 2024-09-19T07:24:50.806 INFO:tasks.workunit.client.0.smithi098.stdout:2/93: creat d1/d9/f24 x:0 0 0 2024-09-19T07:24:50.807 INFO:tasks.workunit.client.0.smithi098.stdout:2/94: chown d1/d5 24 1 2024-09-19T07:24:50.807 INFO:tasks.workunit.client.0.smithi098.stdout:2/95: dread - d1/da/f18 zero size 2024-09-19T07:24:50.808 INFO:tasks.workunit.client.0.smithi098.stdout:6/131: rename d2/f1e to d2/d1b/f2f 0 2024-09-19T07:24:50.808 INFO:tasks.workunit.client.0.smithi098.stdout:6/132: stat d2/d1b/f2f 0 2024-09-19T07:24:50.810 INFO:tasks.workunit.client.0.smithi098.stdout:9/163: mknod d3/dc/df/d15/d1a/d2d/c35 0 2024-09-19T07:24:50.810 INFO:tasks.workunit.client.0.smithi098.stdout:9/164: truncate d3/dc/df/d15/d1b/f29 625419 0 2024-09-19T07:24:50.810 INFO:tasks.workunit.client.0.smithi098.stdout:9/165: fdatasync d3/dc/df/d15/f28 0 2024-09-19T07:24:50.811 INFO:tasks.workunit.client.0.smithi098.stdout:2/96: unlink d1/c6 0 2024-09-19T07:24:50.814 INFO:tasks.workunit.client.0.smithi098.stdout:9/166: write d3/dc/f19 [1494944,103296] 0 2024-09-19T07:24:50.814 INFO:tasks.workunit.client.0.smithi098.stdout:7/184: rename d5/f28 to d5/d10/d1d/f39 0 2024-09-19T07:24:50.814 INFO:tasks.workunit.client.0.smithi098.stdout:7/185: write d5/f37 [523240,187] 0 2024-09-19T07:24:50.814 INFO:tasks.workunit.client.0.smithi098.stdout:1/124: dread f1 [0,4194304] 0 2024-09-19T07:24:50.814 INFO:tasks.workunit.client.0.smithi098.stdout:1/125: readlink dc/d17/l1e 0 2024-09-19T07:24:50.816 INFO:tasks.workunit.client.0.smithi098.stdout:2/97: dread d1/da/db/f15 [0,4194304] 0 2024-09-19T07:24:50.817 INFO:tasks.workunit.client.0.smithi098.stdout:6/133: rename d2/d5/fd to d2/f30 0 2024-09-19T07:24:50.818 INFO:tasks.workunit.client.0.smithi098.stdout:1/126: mkdir dc/d2a 0 2024-09-19T07:24:50.819 INFO:tasks.workunit.client.0.smithi098.stdout:2/98: creat d1/da/f25 x:0 0 0 2024-09-19T07:24:50.819 INFO:tasks.workunit.client.0.smithi098.stdout:2/99: write d1/da/f25 [577008,23679] 0 2024-09-19T07:24:50.821 INFO:tasks.workunit.client.0.smithi098.stdout:7/186: rename d5/d10/f26 to d5/d8/dc/f3a 0 2024-09-19T07:24:50.821 INFO:tasks.workunit.client.0.smithi098.stdout:7/187: write d5/d10/f32 [1029321,37594] 0 2024-09-19T07:24:50.821 INFO:tasks.workunit.client.0.smithi098.stdout:7/188: chown d5/d10/d1d/f2a 3926 1 2024-09-19T07:24:50.822 INFO:tasks.workunit.client.0.smithi098.stdout:2/100: dread d1/da/db/f15 [0,4194304] 0 2024-09-19T07:24:50.822 INFO:tasks.workunit.client.0.smithi098.stdout:2/101: chown d1/c16 10 1 2024-09-19T07:24:50.822 INFO:tasks.workunit.client.0.smithi098.stdout:2/102: truncate d1/da/db/f15 1499268 0 2024-09-19T07:24:50.822 INFO:tasks.workunit.client.0.smithi098.stdout:2/103: stat d1/da/db/f15 0 2024-09-19T07:24:50.823 INFO:tasks.workunit.client.0.smithi098.stdout:6/134: dread d2/fc [0,4194304] 0 2024-09-19T07:24:50.824 INFO:tasks.workunit.client.0.smithi098.stdout:2/104: unlink d1/d5/f23 0 2024-09-19T07:24:50.824 INFO:tasks.workunit.client.0.smithi098.stdout:2/105: chown d1/l4 2906 1 2024-09-19T07:24:50.825 INFO:tasks.workunit.client.0.smithi098.stdout:5/171: write dc/de/d13/f14 [214451,58291] 0 2024-09-19T07:24:50.825 INFO:tasks.workunit.client.0.smithi098.stdout:5/172: chown dc/d1c/l38 58768410 1 2024-09-19T07:24:50.826 INFO:tasks.workunit.client.0.smithi098.stdout:7/189: symlink d5/d8/dc/d16/l3b 0 2024-09-19T07:24:50.827 INFO:tasks.workunit.client.0.smithi098.stdout:2/106: mkdir d1/d9/d26 0 2024-09-19T07:24:50.827 INFO:tasks.workunit.client.0.smithi098.stdout:2/107: write d1/d9/f24 [850725,50741] 0 2024-09-19T07:24:50.828 INFO:tasks.workunit.client.0.smithi098.stdout:2/108: readlink d1/da/db/l1e 0 2024-09-19T07:24:50.833 INFO:tasks.workunit.client.0.smithi098.stdout:2/109: creat d1/d9/f27 x:0 0 0 2024-09-19T07:24:50.835 INFO:tasks.workunit.client.0.smithi098.stdout:7/190: rename d5/d8/dc/d16/f27 to d5/f3c 0 2024-09-19T07:24:50.835 INFO:tasks.workunit.client.0.smithi098.stdout:7/191: write d5/d10/d1d/f2a [421140,60590] 0 2024-09-19T07:24:50.836 INFO:tasks.workunit.client.0.smithi098.stdout:2/110: getdents d1 0 2024-09-19T07:24:50.836 INFO:tasks.workunit.client.0.smithi098.stdout:5/173: dread dc/d1c/f24 [0,4194304] 0 2024-09-19T07:24:50.836 INFO:tasks.workunit.client.0.smithi098.stdout:7/192: write d5/d8/dc/d16/f2e [68346,85097] 0 2024-09-19T07:24:50.838 INFO:tasks.workunit.client.0.smithi098.stdout:9/167: truncate d3/dc/f19 2987628 0 2024-09-19T07:24:50.838 INFO:tasks.workunit.client.0.smithi098.stdout:9/168: chown d3/dc/df/d15/d1b/f29 10797180 1 2024-09-19T07:24:50.838 INFO:tasks.workunit.client.0.smithi098.stdout:2/111: creat d1/d9/f28 x:0 0 0 2024-09-19T07:24:50.839 INFO:tasks.workunit.client.0.smithi098.stdout:5/174: creat dc/d1c/f3e x:0 0 0 2024-09-19T07:24:50.841 INFO:tasks.workunit.client.0.smithi098.stdout:7/193: symlink d5/d10/l3d 0 2024-09-19T07:24:50.842 INFO:tasks.workunit.client.0.smithi098.stdout:7/194: getdents d5/d10/d11 0 2024-09-19T07:24:50.842 INFO:tasks.workunit.client.0.smithi098.stdout:7/195: fsync d5/d8/dc/d16/f1e 0 2024-09-19T07:24:50.847 INFO:tasks.workunit.client.0.smithi098.stdout:5/175: write dc/f12 [2400438,31648] 0 2024-09-19T07:24:50.847 INFO:tasks.workunit.client.0.smithi098.stdout:5/176: write dc/d1c/f3e [632670,6688] 0 2024-09-19T07:24:50.852 INFO:tasks.workunit.client.0.smithi098.stdout:4/150: dwrite da/f2a [0,4194304] 0 2024-09-19T07:24:50.860 INFO:tasks.workunit.client.0.smithi098.stdout:0/155: dwrite f4 [0,4194304] 0 2024-09-19T07:24:50.861 INFO:tasks.workunit.client.0.smithi098.stdout:1/127: dwrite dc/de/f13 [0,4194304] 0 2024-09-19T07:24:50.861 INFO:tasks.workunit.client.0.smithi098.stdout:1/128: truncate dc/de/f13 5172465 0 2024-09-19T07:24:50.862 INFO:tasks.workunit.client.0.smithi098.stdout:7/196: dwrite d5/d8/dc/f15 [4194304,4194304] 0 2024-09-19T07:24:50.865 INFO:tasks.workunit.client.0.smithi098.stdout:5/177: truncate dc/de/d13/f14 3820336 0 2024-09-19T07:24:50.865 INFO:tasks.workunit.client.0.smithi098.stdout:5/178: write dc/d1c/d23/f32 [1046534,115317] 0 2024-09-19T07:24:50.869 INFO:tasks.workunit.client.0.smithi098.stdout:4/151: dread da/fb [0,4194304] 0 2024-09-19T07:24:50.869 INFO:tasks.workunit.client.0.smithi098.stdout:8/132: dwrite d0/d16/f17 [0,4194304] 0 2024-09-19T07:24:50.869 INFO:tasks.workunit.client.0.smithi098.stdout:8/133: truncate d0/d16/f17 4388909 0 2024-09-19T07:24:50.877 INFO:tasks.workunit.client.0.smithi098.stdout:0/156: link d5/l11 d5/d20/l2d 0 2024-09-19T07:24:50.878 INFO:tasks.workunit.client.0.smithi098.stdout:5/179: creat dc/de/f3f x:0 0 0 2024-09-19T07:24:50.878 INFO:tasks.workunit.client.0.smithi098.stdout:5/180: fdatasync f1 0 2024-09-19T07:24:50.880 INFO:tasks.workunit.client.0.smithi098.stdout:2/112: dwrite d1/da/f1a [0,4194304] 0 2024-09-19T07:24:50.882 INFO:tasks.workunit.client.0.smithi098.stdout:2/113: read d1/da/db/f15 [383370,119874] 0 2024-09-19T07:24:50.886 INFO:tasks.workunit.client.0.smithi098.stdout:4/152: link l2 da/d31/l33 0 2024-09-19T07:24:50.887 INFO:tasks.workunit.client.0.smithi098.stdout:0/157: mknod d5/d20/d14/c2e 0 2024-09-19T07:24:50.890 INFO:tasks.workunit.client.0.smithi098.stdout:1/129: dwrite dc/f12 [0,4194304] 0 2024-09-19T07:24:50.890 INFO:tasks.workunit.client.0.smithi098.stdout:1/130: truncate dc/f28 443966 0 2024-09-19T07:24:50.890 INFO:tasks.workunit.client.0.smithi098.stdout:0/158: chown d5/c19 846 1 2024-09-19T07:24:50.891 INFO:tasks.workunit.client.0.smithi098.stdout:2/114: truncate d1/d5/fe 74596 0 2024-09-19T07:24:50.891 INFO:tasks.workunit.client.0.smithi098.stdout:7/197: dwrite d5/f37 [0,4194304] 0 2024-09-19T07:24:50.892 INFO:tasks.workunit.client.0.smithi098.stdout:7/198: chown d5/d8/dc/d16 30084277 1 2024-09-19T07:24:50.892 INFO:tasks.workunit.client.0.smithi098.stdout:0/159: read - d5/f27 zero size 2024-09-19T07:24:50.893 INFO:tasks.workunit.client.0.smithi098.stdout:2/115: symlink d1/d9/d1d/l29 0 2024-09-19T07:24:50.893 INFO:tasks.workunit.client.0.smithi098.stdout:2/116: chown d1/l4 3461 1 2024-09-19T07:24:50.893 INFO:tasks.workunit.client.0.smithi098.stdout:2/117: truncate d1/da/db/fd 978526 0 2024-09-19T07:24:50.895 INFO:tasks.workunit.client.0.smithi098.stdout:2/118: creat d1/d9/f2a x:0 0 0 2024-09-19T07:24:50.897 INFO:tasks.workunit.client.0.smithi098.stdout:4/153: write da/fd [531624,49638] 0 2024-09-19T07:24:50.897 INFO:tasks.workunit.client.0.smithi098.stdout:4/154: fsync da/f23 0 2024-09-19T07:24:50.897 INFO:tasks.workunit.client.0.smithi098.stdout:3/173: sync 2024-09-19T07:24:50.897 INFO:tasks.workunit.client.0.smithi098.stdout:3/174: write de/df/f29 [835483,77155] 0 2024-09-19T07:24:50.898 INFO:tasks.workunit.client.0.smithi098.stdout:8/134: dwrite d0/fa [0,4194304] 0 2024-09-19T07:24:50.898 INFO:tasks.workunit.client.0.smithi098.stdout:8/135: readlink d0/de/d12/l19 0 2024-09-19T07:24:50.898 INFO:tasks.workunit.client.0.smithi098.stdout:8/136: stat d0/de/d21 0 2024-09-19T07:24:50.898 INFO:tasks.workunit.client.0.smithi098.stdout:4/155: unlink da/l24 0 2024-09-19T07:24:50.899 INFO:tasks.workunit.client.0.smithi098.stdout:8/137: getdents d0/d16 0 2024-09-19T07:24:50.906 INFO:tasks.workunit.client.0.smithi098.stdout:8/138: rmdir d0/de 39 2024-09-19T07:24:50.907 INFO:tasks.workunit.client.0.smithi098.stdout:8/139: creat d0/de/f27 x:0 0 0 2024-09-19T07:24:50.909 INFO:tasks.workunit.client.0.smithi098.stdout:8/140: truncate d0/ff 3921264 0 2024-09-19T07:24:50.911 INFO:tasks.workunit.client.0.smithi098.stdout:8/141: mkdir d0/de/d28 0 2024-09-19T07:24:50.911 INFO:tasks.workunit.client.0.smithi098.stdout:8/142: stat d0/d16/f23 0 2024-09-19T07:24:50.911 INFO:tasks.workunit.client.0.smithi098.stdout:3/175: write fc [604756,69913] 0 2024-09-19T07:24:50.913 INFO:tasks.workunit.client.0.smithi098.stdout:8/143: rename d0/l6 to d0/de/d12/l29 0 2024-09-19T07:24:50.913 INFO:tasks.workunit.client.0.smithi098.stdout:4/156: dread f8 [0,4194304] 0 2024-09-19T07:24:50.913 INFO:tasks.workunit.client.0.smithi098.stdout:4/157: symlink da/l34 0 2024-09-19T07:24:50.914 INFO:tasks.workunit.client.0.smithi098.stdout:1/131: write dc/de/f13 [2282783,73910] 0 2024-09-19T07:24:50.915 INFO:tasks.workunit.client.0.smithi098.stdout:3/176: dread f9 [0,4194304] 0 2024-09-19T07:24:50.915 INFO:tasks.workunit.client.0.smithi098.stdout:1/132: mknod dc/de/d22/c2b 0 2024-09-19T07:24:50.917 INFO:tasks.workunit.client.0.smithi098.stdout:3/177: rmdir de/df/d16/d2d 0 2024-09-19T07:24:50.918 INFO:tasks.workunit.client.0.smithi098.stdout:1/133: creat dc/f2c x:0 0 0 2024-09-19T07:24:50.923 INFO:tasks.workunit.client.0.smithi098.stdout:7/199: dwrite d5/d8/dc/d16/f35 [0,4194304] 0 2024-09-19T07:24:50.923 INFO:tasks.workunit.client.0.smithi098.stdout:2/119: dwrite d1/d9/f2a [0,4194304] 0 2024-09-19T07:24:50.923 INFO:tasks.workunit.client.0.smithi098.stdout:2/120: write d1/d9/f27 [237330,47147] 0 2024-09-19T07:24:50.923 INFO:tasks.workunit.client.0.smithi098.stdout:2/121: write d1/da/f12 [3784908,10657] 0 2024-09-19T07:24:50.923 INFO:tasks.workunit.client.0.smithi098.stdout:2/122: stat d1/da/c13 0 2024-09-19T07:24:50.923 INFO:tasks.workunit.client.0.smithi098.stdout:2/123: chown d1/d9/d1d/c1f 41 1 2024-09-19T07:24:50.924 INFO:tasks.workunit.client.0.smithi098.stdout:1/134: link c3 dc/c2d 0 2024-09-19T07:24:50.931 INFO:tasks.workunit.client.0.smithi098.stdout:7/200: mkdir d5/d3e 0 2024-09-19T07:24:50.931 INFO:tasks.workunit.client.0.smithi098.stdout:7/201: chown d5/d10/l3d 241 1 2024-09-19T07:24:50.932 INFO:tasks.workunit.client.0.smithi098.stdout:1/135: mkdir dc/d17/d2e 0 2024-09-19T07:24:50.933 INFO:tasks.workunit.client.0.smithi098.stdout:2/124: dread d1/da/db/f15 [0,4194304] 0 2024-09-19T07:24:50.933 INFO:tasks.workunit.client.0.smithi098.stdout:2/125: fsync d1/da/f25 0 2024-09-19T07:24:50.933 INFO:tasks.workunit.client.0.smithi098.stdout:2/126: read d1/d9/f1b [4009002,12058] 0 2024-09-19T07:24:50.933 INFO:tasks.workunit.client.0.smithi098.stdout:2/127: fdatasync d1/d9/f28 0 2024-09-19T07:24:50.933 INFO:tasks.workunit.client.0.smithi098.stdout:2/128: write d1/da/f22 [780997,79397] 0 2024-09-19T07:24:50.934 INFO:tasks.workunit.client.0.smithi098.stdout:2/129: readlink d1/l4 0 2024-09-19T07:24:50.934 INFO:tasks.workunit.client.0.smithi098.stdout:7/202: creat d5/d10/f3f x:0 0 0 2024-09-19T07:24:50.934 INFO:tasks.workunit.client.0.smithi098.stdout:7/203: write d5/d8/f21 [366021,58751] 0 2024-09-19T07:24:50.934 INFO:tasks.workunit.client.0.smithi098.stdout:7/204: chown d5/d10/d11 12 1 2024-09-19T07:24:50.936 INFO:tasks.workunit.client.0.smithi098.stdout:7/205: creat d5/f40 x:0 0 0 2024-09-19T07:24:50.936 INFO:tasks.workunit.client.0.smithi098.stdout:7/206: rename d5/d10 to d5/d10/d11/d41 22 2024-09-19T07:24:50.938 INFO:tasks.workunit.client.0.smithi098.stdout:7/207: rename d5/d10/d11/f38 to d5/d8/dc/f42 0 2024-09-19T07:24:50.938 INFO:tasks.workunit.client.0.smithi098.stdout:6/135: sync 2024-09-19T07:24:50.938 INFO:tasks.workunit.client.0.smithi098.stdout:9/169: sync 2024-09-19T07:24:50.938 INFO:tasks.workunit.client.0.smithi098.stdout:6/136: write d2/d1b/f2f [5094109,7732] 0 2024-09-19T07:24:50.940 INFO:tasks.workunit.client.0.smithi098.stdout:6/137: rename d2/d5/l6 to d2/d5/l31 0 2024-09-19T07:24:50.940 INFO:tasks.workunit.client.0.smithi098.stdout:9/170: rmdir d3/d6 39 2024-09-19T07:24:50.940 INFO:tasks.workunit.client.0.smithi098.stdout:4/158: dwrite f9 [0,4194304] 0 2024-09-19T07:24:50.941 INFO:tasks.workunit.client.0.smithi098.stdout:8/144: dwrite d0/de/f27 [0,4194304] 0 2024-09-19T07:24:50.941 INFO:tasks.workunit.client.0.smithi098.stdout:8/145: write d0/f22 [501536,53236] 0 2024-09-19T07:24:50.941 INFO:tasks.workunit.client.0.smithi098.stdout:7/208: mknod d5/d8/c43 0 2024-09-19T07:24:50.942 INFO:tasks.workunit.client.0.smithi098.stdout:6/138: link d2/fb d2/f32 0 2024-09-19T07:24:50.942 INFO:tasks.workunit.client.0.smithi098.stdout:6/139: write d2/fe [52492,105240] 0 2024-09-19T07:24:50.943 INFO:tasks.workunit.client.0.smithi098.stdout:4/159: creat da/d31/f35 x:0 0 0 2024-09-19T07:24:50.944 INFO:tasks.workunit.client.0.smithi098.stdout:9/171: rmdir d3 39 2024-09-19T07:24:50.945 INFO:tasks.workunit.client.0.smithi098.stdout:8/146: mknod d0/de/d28/c2a 0 2024-09-19T07:24:50.945 INFO:tasks.workunit.client.0.smithi098.stdout:8/147: fdatasync d0/d16/f23 0 2024-09-19T07:24:50.946 INFO:tasks.workunit.client.0.smithi098.stdout:8/148: chown d0/d16/f17 27 1 2024-09-19T07:24:50.946 INFO:tasks.workunit.client.0.smithi098.stdout:7/209: creat d5/d10/d11/f44 x:0 0 0 2024-09-19T07:24:50.947 INFO:tasks.workunit.client.0.smithi098.stdout:6/140: creat d2/d5/d1f/d26/f33 x:0 0 0 2024-09-19T07:24:50.947 INFO:tasks.workunit.client.0.smithi098.stdout:6/141: chown d2/d1b/l23 221 1 2024-09-19T07:24:50.947 INFO:tasks.workunit.client.0.smithi098.stdout:6/142: truncate d2/d11/f2a 560726 0 2024-09-19T07:24:50.948 INFO:tasks.workunit.client.0.smithi098.stdout:3/178: dwrite de/f2f [0,4194304] 0 2024-09-19T07:24:50.948 INFO:tasks.workunit.client.0.smithi098.stdout:9/172: creat d3/d16/d1f/f36 x:0 0 0 2024-09-19T07:24:50.949 INFO:tasks.workunit.client.0.smithi098.stdout:7/210: creat d5/d8/dc/d16/f45 x:0 0 0 2024-09-19T07:24:50.951 INFO:tasks.workunit.client.0.smithi098.stdout:6/143: unlink d2/f30 0 2024-09-19T07:24:50.954 INFO:tasks.workunit.client.0.smithi098.stdout:9/173: creat d3/dc/df/d15/d1b/f37 x:0 0 0 2024-09-19T07:24:50.955 INFO:tasks.workunit.client.0.smithi098.stdout:3/179: mkdir de/df/d31 0 2024-09-19T07:24:50.958 INFO:tasks.workunit.client.0.smithi098.stdout:7/211: rename d5/d8/dc/d16/l25 to d5/d10/d1d/l46 0 2024-09-19T07:24:50.959 INFO:tasks.workunit.client.0.smithi098.stdout:3/180: symlink de/df/d31/l32 0 2024-09-19T07:24:50.960 INFO:tasks.workunit.client.0.smithi098.stdout:8/149: dread d0/fa [0,4194304] 0 2024-09-19T07:24:50.961 INFO:tasks.workunit.client.0.smithi098.stdout:6/144: rename d2/d5/d1f/d26/f2e to d2/d1b/f34 0 2024-09-19T07:24:50.964 INFO:tasks.workunit.client.0.smithi098.stdout:4/160: dwrite da/f28 [0,4194304] 0 2024-09-19T07:24:50.964 INFO:tasks.workunit.client.0.smithi098.stdout:4/161: write da/d31/f35 [1032979,45763] 0 2024-09-19T07:24:50.965 INFO:tasks.workunit.client.0.smithi098.stdout:4/162: fdatasync da/fd 0 2024-09-19T07:24:50.965 INFO:tasks.workunit.client.0.smithi098.stdout:2/130: dwrite d1/d5/fe [0,4194304] 0 2024-09-19T07:24:50.966 INFO:tasks.workunit.client.0.smithi098.stdout:1/136: dwrite dc/f23 [0,4194304] 0 2024-09-19T07:24:50.969 INFO:tasks.workunit.client.0.smithi098.stdout:2/131: truncate d1/f8 3230989 0 2024-09-19T07:24:50.977 INFO:tasks.workunit.client.0.smithi098.stdout:2/132: rename d1/c16 to d1/da/c2b 0 2024-09-19T07:24:50.977 INFO:tasks.workunit.client.0.smithi098.stdout:2/133: stat d1/f8 0 2024-09-19T07:24:50.978 INFO:tasks.workunit.client.0.smithi098.stdout:4/163: getdents da/d31 0 2024-09-19T07:24:50.979 INFO:tasks.workunit.client.0.smithi098.stdout:6/145: dwrite d2/d11/f2a [0,4194304] 0 2024-09-19T07:24:50.980 INFO:tasks.workunit.client.0.smithi098.stdout:1/137: dread dc/f23 [0,4194304] 0 2024-09-19T07:24:50.980 INFO:tasks.workunit.client.0.smithi098.stdout:1/138: truncate dc/de/f21 446859 0 2024-09-19T07:24:50.980 INFO:tasks.workunit.client.0.smithi098.stdout:7/212: getdents d5/d10/d11 0 2024-09-19T07:24:50.981 INFO:tasks.workunit.client.0.smithi098.stdout:7/213: fsync d5/d8/fa 0 2024-09-19T07:24:50.981 INFO:tasks.workunit.client.0.smithi098.stdout:3/181: dwrite de/f2f [0,4194304] 0 2024-09-19T07:24:50.981 INFO:tasks.workunit.client.0.smithi098.stdout:8/150: dread d0/d16/f17 [0,4194304] 0 2024-09-19T07:24:50.982 INFO:tasks.workunit.client.0.smithi098.stdout:9/174: rename d3/d16/d1f to d3/d16/d38 0 2024-09-19T07:24:50.987 INFO:tasks.workunit.client.0.smithi098.stdout:7/214: write d5/d10/d1d/f39 [448827,45568] 0 2024-09-19T07:24:50.987 INFO:tasks.workunit.client.0.smithi098.stdout:1/139: creat dc/d17/d2e/f2f x:0 0 0 2024-09-19T07:24:50.989 INFO:tasks.workunit.client.0.smithi098.stdout:6/146: rmdir d2 39 2024-09-19T07:24:50.993 INFO:tasks.workunit.client.0.smithi098.stdout:8/151: symlink d0/de/d12/l2b 0 2024-09-19T07:24:50.993 INFO:tasks.workunit.client.0.smithi098.stdout:8/152: truncate d0/fa 4371491 0 2024-09-19T07:24:50.993 INFO:tasks.workunit.client.0.smithi098.stdout:3/182: symlink de/df/d16/d2e/l33 0 2024-09-19T07:24:50.995 INFO:tasks.workunit.client.0.smithi098.stdout:9/175: unlink d3/dc/df/f21 0 2024-09-19T07:24:50.997 INFO:tasks.workunit.client.0.smithi098.stdout:7/215: creat d5/d8/dc/f47 x:0 0 0 2024-09-19T07:24:50.997 INFO:tasks.workunit.client.0.smithi098.stdout:7/216: stat d5/d10/d1d 0 2024-09-19T07:24:50.997 INFO:tasks.workunit.client.0.smithi098.stdout:7/217: fsync d5/d10/f32 0 2024-09-19T07:24:50.997 INFO:tasks.workunit.client.0.smithi098.stdout:1/140: truncate f1 968154 0 2024-09-19T07:24:50.999 INFO:tasks.workunit.client.0.smithi098.stdout:6/147: unlink d2/f32 0 2024-09-19T07:24:50.999 INFO:tasks.workunit.client.0.smithi098.stdout:8/153: mkdir d0/d2c 0 2024-09-19T07:24:51.001 INFO:tasks.workunit.client.0.smithi098.stdout:7/218: mkdir d5/d48 0 2024-09-19T07:24:51.002 INFO:tasks.workunit.client.0.smithi098.stdout:6/148: symlink d2/d11/l35 0 2024-09-19T07:24:51.002 INFO:tasks.workunit.client.0.smithi098.stdout:6/149: write d2/d1b/f34 [78148,47736] 0 2024-09-19T07:24:51.003 INFO:tasks.workunit.client.0.smithi098.stdout:2/134: dwrite d1/d9/f28 [0,4194304] 0 2024-09-19T07:24:51.004 INFO:tasks.workunit.client.0.smithi098.stdout:8/154: mknod d0/de/d28/c2d 0 2024-09-19T07:24:51.004 INFO:tasks.workunit.client.0.smithi098.stdout:4/164: dwrite da/f16 [0,4194304] 0 2024-09-19T07:24:51.004 INFO:tasks.workunit.client.0.smithi098.stdout:4/165: write da/f23 [411532,101749] 0 2024-09-19T07:24:51.004 INFO:tasks.workunit.client.0.smithi098.stdout:4/166: fsync f9 0 2024-09-19T07:24:51.005 INFO:tasks.workunit.client.0.smithi098.stdout:3/183: link de/f19 de/df/d31/f34 0 2024-09-19T07:24:51.005 INFO:tasks.workunit.client.0.smithi098.stdout:7/219: rmdir d5/d48 0 2024-09-19T07:24:51.009 INFO:tasks.workunit.client.0.smithi098.stdout:5/181: sync 2024-09-19T07:24:51.009 INFO:tasks.workunit.client.0.smithi098.stdout:8/155: mknod d0/de/d21/c2e 0 2024-09-19T07:24:51.009 INFO:tasks.workunit.client.0.smithi098.stdout:9/176: read d3/dc/df/d15/f28 [4105536,88746] 0 2024-09-19T07:24:51.010 INFO:tasks.workunit.client.0.smithi098.stdout:4/167: mknod da/d31/c36 0 2024-09-19T07:24:51.011 INFO:tasks.workunit.client.0.smithi098.stdout:3/184: symlink de/df/d1f/l35 0 2024-09-19T07:24:51.011 INFO:tasks.workunit.client.0.smithi098.stdout:3/185: write de/f1a [1000099,16816] 0 2024-09-19T07:24:51.011 INFO:tasks.workunit.client.0.smithi098.stdout:0/160: sync 2024-09-19T07:24:51.012 INFO:tasks.workunit.client.0.smithi098.stdout:7/220: rmdir d5/d10/d1d 39 2024-09-19T07:24:51.013 INFO:tasks.workunit.client.0.smithi098.stdout:6/150: write d2/d11/f24 [2109759,76721] 0 2024-09-19T07:24:51.013 INFO:tasks.workunit.client.0.smithi098.stdout:8/156: symlink d0/de/l2f 0 2024-09-19T07:24:51.014 INFO:tasks.workunit.client.0.smithi098.stdout:8/157: dread - d0/f1f zero size 2024-09-19T07:24:51.016 INFO:tasks.workunit.client.0.smithi098.stdout:9/177: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:51.018 INFO:tasks.workunit.client.0.smithi098.stdout:3/186: fdatasync de/f14 0 2024-09-19T07:24:51.020 INFO:tasks.workunit.client.0.smithi098.stdout:7/221: creat d5/d3e/f49 x:0 0 0 2024-09-19T07:24:51.021 INFO:tasks.workunit.client.0.smithi098.stdout:6/151: write d2/fb [4276407,104956] 0 2024-09-19T07:24:51.021 INFO:tasks.workunit.client.0.smithi098.stdout:6/152: write d2/fe [3298721,127102] 0 2024-09-19T07:24:51.022 INFO:tasks.workunit.client.0.smithi098.stdout:9/178: chown d3/dc/df/d15/d1a/d2d/c32 6 1 2024-09-19T07:24:51.022 INFO:tasks.workunit.client.0.smithi098.stdout:9/179: truncate d3/d16/d38/f36 158526 0 2024-09-19T07:24:51.024 INFO:tasks.workunit.client.0.smithi098.stdout:8/158: rmdir d0/d16 39 2024-09-19T07:24:51.025 INFO:tasks.workunit.client.0.smithi098.stdout:3/187: symlink de/df/d1f/d2b/l36 0 2024-09-19T07:24:51.027 INFO:tasks.workunit.client.0.smithi098.stdout:1/141: dwrite dc/d17/d2e/f2f [0,4194304] 0 2024-09-19T07:24:51.028 INFO:tasks.workunit.client.0.smithi098.stdout:2/135: dwrite d1/d9/f14 [0,4194304] 0 2024-09-19T07:24:51.029 INFO:tasks.workunit.client.0.smithi098.stdout:9/180: mknod d3/dc/df/d31/c39 0 2024-09-19T07:24:51.029 INFO:tasks.workunit.client.0.smithi098.stdout:9/181: write d3/dc/df/d15/d1a/d2b/f33 [546426,99920] 0 2024-09-19T07:24:51.029 INFO:tasks.workunit.client.0.smithi098.stdout:5/182: dwrite dc/f29 [0,4194304] 0 2024-09-19T07:24:51.029 INFO:tasks.workunit.client.0.smithi098.stdout:5/183: dread - dc/de/f1d zero size 2024-09-19T07:24:51.029 INFO:tasks.workunit.client.0.smithi098.stdout:5/184: stat fa 0 2024-09-19T07:24:51.030 INFO:tasks.workunit.client.0.smithi098.stdout:7/222: rename d5/d8/dc/f15 to d5/d10/f4a 0 2024-09-19T07:24:51.030 INFO:tasks.workunit.client.0.smithi098.stdout:7/223: truncate d5/d8/dc/f47 25524 0 2024-09-19T07:24:51.031 INFO:tasks.workunit.client.0.smithi098.stdout:4/168: getdents da/d31 0 2024-09-19T07:24:51.033 INFO:tasks.workunit.client.0.smithi098.stdout:5/185: dread dc/f12 [0,4194304] 0 2024-09-19T07:24:51.036 INFO:tasks.workunit.client.0.smithi098.stdout:6/153: write d2/d1b/f2f [3402675,19707] 0 2024-09-19T07:24:51.040 INFO:tasks.workunit.client.0.smithi098.stdout:2/136: mkdir d1/d2c 0 2024-09-19T07:24:51.042 INFO:tasks.workunit.client.0.smithi098.stdout:7/224: mkdir d5/d8/dc/d4b 0 2024-09-19T07:24:51.042 INFO:tasks.workunit.client.0.smithi098.stdout:7/225: fdatasync d5/d8/dc/d16/f31 0 2024-09-19T07:24:51.043 INFO:tasks.workunit.client.0.smithi098.stdout:5/186: rmdir dc/d1c/d2e 39 2024-09-19T07:24:51.044 INFO:tasks.workunit.client.0.smithi098.stdout:6/154: truncate d2/fb 3648711 0 2024-09-19T07:24:51.045 INFO:tasks.workunit.client.0.smithi098.stdout:4/169: rmdir da 39 2024-09-19T07:24:51.046 INFO:tasks.workunit.client.0.smithi098.stdout:2/137: creat d1/d9/f2d x:0 0 0 2024-09-19T07:24:51.049 INFO:tasks.workunit.client.0.smithi098.stdout:9/182: dwrite d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:51.051 INFO:tasks.workunit.client.0.smithi098.stdout:4/170: rename c7 to da/c37 0 2024-09-19T07:24:51.051 INFO:tasks.workunit.client.0.smithi098.stdout:2/138: creat d1/d9/f2e x:0 0 0 2024-09-19T07:24:51.052 INFO:tasks.workunit.client.0.smithi098.stdout:1/142: dwrite f1 [0,4194304] 0 2024-09-19T07:24:51.052 INFO:tasks.workunit.client.0.smithi098.stdout:5/187: symlink dc/de/d13/l40 0 2024-09-19T07:24:51.053 INFO:tasks.workunit.client.0.smithi098.stdout:6/155: mknod d2/d1b/c36 0 2024-09-19T07:24:51.053 INFO:tasks.workunit.client.0.smithi098.stdout:6/156: write d2/d1b/f2f [4038078,74880] 0 2024-09-19T07:24:51.054 INFO:tasks.workunit.client.0.smithi098.stdout:4/171: truncate da/fd 2761086 0 2024-09-19T07:24:51.055 INFO:tasks.workunit.client.0.smithi098.stdout:2/139: creat d1/d2c/f2f x:0 0 0 2024-09-19T07:24:51.056 INFO:tasks.workunit.client.0.smithi098.stdout:5/188: mknod dc/d1c/d23/c41 0 2024-09-19T07:24:51.056 INFO:tasks.workunit.client.0.smithi098.stdout:5/189: chown dc/de/f3f 1462 1 2024-09-19T07:24:51.056 INFO:tasks.workunit.client.0.smithi098.stdout:5/190: fdatasync dc/de/d36/f39 0 2024-09-19T07:24:51.057 INFO:tasks.workunit.client.0.smithi098.stdout:6/157: mknod d2/d5/c37 0 2024-09-19T07:24:51.058 INFO:tasks.workunit.client.0.smithi098.stdout:4/172: unlink da/l1a 0 2024-09-19T07:24:51.062 INFO:tasks.workunit.client.0.smithi098.stdout:6/158: rename d2/d11/l12 to d2/d5/d1f/l38 0 2024-09-19T07:24:51.066 INFO:tasks.workunit.client.0.smithi098.stdout:8/159: dwrite d0/de/f18 [0,4194304] 0 2024-09-19T07:24:51.066 INFO:tasks.workunit.client.0.smithi098.stdout:8/160: fdatasync d0/d1a/f1c 0 2024-09-19T07:24:51.068 INFO:tasks.workunit.client.0.smithi098.stdout:7/226: dwrite d5/d8/f24 [0,4194304] 0 2024-09-19T07:24:51.069 INFO:tasks.workunit.client.0.smithi098.stdout:1/143: dread f1 [0,4194304] 0 2024-09-19T07:24:51.082 INFO:tasks.workunit.client.0.smithi098.stdout:3/188: dwrite de/f26 [0,4194304] 0 2024-09-19T07:24:51.082 INFO:tasks.workunit.client.0.smithi098.stdout:9/183: dwrite d3/dc/df/d15/f28 [0,4194304] 0 2024-09-19T07:24:51.082 INFO:tasks.workunit.client.0.smithi098.stdout:5/191: dwrite dc/d1c/f24 [0,4194304] 0 2024-09-19T07:24:51.083 INFO:tasks.workunit.client.0.smithi098.stdout:9/184: dread d3/dc/df/d15/d1b/f29 [0,4194304] 0 2024-09-19T07:24:51.089 INFO:tasks.workunit.client.0.smithi098.stdout:4/173: dwrite da/d31/f35 [0,4194304] 0 2024-09-19T07:24:51.094 INFO:tasks.workunit.client.0.smithi098.stdout:8/161: rename d0/de/d12/l2b to d0/de/d28/l30 0 2024-09-19T07:24:51.097 INFO:tasks.workunit.client.0.smithi098.stdout:5/192: dread dc/de/f2a [0,4194304] 0 2024-09-19T07:24:51.097 INFO:tasks.workunit.client.0.smithi098.stdout:5/193: fsync dc/f12 0 2024-09-19T07:24:51.097 INFO:tasks.workunit.client.0.smithi098.stdout:5/194: write dc/de/d36/f39 [2850748,41059] 0 2024-09-19T07:24:51.097 INFO:tasks.workunit.client.0.smithi098.stdout:5/195: chown f3 1 1 2024-09-19T07:24:51.097 INFO:tasks.workunit.client.0.smithi098.stdout:3/189: dread de/f26 [0,4194304] 0 2024-09-19T07:24:51.101 INFO:tasks.workunit.client.0.smithi098.stdout:8/162: dread d0/d16/f17 [0,4194304] 0 2024-09-19T07:24:51.102 INFO:tasks.workunit.client.0.smithi098.stdout:1/144: mkdir dc/d17/d1b/d1d/d30 0 2024-09-19T07:24:51.114 INFO:tasks.workunit.client.0.smithi098.stdout:9/185: creat d3/dc/df/d15/d1a/d2d/f3a x:0 0 0 2024-09-19T07:24:51.123 INFO:tasks.workunit.client.0.smithi098.stdout:6/159: mknod d2/c39 0 2024-09-19T07:24:51.123 INFO:tasks.workunit.client.0.smithi098.stdout:6/160: write f1 [2342805,115596] 0 2024-09-19T07:24:51.135 INFO:tasks.workunit.client.0.smithi098.stdout:7/227: rename d5/d8/dc/l17 to d5/d10/d1d/l4c 0 2024-09-19T07:24:51.138 INFO:tasks.workunit.client.0.smithi098.stdout:5/196: symlink dc/de/d13/d3b/l42 0 2024-09-19T07:24:51.140 INFO:tasks.workunit.client.0.smithi098.stdout:3/190: creat de/df/f37 x:0 0 0 2024-09-19T07:24:51.140 INFO:tasks.workunit.client.0.smithi098.stdout:3/191: write f9 [1270158,13614] 0 2024-09-19T07:24:51.142 INFO:tasks.workunit.client.0.smithi098.stdout:8/163: rename d0/de/l2f to d0/de/l31 0 2024-09-19T07:24:51.146 INFO:tasks.workunit.client.0.smithi098.stdout:9/186: getdents d3/dc/df/d15/d1b 0 2024-09-19T07:24:51.146 INFO:tasks.workunit.client.0.smithi098.stdout:9/187: write d3/dc/df/d15/d1a/d2b/f33 [1596524,112985] 0 2024-09-19T07:24:51.146 INFO:tasks.workunit.client.0.smithi098.stdout:9/188: write d3/d16/d38/f26 [940789,118082] 0 2024-09-19T07:24:51.152 INFO:tasks.workunit.client.0.smithi098.stdout:9/189: dread d3/d16/d38/f26 [0,4194304] 0 2024-09-19T07:24:51.157 INFO:tasks.workunit.client.0.smithi098.stdout:5/197: dread dc/f17 [0,4194304] 0 2024-09-19T07:24:51.158 INFO:tasks.workunit.client.0.smithi098.stdout:7/228: dwrite d5/d8/fa [0,4194304] 0 2024-09-19T07:24:51.158 INFO:tasks.workunit.client.0.smithi098.stdout:7/229: dread - d5/d8/dc/f42 zero size 2024-09-19T07:24:51.158 INFO:tasks.workunit.client.0.smithi098.stdout:7/230: fsync d5/d8/dc/d16/f45 0 2024-09-19T07:24:51.162 INFO:tasks.workunit.client.0.smithi098.stdout:8/164: unlink d0/l9 0 2024-09-19T07:24:51.164 INFO:tasks.workunit.client.0.smithi098.stdout:9/190: mknod d3/dc/df/d15/d1b/c3b 0 2024-09-19T07:24:51.164 INFO:tasks.workunit.client.0.smithi098.stdout:9/191: dread - d3/dc/df/d15/d1a/d2d/f3a zero size 2024-09-19T07:24:51.167 INFO:tasks.workunit.client.0.smithi098.stdout:5/198: link dc/de/d13/f14 dc/d1c/d2e/d37/f43 0 2024-09-19T07:24:51.168 INFO:tasks.workunit.client.0.smithi098.stdout:8/165: dread d0/de/f27 [0,4194304] 0 2024-09-19T07:24:51.169 INFO:tasks.workunit.client.0.smithi098.stdout:7/231: unlink d5/d8/dc/d16/f45 0 2024-09-19T07:24:51.169 INFO:tasks.workunit.client.0.smithi098.stdout:7/232: fdatasync d5/d8/dc/f42 0 2024-09-19T07:24:51.175 INFO:tasks.workunit.client.0.smithi098.stdout:9/192: stat d3/d6/d8/l23 0 2024-09-19T07:24:51.175 INFO:tasks.workunit.client.0.smithi098.stdout:9/193: chown d3/dc/df/d15/d1a/d2b/f33 193302 1 2024-09-19T07:24:51.180 INFO:tasks.workunit.client.0.smithi098.stdout:8/166: rename d0/lb to d0/de/d28/l32 0 2024-09-19T07:24:51.181 INFO:tasks.workunit.client.0.smithi098.stdout:9/194: creat d3/d16/f3c x:0 0 0 2024-09-19T07:24:51.182 INFO:tasks.workunit.client.0.smithi098.stdout:9/195: write d3/d16/f3c [77565,85507] 0 2024-09-19T07:24:51.184 INFO:tasks.workunit.client.0.smithi098.stdout:5/199: link dc/ld dc/d1c/l44 0 2024-09-19T07:24:51.184 INFO:tasks.workunit.client.0.smithi098.stdout:5/200: dread - dc/de/d13/f27 zero size 2024-09-19T07:24:51.184 INFO:tasks.workunit.client.0.smithi098.stdout:5/201: dread - dc/d1c/d2e/f33 zero size 2024-09-19T07:24:51.184 INFO:tasks.workunit.client.0.smithi098.stdout:5/202: chown dc/de/d13/f21 63846350 1 2024-09-19T07:24:51.186 INFO:tasks.workunit.client.0.smithi098.stdout:7/233: dwrite d5/d3e/f49 [0,4194304] 0 2024-09-19T07:24:51.187 INFO:tasks.workunit.client.0.smithi098.stdout:8/167: mkdir d0/d33 0 2024-09-19T07:24:51.190 INFO:tasks.workunit.client.0.smithi098.stdout:9/196: mknod d3/dc/df/d15/c3d 0 2024-09-19T07:24:51.191 INFO:tasks.workunit.client.0.smithi098.stdout:5/203: creat dc/de/d13/d3b/f45 x:0 0 0 2024-09-19T07:24:51.191 INFO:tasks.workunit.client.0.smithi098.stdout:5/204: fsync dc/de/d13/f14 0 2024-09-19T07:24:51.192 INFO:tasks.workunit.client.0.smithi098.stdout:5/205: chown dc/de 258689 1 2024-09-19T07:24:51.193 INFO:tasks.workunit.client.0.smithi098.stdout:8/168: write d0/d16/f17 [1676258,85390] 0 2024-09-19T07:24:51.194 INFO:tasks.workunit.client.0.smithi098.stdout:7/234: mknod d5/c4d 0 2024-09-19T07:24:51.194 INFO:tasks.workunit.client.0.smithi098.stdout:7/235: fsync d5/d8/f21 0 2024-09-19T07:24:51.195 INFO:tasks.workunit.client.0.smithi098.stdout:9/197: creat d3/d16/f3e x:0 0 0 2024-09-19T07:24:51.196 INFO:tasks.workunit.client.0.smithi098.stdout:5/206: stat dc/de/l30 0 2024-09-19T07:24:51.199 INFO:tasks.workunit.client.0.smithi098.stdout:8/169: rename d0/l3 to d0/de/l34 0 2024-09-19T07:24:51.204 INFO:tasks.workunit.client.0.smithi098.stdout:9/198: rmdir d3/dc/df/d15/d1a/d2d 39 2024-09-19T07:24:51.204 INFO:tasks.workunit.client.0.smithi098.stdout:9/199: write d3/dc/df/d15/d1a/d2d/f3a [111810,48030] 0 2024-09-19T07:24:51.204 INFO:tasks.workunit.client.0.smithi098.stdout:9/200: write d3/d16/d38/f26 [1596144,63815] 0 2024-09-19T07:24:51.209 INFO:tasks.workunit.client.0.smithi098.stdout:3/192: chown de/df/d1f/l30 1798698 1 2024-09-19T07:24:51.209 INFO:tasks.workunit.client.0.smithi098.stdout:5/207: dread fa [0,4194304] 0 2024-09-19T07:24:51.211 INFO:tasks.workunit.client.0.smithi098.stdout:5/208: rmdir dc/d1c 39 2024-09-19T07:24:51.212 INFO:tasks.workunit.client.0.smithi098.stdout:7/236: dwrite d5/d10/d1d/f2a [0,4194304] 0 2024-09-19T07:24:51.212 INFO:tasks.workunit.client.0.smithi098.stdout:7/237: chown d5/l33 15 1 2024-09-19T07:24:51.212 INFO:tasks.workunit.client.0.smithi098.stdout:9/201: dread d3/dc/df/d15/f28 [0,4194304] 0 2024-09-19T07:24:51.214 INFO:tasks.workunit.client.0.smithi098.stdout:3/193: mknod de/df/d1f/d2b/c38 0 2024-09-19T07:24:51.218 INFO:tasks.workunit.client.0.smithi098.stdout:9/202: read d3/d16/d38/f2e [2379446,78520] 0 2024-09-19T07:24:51.218 INFO:tasks.workunit.client.0.smithi098.stdout:9/203: write d3/dc/df/d15/d1b/f29 [1388516,9291] 0 2024-09-19T07:24:51.218 INFO:tasks.workunit.client.0.smithi098.stdout:6/161: write d2/d1b/f2f [597594,50994] 0 2024-09-19T07:24:51.224 INFO:tasks.workunit.client.0.smithi098.stdout:6/162: getdents d2/d5/d1f/d26 0 2024-09-19T07:24:51.224 INFO:tasks.workunit.client.0.smithi098.stdout:6/163: chown d2/d5 162 1 2024-09-19T07:24:51.224 INFO:tasks.workunit.client.0.smithi098.stdout:8/170: dwrite d0/f25 [0,4194304] 0 2024-09-19T07:24:51.224 INFO:tasks.workunit.client.0.smithi098.stdout:7/238: creat d5/d8/f4e x:0 0 0 2024-09-19T07:24:51.224 INFO:tasks.workunit.client.0.smithi098.stdout:7/239: chown d5/d8/f34 37650 1 2024-09-19T07:24:51.224 INFO:tasks.workunit.client.0.smithi098.stdout:7/240: read d5/d8/dc/fe [1059438,117138] 0 2024-09-19T07:24:51.224 INFO:tasks.workunit.client.0.smithi098.stdout:7/241: truncate d5/d8/f4e 64681 0 2024-09-19T07:24:51.225 INFO:tasks.workunit.client.0.smithi098.stdout:3/194: getdents de/df 0 2024-09-19T07:24:51.227 INFO:tasks.workunit.client.0.smithi098.stdout:2/140: sync 2024-09-19T07:24:51.227 INFO:tasks.workunit.client.0.smithi098.stdout:0/161: sync 2024-09-19T07:24:51.227 INFO:tasks.workunit.client.0.smithi098.stdout:0/162: chown d5/d20/l2a 3751688 1 2024-09-19T07:24:51.227 INFO:tasks.workunit.client.0.smithi098.stdout:0/163: write d5/d20/d14/f2c [1008027,45042] 0 2024-09-19T07:24:51.227 INFO:tasks.workunit.client.0.smithi098.stdout:0/164: fsync d5/d20/f12 0 2024-09-19T07:24:51.228 INFO:tasks.workunit.client.0.smithi098.stdout:1/145: mkdir dc/de/d22/d31 0 2024-09-19T07:24:51.229 INFO:tasks.workunit.client.0.smithi098.stdout:5/209: rename dc/d1c to dc/de/d13/d46 0 2024-09-19T07:24:51.229 INFO:tasks.workunit.client.0.smithi098.stdout:5/210: truncate dc/de/d13/d46/d2e/f2f 4661280 0 2024-09-19T07:24:51.230 INFO:tasks.workunit.client.0.smithi098.stdout:4/174: creat da/d31/f38 x:0 0 0 2024-09-19T07:24:51.232 INFO:tasks.workunit.client.0.smithi098.stdout:8/171: creat d0/de/d28/f35 x:0 0 0 2024-09-19T07:24:51.232 INFO:tasks.workunit.client.0.smithi098.stdout:8/172: fsync d0/d16/f23 0 2024-09-19T07:24:51.234 INFO:tasks.workunit.client.0.smithi098.stdout:4/175: unlink da/c22 0 2024-09-19T07:24:51.235 INFO:tasks.workunit.client.0.smithi098.stdout:9/204: symlink d3/dc/df/d15/d1a/d2b/l3f 0 2024-09-19T07:24:51.236 INFO:tasks.workunit.client.0.smithi098.stdout:2/141: creat d1/d2c/f30 x:0 0 0 2024-09-19T07:24:51.237 INFO:tasks.workunit.client.0.smithi098.stdout:1/146: mknod dc/c32 0 2024-09-19T07:24:51.237 INFO:tasks.workunit.client.0.smithi098.stdout:5/211: mknod dc/de/d13/d46/c47 0 2024-09-19T07:24:51.238 INFO:tasks.workunit.client.0.smithi098.stdout:7/242: mkdir d5/d8/dc/d16/d4f 0 2024-09-19T07:24:51.239 INFO:tasks.workunit.client.0.smithi098.stdout:3/195: truncate de/f25 308918 0 2024-09-19T07:24:51.239 INFO:tasks.workunit.client.0.smithi098.stdout:3/196: fdatasync fc 0 2024-09-19T07:24:51.240 INFO:tasks.workunit.client.0.smithi098.stdout:9/205: mknod d3/d16/d38/c40 0 2024-09-19T07:24:51.244 INFO:tasks.workunit.client.0.smithi098.stdout:2/142: rename d1/da/db/l1c to d1/d9/d1d/l31 0 2024-09-19T07:24:51.244 INFO:tasks.workunit.client.0.smithi098.stdout:2/143: write d1/d9/f1b [4856285,66789] 0 2024-09-19T07:24:51.245 INFO:tasks.workunit.client.0.smithi098.stdout:1/147: creat dc/f33 x:0 0 0 2024-09-19T07:24:51.248 INFO:tasks.workunit.client.0.smithi098.stdout:5/212: mknod dc/de/d13/d46/d2e/c48 0 2024-09-19T07:24:51.250 INFO:tasks.workunit.client.0.smithi098.stdout:1/148: mknod dc/de/d22/d31/c34 0 2024-09-19T07:24:51.252 INFO:tasks.workunit.client.0.smithi098.stdout:1/149: dread dc/de/f21 [0,4194304] 0 2024-09-19T07:24:51.253 INFO:tasks.workunit.client.0.smithi098.stdout:9/206: creat d3/f41 x:0 0 0 2024-09-19T07:24:51.253 INFO:tasks.workunit.client.0.smithi098.stdout:9/207: write d3/d16/d38/f36 [302651,116951] 0 2024-09-19T07:24:51.254 INFO:tasks.workunit.client.0.smithi098.stdout:5/213: mkdir dc/de/d13/d46/d23/d49 0 2024-09-19T07:24:51.256 INFO:tasks.workunit.client.0.smithi098.stdout:7/243: mkdir d5/d10/d50 0 2024-09-19T07:24:51.256 INFO:tasks.workunit.client.0.smithi098.stdout:7/244: write d5/d10/f4a [3848958,99953] 0 2024-09-19T07:24:51.257 INFO:tasks.workunit.client.0.smithi098.stdout:9/208: creat d3/dc/df/d15/d1a/d2d/f42 x:0 0 0 2024-09-19T07:24:51.260 INFO:tasks.workunit.client.0.smithi098.stdout:0/165: dwrite d5/f7 [0,4194304] 0 2024-09-19T07:24:51.260 INFO:tasks.workunit.client.0.smithi098.stdout:7/245: link d5/d8/dc/f3a d5/d10/d1d/f51 0 2024-09-19T07:24:51.260 INFO:tasks.workunit.client.0.smithi098.stdout:5/214: read dc/de/f2a [1299791,97481] 0 2024-09-19T07:24:51.261 INFO:tasks.workunit.client.0.smithi098.stdout:6/164: dwrite d2/d5/f14 [0,4194304] 0 2024-09-19T07:24:51.262 INFO:tasks.workunit.client.0.smithi098.stdout:9/209: mkdir d3/d16/d43 0 2024-09-19T07:24:51.266 INFO:tasks.workunit.client.0.smithi098.stdout:7/246: dread d5/d8/dc/d16/f31 [0,4194304] 0 2024-09-19T07:24:51.266 INFO:tasks.workunit.client.0.smithi098.stdout:8/173: dwrite d0/de/d28/f35 [0,4194304] 0 2024-09-19T07:24:51.267 INFO:tasks.workunit.client.0.smithi098.stdout:0/166: symlink d5/d20/d14/l2f 0 2024-09-19T07:24:51.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:51.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000bcb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000bcc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_hold) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000bca (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_over) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: Scrub error on inode 0x10000000bcd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_no_en) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:51.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:51.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:51.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:51.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000024b4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_boot_aggregate.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000024b3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_measure.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000024b6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_mmap.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000024b5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000025a0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_capable_net.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000025a1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000025a2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_bind.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: Scrub error on inode 0x100000025a3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_raw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:51.275 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: active paths [/] 2024-09-19T07:24:51.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:50 smithi098 ceph-mon[30950]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.276 INFO:tasks.workunit.client.0.smithi098.stdout:5/215: mknod dc/c4a 0 2024-09-19T07:24:51.276 INFO:tasks.workunit.client.0.smithi098.stdout:7/247: mkdir d5/d8/d52 0 2024-09-19T07:24:51.277 INFO:tasks.workunit.client.0.smithi098.stdout:6/165: dread d2/fe [0,4194304] 0 2024-09-19T07:24:51.277 INFO:tasks.workunit.client.0.smithi098.stdout:5/216: creat dc/de/d36/f4b x:0 0 0 2024-09-19T07:24:51.277 INFO:tasks.workunit.client.0.smithi098.stdout:5/217: readlink dc/de/l30 0 2024-09-19T07:24:51.278 INFO:tasks.workunit.client.0.smithi098.stdout:5/218: truncate dc/de/d13/f19 244000 0 2024-09-19T07:24:51.282 INFO:tasks.workunit.client.0.smithi098.stdout:4/176: getdents da 0 2024-09-19T07:24:51.283 INFO:tasks.workunit.client.0.smithi098.stdout:2/144: dwrite d1/d5/fe [4194304,4194304] 0 2024-09-19T07:24:51.284 INFO:tasks.workunit.client.0.smithi098.stdout:4/177: write da/f23 [446472,60115] 0 2024-09-19T07:24:51.284 INFO:tasks.workunit.client.0.smithi098.stdout:4/178: fsync f9 0 2024-09-19T07:24:51.284 INFO:tasks.workunit.client.0.smithi098.stdout:4/179: write f8 [2043947,53898] 0 2024-09-19T07:24:51.286 INFO:tasks.workunit.client.0.smithi098.stdout:1/150: dwrite f1 [0,4194304] 0 2024-09-19T07:24:51.286 INFO:tasks.workunit.client.0.smithi098.stdout:8/174: dread d0/d16/f17 [0,4194304] 0 2024-09-19T07:24:51.287 INFO:tasks.workunit.client.0.smithi098.stdout:2/145: creat d1/da/f32 x:0 0 0 2024-09-19T07:24:51.287 INFO:tasks.workunit.client.0.smithi098.stdout:4/180: write da/f11 [1879923,74861] 0 2024-09-19T07:24:51.288 INFO:tasks.workunit.client.0.smithi098.stdout:1/151: write dc/de/f13 [4044014,113320] 0 2024-09-19T07:24:51.289 INFO:tasks.workunit.client.0.smithi098.stdout:1/152: write dc/f28 [11891,113247] 0 2024-09-19T07:24:51.290 INFO:tasks.workunit.client.0.smithi098.stdout:8/175: unlink d0/de/c11 0 2024-09-19T07:24:51.292 INFO:tasks.workunit.client.0.smithi098.stdout:7/248: dread d5/d10/f32 [0,4194304] 0 2024-09-19T07:24:51.292 INFO:tasks.workunit.client.0.smithi098.stdout:4/181: stat l1 0 2024-09-19T07:24:51.293 INFO:tasks.workunit.client.0.smithi098.stdout:6/166: write d2/f1a [326226,102359] 0 2024-09-19T07:24:51.293 INFO:tasks.workunit.client.0.smithi098.stdout:8/176: dread d0/f22 [0,4194304] 0 2024-09-19T07:24:51.295 INFO:tasks.workunit.client.0.smithi098.stdout:7/249: dread d5/d8/dc/d16/f31 [0,4194304] 0 2024-09-19T07:24:51.296 INFO:tasks.workunit.client.0.smithi098.stdout:1/153: unlink dc/c20 0 2024-09-19T07:24:51.300 INFO:tasks.workunit.client.0.smithi098.stdout:4/182: unlink da/c10 0 2024-09-19T07:24:51.303 INFO:tasks.workunit.client.0.smithi098.stdout:2/146: fsync d1/da/f32 0 2024-09-19T07:24:51.303 INFO:tasks.workunit.client.0.smithi098.stdout:2/147: dread - d1/da/f32 zero size 2024-09-19T07:24:51.305 INFO:tasks.workunit.client.0.smithi098.stdout:1/154: write dc/f23 [2012068,73288] 0 2024-09-19T07:24:51.306 INFO:tasks.workunit.client.0.smithi098.stdout:1/155: mkdir dc/de/d22/d31/d35 0 2024-09-19T07:24:51.309 INFO:tasks.workunit.client.0.smithi098.stdout:5/219: dwrite dc/de/d36/f3d [0,4194304] 0 2024-09-19T07:24:51.309 INFO:tasks.workunit.client.0.smithi098.stdout:0/167: dwrite d5/f1e [0,4194304] 0 2024-09-19T07:24:51.309 INFO:tasks.workunit.client.0.smithi098.stdout:0/168: write d5/d20/f1b [881441,22748] 0 2024-09-19T07:24:51.309 INFO:tasks.workunit.client.0.smithi098.stdout:3/197: rename fc to de/df/d1f/d2b/f39 0 2024-09-19T07:24:51.310 INFO:tasks.workunit.client.0.smithi098.stdout:3/198: write f4 [777740,95283] 0 2024-09-19T07:24:51.314 INFO:tasks.workunit.client.0.smithi098.stdout:0/169: rmdir d5/d20 39 2024-09-19T07:24:51.314 INFO:tasks.workunit.client.0.smithi098.stdout:4/183: dread f9 [0,4194304] 0 2024-09-19T07:24:51.316 INFO:tasks.workunit.client.0.smithi098.stdout:9/210: rename d3/c11 to d3/dc/df/d15/d1a/d2d/c44 0 2024-09-19T07:24:51.316 INFO:tasks.workunit.client.0.smithi098.stdout:4/184: creat da/d31/f39 x:0 0 0 2024-09-19T07:24:51.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000bcb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000bcc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_hold) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000bca (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_over) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: Scrub error on inode 0x10000000bcd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_no_en) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000024b4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_boot_aggregate.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000024b3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_measure.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000024b6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_mmap.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000024b5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000025a0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_capable_net.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000025a1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000025a2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_bind.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: Scrub error on inode 0x100000025a3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_raw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:51.318 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:51.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: active paths [/] 2024-09-19T07:24:51.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.319 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:50 smithi139 ceph-mon[35039]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.319 INFO:tasks.workunit.client.0.smithi098.stdout:0/170: unlink d5/f27 0 2024-09-19T07:24:51.323 INFO:tasks.workunit.client.0.smithi098.stdout:8/177: rename d0/de/l34 to d0/de/d28/l36 0 2024-09-19T07:24:51.323 INFO:tasks.workunit.client.0.smithi098.stdout:9/211: mknod d3/c45 0 2024-09-19T07:24:51.325 INFO:tasks.workunit.client.0.smithi098.stdout:5/220: dread dc/de/d13/d46/d2e/d37/f43 [0,4194304] 0 2024-09-19T07:24:51.326 INFO:tasks.workunit.client.0.smithi098.stdout:1/156: write dc/d17/d2e/f2f [1296821,53537] 0 2024-09-19T07:24:51.327 INFO:tasks.workunit.client.0.smithi098.stdout:6/167: dwrite d2/d11/f24 [0,4194304] 0 2024-09-19T07:24:51.327 INFO:tasks.workunit.client.0.smithi098.stdout:6/168: write d2/d1b/f1d [841758,55871] 0 2024-09-19T07:24:51.327 INFO:tasks.workunit.client.0.smithi098.stdout:6/169: write d2/fe [1682562,113508] 0 2024-09-19T07:24:51.330 INFO:tasks.workunit.client.0.smithi098.stdout:6/170: creat d2/d1b/f3a x:0 0 0 2024-09-19T07:24:51.334 INFO:tasks.workunit.client.0.smithi098.stdout:6/171: unlink d2/c17 0 2024-09-19T07:24:51.334 INFO:tasks.workunit.client.0.smithi098.stdout:8/178: dread d0/d16/f17 [0,4194304] 0 2024-09-19T07:24:51.334 INFO:tasks.workunit.client.0.smithi098.stdout:8/179: stat d0/de/d28/c2d 0 2024-09-19T07:24:51.339 INFO:tasks.workunit.client.0.smithi098.stdout:7/250: dwrite d5/d8/f34 [0,4194304] 0 2024-09-19T07:24:51.344 INFO:tasks.workunit.client.0.smithi098.stdout:6/172: write d2/d11/f24 [2291993,32601] 0 2024-09-19T07:24:51.344 INFO:tasks.workunit.client.0.smithi098.stdout:6/173: dread - d2/d5/d1f/d26/f33 zero size 2024-09-19T07:24:51.344 INFO:tasks.workunit.client.0.smithi098.stdout:2/148: dwrite d1/da/f18 [0,4194304] 0 2024-09-19T07:24:51.356 INFO:tasks.workunit.client.0.smithi098.stdout:6/174: creat d2/d5/f3b x:0 0 0 2024-09-19T07:24:51.356 INFO:tasks.workunit.client.0.smithi098.stdout:2/149: creat d1/d9/f33 x:0 0 0 2024-09-19T07:24:51.356 INFO:tasks.workunit.client.0.smithi098.stdout:7/251: dread d5/d8/f24 [0,4194304] 0 2024-09-19T07:24:51.356 INFO:tasks.workunit.client.0.smithi098.stdout:3/199: rename de/df/d1f/f27 to de/df/d1f/d2b/f3a 0 2024-09-19T07:24:51.356 INFO:tasks.workunit.client.0.smithi098.stdout:3/200: read f0 [1904000,94791] 0 2024-09-19T07:24:51.357 INFO:tasks.workunit.client.0.smithi098.stdout:0/171: dwrite d5/d20/f12 [4194304,4194304] 0 2024-09-19T07:24:51.357 INFO:tasks.workunit.client.0.smithi098.stdout:0/172: chown d5/d20/d1f/l2b 531526046 1 2024-09-19T07:24:51.358 INFO:tasks.workunit.client.0.smithi098.stdout:1/157: rename c3 to dc/d2a/c36 0 2024-09-19T07:24:51.358 INFO:tasks.workunit.client.0.smithi098.stdout:1/158: write dc/de/f13 [6142706,47813] 0 2024-09-19T07:24:51.358 INFO:tasks.workunit.client.0.smithi098.stdout:9/212: dwrite d3/d16/d38/f2e [4194304,4194304] 0 2024-09-19T07:24:51.358 INFO:tasks.workunit.client.0.smithi098.stdout:9/213: dread - d3/dc/df/d15/d1a/d2d/f42 zero size 2024-09-19T07:24:51.359 INFO:tasks.workunit.client.0.smithi098.stdout:5/221: dwrite f4 [0,4194304] 0 2024-09-19T07:24:51.360 INFO:tasks.workunit.client.0.smithi098.stdout:0/173: creat d5/f30 x:0 0 0 2024-09-19T07:24:51.361 INFO:tasks.workunit.client.0.smithi098.stdout:8/180: rename d0/de/l31 to d0/de/d12/l37 0 2024-09-19T07:24:51.365 INFO:tasks.workunit.client.0.smithi098.stdout:1/159: mkdir dc/de/d37 0 2024-09-19T07:24:51.366 INFO:tasks.workunit.client.0.smithi098.stdout:0/174: fsync d5/f22 0 2024-09-19T07:24:51.366 INFO:tasks.workunit.client.0.smithi098.stdout:0/175: readlink d5/d20/ld 0 2024-09-19T07:24:51.368 INFO:tasks.workunit.client.0.smithi098.stdout:7/252: rename d5/d8/fa to d5/f53 0 2024-09-19T07:24:51.369 INFO:tasks.workunit.client.0.smithi098.stdout:9/214: mkdir d3/d6/d46 0 2024-09-19T07:24:51.371 INFO:tasks.workunit.client.0.smithi098.stdout:0/176: creat d5/f31 x:0 0 0 2024-09-19T07:24:51.373 INFO:tasks.workunit.client.0.smithi098.stdout:7/253: creat d5/d10/d50/f54 x:0 0 0 2024-09-19T07:24:51.375 INFO:tasks.workunit.client.0.smithi098.stdout:9/215: mknod d3/dc/df/d15/d2f/c47 0 2024-09-19T07:24:51.376 INFO:tasks.workunit.client.0.smithi098.stdout:9/216: fsync d3/dc/df/d15/d1a/d2d/f42 0 2024-09-19T07:24:51.377 INFO:tasks.workunit.client.0.smithi098.stdout:9/217: mkdir d3/d16/d38/d48 0 2024-09-19T07:24:51.377 INFO:tasks.workunit.client.0.smithi098.stdout:8/181: dread d0/de/f18 [0,4194304] 0 2024-09-19T07:24:51.378 INFO:tasks.workunit.client.0.smithi098.stdout:2/150: dwrite d1/d9/f28 [4194304,4194304] 0 2024-09-19T07:24:51.379 INFO:tasks.workunit.client.0.smithi098.stdout:9/218: mkdir d3/dc/df/d15/d1a/d2b/d49 0 2024-09-19T07:24:51.381 INFO:tasks.workunit.client.0.smithi098.stdout:9/219: mknod d3/dc/df/d15/d1a/d2b/d49/c4a 0 2024-09-19T07:24:51.381 INFO:tasks.workunit.client.0.smithi098.stdout:0/177: write d5/f18 [2549362,117102] 0 2024-09-19T07:24:51.381 INFO:tasks.workunit.client.0.smithi098.stdout:2/151: mkdir d1/d5/d34 0 2024-09-19T07:24:51.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:51.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000bcb (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000bcc (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_hold) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000bca (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_over) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: Scrub error on inode 0x10000000bcd (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_no_en) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:51.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:51.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:51.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:51.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000024b4 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_boot_aggregate.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000024b3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_measure.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000024b6 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_mmap.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000024b5 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:51.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000025a0 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_capable_net.sh) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000025a1 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/Makefile) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000025a2 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_bind.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: Scrub error on inode 0x100000025a3 (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_raw.c) see mds.i log and `damage ls` output for details 2024-09-19T07:24:51.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:51.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:51.384 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.385 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: active paths [/] 2024-09-19T07:24:51.385 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.385 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:50 smithi162 ceph-mon[35726]: scrub summary: idle+waiting paths [/] 2024-09-19T07:24:51.385 INFO:tasks.workunit.client.0.smithi098.stdout:5/222: dwrite f0 [0,4194304] 0 2024-09-19T07:24:51.385 INFO:tasks.workunit.client.0.smithi098.stdout:9/220: creat d3/dc/df/d15/d2f/f4b x:0 0 0 2024-09-19T07:24:51.385 INFO:tasks.workunit.client.0.smithi098.stdout:2/152: mkdir d1/d9/d26/d35 0 2024-09-19T07:24:51.390 INFO:tasks.workunit.client.0.smithi098.stdout:9/221: symlink d3/dc/df/l4c 0 2024-09-19T07:24:51.390 INFO:tasks.workunit.client.0.smithi098.stdout:9/222: dread - d3/dc/df/d15/d2f/f4b zero size 2024-09-19T07:24:51.391 INFO:tasks.workunit.client.0.smithi098.stdout:5/223: symlink dc/de/l4c 0 2024-09-19T07:24:51.392 INFO:tasks.workunit.client.0.smithi098.stdout:6/175: link f1 d2/f3c 0 2024-09-19T07:24:51.392 INFO:tasks.workunit.client.0.smithi098.stdout:1/160: dwrite dc/de/f13 [0,4194304] 0 2024-09-19T07:24:51.393 INFO:tasks.workunit.client.0.smithi098.stdout:1/161: readlink dc/l14 0 2024-09-19T07:24:51.394 INFO:tasks.workunit.client.0.smithi098.stdout:6/176: symlink d2/d1b/l3d 0 2024-09-19T07:24:51.395 INFO:tasks.workunit.client.0.smithi098.stdout:6/177: getdents d2/d5 0 2024-09-19T07:24:51.395 INFO:tasks.workunit.client.0.smithi098.stdout:6/178: write d2/d1b/f34 [413096,36888] 0 2024-09-19T07:24:51.395 INFO:tasks.workunit.client.0.smithi098.stdout:1/162: rmdir dc/d17/d2e 39 2024-09-19T07:24:51.396 INFO:tasks.workunit.client.0.smithi098.stdout:6/179: unlink d2/d1b/c36 0 2024-09-19T07:24:51.398 INFO:tasks.workunit.client.0.smithi098.stdout:6/180: truncate d2/fc 5813618 0 2024-09-19T07:24:51.400 INFO:tasks.workunit.client.0.smithi098.stdout:6/181: creat d2/f3e x:0 0 0 2024-09-19T07:24:51.400 INFO:tasks.workunit.client.0.smithi098.stdout:1/163: mkdir dc/de/d38 0 2024-09-19T07:24:51.400 INFO:tasks.workunit.client.0.smithi098.stdout:1/164: chown dc/de/d22/d31/c34 0 1 2024-09-19T07:24:51.401 INFO:tasks.workunit.client.0.smithi098.stdout:4/185: sync 2024-09-19T07:24:51.401 INFO:tasks.workunit.client.0.smithi098.stdout:3/201: rename de/df/d1f/l21 to de/df/d31/l3b 0 2024-09-19T07:24:51.401 INFO:tasks.workunit.client.0.smithi098.stdout:3/202: chown de/df/d1f/d2b/c38 933337433 1 2024-09-19T07:24:51.402 INFO:tasks.workunit.client.0.smithi098.stdout:1/165: creat dc/d17/d2e/f39 x:0 0 0 2024-09-19T07:24:51.402 INFO:tasks.workunit.client.0.smithi098.stdout:1/166: truncate dc/d17/d2e/f39 138342 0 2024-09-19T07:24:51.403 INFO:tasks.workunit.client.0.smithi098.stdout:6/182: link d2/d5/c15 d2/d5/d1f/c3f 0 2024-09-19T07:24:51.403 INFO:tasks.workunit.client.0.smithi098.stdout:1/167: dread dc/de/f21 [0,4194304] 0 2024-09-19T07:24:51.403 INFO:tasks.workunit.client.0.smithi098.stdout:3/203: write de/df/d1f/d2b/f3a [130114,119560] 0 2024-09-19T07:24:51.404 INFO:tasks.workunit.client.0.smithi098.stdout:5/224: rename dc/de/d13/d46/d2e/f2f to dc/de/f4d 0 2024-09-19T07:24:51.404 INFO:tasks.workunit.client.0.smithi098.stdout:6/183: write d2/f3c [3008043,80835] 0 2024-09-19T07:24:51.405 INFO:tasks.workunit.client.0.smithi098.stdout:1/168: mknod dc/de/d22/d31/c3a 0 2024-09-19T07:24:51.405 INFO:tasks.workunit.client.0.smithi098.stdout:5/225: creat dc/de/d13/d46/d23/d49/f4e x:0 0 0 2024-09-19T07:24:51.406 INFO:tasks.workunit.client.0.smithi098.stdout:6/184: mknod d2/d11/c40 0 2024-09-19T07:24:51.407 INFO:tasks.workunit.client.0.smithi098.stdout:6/185: mknod d2/d5/c41 0 2024-09-19T07:24:51.410 INFO:tasks.workunit.client.0.smithi098.stdout:0/178: dwrite d5/f18 [0,4194304] 0 2024-09-19T07:24:51.410 INFO:tasks.workunit.client.0.smithi098.stdout:0/179: dread - d5/f31 zero size 2024-09-19T07:24:51.410 INFO:tasks.workunit.client.0.smithi098.stdout:2/153: dwrite d1/d2c/f30 [0,4194304] 0 2024-09-19T07:24:51.410 INFO:tasks.workunit.client.0.smithi098.stdout:2/154: getdents d1/d9/d26/d35 0 2024-09-19T07:24:51.412 INFO:tasks.workunit.client.0.smithi098.stdout:5/226: getdents dc/de 0 2024-09-19T07:24:51.412 INFO:tasks.workunit.client.0.smithi098.stdout:0/180: dread d5/d20/d14/f24 [0,4194304] 0 2024-09-19T07:24:51.415 INFO:tasks.workunit.client.0.smithi098.stdout:2/155: creat d1/d9/d1d/f36 x:0 0 0 2024-09-19T07:24:51.415 INFO:tasks.workunit.client.0.smithi098.stdout:5/227: mknod dc/de/d13/d46/d2e/c4f 0 2024-09-19T07:24:51.416 INFO:tasks.workunit.client.0.smithi098.stdout:6/186: truncate f1 250660 0 2024-09-19T07:24:51.421 INFO:tasks.workunit.client.0.smithi098.stdout:6/187: mkdir d2/d5/d1f/d26/d42 0 2024-09-19T07:24:51.421 INFO:tasks.workunit.client.0.smithi098.stdout:2/156: creat d1/d5/f37 x:0 0 0 2024-09-19T07:24:51.422 INFO:tasks.workunit.client.0.smithi098.stdout:6/188: fsync d2/fb 0 2024-09-19T07:24:51.422 INFO:tasks.workunit.client.0.smithi098.stdout:6/189: write d2/d1b/f3a [1000682,88217] 0 2024-09-19T07:24:51.422 INFO:tasks.workunit.client.0.smithi098.stdout:5/228: truncate dc/de/d13/d46/d23/f32 216126 0 2024-09-19T07:24:51.422 INFO:tasks.workunit.client.0.smithi098.stdout:6/190: rename d2/d1b/l23 to d2/d5/d1f/l43 0 2024-09-19T07:24:51.422 INFO:tasks.workunit.client.0.smithi098.stdout:0/181: unlink d5/l1a 0 2024-09-19T07:24:51.424 INFO:tasks.workunit.client.0.smithi098.stdout:2/157: rmdir d1 39 2024-09-19T07:24:51.424 INFO:tasks.workunit.client.0.smithi098.stdout:2/158: dread - d1/d9/f33 zero size 2024-09-19T07:24:51.424 INFO:tasks.workunit.client.0.smithi098.stdout:2/159: truncate d1/d9/f2e 241516 0 2024-09-19T07:24:51.424 INFO:tasks.workunit.client.0.smithi098.stdout:5/229: dread dc/f12 [0,4194304] 0 2024-09-19T07:24:51.425 INFO:tasks.workunit.client.0.smithi098.stdout:5/230: unlink dc/de/d13/d46/d2e/l3a 0 2024-09-19T07:24:51.433 INFO:tasks.workunit.client.0.smithi098.stdout:1/169: dwrite dc/f33 [0,4194304] 0 2024-09-19T07:24:51.434 INFO:tasks.workunit.client.0.smithi098.stdout:0/182: dread d5/f23 [0,4194304] 0 2024-09-19T07:24:51.434 INFO:tasks.workunit.client.0.smithi098.stdout:0/183: chown d5/d20/d14/c16 60187588 1 2024-09-19T07:24:51.434 INFO:tasks.workunit.client.0.smithi098.stdout:3/204: dwrite de/f25 [0,4194304] 0 2024-09-19T07:24:51.436 INFO:tasks.workunit.client.0.smithi098.stdout:0/184: creat d5/d20/d14/f32 x:0 0 0 2024-09-19T07:24:51.439 INFO:tasks.workunit.client.0.smithi098.stdout:3/205: getdents de/df/d31 0 2024-09-19T07:24:51.440 INFO:tasks.workunit.client.0.smithi098.stdout:3/206: chown de/df/d1f/l35 85 1 2024-09-19T07:24:51.440 INFO:tasks.workunit.client.0.smithi098.stdout:3/207: readlink l7 0 2024-09-19T07:24:51.441 INFO:tasks.workunit.client.0.smithi098.stdout:0/185: mknod d5/d20/d14/c33 0 2024-09-19T07:24:51.442 INFO:tasks.workunit.client.0.smithi098.stdout:6/191: dwrite d2/d5/d1f/d26/f33 [0,4194304] 0 2024-09-19T07:24:51.442 INFO:tasks.workunit.client.0.smithi098.stdout:1/170: dread dc/f23 [0,4194304] 0 2024-09-19T07:24:51.442 INFO:tasks.workunit.client.0.smithi098.stdout:6/192: write d2/d1b/f3a [1927006,55279] 0 2024-09-19T07:24:51.444 INFO:tasks.workunit.client.0.smithi098.stdout:3/208: truncate f9 91503 0 2024-09-19T07:24:51.444 INFO:tasks.workunit.client.0.smithi098.stdout:6/193: chown d2/l22 410 1 2024-09-19T07:24:51.445 INFO:tasks.workunit.client.0.smithi098.stdout:1/171: symlink dc/de/d22/l3b 0 2024-09-19T07:24:51.446 INFO:tasks.workunit.client.0.smithi098.stdout:3/209: unlink l7 0 2024-09-19T07:24:51.447 INFO:tasks.workunit.client.0.smithi098.stdout:1/172: mknod dc/d17/d2e/c3c 0 2024-09-19T07:24:51.450 INFO:tasks.workunit.client.0.smithi098.stdout:4/186: link f8 da/f3a 0 2024-09-19T07:24:51.450 INFO:tasks.workunit.client.0.smithi098.stdout:1/173: mkdir dc/d17/d1b/d1d/d3d 0 2024-09-19T07:24:51.450 INFO:tasks.workunit.client.0.smithi098.stdout:1/174: stat dc/d17/d1b/d1d/d30 0 2024-09-19T07:24:51.451 INFO:tasks.workunit.client.0.smithi098.stdout:1/175: rename dc to dc/de/d22/d3e 22 2024-09-19T07:24:51.452 INFO:tasks.workunit.client.0.smithi098.stdout:1/176: write dc/f12 [4452862,57785] 0 2024-09-19T07:24:51.452 INFO:tasks.workunit.client.0.smithi098.stdout:1/177: chown dc/l27 229943290 1 2024-09-19T07:24:51.452 INFO:tasks.workunit.client.0.smithi098.stdout:3/210: unlink de/l11 0 2024-09-19T07:24:51.454 INFO:tasks.workunit.client.0.smithi098.stdout:1/178: creat dc/d17/d1b/d1d/f3f x:0 0 0 2024-09-19T07:24:51.454 INFO:tasks.workunit.client.0.smithi098.stdout:1/179: fsync fa 0 2024-09-19T07:24:51.455 INFO:tasks.workunit.client.0.smithi098.stdout:0/186: dread f4 [0,4194304] 0 2024-09-19T07:24:51.455 INFO:tasks.workunit.client.0.smithi098.stdout:0/187: chown d5/d20/d14 3 1 2024-09-19T07:24:51.456 INFO:tasks.workunit.client.0.smithi098.stdout:3/211: getdents de/df/d16 0 2024-09-19T07:24:51.457 INFO:tasks.workunit.client.0.smithi098.stdout:3/212: chown de/f19 55 1 2024-09-19T07:24:51.457 INFO:tasks.workunit.client.0.smithi098.stdout:3/213: fdatasync f4 0 2024-09-19T07:24:51.461 INFO:tasks.workunit.client.0.smithi098.stdout:3/214: creat de/df/d16/f3c x:0 0 0 2024-09-19T07:24:51.465 INFO:tasks.workunit.client.0.smithi098.stdout:0/188: write d5/f17 [2243218,118927] 0 2024-09-19T07:24:51.466 INFO:tasks.workunit.client.0.smithi098.stdout:0/189: write d5/f25 [150669,10899] 0 2024-09-19T07:24:51.467 INFO:tasks.workunit.client.0.smithi098.stdout:0/190: write d5/d20/d14/f32 [631003,75721] 0 2024-09-19T07:24:51.467 INFO:tasks.workunit.client.0.smithi098.stdout:0/191: fsync d5/d20/f10 0 2024-09-19T07:24:51.471 INFO:tasks.workunit.client.0.smithi098.stdout:3/215: write de/f25 [3889276,45902] 0 2024-09-19T07:24:51.473 INFO:tasks.workunit.client.0.smithi098.stdout:4/187: dwrite da/f1d [4194304,4194304] 0 2024-09-19T07:24:51.476 INFO:tasks.workunit.client.0.smithi098.stdout:6/194: unlink d2/f3c 0 2024-09-19T07:24:51.476 INFO:tasks.workunit.client.0.smithi098.stdout:6/195: readlink d2/l4 0 2024-09-19T07:24:51.477 INFO:tasks.workunit.client.0.smithi098.stdout:6/196: mkdir d2/d5/d1f/d44 0 2024-09-19T07:24:51.478 INFO:tasks.workunit.client.0.smithi098.stdout:6/197: symlink d2/d5/l45 0 2024-09-19T07:24:51.479 INFO:tasks.workunit.client.0.smithi098.stdout:4/188: rename da/c1b to da/c3b 0 2024-09-19T07:24:51.483 INFO:tasks.workunit.client.0.smithi098.stdout:6/198: getdents d2 0 2024-09-19T07:24:51.484 INFO:tasks.workunit.client.0.smithi098.stdout:4/189: truncate da/f1d 5722594 0 2024-09-19T07:24:51.486 INFO:tasks.workunit.client.0.smithi098.stdout:4/190: rename da/d31/f38 to da/d31/f3c 0 2024-09-19T07:24:51.487 INFO:tasks.workunit.client.0.smithi098.stdout:4/191: creat da/f3d x:0 0 0 2024-09-19T07:24:51.488 INFO:tasks.workunit.client.0.smithi098.stdout:3/216: dwrite f4 [0,4194304] 0 2024-09-19T07:24:51.489 INFO:tasks.workunit.client.0.smithi098.stdout:4/192: truncate da/f1e 366214 0 2024-09-19T07:24:51.489 INFO:tasks.workunit.client.0.smithi098.stdout:3/217: dread f5 [0,4194304] 0 2024-09-19T07:24:51.490 INFO:tasks.workunit.client.0.smithi098.stdout:3/218: creat de/df/d31/f3d x:0 0 0 2024-09-19T07:24:51.495 INFO:tasks.workunit.client.0.smithi098.stdout:4/193: getdents da/d31 0 2024-09-19T07:24:51.496 INFO:tasks.workunit.client.0.smithi098.stdout:4/194: chown da/c25 2 1 2024-09-19T07:24:51.506 INFO:tasks.workunit.client.0.smithi098.stdout:6/199: dwrite d2/fe [0,4194304] 0 2024-09-19T07:24:51.507 INFO:tasks.workunit.client.0.smithi098.stdout:6/200: link d2/d5/d1f/c3f d2/d5/c46 0 2024-09-19T07:24:51.508 INFO:tasks.workunit.client.0.smithi098.stdout:6/201: creat d2/d5/d1f/d26/d42/f47 x:0 0 0 2024-09-19T07:24:51.513 INFO:tasks.workunit.client.0.smithi098.stdout:3/219: dwrite de/f14 [4194304,4194304] 0 2024-09-19T07:24:51.514 INFO:tasks.workunit.client.0.smithi098.stdout:7/254: sync 2024-09-19T07:24:51.514 INFO:tasks.workunit.client.0.smithi098.stdout:7/255: chown d5/d10/c30 12 1 2024-09-19T07:24:51.514 INFO:tasks.workunit.client.0.smithi098.stdout:8/182: sync 2024-09-19T07:24:51.514 INFO:tasks.workunit.client.0.smithi098.stdout:3/220: symlink de/df/l3e 0 2024-09-19T07:24:51.515 INFO:tasks.workunit.client.0.smithi098.stdout:7/256: creat d5/d10/d1d/f55 x:0 0 0 2024-09-19T07:24:51.515 INFO:tasks.workunit.client.0.smithi098.stdout:7/257: readlink d5/d10/d1d/l4c 0 2024-09-19T07:24:51.516 INFO:tasks.workunit.client.0.smithi098.stdout:3/221: mkdir de/df/d16/d2e/d3f 0 2024-09-19T07:24:51.517 INFO:tasks.workunit.client.0.smithi098.stdout:3/222: symlink de/df/l40 0 2024-09-19T07:24:51.517 INFO:tasks.workunit.client.0.smithi098.stdout:3/223: chown de/df/d31/l3b 11179714 1 2024-09-19T07:24:51.525 INFO:tasks.workunit.client.0.smithi098.stdout:7/258: dread d5/f22 [0,4194304] 0 2024-09-19T07:24:51.525 INFO:tasks.workunit.client.0.smithi098.stdout:7/259: write d5/d8/dc/f47 [690081,1229] 0 2024-09-19T07:24:51.527 INFO:tasks.workunit.client.0.smithi098.stdout:7/260: symlink d5/d10/l56 0 2024-09-19T07:24:51.529 INFO:tasks.workunit.client.0.smithi098.stdout:7/261: symlink d5/d10/l57 0 2024-09-19T07:24:51.529 INFO:tasks.workunit.client.0.smithi098.stdout:7/262: fdatasync d5/d3e/f49 0 2024-09-19T07:24:51.529 INFO:tasks.workunit.client.0.smithi098.stdout:7/263: getdents d5/d10/d1d 0 2024-09-19T07:24:51.530 INFO:tasks.workunit.client.0.smithi098.stdout:7/264: getdents d5 0 2024-09-19T07:24:51.531 INFO:tasks.workunit.client.0.smithi098.stdout:7/265: link d5/d8/dc/f42 d5/d10/d11/f58 0 2024-09-19T07:24:51.531 INFO:tasks.workunit.client.0.smithi098.stdout:7/266: write d5/d10/d1d/f51 [708234,129701] 0 2024-09-19T07:24:51.532 INFO:tasks.workunit.client.0.smithi098.stdout:6/202: dwrite d2/d1b/f3a [0,4194304] 0 2024-09-19T07:24:51.532 INFO:tasks.workunit.client.0.smithi098.stdout:8/183: dwrite d0/f7 [8388608,4194304] 0 2024-09-19T07:24:51.532 INFO:tasks.workunit.client.0.smithi098.stdout:7/267: mkdir d5/d8/dc/d4b/d59 0 2024-09-19T07:24:51.534 INFO:tasks.workunit.client.0.smithi098.stdout:8/184: link d0/de/d28/l32 d0/d2c/l38 0 2024-09-19T07:24:51.534 INFO:tasks.workunit.client.0.smithi098.stdout:8/185: fdatasync d0/de/f18 0 2024-09-19T07:24:51.534 INFO:tasks.workunit.client.0.smithi098.stdout:8/186: chown d0/de/d28/c2a 3606351 1 2024-09-19T07:24:51.534 INFO:tasks.workunit.client.0.smithi098.stdout:8/187: chown d0/d16 6 1 2024-09-19T07:24:51.536 INFO:tasks.workunit.client.0.smithi098.stdout:6/203: dread d2/d1b/f34 [0,4194304] 0 2024-09-19T07:24:51.536 INFO:tasks.workunit.client.0.smithi098.stdout:6/204: chown d2/d11/c40 271 1 2024-09-19T07:24:51.536 INFO:tasks.workunit.client.0.smithi098.stdout:6/205: chown d2/d11/c19 338443 1 2024-09-19T07:24:51.536 INFO:tasks.workunit.client.0.smithi098.stdout:7/268: rename d5/d8/dc/d16/f35 to d5/d8/dc/d16/f5a 0 2024-09-19T07:24:51.537 INFO:tasks.workunit.client.0.smithi098.stdout:6/206: mkdir d2/d5/d1f/d26/d42/d48 0 2024-09-19T07:24:51.537 INFO:tasks.workunit.client.0.smithi098.stdout:6/207: fsync d2/d1b/f34 0 2024-09-19T07:24:51.538 INFO:tasks.workunit.client.0.smithi098.stdout:6/208: creat d2/d11/f49 x:0 0 0 2024-09-19T07:24:51.539 INFO:tasks.workunit.client.0.smithi098.stdout:6/209: mkdir d2/d5/d1f/d26/d42/d48/d4a 0 2024-09-19T07:24:51.541 INFO:tasks.workunit.client.0.smithi098.stdout:7/269: dread d5/f22 [0,4194304] 0 2024-09-19T07:24:51.542 INFO:tasks.workunit.client.0.smithi098.stdout:6/210: getdents d2 0 2024-09-19T07:24:51.546 INFO:tasks.workunit.client.0.smithi098.stdout:6/211: dread d2/d1b/f2f [0,4194304] 0 2024-09-19T07:24:51.547 INFO:tasks.workunit.client.0.smithi098.stdout:7/270: fsync d5/d8/dc/f42 0 2024-09-19T07:24:51.547 INFO:tasks.workunit.client.0.smithi098.stdout:7/271: chown d5/d8/f24 7 1 2024-09-19T07:24:51.551 INFO:tasks.workunit.client.0.smithi098.stdout:6/212: dread d2/fc [0,4194304] 0 2024-09-19T07:24:51.558 INFO:tasks.workunit.client.0.smithi098.stdout:8/188: dwrite d0/d16/f17 [0,4194304] 0 2024-09-19T07:24:51.563 INFO:tasks.workunit.client.0.smithi098.stdout:6/213: write d2/d5/f16 [155284,117011] 0 2024-09-19T07:24:51.565 INFO:tasks.workunit.client.0.smithi098.stdout:7/272: dwrite d5/d8/dc/f3a [0,4194304] 0 2024-09-19T07:24:51.565 INFO:tasks.workunit.client.0.smithi098.stdout:7/273: fsync d5/d8/dc/fe 0 2024-09-19T07:24:51.567 INFO:tasks.workunit.client.0.smithi098.stdout:9/223: sync 2024-09-19T07:24:51.567 INFO:tasks.workunit.client.0.smithi098.stdout:9/224: write d3/d16/f3c [336226,85055] 0 2024-09-19T07:24:51.568 INFO:tasks.workunit.client.0.smithi098.stdout:9/225: dread d3/dc/df/d15/d1a/d2d/f3a [0,4194304] 0 2024-09-19T07:24:51.573 INFO:tasks.workunit.client.0.smithi098.stdout:7/274: dread d5/d8/f34 [0,4194304] 0 2024-09-19T07:24:51.573 INFO:tasks.workunit.client.0.smithi098.stdout:9/226: read d3/dc/df/d15/f28 [563477,65414] 0 2024-09-19T07:24:51.573 INFO:tasks.workunit.client.0.smithi098.stdout:9/227: rename d3/dc to d3/dc/df/d15/d1b/d4d 22 2024-09-19T07:24:51.574 INFO:tasks.workunit.client.0.smithi098.stdout:7/275: mknod d5/c5b 0 2024-09-19T07:24:51.575 INFO:tasks.workunit.client.0.smithi098.stdout:6/214: dread d2/f1a [0,4194304] 0 2024-09-19T07:24:51.575 INFO:tasks.workunit.client.0.smithi098.stdout:9/228: creat d3/dc/df/f4e x:0 0 0 2024-09-19T07:24:51.576 INFO:tasks.workunit.client.0.smithi098.stdout:6/215: symlink d2/d5/d1f/d26/l4b 0 2024-09-19T07:24:51.576 INFO:tasks.workunit.client.0.smithi098.stdout:6/216: write d2/d11/f49 [909609,40682] 0 2024-09-19T07:24:51.576 INFO:tasks.workunit.client.0.smithi098.stdout:6/217: write d2/d11/f24 [477854,96557] 0 2024-09-19T07:24:51.576 INFO:tasks.workunit.client.0.smithi098.stdout:7/276: unlink d5/d3e/f49 0 2024-09-19T07:24:51.578 INFO:tasks.workunit.client.0.smithi098.stdout:9/229: creat d3/d16/d38/f4f x:0 0 0 2024-09-19T07:24:51.578 INFO:tasks.workunit.client.0.smithi098.stdout:6/218: rmdir d2/d5/d1f/d26 39 2024-09-19T07:24:51.579 INFO:tasks.workunit.client.0.smithi098.stdout:7/277: truncate d5/d8/f24 2190285 0 2024-09-19T07:24:51.579 INFO:tasks.workunit.client.0.smithi098.stdout:7/278: mkdir d5/d8/dc/d16/d4f/d5c 0 2024-09-19T07:24:51.580 INFO:tasks.workunit.client.0.smithi098.stdout:7/279: chown d5/d10 14195 1 2024-09-19T07:24:51.581 INFO:tasks.workunit.client.0.smithi098.stdout:7/280: mkdir d5/d8/d5d 0 2024-09-19T07:24:51.582 INFO:tasks.workunit.client.0.smithi098.stdout:7/281: link d5/c23 d5/d8/dc/d4b/c5e 0 2024-09-19T07:24:51.583 INFO:tasks.workunit.client.0.smithi098.stdout:7/282: truncate d5/d8/dc/fe 1930765 0 2024-09-19T07:24:51.586 INFO:tasks.workunit.client.0.smithi098.stdout:8/189: dwrite d0/f5 [0,4194304] 0 2024-09-19T07:24:51.589 INFO:tasks.workunit.client.0.smithi098.stdout:8/190: mknod d0/de/d28/c39 0 2024-09-19T07:24:51.589 INFO:tasks.workunit.client.0.smithi098.stdout:6/219: dread d2/d5/f14 [0,4194304] 0 2024-09-19T07:24:51.590 INFO:tasks.workunit.client.0.smithi098.stdout:6/220: write d2/d11/f49 [625509,73349] 0 2024-09-19T07:24:51.591 INFO:tasks.workunit.client.0.smithi098.stdout:8/191: creat d0/d16/f3a x:0 0 0 2024-09-19T07:24:51.593 INFO:tasks.workunit.client.0.smithi098.stdout:8/192: creat d0/d1a/f3b x:0 0 0 2024-09-19T07:24:51.594 INFO:tasks.workunit.client.0.smithi098.stdout:2/160: sync 2024-09-19T07:24:51.594 INFO:tasks.workunit.client.0.smithi098.stdout:5/231: sync 2024-09-19T07:24:51.594 INFO:tasks.workunit.client.0.smithi098.stdout:2/161: readlink d1/l4 0 2024-09-19T07:24:51.594 INFO:tasks.workunit.client.0.smithi098.stdout:2/162: dread - d1/d5/f37 zero size 2024-09-19T07:24:51.594 INFO:tasks.workunit.client.0.smithi098.stdout:2/163: chown d1/d9/d26 1 1 2024-09-19T07:24:51.594 INFO:tasks.workunit.client.0.smithi098.stdout:2/164: chown d1/d5/c7 0 1 2024-09-19T07:24:51.596 INFO:tasks.workunit.client.0.smithi098.stdout:5/232: mknod dc/de/d13/d46/c50 0 2024-09-19T07:24:51.598 INFO:tasks.workunit.client.0.smithi098.stdout:2/165: link d1/d9/f33 d1/d5/f38 0 2024-09-19T07:24:51.598 INFO:tasks.workunit.client.0.smithi098.stdout:2/166: readlink d1/d9/d1d/l29 0 2024-09-19T07:24:51.598 INFO:tasks.workunit.client.0.smithi098.stdout:2/167: stat d1/da/db/fd 0 2024-09-19T07:24:51.600 INFO:tasks.workunit.client.0.smithi098.stdout:5/233: unlink dc/de/d13/d46/d23/c41 0 2024-09-19T07:24:51.601 INFO:tasks.workunit.client.0.smithi098.stdout:2/168: mkdir d1/d5/d34/d39 0 2024-09-19T07:24:51.601 INFO:tasks.workunit.client.0.smithi098.stdout:2/169: read - d1/d5/f37 zero size 2024-09-19T07:24:51.602 INFO:tasks.workunit.client.0.smithi098.stdout:8/193: fsync d0/d1a/f3b 0 2024-09-19T07:24:51.603 INFO:tasks.workunit.client.0.smithi098.stdout:2/170: mknod d1/d9/d26/c3a 0 2024-09-19T07:24:51.604 INFO:tasks.workunit.client.0.smithi098.stdout:8/194: mkdir d0/de/d21/d3c 0 2024-09-19T07:24:51.605 INFO:tasks.workunit.client.0.smithi098.stdout:8/195: mknod d0/de/d21/c3d 0 2024-09-19T07:24:51.606 INFO:tasks.workunit.client.0.smithi098.stdout:8/196: symlink d0/d2c/l3e 0 2024-09-19T07:24:51.616 INFO:tasks.workunit.client.0.smithi098.stdout:2/171: dread d1/d2c/f30 [0,4194304] 0 2024-09-19T07:24:51.616 INFO:tasks.workunit.client.0.smithi098.stdout:2/172: write d1/d5/f37 [953031,63030] 0 2024-09-19T07:24:51.617 INFO:tasks.workunit.client.0.smithi098.stdout:2/173: creat d1/d5/d34/f3b x:0 0 0 2024-09-19T07:24:51.620 INFO:tasks.workunit.client.0.smithi098.stdout:2/174: symlink d1/d9/d26/d35/l3c 0 2024-09-19T07:24:51.628 INFO:tasks.workunit.client.0.smithi098.stdout:2/175: write d1/da/f18 [447644,79667] 0 2024-09-19T07:24:51.629 INFO:tasks.workunit.client.0.smithi098.stdout:2/176: creat d1/d5/d34/f3d x:0 0 0 2024-09-19T07:24:51.629 INFO:tasks.workunit.client.0.smithi098.stdout:2/177: rmdir d1/d9 39 2024-09-19T07:24:51.630 INFO:tasks.workunit.client.0.smithi098.stdout:2/178: rename d1/da/db to d1/d9/d3e 0 2024-09-19T07:24:51.634 INFO:tasks.workunit.client.0.smithi098.stdout:7/283: dwrite d5/d10/d50/f54 [0,4194304] 0 2024-09-19T07:24:51.635 INFO:tasks.workunit.client.0.smithi098.stdout:9/230: dwrite d3/d16/f3c [0,4194304] 0 2024-09-19T07:24:51.636 INFO:tasks.workunit.client.0.smithi098.stdout:6/221: dwrite d2/d11/f2a [4194304,4194304] 0 2024-09-19T07:24:51.636 INFO:tasks.workunit.client.0.smithi098.stdout:6/222: write d2/d11/f24 [2743248,32177] 0 2024-09-19T07:24:51.636 INFO:tasks.workunit.client.0.smithi098.stdout:8/197: dwrite d0/d16/f3a [0,4194304] 0 2024-09-19T07:24:51.636 INFO:tasks.workunit.client.0.smithi098.stdout:9/231: dread d3/dc/df/d15/d1a/d2d/f3a [0,4194304] 0 2024-09-19T07:24:51.636 INFO:tasks.workunit.client.0.smithi098.stdout:9/232: dread - d3/d16/f3e zero size 2024-09-19T07:24:51.636 INFO:tasks.workunit.client.0.smithi098.stdout:9/233: fsync d3/f41 0 2024-09-19T07:24:51.636 INFO:tasks.workunit.client.0.smithi098.stdout:9/234: write d3/dc/df/d15/f28 [1607544,44840] 0 2024-09-19T07:24:51.637 INFO:tasks.workunit.client.0.smithi098.stdout:6/223: mknod d2/d5/d1f/c4c 0 2024-09-19T07:24:51.638 INFO:tasks.workunit.client.0.smithi098.stdout:2/179: dread d1/d5/f37 [0,4194304] 0 2024-09-19T07:24:51.638 INFO:tasks.workunit.client.0.smithi098.stdout:2/180: readlink d1/d9/d1d/l31 0 2024-09-19T07:24:51.639 INFO:tasks.workunit.client.0.smithi098.stdout:6/224: link d2/d5/d1f/d26/c28 d2/d1b/c4d 0 2024-09-19T07:24:51.640 INFO:tasks.workunit.client.0.smithi098.stdout:6/225: mkdir d2/d5/d1f/d26/d42/d48/d4a/d4e 0 2024-09-19T07:24:51.640 INFO:tasks.workunit.client.0.smithi098.stdout:6/226: write d2/d11/f24 [1096039,81266] 0 2024-09-19T07:24:51.641 INFO:tasks.workunit.client.0.smithi098.stdout:9/235: getdents d3/dc/df/d31 0 2024-09-19T07:24:51.641 INFO:tasks.workunit.client.0.smithi098.stdout:9/236: chown d3/d16/l20 446371906 1 2024-09-19T07:24:51.642 INFO:tasks.workunit.client.0.smithi098.stdout:6/227: link d2/d1b/f2f d2/d5/d1f/d26/d42/d48/d4a/f4f 0 2024-09-19T07:24:51.644 INFO:tasks.workunit.client.0.smithi098.stdout:7/284: read d5/f53 [1050864,12] 0 2024-09-19T07:24:51.648 INFO:tasks.workunit.client.0.smithi098.stdout:7/285: dread d5/f3c [4194304,4194304] 0 2024-09-19T07:24:51.649 INFO:tasks.workunit.client.0.smithi098.stdout:9/237: dread d3/dc/df/d15/d1a/d2b/f33 [0,4194304] 0 2024-09-19T07:24:51.650 INFO:tasks.workunit.client.0.smithi098.stdout:6/228: dread d2/fe [0,4194304] 0 2024-09-19T07:24:51.650 INFO:tasks.workunit.client.0.smithi098.stdout:7/286: symlink d5/d8/dc/l5f 0 2024-09-19T07:24:51.650 INFO:tasks.workunit.client.0.smithi098.stdout:6/229: readlink d2/d5/d1f/d26/l4b 0 2024-09-19T07:24:51.650 INFO:tasks.workunit.client.0.smithi098.stdout:9/238: truncate d3/d16/d38/f26 354129 0 2024-09-19T07:24:51.650 INFO:tasks.workunit.client.0.smithi098.stdout:9/239: chown d3/d16/f3c 135421911 1 2024-09-19T07:24:51.651 INFO:tasks.workunit.client.0.smithi098.stdout:6/230: unlink d2/d5/d1f/d26/c28 0 2024-09-19T07:24:51.651 INFO:tasks.workunit.client.0.smithi098.stdout:7/287: link d5/d10/f32 d5/d8/d52/f60 0 2024-09-19T07:24:51.652 INFO:tasks.workunit.client.0.smithi098.stdout:7/288: readlink d5/d8/l2f 0 2024-09-19T07:24:51.653 INFO:tasks.workunit.client.0.smithi098.stdout:9/240: mkdir d3/dc/df/d15/d1a/d2b/d49/d50 0 2024-09-19T07:24:51.653 INFO:tasks.workunit.client.0.smithi098.stdout:9/241: write d3/f41 [689414,126727] 0 2024-09-19T07:24:51.653 INFO:tasks.workunit.client.0.smithi098.stdout:9/242: dread - d3/d16/f3e zero size 2024-09-19T07:24:51.653 INFO:tasks.workunit.client.0.smithi098.stdout:9/243: truncate d3/d16/d38/f36 1409075 0 2024-09-19T07:24:51.653 INFO:tasks.workunit.client.0.smithi098.stdout:9/244: mkdir d3/d16/d43/d51 0 2024-09-19T07:24:51.654 INFO:tasks.workunit.client.0.smithi098.stdout:9/245: symlink d3/d30/l52 0 2024-09-19T07:24:51.654 INFO:tasks.workunit.client.0.smithi098.stdout:9/246: write d3/dc/df/d15/d2f/f4b [742548,2112] 0 2024-09-19T07:24:51.661 INFO:tasks.workunit.client.0.smithi098.stdout:7/289: write d5/d10/d50/f54 [469945,9467] 0 2024-09-19T07:24:51.663 INFO:tasks.workunit.client.0.smithi098.stdout:8/198: dwrite d0/d16/f3a [0,4194304] 0 2024-09-19T07:24:51.663 INFO:tasks.workunit.client.0.smithi098.stdout:2/181: dwrite d1/da/f22 [0,4194304] 0 2024-09-19T07:24:51.667 INFO:tasks.workunit.client.0.smithi098.stdout:2/182: mkdir d1/d5/d34/d39/d3f 0 2024-09-19T07:24:51.667 INFO:tasks.workunit.client.0.smithi098.stdout:2/183: readlink d1/d9/d1d/l29 0 2024-09-19T07:24:51.667 INFO:tasks.workunit.client.0.smithi098.stdout:2/184: fsync d1/d9/f14 0 2024-09-19T07:24:51.673 INFO:tasks.workunit.client.0.smithi098.stdout:3/224: sync 2024-09-19T07:24:51.673 INFO:tasks.workunit.client.0.smithi098.stdout:0/192: sync 2024-09-19T07:24:51.673 INFO:tasks.workunit.client.0.smithi098.stdout:0/193: chown d5/d20 98912650 1 2024-09-19T07:24:51.673 INFO:tasks.workunit.client.0.smithi098.stdout:3/225: fsync de/df/d31/f34 0 2024-09-19T07:24:51.674 INFO:tasks.workunit.client.0.smithi098.stdout:0/194: stat d5/d20/f1b 0 2024-09-19T07:24:51.675 INFO:tasks.workunit.client.0.smithi098.stdout:8/199: dread d0/de/f18 [0,4194304] 0 2024-09-19T07:24:51.675 INFO:tasks.workunit.client.0.smithi098.stdout:3/226: unlink de/df/d31/f34 0 2024-09-19T07:24:51.676 INFO:tasks.workunit.client.0.smithi098.stdout:0/195: truncate f4 1131139 0 2024-09-19T07:24:51.676 INFO:tasks.workunit.client.0.smithi098.stdout:0/196: write d5/f17 [2036934,26023] 0 2024-09-19T07:24:51.676 INFO:tasks.workunit.client.0.smithi098.stdout:0/197: chown d5/d20/l2d 475 1 2024-09-19T07:24:51.677 INFO:tasks.workunit.client.0.smithi098.stdout:8/200: unlink d0/ff 0 2024-09-19T07:24:51.679 INFO:tasks.workunit.client.0.smithi098.stdout:3/227: unlink de/f14 0 2024-09-19T07:24:51.680 INFO:tasks.workunit.client.0.smithi098.stdout:3/228: dread - de/f28 zero size 2024-09-19T07:24:51.682 INFO:tasks.workunit.client.0.smithi098.stdout:3/229: unlink de/df/d16/f3c 0 2024-09-19T07:24:51.683 INFO:tasks.workunit.client.0.smithi098.stdout:4/195: sync 2024-09-19T07:24:51.683 INFO:tasks.workunit.client.0.smithi098.stdout:1/180: sync 2024-09-19T07:24:51.684 INFO:tasks.workunit.client.0.smithi098.stdout:1/181: chown dc/d17/d1b/d1d/f3f 828 1 2024-09-19T07:24:51.684 INFO:tasks.workunit.client.0.smithi098.stdout:3/230: symlink de/df/d1f/d2b/l41 0 2024-09-19T07:24:51.686 INFO:tasks.workunit.client.0.smithi098.stdout:7/290: dwrite d5/f53 [0,4194304] 0 2024-09-19T07:24:51.688 INFO:tasks.workunit.client.0.smithi098.stdout:7/291: unlink d5/f37 0 2024-09-19T07:24:51.689 INFO:tasks.workunit.client.0.smithi098.stdout:8/201: write d0/f25 [180734,33724] 0 2024-09-19T07:24:51.690 INFO:tasks.workunit.client.0.smithi098.stdout:3/231: dread de/f26 [0,4194304] 0 2024-09-19T07:24:51.691 INFO:tasks.workunit.client.0.smithi098.stdout:7/292: mkdir d5/d3e/d61 0 2024-09-19T07:24:51.691 INFO:tasks.workunit.client.0.smithi098.stdout:8/202: creat d0/d16/f3f x:0 0 0 2024-09-19T07:24:51.691 INFO:tasks.workunit.client.0.smithi098.stdout:8/203: write d0/d16/f3f [977534,46396] 0 2024-09-19T07:24:51.692 INFO:tasks.workunit.client.0.smithi098.stdout:8/204: write d0/d1a/f3b [81624,29461] 0 2024-09-19T07:24:51.692 INFO:tasks.workunit.client.0.smithi098.stdout:8/205: write d0/f1f [915737,32366] 0 2024-09-19T07:24:51.692 INFO:tasks.workunit.client.0.smithi098.stdout:3/232: mknod de/df/d16/d2e/d3f/c42 0 2024-09-19T07:24:51.692 INFO:tasks.workunit.client.0.smithi098.stdout:3/233: write f0 [103373,92462] 0 2024-09-19T07:24:51.692 INFO:tasks.workunit.client.0.smithi098.stdout:2/185: dwrite d1/d9/d3e/fd [0,4194304] 0 2024-09-19T07:24:51.693 INFO:tasks.workunit.client.0.smithi098.stdout:7/293: mkdir d5/d3e/d62 0 2024-09-19T07:24:51.694 INFO:tasks.workunit.client.0.smithi098.stdout:2/186: dread d1/d9/f27 [0,4194304] 0 2024-09-19T07:24:51.694 INFO:tasks.workunit.client.0.smithi098.stdout:8/206: mkdir d0/de/d28/d40 0 2024-09-19T07:24:51.698 INFO:tasks.workunit.client.0.smithi098.stdout:2/187: unlink d1/d9/d1d/c1f 0 2024-09-19T07:24:51.699 INFO:tasks.workunit.client.0.smithi098.stdout:0/198: dwrite d5/d20/d14/f32 [0,4194304] 0 2024-09-19T07:24:51.700 INFO:tasks.workunit.client.0.smithi098.stdout:2/188: getdents d1/d9/d26 0 2024-09-19T07:24:51.704 INFO:tasks.workunit.client.0.smithi098.stdout:3/234: write de/f2f [613608,30189] 0 2024-09-19T07:24:51.706 INFO:tasks.workunit.client.0.smithi098.stdout:2/189: creat d1/d5/f40 x:0 0 0 2024-09-19T07:24:51.707 INFO:tasks.workunit.client.0.smithi098.stdout:3/235: chown de/l1c 36991 1 2024-09-19T07:24:51.708 INFO:tasks.workunit.client.0.smithi098.stdout:3/236: mknod de/df/d1f/d2b/c43 0 2024-09-19T07:24:51.709 INFO:tasks.workunit.client.0.smithi098.stdout:2/190: getdents d1/d9/d26/d35 0 2024-09-19T07:24:51.712 INFO:tasks.workunit.client.0.smithi098.stdout:2/191: mkdir d1/d9/d3e/d41 0 2024-09-19T07:24:51.713 INFO:tasks.workunit.client.0.smithi098.stdout:3/237: rmdir de/df/d31 39 2024-09-19T07:24:51.715 INFO:tasks.workunit.client.0.smithi098.stdout:0/199: dwrite d5/f22 [0,4194304] 0 2024-09-19T07:24:51.718 INFO:tasks.workunit.client.0.smithi098.stdout:5/234: sync 2024-09-19T07:24:51.718 INFO:tasks.workunit.client.0.smithi098.stdout:4/196: rename l1 to da/d31/l3e 0 2024-09-19T07:24:51.718 INFO:tasks.workunit.client.0.smithi098.stdout:6/231: sync 2024-09-19T07:24:51.718 INFO:tasks.workunit.client.0.smithi098.stdout:9/247: sync 2024-09-19T07:24:51.720 INFO:tasks.workunit.client.0.smithi098.stdout:6/232: creat d2/d5/d1f/d26/d42/d48/d4a/d4e/f50 x:0 0 0 2024-09-19T07:24:51.720 INFO:tasks.workunit.client.0.smithi098.stdout:1/182: rename dc/c18 to dc/d17/d1b/c40 0 2024-09-19T07:24:51.720 INFO:tasks.workunit.client.0.smithi098.stdout:8/207: rename d0/de to d0/de/d28/d41 22 2024-09-19T07:24:51.721 INFO:tasks.workunit.client.0.smithi098.stdout:3/238: dread de/f2f [0,4194304] 0 2024-09-19T07:24:51.721 INFO:tasks.workunit.client.0.smithi098.stdout:1/183: write dc/de/f21 [375825,118214] 0 2024-09-19T07:24:51.721 INFO:tasks.workunit.client.0.smithi098.stdout:1/184: stat dc/d17/l25 0 2024-09-19T07:24:51.721 INFO:tasks.workunit.client.0.smithi098.stdout:6/233: unlink d2/d5/f14 0 2024-09-19T07:24:51.721 INFO:tasks.workunit.client.0.smithi098.stdout:1/185: dread - dc/f2c zero size 2024-09-19T07:24:51.722 INFO:tasks.workunit.client.0.smithi098.stdout:4/197: creat da/f3f x:0 0 0 2024-09-19T07:24:51.722 INFO:tasks.workunit.client.0.smithi098.stdout:9/248: dread d3/dc/df/d15/d1a/d2b/f33 [0,4194304] 0 2024-09-19T07:24:51.725 INFO:tasks.workunit.client.0.smithi098.stdout:4/198: unlink da/d31/l3e 0 2024-09-19T07:24:51.727 INFO:tasks.workunit.client.0.smithi098.stdout:1/186: stat dc/c2d 0 2024-09-19T07:24:51.728 INFO:tasks.workunit.client.0.smithi098.stdout:4/199: truncate f9 3927646 0 2024-09-19T07:24:51.729 INFO:tasks.workunit.client.0.smithi098.stdout:0/200: write d5/f1e [2820541,110324] 0 2024-09-19T07:24:51.729 INFO:tasks.workunit.client.0.smithi098.stdout:1/187: creat dc/d17/d1b/d1d/f41 x:0 0 0 2024-09-19T07:24:51.731 INFO:tasks.workunit.client.0.smithi098.stdout:4/200: link da/f30 da/d31/f40 0 2024-09-19T07:24:51.731 INFO:tasks.workunit.client.0.smithi098.stdout:4/201: truncate da/f23 841282 0 2024-09-19T07:24:51.731 INFO:tasks.workunit.client.0.smithi098.stdout:8/208: dread d0/de/d28/f35 [0,4194304] 0 2024-09-19T07:24:51.731 INFO:tasks.workunit.client.0.smithi098.stdout:0/201: unlink d5/d20/d1f/l21 0 2024-09-19T07:24:51.732 INFO:tasks.workunit.client.0.smithi098.stdout:0/202: read d5/f25 [84346,57697] 0 2024-09-19T07:24:51.732 INFO:tasks.workunit.client.0.smithi098.stdout:4/202: creat da/d31/f41 x:0 0 0 2024-09-19T07:24:51.733 INFO:tasks.workunit.client.0.smithi098.stdout:1/188: creat dc/d2a/f42 x:0 0 0 2024-09-19T07:24:51.733 INFO:tasks.workunit.client.0.smithi098.stdout:1/189: truncate dc/d17/d2e/f39 232912 0 2024-09-19T07:24:51.733 INFO:tasks.workunit.client.0.smithi098.stdout:1/190: fsync dc/f28 0 2024-09-19T07:24:51.733 INFO:tasks.workunit.client.0.smithi098.stdout:1/191: write fa [1187351,8367] 0 2024-09-19T07:24:51.733 INFO:tasks.workunit.client.0.smithi098.stdout:8/209: mknod d0/c42 0 2024-09-19T07:24:51.735 INFO:tasks.workunit.client.0.smithi098.stdout:2/192: dwrite d1/da/f1a [0,4194304] 0 2024-09-19T07:24:51.735 INFO:tasks.workunit.client.0.smithi098.stdout:1/192: symlink dc/d17/d1b/d1d/d30/l43 0 2024-09-19T07:24:51.736 INFO:tasks.workunit.client.0.smithi098.stdout:1/193: creat dc/de/d38/f44 x:0 0 0 2024-09-19T07:24:51.736 INFO:tasks.workunit.client.0.smithi098.stdout:8/210: link d0/de/d12/l13 d0/de/d12/l43 0 2024-09-19T07:24:51.738 INFO:tasks.workunit.client.0.smithi098.stdout:0/203: symlink d5/l34 0 2024-09-19T07:24:51.739 INFO:tasks.workunit.client.0.smithi098.stdout:0/204: read d5/d20/d14/f2c [571495,37538] 0 2024-09-19T07:24:51.740 INFO:tasks.workunit.client.0.smithi098.stdout:2/193: mkdir d1/d5/d34/d39/d3f/d42 0 2024-09-19T07:24:51.741 INFO:tasks.workunit.client.0.smithi098.stdout:8/211: mkdir d0/d33/d44 0 2024-09-19T07:24:51.742 INFO:tasks.workunit.client.0.smithi098.stdout:0/205: link d5/d20/d14/f2c d5/d20/d14/f35 0 2024-09-19T07:24:51.744 INFO:tasks.workunit.client.0.smithi098.stdout:2/194: link d1/d9/f2e d1/d9/d1d/f43 0 2024-09-19T07:24:51.744 INFO:tasks.workunit.client.0.smithi098.stdout:2/195: readlink d1/d9/d3e/l1e 0 2024-09-19T07:24:51.744 INFO:tasks.workunit.client.0.smithi098.stdout:8/212: mknod d0/d16/c45 0 2024-09-19T07:24:51.745 INFO:tasks.workunit.client.0.smithi098.stdout:0/206: rename d5/d20/d1f/l2b to d5/d20/l36 0 2024-09-19T07:24:51.746 INFO:tasks.workunit.client.0.smithi098.stdout:8/213: unlink d0/l10 0 2024-09-19T07:24:51.747 INFO:tasks.workunit.client.0.smithi098.stdout:8/214: symlink d0/de/l46 0 2024-09-19T07:24:51.748 INFO:tasks.workunit.client.0.smithi098.stdout:0/207: symlink d5/l37 0 2024-09-19T07:24:51.749 INFO:tasks.workunit.client.0.smithi098.stdout:8/215: symlink d0/de/l47 0 2024-09-19T07:24:51.750 INFO:tasks.workunit.client.0.smithi098.stdout:8/216: link d0/c42 d0/de/c48 0 2024-09-19T07:24:51.750 INFO:tasks.workunit.client.0.smithi098.stdout:8/217: truncate d0/f22 1414095 0 2024-09-19T07:24:51.750 INFO:tasks.workunit.client.0.smithi098.stdout:8/218: readlink d0/de/l46 0 2024-09-19T07:24:51.751 INFO:tasks.workunit.client.0.smithi098.stdout:8/219: creat d0/d1a/f49 x:0 0 0 2024-09-19T07:24:51.751 INFO:tasks.workunit.client.0.smithi098.stdout:8/220: getdents d0/d33/d44 0 2024-09-19T07:24:51.751 INFO:tasks.workunit.client.0.smithi098.stdout:8/221: stat d0/de/f27 0 2024-09-19T07:24:51.751 INFO:tasks.workunit.client.0.smithi098.stdout:8/222: getdents d0/de/d21 0 2024-09-19T07:24:51.751 INFO:tasks.workunit.client.0.smithi098.stdout:8/223: fsync d0/d16/f3f 0 2024-09-19T07:24:51.751 INFO:tasks.workunit.client.0.smithi098.stdout:8/224: getdents d0/de/d28/d40 0 2024-09-19T07:24:51.753 INFO:tasks.workunit.client.0.smithi098.stdout:6/234: dwrite d2/d11/f49 [0,4194304] 0 2024-09-19T07:24:51.753 INFO:tasks.workunit.client.0.smithi098.stdout:8/225: dread d0/fc [4194304,4194304] 0 2024-09-19T07:24:51.755 INFO:tasks.workunit.client.0.smithi098.stdout:8/226: unlink d0/f1f 0 2024-09-19T07:24:51.756 INFO:tasks.workunit.client.0.smithi098.stdout:9/249: dwrite d3/dc/df/d15/d1a/d2b/f33 [0,4194304] 0 2024-09-19T07:24:51.756 INFO:tasks.workunit.client.0.smithi098.stdout:6/235: rmdir d2/d5/d1f 39 2024-09-19T07:24:51.756 INFO:tasks.workunit.client.0.smithi098.stdout:3/239: dwrite de/f28 [0,4194304] 0 2024-09-19T07:24:51.757 INFO:tasks.workunit.client.0.smithi098.stdout:3/240: write de/f25 [2519755,37149] 0 2024-09-19T07:24:51.757 INFO:tasks.workunit.client.0.smithi098.stdout:8/227: mknod d0/d33/c4a 0 2024-09-19T07:24:51.757 INFO:tasks.workunit.client.0.smithi098.stdout:8/228: chown d0/fc 158687 1 2024-09-19T07:24:51.758 INFO:tasks.workunit.client.0.smithi098.stdout:6/236: symlink d2/d5/d1f/d26/d42/l51 0 2024-09-19T07:24:51.762 INFO:tasks.workunit.client.0.smithi098.stdout:3/241: mknod de/df/c44 0 2024-09-19T07:24:51.762 INFO:tasks.workunit.client.0.smithi098.stdout:0/208: dread d5/f7 [0,4194304] 0 2024-09-19T07:24:51.764 INFO:tasks.workunit.client.0.smithi098.stdout:8/229: mknod d0/d2c/c4b 0 2024-09-19T07:24:51.768 INFO:tasks.workunit.client.0.smithi098.stdout:8/230: rmdir d0/d16 39 2024-09-19T07:24:51.795 INFO:tasks.workunit.client.0.smithi098.stdout:9/250: dwrite d3/dc/df/d15/d2f/f4b [0,4194304] 0 2024-09-19T07:24:51.797 INFO:tasks.workunit.client.0.smithi098.stdout:9/251: symlink d3/d16/d38/d22/l53 0 2024-09-19T07:24:51.806 INFO:tasks.workunit.client.0.smithi098.stdout:8/231: dwrite d0/f22 [0,4194304] 0 2024-09-19T07:24:51.806 INFO:tasks.workunit.client.0.smithi098.stdout:6/237: dwrite d2/d5/d1f/d26/d42/d48/d4a/d4e/f50 [0,4194304] 0 2024-09-19T07:24:51.806 INFO:tasks.workunit.client.0.smithi098.stdout:0/209: dwrite d5/f30 [0,4194304] 0 2024-09-19T07:24:51.807 INFO:tasks.workunit.client.0.smithi098.stdout:3/242: dwrite de/f2f [0,4194304] 0 2024-09-19T07:24:51.811 INFO:tasks.workunit.client.0.smithi098.stdout:0/210: symlink d5/d20/l38 0 2024-09-19T07:24:51.812 INFO:tasks.workunit.client.0.smithi098.stdout:0/211: creat d5/d20/f39 x:0 0 0 2024-09-19T07:24:51.814 INFO:tasks.workunit.client.0.smithi098.stdout:0/212: symlink d5/d20/l3a 0 2024-09-19T07:24:51.814 INFO:tasks.workunit.client.0.smithi098.stdout:0/213: readlink d5/d20/l2a 0 2024-09-19T07:24:51.814 INFO:tasks.workunit.client.0.smithi098.stdout:3/243: dread de/df/d1f/d2b/f3a [0,4194304] 0 2024-09-19T07:24:51.814 INFO:tasks.workunit.client.0.smithi098.stdout:3/244: truncate de/df/f15 1545305 0 2024-09-19T07:24:51.816 INFO:tasks.workunit.client.0.smithi098.stdout:0/214: mknod d5/d20/d14/c3b 0 2024-09-19T07:24:51.824 INFO:tasks.workunit.client.0.smithi098.stdout:0/215: dread d5/f1e [0,4194304] 0 2024-09-19T07:24:51.824 INFO:tasks.workunit.client.0.smithi098.stdout:0/216: write d5/f1e [491889,34598] 0 2024-09-19T07:24:51.824 INFO:tasks.workunit.client.0.smithi098.stdout:0/217: dread - d5/f31 zero size 2024-09-19T07:24:51.824 INFO:tasks.workunit.client.0.smithi098.stdout:0/218: write d5/d20/f10 [1145713,572] 0 2024-09-19T07:24:51.824 INFO:tasks.workunit.client.0.smithi098.stdout:0/219: rename d5 to d5/d20/d14/d3c 22 2024-09-19T07:24:51.824 INFO:tasks.workunit.client.0.smithi098.stdout:0/220: chown d5/f1e 4605882 1 2024-09-19T07:24:51.829 INFO:tasks.workunit.client.0.smithi098.stdout:0/221: link d5/f22 d5/f3d 0 2024-09-19T07:24:51.829 INFO:tasks.workunit.client.0.smithi098.stdout:0/222: creat d5/f3e x:0 0 0 2024-09-19T07:24:51.829 INFO:tasks.workunit.client.0.smithi098.stdout:0/223: chown d5/l37 81707 1 2024-09-19T07:24:51.829 INFO:tasks.workunit.client.0.smithi098.stdout:0/224: truncate d5/f25 225960 0 2024-09-19T07:24:51.829 INFO:tasks.workunit.client.0.smithi098.stdout:0/225: symlink d5/d20/d1f/l3f 0 2024-09-19T07:24:51.835 INFO:tasks.workunit.client.0.smithi098.stdout:8/232: dwrite d0/f25 [0,4194304] 0 2024-09-19T07:24:51.840 INFO:tasks.workunit.client.0.smithi098.stdout:6/238: dwrite d2/d5/f16 [0,4194304] 0 2024-09-19T07:24:51.842 INFO:tasks.workunit.client.0.smithi098.stdout:6/239: rmdir d2/d5/d1f/d44 0 2024-09-19T07:24:51.843 INFO:tasks.workunit.client.0.smithi098.stdout:3/245: dwrite de/f26 [0,4194304] 0 2024-09-19T07:24:51.843 INFO:tasks.workunit.client.0.smithi098.stdout:3/246: chown de/df/d31/l3b 6647589 1 2024-09-19T07:24:51.845 INFO:tasks.workunit.client.0.smithi098.stdout:6/240: symlink d2/l52 0 2024-09-19T07:24:51.845 INFO:tasks.workunit.client.0.smithi098.stdout:3/247: creat de/df/d1f/d2b/f45 x:0 0 0 2024-09-19T07:24:51.845 INFO:tasks.workunit.client.0.smithi098.stdout:3/248: chown de/df/d1f/d2b/f45 6219095 1 2024-09-19T07:24:51.847 INFO:tasks.workunit.client.0.smithi098.stdout:3/249: creat de/f46 x:0 0 0 2024-09-19T07:24:51.847 INFO:tasks.workunit.client.0.smithi098.stdout:3/250: dread de/df/f22 [0,4194304] 0 2024-09-19T07:24:51.849 INFO:tasks.workunit.client.0.smithi098.stdout:3/251: creat de/df/d1f/f47 x:0 0 0 2024-09-19T07:24:51.849 INFO:tasks.workunit.client.0.smithi098.stdout:3/252: readlink de/l1c 0 2024-09-19T07:24:51.850 INFO:tasks.workunit.client.0.smithi098.stdout:3/253: mknod de/df/d1f/d2b/c48 0 2024-09-19T07:24:51.850 INFO:tasks.workunit.client.0.smithi098.stdout:3/254: truncate de/f28 4957910 0 2024-09-19T07:24:51.857 INFO:tasks.workunit.client.0.smithi098.stdout:8/233: dwrite d0/d16/f3f [0,4194304] 0 2024-09-19T07:24:51.857 INFO:tasks.workunit.client.0.smithi098.stdout:8/234: write d0/d16/f23 [556106,125787] 0 2024-09-19T07:24:51.857 INFO:tasks.workunit.client.0.smithi098.stdout:6/241: dread d2/d1b/f3a [0,4194304] 0 2024-09-19T07:24:51.858 INFO:tasks.workunit.client.0.smithi098.stdout:0/226: dwrite d5/d20/f39 [0,4194304] 0 2024-09-19T07:24:51.858 INFO:tasks.workunit.client.0.smithi098.stdout:6/242: mkdir d2/d5/d1f/d26/d42/d48/d53 0 2024-09-19T07:24:51.859 INFO:tasks.workunit.client.0.smithi098.stdout:8/235: creat d0/f4c x:0 0 0 2024-09-19T07:24:51.860 INFO:tasks.workunit.client.0.smithi098.stdout:8/236: write d0/de/f18 [4210089,118400] 0 2024-09-19T07:24:51.865 INFO:tasks.workunit.client.0.smithi098.stdout:1/194: sync 2024-09-19T07:24:51.865 INFO:tasks.workunit.client.0.smithi098.stdout:7/294: sync 2024-09-19T07:24:51.866 INFO:tasks.workunit.client.0.smithi098.stdout:5/235: sync 2024-09-19T07:24:51.866 INFO:tasks.workunit.client.0.smithi098.stdout:2/196: sync 2024-09-19T07:24:51.866 INFO:tasks.workunit.client.0.smithi098.stdout:4/203: sync 2024-09-19T07:24:51.866 INFO:tasks.workunit.client.0.smithi098.stdout:7/295: stat d5/d10 0 2024-09-19T07:24:51.866 INFO:tasks.workunit.client.0.smithi098.stdout:4/204: stat f9 0 2024-09-19T07:24:51.867 INFO:tasks.workunit.client.0.smithi098.stdout:4/205: chown da/l17 11786172 1 2024-09-19T07:24:51.868 INFO:tasks.workunit.client.0.smithi098.stdout:4/206: write da/f11 [866256,119683] 0 2024-09-19T07:24:51.869 INFO:tasks.workunit.client.0.smithi098.stdout:0/227: creat d5/d20/d14/f40 x:0 0 0 2024-09-19T07:24:51.870 INFO:tasks.workunit.client.0.smithi098.stdout:2/197: rename d1/d9/d3e/f15 to d1/d2c/f44 0 2024-09-19T07:24:51.870 INFO:tasks.workunit.client.0.smithi098.stdout:2/198: stat d1/d9/c21 0 2024-09-19T07:24:51.871 INFO:tasks.workunit.client.0.smithi098.stdout:7/296: creat d5/d8/dc/d4b/d59/f63 x:0 0 0 2024-09-19T07:24:51.873 INFO:tasks.workunit.client.0.smithi098.stdout:8/237: dread d0/f22 [0,4194304] 0 2024-09-19T07:24:51.874 INFO:tasks.workunit.client.0.smithi098.stdout:8/238: write d0/f5 [4991757,14250] 0 2024-09-19T07:24:51.874 INFO:tasks.workunit.client.0.smithi098.stdout:0/228: creat d5/d20/f41 x:0 0 0 2024-09-19T07:24:51.874 INFO:tasks.workunit.client.0.smithi098.stdout:0/229: write d5/f17 [4953253,91183] 0 2024-09-19T07:24:51.875 INFO:tasks.workunit.client.0.smithi098.stdout:2/199: mknod d1/d5/d34/d39/d3f/d42/c45 0 2024-09-19T07:24:51.877 INFO:tasks.workunit.client.0.smithi098.stdout:1/195: dread dc/f33 [0,4194304] 0 2024-09-19T07:24:51.877 INFO:tasks.workunit.client.0.smithi098.stdout:8/239: symlink d0/de/d28/d40/l4d 0 2024-09-19T07:24:51.879 INFO:tasks.workunit.client.0.smithi098.stdout:0/230: creat d5/d20/f42 x:0 0 0 2024-09-19T07:24:51.879 INFO:tasks.workunit.client.0.smithi098.stdout:0/231: readlink d5/d20/d1f/l3f 0 2024-09-19T07:24:51.879 INFO:tasks.workunit.client.0.smithi098.stdout:9/252: sync 2024-09-19T07:24:51.880 INFO:tasks.workunit.client.0.smithi098.stdout:1/196: link dc/d17/l19 dc/d17/d2e/l45 0 2024-09-19T07:24:51.880 INFO:tasks.workunit.client.0.smithi098.stdout:1/197: chown dc/d17/l25 36479656 1 2024-09-19T07:24:51.881 INFO:tasks.workunit.client.0.smithi098.stdout:3/255: dwrite de/f19 [0,4194304] 0 2024-09-19T07:24:51.883 INFO:tasks.workunit.client.0.smithi098.stdout:4/207: write da/f16 [2278312,99502] 0 2024-09-19T07:24:51.883 INFO:tasks.workunit.client.0.smithi098.stdout:8/240: dread d0/de/f27 [0,4194304] 0 2024-09-19T07:24:51.885 INFO:tasks.workunit.client.0.smithi098.stdout:4/208: write da/fd [321596,130642] 0 2024-09-19T07:24:51.886 INFO:tasks.workunit.client.0.smithi098.stdout:4/209: truncate da/f1f 3004848 0 2024-09-19T07:24:51.887 INFO:tasks.workunit.client.0.smithi098.stdout:9/253: mknod d3/dc/df/d15/d1a/d2d/c54 0 2024-09-19T07:24:51.888 INFO:tasks.workunit.client.0.smithi098.stdout:4/210: link da/c12 da/d31/c42 0 2024-09-19T07:24:51.889 INFO:tasks.workunit.client.0.smithi098.stdout:6/243: dwrite d2/fb [0,4194304] 0 2024-09-19T07:24:51.889 INFO:tasks.workunit.client.0.smithi098.stdout:5/236: dread dc/de/f4d [0,4194304] 0 2024-09-19T07:24:51.890 INFO:tasks.workunit.client.0.smithi098.stdout:6/244: symlink d2/d5/d1f/d26/l54 0 2024-09-19T07:24:51.891 INFO:tasks.workunit.client.0.smithi098.stdout:0/232: dread d5/f3d [0,4194304] 0 2024-09-19T07:24:51.891 INFO:tasks.workunit.client.0.smithi098.stdout:0/233: stat d5/l37 0 2024-09-19T07:24:51.891 INFO:tasks.workunit.client.0.smithi098.stdout:0/234: fdatasync d5/d20/f10 0 2024-09-19T07:24:51.893 INFO:tasks.workunit.client.0.smithi098.stdout:8/241: creat d0/f4e x:0 0 0 2024-09-19T07:24:51.893 INFO:tasks.workunit.client.0.smithi098.stdout:8/242: chown d0/d1a 1034747664 1 2024-09-19T07:24:51.893 INFO:tasks.workunit.client.0.smithi098.stdout:0/235: write d5/d20/d14/f24 [394104,86140] 0 2024-09-19T07:24:51.893 INFO:tasks.workunit.client.0.smithi098.stdout:0/236: dread - d5/f31 zero size 2024-09-19T07:24:51.894 INFO:tasks.workunit.client.0.smithi098.stdout:9/254: mkdir d3/dc/df/d15/d1a/d2b/d49/d55 0 2024-09-19T07:24:51.894 INFO:tasks.workunit.client.0.smithi098.stdout:9/255: dread - d3/dc/df/d15/d1a/d2d/f42 zero size 2024-09-19T07:24:51.895 INFO:tasks.workunit.client.0.smithi098.stdout:5/237: readlink dc/l25 0 2024-09-19T07:24:51.895 INFO:tasks.workunit.client.0.smithi098.stdout:3/256: symlink de/l49 0 2024-09-19T07:24:51.895 INFO:tasks.workunit.client.0.smithi098.stdout:3/257: write de/df/d31/f3d [676400,3164] 0 2024-09-19T07:24:51.896 INFO:tasks.workunit.client.0.smithi098.stdout:7/297: dwrite d5/d8/d52/f60 [0,4194304] 0 2024-09-19T07:24:51.896 INFO:tasks.workunit.client.0.smithi098.stdout:4/211: mkdir da/d43 0 2024-09-19T07:24:51.898 INFO:tasks.workunit.client.0.smithi098.stdout:4/212: mknod da/c44 0 2024-09-19T07:24:51.898 INFO:tasks.workunit.client.0.smithi098.stdout:4/213: readlink da/l2b 0 2024-09-19T07:24:51.899 INFO:tasks.workunit.client.0.smithi098.stdout:4/214: rename da/d31/f41 to da/d31/f45 0 2024-09-19T07:24:51.901 INFO:tasks.workunit.client.0.smithi098.stdout:0/237: dread d5/f17 [0,4194304] 0 2024-09-19T07:24:51.901 INFO:tasks.workunit.client.0.smithi098.stdout:0/238: chown d5/d20/l2a 1794931994 1 2024-09-19T07:24:51.901 INFO:tasks.workunit.client.0.smithi098.stdout:0/239: write d5/f1e [4967373,21741] 0 2024-09-19T07:24:51.902 INFO:tasks.workunit.client.0.smithi098.stdout:0/240: readlink d5/l34 0 2024-09-19T07:24:51.902 INFO:tasks.workunit.client.0.smithi098.stdout:9/256: unlink d3/f41 0 2024-09-19T07:24:51.902 INFO:tasks.workunit.client.0.smithi098.stdout:7/298: mknod d5/d10/d50/c64 0 2024-09-19T07:24:51.902 INFO:tasks.workunit.client.0.smithi098.stdout:7/299: fsync d5/d8/d52/f60 0 2024-09-19T07:24:51.903 INFO:tasks.workunit.client.0.smithi098.stdout:9/257: creat d3/dc/df/d15/d1b/f56 x:0 0 0 2024-09-19T07:24:51.903 INFO:tasks.workunit.client.0.smithi098.stdout:9/258: fsync d3/d16/d38/f36 0 2024-09-19T07:24:51.904 INFO:tasks.workunit.client.0.smithi098.stdout:9/259: creat d3/d16/f57 x:0 0 0 2024-09-19T07:24:51.906 INFO:tasks.workunit.client.0.smithi098.stdout:9/260: mknod d3/dc/df/d15/d1a/d2b/d49/d55/c58 0 2024-09-19T07:24:51.909 INFO:tasks.workunit.client.0.smithi098.stdout:1/198: rename dc/de/c10 to dc/d17/d1b/c46 0 2024-09-19T07:24:51.911 INFO:tasks.workunit.client.0.smithi098.stdout:8/243: rename d0/d16/c45 to d0/de/d28/c4f 0 2024-09-19T07:24:51.912 INFO:tasks.workunit.client.0.smithi098.stdout:1/199: mknod dc/d17/d1b/d1d/d3d/c47 0 2024-09-19T07:24:51.914 INFO:tasks.workunit.client.0.smithi098.stdout:5/238: rename dc/de/d13/d46/c47 to dc/de/d13/d46/d2e/d37/c51 0 2024-09-19T07:24:51.914 INFO:tasks.workunit.client.0.smithi098.stdout:1/200: creat dc/de/d37/f48 x:0 0 0 2024-09-19T07:24:51.914 INFO:tasks.workunit.client.0.smithi098.stdout:8/244: mkdir d0/de/d21/d50 0 2024-09-19T07:24:51.914 INFO:tasks.workunit.client.0.smithi098.stdout:8/245: readlink d0/de/d28/l32 0 2024-09-19T07:24:51.915 INFO:tasks.workunit.client.0.smithi098.stdout:8/246: chown d0/de/d28/c2d 2842 1 2024-09-19T07:24:51.915 INFO:tasks.workunit.client.0.smithi098.stdout:5/239: mkdir dc/de/d13/d46/d23/d52 0 2024-09-19T07:24:51.915 INFO:tasks.workunit.client.0.smithi098.stdout:5/240: stat dc/de/d13/d3b/f3c 0 2024-09-19T07:24:51.915 INFO:tasks.workunit.client.0.smithi098.stdout:5/241: chown dc/de/d13/d46/d2e 344 1 2024-09-19T07:24:51.916 INFO:tasks.workunit.client.0.smithi098.stdout:5/242: fsync dc/de/f34 0 2024-09-19T07:24:51.916 INFO:tasks.workunit.client.0.smithi098.stdout:5/243: write f0 [5773765,83039] 0 2024-09-19T07:24:51.916 INFO:tasks.workunit.client.0.smithi098.stdout:9/261: read d3/d16/f3c [2186760,58551] 0 2024-09-19T07:24:51.917 INFO:tasks.workunit.client.0.smithi098.stdout:4/215: rename da/d43 to da/d31/d46 0 2024-09-19T07:24:51.917 INFO:tasks.workunit.client.0.smithi098.stdout:0/241: rename d5/d20 to d5/d20/d43 22 2024-09-19T07:24:51.917 INFO:tasks.workunit.client.0.smithi098.stdout:4/216: write da/d31/f3c [151802,2788] 0 2024-09-19T07:24:51.917 INFO:tasks.workunit.client.0.smithi098.stdout:9/262: symlink d3/d16/l59 0 2024-09-19T07:24:51.918 INFO:tasks.workunit.client.0.smithi098.stdout:7/300: rename d5/d8/f4e to d5/d3e/d62/f65 0 2024-09-19T07:24:51.919 INFO:tasks.workunit.client.0.smithi098.stdout:0/242: getdents d5/d20/d14 0 2024-09-19T07:24:51.919 INFO:tasks.workunit.client.0.smithi098.stdout:0/243: chown d5/d20/d14/l2f 257712 1 2024-09-19T07:24:51.919 INFO:tasks.workunit.client.0.smithi098.stdout:0/244: fdatasync d5/d20/f39 0 2024-09-19T07:24:51.919 INFO:tasks.workunit.client.0.smithi098.stdout:0/245: truncate d5/f3e 34670 0 2024-09-19T07:24:51.920 INFO:tasks.workunit.client.0.smithi098.stdout:9/263: creat d3/d16/d43/d51/f5a x:0 0 0 2024-09-19T07:24:51.920 INFO:tasks.workunit.client.0.smithi098.stdout:6/245: dwrite d2/fb [4194304,4194304] 0 2024-09-19T07:24:51.920 INFO:tasks.workunit.client.0.smithi098.stdout:1/201: dread dc/f33 [0,4194304] 0 2024-09-19T07:24:51.921 INFO:tasks.workunit.client.0.smithi098.stdout:1/202: chown dc/d17/c1f 21085 1 2024-09-19T07:24:51.921 INFO:tasks.workunit.client.0.smithi098.stdout:3/258: dwrite de/df/f29 [0,4194304] 0 2024-09-19T07:24:51.921 INFO:tasks.workunit.client.0.smithi098.stdout:7/301: rmdir d5/d3e 39 2024-09-19T07:24:51.921 INFO:tasks.workunit.client.0.smithi098.stdout:0/246: truncate d5/d20/d14/f32 2748367 0 2024-09-19T07:24:51.922 INFO:tasks.workunit.client.0.smithi098.stdout:6/246: creat d2/d5/d1f/d26/f55 x:0 0 0 2024-09-19T07:24:51.923 INFO:tasks.workunit.client.0.smithi098.stdout:9/264: link d3/dc/df/d15/d1a/d2d/f42 d3/dc/df/d15/f5b 0 2024-09-19T07:24:51.923 INFO:tasks.workunit.client.0.smithi098.stdout:9/265: dread - d3/d16/f57 zero size 2024-09-19T07:24:51.924 INFO:tasks.workunit.client.0.smithi098.stdout:1/203: creat dc/f49 x:0 0 0 2024-09-19T07:24:51.924 INFO:tasks.workunit.client.0.smithi098.stdout:6/247: rename d2/d11/f49 to d2/d11/f56 0 2024-09-19T07:24:51.925 INFO:tasks.workunit.client.0.smithi098.stdout:6/248: creat d2/d1b/f57 x:0 0 0 2024-09-19T07:24:51.928 INFO:tasks.workunit.client.0.smithi098.stdout:3/259: creat de/df/d16/f4a x:0 0 0 2024-09-19T07:24:51.928 INFO:tasks.workunit.client.0.smithi098.stdout:3/260: chown de/df/d1f/f47 516901 1 2024-09-19T07:24:51.931 INFO:tasks.workunit.client.0.smithi098.stdout:7/302: mkdir d5/d8/dc/d16/d4f/d66 0 2024-09-19T07:24:51.931 INFO:tasks.workunit.client.0.smithi098.stdout:1/204: getdents dc/d17/d2e 0 2024-09-19T07:24:51.932 INFO:tasks.workunit.client.0.smithi098.stdout:1/205: write dc/d17/d2e/f39 [524742,129407] 0 2024-09-19T07:24:51.932 INFO:tasks.workunit.client.0.smithi098.stdout:1/206: truncate dc/de/d37/f48 313496 0 2024-09-19T07:24:51.932 INFO:tasks.workunit.client.0.smithi098.stdout:1/207: dread - dc/f2c zero size 2024-09-19T07:24:51.932 INFO:tasks.workunit.client.0.smithi098.stdout:1/208: write dc/d17/d2e/f2f [1329830,59013] 0 2024-09-19T07:24:51.935 INFO:tasks.workunit.client.0.smithi098.stdout:7/303: dread d5/d8/dc/d16/f2e [0,4194304] 0 2024-09-19T07:24:51.937 INFO:tasks.workunit.client.0.smithi098.stdout:3/261: rmdir de 39 2024-09-19T07:24:51.937 INFO:tasks.workunit.client.0.smithi098.stdout:8/247: dread d0/d16/f17 [0,4194304] 0 2024-09-19T07:24:51.937 INFO:tasks.workunit.client.0.smithi098.stdout:8/248: chown d0/d16/f3a 1142361 1 2024-09-19T07:24:51.937 INFO:tasks.workunit.client.0.smithi098.stdout:6/249: rename d2/fb to d2/f58 0 2024-09-19T07:24:51.938 INFO:tasks.workunit.client.0.smithi098.stdout:5/244: write dc/de/d36/f3d [3214598,53294] 0 2024-09-19T07:24:51.938 INFO:tasks.workunit.client.0.smithi098.stdout:7/304: creat d5/d8/dc/d16/f67 x:0 0 0 2024-09-19T07:24:51.938 INFO:tasks.workunit.client.0.smithi098.stdout:7/305: chown d5/d8/dc/l2d 61670 1 2024-09-19T07:24:51.939 INFO:tasks.workunit.client.0.smithi098.stdout:8/249: creat d0/de/d28/d40/f51 x:0 0 0 2024-09-19T07:24:51.940 INFO:tasks.workunit.client.0.smithi098.stdout:9/266: dread d3/dc/df/d15/d1a/d2b/f33 [0,4194304] 0 2024-09-19T07:24:51.943 INFO:tasks.workunit.client.0.smithi098.stdout:6/250: creat d2/d5/f59 x:0 0 0 2024-09-19T07:24:51.943 INFO:tasks.workunit.client.0.smithi098.stdout:5/245: unlink dc/de/f1b 0 2024-09-19T07:24:51.943 INFO:tasks.workunit.client.0.smithi098.stdout:5/246: dread - dc/de/d13/d46/d2e/f33 zero size 2024-09-19T07:24:51.943 INFO:tasks.workunit.client.0.smithi098.stdout:9/267: rmdir d3/d16 39 2024-09-19T07:24:51.943 INFO:tasks.workunit.client.0.smithi098.stdout:9/268: stat d3/dc/df/d15/d1a/d2b/d49/d50 0 2024-09-19T07:24:51.943 INFO:tasks.workunit.client.0.smithi098.stdout:1/209: read f1 [1519534,64245] 0 2024-09-19T07:24:51.943 INFO:tasks.workunit.client.0.smithi098.stdout:1/210: write dc/d17/d1b/d1d/f41 [488202,3028] 0 2024-09-19T07:24:51.944 INFO:tasks.workunit.client.0.smithi098.stdout:1/211: stat dc/c32 0 2024-09-19T07:24:51.944 INFO:tasks.workunit.client.0.smithi098.stdout:7/306: rename d5/d8/c14 to d5/d3e/d62/c68 0 2024-09-19T07:24:51.944 INFO:tasks.workunit.client.0.smithi098.stdout:5/247: symlink dc/de/d13/d46/d23/d52/l53 0 2024-09-19T07:24:51.944 INFO:tasks.workunit.client.0.smithi098.stdout:9/269: truncate d3/d16/f3c 163620 0 2024-09-19T07:24:51.946 INFO:tasks.workunit.client.0.smithi098.stdout:1/212: rename fa to dc/d17/d2e/f4a 0 2024-09-19T07:24:51.946 INFO:tasks.workunit.client.0.smithi098.stdout:1/213: readlink dc/l27 0 2024-09-19T07:24:51.946 INFO:tasks.workunit.client.0.smithi098.stdout:7/307: symlink d5/d3e/l69 0 2024-09-19T07:24:51.947 INFO:tasks.workunit.client.0.smithi098.stdout:5/248: dread dc/f12 [0,4194304] 0 2024-09-19T07:24:51.947 INFO:tasks.workunit.client.0.smithi098.stdout:5/249: chown dc/de/d13/f21 3 1 2024-09-19T07:24:51.947 INFO:tasks.workunit.client.0.smithi098.stdout:1/214: creat dc/de/d22/f4b x:0 0 0 2024-09-19T07:24:51.948 INFO:tasks.workunit.client.0.smithi098.stdout:4/217: dwrite da/d31/f3c [0,4194304] 0 2024-09-19T07:24:51.948 INFO:tasks.workunit.client.0.smithi098.stdout:9/270: truncate d3/dc/df/d15/f28 2537406 0 2024-09-19T07:24:51.949 INFO:tasks.workunit.client.0.smithi098.stdout:7/308: mknod d5/d3e/d61/c6a 0 2024-09-19T07:24:51.951 INFO:tasks.workunit.client.0.smithi098.stdout:0/247: dwrite d5/f22 [0,4194304] 0 2024-09-19T07:24:51.953 INFO:tasks.workunit.client.0.smithi098.stdout:0/248: dread f4 [0,4194304] 0 2024-09-19T07:24:51.955 INFO:tasks.workunit.client.0.smithi098.stdout:4/218: rename da/c2c to da/d31/d46/c47 0 2024-09-19T07:24:51.955 INFO:tasks.workunit.client.0.smithi098.stdout:4/219: write da/fd [2566043,117614] 0 2024-09-19T07:24:51.957 INFO:tasks.workunit.client.0.smithi098.stdout:9/271: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:51.957 INFO:tasks.workunit.client.0.smithi098.stdout:1/215: dread dc/d17/d2e/f39 [0,4194304] 0 2024-09-19T07:24:51.958 INFO:tasks.workunit.client.0.smithi098.stdout:8/250: dwrite d0/de/f18 [0,4194304] 0 2024-09-19T07:24:51.958 INFO:tasks.workunit.client.0.smithi098.stdout:8/251: chown d0/f25 14452 1 2024-09-19T07:24:51.958 INFO:tasks.workunit.client.0.smithi098.stdout:8/252: write d0/f4c [371281,128455] 0 2024-09-19T07:24:51.967 INFO:tasks.workunit.client.0.smithi098.stdout:8/253: write d0/de/d28/f35 [2919424,46013] 0 2024-09-19T07:24:51.968 INFO:tasks.workunit.client.0.smithi098.stdout:7/309: rename d5/f22 to d5/d3e/d61/f6b 0 2024-09-19T07:24:51.969 INFO:tasks.workunit.client.0.smithi098.stdout:9/272: mkdir d3/d30/d5c 0 2024-09-19T07:24:51.969 INFO:tasks.workunit.client.0.smithi098.stdout:9/273: chown d3/dc/df/d15/d1a/d2b/f33 1270 1 2024-09-19T07:24:51.969 INFO:tasks.workunit.client.0.smithi098.stdout:9/274: write d3/d16/f3c [588547,16625] 0 2024-09-19T07:24:51.970 INFO:tasks.workunit.client.0.smithi098.stdout:8/254: creat d0/de/d21/d3c/f52 x:0 0 0 2024-09-19T07:24:51.971 INFO:tasks.workunit.client.0.smithi098.stdout:7/310: creat d5/d10/d50/f6c x:0 0 0 2024-09-19T07:24:51.972 INFO:tasks.workunit.client.0.smithi098.stdout:8/255: creat d0/f53 x:0 0 0 2024-09-19T07:24:51.973 INFO:tasks.workunit.client.0.smithi098.stdout:0/249: dread d5/fe [0,4194304] 0 2024-09-19T07:24:51.973 INFO:tasks.workunit.client.0.smithi098.stdout:7/311: symlink d5/d8/dc/d4b/d59/l6d 0 2024-09-19T07:24:51.975 INFO:tasks.workunit.client.0.smithi098.stdout:8/256: getdents d0/de 0 2024-09-19T07:24:51.975 INFO:tasks.workunit.client.0.smithi098.stdout:8/257: chown d0/d16/f17 0 1 2024-09-19T07:24:51.975 INFO:tasks.workunit.client.0.smithi098.stdout:8/258: dread - d0/de/d28/d40/f51 zero size 2024-09-19T07:24:51.975 INFO:tasks.workunit.client.0.smithi098.stdout:8/259: write d0/de/d28/d40/f51 [530426,106350] 0 2024-09-19T07:24:51.975 INFO:tasks.workunit.client.0.smithi098.stdout:0/250: mknod d5/d20/d1f/c44 0 2024-09-19T07:24:51.976 INFO:tasks.workunit.client.0.smithi098.stdout:9/275: write d3/dc/df/d15/d1a/d2b/f33 [2161337,109857] 0 2024-09-19T07:24:51.977 INFO:tasks.workunit.client.0.smithi098.stdout:0/251: creat d5/d20/d14/f45 x:0 0 0 2024-09-19T07:24:51.979 INFO:tasks.workunit.client.0.smithi098.stdout:7/312: link d5/d10/c30 d5/d8/dc/d16/c6e 0 2024-09-19T07:24:51.981 INFO:tasks.workunit.client.0.smithi098.stdout:9/276: mknod d3/d16/d38/d22/c5d 0 2024-09-19T07:24:51.981 INFO:tasks.workunit.client.0.smithi098.stdout:9/277: truncate d3/d16/f3c 778915 0 2024-09-19T07:24:51.981 INFO:tasks.workunit.client.0.smithi098.stdout:9/278: write d3/dc/df/f4e [894659,52310] 0 2024-09-19T07:24:51.982 INFO:tasks.workunit.client.0.smithi098.stdout:0/252: creat d5/f46 x:0 0 0 2024-09-19T07:24:51.983 INFO:tasks.workunit.client.0.smithi098.stdout:7/313: stat d5/d8/dc/d16/c6e 0 2024-09-19T07:24:51.984 INFO:tasks.workunit.client.0.smithi098.stdout:4/220: dwrite da/f1f [0,4194304] 0 2024-09-19T07:24:51.984 INFO:tasks.workunit.client.0.smithi098.stdout:4/221: chown da/c25 896884 1 2024-09-19T07:24:51.984 INFO:tasks.workunit.client.0.smithi098.stdout:4/222: stat da/c2d 0 2024-09-19T07:24:51.984 INFO:tasks.workunit.client.0.smithi098.stdout:9/279: creat d3/d6/d46/f5e x:0 0 0 2024-09-19T07:24:51.986 INFO:tasks.workunit.client.0.smithi098.stdout:6/251: dwrite f1 [0,4194304] 0 2024-09-19T07:24:51.986 INFO:tasks.workunit.client.0.smithi098.stdout:6/252: chown d2/fe 11767 1 2024-09-19T07:24:51.990 INFO:tasks.workunit.client.0.smithi098.stdout:9/280: dread d3/d16/f3c [0,4194304] 0 2024-09-19T07:24:51.991 INFO:tasks.workunit.client.0.smithi098.stdout:5/250: write dc/de/f4d [1413877,27315] 0 2024-09-19T07:24:51.993 INFO:tasks.workunit.client.0.smithi098.stdout:0/253: dread d5/d20/f12 [4194304,4194304] 0 2024-09-19T07:24:51.993 INFO:tasks.workunit.client.0.smithi098.stdout:0/254: chown d5/l37 64150299 1 2024-09-19T07:24:51.998 INFO:tasks.workunit.client.0.smithi098.stdout:5/251: chown dc/de/c28 2 1 2024-09-19T07:24:51.999 INFO:tasks.workunit.client.0.smithi098.stdout:5/252: creat dc/f54 x:0 0 0 2024-09-19T07:24:52.001 INFO:tasks.workunit.client.0.smithi098.stdout:5/253: getdents dc/de/d13/d46/d2e 0 2024-09-19T07:24:52.003 INFO:tasks.workunit.client.0.smithi098.stdout:1/216: link dc/f28 dc/de/d22/d31/f4c 0 2024-09-19T07:24:52.003 INFO:tasks.workunit.client.0.smithi098.stdout:1/217: fsync dc/de/d22/f4b 0 2024-09-19T07:24:52.005 INFO:tasks.workunit.client.0.smithi098.stdout:2/200: sync 2024-09-19T07:24:52.005 INFO:tasks.workunit.client.0.smithi098.stdout:8/260: dread d0/de/d28/f35 [0,4194304] 0 2024-09-19T07:24:52.005 INFO:tasks.workunit.client.0.smithi098.stdout:8/261: write d0/d16/f23 [1327968,117684] 0 2024-09-19T07:24:52.006 INFO:tasks.workunit.client.0.smithi098.stdout:1/218: mkdir dc/d17/d2e/d4d 0 2024-09-19T07:24:52.006 INFO:tasks.workunit.client.0.smithi098.stdout:1/219: chown dc/d17/d1b/c1c 809922060 1 2024-09-19T07:24:52.008 INFO:tasks.workunit.client.0.smithi098.stdout:1/220: creat dc/de/d37/f4e x:0 0 0 2024-09-19T07:24:52.008 INFO:tasks.workunit.client.0.smithi098.stdout:1/221: read dc/f23 [357733,120626] 0 2024-09-19T07:24:52.008 INFO:tasks.workunit.client.0.smithi098.stdout:1/222: chown dc/de/d22 45 1 2024-09-19T07:24:52.008 INFO:tasks.workunit.client.0.smithi098.stdout:2/201: rmdir d1/d5/d34/d39/d3f/d42 39 2024-09-19T07:24:52.008 INFO:tasks.workunit.client.0.smithi098.stdout:2/202: dread - d1/da/f32 zero size 2024-09-19T07:24:52.009 INFO:tasks.workunit.client.0.smithi098.stdout:8/262: symlink d0/de/d28/l54 0 2024-09-19T07:24:52.010 INFO:tasks.workunit.client.0.smithi098.stdout:1/223: mkdir dc/de/d22/d31/d35/d4f 0 2024-09-19T07:24:52.010 INFO:tasks.workunit.client.0.smithi098.stdout:8/263: chown d0/d1a/f1c 0 1 2024-09-19T07:24:52.010 INFO:tasks.workunit.client.0.smithi098.stdout:1/224: chown dc/d17/l19 7816924 1 2024-09-19T07:24:52.010 INFO:tasks.workunit.client.0.smithi098.stdout:4/223: dwrite da/f1f [0,4194304] 0 2024-09-19T07:24:52.010 INFO:tasks.workunit.client.0.smithi098.stdout:7/314: dwrite d5/d8/dc/d16/f67 [0,4194304] 0 2024-09-19T07:24:52.013 INFO:tasks.workunit.client.0.smithi098.stdout:5/254: getdents dc 0 2024-09-19T07:24:52.015 INFO:tasks.workunit.client.0.smithi098.stdout:7/315: symlink d5/d3e/d61/l6f 0 2024-09-19T07:24:52.019 INFO:tasks.workunit.client.0.smithi098.stdout:1/225: unlink dc/de/f13 0 2024-09-19T07:24:52.019 INFO:tasks.workunit.client.0.smithi098.stdout:4/224: rename da/c29 to da/c48 0 2024-09-19T07:24:52.019 INFO:tasks.workunit.client.0.smithi098.stdout:1/226: chown dc/de/d22/d31/f4c 2454 1 2024-09-19T07:24:52.022 INFO:tasks.workunit.client.0.smithi098.stdout:8/264: dread d0/de/f18 [0,4194304] 0 2024-09-19T07:24:52.023 INFO:tasks.workunit.client.0.smithi098.stdout:0/255: dwrite d5/d20/f12 [8388608,4194304] 0 2024-09-19T07:24:52.023 INFO:tasks.workunit.client.0.smithi098.stdout:9/281: dwrite d3/d6/d46/f5e [0,4194304] 0 2024-09-19T07:24:52.024 INFO:tasks.workunit.client.0.smithi098.stdout:6/253: dwrite d2/d1b/f3a [0,4194304] 0 2024-09-19T07:24:52.028 INFO:tasks.workunit.client.0.smithi098.stdout:8/265: mkdir d0/d33/d55 0 2024-09-19T07:24:52.028 INFO:tasks.workunit.client.0.smithi098.stdout:8/266: truncate d0/de/f18 5033218 0 2024-09-19T07:24:52.029 INFO:tasks.workunit.client.0.smithi098.stdout:6/254: link d2/fc d2/d5/d1f/d26/d42/d48/d4a/d4e/f5a 0 2024-09-19T07:24:52.029 INFO:tasks.workunit.client.0.smithi098.stdout:0/256: mkdir d5/d20/d1f/d47 0 2024-09-19T07:24:52.030 INFO:tasks.workunit.client.0.smithi098.stdout:6/255: mknod d2/d5/d1f/d26/d42/d48/d53/c5b 0 2024-09-19T07:24:52.031 INFO:tasks.workunit.client.0.smithi098.stdout:1/227: mkdir dc/de/d50 0 2024-09-19T07:24:52.036 INFO:tasks.workunit.client.0.smithi098.stdout:8/267: rename d0/de/c48 to d0/de/d12/c56 0 2024-09-19T07:24:52.037 INFO:tasks.workunit.client.0.smithi098.stdout:8/268: readlink d0/d1a/l24 0 2024-09-19T07:24:52.037 INFO:tasks.workunit.client.0.smithi098.stdout:8/269: stat d0/d16/f17 0 2024-09-19T07:24:52.037 INFO:tasks.workunit.client.0.smithi098.stdout:0/257: creat d5/f48 x:0 0 0 2024-09-19T07:24:52.037 INFO:tasks.workunit.client.0.smithi098.stdout:1/228: truncate dc/f28 1057753 0 2024-09-19T07:24:52.038 INFO:tasks.workunit.client.0.smithi098.stdout:0/258: mkdir d5/d20/d14/d49 0 2024-09-19T07:24:52.039 INFO:tasks.workunit.client.0.smithi098.stdout:0/259: fdatasync d5/f18 0 2024-09-19T07:24:52.039 INFO:tasks.workunit.client.0.smithi098.stdout:1/229: creat dc/d2a/f51 x:0 0 0 2024-09-19T07:24:52.040 INFO:tasks.workunit.client.0.smithi098.stdout:0/260: rename d5/d20/d14/f45 to d5/d20/d14/f4a 0 2024-09-19T07:24:52.040 INFO:tasks.workunit.client.0.smithi098.stdout:0/261: write d5/f25 [443945,62176] 0 2024-09-19T07:24:52.040 INFO:tasks.workunit.client.0.smithi098.stdout:0/262: write f4 [1930043,126213] 0 2024-09-19T07:24:52.041 INFO:tasks.workunit.client.0.smithi098.stdout:1/230: rmdir dc/de/d37 39 2024-09-19T07:24:52.041 INFO:tasks.workunit.client.0.smithi098.stdout:7/316: dwrite d5/d8/dc/d4b/d59/f63 [0,4194304] 0 2024-09-19T07:24:52.044 INFO:tasks.workunit.client.0.smithi098.stdout:7/317: creat d5/d3e/d62/f70 x:0 0 0 2024-09-19T07:24:52.051 INFO:tasks.workunit.client.0.smithi098.stdout:3/262: sync 2024-09-19T07:24:52.052 INFO:tasks.workunit.client.0.smithi098.stdout:3/263: mknod de/df/d1f/d2b/c4b 0 2024-09-19T07:24:52.053 INFO:tasks.workunit.client.0.smithi098.stdout:3/264: creat de/df/d16/d2e/f4c x:0 0 0 2024-09-19T07:24:52.053 INFO:tasks.workunit.client.0.smithi098.stdout:4/225: dwrite da/f3f [0,4194304] 0 2024-09-19T07:24:52.054 INFO:tasks.workunit.client.0.smithi098.stdout:3/265: symlink de/df/d16/d2e/l4d 0 2024-09-19T07:24:52.055 INFO:tasks.workunit.client.0.smithi098.stdout:3/266: read de/f1a [88400,76011] 0 2024-09-19T07:24:52.055 INFO:tasks.workunit.client.0.smithi098.stdout:3/267: fsync de/f2f 0 2024-09-19T07:24:52.055 INFO:tasks.workunit.client.0.smithi098.stdout:4/226: link da/d31/f40 da/d31/f49 0 2024-09-19T07:24:52.057 INFO:tasks.workunit.client.0.smithi098.stdout:3/268: mkdir de/d4e 0 2024-09-19T07:24:52.057 INFO:tasks.workunit.client.0.smithi098.stdout:3/269: chown de/df/d16 739500 1 2024-09-19T07:24:52.057 INFO:tasks.workunit.client.0.smithi098.stdout:7/318: write d5/d8/dc/d4b/d59/f63 [1767505,117669] 0 2024-09-19T07:24:52.057 INFO:tasks.workunit.client.0.smithi098.stdout:7/319: chown d5/d10/d11/l19 1705918 1 2024-09-19T07:24:52.057 INFO:tasks.workunit.client.0.smithi098.stdout:7/320: fsync d5/d8/dc/f47 0 2024-09-19T07:24:52.057 INFO:tasks.workunit.client.0.smithi098.stdout:7/321: chown d5/d8/c43 57420 1 2024-09-19T07:24:52.057 INFO:tasks.workunit.client.0.smithi098.stdout:7/322: mknod d5/c71 0 2024-09-19T07:24:52.060 INFO:tasks.workunit.client.0.smithi098.stdout:5/255: dwrite dc/de/d13/d46/f26 [0,4194304] 0 2024-09-19T07:24:52.061 INFO:tasks.workunit.client.0.smithi098.stdout:7/323: write d5/d8/f34 [1781941,1933] 0 2024-09-19T07:24:52.062 INFO:tasks.workunit.client.0.smithi098.stdout:5/256: mknod dc/c55 0 2024-09-19T07:24:52.062 INFO:tasks.workunit.client.0.smithi098.stdout:5/257: readlink dc/de/d13/d3b/l42 0 2024-09-19T07:24:52.062 INFO:tasks.workunit.client.0.smithi098.stdout:3/270: dread f0 [0,4194304] 0 2024-09-19T07:24:52.062 INFO:tasks.workunit.client.0.smithi098.stdout:3/271: write f5 [840438,80946] 0 2024-09-19T07:24:52.062 INFO:tasks.workunit.client.0.smithi098.stdout:3/272: chown de/df/f29 3413 1 2024-09-19T07:24:52.062 INFO:tasks.workunit.client.0.smithi098.stdout:3/273: write de/df/d16/f4a [203417,99938] 0 2024-09-19T07:24:52.063 INFO:tasks.workunit.client.0.smithi098.stdout:7/324: mknod d5/d3e/d62/c72 0 2024-09-19T07:24:52.063 INFO:tasks.workunit.client.0.smithi098.stdout:7/325: stat d5/d8/dc/d16 0 2024-09-19T07:24:52.064 INFO:tasks.workunit.client.0.smithi098.stdout:3/274: mkdir de/df/d4f 0 2024-09-19T07:24:52.067 INFO:tasks.workunit.client.0.smithi098.stdout:9/282: dwrite d3/d16/f3e [0,4194304] 0 2024-09-19T07:24:52.067 INFO:tasks.workunit.client.0.smithi098.stdout:6/256: dwrite d2/d1b/f1d [0,4194304] 0 2024-09-19T07:24:52.070 INFO:tasks.workunit.client.0.smithi098.stdout:6/257: creat d2/d11/f5c x:0 0 0 2024-09-19T07:24:52.070 INFO:tasks.workunit.client.0.smithi098.stdout:6/258: write d2/d11/f24 [5096105,107669] 0 2024-09-19T07:24:52.070 INFO:tasks.workunit.client.0.smithi098.stdout:6/259: chown d2/d11/l2c 357 1 2024-09-19T07:24:52.070 INFO:tasks.workunit.client.0.smithi098.stdout:9/283: link d3/dc/df/d15/d1a/d2d/f42 d3/dc/df/d15/d2f/f5f 0 2024-09-19T07:24:52.070 INFO:tasks.workunit.client.0.smithi098.stdout:9/284: stat d3/dc/df/d15/d1b/c3b 0 2024-09-19T07:24:52.071 INFO:tasks.workunit.client.0.smithi098.stdout:1/231: dwrite dc/d17/d2e/f2f [0,4194304] 0 2024-09-19T07:24:52.074 INFO:tasks.workunit.client.0.smithi098.stdout:9/285: symlink d3/d16/d43/d51/l60 0 2024-09-19T07:24:52.078 INFO:tasks.workunit.client.0.smithi098.stdout:3/275: dread de/f28 [0,4194304] 0 2024-09-19T07:24:52.080 INFO:tasks.workunit.client.0.smithi098.stdout:3/276: unlink de/df/d1f/d2b/f45 0 2024-09-19T07:24:52.081 INFO:tasks.workunit.client.0.smithi098.stdout:6/260: write d2/f58 [2962273,23908] 0 2024-09-19T07:24:52.086 INFO:tasks.workunit.client.0.smithi098.stdout:3/277: dread f0 [0,4194304] 0 2024-09-19T07:24:52.086 INFO:tasks.workunit.client.0.smithi098.stdout:3/278: truncate f9 615492 0 2024-09-19T07:24:52.089 INFO:tasks.workunit.client.0.smithi098.stdout:9/286: write d3/d16/f3e [3224403,78950] 0 2024-09-19T07:24:52.089 INFO:tasks.workunit.client.0.smithi098.stdout:9/287: write d3/dc/df/d15/d1a/d2b/f33 [722647,68821] 0 2024-09-19T07:24:52.090 INFO:tasks.workunit.client.0.smithi098.stdout:6/261: write f1 [681266,47692] 0 2024-09-19T07:24:52.091 INFO:tasks.workunit.client.0.smithi098.stdout:9/288: mkdir d3/d16/d43/d61 0 2024-09-19T07:24:52.091 INFO:tasks.workunit.client.0.smithi098.stdout:9/289: fsync d3/d16/d38/f2e 0 2024-09-19T07:24:52.091 INFO:tasks.workunit.client.0.smithi098.stdout:9/290: write d3/dc/df/d15/f5b [712641,30086] 0 2024-09-19T07:24:52.091 INFO:tasks.workunit.client.0.smithi098.stdout:9/291: chown d3/dc/df/d15/d1a/d2b/d49 7467962 1 2024-09-19T07:24:52.091 INFO:tasks.workunit.client.0.smithi098.stdout:9/292: stat d3/d16/d38/f4f 0 2024-09-19T07:24:52.091 INFO:tasks.workunit.client.0.smithi098.stdout:9/293: fsync d3/d16/d38/f26 0 2024-09-19T07:24:52.091 INFO:tasks.workunit.client.0.smithi098.stdout:6/262: creat d2/d5/d1f/d26/d42/d48/d53/f5d x:0 0 0 2024-09-19T07:24:52.092 INFO:tasks.workunit.client.0.smithi098.stdout:6/263: mkdir d2/d5/d1f/d26/d42/d48/d4a/d5e 0 2024-09-19T07:24:52.093 INFO:tasks.workunit.client.0.smithi098.stdout:9/294: unlink d3/d6/d8/c13 0 2024-09-19T07:24:52.093 INFO:tasks.workunit.client.0.smithi098.stdout:9/295: chown d3/d16/d38/f2e 8899452 1 2024-09-19T07:24:52.093 INFO:tasks.workunit.client.0.smithi098.stdout:9/296: chown d3/d30/d5c 575327 1 2024-09-19T07:24:52.093 INFO:tasks.workunit.client.0.smithi098.stdout:9/297: write d3/dc/df/f4e [1002583,84852] 0 2024-09-19T07:24:52.093 INFO:tasks.workunit.client.0.smithi098.stdout:9/298: stat d3/dc/df/d15/d1b/c3b 0 2024-09-19T07:24:52.093 INFO:tasks.workunit.client.0.smithi098.stdout:9/299: getdents d3/d16/d43/d61 0 2024-09-19T07:24:52.095 INFO:tasks.workunit.client.0.smithi098.stdout:9/300: rename d3/d16/l20 to d3/d6/d8/l62 0 2024-09-19T07:24:52.095 INFO:tasks.workunit.client.0.smithi098.stdout:9/301: write d3/dc/df/d15/f5b [1681303,111573] 0 2024-09-19T07:24:52.096 INFO:tasks.workunit.client.0.smithi098.stdout:6/264: rmdir d2/d5/d1f/d26/d42/d48/d4a/d5e 0 2024-09-19T07:24:52.096 INFO:tasks.workunit.client.0.smithi098.stdout:6/265: fdatasync d2/d1b/f1d 0 2024-09-19T07:24:52.096 INFO:tasks.workunit.client.0.smithi098.stdout:9/302: mknod d3/d16/d38/d48/c63 0 2024-09-19T07:24:52.096 INFO:tasks.workunit.client.0.smithi098.stdout:6/266: chown d2/c7 115 1 2024-09-19T07:24:52.098 INFO:tasks.workunit.client.0.smithi098.stdout:6/267: creat d2/d5/d1f/d26/d42/d48/d53/f5f x:0 0 0 2024-09-19T07:24:52.098 INFO:tasks.workunit.client.0.smithi098.stdout:1/232: dwrite dc/d17/d2e/f2f [0,4194304] 0 2024-09-19T07:24:52.098 INFO:tasks.workunit.client.0.smithi098.stdout:6/268: read - d2/d5/d1f/d26/d42/d48/d53/f5f zero size 2024-09-19T07:24:52.098 INFO:tasks.workunit.client.0.smithi098.stdout:0/263: dwrite d5/f25 [0,4194304] 0 2024-09-19T07:24:52.099 INFO:tasks.workunit.client.0.smithi098.stdout:7/326: dwrite d5/f40 [0,4194304] 0 2024-09-19T07:24:52.099 INFO:tasks.workunit.client.0.smithi098.stdout:7/327: chown d5/f53 0 1 2024-09-19T07:24:52.100 INFO:tasks.workunit.client.0.smithi098.stdout:1/233: symlink dc/d17/d2e/l52 0 2024-09-19T07:24:52.101 INFO:tasks.workunit.client.0.smithi098.stdout:0/264: symlink d5/d20/d14/d49/l4b 0 2024-09-19T07:24:52.108 INFO:tasks.workunit.client.0.smithi098.stdout:3/279: dwrite de/df/d16/d2e/f4c [0,4194304] 0 2024-09-19T07:24:52.109 INFO:tasks.workunit.client.0.smithi098.stdout:9/303: dread d3/d6/d46/f5e [0,4194304] 0 2024-09-19T07:24:52.110 INFO:tasks.workunit.client.0.smithi098.stdout:6/269: read d2/d5/d1f/d26/f33 [130598,76796] 0 2024-09-19T07:24:52.113 INFO:tasks.workunit.client.0.smithi098.stdout:7/328: link d5/d8/f21 d5/d10/d11/f73 0 2024-09-19T07:24:52.113 INFO:tasks.workunit.client.0.smithi098.stdout:1/234: mkdir dc/d17/d2e/d4d/d53 0 2024-09-19T07:24:52.113 INFO:tasks.workunit.client.0.smithi098.stdout:1/235: fdatasync dc/d17/d1b/d1d/f41 0 2024-09-19T07:24:52.116 INFO:tasks.workunit.client.0.smithi098.stdout:3/280: creat de/d4e/f50 x:0 0 0 2024-09-19T07:24:52.116 INFO:tasks.workunit.client.0.smithi098.stdout:3/281: chown f5 6 1 2024-09-19T07:24:52.116 INFO:tasks.workunit.client.0.smithi098.stdout:3/282: write f0 [868624,102166] 0 2024-09-19T07:24:52.117 INFO:tasks.workunit.client.0.smithi098.stdout:9/304: mknod d3/d16/d43/c64 0 2024-09-19T07:24:52.117 INFO:tasks.workunit.client.0.smithi098.stdout:7/329: symlink d5/d10/d1d/l74 0 2024-09-19T07:24:52.119 INFO:tasks.workunit.client.0.smithi098.stdout:3/283: creat de/d4e/f51 x:0 0 0 2024-09-19T07:24:52.121 INFO:tasks.workunit.client.0.smithi098.stdout:7/330: symlink d5/l75 0 2024-09-19T07:24:52.121 INFO:tasks.workunit.client.0.smithi098.stdout:7/331: chown d5/d8/d5d 1 1 2024-09-19T07:24:52.122 INFO:tasks.workunit.client.0.smithi098.stdout:3/284: mknod de/df/d4f/c52 0 2024-09-19T07:24:52.123 INFO:tasks.workunit.client.0.smithi098.stdout:3/285: creat de/df/f53 x:0 0 0 2024-09-19T07:24:52.123 INFO:tasks.workunit.client.0.smithi098.stdout:3/286: truncate de/df/f53 675520 0 2024-09-19T07:24:52.127 INFO:tasks.workunit.client.0.smithi098.stdout:3/287: mknod de/df/d1f/c54 0 2024-09-19T07:24:52.130 INFO:tasks.workunit.client.0.smithi098.stdout:0/265: dwrite d5/f7 [0,4194304] 0 2024-09-19T07:24:52.131 INFO:tasks.workunit.client.0.smithi098.stdout:3/288: symlink de/df/d1f/l55 0 2024-09-19T07:24:52.134 INFO:tasks.workunit.client.0.smithi098.stdout:0/266: creat d5/d20/d1f/f4c x:0 0 0 2024-09-19T07:24:52.134 INFO:tasks.workunit.client.0.smithi098.stdout:0/267: dread - d5/d20/f41 zero size 2024-09-19T07:24:52.134 INFO:tasks.workunit.client.0.smithi098.stdout:0/268: chown d5/d20/d1f/f4c 1133362 1 2024-09-19T07:24:52.135 INFO:tasks.workunit.client.0.smithi098.stdout:3/289: truncate de/df/f15 1265608 0 2024-09-19T07:24:52.136 INFO:tasks.workunit.client.0.smithi098.stdout:6/270: dwrite d2/d5/d1f/d26/f55 [0,4194304] 0 2024-09-19T07:24:52.136 INFO:tasks.workunit.client.0.smithi098.stdout:0/269: mknod d5/d20/d14/c4d 0 2024-09-19T07:24:52.138 INFO:tasks.workunit.client.0.smithi098.stdout:0/270: creat d5/d20/f4e x:0 0 0 2024-09-19T07:24:52.139 INFO:tasks.workunit.client.0.smithi098.stdout:6/271: creat d2/d5/d1f/d26/d42/d48/d4a/d4e/f60 x:0 0 0 2024-09-19T07:24:52.139 INFO:tasks.workunit.client.0.smithi098.stdout:3/290: rmdir de/df/d1f/d2b 39 2024-09-19T07:24:52.140 INFO:tasks.workunit.client.0.smithi098.stdout:6/272: mknod d2/d5/d1f/d26/d42/d48/d53/c61 0 2024-09-19T07:24:52.140 INFO:tasks.workunit.client.0.smithi098.stdout:6/273: fdatasync d2/fc 0 2024-09-19T07:24:52.140 INFO:tasks.workunit.client.0.smithi098.stdout:6/274: truncate d2/f3e 545327 0 2024-09-19T07:24:52.141 INFO:tasks.workunit.client.0.smithi098.stdout:6/275: dread - d2/d5/d1f/d26/d42/d48/d53/f5d zero size 2024-09-19T07:24:52.142 INFO:tasks.workunit.client.0.smithi098.stdout:6/276: rename d2/d5/d1f/d26/d42/d48/d4a/d4e/f5a to d2/d5/f62 0 2024-09-19T07:24:52.142 INFO:tasks.workunit.client.0.smithi098.stdout:6/277: creat d2/d5/d1f/d26/d42/d48/f63 x:0 0 0 2024-09-19T07:24:52.143 INFO:tasks.workunit.client.0.smithi098.stdout:6/278: mkdir d2/d5/d1f/d26/d42/d48/d53/d64 0 2024-09-19T07:24:52.144 INFO:tasks.workunit.client.0.smithi098.stdout:6/279: creat d2/d5/d1f/d26/d42/d48/d4a/d4e/f65 x:0 0 0 2024-09-19T07:24:52.144 INFO:tasks.workunit.client.0.smithi098.stdout:6/280: readlink d2/d5/d1f/l38 0 2024-09-19T07:24:52.145 INFO:tasks.workunit.client.0.smithi098.stdout:6/281: truncate d2/d5/d1f/d26/d42/d48/d4a/d4e/f50 2131570 0 2024-09-19T07:24:52.146 INFO:tasks.workunit.client.0.smithi098.stdout:6/282: creat d2/d11/f66 x:0 0 0 2024-09-19T07:24:52.154 INFO:tasks.workunit.client.0.smithi098.stdout:9/305: dwrite d3/dc/df/d15/d2f/f5f [0,4194304] 0 2024-09-19T07:24:52.154 INFO:tasks.workunit.client.0.smithi098.stdout:1/236: dwrite dc/f33 [4194304,4194304] 0 2024-09-19T07:24:52.154 INFO:tasks.workunit.client.0.smithi098.stdout:7/332: dwrite d5/d10/d1d/f55 [0,4194304] 0 2024-09-19T07:24:52.157 INFO:tasks.workunit.client.0.smithi098.stdout:9/306: unlink d3/dc/df/d15/d1a/d2b/l3f 0 2024-09-19T07:24:52.158 INFO:tasks.workunit.client.0.smithi098.stdout:0/271: dwrite f4 [0,4194304] 0 2024-09-19T07:24:52.158 INFO:tasks.workunit.client.0.smithi098.stdout:0/272: chown d5/d20/l2d 343022 1 2024-09-19T07:24:52.159 INFO:tasks.workunit.client.0.smithi098.stdout:2/203: sync 2024-09-19T07:24:52.160 INFO:tasks.workunit.client.0.smithi098.stdout:9/307: write d3/d6/d46/f5e [3231593,103344] 0 2024-09-19T07:24:52.161 INFO:tasks.workunit.client.0.smithi098.stdout:1/237: creat dc/d17/d2e/d4d/f54 x:0 0 0 2024-09-19T07:24:52.161 INFO:tasks.workunit.client.0.smithi098.stdout:9/308: truncate d3/d16/f3c 1427871 0 2024-09-19T07:24:52.161 INFO:tasks.workunit.client.0.smithi098.stdout:1/238: fsync dc/de/d22/f4b 0 2024-09-19T07:24:52.165 INFO:tasks.workunit.client.0.smithi098.stdout:7/333: unlink d5/d3e/d61/f6b 0 2024-09-19T07:24:52.166 INFO:tasks.workunit.client.0.smithi098.stdout:0/273: creat d5/f4f x:0 0 0 2024-09-19T07:24:52.166 INFO:tasks.workunit.client.0.smithi098.stdout:0/274: chown d5/d20/f41 1447 1 2024-09-19T07:24:52.166 INFO:tasks.workunit.client.0.smithi098.stdout:0/275: read - d5/d20/f41 zero size 2024-09-19T07:24:52.166 INFO:tasks.workunit.client.0.smithi098.stdout:0/276: write d5/d20/d14/f40 [783268,82730] 0 2024-09-19T07:24:52.167 INFO:tasks.workunit.client.0.smithi098.stdout:1/239: creat dc/d17/d2e/d4d/d53/f55 x:0 0 0 2024-09-19T07:24:52.168 INFO:tasks.workunit.client.0.smithi098.stdout:0/277: symlink d5/d20/d14/l50 0 2024-09-19T07:24:52.168 INFO:tasks.workunit.client.0.smithi098.stdout:0/278: chown d5/d20/f1b 1 1 2024-09-19T07:24:52.170 INFO:tasks.workunit.client.0.smithi098.stdout:6/283: dwrite d2/d11/f5c [0,4194304] 0 2024-09-19T07:24:52.170 INFO:tasks.workunit.client.0.smithi098.stdout:0/279: rmdir d5/d20/d14 39 2024-09-19T07:24:52.173 INFO:tasks.workunit.client.0.smithi098.stdout:6/284: creat d2/d5/d1f/d26/f67 x:0 0 0 2024-09-19T07:24:52.173 INFO:tasks.workunit.client.0.smithi098.stdout:8/270: sync 2024-09-19T07:24:52.174 INFO:tasks.workunit.client.0.smithi098.stdout:6/285: symlink d2/d5/d1f/d26/d42/d48/d4a/d4e/l68 0 2024-09-19T07:24:52.174 INFO:tasks.workunit.client.0.smithi098.stdout:6/286: readlink d2/l22 0 2024-09-19T07:24:52.174 INFO:tasks.workunit.client.0.smithi098.stdout:6/287: fdatasync f1 0 2024-09-19T07:24:52.175 INFO:tasks.workunit.client.0.smithi098.stdout:8/271: creat d0/de/d21/d3c/f57 x:0 0 0 2024-09-19T07:24:52.178 INFO:tasks.workunit.client.0.smithi098.stdout:5/258: sync 2024-09-19T07:24:52.178 INFO:tasks.workunit.client.0.smithi098.stdout:4/227: sync 2024-09-19T07:24:52.178 INFO:tasks.workunit.client.0.smithi098.stdout:4/228: read - da/f3d zero size 2024-09-19T07:24:52.178 INFO:tasks.workunit.client.0.smithi098.stdout:5/259: dread - dc/de/d13/d3b/f3c zero size 2024-09-19T07:24:52.178 INFO:tasks.workunit.client.0.smithi098.stdout:5/260: write f5 [854686,48417] 0 2024-09-19T07:24:52.178 INFO:tasks.workunit.client.0.smithi098.stdout:5/261: fdatasync dc/de/d13/d46/d23/f32 0 2024-09-19T07:24:52.180 INFO:tasks.workunit.client.0.smithi098.stdout:5/262: creat dc/de/d13/d3b/f56 x:0 0 0 2024-09-19T07:24:52.181 INFO:tasks.workunit.client.0.smithi098.stdout:5/263: dread - dc/de/d13/f21 zero size 2024-09-19T07:24:52.188 INFO:tasks.workunit.client.0.smithi098.stdout:8/272: write d0/f25 [1230293,42529] 0 2024-09-19T07:24:52.188 INFO:tasks.workunit.client.0.smithi098.stdout:8/273: fsync d0/de/f18 0 2024-09-19T07:24:52.188 INFO:tasks.workunit.client.0.smithi098.stdout:8/274: write d0/f4c [1510511,59455] 0 2024-09-19T07:24:52.188 INFO:tasks.workunit.client.0.smithi098.stdout:8/275: chown d0/de/d28/l36 198 1 2024-09-19T07:24:52.193 INFO:tasks.workunit.client.0.smithi098.stdout:6/288: dread d2/d11/f5c [0,4194304] 0 2024-09-19T07:24:52.194 INFO:tasks.workunit.client.0.smithi098.stdout:9/309: dwrite d3/dc/df/d15/d1b/f37 [0,4194304] 0 2024-09-19T07:24:52.194 INFO:tasks.workunit.client.0.smithi098.stdout:9/310: chown d3/d16/d38/d48 7725907 1 2024-09-19T07:24:52.194 INFO:tasks.workunit.client.0.smithi098.stdout:7/334: dread d5/d10/f32 [0,4194304] 0 2024-09-19T07:24:52.195 INFO:tasks.workunit.client.0.smithi098.stdout:0/280: dwrite d5/f25 [0,4194304] 0 2024-09-19T07:24:52.195 INFO:tasks.workunit.client.0.smithi098.stdout:6/289: creat d2/d5/d1f/d26/f69 x:0 0 0 2024-09-19T07:24:52.195 INFO:tasks.workunit.client.0.smithi098.stdout:6/290: chown d2/d11/f2a 3420595 1 2024-09-19T07:24:52.196 INFO:tasks.workunit.client.0.smithi098.stdout:7/335: stat d5/c23 0 2024-09-19T07:24:52.199 INFO:tasks.workunit.client.0.smithi098.stdout:9/311: mkdir d3/dc/df/d15/d1a/d2b/d49/d65 0 2024-09-19T07:24:52.199 INFO:tasks.workunit.client.0.smithi098.stdout:0/281: creat d5/d20/f51 x:0 0 0 2024-09-19T07:24:52.202 INFO:tasks.workunit.client.0.smithi098.stdout:9/312: creat d3/d16/d43/d61/f66 x:0 0 0 2024-09-19T07:24:52.203 INFO:tasks.workunit.client.0.smithi098.stdout:0/282: rmdir d5/d20/d14/d49 39 2024-09-19T07:24:52.203 INFO:tasks.workunit.client.0.smithi098.stdout:1/240: dwrite f1 [0,4194304] 0 2024-09-19T07:24:52.204 INFO:tasks.workunit.client.0.smithi098.stdout:9/313: symlink d3/d16/d43/d51/l67 0 2024-09-19T07:24:52.205 INFO:tasks.workunit.client.0.smithi098.stdout:0/283: mkdir d5/d20/d1f/d52 0 2024-09-19T07:24:52.205 INFO:tasks.workunit.client.0.smithi098.stdout:0/284: fdatasync d5/d20/d14/f32 0 2024-09-19T07:24:52.207 INFO:tasks.workunit.client.0.smithi098.stdout:9/314: symlink d3/d6/d46/l68 0 2024-09-19T07:24:52.210 INFO:tasks.workunit.client.0.smithi098.stdout:0/285: symlink d5/d20/d14/d49/l53 0 2024-09-19T07:24:52.210 INFO:tasks.workunit.client.0.smithi098.stdout:0/286: fdatasync d5/d20/d14/f35 0 2024-09-19T07:24:52.211 INFO:tasks.workunit.client.0.smithi098.stdout:9/315: symlink d3/d30/l69 0 2024-09-19T07:24:52.212 INFO:tasks.workunit.client.0.smithi098.stdout:9/316: fdatasync d3/d16/f3c 0 2024-09-19T07:24:52.212 INFO:tasks.workunit.client.0.smithi098.stdout:4/229: dwrite da/f16 [0,4194304] 0 2024-09-19T07:24:52.213 INFO:tasks.workunit.client.0.smithi098.stdout:0/287: mknod d5/d20/d1f/c54 0 2024-09-19T07:24:52.213 INFO:tasks.workunit.client.0.smithi098.stdout:0/288: write d5/f17 [1492215,117924] 0 2024-09-19T07:24:52.215 INFO:tasks.workunit.client.0.smithi098.stdout:9/317: truncate d3/d6/d46/f5e 3802729 0 2024-09-19T07:24:52.216 INFO:tasks.workunit.client.0.smithi098.stdout:0/289: link d5/d20/d1f/l3f d5/d20/l55 0 2024-09-19T07:24:52.218 INFO:tasks.workunit.client.0.smithi098.stdout:4/230: rename da/c20 to da/c4a 0 2024-09-19T07:24:52.219 INFO:tasks.workunit.client.0.smithi098.stdout:4/231: stat da/d31/f35 0 2024-09-19T07:24:52.219 INFO:tasks.workunit.client.0.smithi098.stdout:9/318: link d3/d16/f3c d3/dc/f6a 0 2024-09-19T07:24:52.219 INFO:tasks.workunit.client.0.smithi098.stdout:1/241: rename dc/f28 to dc/d17/d2e/f56 0 2024-09-19T07:24:52.219 INFO:tasks.workunit.client.0.smithi098.stdout:1/242: stat dc/d17/d1b/d1d 0 2024-09-19T07:24:52.219 INFO:tasks.workunit.client.0.smithi098.stdout:1/243: write dc/d17/d1b/d1d/f41 [604836,95045] 0 2024-09-19T07:24:52.219 INFO:tasks.workunit.client.0.smithi098.stdout:6/291: dread f1 [0,4194304] 0 2024-09-19T07:24:52.221 INFO:tasks.workunit.client.0.smithi098.stdout:9/319: symlink d3/dc/df/d15/d1a/d2b/d49/d50/l6b 0 2024-09-19T07:24:52.222 INFO:tasks.workunit.client.0.smithi098.stdout:5/264: dwrite fa [0,4194304] 0 2024-09-19T07:24:52.222 INFO:tasks.workunit.client.0.smithi098.stdout:5/265: chown dc/de/d13/d46/d2e/d37/c51 2343766 1 2024-09-19T07:24:52.222 INFO:tasks.workunit.client.0.smithi098.stdout:6/292: symlink d2/d5/d1f/d26/d42/d48/d4a/d4e/l6a 0 2024-09-19T07:24:52.222 INFO:tasks.workunit.client.0.smithi098.stdout:4/232: creat da/f4b x:0 0 0 2024-09-19T07:24:52.222 INFO:tasks.workunit.client.0.smithi098.stdout:6/293: creat d2/d5/d1f/d26/d42/d48/d4a/f6b x:0 0 0 2024-09-19T07:24:52.223 INFO:tasks.workunit.client.0.smithi098.stdout:6/294: symlink d2/d5/d1f/l6c 0 2024-09-19T07:24:52.224 INFO:tasks.workunit.client.0.smithi098.stdout:6/295: mkdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d 0 2024-09-19T07:24:52.224 INFO:tasks.workunit.client.0.smithi098.stdout:1/244: symlink dc/d2a/l57 0 2024-09-19T07:24:52.225 INFO:tasks.workunit.client.0.smithi098.stdout:1/245: truncate dc/d17/d1b/d1d/f3f 433379 0 2024-09-19T07:24:52.225 INFO:tasks.workunit.client.0.smithi098.stdout:6/296: mkdir d2/d5/d1f/d26/d42/d48/d4a/d4e/d6e 0 2024-09-19T07:24:52.225 INFO:tasks.workunit.client.0.smithi098.stdout:9/320: rename d3/dc/df/d15/d1a/d2b/d49/d55/c58 to d3/dc/df/c6c 0 2024-09-19T07:24:52.226 INFO:tasks.workunit.client.0.smithi098.stdout:6/297: creat d2/d5/d1f/d26/d42/d48/d4a/d4e/f6f x:0 0 0 2024-09-19T07:24:52.229 INFO:tasks.workunit.client.0.smithi098.stdout:5/266: symlink dc/de/d13/d46/d2e/l57 0 2024-09-19T07:24:52.229 INFO:tasks.workunit.client.0.smithi098.stdout:6/298: creat d2/d5/d1f/d26/d42/d48/f70 x:0 0 0 2024-09-19T07:24:52.229 INFO:tasks.workunit.client.0.smithi098.stdout:6/299: dread - d2/d5/d1f/d26/d42/d48/d4a/d4e/f65 zero size 2024-09-19T07:24:52.229 INFO:tasks.workunit.client.0.smithi098.stdout:1/246: truncate dc/d17/d2e/f39 149944 0 2024-09-19T07:24:52.229 INFO:tasks.workunit.client.0.smithi098.stdout:1/247: chown dc/f2c 6655951 1 2024-09-19T07:24:52.229 INFO:tasks.workunit.client.0.smithi098.stdout:9/321: creat d3/d16/d43/d51/f6d x:0 0 0 2024-09-19T07:24:52.229 INFO:tasks.workunit.client.0.smithi098.stdout:9/322: getdents d3/d30/d5c 0 2024-09-19T07:24:52.229 INFO:tasks.workunit.client.0.smithi098.stdout:9/323: fdatasync d3/d16/d38/f4f 0 2024-09-19T07:24:52.230 INFO:tasks.workunit.client.0.smithi098.stdout:1/248: read dc/de/d37/f48 [178989,119909] 0 2024-09-19T07:24:52.230 INFO:tasks.workunit.client.0.smithi098.stdout:8/276: dwrite d0/f4c [0,4194304] 0 2024-09-19T07:24:52.230 INFO:tasks.workunit.client.0.smithi098.stdout:8/277: write d0/de/f15 [13370965,110357] 0 2024-09-19T07:24:52.230 INFO:tasks.workunit.client.0.smithi098.stdout:8/278: fdatasync d0/f4c 0 2024-09-19T07:24:52.230 INFO:tasks.workunit.client.0.smithi098.stdout:8/279: readlink d0/d1a/l24 0 2024-09-19T07:24:52.230 INFO:tasks.workunit.client.0.smithi098.stdout:8/280: write d0/de/d21/d3c/f57 [889908,80035] 0 2024-09-19T07:24:52.230 INFO:tasks.workunit.client.0.smithi098.stdout:8/281: fdatasync d0/f4e 0 2024-09-19T07:24:52.230 INFO:tasks.workunit.client.0.smithi098.stdout:7/336: dwrite d5/d10/f4a [4194304,4194304] 0 2024-09-19T07:24:52.230 INFO:tasks.workunit.client.0.smithi098.stdout:5/267: creat dc/de/d13/d3b/f58 x:0 0 0 2024-09-19T07:24:52.230 INFO:tasks.workunit.client.0.smithi098.stdout:1/249: truncate dc/d17/d2e/f56 599243 0 2024-09-19T07:24:52.230 INFO:tasks.workunit.client.0.smithi098.stdout:1/250: stat dc/d17/d2e/d4d 0 2024-09-19T07:24:52.232 INFO:tasks.workunit.client.0.smithi098.stdout:6/300: dread d2/d5/d1f/d26/d42/d48/d4a/f4f [0,4194304] 0 2024-09-19T07:24:52.232 INFO:tasks.workunit.client.0.smithi098.stdout:6/301: chown d2/d5/d1f/d26/f33 20 1 2024-09-19T07:24:52.232 INFO:tasks.workunit.client.0.smithi098.stdout:6/302: chown d2/d5/d1f/d26/d42/d48/f70 1 1 2024-09-19T07:24:52.232 INFO:tasks.workunit.client.0.smithi098.stdout:1/251: mkdir dc/de/d22/d31/d35/d58 0 2024-09-19T07:24:52.232 INFO:tasks.workunit.client.0.smithi098.stdout:1/252: chown cb 23812 1 2024-09-19T07:24:52.232 INFO:tasks.workunit.client.0.smithi098.stdout:1/253: chown dc/d17/d1b/d1d/f41 2 1 2024-09-19T07:24:52.232 INFO:tasks.workunit.client.0.smithi098.stdout:4/233: write da/f16 [1119762,17782] 0 2024-09-19T07:24:52.232 INFO:tasks.workunit.client.0.smithi098.stdout:4/234: chown da/f4b 499 1 2024-09-19T07:24:52.232 INFO:tasks.workunit.client.0.smithi098.stdout:1/254: write dc/d17/d1b/d1d/f41 [445805,36455] 0 2024-09-19T07:24:52.233 INFO:tasks.workunit.client.0.smithi098.stdout:4/235: symlink da/d31/l4c 0 2024-09-19T07:24:52.233 INFO:tasks.workunit.client.0.smithi098.stdout:4/236: write da/f16 [1520251,66540] 0 2024-09-19T07:24:52.237 INFO:tasks.workunit.client.0.smithi098.stdout:7/337: rename d5/d10/d50/c64 to d5/d8/dc/c76 0 2024-09-19T07:24:52.240 INFO:tasks.workunit.client.0.smithi098.stdout:5/268: getdents dc/de/d13 0 2024-09-19T07:24:52.240 INFO:tasks.workunit.client.0.smithi098.stdout:5/269: stat l7 0 2024-09-19T07:24:52.241 INFO:tasks.workunit.client.0.smithi098.stdout:0/290: getdents d5/d20/d1f 0 2024-09-19T07:24:52.241 INFO:tasks.workunit.client.0.smithi098.stdout:0/291: chown d5/d20/d14 24110 1 2024-09-19T07:24:52.241 INFO:tasks.workunit.client.0.smithi098.stdout:0/292: chown d5/f46 343436183 1 2024-09-19T07:24:52.242 INFO:tasks.workunit.client.0.smithi098.stdout:9/324: read d3/d6/d46/f5e [2316087,58893] 0 2024-09-19T07:24:52.242 INFO:tasks.workunit.client.0.smithi098.stdout:9/325: write d3/d16/f3e [63364,3325] 0 2024-09-19T07:24:52.242 INFO:tasks.workunit.client.0.smithi098.stdout:9/326: truncate d3/d16/d43/d51/f5a 710612 0 2024-09-19T07:24:52.256 INFO:tasks.workunit.client.0.smithi098.stdout:7/338: write d5/d10/d1d/f51 [972840,10711] 0 2024-09-19T07:24:52.256 INFO:tasks.workunit.client.0.smithi098.stdout:7/339: getdents d5/d8/d5d 0 2024-09-19T07:24:52.257 INFO:tasks.workunit.client.0.smithi098.stdout:1/255: dwrite dc/f12 [4194304,4194304] 0 2024-09-19T07:24:52.257 INFO:tasks.workunit.client.0.smithi098.stdout:1/256: chown dc/l1a 1 1 2024-09-19T07:24:52.258 INFO:tasks.workunit.client.0.smithi098.stdout:9/327: write d3/dc/df/d15/f5b [3731839,63019] 0 2024-09-19T07:24:52.258 INFO:tasks.workunit.client.0.smithi098.stdout:9/328: chown d3/d16/d43/d61 31724 1 2024-09-19T07:24:52.258 INFO:tasks.workunit.client.0.smithi098.stdout:9/329: read d3/dc/df/d15/f28 [405882,110021] 0 2024-09-19T07:24:52.258 INFO:tasks.workunit.client.0.smithi098.stdout:9/330: chown d3/d30/d5c 79 1 2024-09-19T07:24:52.260 INFO:tasks.workunit.client.0.smithi098.stdout:1/257: dread dc/d17/d1b/d1d/f3f [0,4194304] 0 2024-09-19T07:24:52.263 INFO:tasks.workunit.client.0.smithi098.stdout:8/282: dwrite d0/f7 [4194304,4194304] 0 2024-09-19T07:24:52.263 INFO:tasks.workunit.client.0.smithi098.stdout:5/270: dread dc/de/f2a [0,4194304] 0 2024-09-19T07:24:52.263 INFO:tasks.workunit.client.0.smithi098.stdout:3/291: sync 2024-09-19T07:24:52.265 INFO:tasks.workunit.client.0.smithi098.stdout:0/293: dwrite d5/f25 [0,4194304] 0 2024-09-19T07:24:52.265 INFO:tasks.workunit.client.0.smithi098.stdout:0/294: fsync d5/f18 0 2024-09-19T07:24:52.265 INFO:tasks.workunit.client.0.smithi098.stdout:0/295: read - d5/d20/d14/f4a zero size 2024-09-19T07:24:52.265 INFO:tasks.workunit.client.0.smithi098.stdout:0/296: write d5/f48 [898974,54285] 0 2024-09-19T07:24:52.270 INFO:tasks.workunit.client.0.smithi098.stdout:6/303: rmdir d2 39 2024-09-19T07:24:52.270 INFO:tasks.workunit.client.0.smithi098.stdout:6/304: stat d2/d11/l2d 0 2024-09-19T07:24:52.271 INFO:tasks.workunit.client.0.smithi098.stdout:6/305: fdatasync d2/d5/d1f/d26/d42/d48/f63 0 2024-09-19T07:24:52.271 INFO:tasks.workunit.client.0.smithi098.stdout:6/306: fdatasync d2/d11/f2a 0 2024-09-19T07:24:52.271 INFO:tasks.workunit.client.0.smithi098.stdout:6/307: stat d2/d1b/f2f 0 2024-09-19T07:24:52.273 INFO:tasks.workunit.client.0.smithi098.stdout:8/283: unlink d0/fa 0 2024-09-19T07:24:52.273 INFO:tasks.workunit.client.0.smithi098.stdout:8/284: readlink d0/de/d12/l37 0 2024-09-19T07:24:52.273 INFO:tasks.workunit.client.0.smithi098.stdout:8/285: chown d0/de/d12/l1b 28533898 1 2024-09-19T07:24:52.274 INFO:tasks.workunit.client.0.smithi098.stdout:5/271: symlink dc/de/d13/d46/l59 0 2024-09-19T07:24:52.279 INFO:tasks.workunit.client.0.smithi098.stdout:5/272: stat dc/de/f2c 0 2024-09-19T07:24:52.281 INFO:tasks.workunit.client.0.smithi098.stdout:5/273: creat dc/de/d13/d46/f5a x:0 0 0 2024-09-19T07:24:52.281 INFO:tasks.workunit.client.0.smithi098.stdout:8/286: read d0/d16/f3f [3401730,69831] 0 2024-09-19T07:24:52.281 INFO:tasks.workunit.client.0.smithi098.stdout:8/287: stat d0/d16/f3f 0 2024-09-19T07:24:52.282 INFO:tasks.workunit.client.0.smithi098.stdout:5/274: read f0 [4916850,113220] 0 2024-09-19T07:24:52.282 INFO:tasks.workunit.client.0.smithi098.stdout:8/288: mknod d0/d33/c58 0 2024-09-19T07:24:52.284 INFO:tasks.workunit.client.0.smithi098.stdout:6/308: write f1 [4417949,117981] 0 2024-09-19T07:24:52.285 INFO:tasks.workunit.client.0.smithi098.stdout:6/309: mknod d2/d5/d1f/d26/d42/d48/d4a/d4e/d6e/c71 0 2024-09-19T07:24:52.285 INFO:tasks.workunit.client.0.smithi098.stdout:6/310: dread - d2/d5/d1f/d26/d42/d48/d4a/d4e/f6f zero size 2024-09-19T07:24:52.285 INFO:tasks.workunit.client.0.smithi098.stdout:3/292: dwrite de/df/f37 [0,4194304] 0 2024-09-19T07:24:52.286 INFO:tasks.workunit.client.0.smithi098.stdout:7/340: dwrite d5/d8/dc/d4b/d59/f63 [0,4194304] 0 2024-09-19T07:24:52.286 INFO:tasks.workunit.client.0.smithi098.stdout:7/341: chown d5/d10/f32 14269880 1 2024-09-19T07:24:52.288 INFO:tasks.workunit.client.0.smithi098.stdout:7/342: symlink d5/d3e/d62/l77 0 2024-09-19T07:24:52.289 INFO:tasks.workunit.client.0.smithi098.stdout:3/293: creat de/df/d1f/f56 x:0 0 0 2024-09-19T07:24:52.290 INFO:tasks.workunit.client.0.smithi098.stdout:7/343: getdents d5/d3e/d61 0 2024-09-19T07:24:52.292 INFO:tasks.workunit.client.0.smithi098.stdout:7/344: getdents d5/d10/d11 0 2024-09-19T07:24:52.293 INFO:tasks.workunit.client.0.smithi098.stdout:7/345: write d5/d10/d1d/f39 [2169768,93332] 0 2024-09-19T07:24:52.294 INFO:tasks.workunit.client.0.smithi098.stdout:2/204: sync 2024-09-19T07:24:52.294 INFO:tasks.workunit.client.0.smithi098.stdout:4/237: rename c5 to da/d31/c4d 0 2024-09-19T07:24:52.294 INFO:tasks.workunit.client.0.smithi098.stdout:4/238: readlink da/d31/l33 0 2024-09-19T07:24:52.294 INFO:tasks.workunit.client.0.smithi098.stdout:7/346: creat d5/d8/dc/d16/f78 x:0 0 0 2024-09-19T07:24:52.295 INFO:tasks.workunit.client.0.smithi098.stdout:5/275: dread dc/de/d13/d46/f26 [0,4194304] 0 2024-09-19T07:24:52.296 INFO:tasks.workunit.client.0.smithi098.stdout:1/258: rename dc/f12 to dc/d17/d1b/d1d/d30/f59 0 2024-09-19T07:24:52.297 INFO:tasks.workunit.client.0.smithi098.stdout:2/205: creat d1/d5/f46 x:0 0 0 2024-09-19T07:24:52.298 INFO:tasks.workunit.client.0.smithi098.stdout:2/206: write d1/d9/d1d/f43 [122585,75084] 0 2024-09-19T07:24:52.300 INFO:tasks.workunit.client.0.smithi098.stdout:7/347: creat d5/d8/dc/d16/d4f/f79 x:0 0 0 2024-09-19T07:24:52.300 INFO:tasks.workunit.client.0.smithi098.stdout:6/311: rename d2/d5/d1f/d26/d42/d48/d4a/d4e/f60 to d2/d5/d1f/d26/d42/d48/f72 0 2024-09-19T07:24:52.300 INFO:tasks.workunit.client.0.smithi098.stdout:1/259: chown dc/de/c29 0 1 2024-09-19T07:24:52.301 INFO:tasks.workunit.client.0.smithi098.stdout:1/260: write dc/de/d22/f4b [13642,127055] 0 2024-09-19T07:24:52.301 INFO:tasks.workunit.client.0.smithi098.stdout:1/261: chown dc/d17/d1b/d1d 3317694 1 2024-09-19T07:24:52.301 INFO:tasks.workunit.client.0.smithi098.stdout:1/262: write dc/de/d22/f4b [406192,6539] 0 2024-09-19T07:24:52.301 INFO:tasks.workunit.client.0.smithi098.stdout:1/263: read - dc/de/d38/f44 zero size 2024-09-19T07:24:52.302 INFO:tasks.workunit.client.0.smithi098.stdout:6/312: symlink d2/d5/d1f/d26/d42/d48/d4a/l73 0 2024-09-19T07:24:52.304 INFO:tasks.workunit.client.0.smithi098.stdout:8/289: dwrite d0/d16/f3a [0,4194304] 0 2024-09-19T07:24:52.304 INFO:tasks.workunit.client.0.smithi098.stdout:4/239: rename da/lf to da/d31/l4e 0 2024-09-19T07:24:52.306 INFO:tasks.workunit.client.0.smithi098.stdout:8/290: symlink d0/de/d21/d50/l59 0 2024-09-19T07:24:52.306 INFO:tasks.workunit.client.0.smithi098.stdout:8/291: write d0/d16/f23 [2490207,34323] 0 2024-09-19T07:24:52.307 INFO:tasks.workunit.client.0.smithi098.stdout:2/207: rename d1/d5/fe to d1/d9/f47 0 2024-09-19T07:24:52.307 INFO:tasks.workunit.client.0.smithi098.stdout:2/208: chown d1/d2c/f2f 11342 1 2024-09-19T07:24:52.307 INFO:tasks.workunit.client.0.smithi098.stdout:2/209: dread - d1/d5/f38 zero size 2024-09-19T07:24:52.307 INFO:tasks.workunit.client.0.smithi098.stdout:8/292: creat d0/de/d21/d50/f5a x:0 0 0 2024-09-19T07:24:52.308 INFO:tasks.workunit.client.0.smithi098.stdout:4/240: unlink da/f23 0 2024-09-19T07:24:52.309 INFO:tasks.workunit.client.0.smithi098.stdout:2/210: mkdir d1/d9/d26/d35/d48 0 2024-09-19T07:24:52.309 INFO:tasks.workunit.client.0.smithi098.stdout:1/264: write dc/de/d22/d31/f4c [938575,622] 0 2024-09-19T07:24:52.309 INFO:tasks.workunit.client.0.smithi098.stdout:1/265: readlink l6 0 2024-09-19T07:24:52.309 INFO:tasks.workunit.client.0.smithi098.stdout:1/266: stat f1 0 2024-09-19T07:24:52.309 INFO:tasks.workunit.client.0.smithi098.stdout:1/267: stat dc/de/d22/c2b 0 2024-09-19T07:24:52.309 INFO:tasks.workunit.client.0.smithi098.stdout:8/293: symlink d0/d2c/l5b 0 2024-09-19T07:24:52.310 INFO:tasks.workunit.client.0.smithi098.stdout:2/211: mkdir d1/d9/d26/d35/d48/d49 0 2024-09-19T07:24:52.310 INFO:tasks.workunit.client.0.smithi098.stdout:1/268: symlink dc/de/d38/l5a 0 2024-09-19T07:24:52.310 INFO:tasks.workunit.client.0.smithi098.stdout:1/269: read - dc/d2a/f51 zero size 2024-09-19T07:24:52.310 INFO:tasks.workunit.client.0.smithi098.stdout:1/270: write dc/de/d22/f4b [1371991,61746] 0 2024-09-19T07:24:52.310 INFO:tasks.workunit.client.0.smithi098.stdout:1/271: stat dc/de/d38/f44 0 2024-09-19T07:24:52.311 INFO:tasks.workunit.client.0.smithi098.stdout:8/294: symlink d0/d33/d55/l5c 0 2024-09-19T07:24:52.311 INFO:tasks.workunit.client.0.smithi098.stdout:8/295: chown d0/de/d12/l37 684 1 2024-09-19T07:24:52.312 INFO:tasks.workunit.client.0.smithi098.stdout:2/212: unlink d1/d5/c7 0 2024-09-19T07:24:52.312 INFO:tasks.workunit.client.0.smithi098.stdout:1/272: creat dc/de/d22/d31/f5b x:0 0 0 2024-09-19T07:24:52.312 INFO:tasks.workunit.client.0.smithi098.stdout:4/241: symlink da/l4f 0 2024-09-19T07:24:52.313 INFO:tasks.workunit.client.0.smithi098.stdout:1/273: symlink dc/d17/d1b/d1d/l5c 0 2024-09-19T07:24:52.313 INFO:tasks.workunit.client.0.smithi098.stdout:1/274: readlink dc/l11 0 2024-09-19T07:24:52.313 INFO:tasks.workunit.client.0.smithi098.stdout:4/242: truncate da/f1f 1271740 0 2024-09-19T07:24:52.314 INFO:tasks.workunit.client.0.smithi098.stdout:1/275: mkdir dc/de/d22/d31/d5d 0 2024-09-19T07:24:52.314 INFO:tasks.workunit.client.0.smithi098.stdout:8/296: dread d0/de/f27 [0,4194304] 0 2024-09-19T07:24:52.315 INFO:tasks.workunit.client.0.smithi098.stdout:8/297: symlink d0/d2c/l5d 0 2024-09-19T07:24:52.319 INFO:tasks.workunit.client.0.smithi098.stdout:7/348: dread d5/d8/dc/d4b/d59/f63 [0,4194304] 0 2024-09-19T07:24:52.319 INFO:tasks.workunit.client.0.smithi098.stdout:7/349: truncate d5/d8/dc/d16/f78 963492 0 2024-09-19T07:24:52.319 INFO:tasks.workunit.client.0.smithi098.stdout:7/350: readlink d5/d10/l3d 0 2024-09-19T07:24:52.325 INFO:tasks.workunit.client.0.smithi098.stdout:5/276: dwrite dc/de/d13/d3b/f3c [0,4194304] 0 2024-09-19T07:24:52.325 INFO:tasks.workunit.client.0.smithi098.stdout:3/294: dwrite de/df/d16/d2e/f4c [0,4194304] 0 2024-09-19T07:24:52.325 INFO:tasks.workunit.client.0.smithi098.stdout:3/295: read - de/d4e/f50 zero size 2024-09-19T07:24:52.326 INFO:tasks.workunit.client.0.smithi098.stdout:7/351: dread d5/f3c [0,4194304] 0 2024-09-19T07:24:52.327 INFO:tasks.workunit.client.0.smithi098.stdout:1/276: dread dc/d17/d2e/f2f [0,4194304] 0 2024-09-19T07:24:52.328 INFO:tasks.workunit.client.0.smithi098.stdout:3/296: creat de/df/d1f/d2b/f57 x:0 0 0 2024-09-19T07:24:52.328 INFO:tasks.workunit.client.0.smithi098.stdout:2/213: dread d1/d9/f1b [0,4194304] 0 2024-09-19T07:24:52.328 INFO:tasks.workunit.client.0.smithi098.stdout:7/352: rmdir d5/d10/d11 39 2024-09-19T07:24:52.330 INFO:tasks.workunit.client.0.smithi098.stdout:8/298: dread d0/f4c [0,4194304] 0 2024-09-19T07:24:52.331 INFO:tasks.workunit.client.0.smithi098.stdout:1/277: dread dc/d17/d2e/f2f [0,4194304] 0 2024-09-19T07:24:52.332 INFO:tasks.workunit.client.0.smithi098.stdout:1/278: chown dc/de/c26 869646 1 2024-09-19T07:24:52.335 INFO:tasks.workunit.client.0.smithi098.stdout:2/214: link d1/d5/f38 d1/d9/d1d/f4a 0 2024-09-19T07:24:52.335 INFO:tasks.workunit.client.0.smithi098.stdout:2/215: fdatasync d1/d5/f46 0 2024-09-19T07:24:52.335 INFO:tasks.workunit.client.0.smithi098.stdout:2/216: chown d1/da/f22 134759065 1 2024-09-19T07:24:52.337 INFO:tasks.workunit.client.0.smithi098.stdout:7/353: creat d5/d3e/d62/f7a x:0 0 0 2024-09-19T07:24:52.343 INFO:tasks.workunit.client.0.smithi098.stdout:7/354: mknod d5/d8/c7b 0 2024-09-19T07:24:52.344 INFO:tasks.workunit.client.0.smithi098.stdout:7/355: mknod d5/d8/d5d/c7c 0 2024-09-19T07:24:52.346 INFO:tasks.workunit.client.0.smithi098.stdout:7/356: getdents d5/d8/d52 0 2024-09-19T07:24:52.350 INFO:tasks.workunit.client.0.smithi098.stdout:7/357: unlink d5/d10/l3d 0 2024-09-19T07:24:52.352 INFO:tasks.workunit.client.0.smithi098.stdout:7/358: creat d5/d8/d5d/f7d x:0 0 0 2024-09-19T07:24:52.354 INFO:tasks.workunit.client.0.smithi098.stdout:7/359: creat d5/d8/dc/d16/f7e x:0 0 0 2024-09-19T07:24:52.360 INFO:tasks.workunit.client.0.smithi098.stdout:5/277: dwrite dc/de/f1d [0,4194304] 0 2024-09-19T07:24:52.365 INFO:tasks.workunit.client.0.smithi098.stdout:7/360: dread d5/d8/dc/d16/f2e [0,4194304] 0 2024-09-19T07:24:52.365 INFO:tasks.workunit.client.0.smithi098.stdout:7/361: chown d5/d8/dc/d16/l3b 270 1 2024-09-19T07:24:52.365 INFO:tasks.workunit.client.0.smithi098.stdout:7/362: rename d5/d3e to d5/d3e/d7f 22 2024-09-19T07:24:52.365 INFO:tasks.workunit.client.0.smithi098.stdout:7/363: stat d5/d8/f21 0 2024-09-19T07:24:52.366 INFO:tasks.workunit.client.0.smithi098.stdout:7/364: mknod d5/d8/dc/d16/d4f/d5c/c80 0 2024-09-19T07:24:52.368 INFO:tasks.workunit.client.0.smithi098.stdout:7/365: mknod d5/d3e/d62/c81 0 2024-09-19T07:24:52.368 INFO:tasks.workunit.client.0.smithi098.stdout:3/297: dwrite de/f28 [4194304,4194304] 0 2024-09-19T07:24:52.368 INFO:tasks.workunit.client.0.smithi098.stdout:1/279: dwrite dc/d17/d2e/d4d/f54 [0,4194304] 0 2024-09-19T07:24:52.369 INFO:tasks.workunit.client.0.smithi098.stdout:8/299: dwrite d0/f25 [0,4194304] 0 2024-09-19T07:24:52.369 INFO:tasks.workunit.client.0.smithi098.stdout:2/217: dwrite d1/d9/f2e [0,4194304] 0 2024-09-19T07:24:52.373 INFO:tasks.workunit.client.0.smithi098.stdout:1/280: symlink dc/d17/d1b/l5e 0 2024-09-19T07:24:52.379 INFO:tasks.workunit.client.0.smithi098.stdout:8/300: creat d0/d2c/f5e x:0 0 0 2024-09-19T07:24:52.379 INFO:tasks.workunit.client.0.smithi098.stdout:8/301: write d0/f4e [1022915,25945] 0 2024-09-19T07:24:52.380 INFO:tasks.workunit.client.0.smithi098.stdout:2/218: rename d1/d5/f46 to d1/d9/d3e/d41/f4b 0 2024-09-19T07:24:52.380 INFO:tasks.workunit.client.0.smithi098.stdout:2/219: chown d1/d9/d26/d35/l3c 29039 1 2024-09-19T07:24:52.383 INFO:tasks.workunit.client.0.smithi098.stdout:1/281: truncate dc/d17/d1b/d1d/d30/f59 8199898 0 2024-09-19T07:24:52.383 INFO:tasks.workunit.client.0.smithi098.stdout:1/282: stat dc/d2a 0 2024-09-19T07:24:52.383 INFO:tasks.workunit.client.0.smithi098.stdout:1/283: chown dc/l27 32137 1 2024-09-19T07:24:52.383 INFO:tasks.workunit.client.0.smithi098.stdout:7/366: symlink d5/d10/l82 0 2024-09-19T07:24:52.384 INFO:tasks.workunit.client.0.smithi098.stdout:5/278: dwrite fa [0,4194304] 0 2024-09-19T07:24:52.385 INFO:tasks.workunit.client.0.smithi098.stdout:3/298: mknod de/c58 0 2024-09-19T07:24:52.385 INFO:tasks.workunit.client.0.smithi098.stdout:3/299: fdatasync de/f26 0 2024-09-19T07:24:52.385 INFO:tasks.workunit.client.0.smithi098.stdout:9/331: sync 2024-09-19T07:24:52.401 INFO:tasks.workunit.client.0.smithi098.stdout:3/300: dread f4 [0,4194304] 0 2024-09-19T07:24:52.401 INFO:tasks.workunit.client.0.smithi098.stdout:1/284: write dc/f33 [5043070,26632] 0 2024-09-19T07:24:52.403 INFO:tasks.workunit.client.0.smithi098.stdout:2/220: dwrite d1/da/f25 [0,4194304] 0 2024-09-19T07:24:52.403 INFO:tasks.workunit.client.0.smithi098.stdout:3/301: readlink de/df/d16/d2e/l33 0 2024-09-19T07:24:52.405 INFO:tasks.workunit.client.0.smithi098.stdout:1/285: mkdir dc/d17/d2e/d5f 0 2024-09-19T07:24:52.407 INFO:tasks.workunit.client.0.smithi098.stdout:2/221: getdents d1/d9/d26/d35/d48 0 2024-09-19T07:24:52.407 INFO:tasks.workunit.client.0.smithi098.stdout:2/222: chown d1/da/c13 389 1 2024-09-19T07:24:52.409 INFO:tasks.workunit.client.0.smithi098.stdout:3/302: symlink de/df/d16/d2e/d3f/l59 0 2024-09-19T07:24:52.409 INFO:tasks.workunit.client.0.smithi098.stdout:3/303: dread - de/d4e/f50 zero size 2024-09-19T07:24:52.409 INFO:tasks.workunit.client.0.smithi098.stdout:3/304: write de/df/d31/f3d [887440,77368] 0 2024-09-19T07:24:52.409 INFO:tasks.workunit.client.0.smithi098.stdout:1/286: creat dc/de/d22/d31/d5d/f60 x:0 0 0 2024-09-19T07:24:52.409 INFO:tasks.workunit.client.0.smithi098.stdout:1/287: truncate dc/d17/d2e/d4d/d53/f55 499992 0 2024-09-19T07:24:52.409 INFO:tasks.workunit.client.0.smithi098.stdout:1/288: write dc/de/d22/f4b [521128,111158] 0 2024-09-19T07:24:52.412 INFO:tasks.workunit.client.0.smithi098.stdout:1/289: rmdir dc/de/d38 39 2024-09-19T07:24:52.414 INFO:tasks.workunit.client.0.smithi098.stdout:1/290: creat dc/de/d50/f61 x:0 0 0 2024-09-19T07:24:52.415 INFO:tasks.workunit.client.0.smithi098.stdout:3/305: truncate de/f25 2273280 0 2024-09-19T07:24:52.415 INFO:tasks.workunit.client.0.smithi098.stdout:3/306: chown de/df/d4f 290934 1 2024-09-19T07:24:52.415 INFO:tasks.workunit.client.0.smithi098.stdout:3/307: fsync de/d4e/f51 0 2024-09-19T07:24:52.415 INFO:tasks.workunit.client.0.smithi098.stdout:3/308: truncate de/df/d1f/d2b/f57 662478 0 2024-09-19T07:24:52.415 INFO:tasks.workunit.client.0.smithi098.stdout:3/309: chown de/df/d1f/d2b/l41 3453274 1 2024-09-19T07:24:52.416 INFO:tasks.workunit.client.0.smithi098.stdout:3/310: link de/df/l40 de/df/d16/d2e/d3f/l5a 0 2024-09-19T07:24:52.417 INFO:tasks.workunit.client.0.smithi098.stdout:3/311: write f9 [1191969,107072] 0 2024-09-19T07:24:52.417 INFO:tasks.workunit.client.0.smithi098.stdout:3/312: dread de/df/d1f/d2b/f57 [0,4194304] 0 2024-09-19T07:24:52.424 INFO:tasks.workunit.client.0.smithi098.stdout:3/313: dread f5 [0,4194304] 0 2024-09-19T07:24:52.424 INFO:tasks.workunit.client.0.smithi098.stdout:3/314: truncate de/df/d31/f3d 1901223 0 2024-09-19T07:24:52.425 INFO:tasks.workunit.client.0.smithi098.stdout:3/315: creat de/df/d31/f5b x:0 0 0 2024-09-19T07:24:52.425 INFO:tasks.workunit.client.0.smithi098.stdout:3/316: chown de/df/f2c 10920096 1 2024-09-19T07:24:52.425 INFO:tasks.workunit.client.0.smithi098.stdout:3/317: stat de/c58 0 2024-09-19T07:24:52.425 INFO:tasks.workunit.client.0.smithi098.stdout:3/318: write f0 [4828670,44639] 0 2024-09-19T07:24:52.427 INFO:tasks.workunit.client.0.smithi098.stdout:5/279: dwrite dc/f17 [0,4194304] 0 2024-09-19T07:24:52.429 INFO:tasks.workunit.client.0.smithi098.stdout:5/280: symlink dc/de/d36/l5b 0 2024-09-19T07:24:52.430 INFO:tasks.workunit.client.0.smithi098.stdout:5/281: mkdir dc/de/d13/d5c 0 2024-09-19T07:24:52.433 INFO:tasks.workunit.client.0.smithi098.stdout:7/367: dwrite d5/d10/d11/f58 [0,4194304] 0 2024-09-19T07:24:52.433 INFO:tasks.workunit.client.0.smithi098.stdout:7/368: truncate d5/d10/d1d/f2a 4421524 0 2024-09-19T07:24:52.433 INFO:tasks.workunit.client.0.smithi098.stdout:9/332: dwrite d3/dc/df/d15/f5b [0,4194304] 0 2024-09-19T07:24:52.435 INFO:tasks.workunit.client.0.smithi098.stdout:2/223: truncate d1/da/f25 2254296 0 2024-09-19T07:24:52.435 INFO:tasks.workunit.client.0.smithi098.stdout:2/224: chown d1/d9/f24 2161 1 2024-09-19T07:24:52.435 INFO:tasks.workunit.client.0.smithi098.stdout:8/302: dwrite d0/d16/f3f [4194304,4194304] 0 2024-09-19T07:24:52.437 INFO:tasks.workunit.client.0.smithi098.stdout:7/369: creat d5/d8/dc/d4b/d59/f83 x:0 0 0 2024-09-19T07:24:52.437 INFO:tasks.workunit.client.0.smithi098.stdout:7/370: chown d5/d3e/d62/f65 4143978 1 2024-09-19T07:24:52.437 INFO:tasks.workunit.client.0.smithi098.stdout:9/333: dread d3/dc/df/d15/d1a/d2d/f3a [0,4194304] 0 2024-09-19T07:24:52.440 INFO:tasks.workunit.client.0.smithi098.stdout:1/291: dread dc/de/d22/f4b [0,4194304] 0 2024-09-19T07:24:52.440 INFO:tasks.workunit.client.0.smithi098.stdout:2/225: rename d1/d5/f38 to d1/f4c 0 2024-09-19T07:24:52.440 INFO:tasks.workunit.client.0.smithi098.stdout:2/226: stat d1/d9/f2d 0 2024-09-19T07:24:52.444 INFO:tasks.workunit.client.0.smithi098.stdout:3/319: dwrite de/df/f53 [0,4194304] 0 2024-09-19T07:24:52.447 INFO:tasks.workunit.client.0.smithi098.stdout:7/371: getdents d5/d8/dc/d16 0 2024-09-19T07:24:52.449 INFO:tasks.workunit.client.0.smithi098.stdout:9/334: mkdir d3/d16/d43/d51/d6e 0 2024-09-19T07:24:52.451 INFO:tasks.workunit.client.0.smithi098.stdout:2/227: write d1/d9/f47 [5343260,105913] 0 2024-09-19T07:24:52.455 INFO:tasks.workunit.client.0.smithi098.stdout:7/372: unlink d5/d3e/d61/c6a 0 2024-09-19T07:24:52.455 INFO:tasks.workunit.client.0.smithi098.stdout:7/373: fsync d5/d8/dc/f42 0 2024-09-19T07:24:52.455 INFO:tasks.workunit.client.0.smithi098.stdout:7/374: fdatasync d5/d8/f24 0 2024-09-19T07:24:52.455 INFO:tasks.workunit.client.0.smithi098.stdout:6/313: sync 2024-09-19T07:24:52.455 INFO:tasks.workunit.client.0.smithi098.stdout:4/243: sync 2024-09-19T07:24:52.455 INFO:tasks.workunit.client.0.smithi098.stdout:0/297: sync 2024-09-19T07:24:52.456 INFO:tasks.workunit.client.0.smithi098.stdout:3/320: rmdir de/df 39 2024-09-19T07:24:52.456 INFO:tasks.workunit.client.0.smithi098.stdout:6/314: symlink d2/d5/d1f/d26/d42/d48/d4a/l74 0 2024-09-19T07:24:52.458 INFO:tasks.workunit.client.0.smithi098.stdout:6/315: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/f75 x:0 0 0 2024-09-19T07:24:52.458 INFO:tasks.workunit.client.0.smithi098.stdout:6/316: truncate d2/d5/d1f/d26/d42/f47 674081 0 2024-09-19T07:24:52.459 INFO:tasks.workunit.client.0.smithi098.stdout:6/317: symlink d2/d5/d1f/d26/l76 0 2024-09-19T07:24:52.461 INFO:tasks.workunit.client.0.smithi098.stdout:5/282: dwrite dc/de/d13/d46/d23/d49/f4e [0,4194304] 0 2024-09-19T07:24:52.461 INFO:tasks.workunit.client.0.smithi098.stdout:5/283: chown cb 6 1 2024-09-19T07:24:52.461 INFO:tasks.workunit.client.0.smithi098.stdout:9/335: creat d3/dc/f6f x:0 0 0 2024-09-19T07:24:52.461 INFO:tasks.workunit.client.0.smithi098.stdout:7/375: rename d5/d8/f21 to d5/d8/dc/d16/f84 0 2024-09-19T07:24:52.462 INFO:tasks.workunit.client.0.smithi098.stdout:7/376: write d5/d8/f34 [1645589,114895] 0 2024-09-19T07:24:52.462 INFO:tasks.workunit.client.0.smithi098.stdout:3/321: creat de/df/d31/f5c x:0 0 0 2024-09-19T07:24:52.463 INFO:tasks.workunit.client.0.smithi098.stdout:0/298: write d5/d20/d14/f32 [422141,83158] 0 2024-09-19T07:24:52.463 INFO:tasks.workunit.client.0.smithi098.stdout:0/299: readlink d5/l11 0 2024-09-19T07:24:52.464 INFO:tasks.workunit.client.0.smithi098.stdout:5/284: creat dc/de/d13/d46/d23/f5d x:0 0 0 2024-09-19T07:24:52.465 INFO:tasks.workunit.client.0.smithi098.stdout:6/318: link d2/d5/d1f/d26/d42/d48/d53/f5f d2/d1b/f77 0 2024-09-19T07:24:52.465 INFO:tasks.workunit.client.0.smithi098.stdout:9/336: symlink d3/d16/d38/l70 0 2024-09-19T07:24:52.466 INFO:tasks.workunit.client.0.smithi098.stdout:4/244: write f9 [2888758,116345] 0 2024-09-19T07:24:52.466 INFO:tasks.workunit.client.0.smithi098.stdout:6/319: symlink d2/d11/l78 0 2024-09-19T07:24:52.466 INFO:tasks.workunit.client.0.smithi098.stdout:8/303: dwrite d0/de/d28/d40/f51 [0,4194304] 0 2024-09-19T07:24:52.467 INFO:tasks.workunit.client.0.smithi098.stdout:9/337: dread d3/d16/d38/f26 [0,4194304] 0 2024-09-19T07:24:52.467 INFO:tasks.workunit.client.0.smithi098.stdout:7/377: creat d5/d8/dc/d4b/d59/f85 x:0 0 0 2024-09-19T07:24:52.467 INFO:tasks.workunit.client.0.smithi098.stdout:7/378: chown d5/d10/d1d/l36 56 1 2024-09-19T07:24:52.467 INFO:tasks.workunit.client.0.smithi098.stdout:4/245: truncate da/d31/f3c 514067 0 2024-09-19T07:24:52.467 INFO:tasks.workunit.client.0.smithi098.stdout:1/292: dwrite dc/de/d22/d31/f5b [0,4194304] 0 2024-09-19T07:24:52.468 INFO:tasks.workunit.client.0.smithi098.stdout:4/246: mknod da/d31/d46/c50 0 2024-09-19T07:24:52.468 INFO:tasks.workunit.client.0.smithi098.stdout:0/300: creat d5/d20/d14/d49/f56 x:0 0 0 2024-09-19T07:24:52.468 INFO:tasks.workunit.client.0.smithi098.stdout:0/301: chown d5/f3e 53509420 1 2024-09-19T07:24:52.469 INFO:tasks.workunit.client.0.smithi098.stdout:5/285: dread f1 [0,4194304] 0 2024-09-19T07:24:52.469 INFO:tasks.workunit.client.0.smithi098.stdout:5/286: chown dc/de/d13/d3b/f45 202 1 2024-09-19T07:24:52.474 INFO:tasks.workunit.client.0.smithi098.stdout:9/338: creat d3/d16/d43/d51/d6e/f71 x:0 0 0 2024-09-19T07:24:52.474 INFO:tasks.workunit.client.0.smithi098.stdout:7/379: truncate d5/d8/f24 710263 0 2024-09-19T07:24:52.474 INFO:tasks.workunit.client.0.smithi098.stdout:7/380: fsync d5/d8/dc/d16/f5a 0 2024-09-19T07:24:52.474 INFO:tasks.workunit.client.0.smithi098.stdout:3/322: rmdir de/df/d16/d2e 39 2024-09-19T07:24:52.475 INFO:tasks.workunit.client.0.smithi098.stdout:9/339: write d3/d16/f3c [771085,53989] 0 2024-09-19T07:24:52.483 INFO:tasks.workunit.client.0.smithi098.stdout:0/302: rename d5/c19 to d5/d20/d14/d49/c57 0 2024-09-19T07:24:52.484 INFO:tasks.workunit.client.0.smithi098.stdout:6/320: dread d2/d5/d1f/d26/f55 [0,4194304] 0 2024-09-19T07:24:52.484 INFO:tasks.workunit.client.0.smithi098.stdout:8/304: dread d0/fc [0,4194304] 0 2024-09-19T07:24:52.485 INFO:tasks.workunit.client.0.smithi098.stdout:9/340: symlink d3/dc/df/d15/d1b/l72 0 2024-09-19T07:24:52.485 INFO:tasks.workunit.client.0.smithi098.stdout:6/321: mkdir d2/d5/d1f/d26/d42/d48/d53/d64/d79 0 2024-09-19T07:24:52.486 INFO:tasks.workunit.client.0.smithi098.stdout:6/322: getdents d2/d5/d1f/d26/d42/d48/d53/d64/d79 0 2024-09-19T07:24:52.486 INFO:tasks.workunit.client.0.smithi098.stdout:9/341: write d3/d16/d38/f26 [1063448,6553] 0 2024-09-19T07:24:52.486 INFO:tasks.workunit.client.0.smithi098.stdout:5/287: dread dc/de/f1d [0,4194304] 0 2024-09-19T07:24:52.487 INFO:tasks.workunit.client.0.smithi098.stdout:6/323: symlink d2/d5/d1f/d26/d42/d48/d53/d64/l7a 0 2024-09-19T07:24:52.487 INFO:tasks.workunit.client.0.smithi098.stdout:6/324: chown d2/d5/c10 1739 1 2024-09-19T07:24:52.488 INFO:tasks.workunit.client.0.smithi098.stdout:0/303: rename l2 to d5/d20/d1f/l58 0 2024-09-19T07:24:52.488 INFO:tasks.workunit.client.0.smithi098.stdout:6/325: mkdir d2/d5/d1f/d26/d7b 0 2024-09-19T07:24:52.489 INFO:tasks.workunit.client.0.smithi098.stdout:8/305: creat d0/de/f5f x:0 0 0 2024-09-19T07:24:52.489 INFO:tasks.workunit.client.0.smithi098.stdout:8/306: rename d0/de to d0/de/d28/d60 22 2024-09-19T07:24:52.490 INFO:tasks.workunit.client.0.smithi098.stdout:8/307: write d0/f53 [557814,58440] 0 2024-09-19T07:24:52.491 INFO:tasks.workunit.client.0.smithi098.stdout:0/304: symlink d5/d20/d14/d49/l59 0 2024-09-19T07:24:52.491 INFO:tasks.workunit.client.0.smithi098.stdout:8/308: mkdir d0/d16/d61 0 2024-09-19T07:24:52.492 INFO:tasks.workunit.client.0.smithi098.stdout:0/305: creat d5/d20/d14/f5a x:0 0 0 2024-09-19T07:24:52.493 INFO:tasks.workunit.client.0.smithi098.stdout:8/309: mknod d0/d1a/c62 0 2024-09-19T07:24:52.496 INFO:tasks.workunit.client.0.smithi098.stdout:4/247: dwrite da/f4b [0,4194304] 0 2024-09-19T07:24:52.496 INFO:tasks.workunit.client.0.smithi098.stdout:4/248: stat da/f4b 0 2024-09-19T07:24:52.496 INFO:tasks.workunit.client.0.smithi098.stdout:1/293: dwrite dc/d17/d2e/f2f [0,4194304] 0 2024-09-19T07:24:52.498 INFO:tasks.workunit.client.0.smithi098.stdout:4/249: creat da/d31/d46/f51 x:0 0 0 2024-09-19T07:24:52.499 INFO:tasks.workunit.client.0.smithi098.stdout:1/294: mknod dc/de/d50/c62 0 2024-09-19T07:24:52.499 INFO:tasks.workunit.client.0.smithi098.stdout:0/306: rename d5/d20/d14/l50 to d5/d20/d14/l5b 0 2024-09-19T07:24:52.500 INFO:tasks.workunit.client.0.smithi098.stdout:3/323: write de/df/d1f/d2b/f3a [2243700,61416] 0 2024-09-19T07:24:52.500 INFO:tasks.workunit.client.0.smithi098.stdout:3/324: readlink de/df/d1f/d2b/l36 0 2024-09-19T07:24:52.505 INFO:tasks.workunit.client.0.smithi098.stdout:7/381: dwrite d5/f53 [0,4194304] 0 2024-09-19T07:24:52.505 INFO:tasks.workunit.client.0.smithi098.stdout:7/382: readlink d5/d3e/d62/l77 0 2024-09-19T07:24:52.506 INFO:tasks.workunit.client.0.smithi098.stdout:4/250: dread da/f1d [4194304,4194304] 0 2024-09-19T07:24:52.507 INFO:tasks.workunit.client.0.smithi098.stdout:7/383: getdents d5/d8 0 2024-09-19T07:24:52.508 INFO:tasks.workunit.client.0.smithi098.stdout:7/384: write d5/d8/dc/d16/f31 [2554117,37034] 0 2024-09-19T07:24:52.509 INFO:tasks.workunit.client.0.smithi098.stdout:9/342: dwrite d3/d16/d43/d51/f5a [0,4194304] 0 2024-09-19T07:24:52.510 INFO:tasks.workunit.client.0.smithi098.stdout:7/385: truncate d5/d10/d1d/f39 3986467 0 2024-09-19T07:24:52.510 INFO:tasks.workunit.client.0.smithi098.stdout:7/386: dread - d5/d10/d50/f6c zero size 2024-09-19T07:24:52.510 INFO:tasks.workunit.client.0.smithi098.stdout:7/387: chown d5/d8/dc/d16/f84 12477091 1 2024-09-19T07:24:52.512 INFO:tasks.workunit.client.0.smithi098.stdout:4/251: symlink da/l52 0 2024-09-19T07:24:52.512 INFO:tasks.workunit.client.0.smithi098.stdout:4/252: stat da/d31/c36 0 2024-09-19T07:24:52.512 INFO:tasks.workunit.client.0.smithi098.stdout:4/253: read da/f11 [1143744,8518] 0 2024-09-19T07:24:52.514 INFO:tasks.workunit.client.0.smithi098.stdout:9/343: mkdir d3/d30/d73 0 2024-09-19T07:24:52.518 INFO:tasks.workunit.client.0.smithi098.stdout:1/295: dread f1 [0,4194304] 0 2024-09-19T07:24:52.520 INFO:tasks.workunit.client.0.smithi098.stdout:4/254: unlink da/c3b 0 2024-09-19T07:24:52.522 INFO:tasks.workunit.client.0.smithi098.stdout:4/255: creat da/d31/d46/f53 x:0 0 0 2024-09-19T07:24:52.523 INFO:tasks.workunit.client.0.smithi098.stdout:4/256: chown da/c2f 4801 1 2024-09-19T07:24:52.526 INFO:tasks.workunit.client.0.smithi098.stdout:9/344: write d3/dc/df/d15/d1a/d2d/f42 [1646391,120013] 0 2024-09-19T07:24:52.526 INFO:tasks.workunit.client.0.smithi098.stdout:9/345: stat d3/d16/d38/f4f 0 2024-09-19T07:24:52.527 INFO:tasks.workunit.client.0.smithi098.stdout:3/325: dwrite de/df/d1f/d2b/f57 [0,4194304] 0 2024-09-19T07:24:52.527 INFO:tasks.workunit.client.0.smithi098.stdout:3/326: read de/df/d16/f4a [259488,64401] 0 2024-09-19T07:24:52.528 INFO:tasks.workunit.client.0.smithi098.stdout:9/346: mkdir d3/dc/df/d15/d1a/d2b/d49/d74 0 2024-09-19T07:24:52.528 INFO:tasks.workunit.client.0.smithi098.stdout:9/347: write d3/d16/d38/f4f [237310,94561] 0 2024-09-19T07:24:52.528 INFO:tasks.workunit.client.0.smithi098.stdout:9/348: write d3/dc/df/d15/f28 [49800,23481] 0 2024-09-19T07:24:52.529 INFO:tasks.workunit.client.0.smithi098.stdout:9/349: fsync d3/d16/d38/f26 0 2024-09-19T07:24:52.529 INFO:tasks.workunit.client.0.smithi098.stdout:3/327: rmdir de/df 39 2024-09-19T07:24:52.529 INFO:tasks.workunit.client.0.smithi098.stdout:3/328: chown de/df/c44 65 1 2024-09-19T07:24:52.530 INFO:tasks.workunit.client.0.smithi098.stdout:9/350: symlink d3/dc/df/d15/d1a/d2b/d49/d50/l75 0 2024-09-19T07:24:52.531 INFO:tasks.workunit.client.0.smithi098.stdout:3/329: creat de/df/d16/d2e/d3f/f5d x:0 0 0 2024-09-19T07:24:52.531 INFO:tasks.workunit.client.0.smithi098.stdout:3/330: dread - de/df/d31/f5c zero size 2024-09-19T07:24:52.532 INFO:tasks.workunit.client.0.smithi098.stdout:3/331: chown f0 20 1 2024-09-19T07:24:52.532 INFO:tasks.workunit.client.0.smithi098.stdout:3/332: chown de/df/d16/f4a 819 1 2024-09-19T07:24:52.532 INFO:tasks.workunit.client.0.smithi098.stdout:9/351: creat d3/dc/df/d15/d1a/d2b/d49/f76 x:0 0 0 2024-09-19T07:24:52.532 INFO:tasks.workunit.client.0.smithi098.stdout:9/352: chown d3/d16/d43/c64 29713 1 2024-09-19T07:24:52.532 INFO:tasks.workunit.client.0.smithi098.stdout:9/353: fdatasync d3/dc/df/d15/d1a/d2b/f33 0 2024-09-19T07:24:52.533 INFO:tasks.workunit.client.0.smithi098.stdout:8/310: dwrite d0/d16/f23 [0,4194304] 0 2024-09-19T07:24:52.533 INFO:tasks.workunit.client.0.smithi098.stdout:3/333: getdents de 0 2024-09-19T07:24:52.540 INFO:tasks.workunit.client.0.smithi098.stdout:8/311: unlink d0/de/d28/c39 0 2024-09-19T07:24:52.540 INFO:tasks.workunit.client.0.smithi098.stdout:0/307: dwrite d5/d20/d1f/f4c [0,4194304] 0 2024-09-19T07:24:52.540 INFO:tasks.workunit.client.0.smithi098.stdout:0/308: chown d5/d20/d14/c1c 743 1 2024-09-19T07:24:52.540 INFO:tasks.workunit.client.0.smithi098.stdout:0/309: truncate d5/d20/f42 972212 0 2024-09-19T07:24:52.544 INFO:tasks.workunit.client.0.smithi098.stdout:9/354: dread d3/dc/df/d15/d1b/f37 [0,4194304] 0 2024-09-19T07:24:52.544 INFO:tasks.workunit.client.0.smithi098.stdout:7/388: dwrite d5/d8/dc/d4b/d59/f83 [0,4194304] 0 2024-09-19T07:24:52.546 INFO:tasks.workunit.client.0.smithi098.stdout:9/355: rename d3/d16/d43/d51/d6e/f71 to d3/d6/d8/f77 0 2024-09-19T07:24:52.548 INFO:tasks.workunit.client.0.smithi098.stdout:7/389: unlink d5/d3e/l69 0 2024-09-19T07:24:52.548 INFO:tasks.workunit.client.0.smithi098.stdout:7/390: fsync d5/d3e/d62/f70 0 2024-09-19T07:24:52.549 INFO:tasks.workunit.client.0.smithi098.stdout:9/356: read d3/d16/d38/f26 [11085,73988] 0 2024-09-19T07:24:52.549 INFO:tasks.workunit.client.0.smithi098.stdout:1/296: dwrite dc/d17/d2e/d4d/f54 [4194304,4194304] 0 2024-09-19T07:24:52.549 INFO:tasks.workunit.client.0.smithi098.stdout:4/257: dwrite da/d31/f35 [4194304,4194304] 0 2024-09-19T07:24:52.549 INFO:tasks.workunit.client.0.smithi098.stdout:9/357: symlink d3/d16/d43/l78 0 2024-09-19T07:24:52.554 INFO:tasks.workunit.client.0.smithi098.stdout:4/258: dread da/f11 [0,4194304] 0 2024-09-19T07:24:52.555 INFO:tasks.workunit.client.0.smithi098.stdout:7/391: write d5/d10/f32 [3436708,762] 0 2024-09-19T07:24:52.555 INFO:tasks.workunit.client.0.smithi098.stdout:7/392: write d5/d8/dc/d16/f7e [600478,42707] 0 2024-09-19T07:24:52.556 INFO:tasks.workunit.client.0.smithi098.stdout:4/259: truncate da/fd 614265 0 2024-09-19T07:24:52.557 INFO:tasks.workunit.client.0.smithi098.stdout:9/358: rmdir d3/d30/d5c 0 2024-09-19T07:24:52.557 INFO:tasks.workunit.client.0.smithi098.stdout:9/359: dread - d3/d16/f57 zero size 2024-09-19T07:24:52.558 INFO:tasks.workunit.client.0.smithi098.stdout:3/334: dwrite de/df/f29 [0,4194304] 0 2024-09-19T07:24:52.559 INFO:tasks.workunit.client.0.smithi098.stdout:9/360: dread d3/d16/d38/f36 [0,4194304] 0 2024-09-19T07:24:52.559 INFO:tasks.workunit.client.0.smithi098.stdout:9/361: write d3/d16/d38/f26 [139980,10777] 0 2024-09-19T07:24:52.560 INFO:tasks.workunit.client.0.smithi098.stdout:0/310: truncate d5/d20/d1f/f4c 1190329 0 2024-09-19T07:24:52.562 INFO:tasks.workunit.client.0.smithi098.stdout:7/393: write d5/d8/dc/f42 [508386,120200] 0 2024-09-19T07:24:52.563 INFO:tasks.workunit.client.0.smithi098.stdout:0/311: mknod d5/d20/c5c 0 2024-09-19T07:24:52.565 INFO:tasks.workunit.client.0.smithi098.stdout:9/362: symlink d3/dc/df/d15/d1a/d2b/l79 0 2024-09-19T07:24:52.567 INFO:tasks.workunit.client.0.smithi098.stdout:4/260: dread da/fd [0,4194304] 0 2024-09-19T07:24:52.568 INFO:tasks.workunit.client.0.smithi098.stdout:0/312: mkdir d5/d20/d14/d5d 0 2024-09-19T07:24:52.571 INFO:tasks.workunit.client.0.smithi098.stdout:7/394: dread d5/d8/d52/f60 [0,4194304] 0 2024-09-19T07:24:52.575 INFO:tasks.workunit.client.0.smithi098.stdout:7/395: mknod d5/c86 0 2024-09-19T07:24:52.575 INFO:tasks.workunit.client.0.smithi098.stdout:7/396: write d5/d10/d50/f6c [356810,64663] 0 2024-09-19T07:24:52.575 INFO:tasks.workunit.client.0.smithi098.stdout:7/397: readlink d5/d10/d1d/l74 0 2024-09-19T07:24:52.576 INFO:tasks.workunit.client.0.smithi098.stdout:7/398: creat d5/d8/dc/d16/d4f/d66/f87 x:0 0 0 2024-09-19T07:24:52.584 INFO:tasks.workunit.client.0.smithi098.stdout:9/363: dwrite d3/dc/df/d15/f5b [0,4194304] 0 2024-09-19T07:24:52.585 INFO:tasks.workunit.client.0.smithi098.stdout:9/364: mkdir d3/d6/d46/d7a 0 2024-09-19T07:24:52.587 INFO:tasks.workunit.client.0.smithi098.stdout:9/365: mkdir d3/d16/d7b 0 2024-09-19T07:24:52.588 INFO:tasks.workunit.client.0.smithi098.stdout:9/366: link d3/d16/d43/d51/f6d d3/dc/df/d15/d1a/d2b/d49/d65/f7c 0 2024-09-19T07:24:52.590 INFO:tasks.workunit.client.0.smithi098.stdout:9/367: getdents d3/dc/df/d15/d1a/d2b/d49 0 2024-09-19T07:24:52.591 INFO:tasks.workunit.client.0.smithi098.stdout:4/261: rmdir da 39 2024-09-19T07:24:52.595 INFO:tasks.workunit.client.0.smithi098.stdout:7/399: dwrite d5/d8/dc/f3a [0,4194304] 0 2024-09-19T07:24:52.596 INFO:tasks.workunit.client.0.smithi098.stdout:1/297: rename dc/d17/d1b/d1d/f41 to dc/de/d22/d31/d35/d58/f63 0 2024-09-19T07:24:52.596 INFO:tasks.workunit.client.0.smithi098.stdout:1/298: write dc/f49 [75482,86079] 0 2024-09-19T07:24:52.596 INFO:tasks.workunit.client.0.smithi098.stdout:7/400: creat d5/d8/dc/d16/d4f/d66/f88 x:0 0 0 2024-09-19T07:24:52.597 INFO:tasks.workunit.client.0.smithi098.stdout:7/401: truncate d5/d3e/d62/f70 590085 0 2024-09-19T07:24:52.598 INFO:tasks.workunit.client.0.smithi098.stdout:0/313: rename d5/d20/d14/f2c to d5/d20/d14/d49/f5e 0 2024-09-19T07:24:52.598 INFO:tasks.workunit.client.0.smithi098.stdout:0/314: write d5/d20/f39 [4854906,91624] 0 2024-09-19T07:24:52.599 INFO:tasks.workunit.client.0.smithi098.stdout:7/402: unlink d5/d8/dc/f3a 0 2024-09-19T07:24:52.601 INFO:tasks.workunit.client.0.smithi098.stdout:0/315: symlink d5/d20/d1f/l5f 0 2024-09-19T07:24:52.603 INFO:tasks.workunit.client.0.smithi098.stdout:7/403: creat d5/d8/dc/f89 x:0 0 0 2024-09-19T07:24:52.604 INFO:tasks.workunit.client.0.smithi098.stdout:0/316: symlink d5/d20/d14/d49/l60 0 2024-09-19T07:24:52.604 INFO:tasks.workunit.client.0.smithi098.stdout:0/317: fsync d5/d20/d14/f40 0 2024-09-19T07:24:52.604 INFO:tasks.workunit.client.0.smithi098.stdout:0/318: dread - d5/f31 zero size 2024-09-19T07:24:52.604 INFO:tasks.workunit.client.0.smithi098.stdout:7/404: symlink d5/d8/l8a 0 2024-09-19T07:24:52.606 INFO:tasks.workunit.client.0.smithi098.stdout:7/405: symlink d5/d8/dc/l8b 0 2024-09-19T07:24:52.606 INFO:tasks.workunit.client.0.smithi098.stdout:7/406: chown d5/l75 2389250 1 2024-09-19T07:24:52.607 INFO:tasks.workunit.client.0.smithi098.stdout:7/407: creat d5/d8/dc/d16/d4f/d66/f8c x:0 0 0 2024-09-19T07:24:52.608 INFO:tasks.workunit.client.0.smithi098.stdout:1/299: unlink dc/de/d22/d31/d35/d58/f63 0 2024-09-19T07:24:52.612 INFO:tasks.workunit.client.0.smithi098.stdout:1/300: dread dc/de/f21 [0,4194304] 0 2024-09-19T07:24:52.614 INFO:tasks.workunit.client.0.smithi098.stdout:4/262: dwrite da/d31/d46/f51 [0,4194304] 0 2024-09-19T07:24:52.614 INFO:tasks.workunit.client.0.smithi098.stdout:4/263: fsync da/d31/f45 0 2024-09-19T07:24:52.614 INFO:tasks.workunit.client.0.smithi098.stdout:4/264: write da/d31/f39 [999574,108812] 0 2024-09-19T07:24:52.615 INFO:tasks.workunit.client.0.smithi098.stdout:1/301: mknod dc/d17/d1b/d1d/d3d/c64 0 2024-09-19T07:24:52.615 INFO:tasks.workunit.client.0.smithi098.stdout:1/302: write dc/d2a/f51 [503348,65974] 0 2024-09-19T07:24:52.620 INFO:tasks.workunit.client.0.smithi098.stdout:0/319: write d5/f30 [4137015,124350] 0 2024-09-19T07:24:52.635 INFO:tasks.workunit.client.0.smithi098.stdout:7/408: dwrite d5/d10/f32 [0,4194304] 0 2024-09-19T07:24:52.635 INFO:tasks.workunit.client.0.smithi098.stdout:4/265: dwrite da/f3f [4194304,4194304] 0 2024-09-19T07:24:52.635 INFO:tasks.workunit.client.0.smithi098.stdout:4/266: fdatasync da/fb 0 2024-09-19T07:24:52.636 INFO:tasks.workunit.client.0.smithi098.stdout:7/409: mknod d5/d8/d52/c8d 0 2024-09-19T07:24:52.636 INFO:tasks.workunit.client.0.smithi098.stdout:4/267: write f8 [2006114,86152] 0 2024-09-19T07:24:52.648 INFO:tasks.workunit.client.0.smithi098.stdout:7/410: dread d5/d10/f4a [4194304,4194304] 0 2024-09-19T07:24:52.648 INFO:tasks.workunit.client.0.smithi098.stdout:7/411: read - d5/d8/dc/d16/d4f/f79 zero size 2024-09-19T07:24:52.648 INFO:tasks.workunit.client.0.smithi098.stdout:7/412: write d5/d8/dc/d4b/d59/f85 [867824,7394] 0 2024-09-19T07:24:52.649 INFO:tasks.workunit.client.0.smithi098.stdout:7/413: rename d5/d8/dc/d4b to d5/d8/d8e 0 2024-09-19T07:24:52.650 INFO:tasks.workunit.client.0.smithi098.stdout:7/414: creat d5/d8/dc/d16/d4f/d66/f8f x:0 0 0 2024-09-19T07:24:52.651 INFO:tasks.workunit.client.0.smithi098.stdout:1/303: dwrite dc/d17/d2e/f39 [0,4194304] 0 2024-09-19T07:24:52.651 INFO:tasks.workunit.client.0.smithi098.stdout:1/304: write dc/f2c [742258,963] 0 2024-09-19T07:24:52.652 INFO:tasks.workunit.client.0.smithi098.stdout:7/415: link d5/d8/d8e/d59/l6d d5/d10/d11/l90 0 2024-09-19T07:24:52.653 INFO:tasks.workunit.client.0.smithi098.stdout:1/305: stat l2 0 2024-09-19T07:24:52.654 INFO:tasks.workunit.client.0.smithi098.stdout:7/416: creat d5/d3e/d61/f91 x:0 0 0 2024-09-19T07:24:52.654 INFO:tasks.workunit.client.0.smithi098.stdout:7/417: write d5/d8/dc/d16/d4f/d66/f87 [336052,56237] 0 2024-09-19T07:24:52.658 INFO:tasks.workunit.client.0.smithi098.stdout:4/268: dwrite da/f1f [0,4194304] 0 2024-09-19T07:24:52.658 INFO:tasks.workunit.client.0.smithi098.stdout:0/320: dwrite d5/d20/f41 [0,4194304] 0 2024-09-19T07:24:52.658 INFO:tasks.workunit.client.0.smithi098.stdout:0/321: write d5/d20/d1f/f4c [1290807,20400] 0 2024-09-19T07:24:52.666 INFO:tasks.workunit.client.0.smithi098.stdout:0/322: truncate d5/f1e 3046648 0 2024-09-19T07:24:52.667 INFO:tasks.workunit.client.0.smithi098.stdout:7/418: truncate d5/d8/dc/d16/f5a 1176140 0 2024-09-19T07:24:52.667 INFO:tasks.workunit.client.0.smithi098.stdout:7/419: stat d5/d8/f24 0 2024-09-19T07:24:52.669 INFO:tasks.workunit.client.0.smithi098.stdout:0/323: creat d5/d20/d14/f61 x:0 0 0 2024-09-19T07:24:52.669 INFO:tasks.workunit.client.0.smithi098.stdout:0/324: truncate d5/d20/d14/d49/f56 203170 0 2024-09-19T07:24:52.670 INFO:tasks.workunit.client.0.smithi098.stdout:7/420: getdents d5/d8/d8e/d59 0 2024-09-19T07:24:52.672 INFO:tasks.workunit.client.0.smithi098.stdout:0/325: mkdir d5/d20/d14/d49/d62 0 2024-09-19T07:24:52.672 INFO:tasks.workunit.client.0.smithi098.stdout:0/326: chown d5/f30 31 1 2024-09-19T07:24:52.673 INFO:tasks.workunit.client.0.smithi098.stdout:7/421: mknod d5/d8/d5d/c92 0 2024-09-19T07:24:52.677 INFO:tasks.workunit.client.0.smithi098.stdout:1/306: dwrite dc/de/d22/d31/f5b [0,4194304] 0 2024-09-19T07:24:52.683 INFO:tasks.workunit.client.0.smithi098.stdout:4/269: dwrite da/f1e [0,4194304] 0 2024-09-19T07:24:52.683 INFO:tasks.workunit.client.0.smithi098.stdout:4/270: fdatasync da/d31/f49 0 2024-09-19T07:24:52.683 INFO:tasks.workunit.client.0.smithi098.stdout:4/271: chown da/f1f 1540 1 2024-09-19T07:24:52.691 INFO:tasks.workunit.client.0.smithi098.stdout:4/272: write da/f3f [6591184,34208] 0 2024-09-19T07:24:52.693 INFO:tasks.workunit.client.0.smithi098.stdout:4/273: rmdir da/d31 39 2024-09-19T07:24:52.697 INFO:tasks.workunit.client.0.smithi098.stdout:0/327: dwrite d5/d20/f4e [0,4194304] 0 2024-09-19T07:24:52.698 INFO:tasks.workunit.client.0.smithi098.stdout:7/422: dwrite d5/d8/dc/d16/d4f/d66/f88 [0,4194304] 0 2024-09-19T07:24:52.701 INFO:tasks.workunit.client.0.smithi098.stdout:0/328: unlink d5/d20/d14/f40 0 2024-09-19T07:24:52.701 INFO:tasks.workunit.client.0.smithi098.stdout:0/329: chown d5/f23 1854 1 2024-09-19T07:24:52.702 INFO:tasks.workunit.client.0.smithi098.stdout:0/330: fsync d5/d20/d14/f5a 0 2024-09-19T07:24:52.706 INFO:tasks.workunit.client.0.smithi098.stdout:1/307: rename dc/de/d22/c24 to dc/d2a/c65 0 2024-09-19T07:24:52.706 INFO:tasks.workunit.client.0.smithi098.stdout:1/308: readlink dc/l14 0 2024-09-19T07:24:52.708 INFO:tasks.workunit.client.0.smithi098.stdout:1/309: creat dc/de/d50/f66 x:0 0 0 2024-09-19T07:24:52.708 INFO:tasks.workunit.client.0.smithi098.stdout:1/310: fsync dc/de/d50/f61 0 2024-09-19T07:24:52.708 INFO:tasks.workunit.client.0.smithi098.stdout:1/311: dread - dc/d2a/f42 zero size 2024-09-19T07:24:52.708 INFO:tasks.workunit.client.0.smithi098.stdout:1/312: write dc/de/d22/d31/d5d/f60 [31063,8469] 0 2024-09-19T07:24:52.709 INFO:tasks.workunit.client.0.smithi098.stdout:0/331: getdents d5/d20/d14 0 2024-09-19T07:24:52.711 INFO:tasks.workunit.client.0.smithi098.stdout:1/313: creat dc/d2a/f67 x:0 0 0 2024-09-19T07:24:52.713 INFO:tasks.workunit.client.0.smithi098.stdout:7/423: rename d5/d8/d8e/d59/l6d to d5/d10/d1d/l93 0 2024-09-19T07:24:52.714 INFO:tasks.workunit.client.0.smithi098.stdout:0/332: dread d5/d20/d14/f35 [0,4194304] 0 2024-09-19T07:24:52.714 INFO:tasks.workunit.client.0.smithi098.stdout:1/314: unlink dc/d17/d2e/f2f 0 2024-09-19T07:24:52.715 INFO:tasks.workunit.client.0.smithi098.stdout:7/424: creat d5/d3e/d61/f94 x:0 0 0 2024-09-19T07:24:52.716 INFO:tasks.workunit.client.0.smithi098.stdout:0/333: symlink d5/d20/d1f/l63 0 2024-09-19T07:24:52.716 INFO:tasks.workunit.client.0.smithi098.stdout:0/334: dread - d5/f46 zero size 2024-09-19T07:24:52.716 INFO:tasks.workunit.client.0.smithi098.stdout:0/335: write d5/d20/f41 [4715213,96781] 0 2024-09-19T07:24:52.716 INFO:tasks.workunit.client.0.smithi098.stdout:4/274: dwrite da/f3f [0,4194304] 0 2024-09-19T07:24:52.717 INFO:tasks.workunit.client.0.smithi098.stdout:1/315: creat dc/d17/d2e/d4d/d53/f68 x:0 0 0 2024-09-19T07:24:52.717 INFO:tasks.workunit.client.0.smithi098.stdout:7/425: truncate d5/d8/dc/d16/f5a 411234 0 2024-09-19T07:24:52.718 INFO:tasks.workunit.client.0.smithi098.stdout:7/426: rename d5/d8/dc/f89 to d5/d3e/f95 0 2024-09-19T07:24:52.719 INFO:tasks.workunit.client.0.smithi098.stdout:7/427: creat d5/d8/dc/d16/d4f/f96 x:0 0 0 2024-09-19T07:24:52.719 INFO:tasks.workunit.client.0.smithi098.stdout:7/428: write d5/d10/d50/f6c [1392663,39413] 0 2024-09-19T07:24:52.720 INFO:tasks.workunit.client.0.smithi098.stdout:4/275: mknod da/d31/c54 0 2024-09-19T07:24:52.722 INFO:tasks.workunit.client.0.smithi098.stdout:4/276: mknod da/d31/c55 0 2024-09-19T07:24:52.724 INFO:tasks.workunit.client.0.smithi098.stdout:4/277: mkdir da/d31/d46/d56 0 2024-09-19T07:24:52.724 INFO:tasks.workunit.client.0.smithi098.stdout:4/278: chown da/d31/d46/d56 293517 1 2024-09-19T07:24:52.727 INFO:tasks.workunit.client.0.smithi098.stdout:4/279: rename da/d31/d46/f53 to da/d31/f57 0 2024-09-19T07:24:52.728 INFO:tasks.workunit.client.0.smithi098.stdout:4/280: symlink da/d31/d46/d56/l58 0 2024-09-19T07:24:52.731 INFO:tasks.workunit.client.0.smithi098.stdout:4/281: mkdir da/d59 0 2024-09-19T07:24:52.731 INFO:tasks.workunit.client.0.smithi098.stdout:4/282: read - da/d31/f45 zero size 2024-09-19T07:24:52.735 INFO:tasks.workunit.client.0.smithi098.stdout:4/283: rename da/l26 to da/d31/d46/l5a 0 2024-09-19T07:24:52.736 INFO:tasks.workunit.client.0.smithi098.stdout:4/284: mkdir da/d31/d46/d56/d5b 0 2024-09-19T07:24:52.737 INFO:tasks.workunit.client.0.smithi098.stdout:4/285: creat da/d31/d46/d56/f5c x:0 0 0 2024-09-19T07:24:52.738 INFO:tasks.workunit.client.0.smithi098.stdout:1/316: link l6 dc/de/d22/d31/d35/l69 0 2024-09-19T07:24:52.738 INFO:tasks.workunit.client.0.smithi098.stdout:1/317: fdatasync dc/d2a/f67 0 2024-09-19T07:24:52.741 INFO:tasks.workunit.client.0.smithi098.stdout:0/336: dwrite d5/fe [0,4194304] 0 2024-09-19T07:24:52.742 INFO:tasks.workunit.client.0.smithi098.stdout:1/318: write dc/f2c [127024,108130] 0 2024-09-19T07:24:52.742 INFO:tasks.workunit.client.0.smithi098.stdout:0/337: mkdir d5/d20/d1f/d52/d64 0 2024-09-19T07:24:52.744 INFO:tasks.workunit.client.0.smithi098.stdout:0/338: truncate d5/f30 88207 0 2024-09-19T07:24:52.744 INFO:tasks.workunit.client.0.smithi098.stdout:0/339: chown d5/d20/c5c 2 1 2024-09-19T07:24:52.744 INFO:tasks.workunit.client.0.smithi098.stdout:0/340: getdents d5/d20/d14/d49/d62 0 2024-09-19T07:24:52.744 INFO:tasks.workunit.client.0.smithi098.stdout:0/341: stat d5/l11 0 2024-09-19T07:24:52.750 INFO:tasks.workunit.client.0.smithi098.stdout:1/319: dread dc/d17/d2e/d4d/f54 [0,4194304] 0 2024-09-19T07:24:52.751 INFO:tasks.workunit.client.0.smithi098.stdout:1/320: mkdir dc/de/d22/d31/d5d/d6a 0 2024-09-19T07:24:52.752 INFO:tasks.workunit.client.0.smithi098.stdout:1/321: creat dc/de/d38/f6b x:0 0 0 2024-09-19T07:24:52.753 INFO:tasks.workunit.client.0.smithi098.stdout:1/322: mkdir dc/de/d50/d6c 0 2024-09-19T07:24:52.754 INFO:tasks.workunit.client.0.smithi098.stdout:4/286: dwrite da/d31/f35 [4194304,4194304] 0 2024-09-19T07:24:52.759 INFO:tasks.workunit.client.0.smithi098.stdout:0/342: write f4 [1821889,83913] 0 2024-09-19T07:24:52.760 INFO:tasks.workunit.client.0.smithi098.stdout:0/343: unlink d5/f22 0 2024-09-19T07:24:52.762 INFO:tasks.workunit.client.0.smithi098.stdout:1/323: link cb dc/de/d22/d31/d5d/c6d 0 2024-09-19T07:24:52.764 INFO:tasks.workunit.client.0.smithi098.stdout:1/324: creat dc/de/d22/d31/d5d/f6e x:0 0 0 2024-09-19T07:24:52.764 INFO:tasks.workunit.client.0.smithi098.stdout:1/325: truncate dc/de/d38/f6b 512129 0 2024-09-19T07:24:52.764 INFO:tasks.workunit.client.0.smithi098.stdout:1/326: read dc/f2c [197097,117967] 0 2024-09-19T07:24:52.765 INFO:tasks.workunit.client.0.smithi098.stdout:1/327: fsync dc/de/d50/f66 0 2024-09-19T07:24:52.767 INFO:tasks.workunit.client.0.smithi098.stdout:0/344: read d5/f25 [2164165,49049] 0 2024-09-19T07:24:52.770 INFO:tasks.workunit.client.0.smithi098.stdout:0/345: creat d5/d20/d14/d49/f65 x:0 0 0 2024-09-19T07:24:52.772 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:52 smithi098 ceph-mon[30950]: pgmap v87: 97 pgs: 97 active+clean; 212 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 24 MiB/s wr, 2.35k op/s 2024-09-19T07:24:52.775 INFO:tasks.workunit.client.0.smithi098.stdout:4/287: dwrite da/f4b [0,4194304] 0 2024-09-19T07:24:52.779 INFO:tasks.workunit.client.0.smithi098.stdout:4/288: dread da/d31/f3c [0,4194304] 0 2024-09-19T07:24:52.782 INFO:tasks.workunit.client.0.smithi098.stdout:1/328: rename dc/d17/d2e to dc/de/d22/d31/d5d/d6a/d6f 0 2024-09-19T07:24:52.783 INFO:tasks.workunit.client.0.smithi098.stdout:1/329: dread dc/de/d38/f6b [0,4194304] 0 2024-09-19T07:24:52.784 INFO:tasks.workunit.client.0.smithi098.stdout:1/330: creat dc/d17/d1b/d1d/d30/f70 x:0 0 0 2024-09-19T07:24:52.805 INFO:tasks.workunit.client.0.smithi098.stdout:4/289: dwrite da/f3d [0,4194304] 0 2024-09-19T07:24:52.806 INFO:tasks.workunit.client.0.smithi098.stdout:0/346: dwrite d5/f25 [0,4194304] 0 2024-09-19T07:24:52.806 INFO:tasks.workunit.client.0.smithi098.stdout:1/331: dwrite dc/de/d22/f4b [0,4194304] 0 2024-09-19T07:24:52.807 INFO:tasks.workunit.client.0.smithi098.stdout:1/332: write dc/de/d22/d31/d5d/f6e [836441,6478] 0 2024-09-19T07:24:52.807 INFO:tasks.workunit.client.0.smithi098.stdout:4/290: mkdir da/d59/d5d 0 2024-09-19T07:24:52.807 INFO:tasks.workunit.client.0.smithi098.stdout:4/291: readlink da/l52 0 2024-09-19T07:24:52.810 INFO:tasks.workunit.client.0.smithi098.stdout:4/292: mknod da/d31/d46/c5e 0 2024-09-19T07:24:52.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:52 smithi139 ceph-mon[35039]: pgmap v87: 97 pgs: 97 active+clean; 212 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 24 MiB/s wr, 2.35k op/s 2024-09-19T07:24:52.826 INFO:tasks.workunit.client.0.smithi098.stdout:4/293: dread da/f3a [0,4194304] 0 2024-09-19T07:24:52.826 INFO:tasks.workunit.client.0.smithi098.stdout:1/333: dwrite dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/f68 [0,4194304] 0 2024-09-19T07:24:52.827 INFO:tasks.workunit.client.0.smithi098.stdout:4/294: write da/f1c [2263469,47696] 0 2024-09-19T07:24:52.828 INFO:tasks.workunit.client.0.smithi098.stdout:1/334: getdents dc/d2a 0 2024-09-19T07:24:52.828 INFO:tasks.workunit.client.0.smithi098.stdout:1/335: write dc/de/d37/f48 [181252,111217] 0 2024-09-19T07:24:52.829 INFO:tasks.workunit.client.0.smithi098.stdout:1/336: mkdir dc/d17/d1b/d71 0 2024-09-19T07:24:52.829 INFO:tasks.workunit.client.0.smithi098.stdout:1/337: dread - dc/de/d50/f66 zero size 2024-09-19T07:24:52.829 INFO:tasks.workunit.client.0.smithi098.stdout:1/338: stat dc/de/d22/d31 0 2024-09-19T07:24:52.830 INFO:tasks.workunit.client.0.smithi098.stdout:1/339: symlink dc/de/d50/d6c/l72 0 2024-09-19T07:24:52.831 INFO:tasks.workunit.client.0.smithi098.stdout:1/340: creat dc/de/d22/d31/d5d/d6a/d6f/d4d/f73 x:0 0 0 2024-09-19T07:24:52.834 INFO:tasks.workunit.client.0.smithi098.stdout:1/341: truncate dc/de/d37/f48 136957 0 2024-09-19T07:24:52.836 INFO:tasks.workunit.client.0.smithi098.stdout:0/347: dwrite d5/fe [0,4194304] 0 2024-09-19T07:24:52.836 INFO:tasks.workunit.client.0.smithi098.stdout:4/295: dread da/f1f [0,4194304] 0 2024-09-19T07:24:52.836 INFO:tasks.workunit.client.0.smithi098.stdout:4/296: dread - da/d31/f45 zero size 2024-09-19T07:24:52.836 INFO:tasks.workunit.client.0.smithi098.stdout:4/297: dread - da/f30 zero size 2024-09-19T07:24:52.838 INFO:tasks.workunit.client.0.smithi098.stdout:0/348: symlink d5/d20/d14/l66 0 2024-09-19T07:24:52.838 INFO:tasks.workunit.client.0.smithi098.stdout:0/349: dread - d5/d20/d14/f4a zero size 2024-09-19T07:24:52.852 INFO:tasks.workunit.client.0.smithi098.stdout:0/350: dread d5/d20/f4e [0,4194304] 0 2024-09-19T07:24:52.856 INFO:tasks.workunit.client.0.smithi098.stdout:1/342: dwrite dc/de/d50/f61 [0,4194304] 0 2024-09-19T07:24:52.862 INFO:tasks.workunit.client.0.smithi098.stdout:4/298: dwrite da/d31/d46/f51 [0,4194304] 0 2024-09-19T07:24:52.863 INFO:tasks.workunit.client.0.smithi098.stdout:4/299: unlink da/d31/c55 0 2024-09-19T07:24:52.864 INFO:tasks.workunit.client.0.smithi098.stdout:4/300: mkdir da/d31/d46/d5f 0 2024-09-19T07:24:52.876 INFO:tasks.workunit.client.0.smithi098.stdout:4/301: write da/f1e [275642,87711] 0 2024-09-19T07:24:52.876 INFO:tasks.workunit.client.0.smithi098.stdout:4/302: write da/d31/f57 [252937,59157] 0 2024-09-19T07:24:52.878 INFO:tasks.workunit.client.0.smithi098.stdout:0/351: dwrite f4 [0,4194304] 0 2024-09-19T07:24:52.880 INFO:tasks.workunit.client.0.smithi098.stdout:0/352: mknod d5/d20/d1f/d52/d64/c67 0 2024-09-19T07:24:52.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:52 smithi162 ceph-mon[35726]: pgmap v87: 97 pgs: 97 active+clean; 212 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 24 MiB/s wr, 2.35k op/s 2024-09-19T07:24:52.886 INFO:tasks.workunit.client.0.smithi098.stdout:1/343: rename dc/de/d22/l3b to dc/d17/d1b/d1d/d3d/l74 0 2024-09-19T07:24:52.887 INFO:tasks.workunit.client.0.smithi098.stdout:0/353: rename d5/d20/d1f/l5f to d5/d20/d14/d49/d62/l68 0 2024-09-19T07:24:52.892 INFO:tasks.workunit.client.0.smithi098.stdout:4/303: dwrite da/f1d [0,4194304] 0 2024-09-19T07:24:52.893 INFO:tasks.workunit.client.0.smithi098.stdout:4/304: readlink da/le 0 2024-09-19T07:24:52.896 INFO:tasks.workunit.client.0.smithi098.stdout:0/354: dread d5/d20/f41 [0,4194304] 0 2024-09-19T07:24:52.897 INFO:tasks.workunit.client.0.smithi098.stdout:0/355: creat d5/d20/f69 x:0 0 0 2024-09-19T07:24:52.898 INFO:tasks.workunit.client.0.smithi098.stdout:0/356: read d5/d20/f1b [617217,77504] 0 2024-09-19T07:24:52.898 INFO:tasks.workunit.client.0.smithi098.stdout:1/344: rename dc/f2c to dc/de/d22/d31/d5d/d6a/f75 0 2024-09-19T07:24:52.900 INFO:tasks.workunit.client.0.smithi098.stdout:0/357: rmdir d5/d20/d14/d5d 0 2024-09-19T07:24:52.902 INFO:tasks.workunit.client.0.smithi098.stdout:0/358: symlink d5/l6a 0 2024-09-19T07:24:52.902 INFO:tasks.workunit.client.0.smithi098.stdout:0/359: read d5/d20/f42 [334199,126250] 0 2024-09-19T07:24:52.903 INFO:tasks.workunit.client.0.smithi098.stdout:0/360: write d5/d20/f42 [1052621,73984] 0 2024-09-19T07:24:52.904 INFO:tasks.workunit.client.0.smithi098.stdout:0/361: mkdir d5/d6b 0 2024-09-19T07:24:52.904 INFO:tasks.workunit.client.0.smithi098.stdout:0/362: getdents d5/d20/d1f/d47 0 2024-09-19T07:24:52.905 INFO:tasks.workunit.client.0.smithi098.stdout:4/305: dread da/f28 [0,4194304] 0 2024-09-19T07:24:52.907 INFO:tasks.workunit.client.0.smithi098.stdout:0/363: dread d5/d20/d14/f24 [0,4194304] 0 2024-09-19T07:24:52.907 INFO:tasks.workunit.client.0.smithi098.stdout:0/364: fsync d5/d20/d1f/f4c 0 2024-09-19T07:24:52.907 INFO:tasks.workunit.client.0.smithi098.stdout:0/365: truncate d5/d20/f69 975389 0 2024-09-19T07:24:52.907 INFO:tasks.workunit.client.0.smithi098.stdout:0/366: truncate d5/d20/d14/f5a 525142 0 2024-09-19T07:24:52.908 INFO:tasks.workunit.client.0.smithi098.stdout:0/367: getdents d5/d20/d14/d49/d62 0 2024-09-19T07:24:52.914 INFO:tasks.workunit.client.0.smithi098.stdout:0/368: write d5/d20/f41 [2600995,121216] 0 2024-09-19T07:24:52.915 INFO:tasks.workunit.client.0.smithi098.stdout:0/369: mknod d5/d20/d14/d49/d62/c6c 0 2024-09-19T07:24:52.916 INFO:tasks.workunit.client.0.smithi098.stdout:0/370: chown d5/f48 396273 1 2024-09-19T07:24:52.917 INFO:tasks.workunit.client.0.smithi098.stdout:0/371: mkdir d5/d6b/d6d 0 2024-09-19T07:24:52.918 INFO:tasks.workunit.client.0.smithi098.stdout:1/345: dwrite dc/de/d37/f4e [0,4194304] 0 2024-09-19T07:24:52.918 INFO:tasks.workunit.client.0.smithi098.stdout:0/372: rmdir d5/d20/d14/d49 39 2024-09-19T07:24:52.919 INFO:tasks.workunit.client.0.smithi098.stdout:1/346: creat dc/d17/f76 x:0 0 0 2024-09-19T07:24:52.920 INFO:tasks.workunit.client.0.smithi098.stdout:0/373: readlink d5/l11 0 2024-09-19T07:24:52.921 INFO:tasks.workunit.client.0.smithi098.stdout:0/374: creat d5/d20/d14/d49/d62/f6e x:0 0 0 2024-09-19T07:24:52.922 INFO:tasks.workunit.client.0.smithi098.stdout:1/347: rmdir dc/de/d22 39 2024-09-19T07:24:52.923 INFO:tasks.workunit.client.0.smithi098.stdout:0/375: link d5/f17 d5/d6b/d6d/f6f 0 2024-09-19T07:24:52.923 INFO:tasks.workunit.client.0.smithi098.stdout:0/376: stat d5/d20/d14/f5a 0 2024-09-19T07:24:52.923 INFO:tasks.workunit.client.0.smithi098.stdout:0/377: fsync d5/d20/d1f/f4c 0 2024-09-19T07:24:52.923 INFO:tasks.workunit.client.0.smithi098.stdout:0/378: write d5/d20/d14/f24 [1117972,42980] 0 2024-09-19T07:24:52.924 INFO:tasks.workunit.client.0.smithi098.stdout:1/348: link dc/l1a dc/de/d22/d31/d5d/d6a/d6f/d4d/l77 0 2024-09-19T07:24:52.925 INFO:tasks.workunit.client.0.smithi098.stdout:1/349: creat dc/de/d22/d31/d5d/d6a/d6f/d5f/f78 x:0 0 0 2024-09-19T07:24:52.933 INFO:tasks.workunit.client.0.smithi098.stdout:0/379: read d5/d20/f12 [9205461,34317] 0 2024-09-19T07:24:52.933 INFO:tasks.workunit.client.0.smithi098.stdout:1/350: dread dc/d17/d1b/d1d/d30/f59 [4194304,4194304] 0 2024-09-19T07:24:52.933 INFO:tasks.workunit.client.0.smithi098.stdout:4/306: dwrite da/f1e [0,4194304] 0 2024-09-19T07:24:52.934 INFO:tasks.workunit.client.0.smithi098.stdout:1/351: mknod dc/de/d22/d31/d35/d4f/c79 0 2024-09-19T07:24:52.934 INFO:tasks.workunit.client.0.smithi098.stdout:1/352: fdatasync dc/de/d50/f61 0 2024-09-19T07:24:52.934 INFO:tasks.workunit.client.0.smithi098.stdout:0/380: mknod d5/d20/d14/c70 0 2024-09-19T07:24:52.935 INFO:tasks.workunit.client.0.smithi098.stdout:4/307: link da/d31/c36 da/d59/d5d/c60 0 2024-09-19T07:24:52.935 INFO:tasks.workunit.client.0.smithi098.stdout:4/308: rmdir da/d31/d46/d56 39 2024-09-19T07:24:52.935 INFO:tasks.workunit.client.0.smithi098.stdout:1/353: mkdir dc/d17/d1b/d71/d7a 0 2024-09-19T07:24:52.936 INFO:tasks.workunit.client.0.smithi098.stdout:0/381: creat d5/d20/d1f/f71 x:0 0 0 2024-09-19T07:24:52.937 INFO:tasks.workunit.client.0.smithi098.stdout:1/354: creat dc/d17/d1b/d71/d7a/f7b x:0 0 0 2024-09-19T07:24:52.937 INFO:tasks.workunit.client.0.smithi098.stdout:1/355: stat dc/d17/d1b/d71/d7a/f7b 0 2024-09-19T07:24:52.937 INFO:tasks.workunit.client.0.smithi098.stdout:1/356: stat dc/de/d38/f6b 0 2024-09-19T07:24:52.938 INFO:tasks.workunit.client.0.smithi098.stdout:1/357: truncate dc/de/d22/d31/d5d/d6a/d6f/f4a 2436523 0 2024-09-19T07:24:52.957 INFO:tasks.workunit.client.0.smithi098.stdout:4/309: dwrite da/fb [4194304,4194304] 0 2024-09-19T07:24:52.964 INFO:tasks.workunit.client.0.smithi098.stdout:0/382: dwrite d5/d20/f41 [0,4194304] 0 2024-09-19T07:24:52.965 INFO:tasks.workunit.client.0.smithi098.stdout:0/383: getdents d5/d20/d1f 0 2024-09-19T07:24:52.967 INFO:tasks.workunit.client.0.smithi098.stdout:1/358: rename dc/d17/d1b/d1d/l5c to dc/de/d22/d31/d35/l7c 0 2024-09-19T07:24:52.967 INFO:tasks.workunit.client.0.smithi098.stdout:0/384: creat d5/d20/d14/d49/f72 x:0 0 0 2024-09-19T07:24:52.967 INFO:tasks.workunit.client.0.smithi098.stdout:0/385: write d5/d20/f51 [829494,102559] 0 2024-09-19T07:24:52.968 INFO:tasks.workunit.client.0.smithi098.stdout:0/386: read d5/f3e [7698,30798] 0 2024-09-19T07:24:52.969 INFO:tasks.workunit.client.0.smithi098.stdout:0/387: symlink d5/d20/d14/d49/d62/l73 0 2024-09-19T07:24:52.969 INFO:tasks.workunit.client.0.smithi098.stdout:0/388: chown d5/d20/d14/f4a 3039 1 2024-09-19T07:24:52.970 INFO:tasks.workunit.client.0.smithi098.stdout:0/389: unlink d5/d20/d14/d49/l60 0 2024-09-19T07:24:52.971 INFO:tasks.workunit.client.0.smithi098.stdout:0/390: dread - d5/f4f zero size 2024-09-19T07:24:52.972 INFO:tasks.workunit.client.0.smithi098.stdout:0/391: symlink d5/d20/d1f/l74 0 2024-09-19T07:24:52.977 INFO:tasks.workunit.client.0.smithi098.stdout:0/392: getdents d5/d20/d14/d49 0 2024-09-19T07:24:52.977 INFO:tasks.workunit.client.0.smithi098.stdout:4/310: dwrite da/f1e [0,4194304] 0 2024-09-19T07:24:52.979 INFO:tasks.workunit.client.0.smithi098.stdout:4/311: mkdir da/d31/d46/d56/d5b/d61 0 2024-09-19T07:24:52.979 INFO:tasks.workunit.client.0.smithi098.stdout:4/312: chown da/c4a 3248 1 2024-09-19T07:24:52.980 INFO:tasks.workunit.client.0.smithi098.stdout:4/313: write da/d31/f3c [196828,100786] 0 2024-09-19T07:24:52.987 INFO:tasks.workunit.client.0.smithi098.stdout:0/393: dread d5/fe [0,4194304] 0 2024-09-19T07:24:52.989 INFO:tasks.workunit.client.0.smithi098.stdout:0/394: unlink d5/l6a 0 2024-09-19T07:24:52.991 INFO:tasks.workunit.client.0.smithi098.stdout:0/395: mknod d5/d20/d1f/d52/c75 0 2024-09-19T07:24:52.991 INFO:tasks.workunit.client.0.smithi098.stdout:1/359: dwrite dc/de/d22/d31/d5d/f6e [0,4194304] 0 2024-09-19T07:24:52.991 INFO:tasks.workunit.client.0.smithi098.stdout:0/396: write d5/d20/d14/f61 [316326,78046] 0 2024-09-19T07:24:52.991 INFO:tasks.workunit.client.0.smithi098.stdout:0/397: chown d5/f3e 4 1 2024-09-19T07:24:52.992 INFO:tasks.workunit.client.0.smithi098.stdout:1/360: getdents dc/de/d22/d31/d5d/d6a/d6f/d4d/d53 0 2024-09-19T07:24:52.992 INFO:tasks.workunit.client.0.smithi098.stdout:1/361: stat dc/de/d22/d31/d5d/d6a/f75 0 2024-09-19T07:24:52.993 INFO:tasks.workunit.client.0.smithi098.stdout:0/398: mknod d5/d20/d1f/c76 0 2024-09-19T07:24:52.993 INFO:tasks.workunit.client.0.smithi098.stdout:1/362: creat dc/de/d22/d31/d35/d58/f7d x:0 0 0 2024-09-19T07:24:52.993 INFO:tasks.workunit.client.0.smithi098.stdout:0/399: mkdir d5/d20/d1f/d52/d64/d77 0 2024-09-19T07:24:52.994 INFO:tasks.workunit.client.0.smithi098.stdout:1/363: creat dc/de/d22/d31/d35/d4f/f7e x:0 0 0 2024-09-19T07:24:52.995 INFO:tasks.workunit.client.0.smithi098.stdout:1/364: dread dc/de/d22/d31/d5d/f60 [0,4194304] 0 2024-09-19T07:24:52.996 INFO:tasks.workunit.client.0.smithi098.stdout:0/400: dread d5/d20/d1f/f4c [0,4194304] 0 2024-09-19T07:24:52.999 INFO:tasks.workunit.client.0.smithi098.stdout:4/314: dwrite da/f1d [0,4194304] 0 2024-09-19T07:24:52.999 INFO:tasks.workunit.client.0.smithi098.stdout:4/315: read da/f1c [1563932,127204] 0 2024-09-19T07:24:53.015 INFO:tasks.workunit.client.0.smithi098.stdout:4/316: rename da/d31/l33 to da/d31/l62 0 2024-09-19T07:24:53.015 INFO:tasks.workunit.client.0.smithi098.stdout:4/317: readlink da/l17 0 2024-09-19T07:24:53.016 INFO:tasks.workunit.client.0.smithi098.stdout:4/318: chown da/c44 3654925 1 2024-09-19T07:24:53.016 INFO:tasks.workunit.client.0.smithi098.stdout:1/365: dwrite dc/de/d22/d31/d35/d58/f7d [0,4194304] 0 2024-09-19T07:24:53.016 INFO:tasks.workunit.client.0.smithi098.stdout:4/319: mkdir da/d31/d46/d56/d5b/d63 0 2024-09-19T07:24:53.020 INFO:tasks.workunit.client.0.smithi098.stdout:1/366: chown dc/de/c15 2828296 1 2024-09-19T07:24:53.021 INFO:tasks.workunit.client.0.smithi098.stdout:1/367: truncate dc/f23 843621 0 2024-09-19T07:24:53.021 INFO:tasks.workunit.client.0.smithi098.stdout:1/368: fdatasync dc/d17/d1b/d1d/d30/f59 0 2024-09-19T07:24:53.021 INFO:tasks.workunit.client.0.smithi098.stdout:1/369: truncate dc/d17/d1b/d1d/f3f 1407275 0 2024-09-19T07:24:53.039 INFO:tasks.workunit.client.0.smithi098.stdout:4/320: dwrite da/f1f [0,4194304] 0 2024-09-19T07:24:53.039 INFO:tasks.workunit.client.0.smithi098.stdout:4/321: fsync da/d31/f49 0 2024-09-19T07:24:53.043 INFO:tasks.workunit.client.0.smithi098.stdout:1/370: dwrite dc/de/d38/f6b [0,4194304] 0 2024-09-19T07:24:53.043 INFO:tasks.workunit.client.0.smithi098.stdout:1/371: write dc/d2a/f51 [639852,8289] 0 2024-09-19T07:24:53.044 INFO:tasks.workunit.client.0.smithi098.stdout:1/372: creat dc/d17/d1b/d1d/d30/f7f x:0 0 0 2024-09-19T07:24:53.044 INFO:tasks.workunit.client.0.smithi098.stdout:1/373: stat dc/de/d22/d31 0 2024-09-19T07:24:53.044 INFO:tasks.workunit.client.0.smithi098.stdout:1/374: write dc/de/d22/d31/d5d/d6a/f75 [1687514,79958] 0 2024-09-19T07:24:53.045 INFO:tasks.workunit.client.0.smithi098.stdout:1/375: rmdir dc/de/d22/d31/d5d 39 2024-09-19T07:24:53.046 INFO:tasks.workunit.client.0.smithi098.stdout:1/376: mknod dc/de/d22/d31/d35/c80 0 2024-09-19T07:24:53.047 INFO:tasks.workunit.client.0.smithi098.stdout:1/377: write dc/de/d38/f44 [1019301,94674] 0 2024-09-19T07:24:53.047 INFO:tasks.workunit.client.0.smithi098.stdout:1/378: rmdir dc/d17/d1b/d71 39 2024-09-19T07:24:53.048 INFO:tasks.workunit.client.0.smithi098.stdout:1/379: mkdir dc/d17/d1b/d71/d81 0 2024-09-19T07:24:53.052 INFO:tasks.workunit.client.0.smithi098.stdout:4/322: write da/f1d [760225,54463] 0 2024-09-19T07:24:53.052 INFO:tasks.workunit.client.0.smithi098.stdout:4/323: creat da/d31/f64 x:0 0 0 2024-09-19T07:24:53.052 INFO:tasks.workunit.client.0.smithi098.stdout:4/324: fdatasync da/d31/d46/f51 0 2024-09-19T07:24:53.059 INFO:tasks.workunit.client.0.smithi098.stdout:1/380: rename dc/d17/c1f to dc/de/d50/c82 0 2024-09-19T07:24:53.059 INFO:tasks.workunit.client.0.smithi098.stdout:1/381: fdatasync dc/d17/d1b/d71/d7a/f7b 0 2024-09-19T07:24:53.061 INFO:tasks.workunit.client.0.smithi098.stdout:1/382: mknod dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/c83 0 2024-09-19T07:24:53.061 INFO:tasks.workunit.client.0.smithi098.stdout:1/383: fsync dc/de/d22/d31/d5d/d6a/d6f/f4a 0 2024-09-19T07:24:53.061 INFO:tasks.workunit.client.0.smithi098.stdout:1/384: write dc/de/d22/d31/d5d/d6a/d6f/d5f/f78 [361233,101299] 0 2024-09-19T07:24:53.061 INFO:tasks.workunit.client.0.smithi098.stdout:1/385: write dc/d2a/f42 [237689,21434] 0 2024-09-19T07:24:53.061 INFO:tasks.workunit.client.0.smithi098.stdout:1/386: fdatasync dc/de/d22/d31/d35/d4f/f7e 0 2024-09-19T07:24:53.062 INFO:tasks.workunit.client.0.smithi098.stdout:1/387: creat dc/de/d50/f84 x:0 0 0 2024-09-19T07:24:53.070 INFO:tasks.workunit.client.0.smithi098.stdout:4/325: dwrite da/d31/f57 [0,4194304] 0 2024-09-19T07:24:53.076 INFO:tasks.workunit.client.0.smithi098.stdout:1/388: rename f1 to dc/de/d37/f85 0 2024-09-19T07:24:53.077 INFO:tasks.workunit.client.0.smithi098.stdout:1/389: creat dc/de/d37/f86 x:0 0 0 2024-09-19T07:24:53.078 INFO:tasks.workunit.client.0.smithi098.stdout:1/390: mkdir dc/d17/d1b/d1d/d3d/d87 0 2024-09-19T07:24:53.081 INFO:tasks.workunit.client.0.smithi098.stdout:4/326: dread da/fb [4194304,4194304] 0 2024-09-19T07:24:53.083 INFO:tasks.workunit.client.0.smithi098.stdout:4/327: symlink da/l65 0 2024-09-19T07:24:53.083 INFO:tasks.workunit.client.0.smithi098.stdout:4/328: chown da 13 1 2024-09-19T07:24:53.098 INFO:tasks.workunit.client.0.smithi098.stdout:4/329: dwrite da/fd [0,4194304] 0 2024-09-19T07:24:53.099 INFO:tasks.workunit.client.0.smithi098.stdout:1/391: dwrite dc/f23 [0,4194304] 0 2024-09-19T07:24:53.100 INFO:tasks.workunit.client.0.smithi098.stdout:1/392: dread dc/de/f21 [0,4194304] 0 2024-09-19T07:24:53.106 INFO:tasks.workunit.client.0.smithi098.stdout:4/330: write da/fd [3441264,5023] 0 2024-09-19T07:24:53.107 INFO:tasks.workunit.client.0.smithi098.stdout:4/331: mkdir da/d31/d46/d56/d5b/d66 0 2024-09-19T07:24:53.108 INFO:tasks.workunit.client.0.smithi098.stdout:4/332: creat da/d31/d46/d56/d5b/d63/f67 x:0 0 0 2024-09-19T07:24:53.109 INFO:tasks.workunit.client.0.smithi098.stdout:4/333: creat da/d59/d5d/f68 x:0 0 0 2024-09-19T07:24:53.110 INFO:tasks.workunit.client.0.smithi098.stdout:4/334: creat da/d31/d46/d56/d5b/f69 x:0 0 0 2024-09-19T07:24:53.110 INFO:tasks.workunit.client.0.smithi098.stdout:4/335: write da/d31/f40 [111453,54603] 0 2024-09-19T07:24:53.110 INFO:tasks.workunit.client.0.smithi098.stdout:4/336: write f9 [3798836,75625] 0 2024-09-19T07:24:53.120 INFO:tasks.workunit.client.0.smithi098.stdout:1/393: dwrite dc/d2a/f51 [0,4194304] 0 2024-09-19T07:24:53.129 INFO:tasks.workunit.client.0.smithi098.stdout:1/394: link cb dc/de/d50/d6c/c88 0 2024-09-19T07:24:53.135 INFO:tasks.workunit.client.0.smithi098.stdout:1/395: unlink dc/de/d22/d31/d5d/c6d 0 2024-09-19T07:24:53.135 INFO:tasks.workunit.client.0.smithi098.stdout:1/396: write dc/de/d37/f86 [151056,119291] 0 2024-09-19T07:24:53.156 INFO:tasks.workunit.client.0.smithi098.stdout:1/397: dwrite dc/de/d22/d31/d5d/d6a/d6f/f4a [0,4194304] 0 2024-09-19T07:24:53.157 INFO:tasks.workunit.client.0.smithi098.stdout:1/398: getdents dc/d17/d1b 0 2024-09-19T07:24:53.158 INFO:tasks.workunit.client.0.smithi098.stdout:1/399: getdents dc/de/d22/d31/d35/d58 0 2024-09-19T07:24:53.158 INFO:tasks.workunit.client.0.smithi098.stdout:1/400: truncate dc/de/d50/f66 778890 0 2024-09-19T07:24:53.159 INFO:tasks.workunit.client.0.smithi098.stdout:1/401: fdatasync dc/de/d22/d31/d5d/d6a/d6f/f4a 0 2024-09-19T07:24:53.166 INFO:tasks.workunit.client.0.smithi098.stdout:1/402: rename dc/de/d22/d31/d35/l69 to dc/d17/d1b/d1d/d3d/l89 0 2024-09-19T07:24:53.167 INFO:tasks.workunit.client.0.smithi098.stdout:1/403: creat dc/de/d22/d31/d5d/d6a/d6f/d4d/f8a x:0 0 0 2024-09-19T07:24:53.168 INFO:tasks.workunit.client.0.smithi098.stdout:1/404: truncate dc/de/d50/f66 1497244 0 2024-09-19T07:24:53.168 INFO:tasks.workunit.client.0.smithi098.stdout:1/405: mkdir dc/de/d22/d31/d5d/d6a/d8b 0 2024-09-19T07:24:53.169 INFO:tasks.workunit.client.0.smithi098.stdout:1/406: creat dc/de/d22/f8c x:0 0 0 2024-09-19T07:24:53.179 INFO:tasks.workunit.client.0.smithi098.stdout:1/407: rename dc/de/d50/c82 to dc/de/d37/c8d 0 2024-09-19T07:24:53.179 INFO:tasks.workunit.client.0.smithi098.stdout:1/408: symlink dc/de/d37/l8e 0 2024-09-19T07:24:53.179 INFO:tasks.workunit.client.0.smithi098.stdout:1/409: fsync dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/f55 0 2024-09-19T07:24:53.180 INFO:tasks.workunit.client.0.smithi098.stdout:1/410: truncate dc/de/d22/d31/d35/d4f/f7e 396979 0 2024-09-19T07:24:53.180 INFO:tasks.workunit.client.0.smithi098.stdout:1/411: write dc/de/d22/d31/d5d/d6a/d6f/d5f/f78 [582949,88861] 0 2024-09-19T07:24:53.193 INFO:tasks.workunit.client.0.smithi098.stdout:1/412: dwrite dc/de/d22/d31/f5b [0,4194304] 0 2024-09-19T07:24:53.200 INFO:tasks.workunit.client.0.smithi098.stdout:1/413: write dc/de/d22/f4b [3384639,54326] 0 2024-09-19T07:24:53.200 INFO:tasks.workunit.client.0.smithi098.stdout:1/414: readlink dc/l11 0 2024-09-19T07:24:53.202 INFO:tasks.workunit.client.0.smithi098.stdout:1/415: read dc/de/d22/d31/d5d/d6a/d6f/f56 [452894,47855] 0 2024-09-19T07:24:53.202 INFO:tasks.workunit.client.0.smithi098.stdout:1/416: truncate dc/de/d37/f86 1067323 0 2024-09-19T07:24:53.208 INFO:tasks.workunit.client.0.smithi098.stdout:1/417: dread dc/d2a/f51 [0,4194304] 0 2024-09-19T07:24:53.209 INFO:tasks.workunit.client.0.smithi098.stdout:1/418: mkdir dc/de/d22/d31/d5d/d8f 0 2024-09-19T07:24:53.211 INFO:tasks.workunit.client.0.smithi098.stdout:1/419: symlink dc/de/d22/d31/d5d/d6a/d6f/l90 0 2024-09-19T07:24:53.212 INFO:tasks.workunit.client.0.smithi098.stdout:1/420: creat dc/de/d22/d31/d5d/d6a/d6f/d5f/f91 x:0 0 0 2024-09-19T07:24:53.213 INFO:tasks.workunit.client.0.smithi098.stdout:1/421: chown dc/de/d22/d31/d5d/d6a/d6f/d4d/f54 0 1 2024-09-19T07:24:53.214 INFO:tasks.workunit.client.0.smithi098.stdout:1/422: read dc/d2a/f42 [69938,90742] 0 2024-09-19T07:24:53.215 INFO:tasks.workunit.client.0.smithi098.stdout:1/423: symlink dc/d2a/l92 0 2024-09-19T07:24:53.215 INFO:tasks.workunit.client.0.smithi098.stdout:1/424: truncate dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/f55 1169332 0 2024-09-19T07:24:53.218 INFO:tasks.workunit.client.0.smithi098.stdout:1/425: read dc/d2a/f51 [414205,77468] 0 2024-09-19T07:24:53.219 INFO:tasks.workunit.client.0.smithi098.stdout:1/426: write dc/de/d22/d31/d5d/d6a/f75 [761186,37069] 0 2024-09-19T07:24:53.219 INFO:tasks.workunit.client.0.smithi098.stdout:1/427: chown dc/d2a 908580 1 2024-09-19T07:24:53.220 INFO:tasks.workunit.client.0.smithi098.stdout:1/428: symlink dc/d17/d1b/d1d/d3d/d87/l93 0 2024-09-19T07:24:53.221 INFO:tasks.workunit.client.0.smithi098.stdout:1/429: creat dc/de/d50/f94 x:0 0 0 2024-09-19T07:24:53.221 INFO:tasks.workunit.client.0.smithi098.stdout:1/430: fdatasync dc/f23 0 2024-09-19T07:24:53.222 INFO:tasks.workunit.client.0.smithi098.stdout:1/431: creat dc/de/d38/f95 x:0 0 0 2024-09-19T07:24:53.222 INFO:tasks.workunit.client.0.smithi098.stdout:1/432: fsync dc/de/d22/d31/f5b 0 2024-09-19T07:24:53.238 INFO:tasks.workunit.client.0.smithi098.stdout:1/433: dwrite dc/d2a/f51 [0,4194304] 0 2024-09-19T07:24:53.238 INFO:tasks.workunit.client.0.smithi098.stdout:1/434: readlink dc/l1a 0 2024-09-19T07:24:53.238 INFO:tasks.workunit.client.0.smithi098.stdout:1/435: truncate dc/d17/f76 759066 0 2024-09-19T07:24:53.239 INFO:tasks.workunit.client.0.smithi098.stdout:1/436: read - dc/de/d38/f95 zero size 2024-09-19T07:24:53.239 INFO:tasks.workunit.client.0.smithi098.stdout:1/437: read dc/f49 [11346,116083] 0 2024-09-19T07:24:53.239 INFO:tasks.workunit.client.0.smithi098.stdout:1/438: read - dc/de/d50/f94 zero size 2024-09-19T07:24:53.240 INFO:tasks.workunit.client.0.smithi098.stdout:1/439: fsync dc/de/d22/f4b 0 2024-09-19T07:24:53.241 INFO:tasks.workunit.client.0.smithi098.stdout:1/440: write dc/de/d50/f84 [904140,52782] 0 2024-09-19T07:24:53.261 INFO:tasks.workunit.client.0.smithi098.stdout:1/441: dwrite dc/de/d22/d31/d5d/d6a/f75 [0,4194304] 0 2024-09-19T07:24:53.284 INFO:tasks.workunit.client.0.smithi098.stdout:1/442: dwrite dc/de/d38/f6b [0,4194304] 0 2024-09-19T07:24:53.302 INFO:tasks.workunit.client.0.smithi098.stdout:1/443: dwrite dc/de/d22/d31/d5d/f6e [4194304,4194304] 0 2024-09-19T07:24:53.310 INFO:tasks.workunit.client.0.smithi098.stdout:1/444: link dc/de/d50/f66 dc/d17/d1b/d71/d81/f96 0 2024-09-19T07:24:53.312 INFO:tasks.workunit.client.0.smithi098.stdout:1/445: mkdir dc/de/d22/d31/d5d/d6a/d6f/d5f/d97 0 2024-09-19T07:24:53.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:53 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:53.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:53 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:53.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:53 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:54.513 INFO:tasks.workunit.client.0.smithi098.stdout:7/429: sync 2024-09-19T07:24:54.514 INFO:tasks.workunit.client.0.smithi098.stdout:0/401: sync 2024-09-19T07:24:54.514 INFO:tasks.workunit.client.0.smithi098.stdout:0/402: chown d5/d20/d1f/d52/c75 327 1 2024-09-19T07:24:54.514 INFO:tasks.workunit.client.0.smithi098.stdout:5/288: sync 2024-09-19T07:24:54.514 INFO:tasks.workunit.client.0.smithi098.stdout:2/228: sync 2024-09-19T07:24:54.514 INFO:tasks.workunit.client.0.smithi098.stdout:9/368: sync 2024-09-19T07:24:54.514 INFO:tasks.workunit.client.0.smithi098.stdout:8/312: sync 2024-09-19T07:24:54.514 INFO:tasks.workunit.client.0.smithi098.stdout:4/337: sync 2024-09-19T07:24:54.514 INFO:tasks.workunit.client.0.smithi098.stdout:2/229: fdatasync d1/d2c/f30 0 2024-09-19T07:24:54.515 INFO:tasks.workunit.client.0.smithi098.stdout:3/335: sync 2024-09-19T07:24:54.515 INFO:tasks.workunit.client.0.smithi098.stdout:2/230: getdents d1/d9/d26/d35/d48 0 2024-09-19T07:24:54.515 INFO:tasks.workunit.client.0.smithi098.stdout:2/231: dread - d1/d9/d1d/f4a zero size 2024-09-19T07:24:54.515 INFO:tasks.workunit.client.0.smithi098.stdout:2/232: readlink d1/l4 0 2024-09-19T07:24:54.515 INFO:tasks.workunit.client.0.smithi098.stdout:6/326: sync 2024-09-19T07:24:54.515 INFO:tasks.workunit.client.0.smithi098.stdout:9/369: write d3/d16/d43/d61/f66 [899293,12815] 0 2024-09-19T07:24:54.516 INFO:tasks.workunit.client.0.smithi098.stdout:4/338: dread da/d31/f49 [0,4194304] 0 2024-09-19T07:24:54.516 INFO:tasks.workunit.client.0.smithi098.stdout:6/327: mknod d2/d5/d1f/d26/d42/d48/d53/c7c 0 2024-09-19T07:24:54.517 INFO:tasks.workunit.client.0.smithi098.stdout:7/430: unlink d5/d3e/d62/c81 0 2024-09-19T07:24:54.517 INFO:tasks.workunit.client.0.smithi098.stdout:4/339: creat da/d59/f6a x:0 0 0 2024-09-19T07:24:54.518 INFO:tasks.workunit.client.0.smithi098.stdout:4/340: creat da/d59/f6b x:0 0 0 2024-09-19T07:24:54.521 INFO:tasks.workunit.client.0.smithi098.stdout:0/403: mknod d5/d20/d1f/d47/c78 0 2024-09-19T07:24:54.522 INFO:tasks.workunit.client.0.smithi098.stdout:8/313: write d0/de/f15 [5238293,70307] 0 2024-09-19T07:24:54.522 INFO:tasks.workunit.client.0.smithi098.stdout:8/314: read d0/de/d28/f35 [3978041,44330] 0 2024-09-19T07:24:54.523 INFO:tasks.workunit.client.0.smithi098.stdout:5/289: dread dc/de/d13/d46/f24 [0,4194304] 0 2024-09-19T07:24:54.523 INFO:tasks.workunit.client.0.smithi098.stdout:5/290: dread - dc/de/d13/d46/d2e/f33 zero size 2024-09-19T07:24:54.523 INFO:tasks.workunit.client.0.smithi098.stdout:5/291: chown dc/de/f4d 6061 1 2024-09-19T07:24:54.523 INFO:tasks.workunit.client.0.smithi098.stdout:5/292: chown dc/de/d13/f14 119 1 2024-09-19T07:24:54.524 INFO:tasks.workunit.client.0.smithi098.stdout:2/233: link d1/d5/f37 d1/da/f4d 0 2024-09-19T07:24:54.524 INFO:tasks.workunit.client.0.smithi098.stdout:2/234: chown d1/d5 0 1 2024-09-19T07:24:54.526 INFO:tasks.workunit.client.0.smithi098.stdout:3/336: dread de/df/d1f/d2b/f57 [0,4194304] 0 2024-09-19T07:24:54.527 INFO:tasks.workunit.client.0.smithi098.stdout:3/337: creat de/df/d1f/d2b/f5e x:0 0 0 2024-09-19T07:24:54.528 INFO:tasks.workunit.client.0.smithi098.stdout:9/370: mknod d3/dc/df/d15/c7d 0 2024-09-19T07:24:54.531 INFO:tasks.workunit.client.0.smithi098.stdout:6/328: mknod d2/d1b/c7d 0 2024-09-19T07:24:54.531 INFO:tasks.workunit.client.0.smithi098.stdout:6/329: fdatasync d2/d5/d1f/d26/f69 0 2024-09-19T07:24:54.531 INFO:tasks.workunit.client.0.smithi098.stdout:7/431: getdents d5/d10/d11 0 2024-09-19T07:24:54.532 INFO:tasks.workunit.client.0.smithi098.stdout:7/432: chown d5/d3e/f95 14094 1 2024-09-19T07:24:54.532 INFO:tasks.workunit.client.0.smithi098.stdout:6/330: truncate d2/d5/d1f/d26/d42/d48/d4a/d4e/f50 2112934 0 2024-09-19T07:24:54.532 INFO:tasks.workunit.client.0.smithi098.stdout:6/331: chown d2/d5/d1f/d26/d42/d48/d4a/l73 140104437 1 2024-09-19T07:24:54.533 INFO:tasks.workunit.client.0.smithi098.stdout:8/315: read d0/de/d28/d40/f51 [2786863,123539] 0 2024-09-19T07:24:54.536 INFO:tasks.workunit.client.0.smithi098.stdout:9/371: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:54.538 INFO:tasks.workunit.client.0.smithi098.stdout:0/404: mkdir d5/d20/d1f/d52/d64/d77/d79 0 2024-09-19T07:24:54.538 INFO:tasks.workunit.client.0.smithi098.stdout:0/405: chown d5/d20/d14/d49/d62/l73 1890960 1 2024-09-19T07:24:54.543 INFO:tasks.workunit.client.0.smithi098.stdout:2/235: mkdir d1/d5/d34/d39/d3f/d42/d4e 0 2024-09-19T07:24:54.543 INFO:tasks.workunit.client.0.smithi098.stdout:2/236: chown d1/d9 8 1 2024-09-19T07:24:54.544 INFO:tasks.workunit.client.0.smithi098.stdout:3/338: rmdir de/d4e 39 2024-09-19T07:24:54.545 INFO:tasks.workunit.client.0.smithi098.stdout:3/339: stat de/df/d1f/d2b/c4b 0 2024-09-19T07:24:54.547 INFO:tasks.workunit.client.0.smithi098.stdout:7/433: rmdir d5/d3e/d62 39 2024-09-19T07:24:54.550 INFO:tasks.workunit.client.0.smithi098.stdout:8/316: symlink d0/de/d21/l63 0 2024-09-19T07:24:54.550 INFO:tasks.workunit.client.0.smithi098.stdout:5/293: dwrite dc/f17 [4194304,4194304] 0 2024-09-19T07:24:54.553 INFO:tasks.workunit.client.0.smithi098.stdout:9/372: unlink d3/dc/df/d15/d1a/c27 0 2024-09-19T07:24:54.553 INFO:tasks.workunit.client.0.smithi098.stdout:9/373: write d3/dc/df/d15/d1b/f56 [729384,98991] 0 2024-09-19T07:24:54.561 INFO:tasks.workunit.client.0.smithi098.stdout:2/237: symlink d1/d9/l4f 0 2024-09-19T07:24:54.564 INFO:tasks.workunit.client.0.smithi098.stdout:1/446: rename dc/de/d22/d31/d5d/d6a/f75 to dc/f98 0 2024-09-19T07:24:54.567 INFO:tasks.workunit.client.0.smithi098.stdout:1/447: mkdir dc/de/d22/d31/d35/d99 0 2024-09-19T07:24:54.567 INFO:tasks.workunit.client.0.smithi098.stdout:2/238: getdents d1/d2c 0 2024-09-19T07:24:54.570 INFO:tasks.workunit.client.0.smithi098.stdout:1/448: truncate dc/f98 1777040 0 2024-09-19T07:24:54.570 INFO:tasks.workunit.client.0.smithi098.stdout:2/239: symlink d1/d9/d26/l50 0 2024-09-19T07:24:54.570 INFO:tasks.workunit.client.0.smithi098.stdout:2/240: read - d1/f4c zero size 2024-09-19T07:24:54.570 INFO:tasks.workunit.client.0.smithi098.stdout:2/241: write d1/d9/f1b [1890,90622] 0 2024-09-19T07:24:54.572 INFO:tasks.workunit.client.0.smithi098.stdout:1/449: mkdir dc/d17/d1b/d71/d9a 0 2024-09-19T07:24:54.573 INFO:tasks.workunit.client.0.smithi098.stdout:2/242: rename d1/d5/f40 to d1/d5/d34/d39/d3f/f51 0 2024-09-19T07:24:54.574 INFO:tasks.workunit.client.0.smithi098.stdout:5/294: write fa [929065,70970] 0 2024-09-19T07:24:54.575 INFO:tasks.workunit.client.0.smithi098.stdout:0/406: dwrite d5/d20/d14/d49/d62/f6e [0,4194304] 0 2024-09-19T07:24:54.575 INFO:tasks.workunit.client.0.smithi098.stdout:2/243: creat d1/d9/d26/d35/d48/f52 x:0 0 0 2024-09-19T07:24:54.575 INFO:tasks.workunit.client.0.smithi098.stdout:2/244: truncate d1/d9/f2d 5110 0 2024-09-19T07:24:54.577 INFO:tasks.workunit.client.0.smithi098.stdout:5/295: mkdir dc/de/d13/d46/d23/d5e 0 2024-09-19T07:24:54.579 INFO:tasks.workunit.client.0.smithi098.stdout:2/245: mknod d1/d9/d26/d35/d48/d49/c53 0 2024-09-19T07:24:54.579 INFO:tasks.workunit.client.0.smithi098.stdout:2/246: stat d1/d9/f2e 0 2024-09-19T07:24:54.579 INFO:tasks.workunit.client.0.smithi098.stdout:2/247: chown d1/d5/d34/d39/d3f 660392648 1 2024-09-19T07:24:54.579 INFO:tasks.workunit.client.0.smithi098.stdout:5/296: rename dc/de/d13/d46/d23/f32 to dc/de/d13/d46/d23/f5f 0 2024-09-19T07:24:54.580 INFO:tasks.workunit.client.0.smithi098.stdout:5/297: truncate dc/f29 4938906 0 2024-09-19T07:24:54.580 INFO:tasks.workunit.client.0.smithi098.stdout:2/248: creat d1/d5/f54 x:0 0 0 2024-09-19T07:24:54.584 INFO:tasks.workunit.client.0.smithi098.stdout:0/407: write d5/f25 [812504,84944] 0 2024-09-19T07:24:54.585 INFO:tasks.workunit.client.0.smithi098.stdout:0/408: creat d5/d20/d1f/d52/d64/f7a x:0 0 0 2024-09-19T07:24:54.585 INFO:tasks.workunit.client.0.smithi098.stdout:0/409: read - d5/d20/d14/f4a zero size 2024-09-19T07:24:54.586 INFO:tasks.workunit.client.0.smithi098.stdout:0/410: creat d5/d6b/d6d/f7b x:0 0 0 2024-09-19T07:24:54.586 INFO:tasks.workunit.client.0.smithi098.stdout:0/411: write d5/f17 [3337246,125581] 0 2024-09-19T07:24:54.586 INFO:tasks.workunit.client.0.smithi098.stdout:0/412: creat d5/d20/d1f/d52/d64/d77/d79/f7c x:0 0 0 2024-09-19T07:24:54.587 INFO:tasks.workunit.client.0.smithi098.stdout:0/413: mkdir d5/d20/d1f/d7d 0 2024-09-19T07:24:54.589 INFO:tasks.workunit.client.0.smithi098.stdout:5/298: dread dc/de/d36/f39 [0,4194304] 0 2024-09-19T07:24:54.590 INFO:tasks.workunit.client.0.smithi098.stdout:8/317: dwrite d0/fc [4194304,4194304] 0 2024-09-19T07:24:54.590 INFO:tasks.workunit.client.0.smithi098.stdout:8/318: readlink d0/d2c/l5b 0 2024-09-19T07:24:54.590 INFO:tasks.workunit.client.0.smithi098.stdout:8/319: chown d0/d16/f23 15476105 1 2024-09-19T07:24:54.595 INFO:tasks.workunit.client.0.smithi098.stdout:7/434: dwrite d5/d10/d11/f44 [0,4194304] 0 2024-09-19T07:24:54.596 INFO:tasks.workunit.client.0.smithi098.stdout:7/435: write d5/d8/f34 [3614094,116905] 0 2024-09-19T07:24:54.598 INFO:tasks.workunit.client.0.smithi098.stdout:0/414: mknod d5/c7e 0 2024-09-19T07:24:54.598 INFO:tasks.workunit.client.0.smithi098.stdout:5/299: rename dc/de/d13/d46/d2e/c4f to dc/de/d13/d46/d2e/d37/c60 0 2024-09-19T07:24:54.598 INFO:tasks.workunit.client.0.smithi098.stdout:5/300: stat dc/de/d13/d46/d23/d52/l53 0 2024-09-19T07:24:54.600 INFO:tasks.workunit.client.0.smithi098.stdout:8/320: unlink d0/de/d12/c56 0 2024-09-19T07:24:54.600 INFO:tasks.workunit.client.0.smithi098.stdout:8/321: readlink d0/d1a/l24 0 2024-09-19T07:24:54.600 INFO:tasks.workunit.client.0.smithi098.stdout:8/322: stat d0/d2c/l5d 0 2024-09-19T07:24:54.600 INFO:tasks.workunit.client.0.smithi098.stdout:8/323: fsync d0/d2c/f5e 0 2024-09-19T07:24:54.603 INFO:tasks.workunit.client.0.smithi098.stdout:3/340: dwrite de/df/d1f/f56 [0,4194304] 0 2024-09-19T07:24:54.604 INFO:tasks.workunit.client.0.smithi098.stdout:7/436: fdatasync d5/d10/d1d/f55 0 2024-09-19T07:24:54.605 INFO:tasks.workunit.client.0.smithi098.stdout:7/437: dread d5/d3e/d62/f65 [0,4194304] 0 2024-09-19T07:24:54.606 INFO:tasks.workunit.client.0.smithi098.stdout:5/301: symlink dc/de/d13/d46/d23/d5e/l61 0 2024-09-19T07:24:54.606 INFO:tasks.workunit.client.0.smithi098.stdout:5/302: read dc/de/d13/f14 [1837957,82353] 0 2024-09-19T07:24:54.606 INFO:tasks.workunit.client.0.smithi098.stdout:5/303: stat dc/f17 0 2024-09-19T07:24:54.607 INFO:tasks.workunit.client.0.smithi098.stdout:3/341: dread f4 [0,4194304] 0 2024-09-19T07:24:54.607 INFO:tasks.workunit.client.0.smithi098.stdout:8/324: creat d0/de/d12/f64 x:0 0 0 2024-09-19T07:24:54.608 INFO:tasks.workunit.client.0.smithi098.stdout:7/438: chown d5/d10/d1d/l36 15784457 1 2024-09-19T07:24:54.611 INFO:tasks.workunit.client.0.smithi098.stdout:8/325: mkdir d0/d16/d65 0 2024-09-19T07:24:54.613 INFO:tasks.workunit.client.0.smithi098.stdout:9/374: dwrite d3/dc/df/d15/f5b [0,4194304] 0 2024-09-19T07:24:54.613 INFO:tasks.workunit.client.0.smithi098.stdout:1/450: dwrite dc/de/d50/f61 [0,4194304] 0 2024-09-19T07:24:54.613 INFO:tasks.workunit.client.0.smithi098.stdout:2/249: dread d1/d9/f2a [0,4194304] 0 2024-09-19T07:24:54.614 INFO:tasks.workunit.client.0.smithi098.stdout:7/439: rename d5/d8/dc/l5f to d5/d8/dc/d16/d4f/d66/l97 0 2024-09-19T07:24:54.616 INFO:tasks.workunit.client.0.smithi098.stdout:3/342: symlink de/df/d16/d2e/l5f 0 2024-09-19T07:24:54.616 INFO:tasks.workunit.client.0.smithi098.stdout:3/343: chown de/f1d 251 1 2024-09-19T07:24:54.618 INFO:tasks.workunit.client.0.smithi098.stdout:4/341: rmdir da 39 2024-09-19T07:24:54.618 INFO:tasks.workunit.client.0.smithi098.stdout:4/342: fsync f9 0 2024-09-19T07:24:54.619 INFO:tasks.workunit.client.0.smithi098.stdout:4/343: creat da/d59/d5d/f6c x:0 0 0 2024-09-19T07:24:54.619 INFO:tasks.workunit.client.0.smithi098.stdout:4/344: chown da/d31/f49 45796044 1 2024-09-19T07:24:54.619 INFO:tasks.workunit.client.0.smithi098.stdout:9/375: mkdir d3/d16/d7b/d7e 0 2024-09-19T07:24:54.620 INFO:tasks.workunit.client.0.smithi098.stdout:2/250: creat d1/d9/d3e/f55 x:0 0 0 2024-09-19T07:24:54.622 INFO:tasks.workunit.client.0.smithi098.stdout:8/326: rename d0/fc to d0/d2c/f66 0 2024-09-19T07:24:54.622 INFO:tasks.workunit.client.0.smithi098.stdout:8/327: write d0/d1a/f3b [784135,51793] 0 2024-09-19T07:24:54.622 INFO:tasks.workunit.client.0.smithi098.stdout:8/328: truncate d0/de/d12/f64 41530 0 2024-09-19T07:24:54.622 INFO:tasks.workunit.client.0.smithi098.stdout:7/440: symlink d5/d10/d11/l98 0 2024-09-19T07:24:54.623 INFO:tasks.workunit.client.0.smithi098.stdout:7/441: chown d5/d10/d11 1784 1 2024-09-19T07:24:54.624 INFO:tasks.workunit.client.0.smithi098.stdout:3/344: getdents de/df 0 2024-09-19T07:24:54.625 INFO:tasks.workunit.client.0.smithi098.stdout:1/451: write dc/de/d50/f61 [3833382,61498] 0 2024-09-19T07:24:54.625 INFO:tasks.workunit.client.0.smithi098.stdout:9/376: truncate d3/d16/d43/d51/f5a 3343549 0 2024-09-19T07:24:54.627 INFO:tasks.workunit.client.0.smithi098.stdout:5/304: dwrite dc/de/d13/d46/f3e [0,4194304] 0 2024-09-19T07:24:54.627 INFO:tasks.workunit.client.0.smithi098.stdout:2/251: creat d1/d9/d26/d35/d48/f56 x:0 0 0 2024-09-19T07:24:54.630 INFO:tasks.workunit.client.0.smithi098.stdout:8/329: getdents d0/de 0 2024-09-19T07:24:54.631 INFO:tasks.workunit.client.0.smithi098.stdout:0/415: getdents d5/d20/d1f 0 2024-09-19T07:24:54.632 INFO:tasks.workunit.client.0.smithi098.stdout:7/442: creat d5/d3e/d62/f99 x:0 0 0 2024-09-19T07:24:54.633 INFO:tasks.workunit.client.0.smithi098.stdout:7/443: read - d5/d8/dc/d16/d4f/f79 zero size 2024-09-19T07:24:54.633 INFO:tasks.workunit.client.0.smithi098.stdout:7/444: read - d5/d3e/f95 zero size 2024-09-19T07:24:54.633 INFO:tasks.workunit.client.0.smithi098.stdout:7/445: write d5/f53 [5170380,82229] 0 2024-09-19T07:24:54.633 INFO:tasks.workunit.client.0.smithi098.stdout:3/345: getdents de/df/d4f 0 2024-09-19T07:24:54.635 INFO:tasks.workunit.client.0.smithi098.stdout:1/452: mknod dc/d17/d1b/d1d/c9b 0 2024-09-19T07:24:54.635 INFO:tasks.workunit.client.0.smithi098.stdout:1/453: fsync dc/d17/d1b/d71/d81/f96 0 2024-09-19T07:24:54.645 INFO:tasks.workunit.client.0.smithi098.stdout:5/305: mkdir dc/de/d13/d46/d2e/d62 0 2024-09-19T07:24:54.646 INFO:tasks.workunit.client.0.smithi098.stdout:8/330: creat d0/d2c/f67 x:0 0 0 2024-09-19T07:24:54.647 INFO:tasks.workunit.client.0.smithi098.stdout:8/331: chown d0/de/f5f 12400 1 2024-09-19T07:24:54.648 INFO:tasks.workunit.client.0.smithi098.stdout:7/446: creat d5/d10/d1d/f9a x:0 0 0 2024-09-19T07:24:54.649 INFO:tasks.workunit.client.0.smithi098.stdout:1/454: mkdir dc/d17/d9c 0 2024-09-19T07:24:54.651 INFO:tasks.workunit.client.0.smithi098.stdout:9/377: mkdir d3/dc/df/d15/d1a/d2d/d7f 0 2024-09-19T07:24:54.651 INFO:tasks.workunit.client.0.smithi098.stdout:9/378: chown d3/dc/df/d15/d1a/d2d/c35 0 1 2024-09-19T07:24:54.652 INFO:tasks.workunit.client.0.smithi098.stdout:8/332: creat d0/d16/d65/f68 x:0 0 0 2024-09-19T07:24:54.652 INFO:tasks.workunit.client.0.smithi098.stdout:1/455: dread dc/de/d22/d31/d5d/d6a/d6f/d5f/f78 [0,4194304] 0 2024-09-19T07:24:54.652 INFO:tasks.workunit.client.0.smithi098.stdout:1/456: write dc/de/d22/f4b [2337520,29539] 0 2024-09-19T07:24:54.653 INFO:tasks.workunit.client.0.smithi098.stdout:0/416: link d5/d20/l55 d5/l7f 0 2024-09-19T07:24:54.653 INFO:tasks.workunit.client.0.smithi098.stdout:0/417: chown d5/fe 1 1 2024-09-19T07:24:54.653 INFO:tasks.workunit.client.0.smithi098.stdout:5/306: rmdir dc 39 2024-09-19T07:24:54.654 INFO:tasks.workunit.client.0.smithi098.stdout:1/457: dread dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/f55 [0,4194304] 0 2024-09-19T07:24:54.654 INFO:tasks.workunit.client.0.smithi098.stdout:7/447: creat d5/d8/dc/f9b x:0 0 0 2024-09-19T07:24:54.654 INFO:tasks.workunit.client.0.smithi098.stdout:7/448: write d5/d8/dc/d16/d4f/d66/f8f [226219,122499] 0 2024-09-19T07:24:54.654 INFO:tasks.workunit.client.0.smithi098.stdout:7/449: chown d5/d10/f3f 0 1 2024-09-19T07:24:54.656 INFO:tasks.workunit.client.0.smithi098.stdout:9/379: mknod d3/dc/df/d15/c80 0 2024-09-19T07:24:54.656 INFO:tasks.workunit.client.0.smithi098.stdout:9/380: stat d3/d16/f3c 0 2024-09-19T07:24:54.656 INFO:tasks.workunit.client.0.smithi098.stdout:4/345: dwrite da/d31/d46/d56/d5b/d63/f67 [0,4194304] 0 2024-09-19T07:24:54.656 INFO:tasks.workunit.client.0.smithi098.stdout:4/346: fdatasync da/f3d 0 2024-09-19T07:24:54.656 INFO:tasks.workunit.client.0.smithi098.stdout:4/347: chown da/c44 7 1 2024-09-19T07:24:54.656 INFO:tasks.workunit.client.0.smithi098.stdout:2/252: dwrite d1/f8 [4194304,4194304] 0 2024-09-19T07:24:54.656 INFO:tasks.workunit.client.0.smithi098.stdout:2/253: fsync d1/da/f4d 0 2024-09-19T07:24:54.656 INFO:tasks.workunit.client.0.smithi098.stdout:1/458: symlink dc/de/d50/l9d 0 2024-09-19T07:24:54.656 INFO:tasks.workunit.client.0.smithi098.stdout:3/346: dwrite de/df/d1f/f47 [0,4194304] 0 2024-09-19T07:24:54.657 INFO:tasks.workunit.client.0.smithi098.stdout:5/307: fsync fa 0 2024-09-19T07:24:54.657 INFO:tasks.workunit.client.0.smithi098.stdout:5/308: readlink dc/de/d13/d46/d2e/l35 0 2024-09-19T07:24:54.657 INFO:tasks.workunit.client.0.smithi098.stdout:5/309: chown dc/de/d13 16649 1 2024-09-19T07:24:54.657 INFO:tasks.workunit.client.0.smithi098.stdout:5/310: fsync dc/f29 0 2024-09-19T07:24:54.657 INFO:tasks.workunit.client.0.smithi098.stdout:0/418: mknod d5/d20/c80 0 2024-09-19T07:24:54.657 INFO:tasks.workunit.client.0.smithi098.stdout:0/419: write d5/d20/d14/f4a [9216,97055] 0 2024-09-19T07:24:54.657 INFO:tasks.workunit.client.0.smithi098.stdout:7/450: mknod d5/d8/dc/d16/d4f/d66/c9c 0 2024-09-19T07:24:54.658 INFO:tasks.workunit.client.0.smithi098.stdout:9/381: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:54.658 INFO:tasks.workunit.client.0.smithi098.stdout:9/382: stat d3/c45 0 2024-09-19T07:24:54.659 INFO:tasks.workunit.client.0.smithi098.stdout:4/348: link da/d31/l4e da/d31/d46/d56/d5b/d66/l6d 0 2024-09-19T07:24:54.659 INFO:tasks.workunit.client.0.smithi098.stdout:0/420: write d5/d20/f10 [9720,82604] 0 2024-09-19T07:24:54.660 INFO:tasks.workunit.client.0.smithi098.stdout:4/349: rename da/d31/d46/d56/d5b/d66/l6d to da/d31/d46/l6e 0 2024-09-19T07:24:54.662 INFO:tasks.workunit.client.0.smithi098.stdout:4/350: link da/f16 da/d59/f6f 0 2024-09-19T07:24:54.668 INFO:tasks.workunit.client.0.smithi098.stdout:2/254: link d1/d9/f47 d1/f57 0 2024-09-19T07:24:54.669 INFO:tasks.workunit.client.0.smithi098.stdout:8/333: dwrite d0/de/f5f [0,4194304] 0 2024-09-19T07:24:54.670 INFO:tasks.workunit.client.0.smithi098.stdout:5/311: creat dc/de/f63 x:0 0 0 2024-09-19T07:24:54.672 INFO:tasks.workunit.client.0.smithi098.stdout:7/451: creat d5/d10/f9d x:0 0 0 2024-09-19T07:24:54.674 INFO:tasks.workunit.client.0.smithi098.stdout:9/383: unlink d3/dc/df/d15/d1a/d2d/c54 0 2024-09-19T07:24:54.675 INFO:tasks.workunit.client.0.smithi098.stdout:0/421: link d5/d20/f69 d5/d20/d1f/d52/d64/f81 0 2024-09-19T07:24:54.680 INFO:tasks.workunit.client.0.smithi098.stdout:8/334: symlink d0/de/d21/l69 0 2024-09-19T07:24:54.682 INFO:tasks.workunit.client.0.smithi098.stdout:5/312: creat dc/de/d13/d46/f64 x:0 0 0 2024-09-19T07:24:54.686 INFO:tasks.workunit.client.0.smithi098.stdout:7/452: mkdir d5/d10/d11/d9e 0 2024-09-19T07:24:54.686 INFO:tasks.workunit.client.0.smithi098.stdout:9/384: symlink d3/d16/l81 0 2024-09-19T07:24:54.688 INFO:tasks.workunit.client.0.smithi098.stdout:2/255: truncate d1/d9/f1b 4579993 0 2024-09-19T07:24:54.688 INFO:tasks.workunit.client.0.smithi098.stdout:6/332: sync 2024-09-19T07:24:54.690 INFO:tasks.workunit.client.0.smithi098.stdout:8/335: symlink d0/d16/l6a 0 2024-09-19T07:24:54.690 INFO:tasks.workunit.client.0.smithi098.stdout:6/333: creat d2/d5/d1f/d26/d42/d48/d4a/d4e/f7e x:0 0 0 2024-09-19T07:24:54.690 INFO:tasks.workunit.client.0.smithi098.stdout:6/334: chown d2/d11/c19 45 1 2024-09-19T07:24:54.692 INFO:tasks.workunit.client.0.smithi098.stdout:1/459: rmdir dc/de/d22/d31/d5d/d6a/d6f 39 2024-09-19T07:24:54.693 INFO:tasks.workunit.client.0.smithi098.stdout:5/313: symlink dc/de/d13/l65 0 2024-09-19T07:24:54.693 INFO:tasks.workunit.client.0.smithi098.stdout:1/460: symlink dc/de/d22/d31/d35/d58/l9e 0 2024-09-19T07:24:54.695 INFO:tasks.workunit.client.0.smithi098.stdout:7/453: creat d5/d3e/d62/f9f x:0 0 0 2024-09-19T07:24:54.695 INFO:tasks.workunit.client.0.smithi098.stdout:7/454: truncate d5/d8/dc/d16/f31 3188289 0 2024-09-19T07:24:54.696 INFO:tasks.workunit.client.0.smithi098.stdout:0/422: getdents d5/d20/d1f/d52/d64 0 2024-09-19T07:24:54.696 INFO:tasks.workunit.client.0.smithi098.stdout:0/423: dread - d5/d20/d1f/d52/d64/f7a zero size 2024-09-19T07:24:54.697 INFO:tasks.workunit.client.0.smithi098.stdout:8/336: mknod d0/c6b 0 2024-09-19T07:24:54.701 INFO:tasks.workunit.client.0.smithi098.stdout:3/347: dwrite de/f25 [0,4194304] 0 2024-09-19T07:24:54.701 INFO:tasks.workunit.client.0.smithi098.stdout:3/348: fdatasync f4 0 2024-09-19T07:24:54.703 INFO:tasks.workunit.client.0.smithi098.stdout:5/314: getdents dc/de/d13/d46/d23/d52 0 2024-09-19T07:24:54.704 INFO:tasks.workunit.client.0.smithi098.stdout:6/335: unlink d2/d5/d1f/d26/d42/f47 0 2024-09-19T07:24:54.705 INFO:tasks.workunit.client.0.smithi098.stdout:0/424: mknod d5/d6b/c82 0 2024-09-19T07:24:54.705 INFO:tasks.workunit.client.0.smithi098.stdout:0/425: chown d5/d20/d1f/d47/c78 63706 1 2024-09-19T07:24:54.706 INFO:tasks.workunit.client.0.smithi098.stdout:8/337: mkdir d0/de/d12/d6c 0 2024-09-19T07:24:54.707 INFO:tasks.workunit.client.0.smithi098.stdout:4/351: rename da/d31/l62 to da/d31/d46/l70 0 2024-09-19T07:24:54.707 INFO:tasks.workunit.client.0.smithi098.stdout:1/461: dread dc/de/d38/f6b [0,4194304] 0 2024-09-19T07:24:54.707 INFO:tasks.workunit.client.0.smithi098.stdout:1/462: stat dc/de/d50/c62 0 2024-09-19T07:24:54.707 INFO:tasks.workunit.client.0.smithi098.stdout:4/352: creat da/d31/f71 x:0 0 0 2024-09-19T07:24:54.708 INFO:tasks.workunit.client.0.smithi098.stdout:0/426: creat d5/d6b/f83 x:0 0 0 2024-09-19T07:24:54.709 INFO:tasks.workunit.client.0.smithi098.stdout:1/463: mkdir dc/de/d22/d31/d35/d58/d9f 0 2024-09-19T07:24:54.709 INFO:tasks.workunit.client.0.smithi098.stdout:0/427: dread d5/d20/f69 [0,4194304] 0 2024-09-19T07:24:54.709 INFO:tasks.workunit.client.0.smithi098.stdout:0/428: readlink d5/l7f 0 2024-09-19T07:24:54.710 INFO:tasks.workunit.client.0.smithi098.stdout:8/338: mkdir d0/d33/d6d 0 2024-09-19T07:24:54.710 INFO:tasks.workunit.client.0.smithi098.stdout:3/349: link de/df/d1f/d2b/f5e de/df/d1f/f60 0 2024-09-19T07:24:54.710 INFO:tasks.workunit.client.0.smithi098.stdout:4/353: symlink da/d31/l72 0 2024-09-19T07:24:54.711 INFO:tasks.workunit.client.0.smithi098.stdout:1/464: mknod dc/de/d22/ca0 0 2024-09-19T07:24:54.711 INFO:tasks.workunit.client.0.smithi098.stdout:1/465: getdents dc/d17/d1b 0 2024-09-19T07:24:54.712 INFO:tasks.workunit.client.0.smithi098.stdout:4/354: creat da/d31/f73 x:0 0 0 2024-09-19T07:24:54.712 INFO:tasks.workunit.client.0.smithi098.stdout:1/466: dread dc/de/d22/d31/d35/d4f/f7e [0,4194304] 0 2024-09-19T07:24:54.713 INFO:tasks.workunit.client.0.smithi098.stdout:1/467: creat dc/de/d22/d31/d35/fa1 x:0 0 0 2024-09-19T07:24:54.713 INFO:tasks.workunit.client.0.smithi098.stdout:1/468: chown dc/d17/d1b/d71/d9a 30 1 2024-09-19T07:24:54.716 INFO:tasks.workunit.client.0.smithi098.stdout:8/339: dread d0/f4c [0,4194304] 0 2024-09-19T07:24:54.717 INFO:tasks.workunit.client.0.smithi098.stdout:2/256: rename d1/da to d1/d9/d26/d35/d58 0 2024-09-19T07:24:54.717 INFO:tasks.workunit.client.0.smithi098.stdout:2/257: dread - d1/d9/d26/d35/d48/f52 zero size 2024-09-19T07:24:54.717 INFO:tasks.workunit.client.0.smithi098.stdout:2/258: truncate d1/d9/f27 351833 0 2024-09-19T07:24:54.717 INFO:tasks.workunit.client.0.smithi098.stdout:2/259: fdatasync d1/d9/f24 0 2024-09-19T07:24:54.717 INFO:tasks.workunit.client.0.smithi098.stdout:2/260: chown d1/d5/d34 135752 1 2024-09-19T07:24:54.718 INFO:tasks.workunit.client.0.smithi098.stdout:7/455: rename d5/d8/dc/d16/d4f/d66 to d5/d3e/d62/da0 0 2024-09-19T07:24:54.719 INFO:tasks.workunit.client.0.smithi098.stdout:2/261: creat d1/d9/d26/f59 x:0 0 0 2024-09-19T07:24:54.719 INFO:tasks.workunit.client.0.smithi098.stdout:2/262: stat d1/d2c 0 2024-09-19T07:24:54.720 INFO:tasks.workunit.client.0.smithi098.stdout:0/429: read d5/d20/d14/d49/d62/f6e [1732679,45546] 0 2024-09-19T07:24:54.721 INFO:tasks.workunit.client.0.smithi098.stdout:5/315: rename dc/de/c16 to dc/c66 0 2024-09-19T07:24:54.721 INFO:tasks.workunit.client.0.smithi098.stdout:0/430: write d5/f25 [3033247,2272] 0 2024-09-19T07:24:54.721 INFO:tasks.workunit.client.0.smithi098.stdout:0/431: stat d5/d20/d14/c4d 0 2024-09-19T07:24:54.721 INFO:tasks.workunit.client.0.smithi098.stdout:0/432: getdents d5/d20/d1f/d52/d64 0 2024-09-19T07:24:54.722 INFO:tasks.workunit.client.0.smithi098.stdout:5/316: rename dc/de/d13/d46/d23/d49 to dc/de/d13/d46/d2e/d37/d67 0 2024-09-19T07:24:54.722 INFO:tasks.workunit.client.0.smithi098.stdout:5/317: fdatasync fa 0 2024-09-19T07:24:54.723 INFO:tasks.workunit.client.0.smithi098.stdout:0/433: dread d5/d20/d14/f61 [0,4194304] 0 2024-09-19T07:24:54.723 INFO:tasks.workunit.client.0.smithi098.stdout:0/434: truncate d5/d6b/f83 481458 0 2024-09-19T07:24:54.723 INFO:tasks.workunit.client.0.smithi098.stdout:0/435: write d5/d20/d14/d49/f56 [1157184,88674] 0 2024-09-19T07:24:54.723 INFO:tasks.workunit.client.0.smithi098.stdout:0/436: chown d5/c7e 14713 1 2024-09-19T07:24:54.727 INFO:tasks.workunit.client.0.smithi098.stdout:3/350: rename de/df/d16/d2e to de/df/d31/d61 0 2024-09-19T07:24:54.729 INFO:tasks.workunit.client.0.smithi098.stdout:2/263: rename d1/d5/d34/d39/d3f to d1/d5/d34/d5a 0 2024-09-19T07:24:54.730 INFO:tasks.workunit.client.0.smithi098.stdout:4/355: read da/f3a [2372382,23012] 0 2024-09-19T07:24:54.731 INFO:tasks.workunit.client.0.smithi098.stdout:2/264: creat d1/d9/d26/d35/d58/f5b x:0 0 0 2024-09-19T07:24:54.731 INFO:tasks.workunit.client.0.smithi098.stdout:2/265: write d1/d9/f47 [6082979,29049] 0 2024-09-19T07:24:54.731 INFO:tasks.workunit.client.0.smithi098.stdout:6/336: dwrite d2/d5/d1f/d26/d42/d48/d4a/d4e/f65 [0,4194304] 0 2024-09-19T07:24:54.733 INFO:tasks.workunit.client.0.smithi098.stdout:0/437: rename d5/d20/d14/f24 to d5/f84 0 2024-09-19T07:24:54.733 INFO:tasks.workunit.client.0.smithi098.stdout:6/337: symlink d2/d5/d1f/d26/d7b/l7f 0 2024-09-19T07:24:54.734 INFO:tasks.workunit.client.0.smithi098.stdout:0/438: creat d5/d20/d1f/d7d/f85 x:0 0 0 2024-09-19T07:24:54.734 INFO:tasks.workunit.client.0.smithi098.stdout:0/439: getdents d5/d20/d1f 0 2024-09-19T07:24:54.735 INFO:tasks.workunit.client.0.smithi098.stdout:6/338: mkdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80 0 2024-09-19T07:24:54.736 INFO:tasks.workunit.client.0.smithi098.stdout:0/440: creat d5/d20/d1f/d52/f86 x:0 0 0 2024-09-19T07:24:54.736 INFO:tasks.workunit.client.0.smithi098.stdout:0/441: dread - d5/d20/d14/d49/f72 zero size 2024-09-19T07:24:54.738 INFO:tasks.workunit.client.0.smithi098.stdout:0/442: write d5/d20/f51 [231603,115627] 0 2024-09-19T07:24:54.739 INFO:tasks.workunit.client.0.smithi098.stdout:4/356: rename da/d31/d46/d56/f5c to da/d31/d46/d5f/f74 0 2024-09-19T07:24:54.741 INFO:tasks.workunit.client.0.smithi098.stdout:0/443: mknod d5/d20/d14/d49/d62/c87 0 2024-09-19T07:24:54.741 INFO:tasks.workunit.client.0.smithi098.stdout:0/444: write d5/d20/d1f/f71 [375035,115395] 0 2024-09-19T07:24:54.741 INFO:tasks.workunit.client.0.smithi098.stdout:2/266: write d1/d9/f2e [544889,85943] 0 2024-09-19T07:24:54.742 INFO:tasks.workunit.client.0.smithi098.stdout:7/456: dwrite d5/d3e/d62/f9f [0,4194304] 0 2024-09-19T07:24:54.743 INFO:tasks.workunit.client.0.smithi098.stdout:1/469: dwrite dc/de/d22/d31/d5d/d6a/d6f/f4a [0,4194304] 0 2024-09-19T07:24:54.744 INFO:tasks.workunit.client.0.smithi098.stdout:6/339: unlink d2/d5/d1f/d26/d42/d48/d4a/d4e/f6f 0 2024-09-19T07:24:54.746 INFO:tasks.workunit.client.0.smithi098.stdout:1/470: rmdir dc/de/d22/d31/d35/d99 0 2024-09-19T07:24:54.748 INFO:tasks.workunit.client.0.smithi098.stdout:7/457: link d5/d10/l82 d5/d10/d11/la1 0 2024-09-19T07:24:54.748 INFO:tasks.workunit.client.0.smithi098.stdout:7/458: readlink d5/d8/dc/d16/l3b 0 2024-09-19T07:24:54.749 INFO:tasks.workunit.client.0.smithi098.stdout:7/459: write d5/d10/d1d/f9a [17283,65635] 0 2024-09-19T07:24:54.749 INFO:tasks.workunit.client.0.smithi098.stdout:7/460: write d5/d8/dc/d16/f5a [1360027,40022] 0 2024-09-19T07:24:54.750 INFO:tasks.workunit.client.0.smithi098.stdout:6/340: rename d2/d5/f59 to d2/d5/f81 0 2024-09-19T07:24:54.751 INFO:tasks.workunit.client.0.smithi098.stdout:4/357: getdents da/d31/d46/d56 0 2024-09-19T07:24:54.752 INFO:tasks.workunit.client.0.smithi098.stdout:4/358: creat da/d31/d46/d5f/f75 x:0 0 0 2024-09-19T07:24:54.752 INFO:tasks.workunit.client.0.smithi098.stdout:1/471: symlink dc/d17/d1b/d1d/la2 0 2024-09-19T07:24:54.754 INFO:tasks.workunit.client.0.smithi098.stdout:4/359: rename da/d31/d46/l6e to da/d59/d5d/l76 0 2024-09-19T07:24:54.754 INFO:tasks.workunit.client.0.smithi098.stdout:4/360: chown da/d31/l4e 24893 1 2024-09-19T07:24:54.754 INFO:tasks.workunit.client.0.smithi098.stdout:7/461: symlink d5/d8/d5d/la2 0 2024-09-19T07:24:54.755 INFO:tasks.workunit.client.0.smithi098.stdout:8/340: dwrite d0/de/d28/f35 [0,4194304] 0 2024-09-19T07:24:54.755 INFO:tasks.workunit.client.0.smithi098.stdout:8/341: stat d0/d1a/f1c 0 2024-09-19T07:24:54.755 INFO:tasks.workunit.client.0.smithi098.stdout:1/472: mkdir dc/d17/d1b/d1d/d30/da3 0 2024-09-19T07:24:54.758 INFO:tasks.workunit.client.0.smithi098.stdout:8/342: creat d0/d33/f6e x:0 0 0 2024-09-19T07:24:54.758 INFO:tasks.workunit.client.0.smithi098.stdout:3/351: truncate de/df/d1f/d2b/f3a 5206454 0 2024-09-19T07:24:54.758 INFO:tasks.workunit.client.0.smithi098.stdout:1/473: creat dc/d17/d1b/d1d/d30/fa4 x:0 0 0 2024-09-19T07:24:54.759 INFO:tasks.workunit.client.0.smithi098.stdout:8/343: write d0/de/d28/d40/f51 [3219025,8762] 0 2024-09-19T07:24:54.760 INFO:tasks.workunit.client.0.smithi098.stdout:1/474: mkdir dc/da5 0 2024-09-19T07:24:54.760 INFO:tasks.workunit.client.0.smithi098.stdout:1/475: chown dc/de/d22/d31/d5d 0 1 2024-09-19T07:24:54.762 INFO:tasks.workunit.client.0.smithi098.stdout:1/476: creat dc/da5/fa6 x:0 0 0 2024-09-19T07:24:54.763 INFO:tasks.workunit.client.0.smithi098.stdout:6/341: dread d2/d11/f2a [4194304,4194304] 0 2024-09-19T07:24:54.764 INFO:tasks.workunit.client.0.smithi098.stdout:2/267: dwrite d1/d2c/f30 [0,4194304] 0 2024-09-19T07:24:54.764 INFO:tasks.workunit.client.0.smithi098.stdout:4/361: rename da/fd to da/d59/f77 0 2024-09-19T07:24:54.765 INFO:tasks.workunit.client.0.smithi098.stdout:6/342: getdents d2 0 2024-09-19T07:24:54.765 INFO:tasks.workunit.client.0.smithi098.stdout:6/343: fsync d2/d5/d1f/d26/f67 0 2024-09-19T07:24:54.766 INFO:tasks.workunit.client.0.smithi098.stdout:2/268: mkdir d1/d9/d26/d5c 0 2024-09-19T07:24:54.767 INFO:tasks.workunit.client.0.smithi098.stdout:8/344: dread d0/de/f18 [0,4194304] 0 2024-09-19T07:24:54.767 INFO:tasks.workunit.client.0.smithi098.stdout:2/269: getdents d1/d5/d34/d39 0 2024-09-19T07:24:54.768 INFO:tasks.workunit.client.0.smithi098.stdout:8/345: write d0/f4e [746337,81409] 0 2024-09-19T07:24:54.768 INFO:tasks.workunit.client.0.smithi098.stdout:2/270: symlink d1/d5/d34/d39/l5d 0 2024-09-19T07:24:54.769 INFO:tasks.workunit.client.0.smithi098.stdout:1/477: rmdir dc/de/d22/d31/d5d/d8f 0 2024-09-19T07:24:54.769 INFO:tasks.workunit.client.0.smithi098.stdout:6/344: unlink d2/d11/f24 0 2024-09-19T07:24:54.769 INFO:tasks.workunit.client.0.smithi098.stdout:6/345: readlink d2/d5/l31 0 2024-09-19T07:24:54.769 INFO:tasks.workunit.client.0.smithi098.stdout:8/346: creat d0/de/d21/d50/f6f x:0 0 0 2024-09-19T07:24:54.771 INFO:tasks.workunit.client.0.smithi098.stdout:6/346: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/f82 x:0 0 0 2024-09-19T07:24:54.771 INFO:tasks.workunit.client.0.smithi098.stdout:2/271: rename d1/d9/d1d/f36 to d1/d5/d34/d5a/d42/d4e/f5e 0 2024-09-19T07:24:54.772 INFO:tasks.workunit.client.0.smithi098.stdout:6/347: creat d2/d5/d1f/f83 x:0 0 0 2024-09-19T07:24:54.773 INFO:tasks.workunit.client.0.smithi098.stdout:6/348: write d2/d5/d1f/d26/d42/d48/d53/d64/d6d/f82 [913120,25295] 0 2024-09-19T07:24:54.773 INFO:tasks.workunit.client.0.smithi098.stdout:0/445: dwrite d5/fe [0,4194304] 0 2024-09-19T07:24:54.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:54 smithi098 ceph-mon[30950]: pgmap v88: 97 pgs: 97 active+clean; 212 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 24 MiB/s wr, 2.35k op/s 2024-09-19T07:24:54.773 INFO:tasks.workunit.client.0.smithi098.stdout:8/347: mknod d0/de/d12/d6c/c70 0 2024-09-19T07:24:54.773 INFO:tasks.workunit.client.0.smithi098.stdout:8/348: chown d0/de/d28/c2d 2651237 1 2024-09-19T07:24:54.775 INFO:tasks.workunit.client.0.smithi098.stdout:4/362: unlink l2 0 2024-09-19T07:24:54.776 INFO:tasks.workunit.client.0.smithi098.stdout:2/272: symlink d1/d9/d26/d5c/l5f 0 2024-09-19T07:24:54.776 INFO:tasks.workunit.client.0.smithi098.stdout:2/273: dread - d1/d2c/f2f zero size 2024-09-19T07:24:54.777 INFO:tasks.workunit.client.0.smithi098.stdout:3/352: dread de/df/d1f/d2b/f3a [0,4194304] 0 2024-09-19T07:24:54.777 INFO:tasks.workunit.client.0.smithi098.stdout:0/446: getdents d5 0 2024-09-19T07:24:54.778 INFO:tasks.workunit.client.0.smithi098.stdout:7/462: dwrite d5/d8/dc/f42 [0,4194304] 0 2024-09-19T07:24:54.779 INFO:tasks.workunit.client.0.smithi098.stdout:8/349: unlink d0/de/l47 0 2024-09-19T07:24:54.779 INFO:tasks.workunit.client.0.smithi098.stdout:8/350: chown d0/de/f27 3 1 2024-09-19T07:24:54.780 INFO:tasks.workunit.client.0.smithi098.stdout:8/351: stat d0/de/d21 0 2024-09-19T07:24:54.780 INFO:tasks.workunit.client.0.smithi098.stdout:8/352: dread - d0/d1a/f1c zero size 2024-09-19T07:24:54.780 INFO:tasks.workunit.client.0.smithi098.stdout:2/274: mkdir d1/d9/d3e/d41/d60 0 2024-09-19T07:24:54.781 INFO:tasks.workunit.client.0.smithi098.stdout:0/447: dread d5/d20/d14/d49/d62/f6e [0,4194304] 0 2024-09-19T07:24:54.781 INFO:tasks.workunit.client.0.smithi098.stdout:0/448: write d5/d20/d14/f4a [700481,15719] 0 2024-09-19T07:24:54.782 INFO:tasks.workunit.client.0.smithi098.stdout:4/363: rename da/f11 to da/d31/d46/d56/f78 0 2024-09-19T07:24:54.782 INFO:tasks.workunit.client.0.smithi098.stdout:7/463: truncate d5/d3e/d62/da0/f88 4166733 0 2024-09-19T07:24:54.782 INFO:tasks.workunit.client.0.smithi098.stdout:7/464: chown d5/d3e/d62/da0/f8f 1441281 1 2024-09-19T07:24:54.783 INFO:tasks.workunit.client.0.smithi098.stdout:6/349: dread d2/d11/f56 [0,4194304] 0 2024-09-19T07:24:54.785 INFO:tasks.workunit.client.0.smithi098.stdout:4/364: mknod da/d31/d46/d56/d5b/c79 0 2024-09-19T07:24:54.787 INFO:tasks.workunit.client.0.smithi098.stdout:2/275: mkdir d1/d9/d26/d35/d48/d49/d61 0 2024-09-19T07:24:54.788 INFO:tasks.workunit.client.0.smithi098.stdout:3/353: symlink de/df/d31/d61/l62 0 2024-09-19T07:24:54.790 INFO:tasks.workunit.client.0.smithi098.stdout:8/353: rename d0/d16/d65/f68 to d0/de/d12/d6c/f71 0 2024-09-19T07:24:54.792 INFO:tasks.workunit.client.0.smithi098.stdout:1/478: dwrite dc/de/d22/d31/d5d/f6e [4194304,4194304] 0 2024-09-19T07:24:54.793 INFO:tasks.workunit.client.0.smithi098.stdout:7/465: unlink d5/d3e/d62/f9f 0 2024-09-19T07:24:54.793 INFO:tasks.workunit.client.0.smithi098.stdout:1/479: write dc/de/d22/d31/d5d/d6a/d6f/d5f/f91 [380347,884] 0 2024-09-19T07:24:54.793 INFO:tasks.workunit.client.0.smithi098.stdout:1/480: truncate dc/f49 554744 0 2024-09-19T07:24:54.794 INFO:tasks.workunit.client.0.smithi098.stdout:1/481: creat dc/de/d37/fa7 x:0 0 0 2024-09-19T07:24:54.795 INFO:tasks.workunit.client.0.smithi098.stdout:2/276: mkdir d1/d9/d26/d35/d48/d49/d61/d62 0 2024-09-19T07:24:54.797 INFO:tasks.workunit.client.0.smithi098.stdout:3/354: creat de/df/f63 x:0 0 0 2024-09-19T07:24:54.799 INFO:tasks.workunit.client.0.smithi098.stdout:0/449: rename d5/c7e to d5/d20/d1f/d52/d64/d77/c88 0 2024-09-19T07:24:54.801 INFO:tasks.workunit.client.0.smithi098.stdout:1/482: mknod dc/ca8 0 2024-09-19T07:24:54.803 INFO:tasks.workunit.client.0.smithi098.stdout:2/277: dread d1/d9/d26/d35/d58/f22 [0,4194304] 0 2024-09-19T07:24:54.803 INFO:tasks.workunit.client.0.smithi098.stdout:2/278: write d1/f8 [8864546,113933] 0 2024-09-19T07:24:54.803 INFO:tasks.workunit.client.0.smithi098.stdout:2/279: write d1/d9/f2d [568189,29981] 0 2024-09-19T07:24:54.805 INFO:tasks.workunit.client.0.smithi098.stdout:3/355: read de/df/f29 [3523073,130453] 0 2024-09-19T07:24:54.807 INFO:tasks.workunit.client.0.smithi098.stdout:2/280: mknod d1/d9/d3e/d41/d60/c63 0 2024-09-19T07:24:54.807 INFO:tasks.workunit.client.0.smithi098.stdout:2/281: readlink d1/d9/d3e/l1e 0 2024-09-19T07:24:54.807 INFO:tasks.workunit.client.0.smithi098.stdout:2/282: dread - d1/d9/d26/d35/d48/f56 zero size 2024-09-19T07:24:54.807 INFO:tasks.workunit.client.0.smithi098.stdout:2/283: fsync d1/d9/d26/d35/d48/f52 0 2024-09-19T07:24:54.809 INFO:tasks.workunit.client.0.smithi098.stdout:6/350: rename d2/d5/d1f/d26/d42/d48/d4a/d4e/l68 to d2/l84 0 2024-09-19T07:24:54.809 INFO:tasks.workunit.client.0.smithi098.stdout:0/450: write f4 [4113578,86537] 0 2024-09-19T07:24:54.809 INFO:tasks.workunit.client.0.smithi098.stdout:3/356: mkdir de/df/d31/d61/d3f/d64 0 2024-09-19T07:24:54.810 INFO:tasks.workunit.client.0.smithi098.stdout:6/351: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/l85 0 2024-09-19T07:24:54.810 INFO:tasks.workunit.client.0.smithi098.stdout:6/352: readlink d2/d5/l31 0 2024-09-19T07:24:54.810 INFO:tasks.workunit.client.0.smithi098.stdout:6/353: dread - d2/d5/f81 zero size 2024-09-19T07:24:54.810 INFO:tasks.workunit.client.0.smithi098.stdout:0/451: dread d5/d20/d14/f5a [0,4194304] 0 2024-09-19T07:24:54.810 INFO:tasks.workunit.client.0.smithi098.stdout:0/452: write d5/f4f [1025543,72287] 0 2024-09-19T07:24:54.811 INFO:tasks.workunit.client.0.smithi098.stdout:8/354: rename d0/d16/c20 to d0/de/d12/d6c/c72 0 2024-09-19T07:24:54.811 INFO:tasks.workunit.client.0.smithi098.stdout:8/355: fsync d0/d2c/f5e 0 2024-09-19T07:24:54.812 INFO:tasks.workunit.client.0.smithi098.stdout:3/357: truncate de/f2f 393468 0 2024-09-19T07:24:54.812 INFO:tasks.workunit.client.0.smithi098.stdout:3/358: write de/d4e/f50 [417335,111009] 0 2024-09-19T07:24:54.813 INFO:tasks.workunit.client.0.smithi098.stdout:2/284: mknod d1/d5/d34/d39/c64 0 2024-09-19T07:24:54.813 INFO:tasks.workunit.client.0.smithi098.stdout:2/285: chown d1/d5/f54 45193048 1 2024-09-19T07:24:54.813 INFO:tasks.workunit.client.0.smithi098.stdout:2/286: read - d1/d9/f33 zero size 2024-09-19T07:24:54.814 INFO:tasks.workunit.client.0.smithi098.stdout:0/453: creat d5/d6b/f89 x:0 0 0 2024-09-19T07:24:54.815 INFO:tasks.workunit.client.0.smithi098.stdout:6/354: dread d2/d11/f5c [0,4194304] 0 2024-09-19T07:24:54.815 INFO:tasks.workunit.client.0.smithi098.stdout:7/466: rename d5/d3e/d62/da0/f87 to d5/d8/d8e/d59/fa3 0 2024-09-19T07:24:54.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:54 smithi139 ceph-mon[35039]: pgmap v88: 97 pgs: 97 active+clean; 212 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 24 MiB/s wr, 2.35k op/s 2024-09-19T07:24:54.816 INFO:tasks.workunit.client.0.smithi098.stdout:8/356: creat d0/d16/f73 x:0 0 0 2024-09-19T07:24:54.818 INFO:tasks.workunit.client.0.smithi098.stdout:3/359: symlink de/df/d4f/l65 0 2024-09-19T07:24:54.818 INFO:tasks.workunit.client.0.smithi098.stdout:3/360: chown de/df/d31/d61/l62 1032174 1 2024-09-19T07:24:54.820 INFO:tasks.workunit.client.0.smithi098.stdout:2/287: mkdir d1/d9/d3e/d41/d60/d65 0 2024-09-19T07:24:54.820 INFO:tasks.workunit.client.0.smithi098.stdout:2/288: write d1/d9/f24 [1907988,11101] 0 2024-09-19T07:24:54.820 INFO:tasks.workunit.client.0.smithi098.stdout:2/289: fdatasync d1/d5/d34/d5a/f51 0 2024-09-19T07:24:54.820 INFO:tasks.workunit.client.0.smithi098.stdout:2/290: chown d1/d9/d26/d35/d58/f1a 689 1 2024-09-19T07:24:54.821 INFO:tasks.workunit.client.0.smithi098.stdout:0/454: mknod d5/d20/d1f/c8a 0 2024-09-19T07:24:54.822 INFO:tasks.workunit.client.0.smithi098.stdout:9/385: sync 2024-09-19T07:24:54.822 INFO:tasks.workunit.client.0.smithi098.stdout:9/386: chown d3/dc/df/d15/d1b/f56 5295949 1 2024-09-19T07:24:54.823 INFO:tasks.workunit.client.0.smithi098.stdout:8/357: creat d0/d33/d44/f74 x:0 0 0 2024-09-19T07:24:54.825 INFO:tasks.workunit.client.0.smithi098.stdout:0/455: creat d5/f8b x:0 0 0 2024-09-19T07:24:54.825 INFO:tasks.workunit.client.0.smithi098.stdout:0/456: readlink d5/d20/l55 0 2024-09-19T07:24:54.826 INFO:tasks.workunit.client.0.smithi098.stdout:8/358: creat d0/de/f75 x:0 0 0 2024-09-19T07:24:54.826 INFO:tasks.workunit.client.0.smithi098.stdout:8/359: write d0/de/f27 [5190331,51572] 0 2024-09-19T07:24:54.827 INFO:tasks.workunit.client.0.smithi098.stdout:3/361: stat de/f25 0 2024-09-19T07:24:54.830 INFO:tasks.workunit.client.0.smithi098.stdout:0/457: symlink d5/d20/d14/l8c 0 2024-09-19T07:24:54.830 INFO:tasks.workunit.client.0.smithi098.stdout:0/458: dread - d5/f46 zero size 2024-09-19T07:24:54.830 INFO:tasks.workunit.client.0.smithi098.stdout:0/459: write d5/f30 [364632,109698] 0 2024-09-19T07:24:54.833 INFO:tasks.workunit.client.0.smithi098.stdout:8/360: creat d0/de/d28/d40/f76 x:0 0 0 2024-09-19T07:24:54.833 INFO:tasks.workunit.client.0.smithi098.stdout:2/291: dread d1/d9/f24 [0,4194304] 0 2024-09-19T07:24:54.833 INFO:tasks.workunit.client.0.smithi098.stdout:8/361: readlink d0/de/d21/d50/l59 0 2024-09-19T07:24:54.833 INFO:tasks.workunit.client.0.smithi098.stdout:2/292: stat d1/d9/d3e/fd 0 2024-09-19T07:24:54.833 INFO:tasks.workunit.client.0.smithi098.stdout:2/293: chown d1/d9/d3e/d41/f4b 14601625 1 2024-09-19T07:24:54.835 INFO:tasks.workunit.client.0.smithi098.stdout:0/460: mkdir d5/d20/d1f/d8d 0 2024-09-19T07:24:54.835 INFO:tasks.workunit.client.0.smithi098.stdout:0/461: readlink d5/l11 0 2024-09-19T07:24:54.836 INFO:tasks.workunit.client.0.smithi098.stdout:2/294: link d1/d9/d26/d35/d48/f56 d1/d9/d26/d35/d48/d49/f66 0 2024-09-19T07:24:54.838 INFO:tasks.workunit.client.0.smithi098.stdout:7/467: dwrite d5/d10/d11/f73 [0,4194304] 0 2024-09-19T07:24:54.839 INFO:tasks.workunit.client.0.smithi098.stdout:2/295: mknod d1/d5/d34/d39/c67 0 2024-09-19T07:24:54.839 INFO:tasks.workunit.client.0.smithi098.stdout:2/296: chown d1/d9/d26 581872138 1 2024-09-19T07:24:54.839 INFO:tasks.workunit.client.0.smithi098.stdout:2/297: write d1/d9/f27 [803072,102968] 0 2024-09-19T07:24:54.841 INFO:tasks.workunit.client.0.smithi098.stdout:7/468: creat d5/d8/dc/fa4 x:0 0 0 2024-09-19T07:24:54.842 INFO:tasks.workunit.client.0.smithi098.stdout:2/298: symlink d1/d5/d34/l68 0 2024-09-19T07:24:54.846 INFO:tasks.workunit.client.0.smithi098.stdout:7/469: unlink d5/c86 0 2024-09-19T07:24:54.847 INFO:tasks.workunit.client.0.smithi098.stdout:2/299: symlink d1/d2c/l69 0 2024-09-19T07:24:54.849 INFO:tasks.workunit.client.0.smithi098.stdout:7/470: dread d5/d10/d50/f6c [0,4194304] 0 2024-09-19T07:24:54.852 INFO:tasks.workunit.client.0.smithi098.stdout:3/362: dwrite de/df/d31/d61/d3f/f5d [0,4194304] 0 2024-09-19T07:24:54.852 INFO:tasks.workunit.client.0.smithi098.stdout:3/363: dread - de/d4e/f51 zero size 2024-09-19T07:24:54.854 INFO:tasks.workunit.client.0.smithi098.stdout:3/364: symlink de/df/d1f/l66 0 2024-09-19T07:24:54.855 INFO:tasks.workunit.client.0.smithi098.stdout:3/365: mknod de/df/c67 0 2024-09-19T07:24:54.859 INFO:tasks.workunit.client.0.smithi098.stdout:0/462: dwrite d5/d20/f12 [8388608,4194304] 0 2024-09-19T07:24:54.859 INFO:tasks.workunit.client.0.smithi098.stdout:3/366: fdatasync de/d4e/f50 0 2024-09-19T07:24:54.859 INFO:tasks.workunit.client.0.smithi098.stdout:7/471: dread d5/d8/dc/d16/f84 [0,4194304] 0 2024-09-19T07:24:54.859 INFO:tasks.workunit.client.0.smithi098.stdout:3/367: write de/f1a [1689883,91896] 0 2024-09-19T07:24:54.860 INFO:tasks.workunit.client.0.smithi098.stdout:3/368: symlink de/df/d1f/d2b/l68 0 2024-09-19T07:24:54.863 INFO:tasks.workunit.client.0.smithi098.stdout:0/463: rmdir d5/d20/d1f/d47 39 2024-09-19T07:24:54.864 INFO:tasks.workunit.client.0.smithi098.stdout:1/483: rename dc/d17/d1b/c40 to dc/de/d50/ca9 0 2024-09-19T07:24:54.866 INFO:tasks.workunit.client.0.smithi098.stdout:3/369: mkdir de/df/d31/d61/d69 0 2024-09-19T07:24:54.867 INFO:tasks.workunit.client.0.smithi098.stdout:1/484: creat dc/d17/d1b/faa x:0 0 0 2024-09-19T07:24:54.867 INFO:tasks.workunit.client.0.smithi098.stdout:3/370: dread de/df/f22 [0,4194304] 0 2024-09-19T07:24:54.869 INFO:tasks.workunit.client.0.smithi098.stdout:1/485: mknod dc/d17/d1b/d1d/cab 0 2024-09-19T07:24:54.869 INFO:tasks.workunit.client.0.smithi098.stdout:1/486: write dc/d17/d1b/d71/d7a/f7b [532212,80825] 0 2024-09-19T07:24:54.869 INFO:tasks.workunit.client.0.smithi098.stdout:7/472: write d5/f40 [840442,45080] 0 2024-09-19T07:24:54.869 INFO:tasks.workunit.client.0.smithi098.stdout:7/473: stat d5/c23 0 2024-09-19T07:24:54.871 INFO:tasks.workunit.client.0.smithi098.stdout:3/371: creat de/d4e/f6a x:0 0 0 2024-09-19T07:24:54.871 INFO:tasks.workunit.client.0.smithi098.stdout:3/372: chown de/df/d31/f5b 31387 1 2024-09-19T07:24:54.871 INFO:tasks.workunit.client.0.smithi098.stdout:3/373: chown de/df/d16/f4a 10037 1 2024-09-19T07:24:54.876 INFO:tasks.workunit.client.0.smithi098.stdout:5/318: sync 2024-09-19T07:24:54.878 INFO:tasks.workunit.client.0.smithi098.stdout:6/355: rename d2/d1b/f34 to d2/f86 0 2024-09-19T07:24:54.880 INFO:tasks.workunit.client.0.smithi098.stdout:9/387: rename d3/d16/d43/c64 to d3/d16/d43/d51/c82 0 2024-09-19T07:24:54.880 INFO:tasks.workunit.client.0.smithi098.stdout:9/388: write d3/dc/f6a [2357311,78480] 0 2024-09-19T07:24:54.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:54 smithi162 ceph-mon[35726]: pgmap v88: 97 pgs: 97 active+clean; 212 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 24 MiB/s wr, 2.35k op/s 2024-09-19T07:24:54.882 INFO:tasks.workunit.client.0.smithi098.stdout:8/362: rename d0/c2 to d0/de/d21/c77 0 2024-09-19T07:24:54.882 INFO:tasks.workunit.client.0.smithi098.stdout:8/363: write d0/f22 [4999183,83300] 0 2024-09-19T07:24:54.883 INFO:tasks.workunit.client.0.smithi098.stdout:6/356: write d2/d11/f56 [2928214,19432] 0 2024-09-19T07:24:54.883 INFO:tasks.workunit.client.0.smithi098.stdout:8/364: readlink d0/de/d12/l19 0 2024-09-19T07:24:54.883 INFO:tasks.workunit.client.0.smithi098.stdout:8/365: chown d0/de/f27 2234 1 2024-09-19T07:24:54.883 INFO:tasks.workunit.client.0.smithi098.stdout:8/366: fdatasync d0/f53 0 2024-09-19T07:24:54.883 INFO:tasks.workunit.client.0.smithi098.stdout:9/389: mkdir d3/d6/d46/d83 0 2024-09-19T07:24:54.883 INFO:tasks.workunit.client.0.smithi098.stdout:9/390: write d3/dc/df/d15/d1a/d2b/f33 [1623324,63187] 0 2024-09-19T07:24:54.883 INFO:tasks.workunit.client.0.smithi098.stdout:9/391: write d3/dc/df/d15/d1a/d2b/d49/d65/f7c [386649,63454] 0 2024-09-19T07:24:54.884 INFO:tasks.workunit.client.0.smithi098.stdout:2/300: rename d1/d9/f2e to d1/d5/f6a 0 2024-09-19T07:24:54.884 INFO:tasks.workunit.client.0.smithi098.stdout:2/301: fsync d1/d5/f54 0 2024-09-19T07:24:54.884 INFO:tasks.workunit.client.0.smithi098.stdout:9/392: symlink d3/d16/d43/d61/l84 0 2024-09-19T07:24:54.884 INFO:tasks.workunit.client.0.smithi098.stdout:9/393: fsync d3/d16/f57 0 2024-09-19T07:24:54.886 INFO:tasks.workunit.client.0.smithi098.stdout:3/374: rename de/df/c67 to de/df/d31/c6b 0 2024-09-19T07:24:54.887 INFO:tasks.workunit.client.0.smithi098.stdout:3/375: truncate de/df/f63 836108 0 2024-09-19T07:24:54.887 INFO:tasks.workunit.client.0.smithi098.stdout:3/376: fdatasync de/df/d1f/d2b/f57 0 2024-09-19T07:24:54.887 INFO:tasks.workunit.client.0.smithi098.stdout:6/357: dread d2/d11/f5c [0,4194304] 0 2024-09-19T07:24:54.887 INFO:tasks.workunit.client.0.smithi098.stdout:2/302: link d1/d9/f1b d1/d9/d26/d35/f6b 0 2024-09-19T07:24:54.887 INFO:tasks.workunit.client.0.smithi098.stdout:5/319: dread dc/de/d13/d3b/f3c [0,4194304] 0 2024-09-19T07:24:54.888 INFO:tasks.workunit.client.0.smithi098.stdout:6/358: rmdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d 39 2024-09-19T07:24:54.888 INFO:tasks.workunit.client.0.smithi098.stdout:9/394: getdents d3/dc/df/d15/d1a/d2b/d49/d50 0 2024-09-19T07:24:54.889 INFO:tasks.workunit.client.0.smithi098.stdout:6/359: link d2/d5/d1f/l38 d2/d5/l87 0 2024-09-19T07:24:54.891 INFO:tasks.workunit.client.0.smithi098.stdout:6/360: creat d2/d5/d1f/d26/d42/d48/d4a/f88 x:0 0 0 2024-09-19T07:24:54.892 INFO:tasks.workunit.client.0.smithi098.stdout:5/320: dread f3 [0,4194304] 0 2024-09-19T07:24:54.892 INFO:tasks.workunit.client.0.smithi098.stdout:5/321: stat dc/de/d13/d3b/l42 0 2024-09-19T07:24:54.892 INFO:tasks.workunit.client.0.smithi098.stdout:5/322: write dc/de/d13/f19 [1063238,40754] 0 2024-09-19T07:24:54.893 INFO:tasks.workunit.client.0.smithi098.stdout:8/367: rename d0/de/d21/l69 to d0/d1a/l78 0 2024-09-19T07:24:54.895 INFO:tasks.workunit.client.0.smithi098.stdout:9/395: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:54.895 INFO:tasks.workunit.client.0.smithi098.stdout:9/396: write d3/d16/f3e [2099973,18170] 0 2024-09-19T07:24:54.895 INFO:tasks.workunit.client.0.smithi098.stdout:9/397: stat d3/d16/f3e 0 2024-09-19T07:24:54.895 INFO:tasks.workunit.client.0.smithi098.stdout:6/361: link d2/d5/d1f/d26/d42/d48/d53/f5f d2/d5/d1f/d26/d42/d48/d4a/d4e/f89 0 2024-09-19T07:24:54.896 INFO:tasks.workunit.client.0.smithi098.stdout:3/377: link l6 de/df/d16/l6c 0 2024-09-19T07:24:54.896 INFO:tasks.workunit.client.0.smithi098.stdout:6/362: mkdir d2/d5/d8a 0 2024-09-19T07:24:54.896 INFO:tasks.workunit.client.0.smithi098.stdout:6/363: write d2/d5/d1f/d26/d42/d48/f63 [309046,122320] 0 2024-09-19T07:24:54.896 INFO:tasks.workunit.client.0.smithi098.stdout:0/464: dwrite d5/f17 [4194304,4194304] 0 2024-09-19T07:24:54.896 INFO:tasks.workunit.client.0.smithi098.stdout:7/474: dwrite d5/d3e/d62/f70 [0,4194304] 0 2024-09-19T07:24:54.896 INFO:tasks.workunit.client.0.smithi098.stdout:7/475: stat d5/d3e/d62/f7a 0 2024-09-19T07:24:54.896 INFO:tasks.workunit.client.0.smithi098.stdout:5/323: rename dc/de/d13/d46/d2e/l35 to dc/de/d13/d5c/l68 0 2024-09-19T07:24:54.899 INFO:tasks.workunit.client.0.smithi098.stdout:3/378: mkdir de/d4e/d6d 0 2024-09-19T07:24:54.899 INFO:tasks.workunit.client.0.smithi098.stdout:3/379: write de/df/d1f/d2b/f5e [222500,16702] 0 2024-09-19T07:24:54.905 INFO:tasks.workunit.client.0.smithi098.stdout:2/303: dwrite d1/d2c/f30 [0,4194304] 0 2024-09-19T07:24:54.905 INFO:tasks.workunit.client.0.smithi098.stdout:2/304: chown d1/d9/d26/d35/l3c 109746985 1 2024-09-19T07:24:54.906 INFO:tasks.workunit.client.0.smithi098.stdout:9/398: write d3/dc/df/d15/d2f/f5f [4142468,97371] 0 2024-09-19T07:24:54.909 INFO:tasks.workunit.client.0.smithi098.stdout:7/476: link d5/d8/d5d/f7d d5/d8/d8e/fa5 0 2024-09-19T07:24:54.909 INFO:tasks.workunit.client.0.smithi098.stdout:7/477: readlink d5/d10/d1d/l93 0 2024-09-19T07:24:54.911 INFO:tasks.workunit.client.0.smithi098.stdout:8/368: rename d0/de/d21/d3c/f57 to d0/d16/f79 0 2024-09-19T07:24:54.914 INFO:tasks.workunit.client.0.smithi098.stdout:2/305: symlink d1/d9/d26/d35/d48/d49/d61/l6c 0 2024-09-19T07:24:54.915 INFO:tasks.workunit.client.0.smithi098.stdout:7/478: getdents d5/d8/d52 0 2024-09-19T07:24:54.915 INFO:tasks.workunit.client.0.smithi098.stdout:7/479: fsync d5/d3e/d62/f65 0 2024-09-19T07:24:54.915 INFO:tasks.workunit.client.0.smithi098.stdout:5/324: dwrite f4 [0,4194304] 0 2024-09-19T07:24:54.916 INFO:tasks.workunit.client.0.smithi098.stdout:6/364: read f1 [2614778,46361] 0 2024-09-19T07:24:54.926 INFO:tasks.workunit.client.0.smithi098.stdout:4/365: sync 2024-09-19T07:24:54.926 INFO:tasks.workunit.client.0.smithi098.stdout:4/366: chown da/c25 85962 1 2024-09-19T07:24:54.926 INFO:tasks.workunit.client.0.smithi098.stdout:4/367: write da/d31/f3c [1166982,56016] 0 2024-09-19T07:24:54.927 INFO:tasks.workunit.client.0.smithi098.stdout:7/480: mknod d5/d3e/d62/da0/ca6 0 2024-09-19T07:24:54.927 INFO:tasks.workunit.client.0.smithi098.stdout:5/325: symlink dc/de/d13/d5c/l69 0 2024-09-19T07:24:54.929 INFO:tasks.workunit.client.0.smithi098.stdout:7/481: mkdir d5/d8/dc/da7 0 2024-09-19T07:24:54.929 INFO:tasks.workunit.client.0.smithi098.stdout:4/368: creat da/d31/d46/d56/d5b/d66/f7a x:0 0 0 2024-09-19T07:24:54.930 INFO:tasks.workunit.client.0.smithi098.stdout:5/326: mkdir dc/de/d13/d3b/d6a 0 2024-09-19T07:24:54.930 INFO:tasks.workunit.client.0.smithi098.stdout:5/327: readlink dc/de/d13/d46/l22 0 2024-09-19T07:24:54.933 INFO:tasks.workunit.client.0.smithi098.stdout:5/328: mknod dc/de/d36/c6b 0 2024-09-19T07:24:54.936 INFO:tasks.workunit.client.0.smithi098.stdout:5/329: mkdir dc/d6c 0 2024-09-19T07:24:54.936 INFO:tasks.workunit.client.0.smithi098.stdout:5/330: readlink dc/de/d36/l5b 0 2024-09-19T07:24:54.936 INFO:tasks.workunit.client.0.smithi098.stdout:5/331: write dc/de/d13/d46/f3e [4507834,788] 0 2024-09-19T07:24:54.936 INFO:tasks.workunit.client.0.smithi098.stdout:5/332: write dc/de/d13/f27 [343021,73873] 0 2024-09-19T07:24:54.936 INFO:tasks.workunit.client.0.smithi098.stdout:5/333: fsync dc/de/d13/d46/f24 0 2024-09-19T07:24:54.936 INFO:tasks.workunit.client.0.smithi098.stdout:6/365: getdents d2 0 2024-09-19T07:24:54.937 INFO:tasks.workunit.client.0.smithi098.stdout:6/366: dread - d2/d5/f81 zero size 2024-09-19T07:24:54.937 INFO:tasks.workunit.client.0.smithi098.stdout:5/334: mkdir dc/de/d13/d46/d2e/d37/d6d 0 2024-09-19T07:24:54.938 INFO:tasks.workunit.client.0.smithi098.stdout:6/367: mknod d2/d5/d1f/d26/d42/d48/d53/d64/d6d/c8b 0 2024-09-19T07:24:54.938 INFO:tasks.workunit.client.0.smithi098.stdout:6/368: dread - d2/d5/d1f/d26/d42/d48/d4a/f88 zero size 2024-09-19T07:24:54.938 INFO:tasks.workunit.client.0.smithi098.stdout:6/369: fdatasync d2/d11/f5c 0 2024-09-19T07:24:54.940 INFO:tasks.workunit.client.0.smithi098.stdout:6/370: unlink d2/d5/d1f/c3f 0 2024-09-19T07:24:54.942 INFO:tasks.workunit.client.0.smithi098.stdout:6/371: rename d2/d5/d1f/d26/d42/d48/f72 to d2/d5/d1f/d26/d42/d48/d53/d64/d79/f8c 0 2024-09-19T07:24:54.942 INFO:tasks.workunit.client.0.smithi098.stdout:6/372: mkdir d2/d5/d1f/d26/d42/d48/d4a/d8d 0 2024-09-19T07:24:54.945 INFO:tasks.workunit.client.0.smithi098.stdout:2/306: dwrite d1/d5/f37 [0,4194304] 0 2024-09-19T07:24:54.945 INFO:tasks.workunit.client.0.smithi098.stdout:2/307: dread - d1/d5/d34/d5a/d42/d4e/f5e zero size 2024-09-19T07:24:54.948 INFO:tasks.workunit.client.0.smithi098.stdout:8/369: dwrite d0/d1a/f3b [0,4194304] 0 2024-09-19T07:24:54.949 INFO:tasks.workunit.client.0.smithi098.stdout:2/308: symlink d1/d9/d3e/d41/d60/l6d 0 2024-09-19T07:24:54.949 INFO:tasks.workunit.client.0.smithi098.stdout:2/309: truncate d1/d9/f33 738383 0 2024-09-19T07:24:54.950 INFO:tasks.workunit.client.0.smithi098.stdout:6/373: creat d2/f8e x:0 0 0 2024-09-19T07:24:54.951 INFO:tasks.workunit.client.0.smithi098.stdout:6/374: read - d2/d5/d1f/d26/d42/d48/d4a/d4e/f7e zero size 2024-09-19T07:24:54.951 INFO:tasks.workunit.client.0.smithi098.stdout:6/375: fsync d2/f1a 0 2024-09-19T07:24:54.952 INFO:tasks.workunit.client.0.smithi098.stdout:5/335: dread dc/de/d13/d46/f26 [0,4194304] 0 2024-09-19T07:24:54.952 INFO:tasks.workunit.client.0.smithi098.stdout:6/376: rmdir d2/d5/d1f/d26/d42/d48/d53/d64 39 2024-09-19T07:24:54.952 INFO:tasks.workunit.client.0.smithi098.stdout:2/310: mkdir d1/d9/d26/d35/d48/d6e 0 2024-09-19T07:24:54.952 INFO:tasks.workunit.client.0.smithi098.stdout:2/311: chown d1/d9/d3e/d41 9840619 1 2024-09-19T07:24:54.952 INFO:tasks.workunit.client.0.smithi098.stdout:2/312: stat d1/d9/d26/d5c/l5f 0 2024-09-19T07:24:54.953 INFO:tasks.workunit.client.0.smithi098.stdout:2/313: readlink d1/d9/d3e/l1e 0 2024-09-19T07:24:54.953 INFO:tasks.workunit.client.0.smithi098.stdout:2/314: mknod d1/d5/c6f 0 2024-09-19T07:24:54.954 INFO:tasks.workunit.client.0.smithi098.stdout:6/377: mkdir d2/d1b/d8f 0 2024-09-19T07:24:54.955 INFO:tasks.workunit.client.0.smithi098.stdout:2/315: rename d1/d2c/l69 to d1/d5/l70 0 2024-09-19T07:24:54.955 INFO:tasks.workunit.client.0.smithi098.stdout:6/378: getdents d2/d5/d1f/d26/d42 0 2024-09-19T07:24:54.957 INFO:tasks.workunit.client.0.smithi098.stdout:6/379: symlink d2/d5/d1f/d26/d7b/l90 0 2024-09-19T07:24:54.958 INFO:tasks.workunit.client.0.smithi098.stdout:6/380: creat d2/d11/f91 x:0 0 0 2024-09-19T07:24:54.962 INFO:tasks.workunit.client.0.smithi098.stdout:8/370: dread d0/d1a/f3b [0,4194304] 0 2024-09-19T07:24:54.963 INFO:tasks.workunit.client.0.smithi098.stdout:8/371: mknod d0/de/d21/d50/c7a 0 2024-09-19T07:24:54.965 INFO:tasks.workunit.client.0.smithi098.stdout:3/380: dwrite de/d4e/f50 [0,4194304] 0 2024-09-19T07:24:54.965 INFO:tasks.workunit.client.0.smithi098.stdout:8/372: unlink d0/de/d21/d50/c7a 0 2024-09-19T07:24:54.967 INFO:tasks.workunit.client.0.smithi098.stdout:9/399: dwrite d3/dc/df/d15/d1a/d2b/f33 [0,4194304] 0 2024-09-19T07:24:54.967 INFO:tasks.workunit.client.0.smithi098.stdout:9/400: chown d3/d16/d38/d22 19615 1 2024-09-19T07:24:54.970 INFO:tasks.workunit.client.0.smithi098.stdout:8/373: rename d0/de/d12/d6c/c70 to d0/d1a/c7b 0 2024-09-19T07:24:54.970 INFO:tasks.workunit.client.0.smithi098.stdout:3/381: mknod de/df/d31/d61/c6e 0 2024-09-19T07:24:54.970 INFO:tasks.workunit.client.0.smithi098.stdout:3/382: fdatasync de/d4e/f50 0 2024-09-19T07:24:54.972 INFO:tasks.workunit.client.0.smithi098.stdout:7/482: dwrite d5/d10/d1d/f9a [0,4194304] 0 2024-09-19T07:24:54.974 INFO:tasks.workunit.client.0.smithi098.stdout:9/401: rmdir d3/dc/df/d15/d1a/d2b/d49 39 2024-09-19T07:24:54.975 INFO:tasks.workunit.client.0.smithi098.stdout:7/483: write d5/d8/d8e/d59/fa3 [41309,71867] 0 2024-09-19T07:24:54.979 INFO:tasks.workunit.client.0.smithi098.stdout:7/484: creat d5/fa8 x:0 0 0 2024-09-19T07:24:54.979 INFO:tasks.workunit.client.0.smithi098.stdout:7/485: write d5/d8/dc/d16/d4f/f79 [318404,16073] 0 2024-09-19T07:24:54.980 INFO:tasks.workunit.client.0.smithi098.stdout:9/402: unlink d3/dc/df/d15/d1b/f56 0 2024-09-19T07:24:54.981 INFO:tasks.workunit.client.0.smithi098.stdout:5/336: dwrite dc/de/f2c [0,4194304] 0 2024-09-19T07:24:54.981 INFO:tasks.workunit.client.0.smithi098.stdout:9/403: symlink d3/d16/d38/d22/l85 0 2024-09-19T07:24:54.992 INFO:tasks.workunit.client.0.smithi098.stdout:2/316: dwrite d1/d2c/f30 [0,4194304] 0 2024-09-19T07:24:54.994 INFO:tasks.workunit.client.0.smithi098.stdout:7/486: write d5/d10/d1d/f2a [1782504,30058] 0 2024-09-19T07:24:54.994 INFO:tasks.workunit.client.0.smithi098.stdout:7/487: write d5/d10/d50/f54 [2841447,110731] 0 2024-09-19T07:24:54.999 INFO:tasks.workunit.client.0.smithi098.stdout:2/317: creat d1/d9/d26/d35/f71 x:0 0 0 2024-09-19T07:24:54.999 INFO:tasks.workunit.client.0.smithi098.stdout:2/318: truncate d1/d5/d34/f3d 661345 0 2024-09-19T07:24:54.999 INFO:tasks.workunit.client.0.smithi098.stdout:2/319: write d1/d9/d26/d35/d58/f5b [768905,42238] 0 2024-09-19T07:24:54.999 INFO:tasks.workunit.client.0.smithi098.stdout:7/488: creat d5/d3e/d62/da0/fa9 x:0 0 0 2024-09-19T07:24:55.000 INFO:tasks.workunit.client.0.smithi098.stdout:7/489: write d5/d10/f9d [719343,55901] 0 2024-09-19T07:24:55.000 INFO:tasks.workunit.client.0.smithi098.stdout:7/490: chown d5/d8/dc/d16/f78 67261 1 2024-09-19T07:24:55.000 INFO:tasks.workunit.client.0.smithi098.stdout:7/491: fsync d5/d3e/d62/f7a 0 2024-09-19T07:24:55.001 INFO:tasks.workunit.client.0.smithi098.stdout:7/492: creat d5/d8/dc/d16/d4f/faa x:0 0 0 2024-09-19T07:24:55.002 INFO:tasks.workunit.client.0.smithi098.stdout:6/381: dwrite d2/d5/d1f/d26/d42/d48/d4a/d4e/f50 [0,4194304] 0 2024-09-19T07:24:55.003 INFO:tasks.workunit.client.0.smithi098.stdout:7/493: creat d5/d10/d11/d9e/fab x:0 0 0 2024-09-19T07:24:55.004 INFO:tasks.workunit.client.0.smithi098.stdout:7/494: symlink d5/d8/d5d/lac 0 2024-09-19T07:24:55.005 INFO:tasks.workunit.client.0.smithi098.stdout:6/382: mknod d2/d1b/c92 0 2024-09-19T07:24:55.012 INFO:tasks.workunit.client.0.smithi098.stdout:7/495: write d5/d8/d52/f60 [704398,18357] 0 2024-09-19T07:24:55.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/496: mkdir d5/d10/d50/dad 0 2024-09-19T07:24:55.015 INFO:tasks.workunit.client.0.smithi098.stdout:8/374: dwrite d0/d16/f23 [0,4194304] 0 2024-09-19T07:24:55.015 INFO:tasks.workunit.client.0.smithi098.stdout:8/375: write d0/f4e [1387849,71647] 0 2024-09-19T07:24:55.016 INFO:tasks.workunit.client.0.smithi098.stdout:7/497: mknod d5/d3e/d62/da0/cae 0 2024-09-19T07:24:55.018 INFO:tasks.workunit.client.0.smithi098.stdout:9/404: dwrite d3/dc/df/d15/d1a/d2d/f42 [0,4194304] 0 2024-09-19T07:24:55.019 INFO:tasks.workunit.client.0.smithi098.stdout:8/376: rename d0/de/d28/l36 to d0/d16/d61/l7c 0 2024-09-19T07:24:55.020 INFO:tasks.workunit.client.0.smithi098.stdout:7/498: getdents d5/d3e/d61 0 2024-09-19T07:24:55.020 INFO:tasks.workunit.client.0.smithi098.stdout:7/499: write d5/d8/f34 [4931735,12245] 0 2024-09-19T07:24:55.021 INFO:tasks.workunit.client.0.smithi098.stdout:7/500: link d5/d10/f4a d5/d8/dc/faf 0 2024-09-19T07:24:55.022 INFO:tasks.workunit.client.0.smithi098.stdout:9/405: rmdir d3/dc/df 39 2024-09-19T07:24:55.023 INFO:tasks.workunit.client.0.smithi098.stdout:7/501: mkdir d5/db0 0 2024-09-19T07:24:55.023 INFO:tasks.workunit.client.0.smithi098.stdout:7/502: read d5/d8/f34 [2381164,124148] 0 2024-09-19T07:24:55.023 INFO:tasks.workunit.client.0.smithi098.stdout:7/503: chown d5/d8/dc/d16 5 1 2024-09-19T07:24:55.024 INFO:tasks.workunit.client.0.smithi098.stdout:7/504: creat d5/d3e/d62/fb1 x:0 0 0 2024-09-19T07:24:55.026 INFO:tasks.workunit.client.0.smithi098.stdout:3/383: dwrite de/df/d31/d61/f4c [0,4194304] 0 2024-09-19T07:24:55.026 INFO:tasks.workunit.client.0.smithi098.stdout:3/384: truncate de/f1d 407511 0 2024-09-19T07:24:55.026 INFO:tasks.workunit.client.0.smithi098.stdout:3/385: fdatasync de/f26 0 2024-09-19T07:24:55.028 INFO:tasks.workunit.client.0.smithi098.stdout:3/386: creat de/df/d31/d61/d3f/f6f x:0 0 0 2024-09-19T07:24:55.030 INFO:tasks.workunit.client.0.smithi098.stdout:3/387: symlink de/df/d31/d61/d3f/l70 0 2024-09-19T07:24:55.030 INFO:tasks.workunit.client.0.smithi098.stdout:3/388: readlink de/df/d31/l3b 0 2024-09-19T07:24:55.032 INFO:tasks.workunit.client.0.smithi098.stdout:3/389: mkdir de/d4e/d6d/d71 0 2024-09-19T07:24:55.033 INFO:tasks.workunit.client.0.smithi098.stdout:1/487: sync 2024-09-19T07:24:55.033 INFO:tasks.workunit.client.0.smithi098.stdout:1/488: chown l2 0 1 2024-09-19T07:24:55.033 INFO:tasks.workunit.client.0.smithi098.stdout:1/489: chown dc/de/d37/f48 265927824 1 2024-09-19T07:24:55.036 INFO:tasks.workunit.client.0.smithi098.stdout:5/337: dwrite dc/de/d13/f21 [0,4194304] 0 2024-09-19T07:24:55.036 INFO:tasks.workunit.client.0.smithi098.stdout:5/338: chown dc/de/d13/d46/f5a 833 1 2024-09-19T07:24:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.036+0000 7f311f2af640 1 -- 172.21.15.98:0/2645649137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118107b70 msgr2=0x7f3118107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.036+0000 7f311f2af640 1 --2- 172.21.15.98:0/2645649137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118107b70 0x7f3118107f50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3114009930 tx=0x7f311402a460 comp rx=0 tx=0).stop 2024-09-19T07:24:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.036+0000 7f311f2af640 1 -- 172.21.15.98:0/2645649137 shutdown_connections 2024-09-19T07:24:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.036+0000 7f311f2af640 1 --2- 172.21.15.98:0/2645649137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3118102470 0x7f311810e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.036+0000 7f311f2af640 1 --2- 172.21.15.98:0/2645649137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3118101ad0 0x7f3118101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.036+0000 7f311f2af640 1 --2- 172.21.15.98:0/2645649137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118107b70 0x7f3118107f50 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.036+0000 7f311f2af640 1 -- 172.21.15.98:0/2645649137 >> 172.21.15.98:0/2645649137 conn(0x7f31180fd7b0 msgr2=0x7f31180ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.036+0000 7f311f2af640 1 -- 172.21.15.98:0/2645649137 shutdown_connections 2024-09-19T07:24:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.036+0000 7f311f2af640 1 -- 172.21.15.98:0/2645649137 wait complete. 2024-09-19T07:24:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.037+0000 7f311f2af640 1 Processor -- start 2024-09-19T07:24:55.039 INFO:tasks.workunit.client.0.smithi098.stdout:2/320: dwrite d1/d9/d1d/f4a [0,4194304] 0 2024-09-19T07:24:55.039 INFO:tasks.workunit.client.0.smithi098.stdout:9/406: dread d3/dc/df/d15/d2f/f5f [0,4194304] 0 2024-09-19T07:24:55.039 INFO:tasks.workunit.client.0.smithi098.stdout:6/383: dwrite d2/d5/d1f/d26/d42/d48/f63 [0,4194304] 0 2024-09-19T07:24:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.037+0000 7f311f2af640 1 -- start start 2024-09-19T07:24:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.037+0000 7f311f2af640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118101ad0 0x7f31181983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.037+0000 7f311f2af640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3118102470 0x7f31181988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.037+0000 7f311f2af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3118107b70 0x7f311819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.037+0000 7f311f2af640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3118111f70 con 0x7f3118101ad0 2024-09-19T07:24:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.037+0000 7f311f2af640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3118111df0 con 0x7f3118102470 2024-09-19T07:24:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.037+0000 7f311f2af640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31181120f0 con 0x7f3118107b70 2024-09-19T07:24:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f311d04b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118101ad0 0x7f31181983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f311d04b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118101ad0 0x7f31181983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46710/0 (socket says 172.21.15.98:46710) 2024-09-19T07:24:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f311d04b640 1 -- 172.21.15.98:0/2755388818 learned_addr learned my addr 172.21.15.98:0/2755388818 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f311d84c640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3118107b70 0x7f311819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f311d04b640 1 -- 172.21.15.98:0/2755388818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3118107b70 msgr2=0x7f311819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f311d04b640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3118107b70 0x7f311819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f311d04b640 1 -- 172.21.15.98:0/2755388818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3118102470 msgr2=0x7f31181988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f311d04b640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3118102470 0x7f31181988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.043 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f311d04b640 1 -- 172.21.15.98:0/2755388818 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311819d390 con 0x7f3118101ad0 2024-09-19T07:24:55.044 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f311d04b640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118101ad0 0x7f31181983a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f311402a9d0 tx=0x7f3114003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:55.044 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f310e7fc640 1 -- 172.21.15.98:0/2755388818 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311403f070 con 0x7f3118101ad0 2024-09-19T07:24:55.044 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f310e7fc640 1 -- 172.21.15.98:0/2755388818 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3114031c90 con 0x7f3118101ad0 2024-09-19T07:24:55.044 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f311f2af640 1 -- 172.21.15.98:0/2755388818 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311819d620 con 0x7f3118101ad0 2024-09-19T07:24:55.044 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.038+0000 7f310e7fc640 1 -- 172.21.15.98:0/2755388818 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114035030 con 0x7f3118101ad0 2024-09-19T07:24:55.044 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.039+0000 7f311f2af640 1 -- 172.21.15.98:0/2755388818 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31181a4f10 con 0x7f3118101ad0 2024-09-19T07:24:55.047 INFO:tasks.workunit.client.0.smithi098.stdout:3/390: mkdir de/df/d1f/d72 0 2024-09-19T07:24:55.047 INFO:tasks.workunit.client.0.smithi098.stdout:3/391: stat de/c58 0 2024-09-19T07:24:55.047 INFO:tasks.workunit.client.0.smithi098.stdout:6/384: symlink d2/d5/d1f/l93 0 2024-09-19T07:24:55.048 INFO:tasks.workunit.client.0.smithi098.stdout:6/385: write d2/d5/d1f/d26/d42/d48/f70 [64843,94445] 0 2024-09-19T07:24:55.048 INFO:tasks.workunit.client.0.smithi098.stdout:6/386: mkdir d2/d5/d8a/d94 0 2024-09-19T07:24:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.043+0000 7f312203e740 1 Processor -- start 2024-09-19T07:24:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.043+0000 7f312203e740 1 -- start start 2024-09-19T07:24:55.050 INFO:tasks.workunit.client.0.smithi098.stdout:5/339: dread dc/de/d36/f3d [0,4194304] 0 2024-09-19T07:24:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.044+0000 7f312203e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd1204e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.044+0000 7f312203e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12058b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.044+0000 7f312203e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 0x55fd1205b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.051 INFO:tasks.workunit.client.0.smithi098.stdout:5/340: write dc/de/d36/f3d [1528081,11115] 0 2024-09-19T07:24:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.044+0000 7f312203e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fd11fae2f0 con 0x55fd1204e820 2024-09-19T07:24:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.044+0000 7f312203e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fd11f56270 con 0x55fd120590c0 2024-09-19T07:24:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.044+0000 7f312203e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fd11faa2b0 con 0x55fd1204df00 2024-09-19T07:24:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.045+0000 7f310e7fc640 1 -- 172.21.15.98:0/2755388818 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3114042070 con 0x7f3118101ad0 2024-09-19T07:24:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.045+0000 7f311d84c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd1204e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.045+0000 7f311d84c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd1204e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:60034/0 (socket says 172.21.15.98:60034) 2024-09-19T07:24:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.045+0000 7f311d84c640 1 -- 172.21.15.98:0/1793580694 learned_addr learned my addr 172.21.15.98:0/1793580694 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.045+0000 7f311d04b640 1 --2- 172.21.15.98:0/1793580694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12058b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.045+0000 7f311c84a640 1 --2- 172.21.15.98:0/1793580694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 0x55fd1205b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.045+0000 7f311d04b640 1 -- 172.21.15.98:0/1793580694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 msgr2=0x55fd1204e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.045+0000 7f311d04b640 1 --2- 172.21.15.98:0/1793580694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd1204e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.045+0000 7f311d04b640 1 -- 172.21.15.98:0/1793580694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 msgr2=0x55fd1205b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.045+0000 7f311d04b640 1 --2- 172.21.15.98:0/1793580694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 0x55fd1205b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.045+0000 7f311d04b640 1 -- 172.21.15.98:0/1793580694 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd11f55340 con 0x55fd1204e820 2024-09-19T07:24:55.054 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.045+0000 7f311c84a640 1 --2- 172.21.15.98:0/1793580694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 0x55fd1205b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:55.055 INFO:tasks.workunit.client.0.smithi098.stdout:3/392: read f4 [1303387,32867] 0 2024-09-19T07:24:55.055 INFO:tasks.workunit.client.0.smithi098.stdout:1/490: write dc/d17/d1b/d1d/f3f [950816,39118] 0 2024-09-19T07:24:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.046+0000 7f310e7fc640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f31040a34b0 0x7f31040a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.046+0000 7f311d04b640 1 --2- 172.21.15.98:0/1793580694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12058b80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f31140edcb0 tx=0x7f31140f6cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19142a52117c8d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.046+0000 7f311d84c640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f31040a34b0 0x7f31040a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.046+0000 7f310e7fc640 1 -- 172.21.15.98:0/2755388818 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f31140f0590 con 0x7f3118101ad0 2024-09-19T07:24:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.046+0000 7f31037fe640 1 -- 172.21.15.98:0/1793580694 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31140b8ae0 con 0x55fd1204e820 2024-09-19T07:24:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.046+0000 7f31037fe640 1 -- 172.21.15.98:0/1793580694 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3114031e40 con 0x55fd1204e820 2024-09-19T07:24:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.046+0000 7f31037fe640 1 -- 172.21.15.98:0/1793580694 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31140bc1a0 con 0x55fd1204e820 2024-09-19T07:24:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.047+0000 7f312203e740 1 -- 172.21.15.98:0/1793580694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 msgr2=0x55fd12058b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.047+0000 7f312203e740 1 --2- 172.21.15.98:0/1793580694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12058b80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f31140edcb0 tx=0x7f31140f6cd0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.047+0000 7f311d84c640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f31040a34b0 0x7f31040a5970 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3110009440 tx=0x7f311000d040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.047+0000 7f312203e740 1 -- 172.21.15.98:0/1793580694 shutdown_connections 2024-09-19T07:24:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.047+0000 7f312203e740 1 --2- 172.21.15.98:0/1793580694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 0x55fd1205b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.047+0000 7f312203e740 1 --2- 172.21.15.98:0/1793580694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12058b80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.047+0000 7f312203e740 1 --2- 172.21.15.98:0/1793580694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd1204e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.047+0000 7f312203e740 1 -- 172.21.15.98:0/1793580694 >> 172.21.15.98:0/1793580694 conn(0x55fd1204a470 msgr2=0x55fd1204a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.047+0000 7f312203e740 1 -- 172.21.15.98:0/1793580694 shutdown_connections 2024-09-19T07:24:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.047+0000 7f312203e740 1 -- 172.21.15.98:0/1793580694 wait complete. 2024-09-19T07:24:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f312203e740 1 -- start start 2024-09-19T07:24:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f312203e740 1 Processor -- start 2024-09-19T07:24:55.062 INFO:tasks.workunit.client.0.smithi098.stdout:6/387: unlink d2/d5/d1f/l27 0 2024-09-19T07:24:55.062 INFO:tasks.workunit.client.0.smithi098.stdout:6/388: write d2/d1b/f57 [559047,27394] 0 2024-09-19T07:24:55.064 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f312203e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd12055f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.064 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f312203e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12056490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.064 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f312203e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 0x55fd120569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.064 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f312203e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fd1205ba50 con 0x55fd1204e820 2024-09-19T07:24:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f312203e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fd11f37290 con 0x55fd120590c0 2024-09-19T07:24:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f312203e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55fd1205bbd0 con 0x55fd1204df00 2024-09-19T07:24:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f312203e740 10 client.0 _ll_register_callbacks cb 0x55fd11f68140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f311c84a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12056490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f311c84a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12056490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46738/0 (socket says 172.21.15.98:46738) 2024-09-19T07:24:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f311c84a640 1 -- 172.21.15.98:0/1057006808 learned_addr learned my addr 172.21.15.98:0/1057006808 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.048+0000 7f311d04b640 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd12055f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f311c84a640 1 -- 172.21.15.98:0/1057006808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 msgr2=0x55fd12055f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f311c84a640 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd12055f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f311c84a640 1 -- 172.21.15.98:0/1057006808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 msgr2=0x55fd120569d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:24:55.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f311c84a640 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 0x55fd120569d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f311c84a640 1 -- 172.21.15.98:0/1057006808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd11cc1210 con 0x55fd1204e820 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f311d04b640 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd12055f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f311c84a640 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12056490 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f310800be60 tx=0x7f310800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214c4e8dac41c2db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f3100ff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f3100ff9640 1 -- 172.21.15.98:0/1057006808 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108015070 con 0x55fd1204e820 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f3100ff9640 1 -- 172.21.15.98:0/1057006808 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f3108011850 con 0x55fd1204e820 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f312203e740 1 -- 172.21.15.98:0/1057006808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd11fbba20 con 0x55fd1204e820 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f3100ff9640 1 -- 172.21.15.98:0/1057006808 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3108011a50 con 0x55fd1204e820 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f312203e740 10 client.16215 fetch_fsmap learned FSMap version 28 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f312203e740 1 -- 172.21.15.98:0/1057006808 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd11d8d620 con 0x55fd1204e820 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f3100ff9640 1 -- 172.21.15.98:0/1057006808 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55fd11fbba20 con 0x55fd1204e820 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f3100ff9640 1 -- 172.21.15.98:0/1057006808 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f3108021070 con 0x55fd1204e820 2024-09-19T07:24:55.066 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f312203e740 10 client.16215 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T07:24:55.067 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.049+0000 7f312203e740 10 client.16215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:55.067 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.050+0000 7f312203e740 20 client.16215 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:55.067 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.050+0000 7f312203e740 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55fd12068de0 0x55fd1206b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.067 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.050+0000 7f312203e740 4 client.16215 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:24:55.067 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.050+0000 7f312203e740 1 -- 172.21.15.98:0/1057006808 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd11fb5d70 con 0x55fd12068de0 2024-09-19T07:24:55.067 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.050+0000 7f311d04b640 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55fd12068de0 0x55fd1206b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.067 INFO:tasks.workunit.client.0.smithi098.stdout:6/389: creat d2/d1b/d8f/f95 x:0 0 0 2024-09-19T07:24:55.068 INFO:tasks.workunit.client.0.smithi098.stdout:2/321: mkdir d1/d5/d72 0 2024-09-19T07:24:55.068 INFO:tasks.workunit.client.0.smithi098.stdout:2/322: fdatasync d1/d2c/f44 0 2024-09-19T07:24:55.068 INFO:tasks.workunit.client.0.smithi098.stdout:2/323: dread - d1/d9/d26/f59 zero size 2024-09-19T07:24:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.050+0000 7f3100ff9640 10 client.16215 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:55.068 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.050+0000 7f311d04b640 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55fd12068de0 0x55fd1206b260 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c48015b85839c34 server_cookie=870f8022f90f4933 in_seq=0 out_seq=0 2024-09-19T07:24:55.068 INFO:tasks.workunit.client.0.smithi098.stdout:6/390: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/l96 0 2024-09-19T07:24:55.069 INFO:tasks.workunit.client.0.smithi098.stdout:6/391: chown d2/d5/d1f/d26/d7b/l7f 35 1 2024-09-19T07:24:55.069 INFO:tasks.workunit.client.0.smithi098.stdout:9/407: truncate d3/d16/d38/f26 974830 0 2024-09-19T07:24:55.070 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.053+0000 7f3100ff9640 1 -- 172.21.15.98:0/1057006808 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd11fb5d70 con 0x55fd12068de0 2024-09-19T07:24:55.070 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.053+0000 7f3100ff9640 10 client.16215 handle_command_reply: tid=0 2024-09-19T07:24:55.070 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f312203e740 1 client.16215 shutdown 2024-09-19T07:24:55.070 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f312203e740 1 -- 172.21.15.98:0/1057006808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 msgr2=0x55fd12056490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.070 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f312203e740 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12056490 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f310800be60 tx=0x7f310800f730 comp rx=0 tx=0).stop 2024-09-19T07:24:55.070 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f312203e740 1 -- 172.21.15.98:0/1057006808 shutdown_connections 2024-09-19T07:24:55.070 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f312203e740 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 0x55fd120569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.071 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f312203e740 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55fd12068de0 0x55fd1206b260 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.071 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f312203e740 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12056490 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.071 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f312203e740 1 --2- 172.21.15.98:0/1057006808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd12055f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.071 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f3100ff9640 0 client.16215 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:55.071 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f312203e740 1 -- 172.21.15.98:0/1057006808 >> 172.21.15.98:0/1057006808 conn(0x55fd1204a470 msgr2=0x55fd12050180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:55.071 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f312203e740 1 -- 172.21.15.98:0/1057006808 shutdown_connections 2024-09-19T07:24:55.071 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f312203e740 1 -- 172.21.15.98:0/1057006808 wait complete. 2024-09-19T07:24:55.072 INFO:tasks.workunit.client.0.smithi098.stdout:3/393: creat de/d4e/d6d/d71/f73 x:0 0 0 2024-09-19T07:24:55.072 INFO:tasks.workunit.client.0.smithi098.stdout:3/394: chown de/df/d1f/l30 269851 1 2024-09-19T07:24:55.072 INFO:tasks.workunit.client.0.smithi098.stdout:3/395: chown de/df/d31/f3d 7852902 1 2024-09-19T07:24:55.072 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.054+0000 7f312203e740 20 client.16215 trim_cache size 0 max 16384 2024-09-19T07:24:55.074 INFO:tasks.workunit.client.0.smithi098.stdout:6/392: rmdir d2/d5/d1f/d26/d42 39 2024-09-19T07:24:55.074 INFO:tasks.workunit.client.0.smithi098.stdout:6/393: truncate d2/f58 8742809 0 2024-09-19T07:24:55.074 INFO:tasks.workunit.client.0.smithi098.stdout:8/377: dwrite d0/f4e [0,4194304] 0 2024-09-19T07:24:55.074 INFO:tasks.workunit.client.0.smithi098.stdout:1/491: link dc/d17/d1b/l5e dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/lac 0 2024-09-19T07:24:55.074 INFO:tasks.workunit.client.0.smithi098.stdout:7/505: dwrite d5/d3e/d62/f65 [0,4194304] 0 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:9/408: mknod d3/d6/d8/c86 0 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:3/396: rename de/df/d31/c6b to de/df/d16/c74 0 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:8/378: mkdir d0/d16/d7d 0 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:2/324: dread d1/d9/d26/d35/d58/f1a [0,4194304] 0 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:9/409: creat d3/dc/df/f87 x:0 0 0 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:4/369: sync 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:0/465: sync 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:0/466: fsync d5/d6b/f83 0 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:0/467: read d5/d20/d14/f32 [2158527,6450] 0 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:3/397: symlink de/df/d31/d61/d3f/l75 0 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:8/379: creat d0/f7e x:0 0 0 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:8/380: read - d0/de/d28/d40/f76 zero size 2024-09-19T07:24:55.075 INFO:tasks.workunit.client.0.smithi098.stdout:4/370: mknod da/d59/d5d/c7b 0 2024-09-19T07:24:55.076 INFO:tasks.workunit.client.0.smithi098.stdout:2/325: link d1/d9/d26/c3a d1/d9/d3e/d41/c73 0 2024-09-19T07:24:55.076 INFO:tasks.workunit.client.0.smithi098.stdout:7/506: link d5/d10/d1d/f51 d5/d8/dc/fb2 0 2024-09-19T07:24:55.076 INFO:tasks.workunit.client.0.smithi098.stdout:0/468: creat d5/d20/d14/f8e x:0 0 0 2024-09-19T07:24:55.076 INFO:tasks.workunit.client.0.smithi098.stdout:9/410: write d3/dc/df/d15/d1a/d2b/d49/d65/f7c [187722,45696] 0 2024-09-19T07:24:55.076 INFO:tasks.workunit.client.0.smithi098.stdout:8/381: creat d0/d16/d65/f7f x:0 0 0 2024-09-19T07:24:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.075+0000 7f312203e740 1 Processor -- start 2024-09-19T07:24:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f312203e740 1 -- start start 2024-09-19T07:24:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f312203e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd12057ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f312203e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f312203e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 0x55fd120710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f312203e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f31181ae040 con 0x55fd1204e820 2024-09-19T07:24:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f312203e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f31181ab8e0 con 0x55fd120590c0 2024-09-19T07:24:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f312203e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31181a9750 con 0x55fd1204df00 2024-09-19T07:24:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f311c84a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f311c84a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46750/0 (socket says 172.21.15.98:46750) 2024-09-19T07:24:55.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f311c84a640 1 -- 172.21.15.98:0/402764192 learned_addr learned my addr 172.21.15.98:0/402764192 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f311c84a640 1 -- 172.21.15.98:0/402764192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 msgr2=0x55fd12057ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:24:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f311c84a640 1 --2- 172.21.15.98:0/402764192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd12057ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f311c84a640 1 -- 172.21.15.98:0/402764192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 msgr2=0x55fd120710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:24:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f311c84a640 1 --2- 172.21.15.98:0/402764192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 0x55fd120710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.076+0000 7f311c84a640 1 -- 172.21.15.98:0/402764192 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd12058aa0 con 0x55fd1204e820 2024-09-19T07:24:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.077+0000 7f311c84a640 1 --2- 172.21.15.98:0/402764192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12070b70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f310800fc30 tx=0x7f3108004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738c4dc5325c4a5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.077+0000 7f3102ffd640 1 -- 172.21.15.98:0/402764192 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108015070 con 0x55fd1204e820 2024-09-19T07:24:55.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.077+0000 7f3102ffd640 1 -- 172.21.15.98:0/402764192 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3108030070 con 0x55fd1204e820 2024-09-19T07:24:55.080 INFO:tasks.workunit.client.0.smithi098.stdout:9/411: read d3/dc/f19 [2430615,32238] 0 2024-09-19T07:24:55.080 INFO:tasks.workunit.client.0.smithi098.stdout:2/326: creat d1/d9/d26/d35/d48/d49/f74 x:0 0 0 2024-09-19T07:24:55.080 INFO:tasks.workunit.client.0.smithi098.stdout:9/412: chown d3/d6/d46/d83 27990 1 2024-09-19T07:24:55.080 INFO:tasks.workunit.client.0.smithi098.stdout:9/413: stat d3/d30/l69 0 2024-09-19T07:24:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.077+0000 7f3102ffd640 1 -- 172.21.15.98:0/402764192 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3108027040 con 0x55fd1204e820 2024-09-19T07:24:55.081 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.078+0000 7f312203e740 1 -- 172.21.15.98:0/402764192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 msgr2=0x55fd12070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.078+0000 7f312203e740 1 --2- 172.21.15.98:0/402764192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12070b70 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f310800fc30 tx=0x7f3108004620 comp rx=0 tx=0).stop 2024-09-19T07:24:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.078+0000 7f312203e740 1 -- 172.21.15.98:0/402764192 shutdown_connections 2024-09-19T07:24:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.078+0000 7f312203e740 1 --2- 172.21.15.98:0/402764192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd120590c0 0x55fd120710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.078+0000 7f312203e740 1 --2- 172.21.15.98:0/402764192 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd1204e820 0x55fd12070b70 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.078+0000 7f312203e740 1 --2- 172.21.15.98:0/402764192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd12057ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.078+0000 7f312203e740 1 -- 172.21.15.98:0/402764192 >> 172.21.15.98:0/402764192 conn(0x55fd1204a470 msgr2=0x55fd120577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.078+0000 7f312203e740 1 -- 172.21.15.98:0/402764192 shutdown_connections 2024-09-19T07:24:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.078+0000 7f312203e740 1 -- 172.21.15.98:0/402764192 wait complete. 2024-09-19T07:24:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.078+0000 7f312203e740 1 -- start start 2024-09-19T07:24:55.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.078+0000 7f312203e740 1 Processor -- start 2024-09-19T07:24:55.083 INFO:tasks.workunit.client.0.smithi098.stdout:7/507: rename d5/d8/dc/d16/f5a to d5/d10/d11/fb3 0 2024-09-19T07:24:55.083 INFO:tasks.workunit.client.0.smithi098.stdout:7/508: stat d5/d8/d5d/f7d 0 2024-09-19T07:24:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f312203e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd12061010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f312203e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd1204e820 0x55fd12061550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f312203e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd120590c0 0x55fd1205ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f312203e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f31181a9da0 con 0x55fd120590c0 2024-09-19T07:24:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f312203e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f31181ab210 con 0x55fd1204e820 2024-09-19T07:24:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f312203e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31181aa470 con 0x55fd1204df00 2024-09-19T07:24:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f312203e740 10 client.0 _ll_register_callbacks cb 0x7f310800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:24:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f311d84c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd120590c0 0x55fd1205ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f311d84c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd120590c0 0x55fd1205ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46754/0 (socket says 172.21.15.98:46754) 2024-09-19T07:24:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f311d84c640 1 -- 172.21.15.98:0/2811435990 learned_addr learned my addr 172.21.15.98:0/2811435990 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:24:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f311d84c640 1 -- 172.21.15.98:0/2811435990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 msgr2=0x55fd12061010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:24:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f311d84c640 1 --2- 172.21.15.98:0/2811435990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd12061010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f311d84c640 1 -- 172.21.15.98:0/2811435990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd1204e820 msgr2=0x55fd12061550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:24:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f311d84c640 1 --2- 172.21.15.98:0/2811435990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd1204e820 0x55fd12061550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f311d84c640 1 -- 172.21.15.98:0/2811435990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd1205e530 con 0x55fd120590c0 2024-09-19T07:24:55.085 INFO:tasks.workunit.client.0.smithi098.stdout:0/469: creat d5/f8f x:0 0 0 2024-09-19T07:24:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f311d84c640 1 --2- 172.21.15.98:0/2811435990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd120590c0 0x55fd1205ddf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3110009410 tx=0x7f3110009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94daceb77f0a0bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:24:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f3100ff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:24:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.079+0000 7f3100ff9640 1 -- 172.21.15.98:0/2811435990 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110027060 con 0x55fd120590c0 2024-09-19T07:24:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f3100ff9640 1 -- 172.21.15.98:0/2811435990 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f3110018cf0 con 0x55fd120590c0 2024-09-19T07:24:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f312203e740 1 -- 172.21.15.98:0/2811435990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3108030070 con 0x55fd120590c0 2024-09-19T07:24:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f3100ff9640 1 -- 172.21.15.98:0/2811435990 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f311002b440 con 0x55fd120590c0 2024-09-19T07:24:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f312203e740 10 client.16221 fetch_fsmap learned FSMap version 28 2024-09-19T07:24:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f312203e740 1 -- 172.21.15.98:0/2811435990 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd120d4600 con 0x55fd120590c0 2024-09-19T07:24:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f3100ff9640 1 -- 172.21.15.98:0/2811435990 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3108030070 con 0x55fd120590c0 2024-09-19T07:24:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f3100ff9640 1 -- 172.21.15.98:0/2811435990 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 28) ==== 8358+0+0 (secure 0 0 0) 0x7f3110016460 con 0x55fd120590c0 2024-09-19T07:24:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f312203e740 10 client.16221 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T07:24:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f312203e740 10 client.16221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:24:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f312203e740 20 client.16221 populate_metadata read hostname 'smithi098' 2024-09-19T07:24:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f312203e740 1 --2- 172.21.15.98:0/2811435990 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55fd120d4e40 0x55fd120d7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:24:55.088 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f312203e740 4 client.16221 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:24:55.089 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.080+0000 7f312203e740 1 -- 172.21.15.98:0/2811435990 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fd11f32900 con 0x55fd120d4e40 2024-09-19T07:24:55.089 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.081+0000 7f311d04b640 1 --2- 172.21.15.98:0/2811435990 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55fd120d4e40 0x55fd120d7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:24:55.089 INFO:tasks.workunit.client.0.smithi098.stdout:2/327: creat d1/d5/d34/d39/f75 x:0 0 0 2024-09-19T07:24:55.089 INFO:tasks.workunit.client.0.smithi098.stdout:9/414: creat d3/d30/f88 x:0 0 0 2024-09-19T07:24:55.089 INFO:tasks.workunit.client.0.smithi098.stdout:7/509: creat d5/d8/dc/d16/fb4 x:0 0 0 2024-09-19T07:24:55.089 INFO:tasks.workunit.client.0.smithi098.stdout:7/510: readlink d5/d10/d1d/l93 0 2024-09-19T07:24:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.084+0000 7f3100ff9640 10 client.16221 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.084+0000 7f311d04b640 1 --2- 172.21.15.98:0/2811435990 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55fd120d4e40 0x55fd120d7260 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f9a208f813840a4 server_cookie=17d06d4a8a2d111d in_seq=0 out_seq=0 2024-09-19T07:24:55.091 INFO:tasks.workunit.client.0.smithi098.stdout:0/470: rename d5/d20/d1f/d52/f86 to d5/d20/d1f/d47/f90 0 2024-09-19T07:24:55.091 INFO:tasks.workunit.client.0.smithi098.stdout:0/471: read d5/d20/d14/f35 [649829,48926] 0 2024-09-19T07:24:55.091 INFO:tasks.workunit.client.0.smithi098.stdout:7/511: creat d5/d10/d50/fb5 x:0 0 0 2024-09-19T07:24:55.091 INFO:tasks.workunit.client.0.smithi098.stdout:0/472: mknod d5/d20/d1f/d52/c91 0 2024-09-19T07:24:55.091 INFO:tasks.workunit.client.0.smithi098.stdout:0/473: fsync d5/d20/d14/d49/f65 0 2024-09-19T07:24:55.091 INFO:tasks.workunit.client.0.smithi098.stdout:5/341: dwrite dc/de/f2c [0,4194304] 0 2024-09-19T07:24:55.092 INFO:tasks.workunit.client.0.smithi098.stdout:7/512: mkdir d5/d8/d52/db6 0 2024-09-19T07:24:55.092 INFO:tasks.workunit.client.0.smithi098.stdout:7/513: chown d5/l33 77101 1 2024-09-19T07:24:55.092 INFO:tasks.workunit.client.0.smithi098.stdout:5/342: fdatasync dc/de/f3f 0 2024-09-19T07:24:55.092 INFO:tasks.workunit.client.0.smithi098.stdout:7/514: creat d5/d8/dc/d16/fb7 x:0 0 0 2024-09-19T07:24:55.092 INFO:tasks.workunit.client.0.smithi098.stdout:5/343: mknod dc/de/d13/d46/d23/d5e/c6e 0 2024-09-19T07:24:55.092 INFO:tasks.workunit.client.0.smithi098.stdout:8/382: write d0/f5 [911476,128535] 0 2024-09-19T07:24:55.093 INFO:tasks.workunit.client.0.smithi098.stdout:7/515: creat d5/d10/d11/fb8 x:0 0 0 2024-09-19T07:24:55.093 INFO:tasks.workunit.client.0.smithi098.stdout:6/394: dwrite d2/f3e [0,4194304] 0 2024-09-19T07:24:55.097 INFO:tasks.workunit.client.0.smithi098.stdout:5/344: mknod dc/de/d13/d3b/c6f 0 2024-09-19T07:24:55.097 INFO:tasks.workunit.client.0.smithi098.stdout:5/345: truncate dc/f54 208415 0 2024-09-19T07:24:55.097 INFO:tasks.workunit.client.0.smithi098.stdout:2/328: read d1/d9/f2a [2243941,80287] 0 2024-09-19T07:24:55.097 INFO:tasks.workunit.client.0.smithi098.stdout:2/329: stat d1/d5 0 2024-09-19T07:24:55.097 INFO:tasks.workunit.client.0.smithi098.stdout:6/395: dread d2/d5/d1f/d26/d42/d48/d53/d64/d6d/f82 [0,4194304] 0 2024-09-19T07:24:55.097 INFO:tasks.workunit.client.0.smithi098.stdout:5/346: unlink dc/de/d13/d3b/c6f 0 2024-09-19T07:24:55.097 INFO:tasks.workunit.client.0.smithi098.stdout:3/398: dwrite de/df/d31/f5b [0,4194304] 0 2024-09-19T07:24:55.097 INFO:tasks.workunit.client.0.smithi098.stdout:3/399: fdatasync de/d4e/d6d/d71/f73 0 2024-09-19T07:24:55.097 INFO:tasks.workunit.client.0.smithi098.stdout:3/400: write de/df/f29 [1172245,129779] 0 2024-09-19T07:24:55.097 INFO:tasks.workunit.client.0.smithi098.stdout:3/401: write de/f2f [1026772,75653] 0 2024-09-19T07:24:55.098 INFO:tasks.workunit.client.0.smithi098.stdout:3/402: truncate de/df/d1f/d2b/f57 2706486 0 2024-09-19T07:24:55.098 INFO:tasks.workunit.client.0.smithi098.stdout:2/330: read d1/d2c/f44 [961838,74024] 0 2024-09-19T07:24:55.117 INFO:tasks.workunit.client.0.smithi098.stdout:7/516: dread d5/d3e/d62/da0/f88 [0,4194304] 0 2024-09-19T07:24:55.118 INFO:tasks.workunit.client.0.smithi098.stdout:6/396: dread d2/d5/d1f/d26/d42/d48/d4a/d4e/f65 [0,4194304] 0 2024-09-19T07:24:55.120 INFO:tasks.workunit.client.0.smithi098.stdout:6/397: symlink d2/d5/d8a/l97 0 2024-09-19T07:24:55.120 INFO:tasks.workunit.client.0.smithi098.stdout:8/383: dwrite d0/f7 [0,4194304] 0 2024-09-19T07:24:55.121 INFO:tasks.workunit.client.0.smithi098.stdout:5/347: dread dc/de/f4d [0,4194304] 0 2024-09-19T07:24:55.121 INFO:tasks.workunit.client.0.smithi098.stdout:5/348: fdatasync f1 0 2024-09-19T07:24:55.121 INFO:tasks.workunit.client.0.smithi098.stdout:5/349: truncate dc/de/d13/d46/f5a 890845 0 2024-09-19T07:24:55.121 INFO:tasks.workunit.client.0.smithi098.stdout:5/350: truncate dc/de/f4d 5152521 0 2024-09-19T07:24:55.121 INFO:tasks.workunit.client.0.smithi098.stdout:5/351: fsync f4 0 2024-09-19T07:24:55.121 INFO:tasks.workunit.client.0.smithi098.stdout:0/474: dwrite d5/d20/f4e [4194304,4194304] 0 2024-09-19T07:24:55.123 INFO:tasks.workunit.client.0.smithi098.stdout:6/398: mkdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98 0 2024-09-19T07:24:55.123 INFO:tasks.workunit.client.0.smithi098.stdout:3/403: dread de/f19 [0,4194304] 0 2024-09-19T07:24:55.123 INFO:tasks.workunit.client.0.smithi098.stdout:0/475: mkdir d5/d20/d1f/d52/d64/d77/d79/d92 0 2024-09-19T07:24:55.124 INFO:tasks.workunit.client.0.smithi098.stdout:0/476: dread - d5/d20/d14/d49/f65 zero size 2024-09-19T07:24:55.124 INFO:tasks.workunit.client.0.smithi098.stdout:5/352: symlink dc/de/l70 0 2024-09-19T07:24:55.124 INFO:tasks.workunit.client.0.smithi098.stdout:6/399: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/f99 x:0 0 0 2024-09-19T07:24:55.124 INFO:tasks.workunit.client.0.smithi098.stdout:9/415: dwrite d3/d16/d38/f4f [0,4194304] 0 2024-09-19T07:24:55.124 INFO:tasks.workunit.client.0.smithi098.stdout:9/416: fdatasync d3/dc/df/f4e 0 2024-09-19T07:24:55.124 INFO:tasks.workunit.client.0.smithi098.stdout:3/404: unlink de/df/d31/d61/d3f/l75 0 2024-09-19T07:24:55.124 INFO:tasks.workunit.client.0.smithi098.stdout:6/400: mknod d2/d11/c9a 0 2024-09-19T07:24:55.125 INFO:tasks.workunit.client.0.smithi098.stdout:2/331: write d1/f57 [1859659,4319] 0 2024-09-19T07:24:55.125 INFO:tasks.workunit.client.0.smithi098.stdout:0/477: symlink d5/d20/d1f/d47/l93 0 2024-09-19T07:24:55.125 INFO:tasks.workunit.client.0.smithi098.stdout:6/401: truncate d2/d5/d1f/d26/f55 907187 0 2024-09-19T07:24:55.127 INFO:tasks.workunit.client.0.smithi098.stdout:5/353: mkdir dc/de/d36/d71 0 2024-09-19T07:24:55.127 INFO:tasks.workunit.client.0.smithi098.stdout:5/354: fdatasync dc/de/d36/f4b 0 2024-09-19T07:24:55.127 INFO:tasks.workunit.client.0.smithi098.stdout:6/402: mknod d2/d5/d1f/d26/d42/d48/d53/d64/d79/c9b 0 2024-09-19T07:24:55.127 INFO:tasks.workunit.client.0.smithi098.stdout:6/403: fsync d2/fe 0 2024-09-19T07:24:55.127 INFO:tasks.workunit.client.0.smithi098.stdout:7/517: dread d5/d3e/d62/da0/f88 [0,4194304] 0 2024-09-19T07:24:55.128 INFO:tasks.workunit.client.0.smithi098.stdout:9/417: mknod d3/dc/df/d15/d1a/d2b/d49/d55/c89 0 2024-09-19T07:24:55.129 INFO:tasks.workunit.client.0.smithi098.stdout:8/384: dread d0/d2c/f66 [4194304,4194304] 0 2024-09-19T07:24:55.130 INFO:tasks.workunit.client.0.smithi098.stdout:8/385: fdatasync d0/d16/f3a 0 2024-09-19T07:24:55.130 INFO:tasks.workunit.client.0.smithi098.stdout:8/386: fdatasync d0/d1a/f49 0 2024-09-19T07:24:55.130 INFO:tasks.workunit.client.0.smithi098.stdout:9/418: write d3/d16/f3c [134314,93494] 0 2024-09-19T07:24:55.157 INFO:tasks.workunit.client.0.smithi098.stdout:3/405: dwrite de/df/d31/f5c [0,4194304] 0 2024-09-19T07:24:55.158 INFO:tasks.workunit.client.0.smithi098.stdout:6/404: dwrite d2/d5/d1f/d26/f69 [0,4194304] 0 2024-09-19T07:24:55.163 INFO:tasks.workunit.client.0.smithi098.stdout:3/406: dread de/df/d1f/f47 [0,4194304] 0 2024-09-19T07:24:55.169 INFO:tasks.workunit.client.0.smithi098.stdout:9/419: dwrite d3/dc/df/d15/d1a/d2b/d49/f76 [0,4194304] 0 2024-09-19T07:24:55.371 INFO:tasks.workunit.client.0.smithi098.stdout:0/478: mkdir d5/d20/d1f/d52/d64/d77/d79/d94 0 2024-09-19T07:24:55.375 INFO:tasks.workunit.client.0.smithi098.stdout:5/355: creat dc/de/d13/d46/d2e/d62/f72 x:0 0 0 2024-09-19T07:24:55.375 INFO:tasks.workunit.client.0.smithi098.stdout:5/356: fdatasync f1 0 2024-09-19T07:24:55.375 INFO:tasks.workunit.client.0.smithi098.stdout:5/357: dread - dc/de/d13/d46/d2e/d62/f72 zero size 2024-09-19T07:24:55.375 INFO:tasks.workunit.client.0.smithi098.stdout:5/358: dread - dc/de/d36/f4b zero size 2024-09-19T07:24:55.393 INFO:tasks.workunit.client.0.smithi098.stdout:8/387: symlink d0/d2c/l80 0 2024-09-19T07:24:55.410 INFO:tasks.workunit.client.0.smithi098.stdout:3/407: unlink de/l1e 0 2024-09-19T07:24:55.416 INFO:tasks.workunit.client.0.smithi098.stdout:9/420: mkdir d3/d16/d7b/d8a 0 2024-09-19T07:24:55.426 INFO:tasks.workunit.client.0.smithi098.stdout:5/359: creat dc/de/d36/d71/f73 x:0 0 0 2024-09-19T07:24:55.433 INFO:tasks.workunit.client.0.smithi098.stdout:9/421: mknod d3/d16/d43/d61/c8b 0 2024-09-19T07:24:55.433 INFO:tasks.workunit.client.0.smithi098.stdout:9/422: fdatasync d3/d16/d38/f26 0 2024-09-19T07:24:55.445 INFO:tasks.workunit.client.0.smithi098.stdout:5/360: mknod dc/de/d13/d3b/d6a/c74 0 2024-09-19T07:24:55.445 INFO:tasks.workunit.client.0.smithi098.stdout:5/361: readlink l7 0 2024-09-19T07:24:55.452 INFO:tasks.workunit.client.0.smithi098.stdout:9/423: mkdir d3/d16/d43/d61/d8c 0 2024-09-19T07:24:55.462 INFO:tasks.workunit.client.0.smithi098.stdout:5/362: unlink dc/de/d13/d46/d2e/d37/d67/f4e 0 2024-09-19T07:24:55.462 INFO:tasks.workunit.client.0.smithi098.stdout:5/363: write dc/f12 [3011814,115517] 0 2024-09-19T07:24:55.465 INFO:tasks.workunit.client.0.smithi098.stdout:9/424: rmdir d3/d16/d7b 39 2024-09-19T07:24:55.574 INFO:tasks.workunit.client.0.smithi098.stdout:9/425: dread d3/d16/d38/f4f [0,4194304] 0 2024-09-19T07:24:55.580 INFO:tasks.workunit.client.0.smithi098.stdout:9/426: mknod d3/dc/df/d15/d1a/d2b/d49/d55/c8d 0 2024-09-19T07:24:55.586 INFO:tasks.workunit.client.0.smithi098.stdout:9/427: creat d3/d16/d7b/d7e/f8e x:0 0 0 2024-09-19T07:24:55.587 INFO:tasks.workunit.client.0.smithi098.stdout:9/428: fsync d3/dc/f6f 0 2024-09-19T07:24:55.587 INFO:tasks.workunit.client.0.smithi098.stdout:9/429: truncate d3/d30/f88 203418 0 2024-09-19T07:24:55.604 INFO:tasks.workunit.client.0.smithi098.stdout:8/388: dwrite d0/d16/f73 [0,4194304] 0 2024-09-19T07:24:55.665 INFO:tasks.workunit.client.0.smithi098.stdout:7/518: rename d5/d3e/d62/l77 to d5/d10/lb9 0 2024-09-19T07:24:55.665 INFO:tasks.workunit.client.0.smithi098.stdout:7/519: fdatasync d5/d8/d5d/f7d 0 2024-09-19T07:24:55.667 INFO:tasks.workunit.client.0.smithi098.stdout:7/520: symlink d5/d10/d50/lba 0 2024-09-19T07:24:55.678 INFO:tasks.workunit.client.0.smithi098.stdout:7/521: symlink d5/d10/d50/lbb 0 2024-09-19T07:24:55.678 INFO:tasks.workunit.client.0.smithi098.stdout:7/522: write d5/d3e/d62/f70 [4536498,115792] 0 2024-09-19T07:24:55.678 INFO:tasks.workunit.client.0.smithi098.stdout:7/523: chown d5/c71 82310 1 2024-09-19T07:24:55.682 INFO:tasks.workunit.client.0.smithi098.stdout:7/524: dread d5/d10/f9d [0,4194304] 0 2024-09-19T07:24:55.683 INFO:tasks.workunit.client.0.smithi098.stdout:9/430: dwrite d3/dc/f6f [0,4194304] 0 2024-09-19T07:24:55.688 INFO:tasks.workunit.client.0.smithi098.stdout:7/525: link d5/d3e/d62/da0/f8c d5/d8/d52/fbc 0 2024-09-19T07:24:55.691 INFO:tasks.workunit.client.0.smithi098.stdout:9/431: mknod d3/dc/df/d15/d1a/d2b/d49/d55/c8f 0 2024-09-19T07:24:55.691 INFO:tasks.workunit.client.0.smithi098.stdout:7/526: mkdir d5/d8/dc/d16/d4f/dbd 0 2024-09-19T07:24:55.691 INFO:tasks.workunit.client.0.smithi098.stdout:7/527: write d5/d3e/d61/f94 [510218,51714] 0 2024-09-19T07:24:55.694 INFO:tasks.workunit.client.0.smithi098.stdout:7/528: truncate d5/d8/dc/d16/f7e 36668 0 2024-09-19T07:24:55.694 INFO:tasks.workunit.client.0.smithi098.stdout:9/432: mkdir d3/dc/df/d15/d1b/d90 0 2024-09-19T07:24:55.694 INFO:tasks.workunit.client.0.smithi098.stdout:9/433: stat d3/dc/df/d15/d1a/d2b/d49/d65/f7c 0 2024-09-19T07:24:55.704 INFO:tasks.workunit.client.0.smithi098.stdout:7/529: creat d5/d10/d50/fbe x:0 0 0 2024-09-19T07:24:55.726 INFO:tasks.workunit.client.0.smithi098.stdout:7/530: write d5/d10/d11/f44 [2301254,37383] 0 2024-09-19T07:24:55.726 INFO:tasks.workunit.client.0.smithi098.stdout:7/531: write d5/f3c [4803262,95204] 0 2024-09-19T07:24:55.726 INFO:tasks.workunit.client.0.smithi098.stdout:7/532: fdatasync d5/d8/dc/d16/f31 0 2024-09-19T07:24:55.746 INFO:tasks.workunit.client.0.smithi098.stdout:5/364: dwrite dc/de/f3f [0,4194304] 0 2024-09-19T07:24:55.752 INFO:tasks.workunit.client.0.smithi098.stdout:3/408: dwrite de/df/f15 [0,4194304] 0 2024-09-19T07:24:55.752 INFO:tasks.workunit.client.0.smithi098.stdout:3/409: readlink de/l49 0 2024-09-19T07:24:55.752 INFO:tasks.workunit.client.0.smithi098.stdout:3/410: symlink de/df/d1f/d2b/l76 0 2024-09-19T07:24:55.753 INFO:tasks.workunit.client.0.smithi098.stdout:5/365: mkdir dc/de/d13/d46/d2e/d37/d67/d75 0 2024-09-19T07:24:55.754 INFO:tasks.workunit.client.0.smithi098.stdout:3/411: creat de/df/d1f/d2b/f77 x:0 0 0 2024-09-19T07:24:55.755 INFO:tasks.workunit.client.0.smithi098.stdout:8/389: dwrite d0/d16/f3f [0,4194304] 0 2024-09-19T07:24:55.758 INFO:tasks.workunit.client.0.smithi098.stdout:8/390: truncate d0/de/d12/f64 12691 0 2024-09-19T07:24:55.761 INFO:tasks.workunit.client.0.smithi098.stdout:8/391: rmdir d0/d33/d6d 0 2024-09-19T07:24:55.761 INFO:tasks.workunit.client.0.smithi098.stdout:8/392: readlink d0/de/d12/l37 0 2024-09-19T07:24:55.764 INFO:tasks.workunit.client.0.smithi098.stdout:8/393: mkdir d0/d2c/d81 0 2024-09-19T07:24:55.764 INFO:tasks.workunit.client.0.smithi098.stdout:3/412: dread de/df/d31/f5c [0,4194304] 0 2024-09-19T07:24:55.785 INFO:tasks.workunit.client.0.smithi098.stdout:5/366: dwrite dc/de/d13/d3b/f3c [0,4194304] 0 2024-09-19T07:24:55.788 INFO:tasks.workunit.client.0.smithi098.stdout:5/367: creat dc/de/d13/d3b/d6a/f76 x:0 0 0 2024-09-19T07:24:55.796 INFO:tasks.workunit.client.0.smithi098.stdout:8/394: dwrite d0/d16/f79 [0,4194304] 0 2024-09-19T07:24:55.799 INFO:tasks.workunit.client.0.smithi098.stdout:8/395: mknod d0/d16/d65/c82 0 2024-09-19T07:24:55.802 INFO:tasks.workunit.client.0.smithi098.stdout:8/396: symlink d0/d16/d61/l83 0 2024-09-19T07:24:55.803 INFO:tasks.workunit.client.0.smithi098.stdout:3/413: dwrite de/df/d1f/d2b/f57 [0,4194304] 0 2024-09-19T07:24:55.803 INFO:tasks.workunit.client.0.smithi098.stdout:3/414: fdatasync de/d4e/f51 0 2024-09-19T07:24:55.804 INFO:tasks.workunit.client.0.smithi098.stdout:8/397: unlink d0/de/d12/d6c/f71 0 2024-09-19T07:24:55.804 INFO:tasks.workunit.client.0.smithi098.stdout:8/398: chown d0/d1a/l1e 34826485 1 2024-09-19T07:24:55.806 INFO:tasks.workunit.client.0.smithi098.stdout:3/415: unlink de/df/d31/d61/d3f/l70 0 2024-09-19T07:24:55.806 INFO:tasks.workunit.client.0.smithi098.stdout:3/416: write f4 [2336184,12490] 0 2024-09-19T07:24:55.808 INFO:tasks.workunit.client.0.smithi098.stdout:8/399: getdents d0/d1a 0 2024-09-19T07:24:55.808 INFO:tasks.workunit.client.0.smithi098.stdout:8/400: fsync d0/d16/f17 0 2024-09-19T07:24:55.809 INFO:tasks.workunit.client.0.smithi098.stdout:3/417: truncate de/f19 2665232 0 2024-09-19T07:24:55.809 INFO:tasks.workunit.client.0.smithi098.stdout:3/418: dread - de/df/d31/d61/d3f/f6f zero size 2024-09-19T07:24:55.896 INFO:tasks.workunit.client.0.smithi098.stdout:3/419: symlink de/df/d1f/l78 0 2024-09-19T07:24:55.903 INFO:tasks.workunit.client.0.smithi098.stdout:3/420: mkdir de/df/d31/d61/d79 0 2024-09-19T07:24:55.905 INFO:tasks.workunit.client.0.smithi098.stdout:3/421: creat de/df/d31/d61/d3f/f7a x:0 0 0 2024-09-19T07:24:55.905 INFO:tasks.workunit.client.0.smithi098.stdout:3/422: write de/f46 [283294,99714] 0 2024-09-19T07:24:55.907 INFO:tasks.workunit.client.0.smithi098.stdout:3/423: mknod de/df/d31/d61/c7b 0 2024-09-19T07:24:55.907 INFO:tasks.workunit.client.0.smithi098.stdout:3/424: chown l3 2 1 2024-09-19T07:24:55.907 INFO:tasks.workunit.client.0.smithi098.stdout:3/425: truncate de/df/f53 881250 0 2024-09-19T07:24:55.908 INFO:tasks.workunit.client.0.smithi098.stdout:6/405: rename d2/l22 to d2/d5/d1f/d26/d42/d48/d4a/d4e/d6e/l9c 0 2024-09-19T07:24:55.909 INFO:tasks.workunit.client.0.smithi098.stdout:3/426: creat de/d4e/d6d/d71/f7c x:0 0 0 2024-09-19T07:24:55.909 INFO:tasks.workunit.client.0.smithi098.stdout:3/427: readlink de/df/d1f/l78 0 2024-09-19T07:24:55.913 INFO:tasks.workunit.client.0.smithi098.stdout:7/533: rename d5/d10/d1d/l74 to d5/d8/lbf 0 2024-09-19T07:24:55.915 INFO:tasks.workunit.client.0.smithi098.stdout:7/534: creat d5/d8/d52/fc0 x:0 0 0 2024-09-19T07:24:55.915 INFO:tasks.workunit.client.0.smithi098.stdout:7/535: chown d5/d10 1710 1 2024-09-19T07:24:55.917 INFO:tasks.workunit.client.0.smithi098.stdout:7/536: link d5/d8/d8e/d59/f85 d5/d10/d1d/fc1 0 2024-09-19T07:24:55.917 INFO:tasks.workunit.client.0.smithi098.stdout:7/537: getdents d5/d3e 0 2024-09-19T07:24:55.920 INFO:tasks.workunit.client.0.smithi098.stdout:6/406: dread d2/d5/d1f/d26/d42/d48/f63 [0,4194304] 0 2024-09-19T07:24:55.921 INFO:tasks.workunit.client.0.smithi098.stdout:6/407: truncate d2/d11/f5c 248620 0 2024-09-19T07:24:55.927 INFO:tasks.workunit.client.0.smithi098.stdout:0/479: link d5/d20/f1b d5/d20/d1f/d52/d64/f95 0 2024-09-19T07:24:55.929 INFO:tasks.workunit.client.0.smithi098.stdout:0/480: mknod d5/d20/d1f/d8d/c96 0 2024-09-19T07:24:55.929 INFO:tasks.workunit.client.0.smithi098.stdout:0/481: fsync d5/f84 0 2024-09-19T07:24:55.929 INFO:tasks.workunit.client.0.smithi098.stdout:0/482: chown d5/d20/d1f/l58 2036149560 1 2024-09-19T07:24:55.929 INFO:tasks.workunit.client.0.smithi098.stdout:0/483: read d5/d20/f42 [321682,72924] 0 2024-09-19T07:24:55.934 INFO:tasks.workunit.client.0.smithi098.stdout:3/428: creat de/df/d31/f7d x:0 0 0 2024-09-19T07:24:55.934 INFO:tasks.workunit.client.0.smithi098.stdout:3/429: read - de/d4e/d6d/d71/f7c zero size 2024-09-19T07:24:55.934 INFO:tasks.workunit.client.0.smithi098.stdout:3/430: stat f9 0 2024-09-19T07:24:55.934 INFO:tasks.workunit.client.0.smithi098.stdout:3/431: chown de/df/d1f/l55 22993866 1 2024-09-19T07:24:55.935 INFO:tasks.workunit.client.0.smithi098.stdout:3/432: symlink de/df/l7e 0 2024-09-19T07:24:55.948 INFO:tasks.workunit.client.0.smithi098.stdout:7/538: rename d5/d8/dc/d16/d4f to d5/d10/dc2 0 2024-09-19T07:24:55.950 INFO:tasks.workunit.client.0.smithi098.stdout:7/539: mkdir d5/d10/dc2/d5c/dc3 0 2024-09-19T07:24:55.950 INFO:tasks.workunit.client.0.smithi098.stdout:6/408: rename d2/d5/d8a to d2/d5/d1f/d26/d42/d48/d4a/d4e/d6e/d9d 0 2024-09-19T07:24:55.952 INFO:tasks.workunit.client.0.smithi098.stdout:7/540: creat d5/d3e/d62/da0/fc4 x:0 0 0 2024-09-19T07:24:55.952 INFO:tasks.workunit.client.0.smithi098.stdout:7/541: fsync d5/d8/dc/f9b 0 2024-09-19T07:24:55.954 INFO:tasks.workunit.client.0.smithi098.stdout:8/401: fsync d0/de/d12/f64 0 2024-09-19T07:24:55.956 INFO:tasks.workunit.client.0.smithi098.stdout:8/402: mknod d0/de/d28/d40/c84 0 2024-09-19T07:24:55.957 INFO:tasks.workunit.client.0.smithi098.stdout:8/403: rename d0/d33/c4a to d0/d33/c85 0 2024-09-19T07:24:55.961 INFO:tasks.workunit.client.0.smithi098.stdout:8/404: dread d0/d1a/f3b [0,4194304] 0 2024-09-19T07:24:55.963 INFO:tasks.workunit.client.0.smithi098.stdout:8/405: unlink d0/f4c 0 2024-09-19T07:24:55.963 INFO:tasks.workunit.client.0.smithi098.stdout:8/406: read - d0/d2c/f67 zero size 2024-09-19T07:24:55.964 INFO:tasks.workunit.client.0.smithi098.stdout:8/407: chown d0/d1a/f49 1398942 1 2024-09-19T07:24:55.966 INFO:tasks.workunit.client.0.smithi098.stdout:6/409: read d2/d5/f16 [641727,73755] 0 2024-09-19T07:24:55.966 INFO:tasks.workunit.client.0.smithi098.stdout:0/484: getdents d5/d20/d1f/d52/d64 0 2024-09-19T07:24:55.967 INFO:tasks.workunit.client.0.smithi098.stdout:7/542: read d5/d8/dc/d16/f1e [3734417,104689] 0 2024-09-19T07:24:55.967 INFO:tasks.workunit.client.0.smithi098.stdout:0/485: write d5/f84 [1091059,48716] 0 2024-09-19T07:24:55.967 INFO:tasks.workunit.client.0.smithi098.stdout:7/543: mkdir d5/d3e/d62/da0/dc5 0 2024-09-19T07:24:55.968 INFO:tasks.workunit.client.0.smithi098.stdout:0/486: dread d5/d20/d1f/f4c [0,4194304] 0 2024-09-19T07:24:55.969 INFO:tasks.workunit.client.0.smithi098.stdout:7/544: link d5/d8/dc/d16/f7e d5/d10/d11/fc6 0 2024-09-19T07:24:55.969 INFO:tasks.workunit.client.0.smithi098.stdout:7/545: chown d5/d10/d11/d9e 3124384 1 2024-09-19T07:24:55.969 INFO:tasks.workunit.client.0.smithi098.stdout:7/546: write d5/d3e/d61/f91 [848269,42315] 0 2024-09-19T07:24:55.970 INFO:tasks.workunit.client.0.smithi098.stdout:7/547: dread - d5/d8/dc/f9b zero size 2024-09-19T07:24:55.970 INFO:tasks.workunit.client.0.smithi098.stdout:7/548: readlink d5/d3e/d61/l6f 0 2024-09-19T07:24:55.970 INFO:tasks.workunit.client.0.smithi098.stdout:7/549: write d5/d8/d8e/d59/f85 [1842891,25895] 0 2024-09-19T07:24:55.970 INFO:tasks.workunit.client.0.smithi098.stdout:7/550: dread - d5/d10/d11/fb8 zero size 2024-09-19T07:24:55.970 INFO:tasks.workunit.client.0.smithi098.stdout:7/551: truncate d5/d3e/d62/f99 513589 0 2024-09-19T07:24:55.970 INFO:tasks.workunit.client.0.smithi098.stdout:3/433: dwrite de/df/d31/d61/f4c [0,4194304] 0 2024-09-19T07:24:55.971 INFO:tasks.workunit.client.0.smithi098.stdout:2/332: mkdir d1/d5/d34/d76 0 2024-09-19T07:24:55.973 INFO:tasks.workunit.client.0.smithi098.stdout:2/333: symlink d1/d5/d34/d5a/l77 0 2024-09-19T07:24:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.974+0000 7f3100ff9640 1 -- 172.21.15.98:0/2811435990 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fd11f32900 con 0x55fd120d4e40 2024-09-19T07:24:55.974 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.974+0000 7f3100ff9640 10 client.16221 handle_command_reply: tid=0 2024-09-19T07:24:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.974+0000 7f312203e740 1 client.16221 shutdown 2024-09-19T07:24:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.974+0000 7f312203e740 1 -- 172.21.15.98:0/2811435990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd120590c0 msgr2=0x55fd1205ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.974+0000 7f312203e740 1 --2- 172.21.15.98:0/2811435990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd120590c0 0x55fd1205ddf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3110009410 tx=0x7f3110009650 comp rx=0 tx=0).stop 2024-09-19T07:24:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.974+0000 7f312203e740 1 -- 172.21.15.98:0/2811435990 shutdown_connections 2024-09-19T07:24:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.974+0000 7f312203e740 1 --2- 172.21.15.98:0/2811435990 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55fd120d4e40 0x55fd120d7260 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.974+0000 7f312203e740 1 --2- 172.21.15.98:0/2811435990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd120590c0 0x55fd1205ddf0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.974+0000 7f312203e740 1 --2- 172.21.15.98:0/2811435990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fd1204e820 0x55fd12061550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.974+0000 7f312203e740 1 --2- 172.21.15.98:0/2811435990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd1204df00 0x55fd12061010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.974+0000 7f312203e740 1 -- 172.21.15.98:0/2811435990 >> 172.21.15.98:0/2811435990 conn(0x55fd1204a470 msgr2=0x55fd12057fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:55.975 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.974+0000 7f3100ff9640 0 client.16221 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:24:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.975+0000 7f312203e740 1 -- 172.21.15.98:0/2811435990 shutdown_connections 2024-09-19T07:24:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.975+0000 7f312203e740 1 -- 172.21.15.98:0/2811435990 wait complete. 2024-09-19T07:24:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.975+0000 7f312203e740 20 client.16221 trim_cache size 0 max 16384 2024-09-19T07:24:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:24:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:24:55.976 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:24:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:24:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.976+0000 7f311f2af640 1 -- 172.21.15.98:0/2755388818 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f31040a34b0 msgr2=0x7f31040a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.976+0000 7f311f2af640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f31040a34b0 0x7f31040a5970 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3110009440 tx=0x7f311000d040 comp rx=0 tx=0).stop 2024-09-19T07:24:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.976+0000 7f311f2af640 1 -- 172.21.15.98:0/2755388818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118101ad0 msgr2=0x7f31181983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:24:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.976+0000 7f311f2af640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118101ad0 0x7f31181983a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f311402a9d0 tx=0x7f3114003b70 comp rx=0 tx=0).stop 2024-09-19T07:24:55.977 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.976+0000 7f311f2af640 1 -- 172.21.15.98:0/2755388818 shutdown_connections 2024-09-19T07:24:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.976+0000 7f311f2af640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f31040a34b0 0x7f31040a5970 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.976+0000 7f311f2af640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3118107b70 0x7f311819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.976+0000 7f311f2af640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3118102470 0x7f31181988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.976+0000 7f311f2af640 1 --2- 172.21.15.98:0/2755388818 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3118101ad0 0x7f31181983a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:24:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.976+0000 7f311f2af640 1 -- 172.21.15.98:0/2755388818 >> 172.21.15.98:0/2755388818 conn(0x7f31180fd7b0 msgr2=0x7f31180fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:24:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.976+0000 7f311f2af640 1 -- 172.21.15.98:0/2755388818 shutdown_connections 2024-09-19T07:24:55.978 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:24:55.976+0000 7f311f2af640 1 -- 172.21.15.98:0/2755388818 wait complete. 2024-09-19T07:24:55.982 INFO:tasks.workunit.client.0.smithi098.stdout:1/492: sync 2024-09-19T07:24:55.982 INFO:tasks.workunit.client.0.smithi098.stdout:4/371: sync 2024-09-19T07:24:55.982 INFO:tasks.workunit.client.0.smithi098.stdout:4/372: write da/d59/d5d/f68 [14577,47266] 0 2024-09-19T07:24:55.983 INFO:tasks.workunit.client.0.smithi098.stdout:2/334: write d1/d9/d26/d35/d58/f22 [2794287,120037] 0 2024-09-19T07:24:55.984 INFO:tasks.workunit.client.0.smithi098.stdout:4/373: rename da/d31/f64 to da/d31/d46/d5f/f7c 0 2024-09-19T07:24:55.984 INFO:tasks.workunit.client.0.smithi098.stdout:4/374: readlink da/l52 0 2024-09-19T07:24:55.986 INFO:tasks.workunit.client.0.smithi098.stdout:2/335: getdents d1/d9/d3e/d41/d60 0 2024-09-19T07:24:55.988 INFO:tasks.workunit.client.0.smithi098.stdout:8/408: write d0/de/f5f [932702,118451] 0 2024-09-19T07:24:55.988 INFO:tasks.workunit.client.0.smithi098.stdout:8/409: fdatasync d0/f4e 0 2024-09-19T07:24:55.990 INFO:tasks.workunit.client.0.smithi098.stdout:8/410: creat d0/de/d28/f86 x:0 0 0 2024-09-19T07:24:55.999 INFO:tasks.workunit.client.0.smithi098.stdout:0/487: dwrite d5/f25 [0,4194304] 0 2024-09-19T07:24:55.999 INFO:tasks.workunit.client.0.smithi098.stdout:7/552: dwrite d5/d8/dc/d16/f67 [0,4194304] 0 2024-09-19T07:24:55.999 INFO:tasks.workunit.client.0.smithi098.stdout:7/553: fsync d5/fa8 0 2024-09-19T07:24:56.001 INFO:tasks.workunit.client.0.smithi098.stdout:0/488: symlink d5/d20/d14/d49/d62/l97 0 2024-09-19T07:24:56.002 INFO:tasks.workunit.client.0.smithi098.stdout:6/410: dread d2/d1b/f1d [0,4194304] 0 2024-09-19T07:24:56.004 INFO:tasks.workunit.client.0.smithi098.stdout:7/554: rename d5/d8/d52/c8d to d5/d3e/d62/da0/dc5/cc7 0 2024-09-19T07:24:56.004 INFO:tasks.workunit.client.0.smithi098.stdout:6/411: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98/f9e x:0 0 0 2024-09-19T07:24:56.005 INFO:tasks.workunit.client.0.smithi098.stdout:4/375: link da/l34 da/d31/d46/d56/d5b/d61/l7d 0 2024-09-19T07:24:56.006 INFO:tasks.workunit.client.0.smithi098.stdout:0/489: unlink d5/d20/d1f/d52/d64/d77/c88 0 2024-09-19T07:24:56.007 INFO:tasks.workunit.client.0.smithi098.stdout:7/555: creat d5/d3e/d62/da0/fc8 x:0 0 0 2024-09-19T07:24:56.008 INFO:tasks.workunit.client.0.smithi098.stdout:7/556: chown d5/d3e/d62 2033520410 1 2024-09-19T07:24:56.013 INFO:tasks.workunit.client.0.smithi098.stdout:0/490: dread d5/d20/f1b [0,4194304] 0 2024-09-19T07:24:56.014 INFO:tasks.workunit.client.0.smithi098.stdout:0/491: truncate d5/d20/d1f/d7d/f85 1000125 0 2024-09-19T07:24:56.014 INFO:tasks.workunit.client.0.smithi098.stdout:0/492: fsync d5/d20/d14/d49/f5e 0 2024-09-19T07:24:56.014 INFO:tasks.workunit.client.0.smithi098.stdout:0/493: chown d5/d20/d1f/d47/l93 33248935 1 2024-09-19T07:24:56.014 INFO:tasks.workunit.client.0.smithi098.stdout:0/494: write d5/f25 [4367533,115997] 0 2024-09-19T07:24:56.014 INFO:tasks.workunit.client.0.smithi098.stdout:0/495: fdatasync d5/d20/d1f/f4c 0 2024-09-19T07:24:56.016 INFO:tasks.workunit.client.0.smithi098.stdout:0/496: rename d5/d20/d1f/l58 to d5/d20/l98 0 2024-09-19T07:24:56.025 INFO:tasks.workunit.client.0.smithi098.stdout:2/336: dwrite d1/d9/d26/d35/d58/f12 [4194304,4194304] 0 2024-09-19T07:24:56.026 INFO:tasks.workunit.client.0.smithi098.stdout:2/337: fsync d1/d9/d1d/f4a 0 2024-09-19T07:24:56.026 INFO:tasks.workunit.client.0.smithi098.stdout:2/338: write d1/d9/f27 [1062226,30646] 0 2024-09-19T07:24:56.026 INFO:tasks.workunit.client.0.smithi098.stdout:2/339: read d1/d9/f2a [1067204,80420] 0 2024-09-19T07:24:56.027 INFO:tasks.workunit.client.0.smithi098.stdout:2/340: unlink d1/d5/d34/d5a/l77 0 2024-09-19T07:24:56.030 INFO:tasks.workunit.client.0.smithi098.stdout:2/341: mknod d1/d5/d34/d39/c78 0 2024-09-19T07:24:56.032 INFO:tasks.workunit.client.0.smithi098.stdout:2/342: mknod d1/d5/d34/d39/c79 0 2024-09-19T07:24:56.033 INFO:tasks.workunit.client.0.smithi098.stdout:0/497: dread d5/fe [0,4194304] 0 2024-09-19T07:24:56.034 INFO:tasks.workunit.client.0.smithi098.stdout:2/343: link d1/d9/d1d/l31 d1/l7a 0 2024-09-19T07:24:56.034 INFO:tasks.workunit.client.0.smithi098.stdout:2/344: truncate d1/d9/d3e/d41/f4b 761984 0 2024-09-19T07:24:56.034 INFO:tasks.workunit.client.0.smithi098.stdout:2/345: readlink d1/d9/d26/d5c/l5f 0 2024-09-19T07:24:56.034 INFO:tasks.workunit.client.0.smithi098.stdout:0/498: creat d5/d20/d1f/d52/d64/d77/d79/d94/f99 x:0 0 0 2024-09-19T07:24:56.044 INFO:tasks.workunit.client.0.smithi098.stdout:4/376: dwrite da/f28 [8388608,4194304] 0 2024-09-19T07:24:56.044 INFO:tasks.workunit.client.0.smithi098.stdout:4/377: fsync da/f28 0 2024-09-19T07:24:56.045 INFO:tasks.workunit.client.0.smithi098.stdout:6/412: dwrite d2/d11/f5c [0,4194304] 0 2024-09-19T07:24:56.045 INFO:tasks.workunit.client.0.smithi098.stdout:6/413: dread - d2/d5/d1f/d26/d42/d48/d53/f5d zero size 2024-09-19T07:24:56.045 INFO:tasks.workunit.client.0.smithi098.stdout:6/414: write d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98/f9e [685618,62843] 0 2024-09-19T07:24:56.046 INFO:tasks.workunit.client.0.smithi098.stdout:6/415: creat d2/d5/d1f/d26/d42/d48/d4a/d4e/d6e/d9d/d94/f9f x:0 0 0 2024-09-19T07:24:56.046 INFO:tasks.workunit.client.0.smithi098.stdout:6/416: write d2/d5/d1f/f83 [494286,11322] 0 2024-09-19T07:24:56.047 INFO:tasks.workunit.client.0.smithi098.stdout:7/557: dwrite d5/d10/d1d/f51 [0,4194304] 0 2024-09-19T07:24:56.047 INFO:tasks.workunit.client.0.smithi098.stdout:7/558: stat d5/d8/dc/f9b 0 2024-09-19T07:24:56.047 INFO:tasks.workunit.client.0.smithi098.stdout:7/559: chown d5/c5b 518563 1 2024-09-19T07:24:56.047 INFO:tasks.workunit.client.0.smithi098.stdout:7/560: dread - d5/d8/dc/d16/fb4 zero size 2024-09-19T07:24:56.047 INFO:tasks.workunit.client.0.smithi098.stdout:6/417: creat d2/d5/d1f/d26/d42/d48/d4a/d4e/d6e/d9d/d94/fa0 x:0 0 0 2024-09-19T07:24:56.048 INFO:tasks.workunit.client.0.smithi098.stdout:4/378: mkdir da/d7e 0 2024-09-19T07:24:56.048 INFO:tasks.workunit.client.0.smithi098.stdout:7/561: mkdir d5/d8/d52/db6/dc9 0 2024-09-19T07:24:56.049 INFO:tasks.workunit.client.0.smithi098.stdout:6/418: creat d2/d5/d1f/d26/d42/d48/d4a/d4e/d6e/d9d/fa1 x:0 0 0 2024-09-19T07:24:56.049 INFO:tasks.workunit.client.0.smithi098.stdout:4/379: creat da/d31/d46/d5f/f7f x:0 0 0 2024-09-19T07:24:56.049 INFO:tasks.workunit.client.0.smithi098.stdout:4/380: chown da/f4b 483298 1 2024-09-19T07:24:56.050 INFO:tasks.workunit.client.0.smithi098.stdout:6/419: mkdir d2/d5/d1f/d26/d42/d48/d53/da2 0 2024-09-19T07:24:56.051 INFO:tasks.workunit.client.0.smithi098.stdout:0/499: dwrite d5/f7 [4194304,4194304] 0 2024-09-19T07:24:56.051 INFO:tasks.workunit.client.0.smithi098.stdout:7/562: rename d5/d10/dc2/f79 to d5/d3e/d61/fca 0 2024-09-19T07:24:56.051 INFO:tasks.workunit.client.0.smithi098.stdout:4/381: mkdir da/d31/d46/d80 0 2024-09-19T07:24:56.051 INFO:tasks.workunit.client.0.smithi098.stdout:4/382: fdatasync da/d31/f39 0 2024-09-19T07:24:56.051 INFO:tasks.workunit.client.0.smithi098.stdout:4/383: fdatasync da/f1c 0 2024-09-19T07:24:56.053 INFO:tasks.workunit.client.0.smithi098.stdout:0/500: creat d5/d6b/f9a x:0 0 0 2024-09-19T07:24:56.054 INFO:tasks.workunit.client.0.smithi098.stdout:4/384: mknod da/c81 0 2024-09-19T07:24:56.055 INFO:tasks.workunit.client.0.smithi098.stdout:4/385: mkdir da/d59/d5d/d82 0 2024-09-19T07:24:56.055 INFO:tasks.workunit.client.0.smithi098.stdout:4/386: read da/d59/f77 [2185031,111211] 0 2024-09-19T07:24:56.056 INFO:tasks.workunit.client.0.smithi098.stdout:2/346: dwrite d1/d5/d34/d5a/d42/d4e/f5e [0,4194304] 0 2024-09-19T07:24:56.067 INFO:tasks.workunit.client.0.smithi098.stdout:2/347: write d1/d2c/f30 [74055,46881] 0 2024-09-19T07:24:56.072 INFO:tasks.workunit.client.0.smithi098.stdout:4/387: dwrite da/fb [8388608,4194304] 0 2024-09-19T07:24:56.072 INFO:tasks.workunit.client.0.smithi098.stdout:4/388: chown da/d31/d46/l70 411749 1 2024-09-19T07:24:56.073 INFO:tasks.workunit.client.0.smithi098.stdout:4/389: mknod da/d59/d5d/d82/c83 0 2024-09-19T07:24:56.082 INFO:tasks.workunit.client.0.smithi098.stdout:2/348: symlink d1/d5/d34/d5a/d42/l7b 0 2024-09-19T07:24:56.082 INFO:tasks.workunit.client.0.smithi098.stdout:2/349: readlink d1/d9/l4f 0 2024-09-19T07:24:56.082 INFO:tasks.workunit.client.0.smithi098.stdout:2/350: fsync d1/d9/f2a 0 2024-09-19T07:24:56.082 INFO:tasks.workunit.client.0.smithi098.stdout:2/351: write d1/d5/f54 [49345,29368] 0 2024-09-19T07:24:56.083 INFO:tasks.workunit.client.0.smithi098.stdout:4/390: write da/f28 [6589805,73675] 0 2024-09-19T07:24:56.099 INFO:tasks.workunit.client.0.smithi098.stdout:4/391: mknod da/d31/d46/d56/c84 0 2024-09-19T07:24:56.099 INFO:tasks.workunit.client.0.smithi098.stdout:4/392: write da/d31/d46/d5f/f7c [394446,34439] 0 2024-09-19T07:24:56.100 INFO:tasks.workunit.client.0.smithi098.stdout:2/352: rmdir d1/d9/d26/d35/d58 39 2024-09-19T07:24:56.106 INFO:tasks.workunit.client.0.smithi098.stdout:4/393: dread da/d31/f57 [0,4194304] 0 2024-09-19T07:24:56.106 INFO:tasks.workunit.client.0.smithi098.stdout:2/353: dread d1/d9/d26/d35/d58/f12 [0,4194304] 0 2024-09-19T07:24:56.107 INFO:tasks.workunit.client.0.smithi098.stdout:4/394: mknod da/d31/d46/d56/d5b/c85 0 2024-09-19T07:24:56.107 INFO:tasks.workunit.client.0.smithi098.stdout:2/354: creat d1/d5/d34/f7c x:0 0 0 2024-09-19T07:24:56.108 INFO:tasks.workunit.client.0.smithi098.stdout:2/355: mknod d1/d9/d26/d5c/c7d 0 2024-09-19T07:24:56.110 INFO:tasks.workunit.client.0.smithi098.stdout:2/356: creat d1/d5/d34/d5a/f7e x:0 0 0 2024-09-19T07:24:56.110 INFO:tasks.workunit.client.0.smithi098.stdout:4/395: rename da/f3f to da/d59/f86 0 2024-09-19T07:24:56.110 INFO:tasks.workunit.client.0.smithi098.stdout:2/357: stat d1/d9/d26/c3a 0 2024-09-19T07:24:56.111 INFO:tasks.workunit.client.0.smithi098.stdout:2/358: mkdir d1/d9/d26/d35/d48/d7f 0 2024-09-19T07:24:56.111 INFO:tasks.workunit.client.0.smithi098.stdout:2/359: fdatasync d1/d9/d3e/d41/f4b 0 2024-09-19T07:24:56.112 INFO:tasks.workunit.client.0.smithi098.stdout:4/396: unlink da/d31/d46/d5f/f7f 0 2024-09-19T07:24:56.112 INFO:tasks.workunit.client.0.smithi098.stdout:4/397: symlink da/d31/d46/d5f/l87 0 2024-09-19T07:24:56.113 INFO:tasks.workunit.client.0.smithi098.stdout:2/360: mkdir d1/d5/d34/d80 0 2024-09-19T07:24:56.116 INFO:tasks.workunit.client.0.smithi098.stdout:4/398: creat da/d59/d5d/d82/f88 x:0 0 0 2024-09-19T07:24:56.116 INFO:tasks.workunit.client.0.smithi098.stdout:2/361: symlink d1/d9/d26/d35/d58/l81 0 2024-09-19T07:24:56.117 INFO:tasks.workunit.client.0.smithi098.stdout:2/362: write d1/d9/d26/d35/d58/f4d [4493597,101345] 0 2024-09-19T07:24:56.117 INFO:tasks.workunit.client.0.smithi098.stdout:2/363: stat d1/d9/d26/d35/d58/f25 0 2024-09-19T07:24:56.117 INFO:tasks.workunit.client.0.smithi098.stdout:2/364: stat d1/d5/d34/d39/f75 0 2024-09-19T07:24:56.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:56 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a[30946]: 2024-09-19T07:24:56.456+0000 7efcdf868640 -1 log_channel(cluster) log [ERR] : Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:24:56.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:56 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:56.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:56 smithi098 ceph-mon[30950]: pgmap v89: 97 pgs: 97 active+clean; 856 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 MiB/s rd, 132 MiB/s wr, 2.51k op/s 2024-09-19T07:24:56.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:56 smithi098 ceph-mon[30950]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:24:56.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:56 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:56.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:56 smithi139 ceph-mon[35039]: pgmap v89: 97 pgs: 97 active+clean; 856 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 MiB/s rd, 132 MiB/s wr, 2.51k op/s 2024-09-19T07:24:56.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:56 smithi139 ceph-mon[35039]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:24:56.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:56 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:56.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:56 smithi162 ceph-mon[35726]: pgmap v89: 97 pgs: 97 active+clean; 856 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 MiB/s rd, 132 MiB/s wr, 2.51k op/s 2024-09-19T07:24:56.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:56 smithi162 ceph-mon[35726]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T07:24:57.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/563: sync 2024-09-19T07:24:57.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/564: chown d5/d8/dc/f47 20854937 1 2024-09-19T07:24:57.014 INFO:tasks.workunit.client.0.smithi098.stdout:0/501: sync 2024-09-19T07:24:57.014 INFO:tasks.workunit.client.0.smithi098.stdout:4/399: sync 2024-09-19T07:24:57.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/565: chown d5/d8/dc/d16/fb4 6377 1 2024-09-19T07:24:57.014 INFO:tasks.workunit.client.0.smithi098.stdout:2/365: sync 2024-09-19T07:24:57.014 INFO:tasks.workunit.client.0.smithi098.stdout:1/493: sync 2024-09-19T07:24:57.014 INFO:tasks.workunit.client.0.smithi098.stdout:0/502: chown d5/f48 19194443 1 2024-09-19T07:24:57.014 INFO:tasks.workunit.client.0.smithi098.stdout:8/411: sync 2024-09-19T07:24:57.014 INFO:tasks.workunit.client.0.smithi098.stdout:0/503: chown d5/cc 108 1 2024-09-19T07:24:57.014 INFO:tasks.workunit.client.0.smithi098.stdout:6/420: sync 2024-09-19T07:24:57.014 INFO:tasks.workunit.client.0.smithi098.stdout:8/412: chown d0/d16/d65/c82 92848759 1 2024-09-19T07:24:57.015 INFO:tasks.workunit.client.0.smithi098.stdout:5/368: sync 2024-09-19T07:24:57.015 INFO:tasks.workunit.client.0.smithi098.stdout:3/434: sync 2024-09-19T07:24:57.015 INFO:tasks.workunit.client.0.smithi098.stdout:9/434: sync 2024-09-19T07:24:57.015 INFO:tasks.workunit.client.0.smithi098.stdout:9/435: write d3/d16/d43/d51/f5a [4279893,39278] 0 2024-09-19T07:24:57.015 INFO:tasks.workunit.client.0.smithi098.stdout:4/400: creat da/d31/d46/d56/f89 x:0 0 0 2024-09-19T07:24:57.015 INFO:tasks.workunit.client.0.smithi098.stdout:7/566: write d5/d8/dc/fe [2302984,78457] 0 2024-09-19T07:24:57.016 INFO:tasks.workunit.client.0.smithi098.stdout:2/366: mknod d1/d9/d26/d35/d58/c82 0 2024-09-19T07:24:57.016 INFO:tasks.workunit.client.0.smithi098.stdout:4/401: mkdir da/d31/d46/d5f/d8a 0 2024-09-19T07:24:57.016 INFO:tasks.workunit.client.0.smithi098.stdout:4/402: fdatasync da/f4b 0 2024-09-19T07:24:57.016 INFO:tasks.workunit.client.0.smithi098.stdout:8/413: getdents d0/d16/d65 0 2024-09-19T07:24:57.018 INFO:tasks.workunit.client.0.smithi098.stdout:4/403: creat da/d59/d5d/d82/f8b x:0 0 0 2024-09-19T07:24:57.019 INFO:tasks.workunit.client.0.smithi098.stdout:4/404: symlink da/d31/d46/d5f/l8c 0 2024-09-19T07:24:57.021 INFO:tasks.workunit.client.0.smithi098.stdout:2/367: link d1/d9/d26/d35/d58/c13 d1/d9/c83 0 2024-09-19T07:24:57.021 INFO:tasks.workunit.client.0.smithi098.stdout:2/368: stat d1/d9/d26/d35/d48/d49/d61/l6c 0 2024-09-19T07:24:57.022 INFO:tasks.workunit.client.0.smithi098.stdout:4/405: rename da/d59/f77 to da/d31/d46/d5f/f8d 0 2024-09-19T07:24:57.023 INFO:tasks.workunit.client.0.smithi098.stdout:5/369: link dc/de/f34 dc/de/d13/d46/d2e/f77 0 2024-09-19T07:24:57.023 INFO:tasks.workunit.client.0.smithi098.stdout:4/406: stat da/l34 0 2024-09-19T07:24:57.024 INFO:tasks.workunit.client.0.smithi098.stdout:4/407: write da/d59/f6f [4312698,62238] 0 2024-09-19T07:24:57.025 INFO:tasks.workunit.client.0.smithi098.stdout:7/567: symlink d5/d3e/d61/lcb 0 2024-09-19T07:24:57.027 INFO:tasks.workunit.client.0.smithi098.stdout:9/436: dread d3/d16/d38/f4f [0,4194304] 0 2024-09-19T07:24:57.027 INFO:tasks.workunit.client.0.smithi098.stdout:3/435: read de/df/f15 [364912,82212] 0 2024-09-19T07:24:57.029 INFO:tasks.workunit.client.0.smithi098.stdout:4/408: rename da/c44 to da/d31/d46/d5f/c8e 0 2024-09-19T07:24:57.029 INFO:tasks.workunit.client.0.smithi098.stdout:7/568: link d5/d10/d11/f73 d5/d10/dc2/d5c/dc3/fcc 0 2024-09-19T07:24:57.029 INFO:tasks.workunit.client.0.smithi098.stdout:7/569: truncate d5/d8/dc/fa4 942894 0 2024-09-19T07:24:57.031 INFO:tasks.workunit.client.0.smithi098.stdout:9/437: truncate d3/d16/f3c 1700670 0 2024-09-19T07:24:57.031 INFO:tasks.workunit.client.0.smithi098.stdout:3/436: creat de/df/d1f/f7f x:0 0 0 2024-09-19T07:24:57.032 INFO:tasks.workunit.client.0.smithi098.stdout:2/369: read d1/d9/f1b [6940866,22090] 0 2024-09-19T07:24:57.033 INFO:tasks.workunit.client.0.smithi098.stdout:4/409: creat da/d31/d46/d56/d5b/d61/f8f x:0 0 0 2024-09-19T07:24:57.033 INFO:tasks.workunit.client.0.smithi098.stdout:5/370: rmdir dc/de/d13/d46/d2e/d62 39 2024-09-19T07:24:57.034 INFO:tasks.workunit.client.0.smithi098.stdout:2/370: rmdir d1/d5/d34/d39 39 2024-09-19T07:24:57.034 INFO:tasks.workunit.client.0.smithi098.stdout:2/371: dread - d1/d9/d26/f59 zero size 2024-09-19T07:24:57.034 INFO:tasks.workunit.client.0.smithi098.stdout:2/372: chown d1/d9/f2d 306 1 2024-09-19T07:24:57.035 INFO:tasks.workunit.client.0.smithi098.stdout:4/410: getdents da/d31/d46 0 2024-09-19T07:24:57.035 INFO:tasks.workunit.client.0.smithi098.stdout:5/371: creat dc/de/d13/d3b/f78 x:0 0 0 2024-09-19T07:24:57.036 INFO:tasks.workunit.client.0.smithi098.stdout:5/372: readlink dc/de/l30 0 2024-09-19T07:24:57.036 INFO:tasks.workunit.client.0.smithi098.stdout:5/373: readlink dc/de/d13/d5c/l68 0 2024-09-19T07:24:57.037 INFO:tasks.workunit.client.0.smithi098.stdout:5/374: truncate dc/de/d13/f19 1858357 0 2024-09-19T07:24:57.037 INFO:tasks.workunit.client.0.smithi098.stdout:5/375: chown dc/de/d13/d46/d23/f5f 1297 1 2024-09-19T07:24:57.038 INFO:tasks.workunit.client.0.smithi098.stdout:5/376: creat dc/f79 x:0 0 0 2024-09-19T07:24:57.040 INFO:tasks.workunit.client.0.smithi098.stdout:5/377: truncate dc/de/d13/d46/f26 1841172 0 2024-09-19T07:24:57.040 INFO:tasks.workunit.client.0.smithi098.stdout:5/378: readlink dc/de/d13/d46/d23/d52/l53 0 2024-09-19T07:24:57.040 INFO:tasks.workunit.client.0.smithi098.stdout:6/421: write f1 [1523960,42000] 0 2024-09-19T07:24:57.042 INFO:tasks.workunit.client.0.smithi098.stdout:3/437: truncate de/df/d1f/d2b/f3a 2898923 0 2024-09-19T07:24:57.043 INFO:tasks.workunit.client.0.smithi098.stdout:6/422: mkdir d2/d5/d1f/d26/d7b/da3 0 2024-09-19T07:24:57.043 INFO:tasks.workunit.client.0.smithi098.stdout:6/423: chown d2/f3e 12223470 1 2024-09-19T07:24:57.043 INFO:tasks.workunit.client.0.smithi098.stdout:6/424: read - d2/d5/d1f/d26/d42/d48/d4a/d4e/d6e/d9d/fa1 zero size 2024-09-19T07:24:57.044 INFO:tasks.workunit.client.0.smithi098.stdout:9/438: write d3/dc/df/d15/f5b [669143,30487] 0 2024-09-19T07:24:57.044 INFO:tasks.workunit.client.0.smithi098.stdout:9/439: chown d3/d16/d43/d51/f5a 911356336 1 2024-09-19T07:24:57.044 INFO:tasks.workunit.client.0.smithi098.stdout:9/440: write d3/d16/d38/f26 [1550668,39711] 0 2024-09-19T07:24:57.044 INFO:tasks.workunit.client.0.smithi098.stdout:5/379: symlink dc/de/d13/d46/d2e/d37/d6d/l7a 0 2024-09-19T07:24:57.045 INFO:tasks.workunit.client.0.smithi098.stdout:1/494: dwrite dc/de/d22/d31/d5d/f6e [0,4194304] 0 2024-09-19T07:24:57.045 INFO:tasks.workunit.client.0.smithi098.stdout:1/495: fsync dc/d17/d1b/d1d/f3f 0 2024-09-19T07:24:57.045 INFO:tasks.workunit.client.0.smithi098.stdout:6/425: write d2/d5/d1f/d26/d42/d48/d53/d64/d6d/f82 [715992,88782] 0 2024-09-19T07:24:57.048 INFO:tasks.workunit.client.0.smithi098.stdout:6/426: unlink d2/d5/d1f/d26/l76 0 2024-09-19T07:24:57.048 INFO:tasks.workunit.client.0.smithi098.stdout:6/427: chown d2/d5/d1f/d26/d42/d48/d4a/d4e/d6e/d9d/d94/f9f 1 1 2024-09-19T07:24:57.049 INFO:tasks.workunit.client.0.smithi098.stdout:6/428: mkdir d2/d5/d1f/d26/d42/da4 0 2024-09-19T07:24:57.050 INFO:tasks.workunit.client.0.smithi098.stdout:6/429: creat d2/fa5 x:0 0 0 2024-09-19T07:24:57.053 INFO:tasks.workunit.client.0.smithi098.stdout:0/504: dwrite d5/d20/d1f/d47/f90 [0,4194304] 0 2024-09-19T07:24:57.053 INFO:tasks.workunit.client.0.smithi098.stdout:6/430: creat d2/d5/d1f/d26/d42/d48/d53/d64/fa6 x:0 0 0 2024-09-19T07:24:57.053 INFO:tasks.workunit.client.0.smithi098.stdout:6/431: fdatasync d2/d5/d1f/d26/d42/d48/d4a/f6b 0 2024-09-19T07:24:57.056 INFO:tasks.workunit.client.0.smithi098.stdout:6/432: creat d2/d5/d1f/d26/fa7 x:0 0 0 2024-09-19T07:24:57.057 INFO:tasks.workunit.client.0.smithi098.stdout:7/570: write d5/d8/dc/d16/f67 [999504,65121] 0 2024-09-19T07:24:57.068 INFO:tasks.workunit.client.0.smithi098.stdout:8/414: dwrite d0/d1a/f1c [0,4194304] 0 2024-09-19T07:24:57.071 INFO:tasks.workunit.client.0.smithi098.stdout:8/415: symlink d0/de/d28/d40/l87 0 2024-09-19T07:24:57.072 INFO:tasks.workunit.client.0.smithi098.stdout:8/416: chown d0/de/f18 144 1 2024-09-19T07:24:57.072 INFO:tasks.workunit.client.0.smithi098.stdout:8/417: truncate d0/de/d12/f64 1008404 0 2024-09-19T07:24:57.072 INFO:tasks.workunit.client.0.smithi098.stdout:8/418: fdatasync d0/d2c/f67 0 2024-09-19T07:24:57.072 INFO:tasks.workunit.client.0.smithi098.stdout:2/373: read d1/f8 [5920995,52833] 0 2024-09-19T07:24:57.073 INFO:tasks.workunit.client.0.smithi098.stdout:8/419: creat d0/de/d21/d50/f88 x:0 0 0 2024-09-19T07:24:57.076 INFO:tasks.workunit.client.0.smithi098.stdout:8/420: link d0/de/d12/l1b d0/d16/d65/l89 0 2024-09-19T07:24:57.076 INFO:tasks.workunit.client.0.smithi098.stdout:2/374: unlink d1/d5/d34/f3b 0 2024-09-19T07:24:57.077 INFO:tasks.workunit.client.0.smithi098.stdout:7/571: dread d5/d10/d11/fb3 [0,4194304] 0 2024-09-19T07:24:57.077 INFO:tasks.workunit.client.0.smithi098.stdout:7/572: fdatasync d5/d10/d50/fb5 0 2024-09-19T07:24:57.078 INFO:tasks.workunit.client.0.smithi098.stdout:2/375: unlink d1/d5/f6a 0 2024-09-19T07:24:57.079 INFO:tasks.workunit.client.0.smithi098.stdout:7/573: creat d5/d10/fcd x:0 0 0 2024-09-19T07:24:57.080 INFO:tasks.workunit.client.0.smithi098.stdout:2/376: mknod d1/d5/c84 0 2024-09-19T07:24:57.081 INFO:tasks.workunit.client.0.smithi098.stdout:4/411: rename da/c12 to da/d31/d46/d56/d5b/c90 0 2024-09-19T07:24:57.081 INFO:tasks.workunit.client.0.smithi098.stdout:7/574: truncate d5/d3e/d62/f65 1347636 0 2024-09-19T07:24:57.081 INFO:tasks.workunit.client.0.smithi098.stdout:7/575: chown d5/d8/dc/faf 684 1 2024-09-19T07:24:57.081 INFO:tasks.workunit.client.0.smithi098.stdout:7/576: fsync d5/d3e/f95 0 2024-09-19T07:24:57.083 INFO:tasks.workunit.client.0.smithi098.stdout:2/377: mknod d1/d5/c85 0 2024-09-19T07:24:57.083 INFO:tasks.workunit.client.0.smithi098.stdout:2/378: chown d1/d9/l4f 3949 1 2024-09-19T07:24:57.083 INFO:tasks.workunit.client.0.smithi098.stdout:2/379: write d1/d9/d3e/d41/f4b [1269634,12961] 0 2024-09-19T07:24:57.084 INFO:tasks.workunit.client.0.smithi098.stdout:6/433: rename d2/l4 to d2/d5/d1f/d26/d42/d48/d4a/d8d/la8 0 2024-09-19T07:24:57.084 INFO:tasks.workunit.client.0.smithi098.stdout:6/434: write d2/d5/d1f/d26/d42/d48/d53/f5f [624700,86909] 0 2024-09-19T07:24:57.084 INFO:tasks.workunit.client.0.smithi098.stdout:6/435: write d2/d5/d1f/d26/f55 [1704566,28313] 0 2024-09-19T07:24:57.084 INFO:tasks.workunit.client.0.smithi098.stdout:6/436: chown d2/d11/l35 12 1 2024-09-19T07:24:57.084 INFO:tasks.workunit.client.0.smithi098.stdout:6/437: chown d2/d11/f66 1028018216 1 2024-09-19T07:24:57.084 INFO:tasks.workunit.client.0.smithi098.stdout:1/496: dwrite dc/de/d22/f4b [4194304,4194304] 0 2024-09-19T07:24:57.086 INFO:tasks.workunit.client.0.smithi098.stdout:7/577: write d5/d3e/d61/fca [312228,899] 0 2024-09-19T07:24:57.088 INFO:tasks.workunit.client.0.smithi098.stdout:2/380: dread d1/d9/d26/d35/f6b [4194304,4194304] 0 2024-09-19T07:24:57.088 INFO:tasks.workunit.client.0.smithi098.stdout:1/497: symlink dc/de/d37/lad 0 2024-09-19T07:24:57.089 INFO:tasks.workunit.client.0.smithi098.stdout:5/380: read dc/de/f3f [1949760,38426] 0 2024-09-19T07:24:57.089 INFO:tasks.workunit.client.0.smithi098.stdout:3/438: dwrite de/d4e/f50 [0,4194304] 0 2024-09-19T07:24:57.090 INFO:tasks.workunit.client.0.smithi098.stdout:3/439: write de/df/d16/f4a [537867,29938] 0 2024-09-19T07:24:57.090 INFO:tasks.workunit.client.0.smithi098.stdout:1/498: symlink dc/de/d22/d31/d35/d4f/lae 0 2024-09-19T07:24:57.090 INFO:tasks.workunit.client.0.smithi098.stdout:4/412: mknod da/c91 0 2024-09-19T07:24:57.090 INFO:tasks.workunit.client.0.smithi098.stdout:3/440: getdents de/d4e/d6d/d71 0 2024-09-19T07:24:57.094 INFO:tasks.workunit.client.0.smithi098.stdout:6/438: write d2/d5/d1f/d26/d42/d48/d4a/d4e/f65 [2055375,46300] 0 2024-09-19T07:24:57.095 INFO:tasks.workunit.client.0.smithi098.stdout:4/413: rename da/f3d to da/d31/d46/d5f/f92 0 2024-09-19T07:24:57.098 INFO:tasks.workunit.client.0.smithi098.stdout:6/439: rename d2/f3e to d2/d5/d1f/d26/d42/d48/d4a/d8d/fa9 0 2024-09-19T07:24:57.099 INFO:tasks.workunit.client.0.smithi098.stdout:6/440: mkdir d2/d11/daa 0 2024-09-19T07:24:57.099 INFO:tasks.workunit.client.0.smithi098.stdout:6/441: write d2/d5/f81 [823889,122907] 0 2024-09-19T07:24:57.103 INFO:tasks.workunit.client.0.smithi098.stdout:2/381: write d1/d9/d3e/fd [1844194,130323] 0 2024-09-19T07:24:57.103 INFO:tasks.workunit.client.0.smithi098.stdout:2/382: dread - d1/d5/d34/d5a/f7e zero size 2024-09-19T07:24:57.103 INFO:tasks.workunit.client.0.smithi098.stdout:2/383: read - d1/d2c/f2f zero size 2024-09-19T07:24:57.103 INFO:tasks.workunit.client.0.smithi098.stdout:2/384: fdatasync d1/d2c/f44 0 2024-09-19T07:24:57.103 INFO:tasks.workunit.client.0.smithi098.stdout:2/385: write d1/d9/d26/d35/f71 [410173,90059] 0 2024-09-19T07:24:57.103 INFO:tasks.workunit.client.0.smithi098.stdout:5/381: dread dc/de/f1d [0,4194304] 0 2024-09-19T07:24:57.104 INFO:tasks.workunit.client.0.smithi098.stdout:0/505: dwrite d5/d20/d1f/d7d/f85 [0,4194304] 0 2024-09-19T07:24:57.105 INFO:tasks.workunit.client.0.smithi098.stdout:2/386: mknod d1/d5/d34/d80/c86 0 2024-09-19T07:24:57.105 INFO:tasks.workunit.client.0.smithi098.stdout:2/387: readlink d1/d5/d34/d39/l5d 0 2024-09-19T07:24:57.106 INFO:tasks.workunit.client.0.smithi098.stdout:9/441: dwrite d3/dc/df/d15/d1a/d2b/f33 [0,4194304] 0 2024-09-19T07:24:57.106 INFO:tasks.workunit.client.0.smithi098.stdout:1/499: dread dc/d17/d1b/d1d/f3f [0,4194304] 0 2024-09-19T07:24:57.106 INFO:tasks.workunit.client.0.smithi098.stdout:1/500: getdents dc/d17/d1b/d1d/d30/da3 0 2024-09-19T07:24:57.109 INFO:tasks.workunit.client.0.smithi098.stdout:8/421: dwrite d0/de/f15 [12582912,4194304] 0 2024-09-19T07:24:57.109 INFO:tasks.workunit.client.0.smithi098.stdout:8/422: chown d0/d16/d65/l89 14122331 1 2024-09-19T07:24:57.111 INFO:tasks.workunit.client.0.smithi098.stdout:2/388: symlink d1/d5/d34/d76/l87 0 2024-09-19T07:24:57.111 INFO:tasks.workunit.client.0.smithi098.stdout:6/442: read d2/d5/d1f/d26/f55 [704236,105275] 0 2024-09-19T07:24:57.114 INFO:tasks.workunit.client.0.smithi098.stdout:9/442: write d3/d16/d43/d61/f66 [516021,54765] 0 2024-09-19T07:24:57.118 INFO:tasks.workunit.client.0.smithi098.stdout:3/441: link de/df/d1f/c54 de/d4e/d6d/c80 0 2024-09-19T07:24:57.120 INFO:tasks.workunit.client.0.smithi098.stdout:3/442: creat de/df/d1f/d2b/f81 x:0 0 0 2024-09-19T07:24:57.126 INFO:tasks.workunit.client.0.smithi098.stdout:9/443: creat d3/d6/f91 x:0 0 0 2024-09-19T07:24:57.128 INFO:tasks.workunit.client.0.smithi098.stdout:3/443: truncate de/f1d 898956 0 2024-09-19T07:24:57.130 INFO:tasks.workunit.client.0.smithi098.stdout:2/389: dread d1/d9/f47 [4194304,4194304] 0 2024-09-19T07:24:57.131 INFO:tasks.workunit.client.0.smithi098.stdout:9/444: rename d3/d16/d43/d61/d8c to d3/dc/df/d15/d1a/d2b/d92 0 2024-09-19T07:24:57.132 INFO:tasks.workunit.client.0.smithi098.stdout:3/444: rmdir de/df/d31 39 2024-09-19T07:24:57.132 INFO:tasks.workunit.client.0.smithi098.stdout:3/445: chown de/d4e/f6a 10622062 1 2024-09-19T07:24:57.133 INFO:tasks.workunit.client.0.smithi098.stdout:9/445: rename d3/d6/d46/f5e to d3/d16/d7b/d7e/f93 0 2024-09-19T07:24:57.136 INFO:tasks.workunit.client.0.smithi098.stdout:5/382: dwrite dc/f17 [0,4194304] 0 2024-09-19T07:24:57.136 INFO:tasks.workunit.client.0.smithi098.stdout:1/501: dwrite dc/f33 [8388608,4194304] 0 2024-09-19T07:24:57.137 INFO:tasks.workunit.client.0.smithi098.stdout:1/502: fsync dc/de/d22/d31/d5d/d6a/d6f/f56 0 2024-09-19T07:24:57.140 INFO:tasks.workunit.client.0.smithi098.stdout:0/506: dwrite d5/d20/f12 [8388608,4194304] 0 2024-09-19T07:24:57.140 INFO:tasks.workunit.client.0.smithi098.stdout:5/383: creat dc/de/d13/d46/d23/d52/f7b x:0 0 0 2024-09-19T07:24:57.140 INFO:tasks.workunit.client.0.smithi098.stdout:4/414: link da/c91 da/d31/d46/d56/d5b/c93 0 2024-09-19T07:24:57.142 INFO:tasks.workunit.client.0.smithi098.stdout:8/423: dwrite d0/d16/f3a [0,4194304] 0 2024-09-19T07:24:57.142 INFO:tasks.workunit.client.0.smithi098.stdout:8/424: dread - d0/f7e zero size 2024-09-19T07:24:57.142 INFO:tasks.workunit.client.0.smithi098.stdout:8/425: readlink d0/d2c/l5d 0 2024-09-19T07:24:57.143 INFO:tasks.workunit.client.0.smithi098.stdout:9/446: dread d3/d16/d43/d61/f66 [0,4194304] 0 2024-09-19T07:24:57.146 INFO:tasks.workunit.client.0.smithi098.stdout:0/507: rename d5/d20/d14/f32 to d5/d6b/d6d/f9b 0 2024-09-19T07:24:57.146 INFO:tasks.workunit.client.0.smithi098.stdout:9/447: dread d3/d16/d43/d61/f66 [0,4194304] 0 2024-09-19T07:24:57.148 INFO:tasks.workunit.client.0.smithi098.stdout:4/415: dread da/f1c [0,4194304] 0 2024-09-19T07:24:57.148 INFO:tasks.workunit.client.0.smithi098.stdout:4/416: truncate da/d31/f71 674162 0 2024-09-19T07:24:57.148 INFO:tasks.workunit.client.0.smithi098.stdout:4/417: chown da/d31/d46/d5f/f8d 293345260 1 2024-09-19T07:24:57.153 INFO:tasks.workunit.client.0.smithi098.stdout:8/426: write d0/d16/f3a [2534360,70920] 0 2024-09-19T07:24:57.154 INFO:tasks.workunit.client.0.smithi098.stdout:8/427: write d0/de/d28/f86 [390774,24821] 0 2024-09-19T07:24:57.154 INFO:tasks.workunit.client.0.smithi098.stdout:9/448: creat d3/dc/df/d15/d1a/d2b/d92/f94 x:0 0 0 2024-09-19T07:24:57.157 INFO:tasks.workunit.client.0.smithi098.stdout:2/390: dwrite d1/d9/d26/d35/d58/f32 [0,4194304] 0 2024-09-19T07:24:57.158 INFO:tasks.workunit.client.0.smithi098.stdout:9/449: truncate d3/d16/d38/f2e 3628165 0 2024-09-19T07:24:57.160 INFO:tasks.workunit.client.0.smithi098.stdout:1/503: dwrite dc/de/d22/d31/f5b [0,4194304] 0 2024-09-19T07:24:57.160 INFO:tasks.workunit.client.0.smithi098.stdout:1/504: write dc/d17/d1b/d71/d7a/f7b [1060166,43201] 0 2024-09-19T07:24:57.162 INFO:tasks.workunit.client.0.smithi098.stdout:1/505: creat dc/de/d22/d31/d5d/d6a/d6f/d5f/faf x:0 0 0 2024-09-19T07:24:57.162 INFO:tasks.workunit.client.0.smithi098.stdout:1/506: read - dc/de/d22/f8c zero size 2024-09-19T07:24:57.163 INFO:tasks.workunit.client.0.smithi098.stdout:3/446: rmdir de/df/d1f 39 2024-09-19T07:24:57.163 INFO:tasks.workunit.client.0.smithi098.stdout:1/507: dread dc/de/d22/d31/d35/d4f/f7e [0,4194304] 0 2024-09-19T07:24:57.163 INFO:tasks.workunit.client.0.smithi098.stdout:1/508: chown dc/de/d22/d31/d5d/d6a/d6f/l52 294315515 1 2024-09-19T07:24:57.164 INFO:tasks.workunit.client.0.smithi098.stdout:2/391: mkdir d1/d9/d26/d35/d88 0 2024-09-19T07:24:57.166 INFO:tasks.workunit.client.0.smithi098.stdout:9/450: creat d3/d16/d38/d22/f95 x:0 0 0 2024-09-19T07:24:57.168 INFO:tasks.workunit.client.0.smithi098.stdout:9/451: creat d3/d16/d38/d48/f96 x:0 0 0 2024-09-19T07:24:57.169 INFO:tasks.workunit.client.0.smithi098.stdout:2/392: dread d1/d9/d26/d35/d58/f5b [0,4194304] 0 2024-09-19T07:24:57.171 INFO:tasks.workunit.client.0.smithi098.stdout:9/452: symlink d3/dc/df/d15/d1a/d2d/l97 0 2024-09-19T07:24:57.171 INFO:tasks.workunit.client.0.smithi098.stdout:3/447: write de/df/d31/f5b [855470,47418] 0 2024-09-19T07:24:57.172 INFO:tasks.workunit.client.0.smithi098.stdout:9/453: read d3/d16/f3c [915231,23829] 0 2024-09-19T07:24:57.172 INFO:tasks.workunit.client.0.smithi098.stdout:9/454: readlink d3/d16/l59 0 2024-09-19T07:24:57.172 INFO:tasks.workunit.client.0.smithi098.stdout:5/384: dwrite dc/de/d13/f27 [0,4194304] 0 2024-09-19T07:24:57.173 INFO:tasks.workunit.client.0.smithi098.stdout:8/428: rename d0/de to d0/d33/d55/d8a 0 2024-09-19T07:24:57.173 INFO:tasks.workunit.client.0.smithi098.stdout:2/393: dread d1/f57 [4194304,4194304] 0 2024-09-19T07:24:57.173 INFO:tasks.workunit.client.0.smithi098.stdout:2/394: chown d1/d9/f33 30811761 1 2024-09-19T07:24:57.173 INFO:tasks.workunit.client.0.smithi098.stdout:3/448: mknod de/df/d31/d61/c82 0 2024-09-19T07:24:57.173 INFO:tasks.workunit.client.0.smithi098.stdout:3/449: chown de/df/d1f/d2b/c43 49 1 2024-09-19T07:24:57.175 INFO:tasks.workunit.client.0.smithi098.stdout:2/395: mknod d1/d9/d26/d35/c89 0 2024-09-19T07:24:57.176 INFO:tasks.workunit.client.0.smithi098.stdout:2/396: mknod d1/d5/d34/d76/c8a 0 2024-09-19T07:24:57.176 INFO:tasks.workunit.client.0.smithi098.stdout:2/397: dread - d1/d9/d26/d35/d48/d49/f74 zero size 2024-09-19T07:24:57.178 INFO:tasks.workunit.client.0.smithi098.stdout:2/398: rename d1/d9/d3e/c20 to d1/d5/c8b 0 2024-09-19T07:24:57.179 INFO:tasks.workunit.client.0.smithi098.stdout:2/399: truncate d1/d9/f33 3454288 0 2024-09-19T07:24:57.179 INFO:tasks.workunit.client.0.smithi098.stdout:2/400: chown d1/d5/d34 7674605 1 2024-09-19T07:24:57.179 INFO:tasks.workunit.client.0.smithi098.stdout:3/450: rename de/df/d1f/f60 to de/df/d1f/f83 0 2024-09-19T07:24:57.179 INFO:tasks.workunit.client.0.smithi098.stdout:3/451: truncate de/df/d1f/d2b/f77 960316 0 2024-09-19T07:24:57.181 INFO:tasks.workunit.client.0.smithi098.stdout:2/401: mkdir d1/d9/d1d/d8c 0 2024-09-19T07:24:57.182 INFO:tasks.workunit.client.0.smithi098.stdout:2/402: truncate d1/d9/d26/d35/d58/f4d 3030683 0 2024-09-19T07:24:57.182 INFO:tasks.workunit.client.0.smithi098.stdout:2/403: chown d1/d5/d34/d80 5480 1 2024-09-19T07:24:57.182 INFO:tasks.workunit.client.0.smithi098.stdout:2/404: dread - d1/d5/d34/d5a/f7e zero size 2024-09-19T07:24:57.186 INFO:tasks.workunit.client.0.smithi098.stdout:0/508: dwrite d5/d20/d1f/d52/d64/d77/d79/d94/f99 [0,4194304] 0 2024-09-19T07:24:57.186 INFO:tasks.workunit.client.0.smithi098.stdout:4/418: dwrite da/d31/f39 [0,4194304] 0 2024-09-19T07:24:57.186 INFO:tasks.workunit.client.0.smithi098.stdout:9/455: dread d3/dc/df/d15/d1b/f37 [0,4194304] 0 2024-09-19T07:24:57.196 INFO:tasks.workunit.client.0.smithi098.stdout:3/452: write de/f28 [6625167,34997] 0 2024-09-19T07:24:57.196 INFO:tasks.workunit.client.0.smithi098.stdout:3/453: chown de/df/d1f/d2b/f39 1016891 1 2024-09-19T07:24:57.196 INFO:tasks.workunit.client.0.smithi098.stdout:3/454: write de/df/d31/f5c [4820871,10736] 0 2024-09-19T07:24:57.196 INFO:tasks.workunit.client.0.smithi098.stdout:1/509: dwrite dc/d17/d1b/d71/d7a/f7b [0,4194304] 0 2024-09-19T07:24:57.198 INFO:tasks.workunit.client.0.smithi098.stdout:9/456: creat d3/dc/df/d15/d1a/d2b/d49/d50/f98 x:0 0 0 2024-09-19T07:24:57.200 INFO:tasks.workunit.client.0.smithi098.stdout:8/429: rename d0/d33/d55/d8a/d21/l63 to d0/d2c/d81/l8b 0 2024-09-19T07:24:57.201 INFO:tasks.workunit.client.0.smithi098.stdout:0/509: dread d5/d20/f4e [0,4194304] 0 2024-09-19T07:24:57.202 INFO:tasks.workunit.client.0.smithi098.stdout:1/510: write dc/f98 [74906,111846] 0 2024-09-19T07:24:57.202 INFO:tasks.workunit.client.0.smithi098.stdout:1/511: write dc/de/d22/d31/d5d/d6a/d6f/d4d/f73 [911940,71721] 0 2024-09-19T07:24:57.202 INFO:tasks.workunit.client.0.smithi098.stdout:1/512: write dc/d2a/f67 [923554,45937] 0 2024-09-19T07:24:57.202 INFO:tasks.workunit.client.0.smithi098.stdout:1/513: chown dc/d17/d1b/d1d/d3d/d87 24343 1 2024-09-19T07:24:57.202 INFO:tasks.workunit.client.0.smithi098.stdout:1/514: truncate dc/de/d50/f94 720704 0 2024-09-19T07:24:57.202 INFO:tasks.workunit.client.0.smithi098.stdout:1/515: write dc/d17/f76 [883168,16353] 0 2024-09-19T07:24:57.204 INFO:tasks.workunit.client.0.smithi098.stdout:2/405: truncate d1/d9/d26/d35/d58/f4d 3821052 0 2024-09-19T07:24:57.204 INFO:tasks.workunit.client.0.smithi098.stdout:2/406: readlink d1/d9/d26/d5c/l5f 0 2024-09-19T07:24:57.206 INFO:tasks.workunit.client.0.smithi098.stdout:5/385: dwrite dc/de/d13/d3b/d6a/f76 [0,4194304] 0 2024-09-19T07:24:57.207 INFO:tasks.workunit.client.0.smithi098.stdout:9/457: rename d3/d16/d7b/d7e/f93 to d3/dc/df/d31/f99 0 2024-09-19T07:24:57.208 INFO:tasks.workunit.client.0.smithi098.stdout:8/430: symlink d0/d16/l8c 0 2024-09-19T07:24:57.209 INFO:tasks.workunit.client.0.smithi098.stdout:4/419: write da/f1e [2504732,111191] 0 2024-09-19T07:24:57.209 INFO:tasks.workunit.client.0.smithi098.stdout:2/407: creat d1/d9/d3e/f8d x:0 0 0 2024-09-19T07:24:57.209 INFO:tasks.workunit.client.0.smithi098.stdout:2/408: fsync d1/d9/d26/f59 0 2024-09-19T07:24:57.210 INFO:tasks.workunit.client.0.smithi098.stdout:4/420: symlink da/d31/d46/d56/d5b/d63/l94 0 2024-09-19T07:24:57.210 INFO:tasks.workunit.client.0.smithi098.stdout:4/421: write da/d59/d5d/d82/f88 [660774,81794] 0 2024-09-19T07:24:57.211 INFO:tasks.workunit.client.0.smithi098.stdout:4/422: write da/d31/d46/d56/d5b/f69 [495617,106830] 0 2024-09-19T07:24:57.211 INFO:tasks.workunit.client.0.smithi098.stdout:4/423: write da/d59/f6f [3217373,73004] 0 2024-09-19T07:24:57.216 INFO:tasks.workunit.client.0.smithi098.stdout:7/578: sync 2024-09-19T07:24:57.216 INFO:tasks.workunit.client.0.smithi098.stdout:7/579: write d5/d8/d52/fbc [1045603,31727] 0 2024-09-19T07:24:57.219 INFO:tasks.workunit.client.0.smithi098.stdout:5/386: creat dc/de/d13/d3b/d6a/f7c x:0 0 0 2024-09-19T07:24:57.222 INFO:tasks.workunit.client.0.smithi098.stdout:7/580: write d5/d8/d8e/d59/f63 [1138861,18571] 0 2024-09-19T07:24:57.225 INFO:tasks.workunit.client.0.smithi098.stdout:2/409: link d1/d9/d26/d35/d48/d49/f66 d1/d5/d34/d5a/d42/f8e 0 2024-09-19T07:24:57.225 INFO:tasks.workunit.client.0.smithi098.stdout:2/410: dread - d1/d5/d34/d39/f75 zero size 2024-09-19T07:24:57.226 INFO:tasks.workunit.client.0.smithi098.stdout:8/431: rmdir d0/d16/d65 39 2024-09-19T07:24:57.226 INFO:tasks.workunit.client.0.smithi098.stdout:6/443: sync 2024-09-19T07:24:57.227 INFO:tasks.workunit.client.0.smithi098.stdout:6/444: rmdir d2/d5/d1f/d26/d42/d48/d53 39 2024-09-19T07:24:57.229 INFO:tasks.workunit.client.0.smithi098.stdout:8/432: creat d0/d33/d55/d8a/f8d x:0 0 0 2024-09-19T07:24:57.229 INFO:tasks.workunit.client.0.smithi098.stdout:8/433: dread - d0/d2c/f5e zero size 2024-09-19T07:24:57.229 INFO:tasks.workunit.client.0.smithi098.stdout:8/434: chown d0/d33/d55/d8a/d21 9 1 2024-09-19T07:24:57.229 INFO:tasks.workunit.client.0.smithi098.stdout:8/435: fsync d0/d2c/f5e 0 2024-09-19T07:24:57.229 INFO:tasks.workunit.client.0.smithi098.stdout:7/581: rmdir d5/d10/d1d 39 2024-09-19T07:24:57.229 INFO:tasks.workunit.client.0.smithi098.stdout:7/582: dread - d5/d10/dc2/f96 zero size 2024-09-19T07:24:57.229 INFO:tasks.workunit.client.0.smithi098.stdout:6/445: creat d2/d5/d1f/d26/d42/d48/fab x:0 0 0 2024-09-19T07:24:57.229 INFO:tasks.workunit.client.0.smithi098.stdout:7/583: write d5/d8/dc/d16/f7e [576080,64674] 0 2024-09-19T07:24:57.230 INFO:tasks.workunit.client.0.smithi098.stdout:8/436: rmdir d0/d33/d55/d8a/d12 39 2024-09-19T07:24:57.231 INFO:tasks.workunit.client.0.smithi098.stdout:6/446: creat d2/d5/d1f/d26/d42/d48/d4a/d4e/d6e/d9d/d94/fac x:0 0 0 2024-09-19T07:24:57.231 INFO:tasks.workunit.client.0.smithi098.stdout:6/447: write d2/d1b/f77 [1287851,50880] 0 2024-09-19T07:24:57.231 INFO:tasks.workunit.client.0.smithi098.stdout:6/448: truncate d2/d5/d1f/f83 1212252 0 2024-09-19T07:24:57.238 INFO:tasks.workunit.client.0.smithi098.stdout:6/449: write f1 [3361405,5152] 0 2024-09-19T07:24:57.239 INFO:tasks.workunit.client.0.smithi098.stdout:6/450: mknod d2/d5/d1f/d26/d42/cad 0 2024-09-19T07:24:57.240 INFO:tasks.workunit.client.0.smithi098.stdout:6/451: truncate d2/d11/f91 180477 0 2024-09-19T07:24:57.242 INFO:tasks.workunit.client.0.smithi098.stdout:8/437: dread d0/d16/f23 [0,4194304] 0 2024-09-19T07:24:57.243 INFO:tasks.workunit.client.0.smithi098.stdout:4/424: dwrite f9 [0,4194304] 0 2024-09-19T07:24:57.243 INFO:tasks.workunit.client.0.smithi098.stdout:9/458: dwrite d3/dc/df/d15/d1a/d2b/d49/d65/f7c [0,4194304] 0 2024-09-19T07:24:57.248 INFO:tasks.workunit.client.0.smithi098.stdout:8/438: getdents d0/d33/d55/d8a 0 2024-09-19T07:24:57.250 INFO:tasks.workunit.client.0.smithi098.stdout:5/387: dwrite dc/f17 [8388608,4194304] 0 2024-09-19T07:24:57.251 INFO:tasks.workunit.client.0.smithi098.stdout:6/452: dread d2/d1b/f1d [0,4194304] 0 2024-09-19T07:24:57.252 INFO:tasks.workunit.client.0.smithi098.stdout:8/439: symlink d0/d16/l8e 0 2024-09-19T07:24:57.253 INFO:tasks.workunit.client.0.smithi098.stdout:8/440: stat d0/d2c/d81/l8b 0 2024-09-19T07:24:57.256 INFO:tasks.workunit.client.0.smithi098.stdout:8/441: symlink d0/d33/d44/l8f 0 2024-09-19T07:24:57.257 INFO:tasks.workunit.client.0.smithi098.stdout:5/388: dread f4 [0,4194304] 0 2024-09-19T07:24:57.257 INFO:tasks.workunit.client.0.smithi098.stdout:5/389: chown dc 27 1 2024-09-19T07:24:57.258 INFO:tasks.workunit.client.0.smithi098.stdout:5/390: mkdir dc/de/d13/d7d 0 2024-09-19T07:24:57.263 INFO:tasks.workunit.client.0.smithi098.stdout:1/516: rename dc/d17/d1b/d71/d9a to dc/de/d22/d31/d5d/d6a/d6f/d5f/db0 0 2024-09-19T07:24:57.266 INFO:tasks.workunit.client.0.smithi098.stdout:7/584: dwrite d5/d3e/f95 [0,4194304] 0 2024-09-19T07:24:57.266 INFO:tasks.workunit.client.0.smithi098.stdout:7/585: fsync d5/d8/f34 0 2024-09-19T07:24:57.267 INFO:tasks.workunit.client.0.smithi098.stdout:0/510: dwrite d5/d20/d14/d49/d62/f6e [0,4194304] 0 2024-09-19T07:24:57.271 INFO:tasks.workunit.client.0.smithi098.stdout:2/411: dwrite d1/d9/d26/d35/d58/f25 [0,4194304] 0 2024-09-19T07:24:57.273 INFO:tasks.workunit.client.0.smithi098.stdout:8/442: write d0/d16/f79 [3401814,32765] 0 2024-09-19T07:24:57.273 INFO:tasks.workunit.client.0.smithi098.stdout:8/443: fsync d0/d33/d55/d8a/f18 0 2024-09-19T07:24:57.275 INFO:tasks.workunit.client.0.smithi098.stdout:2/412: mknod d1/d5/d34/d5a/d42/d4e/c8f 0 2024-09-19T07:24:57.275 INFO:tasks.workunit.client.0.smithi098.stdout:2/413: write d1/d9/f47 [5532645,94791] 0 2024-09-19T07:24:57.275 INFO:tasks.workunit.client.0.smithi098.stdout:2/414: fdatasync d1/d5/d34/f7c 0 2024-09-19T07:24:57.277 INFO:tasks.workunit.client.0.smithi098.stdout:9/459: dwrite d3/d16/d38/d22/f95 [0,4194304] 0 2024-09-19T07:24:57.277 INFO:tasks.workunit.client.0.smithi098.stdout:5/391: dread dc/f29 [0,4194304] 0 2024-09-19T07:24:57.279 INFO:tasks.workunit.client.0.smithi098.stdout:5/392: dread dc/de/d13/d46/d23/f5f [0,4194304] 0 2024-09-19T07:24:57.279 INFO:tasks.workunit.client.0.smithi098.stdout:9/460: creat d3/dc/df/d15/d1b/f9a x:0 0 0 2024-09-19T07:24:57.279 INFO:tasks.workunit.client.0.smithi098.stdout:9/461: chown d3/dc/df/d15/d1a/d2b/d49/d50/f98 6820 1 2024-09-19T07:24:57.281 INFO:tasks.workunit.client.0.smithi098.stdout:5/393: link dc/de/d13/d3b/f56 dc/de/d13/f7e 0 2024-09-19T07:24:57.282 INFO:tasks.workunit.client.0.smithi098.stdout:2/415: link d1/d9/d1d/l29 d1/d9/d3e/d41/d60/d65/l90 0 2024-09-19T07:24:57.283 INFO:tasks.workunit.client.0.smithi098.stdout:5/394: mknod dc/de/d13/d5c/c7f 0 2024-09-19T07:24:57.284 INFO:tasks.workunit.client.0.smithi098.stdout:2/416: mkdir d1/d9/d26/d35/d91 0 2024-09-19T07:24:57.285 INFO:tasks.workunit.client.0.smithi098.stdout:2/417: symlink d1/d5/d34/d5a/l92 0 2024-09-19T07:24:57.286 INFO:tasks.workunit.client.0.smithi098.stdout:8/444: write d0/d33/d55/d8a/f18 [3155957,12502] 0 2024-09-19T07:24:57.286 INFO:tasks.workunit.client.0.smithi098.stdout:8/445: readlink d0/d33/d55/d8a/d28/d40/l4d 0 2024-09-19T07:24:57.286 INFO:tasks.workunit.client.0.smithi098.stdout:8/446: write d0/d33/f6e [1014106,65933] 0 2024-09-19T07:24:57.288 INFO:tasks.workunit.client.0.smithi098.stdout:1/517: rename dc/d17/d1b/d1d/d3d/d87 to dc/de/d38/db1 0 2024-09-19T07:24:57.289 INFO:tasks.workunit.client.0.smithi098.stdout:1/518: stat dc/d17/d1b/d1d/cab 0 2024-09-19T07:24:57.289 INFO:tasks.workunit.client.0.smithi098.stdout:8/447: mknod d0/d33/d55/c90 0 2024-09-19T07:24:57.289 INFO:tasks.workunit.client.0.smithi098.stdout:8/448: dread - d0/d33/d55/d8a/d21/d50/f5a zero size 2024-09-19T07:24:57.289 INFO:tasks.workunit.client.0.smithi098.stdout:8/449: write d0/f7e [916205,74398] 0 2024-09-19T07:24:57.289 INFO:tasks.workunit.client.0.smithi098.stdout:9/462: rename d3/d16/d38/c40 to d3/d16/d43/d51/c9b 0 2024-09-19T07:24:57.289 INFO:tasks.workunit.client.0.smithi098.stdout:9/463: write d3/dc/df/d15/d2f/f5f [5273430,66798] 0 2024-09-19T07:24:57.290 INFO:tasks.workunit.client.0.smithi098.stdout:9/464: chown d3/dc/df/d15/d1b 2065 1 2024-09-19T07:24:57.292 INFO:tasks.workunit.client.0.smithi098.stdout:2/418: rename d1/d9/d26/d35/d48/d49 to d1/d5/d34/d80/d93 0 2024-09-19T07:24:57.292 INFO:tasks.workunit.client.0.smithi098.stdout:8/450: dread d0/d16/f23 [0,4194304] 0 2024-09-19T07:24:57.294 INFO:tasks.workunit.client.0.smithi098.stdout:7/586: dwrite d5/d3e/d62/fb1 [0,4194304] 0 2024-09-19T07:24:57.297 INFO:tasks.workunit.client.0.smithi098.stdout:5/395: write f0 [2384357,14603] 0 2024-09-19T07:24:57.300 INFO:tasks.workunit.client.0.smithi098.stdout:2/419: dread d1/d9/f2d [0,4194304] 0 2024-09-19T07:24:57.301 INFO:tasks.workunit.client.0.smithi098.stdout:2/420: fsync d1/d9/d26/d35/d48/f52 0 2024-09-19T07:24:57.301 INFO:tasks.workunit.client.0.smithi098.stdout:0/511: dwrite d5/f48 [0,4194304] 0 2024-09-19T07:24:57.301 INFO:tasks.workunit.client.0.smithi098.stdout:0/512: write d5/d6b/d6d/f9b [474170,94884] 0 2024-09-19T07:24:57.301 INFO:tasks.workunit.client.0.smithi098.stdout:9/465: read d3/d16/d38/f4f [1261107,87944] 0 2024-09-19T07:24:57.301 INFO:tasks.workunit.client.0.smithi098.stdout:5/396: link dc/de/l30 dc/de/d13/d3b/l80 0 2024-09-19T07:24:57.301 INFO:tasks.workunit.client.0.smithi098.stdout:5/397: truncate dc/f79 198902 0 2024-09-19T07:24:57.303 INFO:tasks.workunit.client.0.smithi098.stdout:0/513: read d5/d20/d14/f4a [659654,63688] 0 2024-09-19T07:24:57.303 INFO:tasks.workunit.client.0.smithi098.stdout:1/519: rename dc/de/d50/c62 to dc/de/d22/d31/d5d/d6a/d6f/cb2 0 2024-09-19T07:24:57.303 INFO:tasks.workunit.client.0.smithi098.stdout:1/520: dread - dc/d17/d1b/d1d/d30/f7f zero size 2024-09-19T07:24:57.305 INFO:tasks.workunit.client.0.smithi098.stdout:1/521: symlink dc/de/d22/d31/d5d/d6a/d8b/lb3 0 2024-09-19T07:24:57.305 INFO:tasks.workunit.client.0.smithi098.stdout:2/421: fsync d1/d9/d1d/f4a 0 2024-09-19T07:24:57.308 INFO:tasks.workunit.client.0.smithi098.stdout:9/466: getdents d3/d16/d7b/d7e 0 2024-09-19T07:24:57.309 INFO:tasks.workunit.client.0.smithi098.stdout:1/522: read dc/de/d22/d31/f4c [502322,53464] 0 2024-09-19T07:24:57.309 INFO:tasks.workunit.client.0.smithi098.stdout:2/422: rmdir d1/d5/d34/d80/d93/d61 39 2024-09-19T07:24:57.313 INFO:tasks.workunit.client.0.smithi098.stdout:9/467: rename d3/dc/df/d31/f99 to d3/dc/df/d15/d1a/f9c 0 2024-09-19T07:24:57.315 INFO:tasks.workunit.client.0.smithi098.stdout:2/423: creat d1/d9/d26/d35/d91/f94 x:0 0 0 2024-09-19T07:24:57.315 INFO:tasks.workunit.client.0.smithi098.stdout:2/424: chown d1/d5/d34/d39/c78 18 1 2024-09-19T07:24:57.316 INFO:tasks.workunit.client.0.smithi098.stdout:9/468: creat d3/d16/d38/d48/f9d x:0 0 0 2024-09-19T07:24:57.316 INFO:tasks.workunit.client.0.smithi098.stdout:9/469: write d3/d16/d38/f4f [369310,113157] 0 2024-09-19T07:24:57.318 INFO:tasks.workunit.client.0.smithi098.stdout:2/425: mknod d1/d9/d3e/d41/c95 0 2024-09-19T07:24:57.318 INFO:tasks.workunit.client.0.smithi098.stdout:9/470: mknod d3/d30/d73/c9e 0 2024-09-19T07:24:57.321 INFO:tasks.workunit.client.0.smithi098.stdout:7/587: dwrite d5/d3e/d62/f65 [0,4194304] 0 2024-09-19T07:24:57.321 INFO:tasks.workunit.client.0.smithi098.stdout:8/451: dwrite d0/f25 [0,4194304] 0 2024-09-19T07:24:57.321 INFO:tasks.workunit.client.0.smithi098.stdout:7/588: truncate d5/d8/dc/faf 3653249 0 2024-09-19T07:24:57.321 INFO:tasks.workunit.client.0.smithi098.stdout:7/589: fdatasync d5/d8/d5d/f7d 0 2024-09-19T07:24:57.323 INFO:tasks.workunit.client.0.smithi098.stdout:7/590: truncate d5/d8/dc/fb2 3417753 0 2024-09-19T07:24:57.326 INFO:tasks.workunit.client.0.smithi098.stdout:7/591: mkdir d5/dce 0 2024-09-19T07:24:57.326 INFO:tasks.workunit.client.0.smithi098.stdout:7/592: chown d5/d10/d11/fb8 3796937 1 2024-09-19T07:24:57.326 INFO:tasks.workunit.client.0.smithi098.stdout:7/593: truncate d5/d8/dc/d16/fb4 109943 0 2024-09-19T07:24:57.330 INFO:tasks.workunit.client.0.smithi098.stdout:9/471: dread d3/d16/d38/d22/f95 [0,4194304] 0 2024-09-19T07:24:57.330 INFO:tasks.workunit.client.0.smithi098.stdout:9/472: write d3/dc/df/d15/d1a/f9c [3092539,13289] 0 2024-09-19T07:24:57.350 INFO:tasks.workunit.client.0.smithi098.stdout:0/514: dwrite d5/d6b/d6d/f9b [0,4194304] 0 2024-09-19T07:24:57.350 INFO:tasks.workunit.client.0.smithi098.stdout:2/426: dwrite d1/d5/d34/d5a/f51 [0,4194304] 0 2024-09-19T07:24:57.352 INFO:tasks.workunit.client.0.smithi098.stdout:0/515: creat d5/d20/d1f/d8d/f9c x:0 0 0 2024-09-19T07:24:57.353 INFO:tasks.workunit.client.0.smithi098.stdout:1/523: dwrite dc/de/d22/d31/d5d/d6a/d6f/d5f/f91 [0,4194304] 0 2024-09-19T07:24:57.355 INFO:tasks.workunit.client.0.smithi098.stdout:1/524: creat dc/de/d22/d31/fb4 x:0 0 0 2024-09-19T07:24:57.356 INFO:tasks.workunit.client.0.smithi098.stdout:0/516: rename d5/d20/ld to d5/d6b/l9d 0 2024-09-19T07:24:57.356 INFO:tasks.workunit.client.0.smithi098.stdout:0/517: truncate d5/d20/f10 1258997 0 2024-09-19T07:24:57.356 INFO:tasks.workunit.client.0.smithi098.stdout:0/518: stat d5/d20/d14/d49 0 2024-09-19T07:24:57.357 INFO:tasks.workunit.client.0.smithi098.stdout:7/594: dwrite d5/d3e/d62/f7a [0,4194304] 0 2024-09-19T07:24:57.358 INFO:tasks.workunit.client.0.smithi098.stdout:0/519: unlink d5/d20/d14/d49/c57 0 2024-09-19T07:24:57.360 INFO:tasks.workunit.client.0.smithi098.stdout:7/595: creat d5/d10/dc2/dbd/fcf x:0 0 0 2024-09-19T07:24:57.360 INFO:tasks.workunit.client.0.smithi098.stdout:7/596: write d5/d8/d52/f60 [2230610,55133] 0 2024-09-19T07:24:57.361 INFO:tasks.workunit.client.0.smithi098.stdout:0/520: creat d5/d20/d1f/d52/d64/d77/d79/f9e x:0 0 0 2024-09-19T07:24:57.363 INFO:tasks.workunit.client.0.smithi098.stdout:3/455: sync 2024-09-19T07:24:57.363 INFO:tasks.workunit.client.0.smithi098.stdout:3/456: write de/f1a [2575716,1761] 0 2024-09-19T07:24:57.364 INFO:tasks.workunit.client.0.smithi098.stdout:0/521: dread d5/d20/f1b [0,4194304] 0 2024-09-19T07:24:57.364 INFO:tasks.workunit.client.0.smithi098.stdout:0/522: dread - d5/d20/d1f/d52/d64/d77/d79/f9e zero size 2024-09-19T07:24:57.365 INFO:tasks.workunit.client.0.smithi098.stdout:0/523: stat d5/d20/d14/l28 0 2024-09-19T07:24:57.365 INFO:tasks.workunit.client.0.smithi098.stdout:3/457: write de/df/d1f/d2b/f77 [860704,41577] 0 2024-09-19T07:24:57.365 INFO:tasks.workunit.client.0.smithi098.stdout:3/458: fdatasync de/f26 0 2024-09-19T07:24:57.365 INFO:tasks.workunit.client.0.smithi098.stdout:3/459: chown de/f2f 251426425 1 2024-09-19T07:24:57.365 INFO:tasks.workunit.client.0.smithi098.stdout:2/427: write d1/d5/f37 [193706,55060] 0 2024-09-19T07:24:57.365 INFO:tasks.workunit.client.0.smithi098.stdout:0/524: mkdir d5/d20/d1f/d52/d9f 0 2024-09-19T07:24:57.366 INFO:tasks.workunit.client.0.smithi098.stdout:0/525: chown d5/d20/d14/c70 26 1 2024-09-19T07:24:57.366 INFO:tasks.workunit.client.0.smithi098.stdout:3/460: mkdir de/df/d31/d61/d3f/d64/d84 0 2024-09-19T07:24:57.367 INFO:tasks.workunit.client.0.smithi098.stdout:0/526: mkdir d5/d20/d1f/d52/d64/da0 0 2024-09-19T07:24:57.369 INFO:tasks.workunit.client.0.smithi098.stdout:0/527: dread d5/d20/d1f/d52/d64/f81 [0,4194304] 0 2024-09-19T07:24:57.369 INFO:tasks.workunit.client.0.smithi098.stdout:3/461: creat de/df/d31/d61/d3f/f85 x:0 0 0 2024-09-19T07:24:57.369 INFO:tasks.workunit.client.0.smithi098.stdout:0/528: truncate d5/f4f 1798993 0 2024-09-19T07:24:57.369 INFO:tasks.workunit.client.0.smithi098.stdout:9/473: dwrite d3/d16/d38/f2e [0,4194304] 0 2024-09-19T07:24:57.369 INFO:tasks.workunit.client.0.smithi098.stdout:0/529: chown d5/d20/l36 386348775 1 2024-09-19T07:24:57.371 INFO:tasks.workunit.client.0.smithi098.stdout:0/530: rmdir d5/d20/d1f/d7d 39 2024-09-19T07:24:57.373 INFO:tasks.workunit.client.0.smithi098.stdout:9/474: symlink d3/dc/df/l9f 0 2024-09-19T07:24:57.373 INFO:tasks.workunit.client.0.smithi098.stdout:9/475: read - d3/dc/df/d15/d1b/f9a zero size 2024-09-19T07:24:57.373 INFO:tasks.workunit.client.0.smithi098.stdout:9/476: chown d3/d6 6095 1 2024-09-19T07:24:57.373 INFO:tasks.workunit.client.0.smithi098.stdout:9/477: dread - d3/d6/d8/f77 zero size 2024-09-19T07:24:57.373 INFO:tasks.workunit.client.0.smithi098.stdout:9/478: stat d3/d6/d8/c86 0 2024-09-19T07:24:57.373 INFO:tasks.workunit.client.0.smithi098.stdout:0/531: unlink d5/d20/f10 0 2024-09-19T07:24:57.374 INFO:tasks.workunit.client.0.smithi098.stdout:9/479: symlink d3/dc/la0 0 2024-09-19T07:24:57.375 INFO:tasks.workunit.client.0.smithi098.stdout:0/532: mknod d5/d20/d14/ca1 0 2024-09-19T07:24:57.375 INFO:tasks.workunit.client.0.smithi098.stdout:0/533: write d5/d20/d1f/d52/d64/f7a [824140,86445] 0 2024-09-19T07:24:57.375 INFO:tasks.workunit.client.0.smithi098.stdout:0/534: fdatasync d5/d6b/f89 0 2024-09-19T07:24:57.376 INFO:tasks.workunit.client.0.smithi098.stdout:9/480: stat d3/d6/ld 0 2024-09-19T07:24:57.376 INFO:tasks.workunit.client.0.smithi098.stdout:9/481: fsync d3/dc/df/d15/d1b/f29 0 2024-09-19T07:24:57.376 INFO:tasks.workunit.client.0.smithi098.stdout:1/525: dwrite dc/de/d37/f85 [0,4194304] 0 2024-09-19T07:24:57.377 INFO:tasks.workunit.client.0.smithi098.stdout:2/428: dread d1/d9/f1b [0,4194304] 0 2024-09-19T07:24:57.378 INFO:tasks.workunit.client.0.smithi098.stdout:0/535: rename d5/d20/l38 to d5/d6b/d6d/la2 0 2024-09-19T07:24:57.378 INFO:tasks.workunit.client.0.smithi098.stdout:1/526: symlink dc/de/d22/d31/lb5 0 2024-09-19T07:24:57.379 INFO:tasks.workunit.client.0.smithi098.stdout:9/482: symlink d3/d16/d38/d48/la1 0 2024-09-19T07:24:57.382 INFO:tasks.workunit.client.0.smithi098.stdout:2/429: creat d1/d5/d34/f96 x:0 0 0 2024-09-19T07:24:57.383 INFO:tasks.workunit.client.0.smithi098.stdout:0/536: creat d5/d20/d1f/d52/fa3 x:0 0 0 2024-09-19T07:24:57.386 INFO:tasks.workunit.client.0.smithi098.stdout:0/537: unlink d5/d20/d1f/l74 0 2024-09-19T07:24:57.388 INFO:tasks.workunit.client.0.smithi098.stdout:0/538: mknod d5/d20/d14/ca4 0 2024-09-19T07:24:57.390 INFO:tasks.workunit.client.0.smithi098.stdout:0/539: rmdir d5 39 2024-09-19T07:24:57.391 INFO:tasks.workunit.client.0.smithi098.stdout:0/540: fsync d5/d20/d14/d49/d62/f6e 0 2024-09-19T07:24:57.391 INFO:tasks.workunit.client.0.smithi098.stdout:0/541: fdatasync d5/d20/d14/d49/d62/f6e 0 2024-09-19T07:24:57.391 INFO:tasks.workunit.client.0.smithi098.stdout:0/542: fsync d5/f4f 0 2024-09-19T07:24:57.391 INFO:tasks.workunit.client.0.smithi098.stdout:0/543: chown f4 3065511 1 2024-09-19T07:24:57.392 INFO:tasks.workunit.client.0.smithi098.stdout:0/544: mknod d5/ca5 0 2024-09-19T07:24:57.392 INFO:tasks.workunit.client.0.smithi098.stdout:7/597: dwrite d5/d10/d50/f6c [0,4194304] 0 2024-09-19T07:24:57.392 INFO:tasks.workunit.client.0.smithi098.stdout:7/598: chown d5/d8/l18 233 1 2024-09-19T07:24:57.393 INFO:tasks.workunit.client.0.smithi098.stdout:0/545: mknod d5/d20/d1f/d52/d64/d77/d79/ca6 0 2024-09-19T07:24:57.394 INFO:tasks.workunit.client.0.smithi098.stdout:7/599: dread d5/d8/dc/fa4 [0,4194304] 0 2024-09-19T07:24:57.395 INFO:tasks.workunit.client.0.smithi098.stdout:7/600: creat d5/d3e/d61/fd0 x:0 0 0 2024-09-19T07:24:57.396 INFO:tasks.workunit.client.0.smithi098.stdout:0/546: mkdir d5/d20/d14/d49/d62/da7 0 2024-09-19T07:24:57.396 INFO:tasks.workunit.client.0.smithi098.stdout:0/547: write d5/d20/d14/f35 [1810437,106109] 0 2024-09-19T07:24:57.398 INFO:tasks.workunit.client.0.smithi098.stdout:3/462: dwrite de/df/d1f/f56 [0,4194304] 0 2024-09-19T07:24:57.399 INFO:tasks.workunit.client.0.smithi098.stdout:4/425: sync 2024-09-19T07:24:57.400 INFO:tasks.workunit.client.0.smithi098.stdout:2/430: dread d1/d5/d34/d5a/f51 [0,4194304] 0 2024-09-19T07:24:57.400 INFO:tasks.workunit.client.0.smithi098.stdout:7/601: dread d5/d8/d52/fbc [0,4194304] 0 2024-09-19T07:24:57.400 INFO:tasks.workunit.client.0.smithi098.stdout:3/463: link de/df/d31/l32 de/df/d31/d61/d3f/d64/d84/l86 0 2024-09-19T07:24:57.400 INFO:tasks.workunit.client.0.smithi098.stdout:3/464: fsync de/d4e/f6a 0 2024-09-19T07:24:57.400 INFO:tasks.workunit.client.0.smithi098.stdout:4/426: mknod da/d7e/c95 0 2024-09-19T07:24:57.402 INFO:tasks.workunit.client.0.smithi098.stdout:2/431: truncate d1/d9/d1d/f4a 2538400 0 2024-09-19T07:24:57.404 INFO:tasks.workunit.client.0.smithi098.stdout:7/602: creat d5/d8/d52/db6/fd1 x:0 0 0 2024-09-19T07:24:57.404 INFO:tasks.workunit.client.0.smithi098.stdout:7/603: chown d5/d10/d1d/fc1 127275 1 2024-09-19T07:24:57.404 INFO:tasks.workunit.client.0.smithi098.stdout:7/604: truncate d5/d8/dc/d16/fb7 43306 0 2024-09-19T07:24:57.405 INFO:tasks.workunit.client.0.smithi098.stdout:9/483: dwrite d3/dc/df/d15/d1b/f9a [0,4194304] 0 2024-09-19T07:24:57.408 INFO:tasks.workunit.client.0.smithi098.stdout:9/484: symlink d3/dc/df/d15/d1a/d2b/d49/la2 0 2024-09-19T07:24:57.408 INFO:tasks.workunit.client.0.smithi098.stdout:3/465: write de/df/d31/f5c [2973980,78113] 0 2024-09-19T07:24:57.409 INFO:tasks.workunit.client.0.smithi098.stdout:9/485: mkdir d3/dc/df/da3 0 2024-09-19T07:24:57.412 INFO:tasks.workunit.client.0.smithi098.stdout:9/486: creat d3/dc/df/d15/d1b/fa4 x:0 0 0 2024-09-19T07:24:57.413 INFO:tasks.workunit.client.0.smithi098.stdout:3/466: truncate de/f1d 965527 0 2024-09-19T07:24:57.413 INFO:tasks.workunit.client.0.smithi098.stdout:4/427: dread da/f1d [0,4194304] 0 2024-09-19T07:24:57.415 INFO:tasks.workunit.client.0.smithi098.stdout:8/452: sync 2024-09-19T07:24:57.415 INFO:tasks.workunit.client.0.smithi098.stdout:6/453: sync 2024-09-19T07:24:57.415 INFO:tasks.workunit.client.0.smithi098.stdout:5/398: sync 2024-09-19T07:24:57.415 INFO:tasks.workunit.client.0.smithi098.stdout:1/527: link dc/de/d22/f4b dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/fb6 0 2024-09-19T07:24:57.415 INFO:tasks.workunit.client.0.smithi098.stdout:8/453: chown d0/f22 0 1 2024-09-19T07:24:57.415 INFO:tasks.workunit.client.0.smithi098.stdout:5/399: write dc/de/d13/d3b/f58 [475424,124968] 0 2024-09-19T07:24:57.419 INFO:tasks.workunit.client.0.smithi098.stdout:6/454: rename d2/fa5 to d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/fae 0 2024-09-19T07:24:57.419 INFO:tasks.workunit.client.0.smithi098.stdout:1/528: creat dc/de/fb7 x:0 0 0 2024-09-19T07:24:57.419 INFO:tasks.workunit.client.0.smithi098.stdout:1/529: dread - dc/de/d22/d31/d5d/d6a/d6f/d5f/faf zero size 2024-09-19T07:24:57.419 INFO:tasks.workunit.client.0.smithi098.stdout:6/455: mknod d2/d5/d1f/caf 0 2024-09-19T07:24:57.420 INFO:tasks.workunit.client.0.smithi098.stdout:1/530: truncate dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/f68 3853430 0 2024-09-19T07:24:57.426 INFO:tasks.workunit.client.0.smithi098.stdout:9/487: write d3/d16/d38/f2e [415893,14421] 0 2024-09-19T07:24:57.426 INFO:tasks.workunit.client.0.smithi098.stdout:9/488: write d3/dc/df/d15/d1b/f37 [4885102,57566] 0 2024-09-19T07:24:57.426 INFO:tasks.workunit.client.0.smithi098.stdout:9/489: read d3/dc/df/d15/d1a/f9c [520487,12758] 0 2024-09-19T07:24:57.426 INFO:tasks.workunit.client.0.smithi098.stdout:9/490: read d3/dc/df/d15/d2f/f5f [902603,118052] 0 2024-09-19T07:24:57.428 INFO:tasks.workunit.client.0.smithi098.stdout:8/454: dread d0/d16/f3f [4194304,4194304] 0 2024-09-19T07:24:57.428 INFO:tasks.workunit.client.0.smithi098.stdout:8/455: write d0/d16/f23 [4289974,11047] 0 2024-09-19T07:24:57.429 INFO:tasks.workunit.client.0.smithi098.stdout:9/491: symlink d3/dc/df/d15/d1a/d2b/d49/d74/la5 0 2024-09-19T07:24:57.429 INFO:tasks.workunit.client.0.smithi098.stdout:9/492: write d3/d16/d38/f4f [4013075,73825] 0 2024-09-19T07:24:57.429 INFO:tasks.workunit.client.0.smithi098.stdout:9/493: stat d3/dc/df/f4e 0 2024-09-19T07:24:57.429 INFO:tasks.workunit.client.0.smithi098.stdout:9/494: chown d3/dc/df/d15/d1a/d2b/f33 8122069 1 2024-09-19T07:24:57.431 INFO:tasks.workunit.client.0.smithi098.stdout:9/495: mkdir d3/d16/d43/d61/da6 0 2024-09-19T07:24:57.431 INFO:tasks.workunit.client.0.smithi098.stdout:2/432: dread d1/d9/f33 [0,4194304] 0 2024-09-19T07:24:57.431 INFO:tasks.workunit.client.0.smithi098.stdout:2/433: readlink d1/d5/d34/d80/d93/d61/l6c 0 2024-09-19T07:24:57.433 INFO:tasks.workunit.client.0.smithi098.stdout:0/548: dwrite d5/d20/d1f/d52/d64/f81 [0,4194304] 0 2024-09-19T07:24:57.433 INFO:tasks.workunit.client.0.smithi098.stdout:0/549: truncate d5/f3e 541602 0 2024-09-19T07:24:57.433 INFO:tasks.workunit.client.0.smithi098.stdout:9/496: mknod d3/d16/d43/d51/ca7 0 2024-09-19T07:24:57.434 INFO:tasks.workunit.client.0.smithi098.stdout:9/497: read d3/dc/df/d15/d1a/d2d/f42 [2219621,36303] 0 2024-09-19T07:24:57.435 INFO:tasks.workunit.client.0.smithi098.stdout:9/498: dread d3/d30/f88 [0,4194304] 0 2024-09-19T07:24:57.435 INFO:tasks.workunit.client.0.smithi098.stdout:0/550: symlink d5/d20/la8 0 2024-09-19T07:24:57.436 INFO:tasks.workunit.client.0.smithi098.stdout:9/499: creat d3/d16/d7b/d8a/fa8 x:0 0 0 2024-09-19T07:24:57.436 INFO:tasks.workunit.client.0.smithi098.stdout:9/500: chown d3/d16/d43/d61/c8b 0 1 2024-09-19T07:24:57.437 INFO:tasks.workunit.client.0.smithi098.stdout:0/551: creat d5/d20/d1f/d52/d64/d77/fa9 x:0 0 0 2024-09-19T07:24:57.437 INFO:tasks.workunit.client.0.smithi098.stdout:0/552: readlink d5/d20/d14/d49/d62/l73 0 2024-09-19T07:24:57.437 INFO:tasks.workunit.client.0.smithi098.stdout:9/501: mkdir d3/d6/d46/d83/da9 0 2024-09-19T07:24:57.438 INFO:tasks.workunit.client.0.smithi098.stdout:0/553: symlink d5/d20/d1f/d52/d64/laa 0 2024-09-19T07:24:57.438 INFO:tasks.workunit.client.0.smithi098.stdout:1/531: write dc/de/d22/d31/f5b [376367,85340] 0 2024-09-19T07:24:57.440 INFO:tasks.workunit.client.0.smithi098.stdout:7/605: dwrite d5/d10/fcd [0,4194304] 0 2024-09-19T07:24:57.440 INFO:tasks.workunit.client.0.smithi098.stdout:9/502: mknod d3/d6/caa 0 2024-09-19T07:24:57.440 INFO:tasks.workunit.client.0.smithi098.stdout:9/503: chown d3/d6/caa 61284276 1 2024-09-19T07:24:57.440 INFO:tasks.workunit.client.0.smithi098.stdout:9/504: readlink d3/dc/df/d15/d1a/d2b/d49/d74/la5 0 2024-09-19T07:24:57.440 INFO:tasks.workunit.client.0.smithi098.stdout:9/505: readlink d3/dc/df/d15/d1b/l72 0 2024-09-19T07:24:57.441 INFO:tasks.workunit.client.0.smithi098.stdout:3/467: dwrite de/df/f53 [0,4194304] 0 2024-09-19T07:24:57.442 INFO:tasks.workunit.client.0.smithi098.stdout:3/468: write de/f19 [2813936,82182] 0 2024-09-19T07:24:57.443 INFO:tasks.workunit.client.0.smithi098.stdout:9/506: symlink d3/d16/lab 0 2024-09-19T07:24:57.445 INFO:tasks.workunit.client.0.smithi098.stdout:3/469: unlink de/df/d4f/l65 0 2024-09-19T07:24:57.447 INFO:tasks.workunit.client.0.smithi098.stdout:4/428: dwrite da/d31/f71 [0,4194304] 0 2024-09-19T07:24:57.451 INFO:tasks.workunit.client.0.smithi098.stdout:4/429: mknod da/d31/d46/d56/d5b/d63/c96 0 2024-09-19T07:24:57.453 INFO:tasks.workunit.client.0.smithi098.stdout:2/434: dwrite d1/d9/d26/d35/d48/f52 [0,4194304] 0 2024-09-19T07:24:57.455 INFO:tasks.workunit.client.0.smithi098.stdout:2/435: read d1/d9/f2d [300297,58414] 0 2024-09-19T07:24:57.456 INFO:tasks.workunit.client.0.smithi098.stdout:5/400: rename dc/de/d13/d3b to dc/de/d13/d46/d2e/d37/d81 0 2024-09-19T07:24:57.457 INFO:tasks.workunit.client.0.smithi098.stdout:2/436: write d1/f8 [3970084,41112] 0 2024-09-19T07:24:57.461 INFO:tasks.workunit.client.0.smithi098.stdout:4/430: dread da/f1f [0,4194304] 0 2024-09-19T07:24:57.462 INFO:tasks.workunit.client.0.smithi098.stdout:2/437: mkdir d1/d97 0 2024-09-19T07:24:57.462 INFO:tasks.workunit.client.0.smithi098.stdout:2/438: chown d1/d5/c6f 7 1 2024-09-19T07:24:57.462 INFO:tasks.workunit.client.0.smithi098.stdout:2/439: creat d1/d9/d1d/f98 x:0 0 0 2024-09-19T07:24:57.464 INFO:tasks.workunit.client.0.smithi098.stdout:4/431: creat da/d7e/f97 x:0 0 0 2024-09-19T07:24:57.464 INFO:tasks.workunit.client.0.smithi098.stdout:4/432: write da/f1d [3218645,11135] 0 2024-09-19T07:24:57.464 INFO:tasks.workunit.client.0.smithi098.stdout:4/433: chown da/d31/d46/l70 333344714 1 2024-09-19T07:24:57.465 INFO:tasks.workunit.client.0.smithi098.stdout:6/456: rename d2/d5/d1f/d26/d42/d48/d4a to d2/db0 0 2024-09-19T07:24:57.467 INFO:tasks.workunit.client.0.smithi098.stdout:6/457: creat d2/d11/daa/fb1 x:0 0 0 2024-09-19T07:24:57.467 INFO:tasks.workunit.client.0.smithi098.stdout:6/458: write d2/d1b/d8f/f95 [142093,53728] 0 2024-09-19T07:24:57.468 INFO:tasks.workunit.client.0.smithi098.stdout:8/456: rename d0/f7 to d0/d33/d55/d8a/d28/d40/f91 0 2024-09-19T07:24:57.468 INFO:tasks.workunit.client.0.smithi098.stdout:8/457: chown d0/d16/d65/l89 334 1 2024-09-19T07:24:57.469 INFO:tasks.workunit.client.0.smithi098.stdout:8/458: mkdir d0/d33/d55/d8a/d21/d50/d92 0 2024-09-19T07:24:57.469 INFO:tasks.workunit.client.0.smithi098.stdout:7/606: dwrite d5/d3e/d62/f99 [0,4194304] 0 2024-09-19T07:24:57.470 INFO:tasks.workunit.client.0.smithi098.stdout:0/554: rename d5/d20/f51 to d5/d20/d14/d49/d62/da7/fab 0 2024-09-19T07:24:57.471 INFO:tasks.workunit.client.0.smithi098.stdout:7/607: link d5/d8/d52/f60 d5/dce/fd2 0 2024-09-19T07:24:57.477 INFO:tasks.workunit.client.0.smithi098.stdout:2/440: dread d1/d9/d26/d35/d58/f22 [0,4194304] 0 2024-09-19T07:24:57.477 INFO:tasks.workunit.client.0.smithi098.stdout:9/507: dwrite d3/d16/d7b/d8a/fa8 [0,4194304] 0 2024-09-19T07:24:57.477 INFO:tasks.workunit.client.0.smithi098.stdout:2/441: chown d1/d9/d3e/d41/d60/d65 25883047 1 2024-09-19T07:24:57.477 INFO:tasks.workunit.client.0.smithi098.stdout:0/555: dread d5/f30 [0,4194304] 0 2024-09-19T07:24:57.478 INFO:tasks.workunit.client.0.smithi098.stdout:1/532: rename dc/de/d50/f94 to dc/de/d22/d31/d5d/d6a/d6f/d5f/fb8 0 2024-09-19T07:24:57.479 INFO:tasks.workunit.client.0.smithi098.stdout:6/459: dread d2/d1b/f2f [0,4194304] 0 2024-09-19T07:24:57.481 INFO:tasks.workunit.client.0.smithi098.stdout:7/608: fdatasync d5/d3e/d62/da0/f8c 0 2024-09-19T07:24:57.481 INFO:tasks.workunit.client.0.smithi098.stdout:5/401: dwrite dc/de/d13/d46/f5a [0,4194304] 0 2024-09-19T07:24:57.481 INFO:tasks.workunit.client.0.smithi098.stdout:5/402: read dc/de/d36/f39 [3559749,64273] 0 2024-09-19T07:24:57.483 INFO:tasks.workunit.client.0.smithi098.stdout:1/533: dread dc/de/d22/d31/f4c [0,4194304] 0 2024-09-19T07:24:57.483 INFO:tasks.workunit.client.0.smithi098.stdout:6/460: mknod d2/db0/d8d/cb2 0 2024-09-19T07:24:57.483 INFO:tasks.workunit.client.0.smithi098.stdout:6/461: write d2/d5/d1f/d26/d42/d48/fab [426090,43429] 0 2024-09-19T07:24:57.483 INFO:tasks.workunit.client.0.smithi098.stdout:2/442: unlink d1/d5/d34/d5a/l92 0 2024-09-19T07:24:57.485 INFO:tasks.workunit.client.0.smithi098.stdout:7/609: truncate d5/d8/dc/fa4 383719 0 2024-09-19T07:24:57.485 INFO:tasks.workunit.client.0.smithi098.stdout:1/534: rmdir dc/de/d22/d31/d35/d58/d9f 0 2024-09-19T07:24:57.485 INFO:tasks.workunit.client.0.smithi098.stdout:1/535: fsync dc/d17/d1b/d1d/d30/f70 0 2024-09-19T07:24:57.485 INFO:tasks.workunit.client.0.smithi098.stdout:2/443: dread d1/d5/d34/f3d [0,4194304] 0 2024-09-19T07:24:57.485 INFO:tasks.workunit.client.0.smithi098.stdout:2/444: write d1/d9/d26/d35/d58/f4d [3288022,37606] 0 2024-09-19T07:24:57.485 INFO:tasks.workunit.client.0.smithi098.stdout:2/445: getdents d1/d9/d3e/d41/d60 0 2024-09-19T07:24:57.486 INFO:tasks.workunit.client.0.smithi098.stdout:6/462: truncate d2/d1b/f57 549865 0 2024-09-19T07:24:57.486 INFO:tasks.workunit.client.0.smithi098.stdout:7/610: symlink d5/dce/ld3 0 2024-09-19T07:24:57.486 INFO:tasks.workunit.client.0.smithi098.stdout:7/611: readlink d5/d8/dc/l2d 0 2024-09-19T07:24:57.487 INFO:tasks.workunit.client.0.smithi098.stdout:1/536: truncate dc/d2a/f51 2179752 0 2024-09-19T07:24:57.487 INFO:tasks.workunit.client.0.smithi098.stdout:6/463: mknod d2/db0/cb3 0 2024-09-19T07:24:57.487 INFO:tasks.workunit.client.0.smithi098.stdout:6/464: chown d2/d1b/f1d 1 1 2024-09-19T07:24:57.487 INFO:tasks.workunit.client.0.smithi098.stdout:1/537: truncate dc/de/d38/f44 1583004 0 2024-09-19T07:24:57.488 INFO:tasks.workunit.client.0.smithi098.stdout:7/612: mkdir d5/d8/dc/da7/dd4 0 2024-09-19T07:24:57.489 INFO:tasks.workunit.client.0.smithi098.stdout:3/470: rename de/df/d1f/c54 to de/df/d1f/d72/c87 0 2024-09-19T07:24:57.489 INFO:tasks.workunit.client.0.smithi098.stdout:5/403: rename dc to dc/de/d36/d71/d82 22 2024-09-19T07:24:57.489 INFO:tasks.workunit.client.0.smithi098.stdout:3/471: write de/df/d31/f5c [5275066,82035] 0 2024-09-19T07:24:57.492 INFO:tasks.workunit.client.0.smithi098.stdout:4/434: dwrite da/d31/d46/d56/f89 [0,4194304] 0 2024-09-19T07:24:57.492 INFO:tasks.workunit.client.0.smithi098.stdout:4/435: chown f8 16 1 2024-09-19T07:24:57.492 INFO:tasks.workunit.client.0.smithi098.stdout:5/404: rename dc/de/f1d to dc/de/d13/d46/d23/d5e/f83 0 2024-09-19T07:24:57.492 INFO:tasks.workunit.client.0.smithi098.stdout:1/538: getdents dc/de/d22/d31/d5d/d6a/d6f/d5f 0 2024-09-19T07:24:57.493 INFO:tasks.workunit.client.0.smithi098.stdout:5/405: unlink dc/de/d13/d46/d2e/d37/d81/d6a/c74 0 2024-09-19T07:24:57.495 INFO:tasks.workunit.client.0.smithi098.stdout:7/613: write d5/dce/fd2 [1439087,30065] 0 2024-09-19T07:24:57.495 INFO:tasks.workunit.client.0.smithi098.stdout:7/614: read - d5/d8/d8e/fa5 zero size 2024-09-19T07:24:57.495 INFO:tasks.workunit.client.0.smithi098.stdout:7/615: write d5/d10/d1d/fc1 [2239193,1108] 0 2024-09-19T07:24:57.496 INFO:tasks.workunit.client.0.smithi098.stdout:7/616: getdents d5/d3e 0 2024-09-19T07:24:57.496 INFO:tasks.workunit.client.0.smithi098.stdout:7/617: fdatasync d5/f53 0 2024-09-19T07:24:57.496 INFO:tasks.workunit.client.0.smithi098.stdout:1/539: creat dc/d17/d1b/d71/fb9 x:0 0 0 2024-09-19T07:24:57.496 INFO:tasks.workunit.client.0.smithi098.stdout:8/459: dwrite d0/f25 [0,4194304] 0 2024-09-19T07:24:57.496 INFO:tasks.workunit.client.0.smithi098.stdout:8/460: readlink d0/d16/l8e 0 2024-09-19T07:24:57.497 INFO:tasks.workunit.client.0.smithi098.stdout:5/406: mkdir dc/de/d36/d71/d84 0 2024-09-19T07:24:57.498 INFO:tasks.workunit.client.0.smithi098.stdout:6/465: dread d2/fc [0,4194304] 0 2024-09-19T07:24:57.499 INFO:tasks.workunit.client.0.smithi098.stdout:1/540: symlink dc/d17/d1b/d71/d7a/lba 0 2024-09-19T07:24:57.500 INFO:tasks.workunit.client.0.smithi098.stdout:6/466: link d2/fc d2/d11/fb4 0 2024-09-19T07:24:57.502 INFO:tasks.workunit.client.0.smithi098.stdout:1/541: creat dc/de/d22/fbb x:0 0 0 2024-09-19T07:24:57.504 INFO:tasks.workunit.client.0.smithi098.stdout:6/467: unlink d2/db0/d4e/d6e/d9d/l97 0 2024-09-19T07:24:57.504 INFO:tasks.workunit.client.0.smithi098.stdout:6/468: read d2/db0/d4e/f65 [381121,106044] 0 2024-09-19T07:24:57.504 INFO:tasks.workunit.client.0.smithi098.stdout:7/618: dread d5/d3e/d61/f94 [0,4194304] 0 2024-09-19T07:24:57.505 INFO:tasks.workunit.client.0.smithi098.stdout:6/469: creat d2/d5/d1f/d26/d42/d48/d53/d64/fb5 x:0 0 0 2024-09-19T07:24:57.505 INFO:tasks.workunit.client.0.smithi098.stdout:6/470: fdatasync d2/d5/f62 0 2024-09-19T07:24:57.505 INFO:tasks.workunit.client.0.smithi098.stdout:6/471: readlink d2/d5/d1f/l43 0 2024-09-19T07:24:57.507 INFO:tasks.workunit.client.0.smithi098.stdout:5/407: creat dc/de/d13/d46/d2e/d62/f85 x:0 0 0 2024-09-19T07:24:57.507 INFO:tasks.workunit.client.0.smithi098.stdout:6/472: symlink d2/d5/d1f/d26/lb6 0 2024-09-19T07:24:57.507 INFO:tasks.workunit.client.0.smithi098.stdout:5/408: fdatasync dc/f29 0 2024-09-19T07:24:57.507 INFO:tasks.workunit.client.0.smithi098.stdout:6/473: readlink d2/db0/d4e/d6e/l9c 0 2024-09-19T07:24:57.509 INFO:tasks.workunit.client.0.smithi098.stdout:5/409: creat dc/de/d13/d46/d23/d52/f86 x:0 0 0 2024-09-19T07:24:57.510 INFO:tasks.workunit.client.0.smithi098.stdout:9/508: dwrite d3/d16/d38/d48/f96 [0,4194304] 0 2024-09-19T07:24:57.511 INFO:tasks.workunit.client.0.smithi098.stdout:5/410: creat dc/f87 x:0 0 0 2024-09-19T07:24:57.512 INFO:tasks.workunit.client.0.smithi098.stdout:5/411: write dc/de/d13/d46/d2e/d37/d81/d6a/f7c [281771,37023] 0 2024-09-19T07:24:57.512 INFO:tasks.workunit.client.0.smithi098.stdout:5/412: stat f3 0 2024-09-19T07:24:57.512 INFO:tasks.workunit.client.0.smithi098.stdout:5/413: dread - dc/de/d13/d46/d2e/d62/f72 zero size 2024-09-19T07:24:57.514 INFO:tasks.workunit.client.0.smithi098.stdout:1/542: getdents dc/de/d22 0 2024-09-19T07:24:57.520 INFO:tasks.workunit.client.0.smithi098.stdout:1/543: rename dc/de/d37 to dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc 0 2024-09-19T07:24:57.525 INFO:tasks.workunit.client.0.smithi098.stdout:4/436: dwrite da/d31/d46/d5f/f74 [0,4194304] 0 2024-09-19T07:24:57.525 INFO:tasks.workunit.client.0.smithi098.stdout:0/556: dwrite d5/f3d [0,4194304] 0 2024-09-19T07:24:57.526 INFO:tasks.workunit.client.0.smithi098.stdout:0/557: creat d5/d20/d14/d49/d62/da7/fac x:0 0 0 2024-09-19T07:24:57.527 INFO:tasks.workunit.client.0.smithi098.stdout:3/472: dwrite de/df/d16/f4a [0,4194304] 0 2024-09-19T07:24:57.529 INFO:tasks.workunit.client.0.smithi098.stdout:0/558: rename d5/d20/l55 to d5/d20/d1f/d47/lad 0 2024-09-19T07:24:57.531 INFO:tasks.workunit.client.0.smithi098.stdout:2/446: dwrite d1/d5/d34/d5a/f7e [0,4194304] 0 2024-09-19T07:24:57.532 INFO:tasks.workunit.client.0.smithi098.stdout:3/473: creat de/d4e/d6d/d71/f88 x:0 0 0 2024-09-19T07:24:57.532 INFO:tasks.workunit.client.0.smithi098.stdout:3/474: write de/d4e/d6d/d71/f7c [515955,23027] 0 2024-09-19T07:24:57.532 INFO:tasks.workunit.client.0.smithi098.stdout:3/475: truncate de/d4e/f50 4425674 0 2024-09-19T07:24:57.536 INFO:tasks.workunit.client.0.smithi098.stdout:2/447: creat d1/d5/d34/d80/d93/d61/f99 x:0 0 0 2024-09-19T07:24:57.536 INFO:tasks.workunit.client.0.smithi098.stdout:2/448: write d1/d5/d34/f3d [1000688,51294] 0 2024-09-19T07:24:57.536 INFO:tasks.workunit.client.0.smithi098.stdout:1/544: write dc/de/d38/f6b [3210214,23022] 0 2024-09-19T07:24:57.539 INFO:tasks.workunit.client.0.smithi098.stdout:1/545: creat dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/fbd x:0 0 0 2024-09-19T07:24:57.541 INFO:tasks.workunit.client.0.smithi098.stdout:2/449: truncate d1/d9/d26/d35/d58/f32 1166175 0 2024-09-19T07:24:57.542 INFO:tasks.workunit.client.0.smithi098.stdout:1/546: unlink dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/fbd 0 2024-09-19T07:24:57.543 INFO:tasks.workunit.client.0.smithi098.stdout:2/450: creat d1/d5/d72/f9a x:0 0 0 2024-09-19T07:24:57.543 INFO:tasks.workunit.client.0.smithi098.stdout:2/451: stat d1/d5/d34/d80 0 2024-09-19T07:24:57.544 INFO:tasks.workunit.client.0.smithi098.stdout:2/452: mknod d1/d9/d26/d35/d48/c9b 0 2024-09-19T07:24:57.545 INFO:tasks.workunit.client.0.smithi098.stdout:2/453: rmdir d1/d5/d34/d39 39 2024-09-19T07:24:57.545 INFO:tasks.workunit.client.0.smithi098.stdout:2/454: stat d1/d5/d34/d80/c86 0 2024-09-19T07:24:57.546 INFO:tasks.workunit.client.0.smithi098.stdout:8/461: dwrite d0/d33/d55/d8a/f27 [0,4194304] 0 2024-09-19T07:24:57.547 INFO:tasks.workunit.client.0.smithi098.stdout:5/414: dwrite dc/de/d13/d46/f3e [0,4194304] 0 2024-09-19T07:24:57.547 INFO:tasks.workunit.client.0.smithi098.stdout:5/415: write f4 [4885062,87637] 0 2024-09-19T07:24:57.547 INFO:tasks.workunit.client.0.smithi098.stdout:2/455: rmdir d1/d97 0 2024-09-19T07:24:57.552 INFO:tasks.workunit.client.0.smithi098.stdout:9/509: write d3/dc/df/d15/d1a/d2b/f33 [326153,108829] 0 2024-09-19T07:24:57.557 INFO:tasks.workunit.client.0.smithi098.stdout:7/619: dwrite d5/d10/d1d/f39 [0,4194304] 0 2024-09-19T07:24:57.557 INFO:tasks.workunit.client.0.smithi098.stdout:7/620: write d5/d10/d50/fb5 [467243,12104] 0 2024-09-19T07:24:57.560 INFO:tasks.workunit.client.0.smithi098.stdout:2/456: creat d1/d9/d26/d5c/f9c x:0 0 0 2024-09-19T07:24:57.560 INFO:tasks.workunit.client.0.smithi098.stdout:2/457: chown d1/d9/d26/d35/d58/f25 25 1 2024-09-19T07:24:57.562 INFO:tasks.workunit.client.0.smithi098.stdout:1/547: read dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f4e [1798290,44105] 0 2024-09-19T07:24:57.562 INFO:tasks.workunit.client.0.smithi098.stdout:7/621: mkdir d5/dce/dd5 0 2024-09-19T07:24:57.566 INFO:tasks.workunit.client.0.smithi098.stdout:8/462: symlink d0/d33/d55/l93 0 2024-09-19T07:24:57.567 INFO:tasks.workunit.client.0.smithi098.stdout:6/474: dwrite d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98/f9e [0,4194304] 0 2024-09-19T07:24:57.568 INFO:tasks.workunit.client.0.smithi098.stdout:2/458: mkdir d1/d2c/d9d 0 2024-09-19T07:24:57.568 INFO:tasks.workunit.client.0.smithi098.stdout:2/459: stat d1/d2c/f30 0 2024-09-19T07:24:57.568 INFO:tasks.workunit.client.0.smithi098.stdout:1/548: dread dc/de/d38/f6b [0,4194304] 0 2024-09-19T07:24:57.569 INFO:tasks.workunit.client.0.smithi098.stdout:3/476: dwrite de/f2f [0,4194304] 0 2024-09-19T07:24:57.571 INFO:tasks.workunit.client.0.smithi098.stdout:6/475: creat d2/db0/d4e/d6e/d9d/fb7 x:0 0 0 2024-09-19T07:24:57.571 INFO:tasks.workunit.client.0.smithi098.stdout:4/437: dwrite da/d31/f57 [0,4194304] 0 2024-09-19T07:24:57.571 INFO:tasks.workunit.client.0.smithi098.stdout:4/438: truncate da/d31/f3c 1848492 0 2024-09-19T07:24:57.571 INFO:tasks.workunit.client.0.smithi098.stdout:0/559: dwrite d5/d20/d14/f5a [0,4194304] 0 2024-09-19T07:24:57.572 INFO:tasks.workunit.client.0.smithi098.stdout:1/549: write dc/de/d22/d31/d5d/d6a/d6f/f56 [1248419,66186] 0 2024-09-19T07:24:57.572 INFO:tasks.workunit.client.0.smithi098.stdout:6/476: getdents d2/d5/d1f/d26/d42/d48/d53/d64 0 2024-09-19T07:24:57.573 INFO:tasks.workunit.client.0.smithi098.stdout:3/477: creat de/df/d31/d61/d69/f89 x:0 0 0 2024-09-19T07:24:57.574 INFO:tasks.workunit.client.0.smithi098.stdout:4/439: unlink da/d31/f73 0 2024-09-19T07:24:57.574 INFO:tasks.workunit.client.0.smithi098.stdout:7/622: write d5/d3e/d62/f7a [45899,78621] 0 2024-09-19T07:24:57.582 INFO:tasks.workunit.client.0.smithi098.stdout:0/560: mkdir d5/d20/d1f/d47/dae 0 2024-09-19T07:24:57.583 INFO:tasks.workunit.client.0.smithi098.stdout:6/477: write d2/db0/f4f [4483774,116640] 0 2024-09-19T07:24:57.585 INFO:tasks.workunit.client.0.smithi098.stdout:6/478: creat d2/d5/fb8 x:0 0 0 2024-09-19T07:24:57.585 INFO:tasks.workunit.client.0.smithi098.stdout:2/460: symlink d1/d9/d1d/l9e 0 2024-09-19T07:24:57.586 INFO:tasks.workunit.client.0.smithi098.stdout:2/461: truncate d1/d5/d34/d80/d93/f66 922678 0 2024-09-19T07:24:57.593 INFO:tasks.workunit.client.0.smithi098.stdout:8/463: dwrite d0/d16/f23 [4194304,4194304] 0 2024-09-19T07:24:57.600 INFO:tasks.workunit.client.0.smithi098.stdout:0/561: creat d5/d20/d1f/faf x:0 0 0 2024-09-19T07:24:57.601 INFO:tasks.workunit.client.0.smithi098.stdout:1/550: dwrite dc/de/d22/d31/d5d/f6e [4194304,4194304] 0 2024-09-19T07:24:57.601 INFO:tasks.workunit.client.0.smithi098.stdout:1/551: dread - dc/de/d22/d31/d35/fa1 zero size 2024-09-19T07:24:57.601 INFO:tasks.workunit.client.0.smithi098.stdout:1/552: chown dc/de/d22/d31/d5d/d6a/d6f/d5f 25968738 1 2024-09-19T07:24:57.601 INFO:tasks.workunit.client.0.smithi098.stdout:0/562: write d5/f4f [1303996,70645] 0 2024-09-19T07:24:57.604 INFO:tasks.workunit.client.0.smithi098.stdout:8/464: rmdir d0/d33/d55/d8a/d21/d50/d92 0 2024-09-19T07:24:57.605 INFO:tasks.workunit.client.0.smithi098.stdout:1/553: dread dc/de/d22/d31/f4c [0,4194304] 0 2024-09-19T07:24:57.606 INFO:tasks.workunit.client.0.smithi098.stdout:1/554: symlink dc/de/d22/d31/d5d/d6a/d6f/d5f/d97/lbe 0 2024-09-19T07:24:57.606 INFO:tasks.workunit.client.0.smithi098.stdout:1/555: fdatasync dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f85 0 2024-09-19T07:24:57.607 INFO:tasks.workunit.client.0.smithi098.stdout:8/465: creat d0/d16/f94 x:0 0 0 2024-09-19T07:24:57.607 INFO:tasks.workunit.client.0.smithi098.stdout:1/556: creat dc/de/d38/fbf x:0 0 0 2024-09-19T07:24:57.607 INFO:tasks.workunit.client.0.smithi098.stdout:1/557: truncate dc/d17/d1b/d1d/d30/fa4 732195 0 2024-09-19T07:24:57.614 INFO:tasks.workunit.client.0.smithi098.stdout:2/462: dwrite d1/d5/d34/d80/d93/d61/f99 [0,4194304] 0 2024-09-19T07:24:57.614 INFO:tasks.workunit.client.0.smithi098.stdout:2/463: write d1/d9/d1d/f98 [525376,46996] 0 2024-09-19T07:24:57.614 INFO:tasks.workunit.client.0.smithi098.stdout:3/478: write de/df/d1f/d2b/f3a [2064830,122587] 0 2024-09-19T07:24:57.615 INFO:tasks.workunit.client.0.smithi098.stdout:7/623: dwrite d5/d10/d50/f6c [0,4194304] 0 2024-09-19T07:24:57.615 INFO:tasks.workunit.client.0.smithi098.stdout:3/479: creat de/df/d1f/d72/f8a x:0 0 0 2024-09-19T07:24:57.617 INFO:tasks.workunit.client.0.smithi098.stdout:2/464: rmdir d1/d2c/d9d 0 2024-09-19T07:24:57.619 INFO:tasks.workunit.client.0.smithi098.stdout:7/624: mkdir d5/dce/dd6 0 2024-09-19T07:24:57.620 INFO:tasks.workunit.client.0.smithi098.stdout:4/440: rename da/d31/d46/d56/d5b/c90 to da/d59/d5d/d82/c98 0 2024-09-19T07:24:57.623 INFO:tasks.workunit.client.0.smithi098.stdout:4/441: creat da/d31/d46/d80/f99 x:0 0 0 2024-09-19T07:24:57.631 INFO:tasks.workunit.client.0.smithi098.stdout:8/466: dwrite d0/d33/f6e [0,4194304] 0 2024-09-19T07:24:57.631 INFO:tasks.workunit.client.0.smithi098.stdout:8/467: fdatasync d0/d16/f94 0 2024-09-19T07:24:57.637 INFO:tasks.workunit.client.0.smithi098.stdout:8/468: link d0/f5 d0/d16/f95 0 2024-09-19T07:24:57.637 INFO:tasks.workunit.client.0.smithi098.stdout:8/469: fdatasync d0/d2c/f66 0 2024-09-19T07:24:57.638 INFO:tasks.workunit.client.0.smithi098.stdout:8/470: creat d0/d33/d55/d8a/d28/d40/f96 x:0 0 0 2024-09-19T07:24:57.638 INFO:tasks.workunit.client.0.smithi098.stdout:8/471: write d0/d33/d55/d8a/f5f [1593020,56909] 0 2024-09-19T07:24:57.639 INFO:tasks.workunit.client.0.smithi098.stdout:8/472: truncate d0/d1a/f49 743871 0 2024-09-19T07:24:57.640 INFO:tasks.workunit.client.0.smithi098.stdout:8/473: mknod d0/d16/d61/c97 0 2024-09-19T07:24:57.654 INFO:tasks.workunit.client.0.smithi098.stdout:2/465: dwrite d1/d9/d26/d35/d58/f5b [0,4194304] 0 2024-09-19T07:24:57.654 INFO:tasks.workunit.client.0.smithi098.stdout:3/480: dwrite de/df/d1f/f83 [0,4194304] 0 2024-09-19T07:24:57.654 INFO:tasks.workunit.client.0.smithi098.stdout:2/466: truncate d1/d9/d26/d35/d91/f94 637787 0 2024-09-19T07:24:57.655 INFO:tasks.workunit.client.0.smithi098.stdout:7/625: dwrite d5/d10/fcd [4194304,4194304] 0 2024-09-19T07:24:57.655 INFO:tasks.workunit.client.0.smithi098.stdout:7/626: truncate d5/d8/d52/fc0 55470 0 2024-09-19T07:24:57.656 INFO:tasks.workunit.client.0.smithi098.stdout:3/481: symlink de/df/d31/d61/d3f/d64/d84/l8b 0 2024-09-19T07:24:57.660 INFO:tasks.workunit.client.0.smithi098.stdout:8/474: dwrite d0/d16/f95 [0,4194304] 0 2024-09-19T07:24:57.661 INFO:tasks.workunit.client.0.smithi098.stdout:8/475: fsync d0/f4e 0 2024-09-19T07:24:57.663 INFO:tasks.workunit.client.0.smithi098.stdout:3/482: mkdir de/d4e/d6d/d8c 0 2024-09-19T07:24:57.665 INFO:tasks.workunit.client.0.smithi098.stdout:8/476: symlink d0/d33/d44/l98 0 2024-09-19T07:24:57.666 INFO:tasks.workunit.client.0.smithi098.stdout:3/483: mknod de/df/c8d 0 2024-09-19T07:24:57.667 INFO:tasks.workunit.client.0.smithi098.stdout:8/477: truncate d0/d33/f6e 1130577 0 2024-09-19T07:24:57.667 INFO:tasks.workunit.client.0.smithi098.stdout:8/478: readlink d0/d16/d65/l89 0 2024-09-19T07:24:57.667 INFO:tasks.workunit.client.0.smithi098.stdout:3/484: symlink de/df/d31/d61/d3f/d64/d84/l8e 0 2024-09-19T07:24:57.668 INFO:tasks.workunit.client.0.smithi098.stdout:8/479: rmdir d0/d33 39 2024-09-19T07:24:57.673 INFO:tasks.workunit.client.0.smithi098.stdout:7/627: dwrite d5/d8/dc/fe [0,4194304] 0 2024-09-19T07:24:57.674 INFO:tasks.workunit.client.0.smithi098.stdout:7/628: chown d5/d10/d50/f6c 436 1 2024-09-19T07:24:57.674 INFO:tasks.workunit.client.0.smithi098.stdout:7/629: fdatasync d5/d8/dc/d16/fb7 0 2024-09-19T07:24:57.674 INFO:tasks.workunit.client.0.smithi098.stdout:7/630: fsync d5/d10/f32 0 2024-09-19T07:24:57.674 INFO:tasks.workunit.client.0.smithi098.stdout:7/631: truncate d5/d3e/d62/da0/fc4 230134 0 2024-09-19T07:24:57.677 INFO:tasks.workunit.client.0.smithi098.stdout:7/632: creat d5/d3e/d62/da0/dc5/fd7 x:0 0 0 2024-09-19T07:24:57.678 INFO:tasks.workunit.client.0.smithi098.stdout:7/633: creat d5/d10/d50/dad/fd8 x:0 0 0 2024-09-19T07:24:57.678 INFO:tasks.workunit.client.0.smithi098.stdout:3/485: write de/df/d1f/f47 [1558140,120076] 0 2024-09-19T07:24:57.679 INFO:tasks.workunit.client.0.smithi098.stdout:7/634: symlink d5/d10/d11/d9e/ld9 0 2024-09-19T07:24:57.682 INFO:tasks.workunit.client.0.smithi098.stdout:9/510: sync 2024-09-19T07:24:57.682 INFO:tasks.workunit.client.0.smithi098.stdout:5/416: sync 2024-09-19T07:24:57.690 INFO:tasks.workunit.client.0.smithi098.stdout:3/486: dread de/df/d1f/d2b/f5e [0,4194304] 0 2024-09-19T07:24:57.690 INFO:tasks.workunit.client.0.smithi098.stdout:8/480: dwrite d0/d2c/f5e [0,4194304] 0 2024-09-19T07:24:57.690 INFO:tasks.workunit.client.0.smithi098.stdout:8/481: dread - d0/d33/d55/d8a/d21/d50/f5a zero size 2024-09-19T07:24:57.690 INFO:tasks.workunit.client.0.smithi098.stdout:8/482: stat d0/d16/d7d 0 2024-09-19T07:24:57.694 INFO:tasks.workunit.client.0.smithi098.stdout:3/487: symlink de/df/d31/d61/d3f/d64/d84/l8f 0 2024-09-19T07:24:57.694 INFO:tasks.workunit.client.0.smithi098.stdout:3/488: chown de/df/d1f/d2b/f39 77941617 1 2024-09-19T07:24:57.709 INFO:tasks.workunit.client.0.smithi098.stdout:5/417: dwrite dc/de/d13/d46/d23/f5d [0,4194304] 0 2024-09-19T07:24:57.711 INFO:tasks.workunit.client.0.smithi098.stdout:5/418: getdents dc/de/d13/d5c 0 2024-09-19T07:24:57.713 INFO:tasks.workunit.client.0.smithi098.stdout:5/419: rename l7 to dc/de/d13/d46/d23/d52/l88 0 2024-09-19T07:24:57.713 INFO:tasks.workunit.client.0.smithi098.stdout:5/420: readlink dc/de/d13/d46/d23/d52/l88 0 2024-09-19T07:24:57.714 INFO:tasks.workunit.client.0.smithi098.stdout:5/421: creat dc/de/d13/d46/d2e/d37/d67/f89 x:0 0 0 2024-09-19T07:24:57.723 INFO:tasks.workunit.client.0.smithi098.stdout:9/511: dwrite d3/d16/d38/f2e [0,4194304] 0 2024-09-19T07:24:57.724 INFO:tasks.workunit.client.0.smithi098.stdout:8/483: dwrite d0/d33/d55/d8a/f5f [0,4194304] 0 2024-09-19T07:24:57.724 INFO:tasks.workunit.client.0.smithi098.stdout:3/489: dwrite de/f1a [0,4194304] 0 2024-09-19T07:24:57.724 INFO:tasks.workunit.client.0.smithi098.stdout:9/512: getdents d3/d16/d7b/d8a 0 2024-09-19T07:24:57.727 INFO:tasks.workunit.client.0.smithi098.stdout:3/490: unlink de/df/d31/l32 0 2024-09-19T07:24:57.728 INFO:tasks.workunit.client.0.smithi098.stdout:9/513: rename d3/d6/d8/l23 to d3/dc/df/d15/d1b/lac 0 2024-09-19T07:24:57.731 INFO:tasks.workunit.client.0.smithi098.stdout:5/422: dwrite f4 [0,4194304] 0 2024-09-19T07:24:57.733 INFO:tasks.workunit.client.0.smithi098.stdout:9/514: dread d3/dc/df/f4e [0,4194304] 0 2024-09-19T07:24:57.733 INFO:tasks.workunit.client.0.smithi098.stdout:9/515: chown d3/dc/df 286716 1 2024-09-19T07:24:57.733 INFO:tasks.workunit.client.0.smithi098.stdout:9/516: chown d3/dc/df/d15/d1a/d2d/c35 2446930 1 2024-09-19T07:24:57.742 INFO:tasks.workunit.client.0.smithi098.stdout:5/423: write dc/de/d13/f21 [560011,77909] 0 2024-09-19T07:24:57.743 INFO:tasks.workunit.client.0.smithi098.stdout:5/424: getdents dc/de/d13/d46/d2e/d37/d6d 0 2024-09-19T07:24:57.745 INFO:tasks.workunit.client.0.smithi098.stdout:3/491: dread de/df/d31/d61/d3f/f5d [0,4194304] 0 2024-09-19T07:24:57.746 INFO:tasks.workunit.client.0.smithi098.stdout:3/492: creat de/df/d31/d61/d69/f90 x:0 0 0 2024-09-19T07:24:57.747 INFO:tasks.workunit.client.0.smithi098.stdout:3/493: creat de/df/d31/d61/d79/f91 x:0 0 0 2024-09-19T07:24:57.748 INFO:tasks.workunit.client.0.smithi098.stdout:3/494: rmdir de/df/d16 39 2024-09-19T07:24:57.748 INFO:tasks.workunit.client.0.smithi098.stdout:3/495: write de/d4e/f6a [663149,13917] 0 2024-09-19T07:24:57.748 INFO:tasks.workunit.client.0.smithi098.stdout:8/484: dwrite d0/d33/d55/d8a/f27 [0,4194304] 0 2024-09-19T07:24:57.749 INFO:tasks.workunit.client.0.smithi098.stdout:3/496: stat de/df/d16/l6c 0 2024-09-19T07:24:57.749 INFO:tasks.workunit.client.0.smithi098.stdout:3/497: fsync de/f1a 0 2024-09-19T07:24:57.754 INFO:tasks.workunit.client.0.smithi098.stdout:5/425: write dc/de/d13/d46/d2e/f77 [2372877,25006] 0 2024-09-19T07:24:57.754 INFO:tasks.workunit.client.0.smithi098.stdout:5/426: stat dc/de/d13/d46/d2e/d37/d81/l42 0 2024-09-19T07:24:57.756 INFO:tasks.workunit.client.0.smithi098.stdout:9/517: dwrite d3/d6/d8/f77 [0,4194304] 0 2024-09-19T07:24:57.756 INFO:tasks.workunit.client.0.smithi098.stdout:5/427: truncate dc/de/d36/f3d 2427410 0 2024-09-19T07:24:57.763 INFO:tasks.workunit.client.0.smithi098.stdout:9/518: creat d3/d6/fad x:0 0 0 2024-09-19T07:24:57.763 INFO:tasks.workunit.client.0.smithi098.stdout:9/519: read - d3/dc/df/d15/d1a/d2b/d92/f94 zero size 2024-09-19T07:24:57.765 INFO:tasks.workunit.client.0.smithi098.stdout:9/520: creat d3/d6/d8/fae x:0 0 0 2024-09-19T07:24:57.766 INFO:tasks.workunit.client.0.smithi098.stdout:9/521: dread - d3/d6/f91 zero size 2024-09-19T07:24:57.766 INFO:tasks.workunit.client.0.smithi098.stdout:5/428: dread dc/de/f34 [0,4194304] 0 2024-09-19T07:24:57.771 INFO:tasks.workunit.client.0.smithi098.stdout:8/485: dwrite d0/d33/d55/d8a/d21/d50/f6f [0,4194304] 0 2024-09-19T07:24:57.771 INFO:tasks.workunit.client.0.smithi098.stdout:8/486: readlink d0/d2c/l38 0 2024-09-19T07:24:57.772 INFO:tasks.workunit.client.0.smithi098.stdout:6/479: sync 2024-09-19T07:24:57.772 INFO:tasks.workunit.client.0.smithi098.stdout:0/563: sync 2024-09-19T07:24:57.772 INFO:tasks.workunit.client.0.smithi098.stdout:4/442: sync 2024-09-19T07:24:57.773 INFO:tasks.workunit.client.0.smithi098.stdout:1/558: sync 2024-09-19T07:24:57.773 INFO:tasks.workunit.client.0.smithi098.stdout:1/559: dread - dc/de/d38/fbf zero size 2024-09-19T07:24:57.773 INFO:tasks.workunit.client.0.smithi098.stdout:1/560: readlink dc/de/d50/d6c/l72 0 2024-09-19T07:24:57.773 INFO:tasks.workunit.client.0.smithi098.stdout:1/561: truncate dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f85 4776555 0 2024-09-19T07:24:57.773 INFO:tasks.workunit.client.0.smithi098.stdout:1/562: chown dc/de/d22/d31/d5d/d6a/d6f/d5f/f91 101242 1 2024-09-19T07:24:57.773 INFO:tasks.workunit.client.0.smithi098.stdout:1/563: truncate dc/de/d22/d31/d5d/d6a/d6f/d4d/f8a 911028 0 2024-09-19T07:24:57.775 INFO:tasks.workunit.client.0.smithi098.stdout:6/480: rename d2/d11/f91 to d2/d5/d1f/d26/d42/da4/fb9 0 2024-09-19T07:24:57.776 INFO:tasks.workunit.client.0.smithi098.stdout:8/487: truncate d0/d16/f79 2499737 0 2024-09-19T07:24:57.777 INFO:tasks.workunit.client.0.smithi098.stdout:4/443: mknod da/d31/d46/d80/c9a 0 2024-09-19T07:24:57.778 INFO:tasks.workunit.client.0.smithi098.stdout:6/481: rename d2/d5/d1f/c2b to d2/d5/d1f/d26/d42/d48/cba 0 2024-09-19T07:24:57.778 INFO:tasks.workunit.client.0.smithi098.stdout:6/482: write d2/d11/fb4 [4403837,105880] 0 2024-09-19T07:24:57.779 INFO:tasks.workunit.client.0.smithi098.stdout:6/483: mknod d2/d1b/d8f/cbb 0 2024-09-19T07:24:57.779 INFO:tasks.workunit.client.0.smithi098.stdout:6/484: fsync d2/db0/d4e/d6e/d9d/d94/f9f 0 2024-09-19T07:24:57.779 INFO:tasks.workunit.client.0.smithi098.stdout:6/485: stat d2/d11/l35 0 2024-09-19T07:24:57.781 INFO:tasks.workunit.client.0.smithi098.stdout:6/486: unlink d2/d1b/f77 0 2024-09-19T07:24:57.782 INFO:tasks.workunit.client.0.smithi098.stdout:0/564: creat d5/d20/d1f/d47/fb0 x:0 0 0 2024-09-19T07:24:57.782 INFO:tasks.workunit.client.0.smithi098.stdout:7/635: sync 2024-09-19T07:24:57.782 INFO:tasks.workunit.client.0.smithi098.stdout:2/467: sync 2024-09-19T07:24:57.782 INFO:tasks.workunit.client.0.smithi098.stdout:2/468: write d1/d9/f1b [8584943,39303] 0 2024-09-19T07:24:57.782 INFO:tasks.workunit.client.0.smithi098.stdout:7/636: write d5/d10/dc2/f96 [92108,106758] 0 2024-09-19T07:24:57.783 INFO:tasks.workunit.client.0.smithi098.stdout:6/487: symlink d2/d5/lbc 0 2024-09-19T07:24:57.786 INFO:tasks.workunit.client.0.smithi098.stdout:6/488: link d2/d5/d1f/l29 d2/db0/d8d/lbd 0 2024-09-19T07:24:57.786 INFO:tasks.workunit.client.0.smithi098.stdout:0/565: dread d5/d20/d14/d49/f5e [0,4194304] 0 2024-09-19T07:24:57.786 INFO:tasks.workunit.client.0.smithi098.stdout:2/469: dread d1/d9/d26/d35/f71 [0,4194304] 0 2024-09-19T07:24:57.786 INFO:tasks.workunit.client.0.smithi098.stdout:0/566: stat d5/d20/d14/d49/d62/da7/fab 0 2024-09-19T07:24:57.787 INFO:tasks.workunit.client.0.smithi098.stdout:2/470: mknod d1/d5/d34/c9f 0 2024-09-19T07:24:57.788 INFO:tasks.workunit.client.0.smithi098.stdout:9/522: dread d3/d16/d43/d51/f6d [0,4194304] 0 2024-09-19T07:24:57.789 INFO:tasks.workunit.client.0.smithi098.stdout:2/471: mkdir d1/d9/d3e/d41/d60/d65/da0 0 2024-09-19T07:24:57.789 INFO:tasks.workunit.client.0.smithi098.stdout:2/472: write d1/d9/f1b [6241250,9209] 0 2024-09-19T07:24:57.790 INFO:tasks.workunit.client.0.smithi098.stdout:9/523: symlink d3/dc/df/d15/d1b/d90/laf 0 2024-09-19T07:24:57.790 INFO:tasks.workunit.client.0.smithi098.stdout:8/488: dread d0/d2c/f66 [0,4194304] 0 2024-09-19T07:24:57.790 INFO:tasks.workunit.client.0.smithi098.stdout:8/489: fsync d0/d33/d55/d8a/d28/f86 0 2024-09-19T07:24:57.790 INFO:tasks.workunit.client.0.smithi098.stdout:2/473: symlink d1/d9/d26/d35/d88/la1 0 2024-09-19T07:24:57.791 INFO:tasks.workunit.client.0.smithi098.stdout:8/490: creat d0/d16/d7d/f99 x:0 0 0 2024-09-19T07:24:57.791 INFO:tasks.workunit.client.0.smithi098.stdout:8/491: readlink d0/d33/d55/d8a/d12/l37 0 2024-09-19T07:24:57.792 INFO:tasks.workunit.client.0.smithi098.stdout:2/474: creat d1/d5/d34/d80/d93/d61/d62/fa2 x:0 0 0 2024-09-19T07:24:57.793 INFO:tasks.workunit.client.0.smithi098.stdout:9/524: symlink d3/d6/lb0 0 2024-09-19T07:24:57.793 INFO:tasks.workunit.client.0.smithi098.stdout:7/637: write d5/d8/dc/f42 [1344902,67579] 0 2024-09-19T07:24:57.793 INFO:tasks.workunit.client.0.smithi098.stdout:8/492: mkdir d0/d16/d65/d9a 0 2024-09-19T07:24:57.794 INFO:tasks.workunit.client.0.smithi098.stdout:9/525: mkdir d3/d16/d43/db1 0 2024-09-19T07:24:57.795 INFO:tasks.workunit.client.0.smithi098.stdout:7/638: mkdir d5/d8/d52/db6/dc9/dda 0 2024-09-19T07:24:57.796 INFO:tasks.workunit.client.0.smithi098.stdout:8/493: mknod d0/d33/c9b 0 2024-09-19T07:24:57.796 INFO:tasks.workunit.client.0.smithi098.stdout:8/494: chown d0/d33/d55/d8a/f15 80 1 2024-09-19T07:24:57.796 INFO:tasks.workunit.client.0.smithi098.stdout:9/526: symlink d3/d6/d8/lb2 0 2024-09-19T07:24:57.797 INFO:tasks.workunit.client.0.smithi098.stdout:0/567: dread d5/f25 [0,4194304] 0 2024-09-19T07:24:57.797 INFO:tasks.workunit.client.0.smithi098.stdout:0/568: chown d5/d20/l3a 10466 1 2024-09-19T07:24:57.798 INFO:tasks.workunit.client.0.smithi098.stdout:8/495: getdents d0/d33/d55/d8a/d28/d40 0 2024-09-19T07:24:57.798 INFO:tasks.workunit.client.0.smithi098.stdout:8/496: readlink d0/d33/d55/d8a/d28/d40/l87 0 2024-09-19T07:24:57.798 INFO:tasks.workunit.client.0.smithi098.stdout:7/639: write d5/d3e/d61/f91 [374063,105828] 0 2024-09-19T07:24:57.798 INFO:tasks.workunit.client.0.smithi098.stdout:0/569: symlink d5/d20/d1f/d52/d64/d77/d79/d94/lb1 0 2024-09-19T07:24:57.800 INFO:tasks.workunit.client.0.smithi098.stdout:8/497: link d0/d1a/f49 d0/d16/f9c 0 2024-09-19T07:24:57.801 INFO:tasks.workunit.client.0.smithi098.stdout:1/564: dwrite dc/de/d22/d31/d5d/d6a/d6f/d5f/faf [0,4194304] 0 2024-09-19T07:24:57.801 INFO:tasks.workunit.client.0.smithi098.stdout:7/640: creat d5/d8/d52/db6/dc9/fdb x:0 0 0 2024-09-19T07:24:57.801 INFO:tasks.workunit.client.0.smithi098.stdout:7/641: write d5/d8/dc/f42 [4266656,104844] 0 2024-09-19T07:24:57.802 INFO:tasks.workunit.client.0.smithi098.stdout:5/429: dwrite dc/de/d13/d46/d2e/f77 [0,4194304] 0 2024-09-19T07:24:57.802 INFO:tasks.workunit.client.0.smithi098.stdout:0/570: mkdir d5/d20/d1f/d47/db2 0 2024-09-19T07:24:57.802 INFO:tasks.workunit.client.0.smithi098.stdout:6/489: dread d2/d5/f62 [0,4194304] 0 2024-09-19T07:24:57.802 INFO:tasks.workunit.client.0.smithi098.stdout:4/444: dwrite da/f30 [0,4194304] 0 2024-09-19T07:24:57.802 INFO:tasks.workunit.client.0.smithi098.stdout:4/445: fsync da/d31/f49 0 2024-09-19T07:24:57.803 INFO:tasks.workunit.client.0.smithi098.stdout:7/642: creat d5/d10/dc2/d5c/fdc x:0 0 0 2024-09-19T07:24:57.803 INFO:tasks.workunit.client.0.smithi098.stdout:1/565: truncate dc/de/d22/d31/d5d/d6a/d6f/f39 2180210 0 2024-09-19T07:24:57.803 INFO:tasks.workunit.client.0.smithi098.stdout:9/527: dread d3/d16/d43/d51/f6d [0,4194304] 0 2024-09-19T07:24:57.803 INFO:tasks.workunit.client.0.smithi098.stdout:9/528: write d3/d16/d43/d61/f66 [1458079,836] 0 2024-09-19T07:24:57.804 INFO:tasks.workunit.client.0.smithi098.stdout:1/566: dread dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f85 [4194304,4194304] 0 2024-09-19T07:24:57.804 INFO:tasks.workunit.client.0.smithi098.stdout:5/430: rename dc/de to dc/de/d8a 22 2024-09-19T07:24:57.804 INFO:tasks.workunit.client.0.smithi098.stdout:5/431: read dc/de/d13/d46/d2e/d37/d81/f58 [570374,110862] 0 2024-09-19T07:24:57.806 INFO:tasks.workunit.client.0.smithi098.stdout:2/475: dread d1/d9/d26/d35/f6b [4194304,4194304] 0 2024-09-19T07:24:57.806 INFO:tasks.workunit.client.0.smithi098.stdout:0/571: symlink d5/d20/d14/d49/d62/lb3 0 2024-09-19T07:24:57.806 INFO:tasks.workunit.client.0.smithi098.stdout:0/572: truncate d5/d20/d14/d49/d62/da7/fac 486084 0 2024-09-19T07:24:57.807 INFO:tasks.workunit.client.0.smithi098.stdout:0/573: truncate d5/d20/d14/f5a 4910900 0 2024-09-19T07:24:57.807 INFO:tasks.workunit.client.0.smithi098.stdout:4/446: mknod da/d59/d5d/c9b 0 2024-09-19T07:24:57.807 INFO:tasks.workunit.client.0.smithi098.stdout:9/529: mkdir d3/dc/df/d15/db3 0 2024-09-19T07:24:57.809 INFO:tasks.workunit.client.0.smithi098.stdout:7/643: rename d5/d8/dc/d16/fb4 to d5/d8/dc/da7/dd4/fdd 0 2024-09-19T07:24:57.812 INFO:tasks.workunit.client.0.smithi098.stdout:9/530: mknod d3/dc/df/d15/d1a/d2b/d49/d74/cb4 0 2024-09-19T07:24:57.812 INFO:tasks.workunit.client.0.smithi098.stdout:9/531: write d3/dc/df/d15/f5b [3352803,39458] 0 2024-09-19T07:24:57.813 INFO:tasks.workunit.client.0.smithi098.stdout:1/567: write dc/de/d22/d31/d5d/d6a/d6f/d4d/f54 [3214599,93667] 0 2024-09-19T07:24:57.813 INFO:tasks.workunit.client.0.smithi098.stdout:4/447: rename da/d31/l72 to da/d7e/l9c 0 2024-09-19T07:24:57.815 INFO:tasks.workunit.client.0.smithi098.stdout:1/568: mknod dc/d2a/cc0 0 2024-09-19T07:24:57.816 INFO:tasks.workunit.client.0.smithi098.stdout:7/644: dread d5/d8/dc/d16/f1e [0,4194304] 0 2024-09-19T07:24:57.816 INFO:tasks.workunit.client.0.smithi098.stdout:0/574: dread d5/f3d [0,4194304] 0 2024-09-19T07:24:57.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:57 smithi139 ceph-mon[35039]: scrub summary: idle 2024-09-19T07:24:57.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:57 smithi139 ceph-mon[35039]: scrub summary: idle 2024-09-19T07:24:57.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:57 smithi139 ceph-mon[35039]: scrub summary: idle 2024-09-19T07:24:57.817 INFO:tasks.workunit.client.0.smithi098.stdout:7/645: mknod d5/d8/d8e/cde 0 2024-09-19T07:24:57.818 INFO:tasks.workunit.client.0.smithi098.stdout:0/575: creat d5/d20/d1f/d52/fb4 x:0 0 0 2024-09-19T07:24:57.818 INFO:tasks.workunit.client.0.smithi098.stdout:2/476: write d1/d5/d34/d5a/f51 [1887554,32648] 0 2024-09-19T07:24:57.819 INFO:tasks.workunit.client.0.smithi098.stdout:2/477: unlink d1/d9/d26/d5c/l5f 0 2024-09-19T07:24:57.821 INFO:tasks.workunit.client.0.smithi098.stdout:2/478: unlink d1/d9/l4f 0 2024-09-19T07:24:57.821 INFO:tasks.workunit.client.0.smithi098.stdout:2/479: truncate d1/d5/d34/f96 398671 0 2024-09-19T07:24:57.822 INFO:tasks.workunit.client.0.smithi098.stdout:1/569: creat dc/de/d38/db1/fc1 x:0 0 0 2024-09-19T07:24:57.823 INFO:tasks.workunit.client.0.smithi098.stdout:1/570: truncate dc/da5/fa6 495031 0 2024-09-19T07:24:57.823 INFO:tasks.workunit.client.0.smithi098.stdout:2/480: mkdir d1/d9/d3e/d41/d60/d65/da3 0 2024-09-19T07:24:57.824 INFO:tasks.workunit.client.0.smithi098.stdout:7/646: dread d5/d8/d52/fbc [0,4194304] 0 2024-09-19T07:24:57.824 INFO:tasks.workunit.client.0.smithi098.stdout:1/571: creat dc/de/d22/d31/d5d/d6a/d6f/d5f/fc2 x:0 0 0 2024-09-19T07:24:57.827 INFO:tasks.workunit.client.0.smithi098.stdout:7/647: dread d5/d3e/d61/f94 [0,4194304] 0 2024-09-19T07:24:57.828 INFO:tasks.workunit.client.0.smithi098.stdout:1/572: getdents dc 0 2024-09-19T07:24:57.828 INFO:tasks.workunit.client.0.smithi098.stdout:1/573: fdatasync dc/d17/d1b/faa 0 2024-09-19T07:24:57.853 INFO:tasks.workunit.client.0.smithi098.stdout:0/576: dwrite d5/fe [0,4194304] 0 2024-09-19T07:24:57.859 INFO:tasks.workunit.client.0.smithi098.stdout:1/574: dwrite dc/de/d22/d31/d5d/f60 [0,4194304] 0 2024-09-19T07:24:57.860 INFO:tasks.workunit.client.0.smithi098.stdout:4/448: dwrite da/d31/d46/d56/f78 [0,4194304] 0 2024-09-19T07:24:57.862 INFO:tasks.workunit.client.0.smithi098.stdout:2/481: dwrite d1/d5/d34/d80/d93/f66 [0,4194304] 0 2024-09-19T07:24:57.862 INFO:tasks.workunit.client.0.smithi098.stdout:9/532: dwrite d3/dc/df/d15/d1a/d2b/d92/f94 [0,4194304] 0 2024-09-19T07:24:57.864 INFO:tasks.workunit.client.0.smithi098.stdout:7/648: dwrite d5/d10/f32 [0,4194304] 0 2024-09-19T07:24:57.864 INFO:tasks.workunit.client.0.smithi098.stdout:2/482: creat d1/d9/d3e/d41/fa4 x:0 0 0 2024-09-19T07:24:57.865 INFO:tasks.workunit.client.0.smithi098.stdout:2/483: write d1/d9/d26/d35/d58/f22 [2045256,92458] 0 2024-09-19T07:24:57.868 INFO:tasks.workunit.client.0.smithi098.stdout:7/649: stat d5/d3e/d62/da0/fa9 0 2024-09-19T07:24:57.868 INFO:tasks.workunit.client.0.smithi098.stdout:7/650: chown d5/d8/f34 7 1 2024-09-19T07:24:57.869 INFO:tasks.workunit.client.0.smithi098.stdout:2/484: mkdir d1/d9/d3e/d41/d60/da5 0 2024-09-19T07:24:57.869 INFO:tasks.workunit.client.0.smithi098.stdout:2/485: chown d1/d5/c85 297 1 2024-09-19T07:24:57.872 INFO:tasks.workunit.client.0.smithi098.stdout:0/577: dwrite d5/d20/d1f/d52/d64/d77/d79/f9e [0,4194304] 0 2024-09-19T07:24:57.880 INFO:tasks.workunit.client.0.smithi098.stdout:9/533: dread d3/d6/d8/f77 [0,4194304] 0 2024-09-19T07:24:57.881 INFO:tasks.workunit.client.0.smithi098.stdout:1/575: rename dc/de/d22/d31/d35/l7c to dc/d17/d1b/d71/d81/lc3 0 2024-09-19T07:24:57.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:57 smithi162 ceph-mon[35726]: scrub summary: idle 2024-09-19T07:24:57.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:57 smithi162 ceph-mon[35726]: scrub summary: idle 2024-09-19T07:24:57.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:57 smithi162 ceph-mon[35726]: scrub summary: idle 2024-09-19T07:24:57.883 INFO:tasks.workunit.client.0.smithi098.stdout:9/534: write d3/dc/f6a [1530056,33196] 0 2024-09-19T07:24:57.884 INFO:tasks.workunit.client.0.smithi098.stdout:2/486: rename d1/l7a to d1/d9/d3e/la6 0 2024-09-19T07:24:57.885 INFO:tasks.workunit.client.0.smithi098.stdout:1/576: mkdir dc/d17/d1b/d1d/d3d/dc4 0 2024-09-19T07:24:57.887 INFO:tasks.workunit.client.0.smithi098.stdout:1/577: unlink dc/d17/d1b/d1d/d30/f7f 0 2024-09-19T07:24:57.889 INFO:tasks.workunit.client.0.smithi098.stdout:1/578: dread dc/de/f21 [0,4194304] 0 2024-09-19T07:24:57.891 INFO:tasks.workunit.client.0.smithi098.stdout:1/579: creat dc/de/d22/d31/d35/d4f/fc5 x:0 0 0 2024-09-19T07:24:57.891 INFO:tasks.workunit.client.0.smithi098.stdout:1/580: write dc/d17/d1b/d1d/d30/f70 [1026421,119737] 0 2024-09-19T07:24:57.891 INFO:tasks.workunit.client.0.smithi098.stdout:1/581: fdatasync dc/de/d38/db1/fc1 0 2024-09-19T07:24:57.892 INFO:tasks.workunit.client.0.smithi098.stdout:9/535: read d3/d16/d43/d51/f6d [75406,65562] 0 2024-09-19T07:24:57.892 INFO:tasks.workunit.client.0.smithi098.stdout:9/536: truncate d3/d16/f57 838307 0 2024-09-19T07:24:57.892 INFO:tasks.workunit.client.0.smithi098.stdout:1/582: mkdir dc/de/d22/d31/d5d/d6a/d6f/d4d/dc6 0 2024-09-19T07:24:57.892 INFO:tasks.workunit.client.0.smithi098.stdout:4/449: dwrite da/d31/d46/d80/f99 [0,4194304] 0 2024-09-19T07:24:57.893 INFO:tasks.workunit.client.0.smithi098.stdout:9/537: unlink d3/dc/df/d15/d1b/f29 0 2024-09-19T07:24:57.893 INFO:tasks.workunit.client.0.smithi098.stdout:9/538: fdatasync d3/dc/df/d15/d1a/d2b/f33 0 2024-09-19T07:24:57.894 INFO:tasks.workunit.client.0.smithi098.stdout:9/539: mknod d3/d16/d43/db1/cb5 0 2024-09-19T07:24:57.894 INFO:tasks.workunit.client.0.smithi098.stdout:9/540: write d3/d6/f91 [1032828,119097] 0 2024-09-19T07:24:57.894 INFO:tasks.workunit.client.0.smithi098.stdout:9/541: readlink d3/dc/df/d15/d1a/d2b/d49/la2 0 2024-09-19T07:24:57.894 INFO:tasks.workunit.client.0.smithi098.stdout:9/542: write d3/d30/f88 [627320,108044] 0 2024-09-19T07:24:57.895 INFO:tasks.workunit.client.0.smithi098.stdout:9/543: rename d3/d16 to d3/d16/d43/d51/d6e/db6 22 2024-09-19T07:24:57.895 INFO:tasks.workunit.client.0.smithi098.stdout:4/450: link da/d59/f6b da/d59/d5d/d82/f9d 0 2024-09-19T07:24:57.897 INFO:tasks.workunit.client.0.smithi098.stdout:4/451: readlink da/d31/d46/d56/d5b/d61/l7d 0 2024-09-19T07:24:57.897 INFO:tasks.workunit.client.0.smithi098.stdout:4/452: chown da/d59/f6b 4974 1 2024-09-19T07:24:57.898 INFO:tasks.workunit.client.0.smithi098.stdout:2/487: dread d1/d9/f1b [0,4194304] 0 2024-09-19T07:24:57.898 INFO:tasks.workunit.client.0.smithi098.stdout:2/488: mknod d1/d9/d26/d5c/ca7 0 2024-09-19T07:24:57.898 INFO:tasks.workunit.client.0.smithi098.stdout:2/489: write d1/d2c/f30 [201858,1111] 0 2024-09-19T07:24:57.899 INFO:tasks.workunit.client.0.smithi098.stdout:2/490: mknod d1/d9/d26/d35/d91/ca8 0 2024-09-19T07:24:57.899 INFO:tasks.workunit.client.0.smithi098.stdout:4/453: mknod da/d31/d46/d56/c9e 0 2024-09-19T07:24:57.899 INFO:tasks.workunit.client.0.smithi098.stdout:2/491: mknod d1/d9/d3e/d41/d60/d65/ca9 0 2024-09-19T07:24:57.900 INFO:tasks.workunit.client.0.smithi098.stdout:0/578: dwrite d5/d20/d14/d49/f5e [0,4194304] 0 2024-09-19T07:24:57.901 INFO:tasks.workunit.client.0.smithi098.stdout:2/492: unlink d1/d5/d34/d39/f75 0 2024-09-19T07:24:57.904 INFO:tasks.workunit.client.0.smithi098.stdout:7/651: dwrite d5/d3e/d62/da0/f8c [0,4194304] 0 2024-09-19T07:24:57.906 INFO:tasks.workunit.client.0.smithi098.stdout:1/583: write dc/f33 [3542390,8946] 0 2024-09-19T07:24:57.906 INFO:tasks.workunit.client.0.smithi098.stdout:1/584: fdatasync dc/de/d22/d31/d5d/d6a/d6f/f39 0 2024-09-19T07:24:57.907 INFO:tasks.workunit.client.0.smithi098.stdout:7/652: link d5/d10/f9d d5/d10/dc2/d5c/dc3/fdf 0 2024-09-19T07:24:57.907 INFO:tasks.workunit.client.0.smithi098.stdout:7/653: chown d5/d8/dc/d16/f1e 93723 1 2024-09-19T07:24:57.907 INFO:tasks.workunit.client.0.smithi098.stdout:7/654: write d5/d3e/d62/da0/fa9 [592039,126429] 0 2024-09-19T07:24:57.907 INFO:tasks.workunit.client.0.smithi098.stdout:7/655: dread - d5/d10/dc2/dbd/fcf zero size 2024-09-19T07:24:57.907 INFO:tasks.workunit.client.0.smithi098.stdout:7/656: fsync d5/d10/dc2/dbd/fcf 0 2024-09-19T07:24:57.908 INFO:tasks.workunit.client.0.smithi098.stdout:4/454: rmdir da/d31/d46/d56/d5b 39 2024-09-19T07:24:57.908 INFO:tasks.workunit.client.0.smithi098.stdout:4/455: chown da/d31/d46/d80 153 1 2024-09-19T07:24:57.910 INFO:tasks.workunit.client.0.smithi098.stdout:4/456: creat da/d59/d5d/f9f x:0 0 0 2024-09-19T07:24:57.912 INFO:tasks.workunit.client.0.smithi098.stdout:4/457: getdents da/d59/d5d/d82 0 2024-09-19T07:24:57.922 INFO:tasks.workunit.client.0.smithi098.stdout:0/579: dwrite d5/d20/f42 [0,4194304] 0 2024-09-19T07:24:57.922 INFO:tasks.workunit.client.0.smithi098.stdout:0/580: readlink d5/d20/d14/d49/d62/l73 0 2024-09-19T07:24:57.923 INFO:tasks.workunit.client.0.smithi098.stdout:3/498: sync 2024-09-19T07:24:57.923 INFO:tasks.workunit.client.0.smithi098.stdout:8/498: sync 2024-09-19T07:24:57.923 INFO:tasks.workunit.client.0.smithi098.stdout:6/490: sync 2024-09-19T07:24:57.923 INFO:tasks.workunit.client.0.smithi098.stdout:5/432: sync 2024-09-19T07:24:57.923 INFO:tasks.workunit.client.0.smithi098.stdout:8/499: write d0/d33/d55/d8a/f75 [688499,30884] 0 2024-09-19T07:24:57.926 INFO:tasks.workunit.client.0.smithi098.stdout:8/500: mknod d0/d2c/c9d 0 2024-09-19T07:24:57.927 INFO:tasks.workunit.client.0.smithi098.stdout:8/501: mkdir d0/d33/d55/d8a/d21/d50/d9e 0 2024-09-19T07:24:57.928 INFO:tasks.workunit.client.0.smithi098.stdout:8/502: symlink d0/d33/d55/d8a/d21/d50/d9e/l9f 0 2024-09-19T07:24:57.928 INFO:tasks.workunit.client.0.smithi098.stdout:2/493: dwrite d1/d9/f47 [4194304,4194304] 0 2024-09-19T07:24:57.929 INFO:tasks.workunit.client.0.smithi098.stdout:8/503: creat d0/d16/d7d/fa0 x:0 0 0 2024-09-19T07:24:57.929 INFO:tasks.workunit.client.0.smithi098.stdout:8/504: chown d0/d33/d55/d8a/d28/d40/f96 1668 1 2024-09-19T07:24:57.930 INFO:tasks.workunit.client.0.smithi098.stdout:2/494: creat d1/faa x:0 0 0 2024-09-19T07:24:57.930 INFO:tasks.workunit.client.0.smithi098.stdout:2/495: write d1/d5/d34/f96 [814336,110830] 0 2024-09-19T07:24:57.930 INFO:tasks.workunit.client.0.smithi098.stdout:2/496: readlink d1/d9/d3e/d41/d60/l6d 0 2024-09-19T07:24:57.931 INFO:tasks.workunit.client.0.smithi098.stdout:8/505: symlink d0/d16/la1 0 2024-09-19T07:24:57.931 INFO:tasks.workunit.client.0.smithi098.stdout:8/506: fdatasync d0/d16/d7d/fa0 0 2024-09-19T07:24:57.931 INFO:tasks.workunit.client.0.smithi098.stdout:8/507: chown d0/d16/f94 0 1 2024-09-19T07:24:57.933 INFO:tasks.workunit.client.0.smithi098.stdout:8/508: unlink d0/d33/d55/d8a/d12/l37 0 2024-09-19T07:24:57.933 INFO:tasks.workunit.client.0.smithi098.stdout:8/509: chown d0/d33/d55/d8a/d21/d50/l59 623761 1 2024-09-19T07:24:57.933 INFO:tasks.workunit.client.0.smithi098.stdout:8/510: chown d0/d2c/l80 850670839 1 2024-09-19T07:24:57.935 INFO:tasks.workunit.client.0.smithi098.stdout:8/511: rmdir d0/d33/d55/d8a/d28 39 2024-09-19T07:24:57.938 INFO:tasks.workunit.client.0.smithi098.stdout:0/581: read d5/f48 [286740,69416] 0 2024-09-19T07:24:57.938 INFO:tasks.workunit.client.0.smithi098.stdout:0/582: chown d5/d6b/f83 257351603 1 2024-09-19T07:24:57.943 INFO:tasks.workunit.client.0.smithi098.stdout:4/458: dwrite da/d31/f45 [0,4194304] 0 2024-09-19T07:24:57.945 INFO:tasks.workunit.client.0.smithi098.stdout:4/459: truncate da/d31/f39 396939 0 2024-09-19T07:24:57.947 INFO:tasks.workunit.client.0.smithi098.stdout:4/460: creat da/d31/d46/d56/fa0 x:0 0 0 2024-09-19T07:24:57.947 INFO:tasks.workunit.client.0.smithi098.stdout:4/461: chown da/d31/c42 30 1 2024-09-19T07:24:57.947 INFO:tasks.workunit.client.0.smithi098.stdout:4/462: chown da/d31/l4e 53 1 2024-09-19T07:24:57.948 INFO:tasks.workunit.client.0.smithi098.stdout:8/512: dread d0/d1a/f1c [0,4194304] 0 2024-09-19T07:24:57.948 INFO:tasks.workunit.client.0.smithi098.stdout:8/513: write d0/d16/f94 [14135,6873] 0 2024-09-19T07:24:57.950 INFO:tasks.workunit.client.0.smithi098.stdout:0/583: dread d5/d20/d1f/d52/d64/f81 [0,4194304] 0 2024-09-19T07:24:57.950 INFO:tasks.workunit.client.0.smithi098.stdout:0/584: chown d5/f31 26 1 2024-09-19T07:24:57.950 INFO:tasks.workunit.client.0.smithi098.stdout:8/514: symlink d0/d33/d55/d8a/d21/la2 0 2024-09-19T07:24:57.950 INFO:tasks.workunit.client.0.smithi098.stdout:8/515: truncate d0/d16/d65/f7f 57400 0 2024-09-19T07:24:57.951 INFO:tasks.workunit.client.0.smithi098.stdout:8/516: chown d0/d16/d65/f7f 301 1 2024-09-19T07:24:57.951 INFO:tasks.workunit.client.0.smithi098.stdout:8/517: readlink d0/d16/l8e 0 2024-09-19T07:24:57.951 INFO:tasks.workunit.client.0.smithi098.stdout:8/518: truncate d0/d16/d7d/f99 94783 0 2024-09-19T07:24:57.951 INFO:tasks.workunit.client.0.smithi098.stdout:8/519: fsync d0/d1a/f49 0 2024-09-19T07:24:57.951 INFO:tasks.workunit.client.0.smithi098.stdout:8/520: fdatasync d0/d2c/f67 0 2024-09-19T07:24:57.951 INFO:tasks.workunit.client.0.smithi098.stdout:8/521: dread - d0/d16/d7d/fa0 zero size 2024-09-19T07:24:57.951 INFO:tasks.workunit.client.0.smithi098.stdout:0/585: mknod d5/d20/cb5 0 2024-09-19T07:24:57.952 INFO:tasks.workunit.client.0.smithi098.stdout:0/586: creat d5/d20/d1f/d52/d64/d77/fb6 x:0 0 0 2024-09-19T07:24:57.953 INFO:tasks.workunit.client.0.smithi098.stdout:4/463: getdents da/d31/d46/d56 0 2024-09-19T07:24:57.953 INFO:tasks.workunit.client.0.smithi098.stdout:0/587: mkdir d5/d20/d14/d49/d62/da7/db7 0 2024-09-19T07:24:57.953 INFO:tasks.workunit.client.0.smithi098.stdout:0/588: truncate d5/d20/d1f/d52/d64/d77/fa9 88241 0 2024-09-19T07:24:57.954 INFO:tasks.workunit.client.0.smithi098.stdout:4/464: creat da/d31/d46/d56/d5b/d61/fa1 x:0 0 0 2024-09-19T07:24:57.954 INFO:tasks.workunit.client.0.smithi098.stdout:4/465: rename da/d31 to da/d31/d46/d5f/d8a/da2 22 2024-09-19T07:24:57.955 INFO:tasks.workunit.client.0.smithi098.stdout:0/589: mknod d5/d20/d1f/d52/d64/d77/d79/d92/cb8 0 2024-09-19T07:24:57.955 INFO:tasks.workunit.client.0.smithi098.stdout:0/590: dread - d5/f46 zero size 2024-09-19T07:24:57.956 INFO:tasks.workunit.client.0.smithi098.stdout:0/591: creat d5/d20/d1f/fb9 x:0 0 0 2024-09-19T07:24:57.956 INFO:tasks.workunit.client.0.smithi098.stdout:0/592: chown d5/d20/d14/d49/f56 198379430 1 2024-09-19T07:24:57.956 INFO:tasks.workunit.client.0.smithi098.stdout:0/593: stat d5/d20/d1f/d52/d9f 0 2024-09-19T07:24:57.957 INFO:tasks.workunit.client.0.smithi098.stdout:2/497: dwrite d1/d9/d26/d35/d58/f1a [0,4194304] 0 2024-09-19T07:24:57.958 INFO:tasks.workunit.client.0.smithi098.stdout:5/433: dwrite dc/de/d36/f4b [0,4194304] 0 2024-09-19T07:24:57.958 INFO:tasks.workunit.client.0.smithi098.stdout:5/434: truncate dc/de/d13/d46/d2e/d37/d81/f56 184864 0 2024-09-19T07:24:57.958 INFO:tasks.workunit.client.0.smithi098.stdout:5/435: truncate dc/de/d36/f39 5039345 0 2024-09-19T07:24:57.958 INFO:tasks.workunit.client.0.smithi098.stdout:5/436: chown dc/de/d13/f19 235795 1 2024-09-19T07:24:57.958 INFO:tasks.workunit.client.0.smithi098.stdout:5/437: truncate dc/de/d13/d46/f64 642196 0 2024-09-19T07:24:57.959 INFO:tasks.workunit.client.0.smithi098.stdout:5/438: getdents dc/de/d13/d46/d2e/d37/d67/d75 0 2024-09-19T07:24:57.960 INFO:tasks.workunit.client.0.smithi098.stdout:6/491: dwrite d2/db0/d4e/f65 [0,4194304] 0 2024-09-19T07:24:57.961 INFO:tasks.workunit.client.0.smithi098.stdout:2/498: mknod d1/d9/d1d/d8c/cab 0 2024-09-19T07:24:57.961 INFO:tasks.workunit.client.0.smithi098.stdout:2/499: fdatasync d1/d9/f2a 0 2024-09-19T07:24:57.963 INFO:tasks.workunit.client.0.smithi098.stdout:5/439: truncate dc/de/d13/f27 2588946 0 2024-09-19T07:24:57.965 INFO:tasks.workunit.client.0.smithi098.stdout:5/440: dread dc/f79 [0,4194304] 0 2024-09-19T07:24:57.966 INFO:tasks.workunit.client.0.smithi098.stdout:2/500: symlink d1/d9/d3e/d41/d60/lac 0 2024-09-19T07:24:57.966 INFO:tasks.workunit.client.0.smithi098.stdout:2/501: write d1/d5/d34/d80/d93/d61/d62/fa2 [256608,33804] 0 2024-09-19T07:24:57.966 INFO:tasks.workunit.client.0.smithi098.stdout:2/502: write d1/d9/d26/d35/d58/f18 [4934885,59748] 0 2024-09-19T07:24:57.968 INFO:tasks.workunit.client.0.smithi098.stdout:2/503: mkdir d1/d5/d34/d5a/d42/dad 0 2024-09-19T07:24:57.970 INFO:tasks.workunit.client.0.smithi098.stdout:5/441: symlink dc/de/d13/d46/d2e/d62/l8b 0 2024-09-19T07:24:57.970 INFO:tasks.workunit.client.0.smithi098.stdout:5/442: write f0 [6272033,127951] 0 2024-09-19T07:24:57.970 INFO:tasks.workunit.client.0.smithi098.stdout:5/443: getdents dc/de/d13/d7d 0 2024-09-19T07:24:57.971 INFO:tasks.workunit.client.0.smithi098.stdout:5/444: dread dc/f79 [0,4194304] 0 2024-09-19T07:24:57.971 INFO:tasks.workunit.client.0.smithi098.stdout:5/445: chown dc/c55 223828 1 2024-09-19T07:24:57.971 INFO:tasks.workunit.client.0.smithi098.stdout:2/504: truncate d1/d9/f2a 3518486 0 2024-09-19T07:24:57.971 INFO:tasks.workunit.client.0.smithi098.stdout:2/505: write d1/d9/d26/d35/f71 [485074,71653] 0 2024-09-19T07:24:57.972 INFO:tasks.workunit.client.0.smithi098.stdout:5/446: symlink dc/de/d13/d46/d2e/d37/d6d/l8c 0 2024-09-19T07:24:57.980 INFO:tasks.workunit.client.0.smithi098.stdout:2/506: truncate d1/d9/d1d/f43 1410184 0 2024-09-19T07:24:57.983 INFO:tasks.workunit.client.0.smithi098.stdout:6/492: dwrite d2/db0/d4e/d6e/d9d/fb7 [0,4194304] 0 2024-09-19T07:24:57.986 INFO:tasks.workunit.client.0.smithi098.stdout:2/507: dread d1/d9/f24 [0,4194304] 0 2024-09-19T07:24:57.988 INFO:tasks.workunit.client.0.smithi098.stdout:2/508: truncate d1/d2c/f30 2323178 0 2024-09-19T07:24:57.988 INFO:tasks.workunit.client.0.smithi098.stdout:6/493: dread d2/db0/f4f [0,4194304] 0 2024-09-19T07:24:57.991 INFO:tasks.workunit.client.0.smithi098.stdout:6/494: symlink d2/d5/d1f/d26/d7b/lbe 0 2024-09-19T07:24:57.992 INFO:tasks.workunit.client.0.smithi098.stdout:6/495: mkdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/dbf 0 2024-09-19T07:24:57.997 INFO:tasks.workunit.client.0.smithi098.stdout:4/466: rename da/d31/d46/d56/d5b/d61/f8f to da/d31/d46/d80/fa3 0 2024-09-19T07:24:57.999 INFO:tasks.workunit.client.0.smithi098.stdout:4/467: creat da/d31/d46/d56/fa4 x:0 0 0 2024-09-19T07:24:58.000 INFO:tasks.workunit.client.0.smithi098.stdout:0/594: rename d5/d20/d1f/d7d to d5/d20/d1f/d52/d64/dba 0 2024-09-19T07:24:58.001 INFO:tasks.workunit.client.0.smithi098.stdout:6/496: dread d2/d1b/f3a [0,4194304] 0 2024-09-19T07:24:58.001 INFO:tasks.workunit.client.0.smithi098.stdout:0/595: truncate d5/f84 325396 0 2024-09-19T07:24:58.003 INFO:tasks.workunit.client.0.smithi098.stdout:0/596: symlink d5/d20/d14/d49/d62/da7/lbb 0 2024-09-19T07:24:58.003 INFO:tasks.workunit.client.0.smithi098.stdout:4/468: rename da/f1c to da/d31/d46/d5f/d8a/fa5 0 2024-09-19T07:24:58.003 INFO:tasks.workunit.client.0.smithi098.stdout:6/497: symlink d2/db0/d4e/d6e/lc0 0 2024-09-19T07:24:58.004 INFO:tasks.workunit.client.0.smithi098.stdout:0/597: getdents d5/d20/d1f/d52/d64/d77/d79/d94 0 2024-09-19T07:24:58.005 INFO:tasks.workunit.client.0.smithi098.stdout:6/498: mkdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1 0 2024-09-19T07:24:58.006 INFO:tasks.workunit.client.0.smithi098.stdout:0/598: creat d5/d20/d1f/d52/d64/da0/fbc x:0 0 0 2024-09-19T07:24:58.011 INFO:tasks.workunit.client.0.smithi098.stdout:2/509: dread d1/d9/d26/d35/d48/f52 [0,4194304] 0 2024-09-19T07:24:58.011 INFO:tasks.workunit.client.0.smithi098.stdout:5/447: dwrite dc/de/d13/d46/d23/d5e/f83 [0,4194304] 0 2024-09-19T07:24:58.014 INFO:tasks.workunit.client.0.smithi098.stdout:2/510: creat d1/d5/d34/d5a/d42/d4e/fae x:0 0 0 2024-09-19T07:24:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:57 smithi098 ceph-mon[30950]: scrub summary: idle 2024-09-19T07:24:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:57 smithi098 ceph-mon[30950]: scrub summary: idle 2024-09-19T07:24:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:57 smithi098 ceph-mon[30950]: scrub summary: idle 2024-09-19T07:24:58.024 INFO:tasks.workunit.client.0.smithi098.stdout:4/469: write da/f2a [3889989,80205] 0 2024-09-19T07:24:58.025 INFO:tasks.workunit.client.0.smithi098.stdout:4/470: truncate da/f1f 1041720 0 2024-09-19T07:24:58.025 INFO:tasks.workunit.client.0.smithi098.stdout:4/471: write da/d59/f6f [3098994,112346] 0 2024-09-19T07:24:58.028 INFO:tasks.workunit.client.0.smithi098.stdout:2/511: dread d1/f8 [4194304,4194304] 0 2024-09-19T07:24:58.029 INFO:tasks.workunit.client.0.smithi098.stdout:2/512: creat d1/d9/d3e/d41/d60/d65/da0/faf x:0 0 0 2024-09-19T07:24:58.029 INFO:tasks.workunit.client.0.smithi098.stdout:2/513: chown d1/d9/d26/d5c 4908 1 2024-09-19T07:24:58.034 INFO:tasks.workunit.client.0.smithi098.stdout:2/514: creat d1/d9/d26/d35/d91/fb0 x:0 0 0 2024-09-19T07:24:58.034 INFO:tasks.workunit.client.0.smithi098.stdout:2/515: truncate d1/d9/d3e/d41/fa4 65203 0 2024-09-19T07:24:58.034 INFO:tasks.workunit.client.0.smithi098.stdout:2/516: readlink d1/d5/d34/d80/d93/d61/l6c 0 2024-09-19T07:24:58.034 INFO:tasks.workunit.client.0.smithi098.stdout:2/517: mknod d1/cb1 0 2024-09-19T07:24:58.035 INFO:tasks.workunit.client.0.smithi098.stdout:2/518: mkdir d1/d5/d34/d5a/db2 0 2024-09-19T07:24:58.036 INFO:tasks.workunit.client.0.smithi098.stdout:2/519: creat d1/d9/d3e/fb3 x:0 0 0 2024-09-19T07:24:58.036 INFO:tasks.workunit.client.0.smithi098.stdout:2/520: readlink d1/d9/d26/d35/d88/la1 0 2024-09-19T07:24:58.038 INFO:tasks.workunit.client.0.smithi098.stdout:2/521: unlink d1/d9/d3e/f8d 0 2024-09-19T07:24:58.039 INFO:tasks.workunit.client.0.smithi098.stdout:2/522: mkdir d1/d9/d3e/d41/d60/db4 0 2024-09-19T07:24:58.040 INFO:tasks.workunit.client.0.smithi098.stdout:2/523: unlink d1/cb1 0 2024-09-19T07:24:58.040 INFO:tasks.workunit.client.0.smithi098.stdout:0/599: dwrite d5/d20/d1f/d47/f90 [0,4194304] 0 2024-09-19T07:24:58.040 INFO:tasks.workunit.client.0.smithi098.stdout:0/600: chown d5/d20/d14/d49/d62/c6c 9262458 1 2024-09-19T07:24:58.041 INFO:tasks.workunit.client.0.smithi098.stdout:5/448: dwrite dc/de/d13/d46/d23/d52/f86 [0,4194304] 0 2024-09-19T07:24:58.041 INFO:tasks.workunit.client.0.smithi098.stdout:5/449: chown dc/de/d13/d46/d2e/d37/d81/f3c 467121498 1 2024-09-19T07:24:58.041 INFO:tasks.workunit.client.0.smithi098.stdout:0/601: write d5/d20/d1f/d47/fb0 [189860,46472] 0 2024-09-19T07:24:58.041 INFO:tasks.workunit.client.0.smithi098.stdout:2/524: unlink d1/d5/d34/d39/c79 0 2024-09-19T07:24:58.041 INFO:tasks.workunit.client.0.smithi098.stdout:5/450: mknod dc/de/d13/d46/d2e/d37/d6d/c8d 0 2024-09-19T07:24:58.041 INFO:tasks.workunit.client.0.smithi098.stdout:5/451: chown dc/c55 1 1 2024-09-19T07:24:58.044 INFO:tasks.workunit.client.0.smithi098.stdout:0/602: creat d5/d20/d1f/d52/d64/d77/fbd x:0 0 0 2024-09-19T07:24:58.046 INFO:tasks.workunit.client.0.smithi098.stdout:2/525: unlink d1/d5/d34/c9f 0 2024-09-19T07:24:58.047 INFO:tasks.workunit.client.0.smithi098.stdout:0/603: symlink d5/d20/d14/d49/lbe 0 2024-09-19T07:24:58.050 INFO:tasks.workunit.client.0.smithi098.stdout:4/472: dwrite da/f1f [0,4194304] 0 2024-09-19T07:24:58.053 INFO:tasks.workunit.client.0.smithi098.stdout:4/473: symlink da/d31/d46/d56/la6 0 2024-09-19T07:24:58.054 INFO:tasks.workunit.client.0.smithi098.stdout:4/474: symlink da/d31/d46/la7 0 2024-09-19T07:24:58.056 INFO:tasks.workunit.client.0.smithi098.stdout:4/475: creat da/d31/d46/d56/d5b/d61/fa8 x:0 0 0 2024-09-19T07:24:58.058 INFO:tasks.workunit.client.0.smithi098.stdout:4/476: unlink da/d31/d46/d5f/l8c 0 2024-09-19T07:24:58.060 INFO:tasks.workunit.client.0.smithi098.stdout:2/526: rename d1/d5/d34/d5a/d42 to d1/d5/d72/db5 0 2024-09-19T07:24:58.060 INFO:tasks.workunit.client.0.smithi098.stdout:2/527: write d1/d9/d26/d35/f71 [882805,90924] 0 2024-09-19T07:24:58.060 INFO:tasks.workunit.client.0.smithi098.stdout:2/528: write d1/d9/d26/d5c/f9c [868705,126087] 0 2024-09-19T07:24:58.062 INFO:tasks.workunit.client.0.smithi098.stdout:2/529: link d1/d5/c84 d1/d5/d34/d39/cb6 0 2024-09-19T07:24:58.072 INFO:tasks.workunit.client.0.smithi098.stdout:2/530: dread d1/d5/d72/db5/f8e [0,4194304] 0 2024-09-19T07:24:58.074 INFO:tasks.workunit.client.0.smithi098.stdout:2/531: mkdir d1/d9/d26/d5c/db7 0 2024-09-19T07:24:58.075 INFO:tasks.workunit.client.0.smithi098.stdout:2/532: creat d1/d5/d34/fb8 x:0 0 0 2024-09-19T07:24:58.079 INFO:tasks.workunit.client.0.smithi098.stdout:0/604: dwrite d5/d20/d14/f4a [0,4194304] 0 2024-09-19T07:24:58.079 INFO:tasks.workunit.client.0.smithi098.stdout:0/605: chown d5/f17 58777 1 2024-09-19T07:24:58.079 INFO:tasks.workunit.client.0.smithi098.stdout:0/606: fdatasync d5/d6b/d6d/f7b 0 2024-09-19T07:24:58.079 INFO:tasks.workunit.client.0.smithi098.stdout:0/607: fdatasync d5/f30 0 2024-09-19T07:24:58.079 INFO:tasks.workunit.client.0.smithi098.stdout:0/608: write d5/d20/d14/f5a [4532613,82337] 0 2024-09-19T07:24:58.079 INFO:tasks.workunit.client.0.smithi098.stdout:0/609: write d5/d6b/f9a [858973,23085] 0 2024-09-19T07:24:58.079 INFO:tasks.workunit.client.0.smithi098.stdout:0/610: write d5/d20/d14/d49/d62/da7/fac [84693,124210] 0 2024-09-19T07:24:58.081 INFO:tasks.workunit.client.0.smithi098.stdout:4/477: dwrite da/d31/f57 [0,4194304] 0 2024-09-19T07:24:58.082 INFO:tasks.workunit.client.0.smithi098.stdout:0/611: rename d5/d6b to d5/d20/d1f/d47/db2/dbf 0 2024-09-19T07:24:58.084 INFO:tasks.workunit.client.0.smithi098.stdout:0/612: rename d5/d20/cb5 to d5/d20/d1f/d47/db2/dbf/d6d/cc0 0 2024-09-19T07:24:58.091 INFO:tasks.workunit.client.0.smithi098.stdout:4/478: dread da/d31/f71 [0,4194304] 0 2024-09-19T07:24:58.091 INFO:tasks.workunit.client.0.smithi098.stdout:4/479: chown da/d59/d5d/l76 377838306 1 2024-09-19T07:24:58.094 INFO:tasks.workunit.client.0.smithi098.stdout:0/613: write d5/d20/f41 [220232,52682] 0 2024-09-19T07:24:58.094 INFO:tasks.workunit.client.0.smithi098.stdout:0/614: dread - d5/f46 zero size 2024-09-19T07:24:58.098 INFO:tasks.workunit.client.0.smithi098.stdout:4/480: dread da/f16 [0,4194304] 0 2024-09-19T07:24:58.099 INFO:tasks.workunit.client.0.smithi098.stdout:4/481: chown da/c37 0 1 2024-09-19T07:24:58.099 INFO:tasks.workunit.client.0.smithi098.stdout:4/482: chown da/d31/f40 79885754 1 2024-09-19T07:24:58.099 INFO:tasks.workunit.client.0.smithi098.stdout:4/483: chown da/c48 1 1 2024-09-19T07:24:58.102 INFO:tasks.workunit.client.0.smithi098.stdout:0/615: dread d5/f23 [0,4194304] 0 2024-09-19T07:24:58.108 INFO:tasks.workunit.client.0.smithi098.stdout:4/484: link da/d31/d46/d5f/d8a/fa5 da/d31/d46/d56/d5b/d66/fa9 0 2024-09-19T07:24:58.108 INFO:tasks.workunit.client.0.smithi098.stdout:4/485: readlink da/l17 0 2024-09-19T07:24:58.108 INFO:tasks.workunit.client.0.smithi098.stdout:4/486: write da/d31/d46/d5f/f75 [712033,97418] 0 2024-09-19T07:24:58.108 INFO:tasks.workunit.client.0.smithi098.stdout:0/616: write d5/d20/f12 [9911097,51222] 0 2024-09-19T07:24:58.109 INFO:tasks.workunit.client.0.smithi098.stdout:0/617: dread - d5/d20/d14/d49/f65 zero size 2024-09-19T07:24:58.109 INFO:tasks.workunit.client.0.smithi098.stdout:4/487: mkdir da/d31/d46/d56/d5b/d61/daa 0 2024-09-19T07:24:58.109 INFO:tasks.workunit.client.0.smithi098.stdout:4/488: write da/d31/d46/d80/fa3 [387367,14350] 0 2024-09-19T07:24:58.111 INFO:tasks.workunit.client.0.smithi098.stdout:4/489: rename da/d31/c4d to da/d31/d46/d80/cab 0 2024-09-19T07:24:58.112 INFO:tasks.workunit.client.0.smithi098.stdout:4/490: truncate da/d31/d46/f51 2749232 0 2024-09-19T07:24:58.133 INFO:tasks.workunit.client.0.smithi098.stdout:0/618: dwrite d5/f84 [0,4194304] 0 2024-09-19T07:24:58.135 INFO:tasks.workunit.client.0.smithi098.stdout:0/619: getdents d5 0 2024-09-19T07:24:58.136 INFO:tasks.workunit.client.0.smithi098.stdout:0/620: mknod d5/d20/d1f/d52/d64/dba/cc1 0 2024-09-19T07:24:58.140 INFO:tasks.workunit.client.0.smithi098.stdout:9/544: sync 2024-09-19T07:24:58.140 INFO:tasks.workunit.client.0.smithi098.stdout:9/545: chown d3/d30/d73 131547712 1 2024-09-19T07:24:58.141 INFO:tasks.workunit.client.0.smithi098.stdout:9/546: mkdir d3/dc/df/d15/d1a/db7 0 2024-09-19T07:24:58.141 INFO:tasks.workunit.client.0.smithi098.stdout:9/547: read d3/dc/df/d15/d1a/f9c [817588,33683] 0 2024-09-19T07:24:58.144 INFO:tasks.workunit.client.0.smithi098.stdout:4/491: dwrite da/d31/d46/f51 [0,4194304] 0 2024-09-19T07:24:58.146 INFO:tasks.workunit.client.0.smithi098.stdout:4/492: mknod da/d31/d46/d56/d5b/cac 0 2024-09-19T07:24:58.147 INFO:tasks.workunit.client.0.smithi098.stdout:0/621: dread d5/d20/d14/f35 [0,4194304] 0 2024-09-19T07:24:58.148 INFO:tasks.workunit.client.0.smithi098.stdout:4/493: dread da/f1d [4194304,4194304] 0 2024-09-19T07:24:58.149 INFO:tasks.workunit.client.0.smithi098.stdout:4/494: creat da/d31/d46/d80/fad x:0 0 0 2024-09-19T07:24:58.150 INFO:tasks.workunit.client.0.smithi098.stdout:4/495: write da/fb [7469531,95434] 0 2024-09-19T07:24:58.150 INFO:tasks.workunit.client.0.smithi098.stdout:0/622: rename d5/f84 to d5/d20/d1f/d47/db2/dbf/fc2 0 2024-09-19T07:24:58.150 INFO:tasks.workunit.client.0.smithi098.stdout:0/623: read - d5/d20/d14/d49/f72 zero size 2024-09-19T07:24:58.150 INFO:tasks.workunit.client.0.smithi098.stdout:0/624: creat d5/d20/d1f/d52/d64/fc3 x:0 0 0 2024-09-19T07:24:58.151 INFO:tasks.workunit.client.0.smithi098.stdout:0/625: truncate d5/f4f 1058668 0 2024-09-19T07:24:58.152 INFO:tasks.workunit.client.0.smithi098.stdout:0/626: write d5/d20/d1f/d47/db2/dbf/d6d/f6f [2616443,98237] 0 2024-09-19T07:24:58.168 INFO:tasks.workunit.client.0.smithi098.stdout:4/496: dwrite da/d31/d46/d80/f99 [4194304,4194304] 0 2024-09-19T07:24:58.170 INFO:tasks.workunit.client.0.smithi098.stdout:4/497: creat da/d31/d46/d56/fae x:0 0 0 2024-09-19T07:24:58.171 INFO:tasks.workunit.client.0.smithi098.stdout:4/498: link da/d59/d5d/l76 da/d31/d46/d5f/d8a/laf 0 2024-09-19T07:24:58.172 INFO:tasks.workunit.client.0.smithi098.stdout:1/585: sync 2024-09-19T07:24:58.172 INFO:tasks.workunit.client.0.smithi098.stdout:7/657: sync 2024-09-19T07:24:58.172 INFO:tasks.workunit.client.0.smithi098.stdout:3/499: sync 2024-09-19T07:24:58.172 INFO:tasks.workunit.client.0.smithi098.stdout:3/500: readlink de/df/d1f/l78 0 2024-09-19T07:24:58.172 INFO:tasks.workunit.client.0.smithi098.stdout:1/586: dread - dc/de/d22/d31/d5d/d6a/d6f/d5f/fc2 zero size 2024-09-19T07:24:58.174 INFO:tasks.workunit.client.0.smithi098.stdout:7/658: dread d5/f3c [4194304,4194304] 0 2024-09-19T07:24:58.175 INFO:tasks.workunit.client.0.smithi098.stdout:7/659: rmdir d5 39 2024-09-19T07:24:58.184 INFO:tasks.workunit.client.0.smithi098.stdout:3/501: rename de/df/d1f/d2b/c43 to de/df/c92 0 2024-09-19T07:24:58.186 INFO:tasks.workunit.client.0.smithi098.stdout:3/502: mkdir de/df/d1f/d2b/d93 0 2024-09-19T07:24:58.189 INFO:tasks.workunit.client.0.smithi098.stdout:1/587: dread dc/de/d22/d31/d5d/d6a/d6f/d5f/f91 [0,4194304] 0 2024-09-19T07:24:58.190 INFO:tasks.workunit.client.0.smithi098.stdout:1/588: fdatasync dc/de/d22/d31/d5d/d6a/d6f/d5f/fc2 0 2024-09-19T07:24:58.190 INFO:tasks.workunit.client.0.smithi098.stdout:7/660: write d5/d8/dc/d16/f84 [682616,116345] 0 2024-09-19T07:24:58.190 INFO:tasks.workunit.client.0.smithi098.stdout:3/503: symlink de/df/d1f/l94 0 2024-09-19T07:24:58.191 INFO:tasks.workunit.client.0.smithi098.stdout:3/504: creat de/df/d1f/d72/f95 x:0 0 0 2024-09-19T07:24:58.191 INFO:tasks.workunit.client.0.smithi098.stdout:3/505: getdents de/df/d1f/d2b/d93 0 2024-09-19T07:24:58.192 INFO:tasks.workunit.client.0.smithi098.stdout:3/506: creat de/df/d31/d61/d3f/d64/f96 x:0 0 0 2024-09-19T07:24:58.192 INFO:tasks.workunit.client.0.smithi098.stdout:3/507: symlink de/d4e/d6d/l97 0 2024-09-19T07:24:58.193 INFO:tasks.workunit.client.0.smithi098.stdout:3/508: fdatasync de/f25 0 2024-09-19T07:24:58.194 INFO:tasks.workunit.client.0.smithi098.stdout:3/509: creat de/df/d1f/d72/f98 x:0 0 0 2024-09-19T07:24:58.195 INFO:tasks.workunit.client.0.smithi098.stdout:4/499: dwrite da/d31/d46/d5f/f7c [0,4194304] 0 2024-09-19T07:24:58.196 INFO:tasks.workunit.client.0.smithi098.stdout:3/510: dread de/d4e/f6a [0,4194304] 0 2024-09-19T07:24:58.198 INFO:tasks.workunit.client.0.smithi098.stdout:1/589: read dc/d17/d1b/d1d/d30/f59 [3173304,120195] 0 2024-09-19T07:24:58.200 INFO:tasks.workunit.client.0.smithi098.stdout:1/590: creat dc/d17/fc7 x:0 0 0 2024-09-19T07:24:58.201 INFO:tasks.workunit.client.0.smithi098.stdout:1/591: chown dc/de/d22/d31/d5d/d6a/d6f/l52 0 1 2024-09-19T07:24:58.201 INFO:tasks.workunit.client.0.smithi098.stdout:1/592: chown dc/de/d22/d31/d35/d58/f7d 15 1 2024-09-19T07:24:58.201 INFO:tasks.workunit.client.0.smithi098.stdout:1/593: chown dc/d17/f76 1 1 2024-09-19T07:24:58.204 INFO:tasks.workunit.client.0.smithi098.stdout:3/511: dread de/f19 [0,4194304] 0 2024-09-19T07:24:58.204 INFO:tasks.workunit.client.0.smithi098.stdout:3/512: readlink de/l2a 0 2024-09-19T07:24:58.204 INFO:tasks.workunit.client.0.smithi098.stdout:4/500: dread da/d31/d46/d56/f89 [0,4194304] 0 2024-09-19T07:24:58.204 INFO:tasks.workunit.client.0.smithi098.stdout:4/501: readlink da/d31/l4c 0 2024-09-19T07:24:58.204 INFO:tasks.workunit.client.0.smithi098.stdout:4/502: creat da/d7e/fb0 x:0 0 0 2024-09-19T07:24:58.204 INFO:tasks.workunit.client.0.smithi098.stdout:3/513: creat de/df/d1f/f99 x:0 0 0 2024-09-19T07:24:58.206 INFO:tasks.workunit.client.0.smithi098.stdout:3/514: mknod de/df/d31/d61/d3f/d64/d84/c9a 0 2024-09-19T07:24:58.206 INFO:tasks.workunit.client.0.smithi098.stdout:3/515: chown de/df/d31/l3b 81541775 1 2024-09-19T07:24:58.206 INFO:tasks.workunit.client.0.smithi098.stdout:3/516: read f4 [1427396,17373] 0 2024-09-19T07:24:58.207 INFO:tasks.workunit.client.0.smithi098.stdout:3/517: getdents de/df 0 2024-09-19T07:24:58.207 INFO:tasks.workunit.client.0.smithi098.stdout:3/518: chown de/f19 34 1 2024-09-19T07:24:58.207 INFO:tasks.workunit.client.0.smithi098.stdout:4/503: mknod da/d31/d46/d56/d5b/cb1 0 2024-09-19T07:24:58.208 INFO:tasks.workunit.client.0.smithi098.stdout:3/519: truncate de/f1d 733831 0 2024-09-19T07:24:58.209 INFO:tasks.workunit.client.0.smithi098.stdout:4/504: dread da/d31/d46/d5f/f75 [0,4194304] 0 2024-09-19T07:24:58.209 INFO:tasks.workunit.client.0.smithi098.stdout:4/505: readlink da/d31/d46/la7 0 2024-09-19T07:24:58.209 INFO:tasks.workunit.client.0.smithi098.stdout:4/506: write da/d31/d46/d56/fa0 [105536,57622] 0 2024-09-19T07:24:58.209 INFO:tasks.workunit.client.0.smithi098.stdout:3/520: mknod de/d4e/d6d/c9b 0 2024-09-19T07:24:58.210 INFO:tasks.workunit.client.0.smithi098.stdout:7/661: dwrite d5/d3e/f95 [0,4194304] 0 2024-09-19T07:24:58.210 INFO:tasks.workunit.client.0.smithi098.stdout:3/521: symlink de/df/d31/d61/d3f/d64/l9c 0 2024-09-19T07:24:58.211 INFO:tasks.workunit.client.0.smithi098.stdout:4/507: creat da/d31/d46/d56/d5b/fb2 x:0 0 0 2024-09-19T07:24:58.213 INFO:tasks.workunit.client.0.smithi098.stdout:7/662: unlink d5/d3e/f95 0 2024-09-19T07:24:58.213 INFO:tasks.workunit.client.0.smithi098.stdout:4/508: unlink da/d31/d46/d56/fa4 0 2024-09-19T07:24:58.215 INFO:tasks.workunit.client.0.smithi098.stdout:4/509: mknod da/d31/d46/d56/d5b/d66/cb3 0 2024-09-19T07:24:58.215 INFO:tasks.workunit.client.0.smithi098.stdout:1/594: write dc/f33 [11280079,43792] 0 2024-09-19T07:24:58.221 INFO:tasks.workunit.client.0.smithi098.stdout:1/595: dread dc/de/d22/d31/f5b [0,4194304] 0 2024-09-19T07:24:58.223 INFO:tasks.workunit.client.0.smithi098.stdout:1/596: creat dc/d17/d1b/d71/d7a/fc8 x:0 0 0 2024-09-19T07:24:58.224 INFO:tasks.workunit.client.0.smithi098.stdout:1/597: getdents dc/de/d50/d6c 0 2024-09-19T07:24:58.224 INFO:tasks.workunit.client.0.smithi098.stdout:1/598: truncate dc/d17/fc7 1013487 0 2024-09-19T07:24:58.224 INFO:tasks.workunit.client.0.smithi098.stdout:1/599: rename dc/d17 to dc/d17/d1b/d1d/d3d/dc9 22 2024-09-19T07:24:58.224 INFO:tasks.workunit.client.0.smithi098.stdout:1/600: chown dc/de/d50/l9d 5979899 1 2024-09-19T07:24:58.224 INFO:tasks.workunit.client.0.smithi098.stdout:1/601: chown dc/d17/d1b/d1d/f3f 1063377020 1 2024-09-19T07:24:58.225 INFO:tasks.workunit.client.0.smithi098.stdout:1/602: truncate dc/f23 513926 0 2024-09-19T07:24:58.228 INFO:tasks.workunit.client.0.smithi098.stdout:1/603: creat dc/de/d22/d31/d5d/fca x:0 0 0 2024-09-19T07:24:58.228 INFO:tasks.workunit.client.0.smithi098.stdout:1/604: write dc/de/d22/f8c [220184,12729] 0 2024-09-19T07:24:58.228 INFO:tasks.workunit.client.0.smithi098.stdout:1/605: write dc/d17/d1b/faa [101494,87947] 0 2024-09-19T07:24:58.228 INFO:tasks.workunit.client.0.smithi098.stdout:1/606: mknod dc/d2a/ccb 0 2024-09-19T07:24:58.228 INFO:tasks.workunit.client.0.smithi098.stdout:1/607: chown dc/de/d22/d31/d35/d4f/lae 2 1 2024-09-19T07:24:58.229 INFO:tasks.workunit.client.0.smithi098.stdout:1/608: stat dc/cd 0 2024-09-19T07:24:58.229 INFO:tasks.workunit.client.0.smithi098.stdout:1/609: truncate dc/de/d38/f6b 80678 0 2024-09-19T07:24:58.230 INFO:tasks.workunit.client.0.smithi098.stdout:1/610: creat dc/de/fcc x:0 0 0 2024-09-19T07:24:58.231 INFO:tasks.workunit.client.0.smithi098.stdout:1/611: rename dc/d17/d1b/d1d/d30/f70 to dc/d17/d1b/d71/fcd 0 2024-09-19T07:24:58.233 INFO:tasks.workunit.client.0.smithi098.stdout:3/522: dwrite de/df/f53 [4194304,4194304] 0 2024-09-19T07:24:58.233 INFO:tasks.workunit.client.0.smithi098.stdout:1/612: creat dc/de/d22/d31/d5d/d6a/d8b/fce x:0 0 0 2024-09-19T07:24:58.234 INFO:tasks.workunit.client.0.smithi098.stdout:3/523: symlink de/df/d1f/d2b/d93/l9d 0 2024-09-19T07:24:58.234 INFO:tasks.workunit.client.0.smithi098.stdout:3/524: readlink de/df/l7e 0 2024-09-19T07:24:58.238 INFO:tasks.workunit.client.0.smithi098.stdout:1/613: mkdir dc/da5/dcf 0 2024-09-19T07:24:58.239 INFO:tasks.workunit.client.0.smithi098.stdout:4/510: dwrite da/f16 [0,4194304] 0 2024-09-19T07:24:58.240 INFO:tasks.workunit.client.0.smithi098.stdout:4/511: readlink da/l34 0 2024-09-19T07:24:58.240 INFO:tasks.workunit.client.0.smithi098.stdout:4/512: write da/d7e/f97 [764144,40030] 0 2024-09-19T07:24:58.240 INFO:tasks.workunit.client.0.smithi098.stdout:4/513: creat da/d31/d46/d56/d5b/d61/fb4 x:0 0 0 2024-09-19T07:24:58.243 INFO:tasks.workunit.client.0.smithi098.stdout:5/452: sync 2024-09-19T07:24:58.243 INFO:tasks.workunit.client.0.smithi098.stdout:8/522: sync 2024-09-19T07:24:58.243 INFO:tasks.workunit.client.0.smithi098.stdout:6/499: sync 2024-09-19T07:24:58.243 INFO:tasks.workunit.client.0.smithi098.stdout:6/500: rename d2/d5/d1f/d26 to d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98/dc2 22 2024-09-19T07:24:58.244 INFO:tasks.workunit.client.0.smithi098.stdout:8/523: truncate d0/d1a/f3b 2003224 0 2024-09-19T07:24:58.244 INFO:tasks.workunit.client.0.smithi098.stdout:8/524: truncate d0/d16/f94 1040906 0 2024-09-19T07:24:58.244 INFO:tasks.workunit.client.0.smithi098.stdout:2/533: sync 2024-09-19T07:24:58.244 INFO:tasks.workunit.client.0.smithi098.stdout:2/534: chown d1/d9/d26/d35/d91/f94 3208 1 2024-09-19T07:24:58.244 INFO:tasks.workunit.client.0.smithi098.stdout:3/525: write de/df/d16/f4a [708447,79487] 0 2024-09-19T07:24:58.244 INFO:tasks.workunit.client.0.smithi098.stdout:5/453: dread f3 [4194304,4194304] 0 2024-09-19T07:24:58.245 INFO:tasks.workunit.client.0.smithi098.stdout:5/454: symlink dc/de/d13/d46/d2e/d37/d6d/l8e 0 2024-09-19T07:24:58.245 INFO:tasks.workunit.client.0.smithi098.stdout:8/525: mknod d0/d16/d61/ca3 0 2024-09-19T07:24:58.248 INFO:tasks.workunit.client.0.smithi098.stdout:2/535: link d1/d9/d26/d35/d58/f18 d1/d9/d26/d35/d58/fb9 0 2024-09-19T07:24:58.249 INFO:tasks.workunit.client.0.smithi098.stdout:4/514: dread da/d31/f49 [0,4194304] 0 2024-09-19T07:24:58.250 INFO:tasks.workunit.client.0.smithi098.stdout:4/515: fsync da/d31/d46/d5f/f7c 0 2024-09-19T07:24:58.250 INFO:tasks.workunit.client.0.smithi098.stdout:3/526: rename de/df/c10 to de/d4e/d6d/c9e 0 2024-09-19T07:24:58.251 INFO:tasks.workunit.client.0.smithi098.stdout:8/526: mkdir d0/d33/d55/d8a/d21/d50/d9e/da4 0 2024-09-19T07:24:58.251 INFO:tasks.workunit.client.0.smithi098.stdout:8/527: stat d0/d33/d55/d8a/d28/f86 0 2024-09-19T07:24:58.252 INFO:tasks.workunit.client.0.smithi098.stdout:2/536: creat d1/d9/fba x:0 0 0 2024-09-19T07:24:58.256 INFO:tasks.workunit.client.0.smithi098.stdout:8/528: unlink d0/d33/d55/d8a/d21/c2e 0 2024-09-19T07:24:58.265 INFO:tasks.workunit.client.0.smithi098.stdout:8/529: dread d0/d1a/f1c [0,4194304] 0 2024-09-19T07:24:58.269 INFO:tasks.workunit.client.0.smithi098.stdout:1/614: dwrite dc/de/d22/d31/d35/fa1 [0,4194304] 0 2024-09-19T07:24:58.270 INFO:tasks.workunit.client.0.smithi098.stdout:1/615: mkdir dc/d17/d1b/d1d/d30/dd0 0 2024-09-19T07:24:58.270 INFO:tasks.workunit.client.0.smithi098.stdout:1/616: write dc/de/d22/fbb [822277,48738] 0 2024-09-19T07:24:58.274 INFO:tasks.workunit.client.0.smithi098.stdout:1/617: dread dc/de/d38/f6b [0,4194304] 0 2024-09-19T07:24:58.276 INFO:tasks.workunit.client.0.smithi098.stdout:1/618: symlink dc/da5/dcf/ld1 0 2024-09-19T07:24:58.277 INFO:tasks.workunit.client.0.smithi098.stdout:1/619: creat dc/de/d22/fd2 x:0 0 0 2024-09-19T07:24:58.277 INFO:tasks.workunit.client.0.smithi098.stdout:8/530: read d0/d16/f3f [1734525,79007] 0 2024-09-19T07:24:58.277 INFO:tasks.workunit.client.0.smithi098.stdout:6/501: dwrite d2/fe [0,4194304] 0 2024-09-19T07:24:58.278 INFO:tasks.workunit.client.0.smithi098.stdout:8/531: fdatasync d0/f4e 0 2024-09-19T07:24:58.279 INFO:tasks.workunit.client.0.smithi098.stdout:8/532: creat d0/fa5 x:0 0 0 2024-09-19T07:24:58.279 INFO:tasks.workunit.client.0.smithi098.stdout:8/533: fdatasync d0/d33/d55/d8a/f18 0 2024-09-19T07:24:58.280 INFO:tasks.workunit.client.0.smithi098.stdout:6/502: mkdir d2/d5/d1f/d26/d42/d48/dc3 0 2024-09-19T07:24:58.280 INFO:tasks.workunit.client.0.smithi098.stdout:6/503: chown d2/db0/l74 7399212 1 2024-09-19T07:24:58.284 INFO:tasks.workunit.client.0.smithi098.stdout:6/504: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98/fc4 x:0 0 0 2024-09-19T07:24:58.284 INFO:tasks.workunit.client.0.smithi098.stdout:6/505: dread - d2/db0/d4e/d6e/d9d/fa1 zero size 2024-09-19T07:24:58.285 INFO:tasks.workunit.client.0.smithi098.stdout:1/620: read dc/de/d22/d31/d5d/d6a/d6f/f4a [1266183,92873] 0 2024-09-19T07:24:58.285 INFO:tasks.workunit.client.0.smithi098.stdout:1/621: fsync dc/de/d22/d31/d5d/d6a/d6f/d5f/fb8 0 2024-09-19T07:24:58.285 INFO:tasks.workunit.client.0.smithi098.stdout:6/506: mknod d2/d5/d1f/d26/d42/d48/dc3/cc5 0 2024-09-19T07:24:58.285 INFO:tasks.workunit.client.0.smithi098.stdout:6/507: chown d2/d5/d1f/d26/lb6 7 1 2024-09-19T07:24:58.286 INFO:tasks.workunit.client.0.smithi098.stdout:2/537: dwrite d1/d5/d34/f96 [0,4194304] 0 2024-09-19T07:24:58.287 INFO:tasks.workunit.client.0.smithi098.stdout:2/538: fdatasync d1/d2c/f2f 0 2024-09-19T07:24:58.287 INFO:tasks.workunit.client.0.smithi098.stdout:4/516: dwrite da/d59/f86 [0,4194304] 0 2024-09-19T07:24:58.287 INFO:tasks.workunit.client.0.smithi098.stdout:4/517: truncate da/d31/d46/d56/fae 79172 0 2024-09-19T07:24:58.287 INFO:tasks.workunit.client.0.smithi098.stdout:4/518: chown da/d31/f45 16 1 2024-09-19T07:24:58.287 INFO:tasks.workunit.client.0.smithi098.stdout:1/622: creat dc/d2a/fd3 x:0 0 0 2024-09-19T07:24:58.287 INFO:tasks.workunit.client.0.smithi098.stdout:1/623: chown dc/d2a/l92 493 1 2024-09-19T07:24:58.287 INFO:tasks.workunit.client.0.smithi098.stdout:5/455: dwrite dc/de/f63 [0,4194304] 0 2024-09-19T07:24:58.287 INFO:tasks.workunit.client.0.smithi098.stdout:3/527: dwrite de/df/f53 [8388608,4194304] 0 2024-09-19T07:24:58.287 INFO:tasks.workunit.client.0.smithi098.stdout:4/519: creat da/d59/d5d/fb5 x:0 0 0 2024-09-19T07:24:58.288 INFO:tasks.workunit.client.0.smithi098.stdout:2/539: creat d1/d9/d3e/d41/d60/fbb x:0 0 0 2024-09-19T07:24:58.290 INFO:tasks.workunit.client.0.smithi098.stdout:4/520: stat da/d31/d46/d5f/d8a/fa5 0 2024-09-19T07:24:58.292 INFO:tasks.workunit.client.0.smithi098.stdout:5/456: link fa dc/de/d36/d71/d84/f8f 0 2024-09-19T07:24:58.292 INFO:tasks.workunit.client.0.smithi098.stdout:4/521: mkdir da/d31/d46/d5f/d8a/db6 0 2024-09-19T07:24:58.293 INFO:tasks.workunit.client.0.smithi098.stdout:3/528: creat de/df/d16/f9f x:0 0 0 2024-09-19T07:24:58.294 INFO:tasks.workunit.client.0.smithi098.stdout:5/457: getdents dc/de/d36 0 2024-09-19T07:24:58.295 INFO:tasks.workunit.client.0.smithi098.stdout:4/522: creat da/d31/d46/d56/d5b/d61/fb7 x:0 0 0 2024-09-19T07:24:58.297 INFO:tasks.workunit.client.0.smithi098.stdout:8/534: dwrite d0/d16/f9c [0,4194304] 0 2024-09-19T07:24:58.297 INFO:tasks.workunit.client.0.smithi098.stdout:1/624: rmdir dc/d17/d1b/d1d/d30/da3 0 2024-09-19T07:24:58.297 INFO:tasks.workunit.client.0.smithi098.stdout:6/508: dread d2/d1b/f1d [0,4194304] 0 2024-09-19T07:24:58.303 INFO:tasks.workunit.client.0.smithi098.stdout:8/535: symlink d0/d33/d55/d8a/d21/d50/la6 0 2024-09-19T07:24:58.305 INFO:tasks.workunit.client.0.smithi098.stdout:5/458: write dc/f17 [12052449,8258] 0 2024-09-19T07:24:58.306 INFO:tasks.workunit.client.0.smithi098.stdout:1/625: mkdir dc/d17/d9c/dd4 0 2024-09-19T07:24:58.307 INFO:tasks.workunit.client.0.smithi098.stdout:1/626: chown dc/de/d22/d31/d5d/d6a/d8b/fce 2582149 1 2024-09-19T07:24:58.307 INFO:tasks.workunit.client.0.smithi098.stdout:1/627: chown dc/de/d22/d31/d5d/d6a/d6f/f4a 85213164 1 2024-09-19T07:24:58.307 INFO:tasks.workunit.client.0.smithi098.stdout:8/536: rename d0/d16/d65/c82 to d0/d16/d65/ca7 0 2024-09-19T07:24:58.309 INFO:tasks.workunit.client.0.smithi098.stdout:1/628: truncate dc/de/d22/d31/d5d/d6a/d6f/d5f/f78 398825 0 2024-09-19T07:24:58.312 INFO:tasks.workunit.client.0.smithi098.stdout:2/540: dwrite d1/d9/d3e/d41/d60/fbb [0,4194304] 0 2024-09-19T07:24:58.316 INFO:tasks.workunit.client.0.smithi098.stdout:7/663: sync 2024-09-19T07:24:58.316 INFO:tasks.workunit.client.0.smithi098.stdout:0/627: sync 2024-09-19T07:24:58.316 INFO:tasks.workunit.client.0.smithi098.stdout:9/548: sync 2024-09-19T07:24:58.316 INFO:tasks.workunit.client.0.smithi098.stdout:9/549: write d3/dc/df/f87 [365502,3064] 0 2024-09-19T07:24:58.318 INFO:tasks.workunit.client.0.smithi098.stdout:0/628: creat d5/d20/d14/d49/d62/da7/fc4 x:0 0 0 2024-09-19T07:24:58.319 INFO:tasks.workunit.client.0.smithi098.stdout:9/550: creat d3/dc/df/d15/fb8 x:0 0 0 2024-09-19T07:24:58.319 INFO:tasks.workunit.client.0.smithi098.stdout:9/551: write d3/dc/df/d15/d2f/f5f [589403,14615] 0 2024-09-19T07:24:58.320 INFO:tasks.workunit.client.0.smithi098.stdout:0/629: creat d5/fc5 x:0 0 0 2024-09-19T07:24:58.320 INFO:tasks.workunit.client.0.smithi098.stdout:0/630: getdents d5/d20/d1f/d47/dae 0 2024-09-19T07:24:58.322 INFO:tasks.workunit.client.0.smithi098.stdout:0/631: rename d5/d20/f1b to d5/d20/d1f/d47/fc6 0 2024-09-19T07:24:58.323 INFO:tasks.workunit.client.0.smithi098.stdout:1/629: read dc/de/d22/d31/d35/fa1 [3455307,69712] 0 2024-09-19T07:24:58.323 INFO:tasks.workunit.client.0.smithi098.stdout:1/630: read - dc/de/d38/db1/fc1 zero size 2024-09-19T07:24:58.323 INFO:tasks.workunit.client.0.smithi098.stdout:1/631: readlink dc/l11 0 2024-09-19T07:24:58.323 INFO:tasks.workunit.client.0.smithi098.stdout:1/632: write dc/d17/d1b/faa [1080180,110011] 0 2024-09-19T07:24:58.324 INFO:tasks.workunit.client.0.smithi098.stdout:0/632: creat d5/d20/d1f/d8d/fc7 x:0 0 0 2024-09-19T07:24:58.324 INFO:tasks.workunit.client.0.smithi098.stdout:0/633: write d5/f30 [610652,47597] 0 2024-09-19T07:24:58.325 INFO:tasks.workunit.client.0.smithi098.stdout:1/633: dread dc/de/d22/f8c [0,4194304] 0 2024-09-19T07:24:58.326 INFO:tasks.workunit.client.0.smithi098.stdout:0/634: unlink d5/d20/d14/c70 0 2024-09-19T07:24:58.327 INFO:tasks.workunit.client.0.smithi098.stdout:1/634: truncate dc/de/d22/d31/d5d/d6a/d6f/d4d/f73 264406 0 2024-09-19T07:24:58.328 INFO:tasks.workunit.client.0.smithi098.stdout:0/635: symlink d5/d20/d14/d49/d62/da7/db7/lc8 0 2024-09-19T07:24:58.328 INFO:tasks.workunit.client.0.smithi098.stdout:1/635: mknod dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/cd5 0 2024-09-19T07:24:58.329 INFO:tasks.workunit.client.0.smithi098.stdout:1/636: fsync dc/de/d22/d31/d35/d4f/fc5 0 2024-09-19T07:24:58.329 INFO:tasks.workunit.client.0.smithi098.stdout:0/636: symlink d5/d20/d1f/d52/d64/da0/lc9 0 2024-09-19T07:24:58.329 INFO:tasks.workunit.client.0.smithi098.stdout:0/637: fsync d5/fe 0 2024-09-19T07:24:58.330 INFO:tasks.workunit.client.0.smithi098.stdout:1/637: mknod dc/de/d22/d31/d5d/d6a/d6f/d4d/cd6 0 2024-09-19T07:24:58.330 INFO:tasks.workunit.client.0.smithi098.stdout:1/638: rename dc/de/d22/d31 to dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/dd7 22 2024-09-19T07:24:58.331 INFO:tasks.workunit.client.0.smithi098.stdout:1/639: truncate dc/de/d22/d31/d5d/d6a/d6f/d4d/f54 4597372 0 2024-09-19T07:24:58.332 INFO:tasks.workunit.client.0.smithi098.stdout:7/664: read d5/d10/d11/fb3 [2435672,3164] 0 2024-09-19T07:24:58.332 INFO:tasks.workunit.client.0.smithi098.stdout:7/665: readlink d5/d8/d5d/lac 0 2024-09-19T07:24:58.333 INFO:tasks.workunit.client.0.smithi098.stdout:7/666: chown d5/d3e/d62/fb1 49471310 1 2024-09-19T07:24:58.333 INFO:tasks.workunit.client.0.smithi098.stdout:7/667: write d5/d10/d11/f73 [1465874,68991] 0 2024-09-19T07:24:58.333 INFO:tasks.workunit.client.0.smithi098.stdout:7/668: stat d5/d8/dc/d16/l3b 0 2024-09-19T07:24:58.333 INFO:tasks.workunit.client.0.smithi098.stdout:1/640: getdents dc/de/d22/d31/d5d 0 2024-09-19T07:24:58.336 INFO:tasks.workunit.client.0.smithi098.stdout:3/529: dwrite de/df/d1f/f47 [4194304,4194304] 0 2024-09-19T07:24:58.337 INFO:tasks.workunit.client.0.smithi098.stdout:7/669: unlink d5/d10/d50/fbe 0 2024-09-19T07:24:58.339 INFO:tasks.workunit.client.0.smithi098.stdout:3/530: unlink de/df/d1f/l94 0 2024-09-19T07:24:58.339 INFO:tasks.workunit.client.0.smithi098.stdout:6/509: dwrite d2/db0/d4e/d6e/d9d/d94/fac [0,4194304] 0 2024-09-19T07:24:58.342 INFO:tasks.workunit.client.0.smithi098.stdout:3/531: read de/f1d [388508,110142] 0 2024-09-19T07:24:58.342 INFO:tasks.workunit.client.0.smithi098.stdout:6/510: mkdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6 0 2024-09-19T07:24:58.342 INFO:tasks.workunit.client.0.smithi098.stdout:3/532: fsync f5 0 2024-09-19T07:24:58.342 INFO:tasks.workunit.client.0.smithi098.stdout:3/533: dread - de/df/d31/f7d zero size 2024-09-19T07:24:58.342 INFO:tasks.workunit.client.0.smithi098.stdout:3/534: truncate f5 1325622 0 2024-09-19T07:24:58.342 INFO:tasks.workunit.client.0.smithi098.stdout:3/535: readlink de/df/d16/l6c 0 2024-09-19T07:24:58.343 INFO:tasks.workunit.client.0.smithi098.stdout:6/511: creat d2/d5/d1f/fc7 x:0 0 0 2024-09-19T07:24:58.343 INFO:tasks.workunit.client.0.smithi098.stdout:6/512: chown d2/d5/c25 2074453682 1 2024-09-19T07:24:58.344 INFO:tasks.workunit.client.0.smithi098.stdout:6/513: fsync d2/d5/f81 0 2024-09-19T07:24:58.344 INFO:tasks.workunit.client.0.smithi098.stdout:3/536: creat de/df/d1f/fa0 x:0 0 0 2024-09-19T07:24:58.344 INFO:tasks.workunit.client.0.smithi098.stdout:3/537: fsync de/df/d31/d61/d3f/f5d 0 2024-09-19T07:24:58.344 INFO:tasks.workunit.client.0.smithi098.stdout:2/541: dwrite d1/d5/d34/f96 [0,4194304] 0 2024-09-19T07:24:58.345 INFO:tasks.workunit.client.0.smithi098.stdout:6/514: rmdir d2/db0/d4e/d6e 39 2024-09-19T07:24:58.345 INFO:tasks.workunit.client.0.smithi098.stdout:3/538: creat de/d4e/d6d/fa1 x:0 0 0 2024-09-19T07:24:58.345 INFO:tasks.workunit.client.0.smithi098.stdout:3/539: write de/df/d1f/f7f [566059,97298] 0 2024-09-19T07:24:58.346 INFO:tasks.workunit.client.0.smithi098.stdout:2/542: creat d1/d5/d34/d5a/fbc x:0 0 0 2024-09-19T07:24:58.346 INFO:tasks.workunit.client.0.smithi098.stdout:2/543: chown d1/d9/d26/d35/d58/fb9 87877313 1 2024-09-19T07:24:58.346 INFO:tasks.workunit.client.0.smithi098.stdout:2/544: mknod d1/d9/d26/d35/d91/cbd 0 2024-09-19T07:24:58.347 INFO:tasks.workunit.client.0.smithi098.stdout:4/523: dwrite da/d31/f45 [4194304,4194304] 0 2024-09-19T07:24:58.347 INFO:tasks.workunit.client.0.smithi098.stdout:9/552: dread d3/dc/df/d15/f5b [0,4194304] 0 2024-09-19T07:24:58.347 INFO:tasks.workunit.client.0.smithi098.stdout:2/545: mkdir d1/d9/d3e/d41/d60/dbe 0 2024-09-19T07:24:58.348 INFO:tasks.workunit.client.0.smithi098.stdout:2/546: dread - d1/d5/d34/d5a/fbc zero size 2024-09-19T07:24:58.350 INFO:tasks.workunit.client.0.smithi098.stdout:4/524: creat da/d31/d46/d5f/fb8 x:0 0 0 2024-09-19T07:24:58.350 INFO:tasks.workunit.client.0.smithi098.stdout:9/553: symlink d3/dc/df/d15/d1a/d2d/lb9 0 2024-09-19T07:24:58.350 INFO:tasks.workunit.client.0.smithi098.stdout:9/554: chown d3/d30/f88 2 1 2024-09-19T07:24:58.350 INFO:tasks.workunit.client.0.smithi098.stdout:9/555: chown d3/d16/d43/d51/l67 48066083 1 2024-09-19T07:24:58.352 INFO:tasks.workunit.client.0.smithi098.stdout:4/525: mkdir da/d31/d46/d56/d5b/db9 0 2024-09-19T07:24:58.353 INFO:tasks.workunit.client.0.smithi098.stdout:4/526: mknod da/d31/d46/d80/cba 0 2024-09-19T07:24:58.355 INFO:tasks.workunit.client.0.smithi098.stdout:8/537: dwrite d0/d33/d55/d8a/f5f [0,4194304] 0 2024-09-19T07:24:58.356 INFO:tasks.workunit.client.0.smithi098.stdout:8/538: mknod d0/d33/d55/d8a/d21/d50/ca8 0 2024-09-19T07:24:58.357 INFO:tasks.workunit.client.0.smithi098.stdout:8/539: mknod d0/d33/ca9 0 2024-09-19T07:24:58.360 INFO:tasks.workunit.client.0.smithi098.stdout:6/515: write d2/db0/d8d/fa9 [532482,68123] 0 2024-09-19T07:24:58.362 INFO:tasks.workunit.client.0.smithi098.stdout:2/547: dread d1/d9/f47 [0,4194304] 0 2024-09-19T07:24:58.362 INFO:tasks.workunit.client.0.smithi098.stdout:2/548: write d1/d2c/f2f [444920,130713] 0 2024-09-19T07:24:58.366 INFO:tasks.workunit.client.0.smithi098.stdout:1/641: dwrite dc/de/d22/d31/d5d/d6a/d6f/f4a [0,4194304] 0 2024-09-19T07:24:58.368 INFO:tasks.workunit.client.0.smithi098.stdout:1/642: write dc/de/d22/fbb [638662,71340] 0 2024-09-19T07:24:58.368 INFO:tasks.workunit.client.0.smithi098.stdout:0/638: dwrite d5/f8f [0,4194304] 0 2024-09-19T07:24:58.372 INFO:tasks.workunit.client.0.smithi098.stdout:0/639: mkdir d5/d20/d1f/d47/dae/dca 0 2024-09-19T07:24:58.375 INFO:tasks.workunit.client.0.smithi098.stdout:2/549: read d1/d5/d34/d80/d93/d61/f99 [3615758,98081] 0 2024-09-19T07:24:58.375 INFO:tasks.workunit.client.0.smithi098.stdout:0/640: dread d5/f3e [0,4194304] 0 2024-09-19T07:24:58.379 INFO:tasks.workunit.client.0.smithi098.stdout:2/550: mkdir d1/dbf 0 2024-09-19T07:24:58.380 INFO:tasks.workunit.client.0.smithi098.stdout:1/643: truncate dc/de/d22/fbb 658476 0 2024-09-19T07:24:58.380 INFO:tasks.workunit.client.0.smithi098.stdout:2/551: creat d1/d5/d72/db5/dad/fc0 x:0 0 0 2024-09-19T07:24:58.381 INFO:tasks.workunit.client.0.smithi098.stdout:1/644: creat dc/d17/d9c/fd8 x:0 0 0 2024-09-19T07:24:58.383 INFO:tasks.workunit.client.0.smithi098.stdout:2/552: rmdir d1/d9/d26/d5c/db7 0 2024-09-19T07:24:58.383 INFO:tasks.workunit.client.0.smithi098.stdout:2/553: write d1/d5/d34/d80/d93/d61/d62/fa2 [894793,1654] 0 2024-09-19T07:24:58.383 INFO:tasks.workunit.client.0.smithi098.stdout:2/554: readlink d1/d9/d3e/l1e 0 2024-09-19T07:24:58.390 INFO:tasks.workunit.client.0.smithi098.stdout:9/556: dwrite d3/dc/df/d15/fb8 [0,4194304] 0 2024-09-19T07:24:58.390 INFO:tasks.workunit.client.0.smithi098.stdout:4/527: dwrite da/d31/f45 [4194304,4194304] 0 2024-09-19T07:24:58.390 INFO:tasks.workunit.client.0.smithi098.stdout:4/528: stat da/f1d 0 2024-09-19T07:24:58.392 INFO:tasks.workunit.client.0.smithi098.stdout:4/529: rmdir da/d59/d5d/d82 39 2024-09-19T07:24:58.393 INFO:tasks.workunit.client.0.smithi098.stdout:4/530: creat da/d31/d46/d56/d5b/d61/fbb x:0 0 0 2024-09-19T07:24:58.393 INFO:tasks.workunit.client.0.smithi098.stdout:4/531: truncate da/d31/d46/d56/d5b/fb2 460432 0 2024-09-19T07:24:58.393 INFO:tasks.workunit.client.0.smithi098.stdout:3/540: rename de/df/l3e to de/df/d1f/d2b/la2 0 2024-09-19T07:24:58.394 INFO:tasks.workunit.client.0.smithi098.stdout:3/541: mknod de/df/d1f/d72/ca3 0 2024-09-19T07:24:58.394 INFO:tasks.workunit.client.0.smithi098.stdout:4/532: creat da/d59/d5d/fbc x:0 0 0 2024-09-19T07:24:58.395 INFO:tasks.workunit.client.0.smithi098.stdout:9/557: dread d3/d16/d43/d51/f6d [0,4194304] 0 2024-09-19T07:24:58.395 INFO:tasks.workunit.client.0.smithi098.stdout:6/516: rename d2/d5/l31 to d2/d1b/lc8 0 2024-09-19T07:24:58.396 INFO:tasks.workunit.client.0.smithi098.stdout:0/641: dwrite d5/fc5 [0,4194304] 0 2024-09-19T07:24:58.396 INFO:tasks.workunit.client.0.smithi098.stdout:0/642: fsync d5/d20/d1f/d52/fb4 0 2024-09-19T07:24:58.396 INFO:tasks.workunit.client.0.smithi098.stdout:0/643: fsync d5/d20/f41 0 2024-09-19T07:24:58.396 INFO:tasks.workunit.client.0.smithi098.stdout:8/540: dwrite d0/d33/d55/d8a/d28/d40/f96 [0,4194304] 0 2024-09-19T07:24:58.397 INFO:tasks.workunit.client.0.smithi098.stdout:4/533: symlink da/d31/d46/d56/lbd 0 2024-09-19T07:24:58.398 INFO:tasks.workunit.client.0.smithi098.stdout:4/534: creat da/d31/d46/fbe x:0 0 0 2024-09-19T07:24:58.398 INFO:tasks.workunit.client.0.smithi098.stdout:9/558: rmdir d3/dc/df/d15/d1a/d2d 39 2024-09-19T07:24:58.403 INFO:tasks.workunit.client.0.smithi098.stdout:0/644: creat d5/d20/d1f/d52/d64/d77/fcb x:0 0 0 2024-09-19T07:24:58.404 INFO:tasks.workunit.client.0.smithi098.stdout:8/541: symlink d0/d33/d55/d8a/d21/d3c/laa 0 2024-09-19T07:24:58.405 INFO:tasks.workunit.client.0.smithi098.stdout:9/559: symlink d3/d16/d43/d61/lba 0 2024-09-19T07:24:58.406 INFO:tasks.workunit.client.0.smithi098.stdout:0/645: truncate d5/d20/d1f/f4c 948688 0 2024-09-19T07:24:58.406 INFO:tasks.workunit.client.0.smithi098.stdout:0/646: readlink d5/d20/l2a 0 2024-09-19T07:24:58.407 INFO:tasks.workunit.client.0.smithi098.stdout:0/647: stat d5/d20/d14/ca4 0 2024-09-19T07:24:58.407 INFO:tasks.workunit.client.0.smithi098.stdout:9/560: write d3/dc/df/d15/d1b/f37 [4318992,107975] 0 2024-09-19T07:24:58.407 INFO:tasks.workunit.client.0.smithi098.stdout:0/648: readlink d5/d20/d14/d49/d62/l97 0 2024-09-19T07:24:58.410 INFO:tasks.workunit.client.0.smithi098.stdout:0/649: mkdir d5/d20/d1f/d52/d64/dcc 0 2024-09-19T07:24:58.410 INFO:tasks.workunit.client.0.smithi098.stdout:0/650: chown d5/d20/d1f/c44 12675369 1 2024-09-19T07:24:58.411 INFO:tasks.workunit.client.0.smithi098.stdout:9/561: symlink d3/dc/df/d15/d1b/lbb 0 2024-09-19T07:24:58.414 INFO:tasks.workunit.client.0.smithi098.stdout:4/535: write da/f3a [1135183,67012] 0 2024-09-19T07:24:58.414 INFO:tasks.workunit.client.0.smithi098.stdout:0/651: creat d5/d20/d1f/d47/dae/dca/fcd x:0 0 0 2024-09-19T07:24:58.416 INFO:tasks.workunit.client.0.smithi098.stdout:9/562: mkdir d3/d6/d46/d83/da9/dbc 0 2024-09-19T07:24:58.416 INFO:tasks.workunit.client.0.smithi098.stdout:9/563: readlink d3/dc/df/d15/d1a/d2b/l79 0 2024-09-19T07:24:58.417 INFO:tasks.workunit.client.0.smithi098.stdout:0/652: unlink d5/d20/d1f/d47/db2/dbf/fc2 0 2024-09-19T07:24:58.421 INFO:tasks.workunit.client.0.smithi098.stdout:9/564: dread d3/dc/df/d15/d1a/f9c [0,4194304] 0 2024-09-19T07:24:58.423 INFO:tasks.workunit.client.0.smithi098.stdout:9/565: creat d3/dc/df/d15/fbd x:0 0 0 2024-09-19T07:24:58.424 INFO:tasks.workunit.client.0.smithi098.stdout:9/566: symlink d3/dc/df/d15/d2f/lbe 0 2024-09-19T07:24:58.425 INFO:tasks.workunit.client.0.smithi098.stdout:9/567: mknod d3/d16/d43/d51/d6e/cbf 0 2024-09-19T07:24:58.425 INFO:tasks.workunit.client.0.smithi098.stdout:9/568: fsync d3/dc/df/f4e 0 2024-09-19T07:24:58.425 INFO:tasks.workunit.client.0.smithi098.stdout:9/569: truncate d3/d16/d38/f4f 5075826 0 2024-09-19T07:24:58.426 INFO:tasks.workunit.client.0.smithi098.stdout:9/570: mknod d3/d6/d46/d83/cc0 0 2024-09-19T07:24:58.426 INFO:tasks.workunit.client.0.smithi098.stdout:9/571: dread - d3/d16/d38/d48/f9d zero size 2024-09-19T07:24:58.426 INFO:tasks.workunit.client.0.smithi098.stdout:0/653: write d5/f18 [219493,114568] 0 2024-09-19T07:24:58.426 INFO:tasks.workunit.client.0.smithi098.stdout:9/572: truncate d3/d16/d38/d48/f96 2771380 0 2024-09-19T07:24:58.429 INFO:tasks.workunit.client.0.smithi098.stdout:0/654: creat d5/d20/d1f/d47/dae/dca/fce x:0 0 0 2024-09-19T07:24:58.429 INFO:tasks.workunit.client.0.smithi098.stdout:0/655: truncate d5/f46 414389 0 2024-09-19T07:24:58.429 INFO:tasks.workunit.client.0.smithi098.stdout:0/656: stat d5/d20/d14/d49/d62/da7/fac 0 2024-09-19T07:24:58.429 INFO:tasks.workunit.client.0.smithi098.stdout:0/657: dread - d5/d20/d14/d49/f72 zero size 2024-09-19T07:24:58.429 INFO:tasks.workunit.client.0.smithi098.stdout:0/658: readlink d5/d20/l98 0 2024-09-19T07:24:58.430 INFO:tasks.workunit.client.0.smithi098.stdout:9/573: unlink d3/dc/df/d15/d1a/d2b/d49/d55/c89 0 2024-09-19T07:24:58.431 INFO:tasks.workunit.client.0.smithi098.stdout:0/659: symlink d5/d20/d1f/d52/d64/d77/d79/d92/lcf 0 2024-09-19T07:24:58.431 INFO:tasks.workunit.client.0.smithi098.stdout:0/660: fsync d5/d20/d1f/d52/d64/da0/fbc 0 2024-09-19T07:24:58.431 INFO:tasks.workunit.client.0.smithi098.stdout:1/645: rename dc/de/d22/d31/d5d/d6a/d6f/l45 to dc/d17/d1b/d71/ld9 0 2024-09-19T07:24:58.432 INFO:tasks.workunit.client.0.smithi098.stdout:5/459: sync 2024-09-19T07:24:58.433 INFO:tasks.workunit.client.0.smithi098.stdout:2/555: rename d1/d9/d26/d5c/ca7 to d1/d9/d1d/d8c/cc1 0 2024-09-19T07:24:58.434 INFO:tasks.workunit.client.0.smithi098.stdout:5/460: symlink dc/de/d13/d46/l90 0 2024-09-19T07:24:58.436 INFO:tasks.workunit.client.0.smithi098.stdout:3/542: rename de/df/d31/d61/d3f/c42 to de/d4e/ca4 0 2024-09-19T07:24:58.437 INFO:tasks.workunit.client.0.smithi098.stdout:2/556: unlink d1/d9/d1d/f98 0 2024-09-19T07:24:58.437 INFO:tasks.workunit.client.0.smithi098.stdout:3/543: symlink de/df/d1f/d72/la5 0 2024-09-19T07:24:58.438 INFO:tasks.workunit.client.0.smithi098.stdout:3/544: write de/df/d31/f7d [369086,102747] 0 2024-09-19T07:24:58.438 INFO:tasks.workunit.client.0.smithi098.stdout:1/646: getdents dc/de/d22/d31/d5d/d6a/d6f/d5f/db0 0 2024-09-19T07:24:58.438 INFO:tasks.workunit.client.0.smithi098.stdout:1/647: dread - dc/de/fcc zero size 2024-09-19T07:24:58.438 INFO:tasks.workunit.client.0.smithi098.stdout:4/536: dwrite da/d31/d46/d5f/f7c [0,4194304] 0 2024-09-19T07:24:58.438 INFO:tasks.workunit.client.0.smithi098.stdout:2/557: mkdir d1/d9/d26/d35/d88/dc2 0 2024-09-19T07:24:58.440 INFO:tasks.workunit.client.0.smithi098.stdout:3/545: symlink de/df/d16/la6 0 2024-09-19T07:24:58.440 INFO:tasks.workunit.client.0.smithi098.stdout:3/546: truncate de/df/d1f/d72/f8a 624739 0 2024-09-19T07:24:58.440 INFO:tasks.workunit.client.0.smithi098.stdout:3/547: dread - de/d4e/d6d/d71/f73 zero size 2024-09-19T07:24:58.440 INFO:tasks.workunit.client.0.smithi098.stdout:3/548: write de/f28 [8438027,47562] 0 2024-09-19T07:24:58.440 INFO:tasks.workunit.client.0.smithi098.stdout:6/517: rename d2/db0/d8d/fa9 to d2/db0/d4e/d6e/d9d/fc9 0 2024-09-19T07:24:58.444 INFO:tasks.workunit.client.0.smithi098.stdout:6/518: creat d2/d5/d1f/d26/d42/da4/fca x:0 0 0 2024-09-19T07:24:58.444 INFO:tasks.workunit.client.0.smithi098.stdout:8/542: rename d0/d16/f73 to d0/d33/d55/d8a/d12/fab 0 2024-09-19T07:24:58.444 INFO:tasks.workunit.client.0.smithi098.stdout:8/543: chown d0/d2c/d81 1 1 2024-09-19T07:24:58.444 INFO:tasks.workunit.client.0.smithi098.stdout:4/537: mknod da/d31/cbf 0 2024-09-19T07:24:58.445 INFO:tasks.workunit.client.0.smithi098.stdout:2/558: rename d1/d2c/f2f to d1/d5/d34/d80/d93/d61/d62/fc3 0 2024-09-19T07:24:58.446 INFO:tasks.workunit.client.0.smithi098.stdout:5/461: symlink dc/de/d13/d46/d2e/d62/l91 0 2024-09-19T07:24:58.447 INFO:tasks.workunit.client.0.smithi098.stdout:6/519: rmdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1 39 2024-09-19T07:24:58.451 INFO:tasks.workunit.client.0.smithi098.stdout:5/462: rename dc/de/d13/d46/l38 to dc/de/l92 0 2024-09-19T07:24:58.454 INFO:tasks.workunit.client.0.smithi098.stdout:2/559: dread d1/d9/d26/d35/d58/f1a [0,4194304] 0 2024-09-19T07:24:58.454 INFO:tasks.workunit.client.0.smithi098.stdout:2/560: chown d1/d9/d3e/d41/d60/d65/da0/faf 0 1 2024-09-19T07:24:58.454 INFO:tasks.workunit.client.0.smithi098.stdout:2/561: fdatasync d1/d5/d34/f96 0 2024-09-19T07:24:58.456 INFO:tasks.workunit.client.0.smithi098.stdout:2/562: creat d1/d9/d3e/d41/d60/da5/fc4 x:0 0 0 2024-09-19T07:24:58.458 INFO:tasks.workunit.client.0.smithi098.stdout:7/670: sync 2024-09-19T07:24:58.459 INFO:tasks.workunit.client.0.smithi098.stdout:8/544: dread d0/d16/f95 [0,4194304] 0 2024-09-19T07:24:58.460 INFO:tasks.workunit.client.0.smithi098.stdout:7/671: rmdir d5/d8/d52/db6/dc9/dda 0 2024-09-19T07:24:58.460 INFO:tasks.workunit.client.0.smithi098.stdout:8/545: truncate d0/d1a/f49 2262296 0 2024-09-19T07:24:58.461 INFO:tasks.workunit.client.0.smithi098.stdout:7/672: rmdir d5/d8/d5d 39 2024-09-19T07:24:58.461 INFO:tasks.workunit.client.0.smithi098.stdout:7/673: truncate d5/fa8 846703 0 2024-09-19T07:24:58.461 INFO:tasks.workunit.client.0.smithi098.stdout:5/463: dread dc/de/d13/f27 [0,4194304] 0 2024-09-19T07:24:58.462 INFO:tasks.workunit.client.0.smithi098.stdout:7/674: truncate d5/d3e/d62/f70 4950169 0 2024-09-19T07:24:58.462 INFO:tasks.workunit.client.0.smithi098.stdout:2/563: dread d1/d5/d34/d80/d93/d61/d62/fc3 [0,4194304] 0 2024-09-19T07:24:58.463 INFO:tasks.workunit.client.0.smithi098.stdout:8/546: mknod d0/d33/cac 0 2024-09-19T07:24:58.463 INFO:tasks.workunit.client.0.smithi098.stdout:8/547: write d0/d16/d7d/fa0 [618086,101105] 0 2024-09-19T07:24:58.465 INFO:tasks.workunit.client.0.smithi098.stdout:2/564: unlink d1/d9/d3e/d41/d60/d65/ca9 0 2024-09-19T07:24:58.465 INFO:tasks.workunit.client.0.smithi098.stdout:2/565: chown d1/d2c/f44 12530 1 2024-09-19T07:24:58.466 INFO:tasks.workunit.client.0.smithi098.stdout:2/566: creat d1/d9/d26/d35/d48/d7f/fc5 x:0 0 0 2024-09-19T07:24:58.466 INFO:tasks.workunit.client.0.smithi098.stdout:2/567: dread - d1/d5/d34/d5a/fbc zero size 2024-09-19T07:24:58.466 INFO:tasks.workunit.client.0.smithi098.stdout:2/568: chown d1/d9/d3e/fd 1 1 2024-09-19T07:24:58.467 INFO:tasks.workunit.client.0.smithi098.stdout:2/569: truncate d1/d9/f2d 576201 0 2024-09-19T07:24:58.468 INFO:tasks.workunit.client.0.smithi098.stdout:2/570: truncate d1/d9/f28 549545 0 2024-09-19T07:24:58.470 INFO:tasks.workunit.client.0.smithi098.stdout:2/571: creat d1/d9/d26/d35/d48/d7f/fc6 x:0 0 0 2024-09-19T07:24:58.471 INFO:tasks.workunit.client.0.smithi098.stdout:2/572: creat d1/d9/d3e/d41/d60/dbe/fc7 x:0 0 0 2024-09-19T07:24:58.472 INFO:tasks.workunit.client.0.smithi098.stdout:1/648: dwrite dc/de/d22/d31/d5d/d6a/d6f/d4d/f8a [0,4194304] 0 2024-09-19T07:24:58.472 INFO:tasks.workunit.client.0.smithi098.stdout:0/661: dwrite d5/fc5 [0,4194304] 0 2024-09-19T07:24:58.473 INFO:tasks.workunit.client.0.smithi098.stdout:3/549: dwrite de/df/d31/f5c [0,4194304] 0 2024-09-19T07:24:58.473 INFO:tasks.workunit.client.0.smithi098.stdout:3/550: fsync de/df/d31/d61/f4c 0 2024-09-19T07:24:58.473 INFO:tasks.workunit.client.0.smithi098.stdout:9/574: dwrite d3/dc/df/d15/fbd [0,4194304] 0 2024-09-19T07:24:58.473 INFO:tasks.workunit.client.0.smithi098.stdout:6/520: dwrite d2/db0/f88 [0,4194304] 0 2024-09-19T07:24:58.474 INFO:tasks.workunit.client.0.smithi098.stdout:2/573: mknod d1/d5/d72/db5/dad/cc8 0 2024-09-19T07:24:58.474 INFO:tasks.workunit.client.0.smithi098.stdout:2/574: chown d1/d5/d72/db5/l7b 14 1 2024-09-19T07:24:58.477 INFO:tasks.workunit.client.0.smithi098.stdout:9/575: mkdir d3/d16/d7b/dc1 0 2024-09-19T07:24:58.478 INFO:tasks.workunit.client.0.smithi098.stdout:8/548: dread d0/d16/d7d/fa0 [0,4194304] 0 2024-09-19T07:24:58.480 INFO:tasks.workunit.client.0.smithi098.stdout:2/575: creat d1/d5/d72/db5/dad/fc9 x:0 0 0 2024-09-19T07:24:58.481 INFO:tasks.workunit.client.0.smithi098.stdout:6/521: rmdir d2/d11 39 2024-09-19T07:24:58.481 INFO:tasks.workunit.client.0.smithi098.stdout:6/522: truncate d2/db0/d4e/d6e/d9d/fa1 761893 0 2024-09-19T07:24:58.482 INFO:tasks.workunit.client.0.smithi098.stdout:4/538: dwrite da/d31/f71 [0,4194304] 0 2024-09-19T07:24:58.482 INFO:tasks.workunit.client.0.smithi098.stdout:3/551: dread de/f19 [0,4194304] 0 2024-09-19T07:24:58.483 INFO:tasks.workunit.client.0.smithi098.stdout:2/576: creat d1/d5/fca x:0 0 0 2024-09-19T07:24:58.484 INFO:tasks.workunit.client.0.smithi098.stdout:8/549: write d0/d1a/f49 [3045269,73627] 0 2024-09-19T07:24:58.484 INFO:tasks.workunit.client.0.smithi098.stdout:8/550: dread - d0/d33/d55/d8a/d21/d50/f5a zero size 2024-09-19T07:24:58.484 INFO:tasks.workunit.client.0.smithi098.stdout:8/551: chown d0/d33/d55/d8a/d28/d40/f96 0 1 2024-09-19T07:24:58.485 INFO:tasks.workunit.client.0.smithi098.stdout:1/649: creat dc/de/d22/d31/d5d/d6a/d6f/fda x:0 0 0 2024-09-19T07:24:58.486 INFO:tasks.workunit.client.0.smithi098.stdout:0/662: dread d5/d20/f41 [0,4194304] 0 2024-09-19T07:24:58.486 INFO:tasks.workunit.client.0.smithi098.stdout:3/552: getdents de/df 0 2024-09-19T07:24:58.486 INFO:tasks.workunit.client.0.smithi098.stdout:3/553: chown de/df/d1f/d72/f8a 94288573 1 2024-09-19T07:24:58.488 INFO:tasks.workunit.client.0.smithi098.stdout:1/650: rename dc/de/d22/d31/d5d/d6a/d6f/d5f/d97 to dc/de/d50/d6c/ddb 0 2024-09-19T07:24:58.488 INFO:tasks.workunit.client.0.smithi098.stdout:2/577: mkdir d1/dcb 0 2024-09-19T07:24:58.488 INFO:tasks.workunit.client.0.smithi098.stdout:2/578: fdatasync d1/d2c/f44 0 2024-09-19T07:24:58.488 INFO:tasks.workunit.client.0.smithi098.stdout:2/579: readlink d1/d9/d3e/l1e 0 2024-09-19T07:24:58.492 INFO:tasks.workunit.client.0.smithi098.stdout:0/663: dread d5/d20/d1f/d47/db2/dbf/f9a [0,4194304] 0 2024-09-19T07:24:58.493 INFO:tasks.workunit.client.0.smithi098.stdout:2/580: creat d1/d9/d26/d35/d48/d7f/fcc x:0 0 0 2024-09-19T07:24:58.493 INFO:tasks.workunit.client.0.smithi098.stdout:2/581: read - d1/d5/d72/db5/dad/fc9 zero size 2024-09-19T07:24:58.494 INFO:tasks.workunit.client.0.smithi098.stdout:4/539: dread da/f28 [8388608,4194304] 0 2024-09-19T07:24:58.495 INFO:tasks.workunit.client.0.smithi098.stdout:4/540: chown da/d31/d46/d5f/d8a/fa5 981065 1 2024-09-19T07:24:58.497 INFO:tasks.workunit.client.0.smithi098.stdout:4/541: mknod da/d31/d46/d56/d5b/d61/cc0 0 2024-09-19T07:24:58.500 INFO:tasks.workunit.client.0.smithi098.stdout:7/675: dwrite d5/d10/d11/f58 [4194304,4194304] 0 2024-09-19T07:24:58.503 INFO:tasks.workunit.client.0.smithi098.stdout:0/664: dread d5/f48 [0,4194304] 0 2024-09-19T07:24:58.506 INFO:tasks.workunit.client.0.smithi098.stdout:0/665: truncate d5/d20/d14/d49/d62/da7/fac 112915 0 2024-09-19T07:24:58.506 INFO:tasks.workunit.client.0.smithi098.stdout:0/666: write d5/fe [5045012,27936] 0 2024-09-19T07:24:58.507 INFO:tasks.workunit.client.0.smithi098.stdout:9/576: dwrite d3/d16/d38/f26 [0,4194304] 0 2024-09-19T07:24:58.508 INFO:tasks.workunit.client.0.smithi098.stdout:0/667: link d5/d20/d1f/f71 d5/d20/d1f/d52/d64/d77/fd0 0 2024-09-19T07:24:58.513 INFO:tasks.workunit.client.0.smithi098.stdout:3/554: dwrite de/d4e/d6d/fa1 [0,4194304] 0 2024-09-19T07:24:58.517 INFO:tasks.workunit.client.0.smithi098.stdout:9/577: dread d3/d16/d38/d48/f96 [0,4194304] 0 2024-09-19T07:24:58.518 INFO:tasks.workunit.client.0.smithi098.stdout:9/578: symlink d3/d16/d43/lc2 0 2024-09-19T07:24:58.518 INFO:tasks.workunit.client.0.smithi098.stdout:9/579: truncate d3/d6/fad 907001 0 2024-09-19T07:24:58.518 INFO:tasks.workunit.client.0.smithi098.stdout:9/580: dread - d3/d6/d8/fae zero size 2024-09-19T07:24:58.521 INFO:tasks.workunit.client.0.smithi098.stdout:6/523: dwrite d2/d5/d1f/d26/d42/d48/f70 [0,4194304] 0 2024-09-19T07:24:58.521 INFO:tasks.workunit.client.0.smithi098.stdout:9/581: dread d3/dc/df/f87 [0,4194304] 0 2024-09-19T07:24:58.522 INFO:tasks.workunit.client.0.smithi098.stdout:1/651: dwrite dc/d2a/f51 [0,4194304] 0 2024-09-19T07:24:58.524 INFO:tasks.workunit.client.0.smithi098.stdout:9/582: symlink d3/dc/df/d15/d1b/d90/lc3 0 2024-09-19T07:24:58.524 INFO:tasks.workunit.client.0.smithi098.stdout:9/583: chown d3/dc/df/d15/d1b 9366 1 2024-09-19T07:24:58.524 INFO:tasks.workunit.client.0.smithi098.stdout:9/584: truncate d3/dc/df/d15/d1a/d2b/d49/d65/f7c 4710761 0 2024-09-19T07:24:58.524 INFO:tasks.workunit.client.0.smithi098.stdout:9/585: readlink d3/d16/l59 0 2024-09-19T07:24:58.524 INFO:tasks.workunit.client.0.smithi098.stdout:9/586: dread - d3/d16/d38/d48/f9d zero size 2024-09-19T07:24:58.525 INFO:tasks.workunit.client.0.smithi098.stdout:2/582: dwrite d1/d5/d34/d80/d93/f66 [0,4194304] 0 2024-09-19T07:24:58.525 INFO:tasks.workunit.client.0.smithi098.stdout:5/464: dwrite dc/de/d13/f21 [0,4194304] 0 2024-09-19T07:24:58.525 INFO:tasks.workunit.client.0.smithi098.stdout:6/524: getdents d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98 0 2024-09-19T07:24:58.525 INFO:tasks.workunit.client.0.smithi098.stdout:6/525: fdatasync d2/f58 0 2024-09-19T07:24:58.526 INFO:tasks.workunit.client.0.smithi098.stdout:9/587: symlink d3/d16/d7b/d8a/lc4 0 2024-09-19T07:24:58.527 INFO:tasks.workunit.client.0.smithi098.stdout:6/526: mkdir d2/d1b/d8f/dcb 0 2024-09-19T07:24:58.527 INFO:tasks.workunit.client.0.smithi098.stdout:6/527: fsync d2/d5/f16 0 2024-09-19T07:24:58.527 INFO:tasks.workunit.client.0.smithi098.stdout:6/528: fdatasync d2/d5/d1f/d26/f67 0 2024-09-19T07:24:58.528 INFO:tasks.workunit.client.0.smithi098.stdout:9/588: unlink d3/dc/df/d15/d1a/d2b/d49/d74/cb4 0 2024-09-19T07:24:58.529 INFO:tasks.workunit.client.0.smithi098.stdout:1/652: getdents dc/de/d50/d6c 0 2024-09-19T07:24:58.529 INFO:tasks.workunit.client.0.smithi098.stdout:1/653: truncate dc/de/d22/d31/d35/d58/f7d 4955436 0 2024-09-19T07:24:58.530 INFO:tasks.workunit.client.0.smithi098.stdout:9/589: mkdir d3/dc/df/d15/db3/dc5 0 2024-09-19T07:24:58.531 INFO:tasks.workunit.client.0.smithi098.stdout:6/529: creat d2/db0/d8d/fcc x:0 0 0 2024-09-19T07:24:58.532 INFO:tasks.workunit.client.0.smithi098.stdout:1/654: creat dc/d17/d1b/fdc x:0 0 0 2024-09-19T07:24:58.532 INFO:tasks.workunit.client.0.smithi098.stdout:6/530: symlink d2/d5/d1f/lcd 0 2024-09-19T07:24:58.534 INFO:tasks.workunit.client.0.smithi098.stdout:6/531: creat d2/d5/d1f/d26/d42/d48/fce x:0 0 0 2024-09-19T07:24:58.534 INFO:tasks.workunit.client.0.smithi098.stdout:9/590: creat d3/d16/d38/fc6 x:0 0 0 2024-09-19T07:24:58.536 INFO:tasks.workunit.client.0.smithi098.stdout:1/655: dread dc/d17/d1b/d1d/f3f [0,4194304] 0 2024-09-19T07:24:58.537 INFO:tasks.workunit.client.0.smithi098.stdout:2/583: read d1/f4c [982896,1614] 0 2024-09-19T07:24:58.537 INFO:tasks.workunit.client.0.smithi098.stdout:3/555: dwrite de/df/d16/f4a [4194304,4194304] 0 2024-09-19T07:24:58.537 INFO:tasks.workunit.client.0.smithi098.stdout:3/556: dread - de/df/d31/d61/d79/f91 zero size 2024-09-19T07:24:58.537 INFO:tasks.workunit.client.0.smithi098.stdout:9/591: mkdir d3/d30/d73/dc7 0 2024-09-19T07:24:58.545 INFO:tasks.workunit.client.0.smithi098.stdout:9/592: dread d3/d16/d7b/d8a/fa8 [0,4194304] 0 2024-09-19T07:24:58.546 INFO:tasks.workunit.client.0.smithi098.stdout:9/593: fsync d3/dc/f19 0 2024-09-19T07:24:58.550 INFO:tasks.workunit.client.0.smithi098.stdout:9/594: creat d3/d6/d46/d83/da9/fc8 x:0 0 0 2024-09-19T07:24:58.552 INFO:tasks.workunit.client.0.smithi098.stdout:9/595: mkdir d3/dc/df/d15/d1a/dc9 0 2024-09-19T07:24:58.553 INFO:tasks.workunit.client.0.smithi098.stdout:9/596: symlink d3/dc/df/d15/d1a/db7/lca 0 2024-09-19T07:24:58.554 INFO:tasks.workunit.client.0.smithi098.stdout:4/542: rename da/c25 to da/d31/d46/d56/d5b/d63/cc1 0 2024-09-19T07:24:58.554 INFO:tasks.workunit.client.0.smithi098.stdout:4/543: read - da/d31/d46/d80/fad zero size 2024-09-19T07:24:58.554 INFO:tasks.workunit.client.0.smithi098.stdout:4/544: readlink da/d31/l4c 0 2024-09-19T07:24:58.556 INFO:tasks.workunit.client.0.smithi098.stdout:4/545: unlink da/d59/d5d/fbc 0 2024-09-19T07:24:58.556 INFO:tasks.workunit.client.0.smithi098.stdout:1/656: dwrite dc/d17/f76 [0,4194304] 0 2024-09-19T07:24:58.557 INFO:tasks.workunit.client.0.smithi098.stdout:7/676: rename d5/d3e/d61/l6f to d5/d10/dc2/d5c/dc3/le0 0 2024-09-19T07:24:58.557 INFO:tasks.workunit.client.0.smithi098.stdout:7/677: read - d5/d10/f3f zero size 2024-09-19T07:24:58.557 INFO:tasks.workunit.client.0.smithi098.stdout:6/532: dwrite d2/d5/d1f/d26/d42/d48/fab [0,4194304] 0 2024-09-19T07:24:58.557 INFO:tasks.workunit.client.0.smithi098.stdout:6/533: write d2/d5/d1f/d26/f67 [188856,75948] 0 2024-09-19T07:24:58.557 INFO:tasks.workunit.client.0.smithi098.stdout:4/546: mkdir da/d31/d46/d5f/d8a/db6/dc2 0 2024-09-19T07:24:58.559 INFO:tasks.workunit.client.0.smithi098.stdout:6/534: symlink d2/db0/d8d/lcf 0 2024-09-19T07:24:58.562 INFO:tasks.workunit.client.0.smithi098.stdout:6/535: mkdir d2/d11/dd0 0 2024-09-19T07:24:58.562 INFO:tasks.workunit.client.0.smithi098.stdout:6/536: readlink d2/d5/l45 0 2024-09-19T07:24:58.562 INFO:tasks.workunit.client.0.smithi098.stdout:0/668: rename d5/l6 to d5/d20/d1f/d47/db2/ld1 0 2024-09-19T07:24:58.565 INFO:tasks.workunit.client.0.smithi098.stdout:5/465: rename dc/de/f63 to dc/de/d13/d46/d2e/d37/d81/d6a/f93 0 2024-09-19T07:24:58.565 INFO:tasks.workunit.client.0.smithi098.stdout:1/657: mkdir dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/ddd 0 2024-09-19T07:24:58.567 INFO:tasks.workunit.client.0.smithi098.stdout:1/658: creat dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/fde x:0 0 0 2024-09-19T07:24:58.567 INFO:tasks.workunit.client.0.smithi098.stdout:1/659: readlink dc/d2a/l57 0 2024-09-19T07:24:58.567 INFO:tasks.workunit.client.0.smithi098.stdout:5/466: creat dc/de/d13/d46/d23/d52/f94 x:0 0 0 2024-09-19T07:24:58.569 INFO:tasks.workunit.client.0.smithi098.stdout:1/660: creat dc/d17/d1b/d1d/d3d/dc4/fdf x:0 0 0 2024-09-19T07:24:58.570 INFO:tasks.workunit.client.0.smithi098.stdout:7/678: dread d5/d3e/d62/da0/f8c [0,4194304] 0 2024-09-19T07:24:58.570 INFO:tasks.workunit.client.0.smithi098.stdout:8/552: sync 2024-09-19T07:24:58.570 INFO:tasks.workunit.client.0.smithi098.stdout:8/553: write d0/d33/d55/d8a/f8d [705342,24204] 0 2024-09-19T07:24:58.572 INFO:tasks.workunit.client.0.smithi098.stdout:8/554: link d0/d2c/l80 d0/d33/d55/d8a/d21/lad 0 2024-09-19T07:24:58.573 INFO:tasks.workunit.client.0.smithi098.stdout:7/679: symlink d5/d3e/d61/le1 0 2024-09-19T07:24:58.573 INFO:tasks.workunit.client.0.smithi098.stdout:9/597: dwrite d3/d16/d38/f2e [0,4194304] 0 2024-09-19T07:24:58.573 INFO:tasks.workunit.client.0.smithi098.stdout:8/555: getdents d0/d33/d55/d8a/d28 0 2024-09-19T07:24:58.574 INFO:tasks.workunit.client.0.smithi098.stdout:8/556: chown d0/d33/d55/d8a/d12/d6c/c72 0 1 2024-09-19T07:24:58.575 INFO:tasks.workunit.client.0.smithi098.stdout:7/680: mknod d5/d10/dc2/d5c/dc3/ce2 0 2024-09-19T07:24:58.579 INFO:tasks.workunit.client.0.smithi098.stdout:7/681: unlink d5/d10/d50/f6c 0 2024-09-19T07:24:58.579 INFO:tasks.workunit.client.0.smithi098.stdout:7/682: truncate d5/d8/dc/d16/fb7 829522 0 2024-09-19T07:24:58.579 INFO:tasks.workunit.client.0.smithi098.stdout:7/683: chown d5/d8/dc/d16/l3b 0 1 2024-09-19T07:24:58.580 INFO:tasks.workunit.client.0.smithi098.stdout:7/684: link d5/d8/f34 d5/d10/d11/d9e/fe3 0 2024-09-19T07:24:58.580 INFO:tasks.workunit.client.0.smithi098.stdout:7/685: stat d5/d10/d11/d9e 0 2024-09-19T07:24:58.581 INFO:tasks.workunit.client.0.smithi098.stdout:7/686: truncate d5/d8/dc/d16/f1e 1271038 0 2024-09-19T07:24:58.583 INFO:tasks.workunit.client.0.smithi098.stdout:7/687: getdents d5/d8/dc 0 2024-09-19T07:24:58.583 INFO:tasks.workunit.client.0.smithi098.stdout:7/688: write d5/d8/dc/d16/f67 [1506842,79537] 0 2024-09-19T07:24:58.592 INFO:tasks.workunit.client.0.smithi098.stdout:6/537: dwrite d2/d5/d1f/d26/f67 [0,4194304] 0 2024-09-19T07:24:58.594 INFO:tasks.workunit.client.0.smithi098.stdout:7/689: dread d5/d8/d52/f60 [0,4194304] 0 2024-09-19T07:24:58.594 INFO:tasks.workunit.client.0.smithi098.stdout:6/538: chown d2/l84 8202 1 2024-09-19T07:24:58.595 INFO:tasks.workunit.client.0.smithi098.stdout:7/690: mknod d5/d3e/d62/da0/ce4 0 2024-09-19T07:24:58.596 INFO:tasks.workunit.client.0.smithi098.stdout:7/691: creat d5/dce/dd6/fe5 x:0 0 0 2024-09-19T07:24:58.596 INFO:tasks.workunit.client.0.smithi098.stdout:8/557: dwrite d0/d33/d55/d8a/d21/d50/f6f [4194304,4194304] 0 2024-09-19T07:24:58.597 INFO:tasks.workunit.client.0.smithi098.stdout:5/467: dwrite dc/de/d13/d46/d2e/d37/d67/f89 [0,4194304] 0 2024-09-19T07:24:58.597 INFO:tasks.workunit.client.0.smithi098.stdout:7/692: dread d5/d8/dc/da7/dd4/fdd [0,4194304] 0 2024-09-19T07:24:58.600 INFO:tasks.workunit.client.0.smithi098.stdout:7/693: creat d5/dce/fe6 x:0 0 0 2024-09-19T07:24:58.600 INFO:tasks.workunit.client.0.smithi098.stdout:7/694: stat d5/d3e/d62/f99 0 2024-09-19T07:24:58.602 INFO:tasks.workunit.client.0.smithi098.stdout:7/695: creat d5/fe7 x:0 0 0 2024-09-19T07:24:58.603 INFO:tasks.workunit.client.0.smithi098.stdout:7/696: creat d5/d8/dc/da7/dd4/fe8 x:0 0 0 2024-09-19T07:24:58.603 INFO:tasks.workunit.client.0.smithi098.stdout:7/697: stat d5/d10/dc2/d5c/dc3 0 2024-09-19T07:24:58.603 INFO:tasks.workunit.client.0.smithi098.stdout:7/698: fdatasync d5/d10/d1d/f51 0 2024-09-19T07:24:58.604 INFO:tasks.workunit.client.0.smithi098.stdout:7/699: symlink d5/d3e/d62/da0/dc5/le9 0 2024-09-19T07:24:58.607 INFO:tasks.workunit.client.0.smithi098.stdout:7/700: creat d5/dce/dd5/fea x:0 0 0 2024-09-19T07:24:58.607 INFO:tasks.workunit.client.0.smithi098.stdout:7/701: write d5/d8/dc/fb2 [3772729,55718] 0 2024-09-19T07:24:58.616 INFO:tasks.workunit.client.0.smithi098.stdout:5/468: dwrite dc/de/d13/d46/d23/f5f [0,4194304] 0 2024-09-19T07:24:58.623 INFO:tasks.workunit.client.0.smithi098.stdout:9/598: dwrite d3/dc/df/d15/d1a/d2b/f33 [0,4194304] 0 2024-09-19T07:24:58.623 INFO:tasks.workunit.client.0.smithi098.stdout:9/599: chown d3/dc/df/d15/d2f/lbe 3264417 1 2024-09-19T07:24:58.623 INFO:tasks.workunit.client.0.smithi098.stdout:6/539: dwrite d2/db0/d4e/f50 [0,4194304] 0 2024-09-19T07:24:58.625 INFO:tasks.workunit.client.0.smithi098.stdout:6/540: creat d2/d5/d1f/d26/fd1 x:0 0 0 2024-09-19T07:24:58.626 INFO:tasks.workunit.client.0.smithi098.stdout:6/541: symlink d2/d5/d1f/d26/d7b/da3/ld2 0 2024-09-19T07:24:58.626 INFO:tasks.workunit.client.0.smithi098.stdout:6/542: fsync d2/d5/d1f/d26/d42/d48/f70 0 2024-09-19T07:24:58.628 INFO:tasks.workunit.client.0.smithi098.stdout:7/702: truncate d5/d10/d1d/f51 3376042 0 2024-09-19T07:24:58.628 INFO:tasks.workunit.client.0.smithi098.stdout:5/469: dread dc/f12 [0,4194304] 0 2024-09-19T07:24:58.628 INFO:tasks.workunit.client.0.smithi098.stdout:6/543: rename d2/db0/d4e/d6e/d9d/fc9 to d2/d5/d1f/fd3 0 2024-09-19T07:24:58.628 INFO:tasks.workunit.client.0.smithi098.stdout:6/544: fsync d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/f99 0 2024-09-19T07:24:58.628 INFO:tasks.workunit.client.0.smithi098.stdout:6/545: readlink d2/d11/l78 0 2024-09-19T07:24:58.629 INFO:tasks.workunit.client.0.smithi098.stdout:7/703: dread d5/d3e/d62/da0/fc4 [0,4194304] 0 2024-09-19T07:24:58.629 INFO:tasks.workunit.client.0.smithi098.stdout:5/470: dread dc/de/d13/d46/d2e/d37/d81/f56 [0,4194304] 0 2024-09-19T07:24:58.630 INFO:tasks.workunit.client.0.smithi098.stdout:7/704: creat d5/d8/d52/db6/dc9/feb x:0 0 0 2024-09-19T07:24:58.631 INFO:tasks.workunit.client.0.smithi098.stdout:5/471: creat dc/de/d13/d46/d2e/d37/d81/d6a/f95 x:0 0 0 2024-09-19T07:24:58.631 INFO:tasks.workunit.client.0.smithi098.stdout:9/600: read d3/d6/d8/f77 [1106204,69646] 0 2024-09-19T07:24:58.631 INFO:tasks.workunit.client.0.smithi098.stdout:9/601: chown d3/dc/df/l4c 5053 1 2024-09-19T07:24:58.631 INFO:tasks.workunit.client.0.smithi098.stdout:7/705: symlink d5/db0/lec 0 2024-09-19T07:24:58.632 INFO:tasks.workunit.client.0.smithi098.stdout:9/602: symlink d3/dc/df/d15/d1a/d2d/d7f/lcb 0 2024-09-19T07:24:58.633 INFO:tasks.workunit.client.0.smithi098.stdout:2/584: sync 2024-09-19T07:24:58.633 INFO:tasks.workunit.client.0.smithi098.stdout:3/557: sync 2024-09-19T07:24:58.634 INFO:tasks.workunit.client.0.smithi098.stdout:3/558: read de/df/d31/f7d [257153,93367] 0 2024-09-19T07:24:58.634 INFO:tasks.workunit.client.0.smithi098.stdout:3/559: fsync de/d4e/f6a 0 2024-09-19T07:24:58.634 INFO:tasks.workunit.client.0.smithi098.stdout:7/706: truncate d5/d8/dc/f42 6987253 0 2024-09-19T07:24:58.634 INFO:tasks.workunit.client.0.smithi098.stdout:7/707: readlink d5/d8/l2f 0 2024-09-19T07:24:58.635 INFO:tasks.workunit.client.0.smithi098.stdout:3/560: creat de/df/d1f/d2b/d93/fa7 x:0 0 0 2024-09-19T07:24:58.635 INFO:tasks.workunit.client.0.smithi098.stdout:5/472: link dc/de/d36/f4b dc/de/f96 0 2024-09-19T07:24:58.635 INFO:tasks.workunit.client.0.smithi098.stdout:5/473: chown dc/de/d13/d46/l44 182215256 1 2024-09-19T07:24:58.636 INFO:tasks.workunit.client.0.smithi098.stdout:5/474: getdents dc/de/d13/d46/d2e/d37/d6d 0 2024-09-19T07:24:58.637 INFO:tasks.workunit.client.0.smithi098.stdout:9/603: chown d3/d6/c10 5372 1 2024-09-19T07:24:58.638 INFO:tasks.workunit.client.0.smithi098.stdout:5/475: dread dc/de/d13/f27 [0,4194304] 0 2024-09-19T07:24:58.639 INFO:tasks.workunit.client.0.smithi098.stdout:5/476: write dc/f79 [674699,31398] 0 2024-09-19T07:24:58.639 INFO:tasks.workunit.client.0.smithi098.stdout:2/585: link d1/d5/d34/f96 d1/d9/d26/d35/d48/d6e/fcd 0 2024-09-19T07:24:58.641 INFO:tasks.workunit.client.0.smithi098.stdout:9/604: mknod d3/d16/d7b/ccc 0 2024-09-19T07:24:58.641 INFO:tasks.workunit.client.0.smithi098.stdout:9/605: chown d3/d16/f57 599296 1 2024-09-19T07:24:58.643 INFO:tasks.workunit.client.0.smithi098.stdout:2/586: mknod d1/d2c/cce 0 2024-09-19T07:24:58.643 INFO:tasks.workunit.client.0.smithi098.stdout:2/587: readlink d1/d5/d34/d76/l87 0 2024-09-19T07:24:58.643 INFO:tasks.workunit.client.0.smithi098.stdout:2/588: chown d1/d5/d34/d80/d93/d61/d62/fc3 37472 1 2024-09-19T07:24:58.644 INFO:tasks.workunit.client.0.smithi098.stdout:3/561: rename de/df/d31/d61/l5f to de/df/d31/d61/la8 0 2024-09-19T07:24:58.644 INFO:tasks.workunit.client.0.smithi098.stdout:9/606: stat d3/dc/df/c6c 0 2024-09-19T07:24:58.645 INFO:tasks.workunit.client.0.smithi098.stdout:9/607: dread - d3/d16/d38/d48/f9d zero size 2024-09-19T07:24:58.645 INFO:tasks.workunit.client.0.smithi098.stdout:6/546: rmdir d2 39 2024-09-19T07:24:58.647 INFO:tasks.workunit.client.0.smithi098.stdout:2/589: symlink d1/d5/d72/lcf 0 2024-09-19T07:24:58.647 INFO:tasks.workunit.client.0.smithi098.stdout:2/590: truncate d1/d9/d26/d35/d58/f22 4750736 0 2024-09-19T07:24:58.648 INFO:tasks.workunit.client.0.smithi098.stdout:3/562: readlink de/df/d31/d61/d3f/d64/d84/l8e 0 2024-09-19T07:24:58.649 INFO:tasks.workunit.client.0.smithi098.stdout:9/608: link d3/d16/d43/d61/lba d3/dc/lcd 0 2024-09-19T07:24:58.650 INFO:tasks.workunit.client.0.smithi098.stdout:2/591: dread d1/d9/d26/d35/d58/fb9 [0,4194304] 0 2024-09-19T07:24:58.651 INFO:tasks.workunit.client.0.smithi098.stdout:9/609: mkdir d3/d16/d43/dce 0 2024-09-19T07:24:58.651 INFO:tasks.workunit.client.0.smithi098.stdout:2/592: getdents d1/d5/d34/d39 0 2024-09-19T07:24:58.652 INFO:tasks.workunit.client.0.smithi098.stdout:3/563: symlink de/df/d1f/la9 0 2024-09-19T07:24:58.653 INFO:tasks.workunit.client.0.smithi098.stdout:9/610: rename d3/d16/d38/d22/l85 to d3/d16/d43/lcf 0 2024-09-19T07:24:58.654 INFO:tasks.workunit.client.0.smithi098.stdout:2/593: write d1/d9/f24 [1303175,82021] 0 2024-09-19T07:24:58.655 INFO:tasks.workunit.client.0.smithi098.stdout:5/477: dwrite dc/de/d13/d46/d2e/d62/f72 [0,4194304] 0 2024-09-19T07:24:58.655 INFO:tasks.workunit.client.0.smithi098.stdout:5/478: readlink dc/de/d13/d46/l44 0 2024-09-19T07:24:58.655 INFO:tasks.workunit.client.0.smithi098.stdout:9/611: link d3/dc/df/c6c d3/d16/d43/d61/da6/cd0 0 2024-09-19T07:24:58.655 INFO:tasks.workunit.client.0.smithi098.stdout:9/612: dread - d3/d6/d8/fae zero size 2024-09-19T07:24:58.657 INFO:tasks.workunit.client.0.smithi098.stdout:5/479: rmdir dc/de/d36/d71/d84 39 2024-09-19T07:24:58.657 INFO:tasks.workunit.client.0.smithi098.stdout:5/480: readlink dc/de/d13/l31 0 2024-09-19T07:24:58.658 INFO:tasks.workunit.client.0.smithi098.stdout:5/481: link dc/f12 dc/de/d13/d46/d23/d5e/f97 0 2024-09-19T07:24:58.658 INFO:tasks.workunit.client.0.smithi098.stdout:5/482: write f1 [1943653,101699] 0 2024-09-19T07:24:58.658 INFO:tasks.workunit.client.0.smithi098.stdout:5/483: mknod dc/de/d13/d46/d23/d52/c98 0 2024-09-19T07:24:58.660 INFO:tasks.workunit.client.0.smithi098.stdout:2/594: dread d1/d9/d3e/fd [0,4194304] 0 2024-09-19T07:24:58.662 INFO:tasks.workunit.client.0.smithi098.stdout:5/484: write dc/de/d13/d46/d2e/d37/f43 [4088679,33751] 0 2024-09-19T07:24:58.668 INFO:tasks.workunit.client.0.smithi098.stdout:6/547: dwrite d2/db0/d8d/fcc [0,4194304] 0 2024-09-19T07:24:58.668 INFO:tasks.workunit.client.0.smithi098.stdout:6/548: write d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98/fc4 [868537,89681] 0 2024-09-19T07:24:58.670 INFO:tasks.workunit.client.0.smithi098.stdout:6/549: dread d2/d5/d1f/d26/d42/da4/fb9 [0,4194304] 0 2024-09-19T07:24:58.674 INFO:tasks.workunit.client.0.smithi098.stdout:2/595: write d1/d9/d26/d35/d48/f56 [1002267,11263] 0 2024-09-19T07:24:58.674 INFO:tasks.workunit.client.0.smithi098.stdout:2/596: stat d1/dbf 0 2024-09-19T07:24:58.674 INFO:tasks.workunit.client.0.smithi098.stdout:2/597: truncate d1/d5/f37 4357114 0 2024-09-19T07:24:58.674 INFO:tasks.workunit.client.0.smithi098.stdout:2/598: chown d1/d5/d72/db5/f8e 15 1 2024-09-19T07:24:58.675 INFO:tasks.workunit.client.0.smithi098.stdout:2/599: unlink d1/d5/d34/d39/l5d 0 2024-09-19T07:24:58.675 INFO:tasks.workunit.client.0.smithi098.stdout:2/600: fsync d1/d9/d3e/d41/fa4 0 2024-09-19T07:24:58.676 INFO:tasks.workunit.client.0.smithi098.stdout:5/485: read dc/de/f2c [811617,17935] 0 2024-09-19T07:24:58.676 INFO:tasks.workunit.client.0.smithi098.stdout:5/486: truncate dc/de/d13/d46/d23/d52/f7b 618246 0 2024-09-19T07:24:58.676 INFO:tasks.workunit.client.0.smithi098.stdout:5/487: chown dc/de/f2a 210 1 2024-09-19T07:24:58.676 INFO:tasks.workunit.client.0.smithi098.stdout:5/488: mkdir dc/de/d13/d46/d2e/d37/d67/d99 0 2024-09-19T07:24:58.676 INFO:tasks.workunit.client.0.smithi098.stdout:5/489: write dc/de/f4d [3262975,105101] 0 2024-09-19T07:24:58.677 INFO:tasks.workunit.client.0.smithi098.stdout:2/601: dread d1/d2c/f44 [0,4194304] 0 2024-09-19T07:24:58.678 INFO:tasks.workunit.client.0.smithi098.stdout:9/613: dwrite d3/d16/d43/d51/f5a [0,4194304] 0 2024-09-19T07:24:58.679 INFO:tasks.workunit.client.0.smithi098.stdout:2/602: creat d1/d9/d26/d35/fd0 x:0 0 0 2024-09-19T07:24:58.679 INFO:tasks.workunit.client.0.smithi098.stdout:2/603: stat d1 0 2024-09-19T07:24:58.679 INFO:tasks.workunit.client.0.smithi098.stdout:2/604: chown d1/d9/d3e/d41/d60/d65/l90 479791 1 2024-09-19T07:24:58.680 INFO:tasks.workunit.client.0.smithi098.stdout:9/614: symlink d3/dc/df/d15/d2f/ld1 0 2024-09-19T07:24:58.680 INFO:tasks.workunit.client.0.smithi098.stdout:9/615: chown d3/dc/df/d15/d1a/dc9 144596036 1 2024-09-19T07:24:58.680 INFO:tasks.workunit.client.0.smithi098.stdout:2/605: creat d1/d5/d34/d5a/db2/fd1 x:0 0 0 2024-09-19T07:24:58.680 INFO:tasks.workunit.client.0.smithi098.stdout:2/606: readlink d1/d9/d1d/l29 0 2024-09-19T07:24:58.680 INFO:tasks.workunit.client.0.smithi098.stdout:2/607: dread - d1/d5/d34/d5a/db2/fd1 zero size 2024-09-19T07:24:58.680 INFO:tasks.workunit.client.0.smithi098.stdout:2/608: truncate d1/d5/d72/db5/d4e/fae 716121 0 2024-09-19T07:24:58.681 INFO:tasks.workunit.client.0.smithi098.stdout:9/616: symlink d3/dc/df/d15/db3/ld2 0 2024-09-19T07:24:58.681 INFO:tasks.workunit.client.0.smithi098.stdout:2/609: link d1/d9/d3e/d41/d60/l6d d1/d5/d34/ld2 0 2024-09-19T07:24:58.682 INFO:tasks.workunit.client.0.smithi098.stdout:9/617: getdents d3/dc/df/d15/d1a/d2b/d49/d65 0 2024-09-19T07:24:58.682 INFO:tasks.workunit.client.0.smithi098.stdout:6/550: write d2/db0/f88 [543258,39480] 0 2024-09-19T07:24:58.683 INFO:tasks.workunit.client.0.smithi098.stdout:2/610: symlink d1/d9/d3e/d41/ld3 0 2024-09-19T07:24:58.683 INFO:tasks.workunit.client.0.smithi098.stdout:2/611: write d1/d9/f33 [2130579,121598] 0 2024-09-19T07:24:58.684 INFO:tasks.workunit.client.0.smithi098.stdout:2/612: write d1/d5/d72/db5/dad/fc0 [779490,10547] 0 2024-09-19T07:24:58.685 INFO:tasks.workunit.client.0.smithi098.stdout:9/618: unlink d3/dc/f6f 0 2024-09-19T07:24:58.686 INFO:tasks.workunit.client.0.smithi098.stdout:6/551: rename d2/d5/c10 to d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/dbf/cd4 0 2024-09-19T07:24:58.686 INFO:tasks.workunit.client.0.smithi098.stdout:6/552: chown d2/db0/d4e/d6e/d9d/fa1 201668161 1 2024-09-19T07:24:58.689 INFO:tasks.workunit.client.0.smithi098.stdout:6/553: dread d2/d1b/d8f/f95 [0,4194304] 0 2024-09-19T07:24:58.694 INFO:tasks.workunit.client.0.smithi098.stdout:2/613: dread d1/d9/f47 [4194304,4194304] 0 2024-09-19T07:24:58.704 INFO:tasks.workunit.client.0.smithi098.stdout:9/619: dread d3/d16/d38/f4f [0,4194304] 0 2024-09-19T07:24:58.706 INFO:tasks.workunit.client.0.smithi098.stdout:5/490: dwrite dc/de/f3f [0,4194304] 0 2024-09-19T07:24:58.706 INFO:tasks.workunit.client.0.smithi098.stdout:5/491: chown dc/de/d13/d46/d23/d52/c98 124 1 2024-09-19T07:24:58.712 INFO:tasks.workunit.client.0.smithi098.stdout:5/492: creat dc/d6c/f9a x:0 0 0 2024-09-19T07:24:58.713 INFO:tasks.workunit.client.0.smithi098.stdout:5/493: creat dc/de/d13/d46/d23/f9b x:0 0 0 2024-09-19T07:24:58.714 INFO:tasks.workunit.client.0.smithi098.stdout:9/620: rename d3/d16/d7b to d3/d16/d43/d51/dd3 0 2024-09-19T07:24:58.714 INFO:tasks.workunit.client.0.smithi098.stdout:5/494: mknod dc/de/d13/d46/d2e/c9c 0 2024-09-19T07:24:58.715 INFO:tasks.workunit.client.0.smithi098.stdout:9/621: mknod d3/d16/d38/d48/cd4 0 2024-09-19T07:24:58.715 INFO:tasks.workunit.client.0.smithi098.stdout:9/622: chown d3/d16/d43/d51/dd3 60016565 1 2024-09-19T07:24:58.716 INFO:tasks.workunit.client.0.smithi098.stdout:5/495: creat dc/de/d13/d46/d23/f9d x:0 0 0 2024-09-19T07:24:58.717 INFO:tasks.workunit.client.0.smithi098.stdout:9/623: getdents d3/d6/d46/d83/da9 0 2024-09-19T07:24:58.717 INFO:tasks.workunit.client.0.smithi098.stdout:9/624: write d3/d30/f88 [1129095,29225] 0 2024-09-19T07:24:58.717 INFO:tasks.workunit.client.0.smithi098.stdout:5/496: creat dc/de/d13/d46/d2e/d37/f9e x:0 0 0 2024-09-19T07:24:58.718 INFO:tasks.workunit.client.0.smithi098.stdout:9/625: creat d3/dc/df/d15/d1a/d2b/fd5 x:0 0 0 2024-09-19T07:24:58.719 INFO:tasks.workunit.client.0.smithi098.stdout:6/554: dwrite d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98/f9e [0,4194304] 0 2024-09-19T07:24:58.720 INFO:tasks.workunit.client.0.smithi098.stdout:2/614: dwrite d1/d9/d1d/f43 [0,4194304] 0 2024-09-19T07:24:58.720 INFO:tasks.workunit.client.0.smithi098.stdout:2/615: write d1/d9/d26/d35/d58/f4d [1696315,59731] 0 2024-09-19T07:24:58.721 INFO:tasks.workunit.client.0.smithi098.stdout:6/555: truncate d2/d1b/f2f 3348675 0 2024-09-19T07:24:58.723 INFO:tasks.workunit.client.0.smithi098.stdout:9/626: rename d3/dc/df/d15/d1b/f37 to d3/dc/df/d15/d1a/d2b/d49/d50/fd6 0 2024-09-19T07:24:58.725 INFO:tasks.workunit.client.0.smithi098.stdout:6/556: rename d2/d5/d1f/d26/d42/da4/fb9 to d2/d5/d1f/d26/d7b/fd5 0 2024-09-19T07:24:58.727 INFO:tasks.workunit.client.0.smithi098.stdout:6/557: symlink d2/d5/d1f/d26/d42/d48/d53/da2/ld6 0 2024-09-19T07:24:58.727 INFO:tasks.workunit.client.0.smithi098.stdout:6/558: chown d2/db0/d8d/cb2 21355 1 2024-09-19T07:24:58.727 INFO:tasks.workunit.client.0.smithi098.stdout:6/559: chown d2/d5/d1f/d26/d42/d48/d53/c61 10 1 2024-09-19T07:24:58.727 INFO:tasks.workunit.client.0.smithi098.stdout:6/560: fdatasync d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/fae 0 2024-09-19T07:24:58.728 INFO:tasks.workunit.client.0.smithi098.stdout:6/561: rename d2/d5/d1f/l93 to d2/d11/ld7 0 2024-09-19T07:24:58.730 INFO:tasks.workunit.client.0.smithi098.stdout:2/616: truncate d1/d9/d3e/d41/d60/fbb 1614237 0 2024-09-19T07:24:58.731 INFO:tasks.workunit.client.0.smithi098.stdout:2/617: symlink d1/d5/d34/d5a/db2/ld4 0 2024-09-19T07:24:58.734 INFO:tasks.workunit.client.0.smithi098.stdout:9/627: symlink d3/dc/df/d15/d1a/d2b/ld7 0 2024-09-19T07:24:58.734 INFO:tasks.workunit.client.0.smithi098.stdout:9/628: readlink d3/dc/df/d15/d1a/db7/lca 0 2024-09-19T07:24:58.734 INFO:tasks.workunit.client.0.smithi098.stdout:9/629: chown d3/dc/df/d15 48973 1 2024-09-19T07:24:58.737 INFO:tasks.workunit.client.0.smithi098.stdout:4/547: sync 2024-09-19T07:24:58.738 INFO:tasks.workunit.client.0.smithi098.stdout:6/562: dread d2/d5/d1f/d26/f33 [0,4194304] 0 2024-09-19T07:24:58.739 INFO:tasks.workunit.client.0.smithi098.stdout:6/563: rmdir d2/db0/d8d 39 2024-09-19T07:24:58.739 INFO:tasks.workunit.client.0.smithi098.stdout:6/564: getdents d2/d5/d1f/d26/d42/d48/dc3 0 2024-09-19T07:24:58.741 INFO:tasks.workunit.client.0.smithi098.stdout:0/669: sync 2024-09-19T07:24:58.742 INFO:tasks.workunit.client.0.smithi098.stdout:1/661: sync 2024-09-19T07:24:58.742 INFO:tasks.workunit.client.0.smithi098.stdout:3/564: sync 2024-09-19T07:24:58.742 INFO:tasks.workunit.client.0.smithi098.stdout:8/558: sync 2024-09-19T07:24:58.742 INFO:tasks.workunit.client.0.smithi098.stdout:1/662: dread - dc/de/d22/d31/d5d/d6a/d8b/fce zero size 2024-09-19T07:24:58.742 INFO:tasks.workunit.client.0.smithi098.stdout:3/565: dread - de/df/d1f/f99 zero size 2024-09-19T07:24:58.742 INFO:tasks.workunit.client.0.smithi098.stdout:7/708: sync 2024-09-19T07:24:58.742 INFO:tasks.workunit.client.0.smithi098.stdout:8/559: write d0/d33/d55/d8a/d12/fab [4496889,90844] 0 2024-09-19T07:24:58.743 INFO:tasks.workunit.client.0.smithi098.stdout:0/670: mkdir d5/d20/d1f/d52/d64/dba/dd2 0 2024-09-19T07:24:58.743 INFO:tasks.workunit.client.0.smithi098.stdout:1/663: mkdir dc/de/d22/d31/d5d/d6a/de0 0 2024-09-19T07:24:58.743 INFO:tasks.workunit.client.0.smithi098.stdout:3/566: truncate de/df/f53 12286730 0 2024-09-19T07:24:58.746 INFO:tasks.workunit.client.0.smithi098.stdout:1/664: unlink dc/l1a 0 2024-09-19T07:24:58.746 INFO:tasks.workunit.client.0.smithi098.stdout:1/665: fdatasync dc/de/d22/d31/d5d/d6a/d8b/fce 0 2024-09-19T07:24:58.746 INFO:tasks.workunit.client.0.smithi098.stdout:1/666: chown dc/de/d22/d31/d5d/d6a/d6f/fda 20375324 1 2024-09-19T07:24:58.746 INFO:tasks.workunit.client.0.smithi098.stdout:1/667: write dc/f49 [10976,15170] 0 2024-09-19T07:24:58.752 INFO:tasks.workunit.client.0.smithi098.stdout:4/548: dread da/f28 [0,4194304] 0 2024-09-19T07:24:58.752 INFO:tasks.workunit.client.0.smithi098.stdout:3/567: write de/df/d1f/d2b/f5e [1011322,20462] 0 2024-09-19T07:24:58.752 INFO:tasks.workunit.client.0.smithi098.stdout:3/568: write de/df/f2c [615313,38760] 0 2024-09-19T07:24:58.752 INFO:tasks.workunit.client.0.smithi098.stdout:6/565: dread d2/f58 [0,4194304] 0 2024-09-19T07:24:58.753 INFO:tasks.workunit.client.0.smithi098.stdout:8/560: write d0/d16/f9c [2017638,28637] 0 2024-09-19T07:24:58.754 INFO:tasks.workunit.client.0.smithi098.stdout:4/549: symlink da/d31/d46/d80/lc3 0 2024-09-19T07:24:58.755 INFO:tasks.workunit.client.0.smithi098.stdout:8/561: mknod d0/d2c/d81/cae 0 2024-09-19T07:24:58.760 INFO:tasks.workunit.client.0.smithi098.stdout:2/618: dwrite d1/d9/f24 [0,4194304] 0 2024-09-19T07:24:58.772 INFO:tasks.workunit.client.0.smithi098.stdout:7/709: dwrite d5/d10/d1d/f9a [0,4194304] 0 2024-09-19T07:24:58.779 INFO:tasks.workunit.client.0.smithi098.stdout:6/566: dwrite d2/d5/d1f/d26/d42/d48/f63 [0,4194304] 0 2024-09-19T07:24:58.781 INFO:tasks.workunit.client.0.smithi098.stdout:6/567: unlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98/f9e 0 2024-09-19T07:24:58.781 INFO:tasks.workunit.client.0.smithi098.stdout:6/568: stat d2/d5/d1f/d26/d42/d48/d53/f5d 0 2024-09-19T07:24:58.781 INFO:tasks.workunit.client.0.smithi098.stdout:6/569: truncate d2/db0/d4e/f7e 629480 0 2024-09-19T07:24:58.781 INFO:tasks.workunit.client.0.smithi098.stdout:6/570: truncate d2/d5/d1f/d26/f55 1449266 0 2024-09-19T07:24:58.783 INFO:tasks.workunit.client.0.smithi098.stdout:2/619: dwrite d1/d5/d34/d80/d93/f66 [0,4194304] 0 2024-09-19T07:24:58.783 INFO:tasks.workunit.client.0.smithi098.stdout:2/620: dread - d1/d9/d26/d35/fd0 zero size 2024-09-19T07:24:58.783 INFO:tasks.workunit.client.0.smithi098.stdout:2/621: getdents d1/dcb 0 2024-09-19T07:24:58.787 INFO:tasks.workunit.client.0.smithi098.stdout:2/622: write d1/d9/d3e/d41/f4b [867543,3034] 0 2024-09-19T07:24:58.788 INFO:tasks.workunit.client.0.smithi098.stdout:2/623: write d1/d9/d26/d35/d58/f18 [5021742,121599] 0 2024-09-19T07:24:58.788 INFO:tasks.workunit.client.0.smithi098.stdout:1/668: rename dc/de/d38 to dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1 0 2024-09-19T07:24:58.790 INFO:tasks.workunit.client.0.smithi098.stdout:2/624: creat d1/d9/d3e/d41/fd5 x:0 0 0 2024-09-19T07:24:58.790 INFO:tasks.workunit.client.0.smithi098.stdout:2/625: chown d1/d9/d26/l50 1 1 2024-09-19T07:24:58.791 INFO:tasks.workunit.client.0.smithi098.stdout:4/550: rename da/d59/f6b to da/d31/d46/d5f/d8a/fc4 0 2024-09-19T07:24:58.791 INFO:tasks.workunit.client.0.smithi098.stdout:1/669: creat dc/d17/d1b/d1d/d30/fe2 x:0 0 0 2024-09-19T07:24:58.791 INFO:tasks.workunit.client.0.smithi098.stdout:1/670: chown dc/de/d22/d31/c3a 303270 1 2024-09-19T07:24:58.791 INFO:tasks.workunit.client.0.smithi098.stdout:2/626: getdents d1/d2c 0 2024-09-19T07:24:58.792 INFO:tasks.workunit.client.0.smithi098.stdout:4/551: mkdir da/d31/dc5 0 2024-09-19T07:24:58.793 INFO:tasks.workunit.client.0.smithi098.stdout:8/562: rename d0/d33/d55/d8a/d28/f86 to d0/d33/d55/d8a/d21/d50/d9e/da4/faf 0 2024-09-19T07:24:58.794 INFO:tasks.workunit.client.0.smithi098.stdout:4/552: truncate da/d31/d46/d5f/f8d 299827 0 2024-09-19T07:24:58.794 INFO:tasks.workunit.client.0.smithi098.stdout:8/563: truncate d0/d16/f94 369301 0 2024-09-19T07:24:58.795 INFO:tasks.workunit.client.0.smithi098.stdout:1/671: symlink dc/da5/le3 0 2024-09-19T07:24:58.796 INFO:tasks.workunit.client.0.smithi098.stdout:4/553: truncate da/d31/f3c 1488227 0 2024-09-19T07:24:58.796 INFO:tasks.workunit.client.0.smithi098.stdout:4/554: dread - da/d59/f6a zero size 2024-09-19T07:24:58.797 INFO:tasks.workunit.client.0.smithi098.stdout:4/555: stat da/d31/d46/d56/d5b/c93 0 2024-09-19T07:24:58.797 INFO:tasks.workunit.client.0.smithi098.stdout:4/556: chown da/d59 59 1 2024-09-19T07:24:58.799 INFO:tasks.workunit.client.0.smithi098.stdout:4/557: unlink da/l52 0 2024-09-19T07:24:58.799 INFO:tasks.workunit.client.0.smithi098.stdout:4/558: read da/f1e [2638913,72594] 0 2024-09-19T07:24:58.801 INFO:tasks.workunit.client.0.smithi098.stdout:6/571: dwrite d2/d5/fb8 [0,4194304] 0 2024-09-19T07:24:58.806 INFO:tasks.workunit.client.0.smithi098.stdout:6/572: mknod d2/db0/d4e/d6e/cd8 0 2024-09-19T07:24:58.807 INFO:tasks.workunit.client.0.smithi098.stdout:8/564: write d0/d16/f17 [229000,86185] 0 2024-09-19T07:24:58.807 INFO:tasks.workunit.client.0.smithi098.stdout:8/565: write d0/d33/d55/d8a/f27 [6077063,79987] 0 2024-09-19T07:24:58.807 INFO:tasks.workunit.client.0.smithi098.stdout:8/566: chown d0/d1a/c7b 7541 1 2024-09-19T07:24:58.808 INFO:tasks.workunit.client.0.smithi098.stdout:8/567: chown d0/d16/d61 0 1 2024-09-19T07:24:58.809 INFO:tasks.workunit.client.0.smithi098.stdout:8/568: mknod d0/d16/d7d/cb0 0 2024-09-19T07:24:58.810 INFO:tasks.workunit.client.0.smithi098.stdout:8/569: creat d0/d33/d44/fb1 x:0 0 0 2024-09-19T07:24:58.814 INFO:tasks.workunit.client.0.smithi098.stdout:2/627: dwrite d1/f4c [0,4194304] 0 2024-09-19T07:24:58.823 INFO:tasks.workunit.client.0.smithi098.stdout:1/672: dwrite dc/de/d50/f66 [0,4194304] 0 2024-09-19T07:24:58.823 INFO:tasks.workunit.client.0.smithi098.stdout:1/673: chown dc/d17/d1b/d1d/d30/f59 3 1 2024-09-19T07:24:58.823 INFO:tasks.workunit.client.0.smithi098.stdout:7/710: rename d5/d8/dc/faf to d5/d3e/d62/da0/dc5/fed 0 2024-09-19T07:24:58.826 INFO:tasks.workunit.client.0.smithi098.stdout:1/674: getdents dc/de/d22/d31 0 2024-09-19T07:24:58.826 INFO:tasks.workunit.client.0.smithi098.stdout:8/570: rename d0/d33/d55/d8a/d28/f35 to d0/d16/d7d/fb2 0 2024-09-19T07:24:58.828 INFO:tasks.workunit.client.0.smithi098.stdout:7/711: mkdir d5/d10/d11/d9e/dee 0 2024-09-19T07:24:58.828 INFO:tasks.workunit.client.0.smithi098.stdout:7/712: write d5/d10/dc2/d5c/dc3/fcc [1415974,54290] 0 2024-09-19T07:24:58.830 INFO:tasks.workunit.client.0.smithi098.stdout:2/628: rename d1/d5/d34/d80/d93/d61/f99 to d1/d5/d34/d39/fd6 0 2024-09-19T07:24:58.830 INFO:tasks.workunit.client.0.smithi098.stdout:8/571: creat d0/d33/d55/d8a/d21/d50/d9e/da4/fb3 x:0 0 0 2024-09-19T07:24:58.831 INFO:tasks.workunit.client.0.smithi098.stdout:4/559: dwrite da/d31/d46/d5f/fb8 [0,4194304] 0 2024-09-19T07:24:58.831 INFO:tasks.workunit.client.0.smithi098.stdout:6/573: dwrite d2/db0/d8d/fcc [0,4194304] 0 2024-09-19T07:24:58.833 INFO:tasks.workunit.client.0.smithi098.stdout:7/713: link d5/dce/fe6 d5/d10/dc2/dbd/fef 0 2024-09-19T07:24:58.833 INFO:tasks.workunit.client.0.smithi098.stdout:7/714: readlink d5/d10/d50/lbb 0 2024-09-19T07:24:58.834 INFO:tasks.workunit.client.0.smithi098.stdout:2/629: mkdir d1/d9/dd7 0 2024-09-19T07:24:58.834 INFO:tasks.workunit.client.0.smithi098.stdout:2/630: fsync d1/d9/d3e/d41/fa4 0 2024-09-19T07:24:58.835 INFO:tasks.workunit.client.0.smithi098.stdout:4/560: rmdir da/d59/d5d/d82 39 2024-09-19T07:24:58.835 INFO:tasks.workunit.client.0.smithi098.stdout:7/715: read d5/d8/d8e/d59/f85 [1753936,91844] 0 2024-09-19T07:24:58.835 INFO:tasks.workunit.client.0.smithi098.stdout:8/572: creat d0/d16/d65/d9a/fb4 x:0 0 0 2024-09-19T07:24:58.839 INFO:tasks.workunit.client.0.smithi098.stdout:2/631: link d1/d9/d1d/f43 d1/d5/d34/d80/d93/fd8 0 2024-09-19T07:24:58.839 INFO:tasks.workunit.client.0.smithi098.stdout:4/561: chown da/d31/d46/d56/d5b/c85 57389 1 2024-09-19T07:24:58.840 INFO:tasks.workunit.client.0.smithi098.stdout:8/573: creat d0/fb5 x:0 0 0 2024-09-19T07:24:58.841 INFO:tasks.workunit.client.0.smithi098.stdout:6/574: unlink d2/c7 0 2024-09-19T07:24:58.842 INFO:tasks.workunit.client.0.smithi098.stdout:8/574: creat d0/d33/d55/d8a/d28/d40/fb6 x:0 0 0 2024-09-19T07:24:58.842 INFO:tasks.workunit.client.0.smithi098.stdout:6/575: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/ld9 0 2024-09-19T07:24:58.842 INFO:tasks.workunit.client.0.smithi098.stdout:8/575: symlink d0/d16/d65/d9a/lb7 0 2024-09-19T07:24:58.844 INFO:tasks.workunit.client.0.smithi098.stdout:1/675: dwrite dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/f44 [0,4194304] 0 2024-09-19T07:24:58.844 INFO:tasks.workunit.client.0.smithi098.stdout:8/576: getdents d0/d33 0 2024-09-19T07:24:58.844 INFO:tasks.workunit.client.0.smithi098.stdout:1/676: write dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/fbf [383619,115544] 0 2024-09-19T07:24:58.844 INFO:tasks.workunit.client.0.smithi098.stdout:1/677: stat dc/de/d22/d31/d35/d4f/fc5 0 2024-09-19T07:24:58.844 INFO:tasks.workunit.client.0.smithi098.stdout:8/577: write d0/d33/d55/d8a/d28/d40/fb6 [733593,23783] 0 2024-09-19T07:24:58.845 INFO:tasks.workunit.client.0.smithi098.stdout:8/578: rename d0/d33/d55/d8a/d12/l1b to d0/d33/d55/d8a/d12/lb8 0 2024-09-19T07:24:58.845 INFO:tasks.workunit.client.0.smithi098.stdout:8/579: chown d0/d33/d55/d8a/d21/d50/d9e 158 1 2024-09-19T07:24:58.846 INFO:tasks.workunit.client.0.smithi098.stdout:8/580: mkdir d0/d33/d55/d8a/d21/d50/d9e/da4/db9 0 2024-09-19T07:24:58.849 INFO:tasks.workunit.client.0.smithi098.stdout:2/632: rename d1/d2c to d1/d9/d3e/d41/d60/da5/dd9 0 2024-09-19T07:24:58.850 INFO:tasks.workunit.client.0.smithi098.stdout:2/633: mknod d1/d9/d3e/d41/d60/d65/da3/cda 0 2024-09-19T07:24:58.850 INFO:tasks.workunit.client.0.smithi098.stdout:1/678: write dc/d17/d1b/d71/d7a/f7b [901200,77604] 0 2024-09-19T07:24:58.850 INFO:tasks.workunit.client.0.smithi098.stdout:1/679: dread - dc/de/d22/d31/d5d/d6a/d6f/d5f/fc2 zero size 2024-09-19T07:24:58.851 INFO:tasks.workunit.client.0.smithi098.stdout:1/680: mknod dc/de/d22/d31/d5d/d6a/d6f/d5f/ce4 0 2024-09-19T07:24:58.851 INFO:tasks.workunit.client.0.smithi098.stdout:1/681: write dc/de/d22/d31/d5d/d6a/d8b/fce [853911,58485] 0 2024-09-19T07:24:58.852 INFO:tasks.workunit.client.0.smithi098.stdout:2/634: creat d1/d9/d26/d5c/fdb x:0 0 0 2024-09-19T07:24:58.852 INFO:tasks.workunit.client.0.smithi098.stdout:2/635: truncate d1/d9/d26/d35/d48/f56 4478426 0 2024-09-19T07:24:58.859 INFO:tasks.workunit.client.0.smithi098.stdout:7/716: dwrite d5/dce/fe6 [0,4194304] 0 2024-09-19T07:24:58.861 INFO:tasks.workunit.client.0.smithi098.stdout:5/497: sync 2024-09-19T07:24:58.862 INFO:tasks.workunit.client.0.smithi098.stdout:8/581: dread d0/d16/d7d/fb2 [0,4194304] 0 2024-09-19T07:24:58.863 INFO:tasks.workunit.client.0.smithi098.stdout:6/576: write d2/f86 [877294,81814] 0 2024-09-19T07:24:58.863 INFO:tasks.workunit.client.0.smithi098.stdout:6/577: fdatasync d2/d11/f5c 0 2024-09-19T07:24:58.863 INFO:tasks.workunit.client.0.smithi098.stdout:6/578: write d2/db0/d8d/fcc [4484253,71011] 0 2024-09-19T07:24:58.863 INFO:tasks.workunit.client.0.smithi098.stdout:6/579: truncate d2/d11/f66 618745 0 2024-09-19T07:24:58.864 INFO:tasks.workunit.client.0.smithi098.stdout:6/580: read - d2/d5/d1f/d26/fa7 zero size 2024-09-19T07:24:58.864 INFO:tasks.workunit.client.0.smithi098.stdout:6/581: write d2/d5/d1f/fc7 [530510,93620] 0 2024-09-19T07:24:58.864 INFO:tasks.workunit.client.0.smithi098.stdout:2/636: dread d1/d5/d34/f3d [0,4194304] 0 2024-09-19T07:24:58.865 INFO:tasks.workunit.client.0.smithi098.stdout:6/582: creat d2/db0/d4e/d6e/d9d/fda x:0 0 0 2024-09-19T07:24:58.866 INFO:tasks.workunit.client.0.smithi098.stdout:6/583: creat d2/db0/d4e/d6e/fdb x:0 0 0 2024-09-19T07:24:58.866 INFO:tasks.workunit.client.0.smithi098.stdout:6/584: chown d2/d5/d1f/d26/d7b 273132937 1 2024-09-19T07:24:58.869 INFO:tasks.workunit.client.0.smithi098.stdout:7/717: dread d5/d8/d52/f60 [0,4194304] 0 2024-09-19T07:24:58.873 INFO:tasks.workunit.client.0.smithi098.stdout:5/498: symlink dc/l9f 0 2024-09-19T07:24:58.873 INFO:tasks.workunit.client.0.smithi098.stdout:5/499: write dc/de/d13/d46/d2e/d37/d81/f58 [680195,21700] 0 2024-09-19T07:24:58.874 INFO:tasks.workunit.client.0.smithi098.stdout:8/582: getdents d0/d2c 0 2024-09-19T07:24:58.875 INFO:tasks.workunit.client.0.smithi098.stdout:7/718: link d5/d8/d52/db6/dc9/fdb d5/dce/dd5/ff0 0 2024-09-19T07:24:58.876 INFO:tasks.workunit.client.0.smithi098.stdout:4/562: rename da/d31/d46/d5f/f7c to da/d31/d46/d56/d5b/d66/fc6 0 2024-09-19T07:24:58.876 INFO:tasks.workunit.client.0.smithi098.stdout:4/563: fsync da/f1f 0 2024-09-19T07:24:58.878 INFO:tasks.workunit.client.0.smithi098.stdout:5/500: creat dc/fa0 x:0 0 0 2024-09-19T07:24:58.878 INFO:tasks.workunit.client.0.smithi098.stdout:0/671: sync 2024-09-19T07:24:58.879 INFO:tasks.workunit.client.0.smithi098.stdout:9/630: sync 2024-09-19T07:24:58.879 INFO:tasks.workunit.client.0.smithi098.stdout:3/569: sync 2024-09-19T07:24:58.879 INFO:tasks.workunit.client.0.smithi098.stdout:1/682: link dc/d17/d1b/fdc dc/de/d22/d31/d5d/d6a/d6f/d4d/dc6/fe5 0 2024-09-19T07:24:58.879 INFO:tasks.workunit.client.0.smithi098.stdout:3/570: readlink de/l2a 0 2024-09-19T07:24:58.879 INFO:tasks.workunit.client.0.smithi098.stdout:1/683: write dc/de/d22/fbb [693643,96988] 0 2024-09-19T07:24:58.879 INFO:tasks.workunit.client.0.smithi098.stdout:9/631: write d3/d6/d46/d83/da9/fc8 [890096,101721] 0 2024-09-19T07:24:58.880 INFO:tasks.workunit.client.0.smithi098.stdout:6/585: read d2/d1b/f3a [3120571,122815] 0 2024-09-19T07:24:58.880 INFO:tasks.workunit.client.0.smithi098.stdout:8/583: mkdir d0/d33/d55/d8a/d12/dba 0 2024-09-19T07:24:58.880 INFO:tasks.workunit.client.0.smithi098.stdout:1/684: dread dc/de/d22/d31/d5d/d6a/d6f/d5f/f78 [0,4194304] 0 2024-09-19T07:24:58.880 INFO:tasks.workunit.client.0.smithi098.stdout:7/719: creat d5/d8/dc/da7/dd4/ff1 x:0 0 0 2024-09-19T07:24:58.881 INFO:tasks.workunit.client.0.smithi098.stdout:5/501: dread dc/de/d13/f19 [0,4194304] 0 2024-09-19T07:24:58.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:58 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:58.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:58 smithi162 ceph-mon[35726]: pgmap v90: 97 pgs: 97 active+clean; 856 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 MiB/s rd, 131 MiB/s wr, 1.21k op/s 2024-09-19T07:24:58.883 INFO:tasks.workunit.client.0.smithi098.stdout:0/672: mkdir d5/d20/d1f/d47/db2/dd3 0 2024-09-19T07:24:58.884 INFO:tasks.workunit.client.0.smithi098.stdout:9/632: mkdir d3/d16/d43/d61/da6/dd8 0 2024-09-19T07:24:58.884 INFO:tasks.workunit.client.0.smithi098.stdout:9/633: chown d3/d6/d8/c86 935941899 1 2024-09-19T07:24:58.884 INFO:tasks.workunit.client.0.smithi098.stdout:9/634: write d3/dc/df/d15/d1a/d2b/d49/d65/f7c [3825474,84853] 0 2024-09-19T07:24:58.885 INFO:tasks.workunit.client.0.smithi098.stdout:3/571: rmdir de/df/d4f 39 2024-09-19T07:24:58.885 INFO:tasks.workunit.client.0.smithi098.stdout:3/572: write de/df/d1f/f99 [920305,48766] 0 2024-09-19T07:24:58.885 INFO:tasks.workunit.client.0.smithi098.stdout:6/586: dread d2/d5/d1f/d26/f33 [0,4194304] 0 2024-09-19T07:24:58.886 INFO:tasks.workunit.client.0.smithi098.stdout:8/584: truncate d0/d16/f9c 1644799 0 2024-09-19T07:24:58.887 INFO:tasks.workunit.client.0.smithi098.stdout:2/637: dwrite d1/d9/f47 [0,4194304] 0 2024-09-19T07:24:58.887 INFO:tasks.workunit.client.0.smithi098.stdout:1/685: symlink dc/d17/d9c/le6 0 2024-09-19T07:24:58.888 INFO:tasks.workunit.client.0.smithi098.stdout:7/720: mkdir d5/d3e/df2 0 2024-09-19T07:24:58.890 INFO:tasks.workunit.client.0.smithi098.stdout:5/502: creat dc/de/d13/fa1 x:0 0 0 2024-09-19T07:24:58.890 INFO:tasks.workunit.client.0.smithi098.stdout:5/503: chown dc/l25 2 1 2024-09-19T07:24:58.890 INFO:tasks.workunit.client.0.smithi098.stdout:5/504: fdatasync f1 0 2024-09-19T07:24:58.893 INFO:tasks.workunit.client.0.smithi098.stdout:0/673: mknod d5/d20/d1f/d52/d64/d77/cd4 0 2024-09-19T07:24:58.893 INFO:tasks.workunit.client.0.smithi098.stdout:9/635: creat d3/dc/df/d15/d1a/d2b/d49/d55/fd9 x:0 0 0 2024-09-19T07:24:58.894 INFO:tasks.workunit.client.0.smithi098.stdout:3/573: creat de/faa x:0 0 0 2024-09-19T07:24:58.896 INFO:tasks.workunit.client.0.smithi098.stdout:8/585: creat d0/d16/fbb x:0 0 0 2024-09-19T07:24:58.898 INFO:tasks.workunit.client.0.smithi098.stdout:9/636: link d3/d6/d8/fae d3/dc/df/d31/fda 0 2024-09-19T07:24:58.899 INFO:tasks.workunit.client.0.smithi098.stdout:1/686: dread dc/de/d50/f66 [0,4194304] 0 2024-09-19T07:24:58.899 INFO:tasks.workunit.client.0.smithi098.stdout:0/674: creat d5/d20/d1f/d52/d9f/fd5 x:0 0 0 2024-09-19T07:24:58.900 INFO:tasks.workunit.client.0.smithi098.stdout:8/586: stat d0/d33/d55/l5c 0 2024-09-19T07:24:58.901 INFO:tasks.workunit.client.0.smithi098.stdout:4/564: dwrite da/d59/d5d/f6c [0,4194304] 0 2024-09-19T07:24:58.901 INFO:tasks.workunit.client.0.smithi098.stdout:9/637: creat d3/d6/d46/d83/fdb x:0 0 0 2024-09-19T07:24:58.902 INFO:tasks.workunit.client.0.smithi098.stdout:9/638: chown d3/dc/df/d15/d1b/d90 7 1 2024-09-19T07:24:58.902 INFO:tasks.workunit.client.0.smithi098.stdout:4/565: dread da/d31/d46/d5f/f8d [0,4194304] 0 2024-09-19T07:24:58.908 INFO:tasks.workunit.client.0.smithi098.stdout:1/687: symlink dc/d17/d1b/d71/d81/le7 0 2024-09-19T07:24:58.909 INFO:tasks.workunit.client.0.smithi098.stdout:1/688: chown dc/de/d22/d31/d5d/fca 7549 1 2024-09-19T07:24:58.909 INFO:tasks.workunit.client.0.smithi098.stdout:1/689: getdents dc/de/d22/d31/d5d 0 2024-09-19T07:24:58.909 INFO:tasks.workunit.client.0.smithi098.stdout:0/675: getdents d5/d20/d1f/d47 0 2024-09-19T07:24:58.909 INFO:tasks.workunit.client.0.smithi098.stdout:8/587: mknod d0/cbc 0 2024-09-19T07:24:58.909 INFO:tasks.workunit.client.0.smithi098.stdout:9/639: rename d3/dc/df/d15/fbd to d3/dc/df/d15/db3/dc5/fdc 0 2024-09-19T07:24:58.913 INFO:tasks.workunit.client.0.smithi098.stdout:2/638: read d1/d9/f28 [100531,21417] 0 2024-09-19T07:24:58.913 INFO:tasks.workunit.client.0.smithi098.stdout:1/690: rmdir dc/d17/d1b/d71/d7a 39 2024-09-19T07:24:58.915 INFO:tasks.workunit.client.0.smithi098.stdout:9/640: dread d3/d16/d38/f4f [0,4194304] 0 2024-09-19T07:24:58.915 INFO:tasks.workunit.client.0.smithi098.stdout:6/587: dwrite d2/d5/d1f/d26/f67 [0,4194304] 0 2024-09-19T07:24:58.916 INFO:tasks.workunit.client.0.smithi098.stdout:0/676: creat d5/d20/d1f/d52/d64/d77/d79/fd6 x:0 0 0 2024-09-19T07:24:58.916 INFO:tasks.workunit.client.0.smithi098.stdout:0/677: truncate d5/d20/d1f/d47/db2/dbf/f89 222891 0 2024-09-19T07:24:58.918 INFO:tasks.workunit.client.0.smithi098.stdout:6/588: rename d2/d5/d1f/d26/d42/d48/d53/c61 to d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/cdc 0 2024-09-19T07:24:58.918 INFO:tasks.workunit.client.0.smithi098.stdout:6/589: readlink d2/l52 0 2024-09-19T07:24:58.918 INFO:tasks.workunit.client.0.smithi098.stdout:6/590: fsync d2/db0/d4e/f65 0 2024-09-19T07:24:58.918 INFO:tasks.workunit.client.0.smithi098.stdout:6/591: fdatasync d2/d5/d1f/d26/d42/d48/fce 0 2024-09-19T07:24:58.918 INFO:tasks.workunit.client.0.smithi098.stdout:8/588: mknod d0/d33/d55/d8a/d21/d3c/cbd 0 2024-09-19T07:24:58.918 INFO:tasks.workunit.client.0.smithi098.stdout:8/589: dread - d0/d33/d55/d8a/d28/d40/f76 zero size 2024-09-19T07:24:58.919 INFO:tasks.workunit.client.0.smithi098.stdout:5/505: dwrite dc/de/d13/d46/d23/f9b [0,4194304] 0 2024-09-19T07:24:58.922 INFO:tasks.workunit.client.0.smithi098.stdout:9/641: dread d3/dc/f19 [0,4194304] 0 2024-09-19T07:24:58.924 INFO:tasks.workunit.client.0.smithi098.stdout:1/691: mknod dc/de/d22/d31/d5d/d6a/d6f/ce8 0 2024-09-19T07:24:58.927 INFO:tasks.workunit.client.0.smithi098.stdout:2/639: write d1/d9/d1d/f4a [1630902,393] 0 2024-09-19T07:24:58.927 INFO:tasks.workunit.client.0.smithi098.stdout:1/692: dread dc/de/d22/d31/d5d/d6a/d8b/fce [0,4194304] 0 2024-09-19T07:24:58.929 INFO:tasks.workunit.client.0.smithi098.stdout:4/566: write da/f3a [5251776,81250] 0 2024-09-19T07:24:58.929 INFO:tasks.workunit.client.0.smithi098.stdout:5/506: dread dc/de/d13/d46/f5a [0,4194304] 0 2024-09-19T07:24:58.929 INFO:tasks.workunit.client.0.smithi098.stdout:4/567: write da/d31/d46/d56/d5b/fb2 [519575,108532] 0 2024-09-19T07:24:58.929 INFO:tasks.workunit.client.0.smithi098.stdout:4/568: write da/d31/d46/d5f/f8d [726254,70135] 0 2024-09-19T07:24:58.930 INFO:tasks.workunit.client.0.smithi098.stdout:2/640: creat d1/d5/d72/db5/fdc x:0 0 0 2024-09-19T07:24:58.930 INFO:tasks.workunit.client.0.smithi098.stdout:2/641: chown d1/d5/c84 13905 1 2024-09-19T07:24:58.930 INFO:tasks.workunit.client.0.smithi098.stdout:5/507: read dc/de/d13/f19 [125308,108468] 0 2024-09-19T07:24:58.931 INFO:tasks.workunit.client.0.smithi098.stdout:4/569: truncate da/d31/f45 1465787 0 2024-09-19T07:24:58.932 INFO:tasks.workunit.client.0.smithi098.stdout:5/508: truncate f1 521462 0 2024-09-19T07:24:58.936 INFO:tasks.workunit.client.0.smithi098.stdout:8/590: dread d0/d33/f6e [0,4194304] 0 2024-09-19T07:24:58.936 INFO:tasks.workunit.client.0.smithi098.stdout:8/591: readlink d0/d33/d55/l5c 0 2024-09-19T07:24:58.936 INFO:tasks.workunit.client.0.smithi098.stdout:8/592: chown d0/d2c/d81/cae 7 1 2024-09-19T07:24:58.936 INFO:tasks.workunit.client.0.smithi098.stdout:1/693: mkdir dc/de/de9 0 2024-09-19T07:24:58.937 INFO:tasks.workunit.client.0.smithi098.stdout:5/509: getdents dc/de/d13/d46/d2e/d37/d81 0 2024-09-19T07:24:58.937 INFO:tasks.workunit.client.0.smithi098.stdout:5/510: chown dc/de/d13/d46/l90 786007 1 2024-09-19T07:24:58.939 INFO:tasks.workunit.client.0.smithi098.stdout:1/694: mknod dc/de/d50/d6c/ddb/cea 0 2024-09-19T07:24:58.939 INFO:tasks.workunit.client.0.smithi098.stdout:8/593: mkdir d0/d33/d44/dbe 0 2024-09-19T07:24:58.942 INFO:tasks.workunit.client.0.smithi098.stdout:1/695: mknod dc/d17/d9c/ceb 0 2024-09-19T07:24:58.942 INFO:tasks.workunit.client.0.smithi098.stdout:1/696: chown dc/de/d22/d31/d35/fa1 347366 1 2024-09-19T07:24:58.942 INFO:tasks.workunit.client.0.smithi098.stdout:1/697: getdents dc/de/d22/d31/d5d/d6a/de0 0 2024-09-19T07:24:58.942 INFO:tasks.workunit.client.0.smithi098.stdout:8/594: truncate d0/d33/d55/d8a/f15 10203173 0 2024-09-19T07:24:58.943 INFO:tasks.workunit.client.0.smithi098.stdout:7/721: link d5/d8/d8e/d59/fa3 d5/d3e/d62/da0/ff3 0 2024-09-19T07:24:58.944 INFO:tasks.workunit.client.0.smithi098.stdout:1/698: mkdir dc/de/d22/d31/d35/d58/dec 0 2024-09-19T07:24:58.945 INFO:tasks.workunit.client.0.smithi098.stdout:1/699: readlink dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/l5a 0 2024-09-19T07:24:58.945 INFO:tasks.workunit.client.0.smithi098.stdout:1/700: write dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/f6b [938699,96247] 0 2024-09-19T07:24:58.947 INFO:tasks.workunit.client.0.smithi098.stdout:8/595: creat d0/d16/d7d/fbf x:0 0 0 2024-09-19T07:24:58.949 INFO:tasks.workunit.client.0.smithi098.stdout:7/722: mknod d5/dce/dd6/cf4 0 2024-09-19T07:24:58.949 INFO:tasks.workunit.client.0.smithi098.stdout:1/701: creat dc/fed x:0 0 0 2024-09-19T07:24:58.949 INFO:tasks.workunit.client.0.smithi098.stdout:1/702: write dc/f33 [10590414,23339] 0 2024-09-19T07:24:58.952 INFO:tasks.workunit.client.0.smithi098.stdout:1/703: creat dc/de/d22/d31/d5d/d6a/fee x:0 0 0 2024-09-19T07:24:58.952 INFO:tasks.workunit.client.0.smithi098.stdout:7/723: unlink d5/d10/d11/l98 0 2024-09-19T07:24:58.952 INFO:tasks.workunit.client.0.smithi098.stdout:7/724: fsync d5/d10/d1d/f55 0 2024-09-19T07:24:58.954 INFO:tasks.workunit.client.0.smithi098.stdout:1/704: creat dc/de/d22/d31/d5d/d6a/d6f/d4d/dc6/fef x:0 0 0 2024-09-19T07:24:58.955 INFO:tasks.workunit.client.0.smithi098.stdout:1/705: mkdir dc/de/d50/d6c/ddb/df0 0 2024-09-19T07:24:58.957 INFO:tasks.workunit.client.0.smithi098.stdout:1/706: creat dc/de/d22/ff1 x:0 0 0 2024-09-19T07:24:58.966 INFO:tasks.workunit.client.0.smithi098.stdout:0/678: dwrite d5/d20/d1f/d47/db2/dbf/f83 [0,4194304] 0 2024-09-19T07:24:58.966 INFO:tasks.workunit.client.0.smithi098.stdout:0/679: write d5/d20/d1f/d52/d64/d77/d79/fd6 [392447,105910] 0 2024-09-19T07:24:58.969 INFO:tasks.workunit.client.0.smithi098.stdout:6/592: dwrite d2/d5/d1f/fd3 [4194304,4194304] 0 2024-09-19T07:24:58.970 INFO:tasks.workunit.client.0.smithi098.stdout:6/593: readlink d2/db0/d8d/la8 0 2024-09-19T07:24:58.974 INFO:tasks.workunit.client.0.smithi098.stdout:6/594: creat d2/db0/d8d/fdd x:0 0 0 2024-09-19T07:24:58.974 INFO:tasks.workunit.client.0.smithi098.stdout:6/595: truncate d2/d11/f56 2176682 0 2024-09-19T07:24:58.975 INFO:tasks.workunit.client.0.smithi098.stdout:9/642: dwrite d3/dc/f6a [0,4194304] 0 2024-09-19T07:24:58.976 INFO:tasks.workunit.client.0.smithi098.stdout:9/643: chown d3/d16/d38/d22/f95 107498 1 2024-09-19T07:24:58.976 INFO:tasks.workunit.client.0.smithi098.stdout:9/644: write d3/d16/d43/d51/dd3/d8a/fa8 [4352240,94259] 0 2024-09-19T07:24:58.977 INFO:tasks.workunit.client.0.smithi098.stdout:5/511: dwrite dc/de/d13/d46/f26 [0,4194304] 0 2024-09-19T07:24:58.977 INFO:tasks.workunit.client.0.smithi098.stdout:5/512: chown dc/de/d13/d46/d2e/l57 0 1 2024-09-19T07:24:58.978 INFO:tasks.workunit.client.0.smithi098.stdout:9/645: rmdir d3/dc/df/d15/d1a/db7 39 2024-09-19T07:24:58.978 INFO:tasks.workunit.client.0.smithi098.stdout:4/570: dwrite da/d31/d46/d56/d5b/fb2 [0,4194304] 0 2024-09-19T07:24:58.978 INFO:tasks.workunit.client.0.smithi098.stdout:4/571: fdatasync da/d31/d46/d56/d5b/d61/fb4 0 2024-09-19T07:24:58.978 INFO:tasks.workunit.client.0.smithi098.stdout:4/572: chown da/d31/d46/d56/d5b/d66 2 1 2024-09-19T07:24:58.979 INFO:tasks.workunit.client.0.smithi098.stdout:8/596: dwrite d0/d16/f17 [4194304,4194304] 0 2024-09-19T07:24:58.979 INFO:tasks.workunit.client.0.smithi098.stdout:0/680: write d5/f17 [8339035,108259] 0 2024-09-19T07:24:58.983 INFO:tasks.workunit.client.0.smithi098.stdout:0/681: truncate f4 310669 0 2024-09-19T07:24:58.983 INFO:tasks.workunit.client.0.smithi098.stdout:0/682: chown d5/d20/d1f/d47/db2/dbf 372 1 2024-09-19T07:24:58.987 INFO:tasks.workunit.client.0.smithi098.stdout:5/513: rename dc/de/d13/d46/d23/d52 to dc/de/d13/d5c/da2 0 2024-09-19T07:24:58.987 INFO:tasks.workunit.client.0.smithi098.stdout:5/514: fdatasync dc/de/d13/d46/f26 0 2024-09-19T07:24:58.988 INFO:tasks.workunit.client.0.smithi098.stdout:5/515: dread dc/de/d13/d5c/da2/f7b [0,4194304] 0 2024-09-19T07:24:58.989 INFO:tasks.workunit.client.0.smithi098.stdout:8/597: rename d0/d1a/c7b to d0/d33/d55/d8a/d12/dba/cc0 0 2024-09-19T07:24:58.990 INFO:tasks.workunit.client.0.smithi098.stdout:9/646: dread d3/dc/df/d15/d1a/d2b/d92/f94 [0,4194304] 0 2024-09-19T07:24:58.990 INFO:tasks.workunit.client.0.smithi098.stdout:5/516: creat dc/de/d13/d5c/da2/fa3 x:0 0 0 2024-09-19T07:24:58.990 INFO:tasks.workunit.client.0.smithi098.stdout:7/725: dwrite d5/d10/d11/fc6 [0,4194304] 0 2024-09-19T07:24:58.991 INFO:tasks.workunit.client.0.smithi098.stdout:5/517: unlink dc/c66 0 2024-09-19T07:24:58.991 INFO:tasks.workunit.client.0.smithi098.stdout:9/647: read d3/dc/df/f4e [712857,75795] 0 2024-09-19T07:24:58.991 INFO:tasks.workunit.client.0.smithi098.stdout:1/707: dwrite dc/d2a/f51 [0,4194304] 0 2024-09-19T07:24:58.991 INFO:tasks.workunit.client.0.smithi098.stdout:4/573: dread da/f16 [0,4194304] 0 2024-09-19T07:24:58.993 INFO:tasks.workunit.client.0.smithi098.stdout:0/683: write d5/d20/d1f/d52/d64/d77/d79/f9e [1056717,26986] 0 2024-09-19T07:24:58.994 INFO:tasks.workunit.client.0.smithi098.stdout:8/598: dread d0/f53 [0,4194304] 0 2024-09-19T07:24:58.997 INFO:tasks.workunit.client.0.smithi098.stdout:7/726: creat d5/dce/ff5 x:0 0 0 2024-09-19T07:24:58.997 INFO:tasks.workunit.client.0.smithi098.stdout:9/648: rmdir d3/dc/df/d15/d1b 39 2024-09-19T07:24:58.998 INFO:tasks.workunit.client.0.smithi098.stdout:1/708: dread - dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/f95 zero size 2024-09-19T07:24:58.998 INFO:tasks.workunit.client.0.smithi098.stdout:0/684: symlink d5/d20/d1f/d47/db2/dbf/d6d/ld7 0 2024-09-19T07:24:58.998 INFO:tasks.workunit.client.0.smithi098.stdout:0/685: truncate d5/f3e 1320874 0 2024-09-19T07:24:58.999 INFO:tasks.workunit.client.0.smithi098.stdout:8/599: mknod d0/d16/d65/cc1 0 2024-09-19T07:24:59.000 INFO:tasks.workunit.client.0.smithi098.stdout:6/596: dwrite d2/db0/d4e/f89 [0,4194304] 0 2024-09-19T07:24:59.003 INFO:tasks.workunit.client.0.smithi098.stdout:6/597: getdents d2/d5/d1f/d26/d7b 0 2024-09-19T07:24:59.005 INFO:tasks.workunit.client.0.smithi098.stdout:6/598: mknod d2/d5/d1f/d26/d42/cde 0 2024-09-19T07:24:59.005 INFO:tasks.workunit.client.0.smithi098.stdout:6/599: getdents d2/d11/dd0 0 2024-09-19T07:24:59.005 INFO:tasks.workunit.client.0.smithi098.stdout:6/600: write d2/f8e [197129,83199] 0 2024-09-19T07:24:59.008 INFO:tasks.workunit.client.0.smithi098.stdout:9/649: symlink d3/ldd 0 2024-09-19T07:24:59.008 INFO:tasks.workunit.client.0.smithi098.stdout:1/709: creat dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/ddd/ff2 x:0 0 0 2024-09-19T07:24:59.008 INFO:tasks.workunit.client.0.smithi098.stdout:0/686: creat d5/d20/d1f/d47/dae/fd8 x:0 0 0 2024-09-19T07:24:59.009 INFO:tasks.workunit.client.0.smithi098.stdout:0/687: chown d5/d20/d1f/d52/d64/d77/d79/d94 59767 1 2024-09-19T07:24:59.009 INFO:tasks.workunit.client.0.smithi098.stdout:4/574: write da/d31/d46/d56/d5b/d63/f67 [1394209,29889] 0 2024-09-19T07:24:59.009 INFO:tasks.workunit.client.0.smithi098.stdout:6/601: rename d2/d5/l87 to d2/d5/d1f/d26/d42/d48/d53/ldf 0 2024-09-19T07:24:59.009 INFO:tasks.workunit.client.0.smithi098.stdout:1/710: rename dc/d17/d1b/d1d to dc/d17/d1b/d1d/d30/df3 22 2024-09-19T07:24:59.009 INFO:tasks.workunit.client.0.smithi098.stdout:6/602: readlink d2/d5/d1f/d26/l54 0 2024-09-19T07:24:59.009 INFO:tasks.workunit.client.0.smithi098.stdout:1/711: write dc/d17/fc7 [1105622,59128] 0 2024-09-19T07:24:59.010 INFO:tasks.workunit.client.0.smithi098.stdout:4/575: unlink da/d31/d46/c50 0 2024-09-19T07:24:59.010 INFO:tasks.workunit.client.0.smithi098.stdout:1/712: creat dc/de/d22/d31/d35/ff4 x:0 0 0 2024-09-19T07:24:59.013 INFO:tasks.workunit.client.0.smithi098.stdout:7/727: unlink d5/d10/d1d/l4c 0 2024-09-19T07:24:59.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/728: fdatasync d5/d8/d52/db6/fd1 0 2024-09-19T07:24:59.014 INFO:tasks.workunit.client.0.smithi098.stdout:9/650: symlink d3/d16/d43/d61/da6/dd8/lde 0 2024-09-19T07:24:59.014 INFO:tasks.workunit.client.0.smithi098.stdout:9/651: readlink d3/d16/d38/d48/la1 0 2024-09-19T07:24:59.014 INFO:tasks.workunit.client.0.smithi098.stdout:9/652: chown d3/d16/d43/d51/dd3/dc1 10 1 2024-09-19T07:24:59.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/729: write d5/d10/f9d [1027527,99297] 0 2024-09-19T07:24:59.014 INFO:tasks.workunit.client.0.smithi098.stdout:7/730: chown d5/d10/d1d/f51 142042330 1 2024-09-19T07:24:59.015 INFO:tasks.workunit.client.0.smithi098.stdout:4/576: creat da/fc7 x:0 0 0 2024-09-19T07:24:59.015 INFO:tasks.workunit.client.0.smithi098.stdout:9/653: symlink d3/dc/df/d15/d1a/d2b/d49/d74/ldf 0 2024-09-19T07:24:59.015 INFO:tasks.workunit.client.0.smithi098.stdout:5/518: dwrite dc/de/d13/d46/d2e/d37/d81/f3c [0,4194304] 0 2024-09-19T07:24:59.015 INFO:tasks.workunit.client.0.smithi098.stdout:4/577: mkdir da/d31/d46/d5f/dc8 0 2024-09-19T07:24:59.015 INFO:tasks.workunit.client.0.smithi098.stdout:4/578: dread - da/d31/d46/d56/d5b/d61/fa8 zero size 2024-09-19T07:24:59.015 INFO:tasks.workunit.client.0.smithi098.stdout:4/579: fdatasync da/d31/d46/d56/d5b/d66/fa9 0 2024-09-19T07:24:59.016 INFO:tasks.workunit.client.0.smithi098.stdout:4/580: mkdir da/d31/d46/d5f/d8a/db6/dc9 0 2024-09-19T07:24:59.017 INFO:tasks.workunit.client.0.smithi098.stdout:4/581: dread - da/d31/d46/fbe zero size 2024-09-19T07:24:59.017 INFO:tasks.workunit.client.0.smithi098.stdout:0/688: dread d5/d20/d1f/d52/d64/d77/d79/fd6 [0,4194304] 0 2024-09-19T07:24:59.019 INFO:tasks.workunit.client.0.smithi098.stdout:6/603: dread d2/d5/d1f/d26/f33 [0,4194304] 0 2024-09-19T07:24:59.022 INFO:tasks.workunit.client.0.smithi098.stdout:1/713: dread dc/de/d22/f4b [4194304,4194304] 0 2024-09-19T07:24:59.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:58 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:59.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:58 smithi098 ceph-mon[30950]: pgmap v90: 97 pgs: 97 active+clean; 856 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 MiB/s rd, 131 MiB/s wr, 1.21k op/s 2024-09-19T07:24:59.024 INFO:tasks.workunit.client.0.smithi098.stdout:0/689: read d5/d20/f12 [7205919,66927] 0 2024-09-19T07:24:59.025 INFO:tasks.workunit.client.0.smithi098.stdout:0/690: fdatasync d5/d20/d1f/d8d/fc7 0 2024-09-19T07:24:59.025 INFO:tasks.workunit.client.0.smithi098.stdout:5/519: mknod dc/de/d13/d5c/da2/ca4 0 2024-09-19T07:24:59.026 INFO:tasks.workunit.client.0.smithi098.stdout:7/731: symlink d5/d3e/d61/lf6 0 2024-09-19T07:24:59.027 INFO:tasks.workunit.client.0.smithi098.stdout:7/732: fdatasync d5/d3e/d62/da0/f8f 0 2024-09-19T07:24:59.027 INFO:tasks.workunit.client.0.smithi098.stdout:1/714: rename dc/d17/d1b/d1d/d30/dd0 to dc/d2a/df5 0 2024-09-19T07:24:59.028 INFO:tasks.workunit.client.0.smithi098.stdout:0/691: mkdir d5/d20/d14/dd9 0 2024-09-19T07:24:59.030 INFO:tasks.workunit.client.0.smithi098.stdout:7/733: creat d5/d10/dc2/d5c/ff7 x:0 0 0 2024-09-19T07:24:59.032 INFO:tasks.workunit.client.0.smithi098.stdout:0/692: creat d5/d20/d1f/d52/d64/d77/d79/d92/fda x:0 0 0 2024-09-19T07:24:59.032 INFO:tasks.workunit.client.0.smithi098.stdout:0/693: chown d5/d20/d1f/d52/d64/d77/fd0 804 1 2024-09-19T07:24:59.032 INFO:tasks.workunit.client.0.smithi098.stdout:7/734: mkdir d5/d10/d50/df8 0 2024-09-19T07:24:59.033 INFO:tasks.workunit.client.0.smithi098.stdout:0/694: mknod d5/d20/d14/d49/cdb 0 2024-09-19T07:24:59.034 INFO:tasks.workunit.client.0.smithi098.stdout:0/695: truncate d5/d20/d1f/d47/db2/dbf/d6d/f7b 352493 0 2024-09-19T07:24:59.035 INFO:tasks.workunit.client.0.smithi098.stdout:0/696: link d5/d20/d1f/d52/d9f/fd5 d5/d20/d1f/d52/d64/da0/fdc 0 2024-09-19T07:24:59.036 INFO:tasks.workunit.client.0.smithi098.stdout:6/604: dread d2/d5/f16 [0,4194304] 0 2024-09-19T07:24:59.036 INFO:tasks.workunit.client.0.smithi098.stdout:6/605: write d2/f1a [4471168,14043] 0 2024-09-19T07:24:59.038 INFO:tasks.workunit.client.0.smithi098.stdout:8/600: dwrite d0/d16/f79 [0,4194304] 0 2024-09-19T07:24:59.038 INFO:tasks.workunit.client.0.smithi098.stdout:6/606: mkdir d2/d5/d1f/d26/d7b/de0 0 2024-09-19T07:24:59.039 INFO:tasks.workunit.client.0.smithi098.stdout:0/697: rename d5/f17 to d5/d20/d14/fdd 0 2024-09-19T07:24:59.040 INFO:tasks.workunit.client.0.smithi098.stdout:1/715: dread dc/de/d22/d31/d5d/d6a/d6f/d5f/f91 [0,4194304] 0 2024-09-19T07:24:59.044 INFO:tasks.workunit.client.0.smithi098.stdout:9/654: dwrite d3/d6/d46/d83/da9/fc8 [0,4194304] 0 2024-09-19T07:24:59.044 INFO:tasks.workunit.client.0.smithi098.stdout:9/655: chown d3/d16/d38/f2e 425 1 2024-09-19T07:24:59.044 INFO:tasks.workunit.client.0.smithi098.stdout:6/607: dread d2/d5/f81 [0,4194304] 0 2024-09-19T07:24:59.045 INFO:tasks.workunit.client.0.smithi098.stdout:6/608: fdatasync d2/db0/f6b 0 2024-09-19T07:24:59.045 INFO:tasks.workunit.client.0.smithi098.stdout:6/609: fsync d2/f58 0 2024-09-19T07:24:59.045 INFO:tasks.workunit.client.0.smithi098.stdout:4/582: dwrite da/d7e/fb0 [0,4194304] 0 2024-09-19T07:24:59.046 INFO:tasks.workunit.client.0.smithi098.stdout:0/698: rename d5/d20/l98 to d5/d20/d1f/d52/d64/da0/lde 0 2024-09-19T07:24:59.046 INFO:tasks.workunit.client.0.smithi098.stdout:6/610: link d2/d5/d1f/l6c d2/d5/d1f/d26/d42/d48/d53/d64/d6d/le1 0 2024-09-19T07:24:59.047 INFO:tasks.workunit.client.0.smithi098.stdout:3/574: sync 2024-09-19T07:24:59.047 INFO:tasks.workunit.client.0.smithi098.stdout:3/575: chown de/df/d31/f3d 10161 1 2024-09-19T07:24:59.047 INFO:tasks.workunit.client.0.smithi098.stdout:3/576: dread - de/df/d1f/d72/f98 zero size 2024-09-19T07:24:59.047 INFO:tasks.workunit.client.0.smithi098.stdout:3/577: write de/df/d1f/d2b/d93/fa7 [928241,32346] 0 2024-09-19T07:24:59.048 INFO:tasks.workunit.client.0.smithi098.stdout:4/583: readlink da/l27 0 2024-09-19T07:24:59.049 INFO:tasks.workunit.client.0.smithi098.stdout:6/611: creat d2/d1b/d8f/dcb/fe2 x:0 0 0 2024-09-19T07:24:59.052 INFO:tasks.workunit.client.0.smithi098.stdout:0/699: rmdir d5/d20/d1f/d52/d64 39 2024-09-19T07:24:59.056 INFO:tasks.workunit.client.0.smithi098.stdout:0/700: dread d5/d20/d14/f61 [0,4194304] 0 2024-09-19T07:24:59.059 INFO:tasks.workunit.client.0.smithi098.stdout:0/701: link d5/f8f d5/d20/d1f/d52/d64/dcc/fdf 0 2024-09-19T07:24:59.061 INFO:tasks.workunit.client.0.smithi098.stdout:2/642: sync 2024-09-19T07:24:59.063 INFO:tasks.workunit.client.0.smithi098.stdout:3/578: dread de/df/d1f/d2b/f39 [0,4194304] 0 2024-09-19T07:24:59.063 INFO:tasks.workunit.client.0.smithi098.stdout:3/579: chown de/df/d1f/d72/la5 997070794 1 2024-09-19T07:24:59.064 INFO:tasks.workunit.client.0.smithi098.stdout:7/735: dwrite d5/d10/dc2/dbd/fef [0,4194304] 0 2024-09-19T07:24:59.064 INFO:tasks.workunit.client.0.smithi098.stdout:7/736: write d5/d8/dc/d16/f84 [548721,89149] 0 2024-09-19T07:24:59.065 INFO:tasks.workunit.client.0.smithi098.stdout:3/580: mkdir de/d4e/d6d/d8c/dab 0 2024-09-19T07:24:59.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:58 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:24:59.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:58 smithi139 ceph-mon[35039]: pgmap v90: 97 pgs: 97 active+clean; 856 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 MiB/s rd, 131 MiB/s wr, 1.21k op/s 2024-09-19T07:24:59.067 INFO:tasks.workunit.client.0.smithi098.stdout:2/643: write d1/d9/d26/d35/d58/f32 [127109,32124] 0 2024-09-19T07:24:59.067 INFO:tasks.workunit.client.0.smithi098.stdout:2/644: stat d1/d9/f2a 0 2024-09-19T07:24:59.068 INFO:tasks.workunit.client.0.smithi098.stdout:5/520: dwrite fa [0,4194304] 0 2024-09-19T07:24:59.071 INFO:tasks.workunit.client.0.smithi098.stdout:5/521: mkdir dc/de/d13/d46/d2e/da5 0 2024-09-19T07:24:59.073 INFO:tasks.workunit.client.0.smithi098.stdout:5/522: mknod dc/de/d13/d7d/ca6 0 2024-09-19T07:24:59.075 INFO:tasks.workunit.client.0.smithi098.stdout:5/523: symlink dc/de/d13/d46/d23/la7 0 2024-09-19T07:24:59.075 INFO:tasks.workunit.client.0.smithi098.stdout:5/524: chown fa 210000866 1 2024-09-19T07:24:59.076 INFO:tasks.workunit.client.0.smithi098.stdout:5/525: fdatasync f5 0 2024-09-19T07:24:59.076 INFO:tasks.workunit.client.0.smithi098.stdout:5/526: fdatasync dc/de/d13/d46/d23/f9b 0 2024-09-19T07:24:59.076 INFO:tasks.workunit.client.0.smithi098.stdout:1/716: dwrite dc/d17/d1b/d1d/d3d/dc4/fdf [0,4194304] 0 2024-09-19T07:24:59.077 INFO:tasks.workunit.client.0.smithi098.stdout:5/527: truncate dc/de/f2c 253901 0 2024-09-19T07:24:59.077 INFO:tasks.workunit.client.0.smithi098.stdout:1/717: creat dc/de/d22/d31/d5d/d6a/d6f/d4d/dc6/ff6 x:0 0 0 2024-09-19T07:24:59.078 INFO:tasks.workunit.client.0.smithi098.stdout:1/718: write dc/de/d50/f61 [776540,103622] 0 2024-09-19T07:24:59.079 INFO:tasks.workunit.client.0.smithi098.stdout:7/737: dread d5/d8/d52/fbc [0,4194304] 0 2024-09-19T07:24:59.080 INFO:tasks.workunit.client.0.smithi098.stdout:7/738: mknod d5/db0/cf9 0 2024-09-19T07:24:59.084 INFO:tasks.workunit.client.0.smithi098.stdout:8/601: dwrite d0/d33/f6e [0,4194304] 0 2024-09-19T07:24:59.086 INFO:tasks.workunit.client.0.smithi098.stdout:8/602: mkdir d0/d16/dc2 0 2024-09-19T07:24:59.088 INFO:tasks.workunit.client.0.smithi098.stdout:8/603: creat d0/d33/d55/fc3 x:0 0 0 2024-09-19T07:24:59.088 INFO:tasks.workunit.client.0.smithi098.stdout:8/604: chown d0/d16/f79 568 1 2024-09-19T07:24:59.092 INFO:tasks.workunit.client.0.smithi098.stdout:2/645: dread d1/d5/d72/db5/f8e [0,4194304] 0 2024-09-19T07:24:59.092 INFO:tasks.workunit.client.0.smithi098.stdout:2/646: truncate d1/d9/d26/d35/d48/d7f/fc5 160318 0 2024-09-19T07:24:59.093 INFO:tasks.workunit.client.0.smithi098.stdout:2/647: write d1/d9/d3e/d41/d60/d65/da0/faf [637539,68853] 0 2024-09-19T07:24:59.095 INFO:tasks.workunit.client.0.smithi098.stdout:5/528: dread dc/de/f96 [0,4194304] 0 2024-09-19T07:24:59.096 INFO:tasks.workunit.client.0.smithi098.stdout:2/648: dread d1/d9/d3e/d41/d60/da5/dd9/f44 [0,4194304] 0 2024-09-19T07:24:59.096 INFO:tasks.workunit.client.0.smithi098.stdout:2/649: write d1/d9/d26/d35/d48/d7f/fc6 [862143,39514] 0 2024-09-19T07:24:59.096 INFO:tasks.workunit.client.0.smithi098.stdout:9/656: dwrite d3/dc/df/d15/d1a/d2b/d49/d65/f7c [0,4194304] 0 2024-09-19T07:24:59.097 INFO:tasks.workunit.client.0.smithi098.stdout:4/584: dwrite da/d31/d46/d80/f99 [0,4194304] 0 2024-09-19T07:24:59.097 INFO:tasks.workunit.client.0.smithi098.stdout:4/585: write da/d59/d5d/f9f [906521,74437] 0 2024-09-19T07:24:59.097 INFO:tasks.workunit.client.0.smithi098.stdout:4/586: readlink da/d31/d46/l70 0 2024-09-19T07:24:59.098 INFO:tasks.workunit.client.0.smithi098.stdout:4/587: dread - da/fc7 zero size 2024-09-19T07:24:59.098 INFO:tasks.workunit.client.0.smithi098.stdout:6/612: dwrite d2/f8e [0,4194304] 0 2024-09-19T07:24:59.100 INFO:tasks.workunit.client.0.smithi098.stdout:1/719: write dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f85 [857115,66615] 0 2024-09-19T07:24:59.100 INFO:tasks.workunit.client.0.smithi098.stdout:0/702: dwrite d5/f18 [4194304,4194304] 0 2024-09-19T07:24:59.100 INFO:tasks.workunit.client.0.smithi098.stdout:0/703: readlink d5/d20/d1f/d52/d64/da0/lde 0 2024-09-19T07:24:59.100 INFO:tasks.workunit.client.0.smithi098.stdout:1/720: write dc/d17/d1b/d1d/d30/f59 [2455450,87301] 0 2024-09-19T07:24:59.101 INFO:tasks.workunit.client.0.smithi098.stdout:9/657: truncate d3/dc/f19 2328564 0 2024-09-19T07:24:59.101 INFO:tasks.workunit.client.0.smithi098.stdout:9/658: readlink d3/d16/d38/l70 0 2024-09-19T07:24:59.103 INFO:tasks.workunit.client.0.smithi098.stdout:4/588: creat da/d31/d46/d56/d5b/d66/fca x:0 0 0 2024-09-19T07:24:59.104 INFO:tasks.workunit.client.0.smithi098.stdout:4/589: dread - da/d31/d46/d56/d5b/d66/f7a zero size 2024-09-19T07:24:59.105 INFO:tasks.workunit.client.0.smithi098.stdout:1/721: unlink dc/de/c29 0 2024-09-19T07:24:59.113 INFO:tasks.workunit.client.0.smithi098.stdout:4/590: dread da/d31/d46/d56/d5b/d63/f67 [0,4194304] 0 2024-09-19T07:24:59.113 INFO:tasks.workunit.client.0.smithi098.stdout:4/591: chown da/d31/d46/d56/d5b/c79 20598 1 2024-09-19T07:24:59.116 INFO:tasks.workunit.client.0.smithi098.stdout:4/592: mknod da/d31/d46/d56/d5b/d66/ccb 0 2024-09-19T07:24:59.117 INFO:tasks.workunit.client.0.smithi098.stdout:5/529: dread dc/de/d13/d46/d2e/d37/f43 [0,4194304] 0 2024-09-19T07:24:59.117 INFO:tasks.workunit.client.0.smithi098.stdout:5/530: truncate dc/de/d13/d46/d2e/d37/d81/f45 353570 0 2024-09-19T07:24:59.130 INFO:tasks.workunit.client.0.smithi098.stdout:3/581: rename de/df/d4f/c52 to de/df/d1f/d72/cac 0 2024-09-19T07:24:59.130 INFO:tasks.workunit.client.0.smithi098.stdout:3/582: read de/df/d1f/f83 [3556110,117682] 0 2024-09-19T07:24:59.131 INFO:tasks.workunit.client.0.smithi098.stdout:7/739: rename d5/d10/dc2/d5c/dc3/fcc to d5/d10/dc2/dbd/ffa 0 2024-09-19T07:24:59.131 INFO:tasks.workunit.client.0.smithi098.stdout:7/740: chown d5/d8/l8a 541 1 2024-09-19T07:24:59.132 INFO:tasks.workunit.client.0.smithi098.stdout:3/583: mkdir de/d4e/d6d/dad 0 2024-09-19T07:24:59.132 INFO:tasks.workunit.client.0.smithi098.stdout:3/584: write de/f46 [1160143,6] 0 2024-09-19T07:24:59.132 INFO:tasks.workunit.client.0.smithi098.stdout:3/585: write de/df/d31/d61/d69/f89 [912431,56693] 0 2024-09-19T07:24:59.132 INFO:tasks.workunit.client.0.smithi098.stdout:8/605: rename d0/d16/d7d/fbf to d0/d33/d55/d8a/d21/d50/d9e/da4/fc4 0 2024-09-19T07:24:59.133 INFO:tasks.workunit.client.0.smithi098.stdout:7/741: truncate d5/f3c 3716212 0 2024-09-19T07:24:59.133 INFO:tasks.workunit.client.0.smithi098.stdout:7/742: write d5/d10/dc2/d5c/fdc [709122,105421] 0 2024-09-19T07:24:59.134 INFO:tasks.workunit.client.0.smithi098.stdout:3/586: creat de/d4e/fae x:0 0 0 2024-09-19T07:24:59.136 INFO:tasks.workunit.client.0.smithi098.stdout:3/587: getdents de/df/d31 0 2024-09-19T07:24:59.136 INFO:tasks.workunit.client.0.smithi098.stdout:3/588: fdatasync de/df/d1f/f56 0 2024-09-19T07:24:59.136 INFO:tasks.workunit.client.0.smithi098.stdout:0/704: dwrite d5/d20/d1f/d52/d64/d77/d79/fd6 [0,4194304] 0 2024-09-19T07:24:59.136 INFO:tasks.workunit.client.0.smithi098.stdout:0/705: fdatasync d5/d20/d14/d49/f5e 0 2024-09-19T07:24:59.136 INFO:tasks.workunit.client.0.smithi098.stdout:0/706: chown d5/f23 95126087 1 2024-09-19T07:24:59.136 INFO:tasks.workunit.client.0.smithi098.stdout:0/707: fsync d5/d20/d1f/d52/fa3 0 2024-09-19T07:24:59.136 INFO:tasks.workunit.client.0.smithi098.stdout:2/650: dwrite d1/d5/fca [0,4194304] 0 2024-09-19T07:24:59.137 INFO:tasks.workunit.client.0.smithi098.stdout:3/589: mknod de/df/d1f/d2b/d93/caf 0 2024-09-19T07:24:59.138 INFO:tasks.workunit.client.0.smithi098.stdout:9/659: dwrite d3/dc/f6a [4194304,4194304] 0 2024-09-19T07:24:59.138 INFO:tasks.workunit.client.0.smithi098.stdout:9/660: fsync d3/d16/f57 0 2024-09-19T07:24:59.139 INFO:tasks.workunit.client.0.smithi098.stdout:1/722: dwrite dc/de/d22/d31/d5d/d6a/d6f/d4d/f8a [0,4194304] 0 2024-09-19T07:24:59.140 INFO:tasks.workunit.client.0.smithi098.stdout:2/651: creat d1/d9/d3e/d41/d60/fdd x:0 0 0 2024-09-19T07:24:59.140 INFO:tasks.workunit.client.0.smithi098.stdout:2/652: read - d1/d9/d26/d35/fd0 zero size 2024-09-19T07:24:59.141 INFO:tasks.workunit.client.0.smithi098.stdout:2/653: getdents d1/d5/d72 0 2024-09-19T07:24:59.143 INFO:tasks.workunit.client.0.smithi098.stdout:6/613: dwrite d2/d1b/f2f [0,4194304] 0 2024-09-19T07:24:59.143 INFO:tasks.workunit.client.0.smithi098.stdout:6/614: dread - d2/d5/d1f/d26/d42/d48/d53/f5d zero size 2024-09-19T07:24:59.144 INFO:tasks.workunit.client.0.smithi098.stdout:2/654: creat d1/d5/d72/db5/d4e/fde x:0 0 0 2024-09-19T07:24:59.144 INFO:tasks.workunit.client.0.smithi098.stdout:2/655: dread - d1/d5/d34/d80/d93/f74 zero size 2024-09-19T07:24:59.144 INFO:tasks.workunit.client.0.smithi098.stdout:0/708: write d5/d20/f69 [2060271,5810] 0 2024-09-19T07:24:59.144 INFO:tasks.workunit.client.0.smithi098.stdout:6/615: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d79/le3 0 2024-09-19T07:24:59.146 INFO:tasks.workunit.client.0.smithi098.stdout:0/709: unlink d5/d20/f69 0 2024-09-19T07:24:59.156 INFO:tasks.workunit.client.0.smithi098.stdout:6/616: write d2/d5/fb8 [529681,75291] 0 2024-09-19T07:24:59.156 INFO:tasks.workunit.client.0.smithi098.stdout:6/617: chown d2/d11/l78 6768 1 2024-09-19T07:24:59.157 INFO:tasks.workunit.client.0.smithi098.stdout:4/593: link da/f4b da/d31/d46/d56/d5b/db9/fcc 0 2024-09-19T07:24:59.157 INFO:tasks.workunit.client.0.smithi098.stdout:3/590: dread de/f26 [0,4194304] 0 2024-09-19T07:24:59.157 INFO:tasks.workunit.client.0.smithi098.stdout:4/594: chown da/d31/l4e 17 1 2024-09-19T07:24:59.157 INFO:tasks.workunit.client.0.smithi098.stdout:5/531: link dc/f54 dc/de/d13/d46/d2e/d37/d67/d75/fa8 0 2024-09-19T07:24:59.159 INFO:tasks.workunit.client.0.smithi098.stdout:6/618: mknod d2/d5/d1f/d26/d7b/da3/ce4 0 2024-09-19T07:24:59.159 INFO:tasks.workunit.client.0.smithi098.stdout:5/532: creat dc/de/d36/d71/fa9 x:0 0 0 2024-09-19T07:24:59.160 INFO:tasks.workunit.client.0.smithi098.stdout:4/595: rmdir da/d31/d46/d5f/d8a/db6 39 2024-09-19T07:24:59.161 INFO:tasks.workunit.client.0.smithi098.stdout:5/533: mknod dc/de/d13/d46/caa 0 2024-09-19T07:24:59.161 INFO:tasks.workunit.client.0.smithi098.stdout:6/619: dread d2/d11/f66 [0,4194304] 0 2024-09-19T07:24:59.161 INFO:tasks.workunit.client.0.smithi098.stdout:6/620: fdatasync d2/db0/d4e/f7e 0 2024-09-19T07:24:59.161 INFO:tasks.workunit.client.0.smithi098.stdout:6/621: fdatasync d2/db0/d4e/f65 0 2024-09-19T07:24:59.162 INFO:tasks.workunit.client.0.smithi098.stdout:6/622: write d2/d5/d1f/d26/d42/d48/d53/d64/fb5 [503047,120067] 0 2024-09-19T07:24:59.162 INFO:tasks.workunit.client.0.smithi098.stdout:5/534: symlink dc/de/d36/lab 0 2024-09-19T07:24:59.163 INFO:tasks.workunit.client.0.smithi098.stdout:8/606: dwrite d0/d33/f6e [0,4194304] 0 2024-09-19T07:24:59.163 INFO:tasks.workunit.client.0.smithi098.stdout:0/710: dread d5/d20/d14/f4a [0,4194304] 0 2024-09-19T07:24:59.164 INFO:tasks.workunit.client.0.smithi098.stdout:0/711: stat d5/d20/d1f/d47/db2/dbf/d6d/f7b 0 2024-09-19T07:24:59.166 INFO:tasks.workunit.client.0.smithi098.stdout:0/712: creat d5/d20/d1f/d52/d64/d77/d79/d94/fe0 x:0 0 0 2024-09-19T07:24:59.166 INFO:tasks.workunit.client.0.smithi098.stdout:0/713: fsync d5/d20/d14/d49/d62/da7/fac 0 2024-09-19T07:24:59.166 INFO:tasks.workunit.client.0.smithi098.stdout:0/714: write d5/d20/d1f/d8d/f9c [324741,55554] 0 2024-09-19T07:24:59.166 INFO:tasks.workunit.client.0.smithi098.stdout:3/591: dread de/f19 [0,4194304] 0 2024-09-19T07:24:59.167 INFO:tasks.workunit.client.0.smithi098.stdout:0/715: link d5/d20/d14/d49/f56 d5/d20/d1f/d47/fe1 0 2024-09-19T07:24:59.168 INFO:tasks.workunit.client.0.smithi098.stdout:3/592: read de/df/d1f/f7f [310460,50214] 0 2024-09-19T07:24:59.168 INFO:tasks.workunit.client.0.smithi098.stdout:0/716: mkdir d5/d20/d1f/de2 0 2024-09-19T07:24:59.169 INFO:tasks.workunit.client.0.smithi098.stdout:0/717: write d5/d20/d1f/d52/fb4 [714653,96832] 0 2024-09-19T07:24:59.169 INFO:tasks.workunit.client.0.smithi098.stdout:0/718: chown d5/d20/d1f/d8d 240 1 2024-09-19T07:24:59.169 INFO:tasks.workunit.client.0.smithi098.stdout:0/719: write d5/d20/d14/d49/f72 [247665,110938] 0 2024-09-19T07:24:59.169 INFO:tasks.workunit.client.0.smithi098.stdout:0/720: chown d5/d20/d14/f4a 56105 1 2024-09-19T07:24:59.170 INFO:tasks.workunit.client.0.smithi098.stdout:0/721: mkdir d5/d20/d14/de3 0 2024-09-19T07:24:59.170 INFO:tasks.workunit.client.0.smithi098.stdout:3/593: rmdir de/df/d31/d61/d3f/d64 39 2024-09-19T07:24:59.172 INFO:tasks.workunit.client.0.smithi098.stdout:3/594: rmdir de/df/d31/d61 39 2024-09-19T07:24:59.173 INFO:tasks.workunit.client.0.smithi098.stdout:3/595: creat de/df/d31/fb0 x:0 0 0 2024-09-19T07:24:59.174 INFO:tasks.workunit.client.0.smithi098.stdout:6/623: write d2/d5/d1f/d26/d42/d48/f70 [1669725,122943] 0 2024-09-19T07:24:59.175 INFO:tasks.workunit.client.0.smithi098.stdout:6/624: creat d2/d5/d1f/d26/d7b/da3/fe5 x:0 0 0 2024-09-19T07:24:59.176 INFO:tasks.workunit.client.0.smithi098.stdout:6/625: mknod d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98/ce6 0 2024-09-19T07:24:59.178 INFO:tasks.workunit.client.0.smithi098.stdout:6/626: creat d2/db0/d4e/d6e/d9d/d94/fe7 x:0 0 0 2024-09-19T07:24:59.178 INFO:tasks.workunit.client.0.smithi098.stdout:2/656: dwrite d1/d9/d3e/d41/d60/da5/dd9/f30 [0,4194304] 0 2024-09-19T07:24:59.178 INFO:tasks.workunit.client.0.smithi098.stdout:2/657: read - d1/faa zero size 2024-09-19T07:24:59.178 INFO:tasks.workunit.client.0.smithi098.stdout:7/743: dwrite d5/d8/d52/f60 [0,4194304] 0 2024-09-19T07:24:59.179 INFO:tasks.workunit.client.0.smithi098.stdout:5/535: dread fa [0,4194304] 0 2024-09-19T07:24:59.179 INFO:tasks.workunit.client.0.smithi098.stdout:9/661: dwrite d3/dc/df/d15/d1a/d2b/d92/f94 [0,4194304] 0 2024-09-19T07:24:59.184 INFO:tasks.workunit.client.0.smithi098.stdout:2/658: mkdir d1/d9/d26/d35/d48/ddf 0 2024-09-19T07:24:59.184 INFO:tasks.workunit.client.0.smithi098.stdout:1/723: rename dc/de/d22/d31/d5d/d6a/d8b to dc/d17/d1b/d1d/d30/df7 0 2024-09-19T07:24:59.184 INFO:tasks.workunit.client.0.smithi098.stdout:7/744: creat d5/d8/dc/da7/ffb x:0 0 0 2024-09-19T07:24:59.184 INFO:tasks.workunit.client.0.smithi098.stdout:5/536: getdents dc/d6c 0 2024-09-19T07:24:59.184 INFO:tasks.workunit.client.0.smithi098.stdout:5/537: chown dc/de/d13/d46/d2e/d62/f85 18 1 2024-09-19T07:24:59.185 INFO:tasks.workunit.client.0.smithi098.stdout:1/724: creat dc/de/d22/d31/ff8 x:0 0 0 2024-09-19T07:24:59.189 INFO:tasks.workunit.client.0.smithi098.stdout:3/596: read de/df/d1f/d2b/f57 [1320331,78096] 0 2024-09-19T07:24:59.189 INFO:tasks.workunit.client.0.smithi098.stdout:5/538: dread dc/de/d13/d46/d2e/d37/d81/f56 [0,4194304] 0 2024-09-19T07:24:59.189 INFO:tasks.workunit.client.0.smithi098.stdout:5/539: readlink dc/de/l30 0 2024-09-19T07:24:59.191 INFO:tasks.workunit.client.0.smithi098.stdout:1/725: dread dc/d17/d1b/d71/d7a/f7b [0,4194304] 0 2024-09-19T07:24:59.191 INFO:tasks.workunit.client.0.smithi098.stdout:5/540: creat dc/d6c/fac x:0 0 0 2024-09-19T07:24:59.192 INFO:tasks.workunit.client.0.smithi098.stdout:3/597: mknod de/df/d31/d61/d3f/d64/d84/cb1 0 2024-09-19T07:24:59.193 INFO:tasks.workunit.client.0.smithi098.stdout:5/541: getdents dc/de/d36 0 2024-09-19T07:24:59.195 INFO:tasks.workunit.client.0.smithi098.stdout:9/662: dread d3/d16/d43/d51/f6d [0,4194304] 0 2024-09-19T07:24:59.195 INFO:tasks.workunit.client.0.smithi098.stdout:5/542: mknod dc/de/d13/d5c/cad 0 2024-09-19T07:24:59.195 INFO:tasks.workunit.client.0.smithi098.stdout:9/663: dread - d3/dc/df/d15/d1a/d2b/d49/d55/fd9 zero size 2024-09-19T07:24:59.195 INFO:tasks.workunit.client.0.smithi098.stdout:1/726: creat dc/de/d22/d31/d5d/d6a/d6f/d5f/db0/ff9 x:0 0 0 2024-09-19T07:24:59.195 INFO:tasks.workunit.client.0.smithi098.stdout:4/596: dwrite da/d59/d5d/f9f [0,4194304] 0 2024-09-19T07:24:59.196 INFO:tasks.workunit.client.0.smithi098.stdout:5/543: creat dc/de/d13/d46/d23/d5e/fae x:0 0 0 2024-09-19T07:24:59.197 INFO:tasks.workunit.client.0.smithi098.stdout:9/664: getdents d3/d16/d43/d61/da6/dd8 0 2024-09-19T07:24:59.197 INFO:tasks.workunit.client.0.smithi098.stdout:4/597: creat da/d31/d46/fcd x:0 0 0 2024-09-19T07:24:59.197 INFO:tasks.workunit.client.0.smithi098.stdout:4/598: chown da/d31/d46/d80/fa3 89182317 1 2024-09-19T07:24:59.199 INFO:tasks.workunit.client.0.smithi098.stdout:8/607: rename d0/d33/d55/d8a/d28/d40 to d0/dc5 0 2024-09-19T07:24:59.199 INFO:tasks.workunit.client.0.smithi098.stdout:8/608: write d0/fb5 [248376,106994] 0 2024-09-19T07:24:59.199 INFO:tasks.workunit.client.0.smithi098.stdout:8/609: write d0/d33/d55/d8a/d12/f64 [1202380,93452] 0 2024-09-19T07:24:59.199 INFO:tasks.workunit.client.0.smithi098.stdout:8/610: fsync d0/d33/d55/d8a/f18 0 2024-09-19T07:24:59.199 INFO:tasks.workunit.client.0.smithi098.stdout:8/611: write d0/d33/d55/d8a/d21/d50/d9e/da4/fc4 [78875,35541] 0 2024-09-19T07:24:59.199 INFO:tasks.workunit.client.0.smithi098.stdout:8/612: chown d0/d2c 3 1 2024-09-19T07:24:59.199 INFO:tasks.workunit.client.0.smithi098.stdout:9/665: dread d3/d6/fad [0,4194304] 0 2024-09-19T07:24:59.199 INFO:tasks.workunit.client.0.smithi098.stdout:5/544: mkdir dc/de/d13/d5c/daf 0 2024-09-19T07:24:59.200 INFO:tasks.workunit.client.0.smithi098.stdout:8/613: mknod d0/d33/d55/d8a/d12/cc6 0 2024-09-19T07:24:59.200 INFO:tasks.workunit.client.0.smithi098.stdout:1/727: creat dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/ffa x:0 0 0 2024-09-19T07:24:59.200 INFO:tasks.workunit.client.0.smithi098.stdout:1/728: dread - dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/ddd/ff2 zero size 2024-09-19T07:24:59.202 INFO:tasks.workunit.client.0.smithi098.stdout:8/614: mkdir d0/dc7 0 2024-09-19T07:24:59.207 INFO:tasks.workunit.client.0.smithi098.stdout:3/598: dread de/df/d31/f7d [0,4194304] 0 2024-09-19T07:24:59.209 INFO:tasks.workunit.client.0.smithi098.stdout:8/615: read d0/f7e [120281,127944] 0 2024-09-19T07:24:59.209 INFO:tasks.workunit.client.0.smithi098.stdout:0/722: dwrite d5/d20/d14/d49/f65 [0,4194304] 0 2024-09-19T07:24:59.209 INFO:tasks.workunit.client.0.smithi098.stdout:4/599: dread da/f1e [0,4194304] 0 2024-09-19T07:24:59.211 INFO:tasks.workunit.client.0.smithi098.stdout:6/627: dwrite d2/fc [0,4194304] 0 2024-09-19T07:24:59.221 INFO:tasks.workunit.client.0.smithi098.stdout:2/659: dwrite d1/d5/d72/db5/fdc [0,4194304] 0 2024-09-19T07:24:59.224 INFO:tasks.workunit.client.0.smithi098.stdout:2/660: rmdir d1/d5/d34/d5a/db2 39 2024-09-19T07:24:59.224 INFO:tasks.workunit.client.0.smithi098.stdout:7/745: dwrite d5/d10/dc2/d5c/dc3/fdf [0,4194304] 0 2024-09-19T07:24:59.224 INFO:tasks.workunit.client.0.smithi098.stdout:7/746: truncate d5/d8/dc/fa4 388040 0 2024-09-19T07:24:59.225 INFO:tasks.workunit.client.0.smithi098.stdout:6/628: read d2/fe [3274684,10382] 0 2024-09-19T07:24:59.226 INFO:tasks.workunit.client.0.smithi098.stdout:5/545: write dc/de/f96 [878116,119755] 0 2024-09-19T07:24:59.226 INFO:tasks.workunit.client.0.smithi098.stdout:5/546: truncate dc/de/d13/d46/d2e/d37/d81/f78 388504 0 2024-09-19T07:24:59.226 INFO:tasks.workunit.client.0.smithi098.stdout:7/747: dread d5/d8/dc/d16/fb7 [0,4194304] 0 2024-09-19T07:24:59.227 INFO:tasks.workunit.client.0.smithi098.stdout:7/748: chown d5/d8/d8e 64 1 2024-09-19T07:24:59.227 INFO:tasks.workunit.client.0.smithi098.stdout:6/629: rename d2/d5/d1f/d26/d42/cde to d2/d5/d1f/d26/d42/d48/d53/da2/ce8 0 2024-09-19T07:24:59.228 INFO:tasks.workunit.client.0.smithi098.stdout:2/661: truncate d1/d5/d34/f3d 545081 0 2024-09-19T07:24:59.228 INFO:tasks.workunit.client.0.smithi098.stdout:2/662: write d1/d5/d34/d5a/fbc [662632,100843] 0 2024-09-19T07:24:59.231 INFO:tasks.workunit.client.0.smithi098.stdout:7/749: truncate d5/d8/d52/fbc 2188310 0 2024-09-19T07:24:59.233 INFO:tasks.workunit.client.0.smithi098.stdout:6/630: symlink d2/d5/d1f/d26/d7b/le9 0 2024-09-19T07:24:59.233 INFO:tasks.workunit.client.0.smithi098.stdout:6/631: dread - d2/d5/d1f/d26/d42/d48/d53/d64/fa6 zero size 2024-09-19T07:24:59.234 INFO:tasks.workunit.client.0.smithi098.stdout:6/632: mknod d2/d5/d1f/d26/d7b/de0/cea 0 2024-09-19T07:24:59.234 INFO:tasks.workunit.client.0.smithi098.stdout:6/633: write d2/db0/f6b [362351,21251] 0 2024-09-19T07:24:59.234 INFO:tasks.workunit.client.0.smithi098.stdout:6/634: rmdir d2/db0/d4e/d6e/d9d/d94 39 2024-09-19T07:24:59.235 INFO:tasks.workunit.client.0.smithi098.stdout:6/635: dread - d2/db0/d4e/d6e/d9d/d94/f9f zero size 2024-09-19T07:24:59.237 INFO:tasks.workunit.client.0.smithi098.stdout:5/547: creat dc/de/d13/d5c/da2/fb0 x:0 0 0 2024-09-19T07:24:59.238 INFO:tasks.workunit.client.0.smithi098.stdout:2/663: creat d1/d5/fe0 x:0 0 0 2024-09-19T07:24:59.238 INFO:tasks.workunit.client.0.smithi098.stdout:2/664: chown d1/d9/f47 375924 1 2024-09-19T07:24:59.238 INFO:tasks.workunit.client.0.smithi098.stdout:5/548: truncate f3 3989053 0 2024-09-19T07:24:59.239 INFO:tasks.workunit.client.0.smithi098.stdout:2/665: dread d1/d9/d26/d35/d48/d7f/fc5 [0,4194304] 0 2024-09-19T07:24:59.239 INFO:tasks.workunit.client.0.smithi098.stdout:5/549: rmdir dc/de/d13/d5c 39 2024-09-19T07:24:59.239 INFO:tasks.workunit.client.0.smithi098.stdout:5/550: write fa [4275526,97134] 0 2024-09-19T07:24:59.244 INFO:tasks.workunit.client.0.smithi098.stdout:4/600: dwrite da/d7e/fb0 [4194304,4194304] 0 2024-09-19T07:24:59.244 INFO:tasks.workunit.client.0.smithi098.stdout:4/601: getdents da/d31/dc5 0 2024-09-19T07:24:59.244 INFO:tasks.workunit.client.0.smithi098.stdout:3/599: dwrite de/d4e/f51 [0,4194304] 0 2024-09-19T07:24:59.244 INFO:tasks.workunit.client.0.smithi098.stdout:7/750: dread d5/d10/f32 [0,4194304] 0 2024-09-19T07:24:59.244 INFO:tasks.workunit.client.0.smithi098.stdout:3/600: creat de/df/d1f/d2b/d93/fb2 x:0 0 0 2024-09-19T07:24:59.248 INFO:tasks.workunit.client.0.smithi098.stdout:4/602: symlink da/d31/d46/d56/d5b/d61/lce 0 2024-09-19T07:24:59.249 INFO:tasks.workunit.client.0.smithi098.stdout:3/601: dread de/d4e/d6d/d71/f7c [0,4194304] 0 2024-09-19T07:24:59.249 INFO:tasks.workunit.client.0.smithi098.stdout:3/602: chown de/df/d16/l20 2281279 1 2024-09-19T07:24:59.250 INFO:tasks.workunit.client.0.smithi098.stdout:4/603: read da/d31/f3c [1036566,121163] 0 2024-09-19T07:24:59.251 INFO:tasks.workunit.client.0.smithi098.stdout:8/616: dwrite d0/f22 [4194304,4194304] 0 2024-09-19T07:24:59.251 INFO:tasks.workunit.client.0.smithi098.stdout:0/723: dwrite d5/d20/d1f/d52/d64/dba/f85 [4194304,4194304] 0 2024-09-19T07:24:59.251 INFO:tasks.workunit.client.0.smithi098.stdout:4/604: creat da/d59/fcf x:0 0 0 2024-09-19T07:24:59.251 INFO:tasks.workunit.client.0.smithi098.stdout:1/729: dwrite dc/d17/d1b/d1d/d30/f59 [0,4194304] 0 2024-09-19T07:24:59.252 INFO:tasks.workunit.client.0.smithi098.stdout:3/603: rename de/d4e/d6d/c9e to de/d4e/d6d/d8c/cb3 0 2024-09-19T07:24:59.255 INFO:tasks.workunit.client.0.smithi098.stdout:8/617: creat d0/d33/d44/dbe/fc8 x:0 0 0 2024-09-19T07:24:59.257 INFO:tasks.workunit.client.0.smithi098.stdout:0/724: getdents d5/d20/d1f/d47/db2/dbf/d6d 0 2024-09-19T07:24:59.259 INFO:tasks.workunit.client.0.smithi098.stdout:4/605: creat da/d31/d46/d56/d5b/d66/fd0 x:0 0 0 2024-09-19T07:24:59.260 INFO:tasks.workunit.client.0.smithi098.stdout:4/606: mknod da/d31/d46/d5f/d8a/db6/dc2/cd1 0 2024-09-19T07:24:59.261 INFO:tasks.workunit.client.0.smithi098.stdout:4/607: symlink da/d31/d46/d5f/d8a/db6/dc2/ld2 0 2024-09-19T07:24:59.262 INFO:tasks.workunit.client.0.smithi098.stdout:3/604: dread de/df/d31/f5c [0,4194304] 0 2024-09-19T07:24:59.262 INFO:tasks.workunit.client.0.smithi098.stdout:3/605: chown de/df/d31/d61/d3f/f7a 278926153 1 2024-09-19T07:24:59.262 INFO:tasks.workunit.client.0.smithi098.stdout:1/730: creat dc/d17/ffb x:0 0 0 2024-09-19T07:24:59.262 INFO:tasks.workunit.client.0.smithi098.stdout:1/731: write dc/de/d22/fbb [127942,2767] 0 2024-09-19T07:24:59.264 INFO:tasks.workunit.client.0.smithi098.stdout:4/608: rename da/d31/f49 to da/d31/d46/fd3 0 2024-09-19T07:24:59.264 INFO:tasks.workunit.client.0.smithi098.stdout:4/609: chown da/l4f 6 1 2024-09-19T07:24:59.264 INFO:tasks.workunit.client.0.smithi098.stdout:4/610: stat da/l27 0 2024-09-19T07:24:59.264 INFO:tasks.workunit.client.0.smithi098.stdout:8/618: mknod d0/d33/d55/d8a/d12/dba/cc9 0 2024-09-19T07:24:59.265 INFO:tasks.workunit.client.0.smithi098.stdout:8/619: write d0/d33/d55/d8a/f27 [4912214,42847] 0 2024-09-19T07:24:59.265 INFO:tasks.workunit.client.0.smithi098.stdout:1/732: link dc/de/d22/d31/lb5 dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/lfc 0 2024-09-19T07:24:59.267 INFO:tasks.workunit.client.0.smithi098.stdout:4/611: getdents da/d31/d46/d5f 0 2024-09-19T07:24:59.267 INFO:tasks.workunit.client.0.smithi098.stdout:4/612: chown da/d31/d46/d56/la6 116 1 2024-09-19T07:24:59.267 INFO:tasks.workunit.client.0.smithi098.stdout:7/751: dwrite d5/d8/dc/f9b [0,4194304] 0 2024-09-19T07:24:59.268 INFO:tasks.workunit.client.0.smithi098.stdout:0/725: mknod d5/d20/d1f/d52/d64/d77/ce4 0 2024-09-19T07:24:59.270 INFO:tasks.workunit.client.0.smithi098.stdout:2/666: fsync d1/d5/d34/f3d 0 2024-09-19T07:24:59.273 INFO:tasks.workunit.client.0.smithi098.stdout:4/613: dread da/f2a [0,4194304] 0 2024-09-19T07:24:59.273 INFO:tasks.workunit.client.0.smithi098.stdout:4/614: fdatasync da/f28 0 2024-09-19T07:24:59.273 INFO:tasks.workunit.client.0.smithi098.stdout:4/615: chown da/d59/d5d/f68 24 1 2024-09-19T07:24:59.274 INFO:tasks.workunit.client.0.smithi098.stdout:1/733: creat dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/db1/ffd x:0 0 0 2024-09-19T07:24:59.274 INFO:tasks.workunit.client.0.smithi098.stdout:7/752: mkdir d5/d10/dc2/dbd/dfc 0 2024-09-19T07:24:59.279 INFO:tasks.workunit.client.0.smithi098.stdout:1/734: dread dc/de/d22/d31/d5d/d6a/d6f/f56 [0,4194304] 0 2024-09-19T07:24:59.279 INFO:tasks.workunit.client.0.smithi098.stdout:1/735: write dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/ddd/ff2 [394395,40713] 0 2024-09-19T07:24:59.282 INFO:tasks.workunit.client.0.smithi098.stdout:4/616: dread da/f28 [4194304,4194304] 0 2024-09-19T07:24:59.282 INFO:tasks.workunit.client.0.smithi098.stdout:4/617: dread - da/d31/d46/d5f/d8a/fc4 zero size 2024-09-19T07:24:59.282 INFO:tasks.workunit.client.0.smithi098.stdout:2/667: mknod d1/d5/d34/d5a/db2/ce1 0 2024-09-19T07:24:59.282 INFO:tasks.workunit.client.0.smithi098.stdout:2/668: write d1/d9/f33 [86157,36507] 0 2024-09-19T07:24:59.282 INFO:tasks.workunit.client.0.smithi098.stdout:4/618: symlink da/d31/d46/ld4 0 2024-09-19T07:24:59.284 INFO:tasks.workunit.client.0.smithi098.stdout:4/619: creat da/d7e/fd5 x:0 0 0 2024-09-19T07:24:59.285 INFO:tasks.workunit.client.0.smithi098.stdout:3/606: dwrite de/df/f15 [0,4194304] 0 2024-09-19T07:24:59.285 INFO:tasks.workunit.client.0.smithi098.stdout:4/620: symlink da/d31/d46/d5f/ld6 0 2024-09-19T07:24:59.286 INFO:tasks.workunit.client.0.smithi098.stdout:1/736: dread dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/fb6 [4194304,4194304] 0 2024-09-19T07:24:59.288 INFO:tasks.workunit.client.0.smithi098.stdout:8/620: getdents d0/d33/d44/dbe 0 2024-09-19T07:24:59.288 INFO:tasks.workunit.client.0.smithi098.stdout:2/669: rename d1/d9/d3e/d41/d60/fdd to d1/d5/fe2 0 2024-09-19T07:24:59.288 INFO:tasks.workunit.client.0.smithi098.stdout:8/621: chown d0/cbc 6856 1 2024-09-19T07:24:59.288 INFO:tasks.workunit.client.0.smithi098.stdout:3/607: symlink de/df/d1f/lb4 0 2024-09-19T07:24:59.288 INFO:tasks.workunit.client.0.smithi098.stdout:3/608: readlink de/l49 0 2024-09-19T07:24:59.290 INFO:tasks.workunit.client.0.smithi098.stdout:2/670: creat d1/dbf/fe3 x:0 0 0 2024-09-19T07:24:59.291 INFO:tasks.workunit.client.0.smithi098.stdout:3/609: creat de/df/d31/d61/d79/fb5 x:0 0 0 2024-09-19T07:24:59.292 INFO:tasks.workunit.client.0.smithi098.stdout:2/671: creat d1/dcb/fe4 x:0 0 0 2024-09-19T07:24:59.292 INFO:tasks.workunit.client.0.smithi098.stdout:3/610: getdents de/df/d1f/d72 0 2024-09-19T07:24:59.294 INFO:tasks.workunit.client.0.smithi098.stdout:4/621: rename da/d31/d46/fbe to da/d31/d46/d5f/fd7 0 2024-09-19T07:24:59.294 INFO:tasks.workunit.client.0.smithi098.stdout:1/737: creat dc/de/d22/d31/d5d/d6a/d6f/ffe x:0 0 0 2024-09-19T07:24:59.295 INFO:tasks.workunit.client.0.smithi098.stdout:1/738: creat dc/de/d22/d31/d5d/d6a/de0/fff x:0 0 0 2024-09-19T07:24:59.296 INFO:tasks.workunit.client.0.smithi098.stdout:1/739: chown dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/lad 3 1 2024-09-19T07:24:59.297 INFO:tasks.workunit.client.0.smithi098.stdout:1/740: rmdir dc/d2a/df5 0 2024-09-19T07:24:59.297 INFO:tasks.workunit.client.0.smithi098.stdout:1/741: chown dc/de/d22/d31/c3a 32 1 2024-09-19T07:24:59.297 INFO:tasks.workunit.client.0.smithi098.stdout:1/742: chown dc 121991929 1 2024-09-19T07:24:59.298 INFO:tasks.workunit.client.0.smithi098.stdout:1/743: rmdir dc/d17 39 2024-09-19T07:24:59.298 INFO:tasks.workunit.client.0.smithi098.stdout:1/744: readlink dc/de/d22/d31/d5d/d6a/d6f/d4d/l77 0 2024-09-19T07:24:59.298 INFO:tasks.workunit.client.0.smithi098.stdout:1/745: write dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/ddd/ff2 [771604,60520] 0 2024-09-19T07:24:59.299 INFO:tasks.workunit.client.0.smithi098.stdout:1/746: link dc/de/d22/d31/fb4 dc/de/d50/d6c/ddb/f100 0 2024-09-19T07:24:59.299 INFO:tasks.workunit.client.0.smithi098.stdout:1/747: write dc/de/d22/d31/d5d/d6a/d6f/d5f/fb8 [90693,109392] 0 2024-09-19T07:24:59.300 INFO:tasks.workunit.client.0.smithi098.stdout:1/748: creat dc/de/d22/d31/d5d/d6a/d6f/f101 x:0 0 0 2024-09-19T07:24:59.307 INFO:tasks.workunit.client.0.smithi098.stdout:4/622: dread da/f30 [0,4194304] 0 2024-09-19T07:24:59.308 INFO:tasks.workunit.client.0.smithi098.stdout:0/726: dwrite d5/d20/d1f/d52/d64/f95 [0,4194304] 0 2024-09-19T07:24:59.308 INFO:tasks.workunit.client.0.smithi098.stdout:7/753: dwrite d5/d3e/d62/da0/dc5/fd7 [0,4194304] 0 2024-09-19T07:24:59.308 INFO:tasks.workunit.client.0.smithi098.stdout:2/672: write d1/d9/d26/d35/d58/f25 [184991,82834] 0 2024-09-19T07:24:59.308 INFO:tasks.workunit.client.0.smithi098.stdout:7/754: write d5/d8/dc/d16/f78 [1855266,14256] 0 2024-09-19T07:24:59.308 INFO:tasks.workunit.client.0.smithi098.stdout:7/755: fsync d5/d8/dc/f9b 0 2024-09-19T07:24:59.308 INFO:tasks.workunit.client.0.smithi098.stdout:5/551: dwrite dc/de/d36/f39 [0,4194304] 0 2024-09-19T07:24:59.309 INFO:tasks.workunit.client.0.smithi098.stdout:4/623: rename da/d31/d46/d5f/f75 to da/d31/d46/fd8 0 2024-09-19T07:24:59.309 INFO:tasks.workunit.client.0.smithi098.stdout:4/624: write da/d31/d46/d5f/d8a/fa5 [3036016,80687] 0 2024-09-19T07:24:59.309 INFO:tasks.workunit.client.0.smithi098.stdout:4/625: stat da/d59/d5d/d82 0 2024-09-19T07:24:59.312 INFO:tasks.workunit.client.0.smithi098.stdout:2/673: symlink d1/d5/d34/d80/d93/le5 0 2024-09-19T07:24:59.316 INFO:tasks.workunit.client.0.smithi098.stdout:8/622: dwrite d0/d2c/f66 [0,4194304] 0 2024-09-19T07:24:59.317 INFO:tasks.workunit.client.0.smithi098.stdout:7/756: write d5/d3e/d62/da0/f88 [2687115,8313] 0 2024-09-19T07:24:59.317 INFO:tasks.workunit.client.0.smithi098.stdout:4/626: creat da/d31/d46/d56/d5b/db9/fd9 x:0 0 0 2024-09-19T07:24:59.317 INFO:tasks.workunit.client.0.smithi098.stdout:4/627: write da/d31/d46/d56/d5b/d66/f7a [902591,46185] 0 2024-09-19T07:24:59.318 INFO:tasks.workunit.client.0.smithi098.stdout:4/628: chown da/d31/d46/d80/cba 1 1 2024-09-19T07:24:59.319 INFO:tasks.workunit.client.0.smithi098.stdout:2/674: creat d1/d5/d72/fe6 x:0 0 0 2024-09-19T07:24:59.319 INFO:tasks.workunit.client.0.smithi098.stdout:4/629: creat da/d31/d46/d5f/d8a/db6/dc9/fda x:0 0 0 2024-09-19T07:24:59.320 INFO:tasks.workunit.client.0.smithi098.stdout:8/623: getdents d0/d16/d65 0 2024-09-19T07:24:59.321 INFO:tasks.workunit.client.0.smithi098.stdout:4/630: link da/d31/l4e da/d31/d46/d5f/ldb 0 2024-09-19T07:24:59.322 INFO:tasks.workunit.client.0.smithi098.stdout:7/757: mknod d5/d10/d50/dad/cfd 0 2024-09-19T07:24:59.324 INFO:tasks.workunit.client.0.smithi098.stdout:2/675: creat d1/d5/d72/db5/dad/fe7 x:0 0 0 2024-09-19T07:24:59.326 INFO:tasks.workunit.client.0.smithi098.stdout:8/624: link d0/d2c/d81/cae d0/d33/cca 0 2024-09-19T07:24:59.326 INFO:tasks.workunit.client.0.smithi098.stdout:8/625: stat d0/d33/d55/d8a/d21/d50/f6f 0 2024-09-19T07:24:59.326 INFO:tasks.workunit.client.0.smithi098.stdout:8/626: write d0/d16/f3a [1974385,79083] 0 2024-09-19T07:24:59.331 INFO:tasks.workunit.client.0.smithi098.stdout:7/758: write d5/d10/d1d/f39 [899208,93105] 0 2024-09-19T07:24:59.333 INFO:tasks.workunit.client.0.smithi098.stdout:7/759: mknod d5/d3e/d62/cfe 0 2024-09-19T07:24:59.337 INFO:tasks.workunit.client.0.smithi098.stdout:0/727: dwrite d5/d20/f41 [4194304,4194304] 0 2024-09-19T07:24:59.338 INFO:tasks.workunit.client.0.smithi098.stdout:5/552: dwrite dc/f79 [0,4194304] 0 2024-09-19T07:24:59.338 INFO:tasks.workunit.client.0.smithi098.stdout:8/627: dread d0/d33/f6e [0,4194304] 0 2024-09-19T07:24:59.338 INFO:tasks.workunit.client.0.smithi098.stdout:8/628: truncate d0/d1a/f3b 2694538 0 2024-09-19T07:24:59.338 INFO:tasks.workunit.client.0.smithi098.stdout:8/629: chown d0/d33/d55/d8a/d12/d6c/c72 55366 1 2024-09-19T07:24:59.339 INFO:tasks.workunit.client.0.smithi098.stdout:0/728: mkdir d5/d20/d1f/d47/db2/dbf/de5 0 2024-09-19T07:24:59.341 INFO:tasks.workunit.client.0.smithi098.stdout:5/553: getdents dc/de/d13/d5c/da2 0 2024-09-19T07:24:59.341 INFO:tasks.workunit.client.0.smithi098.stdout:4/631: getdents da/d31/d46/d56 0 2024-09-19T07:24:59.342 INFO:tasks.workunit.client.0.smithi098.stdout:5/554: link dc/de/d13/d46/d2e/d37/d6d/l8c dc/de/d13/d46/d2e/d37/d67/d75/lb1 0 2024-09-19T07:24:59.343 INFO:tasks.workunit.client.0.smithi098.stdout:0/729: creat d5/d20/d1f/d52/d64/d77/d79/d92/fe6 x:0 0 0 2024-09-19T07:24:59.343 INFO:tasks.workunit.client.0.smithi098.stdout:0/730: fsync d5/d20/d1f/d47/db2/dbf/d6d/f9b 0 2024-09-19T07:24:59.343 INFO:tasks.workunit.client.0.smithi098.stdout:4/632: creat da/d31/d46/fdc x:0 0 0 2024-09-19T07:24:59.346 INFO:tasks.workunit.client.0.smithi098.stdout:0/731: dread d5/f3d [0,4194304] 0 2024-09-19T07:24:59.347 INFO:tasks.workunit.client.0.smithi098.stdout:2/676: dwrite d1/d9/d3e/d41/d60/dbe/fc7 [0,4194304] 0 2024-09-19T07:24:59.348 INFO:tasks.workunit.client.0.smithi098.stdout:5/555: creat dc/de/d13/d5c/daf/fb2 x:0 0 0 2024-09-19T07:24:59.349 INFO:tasks.workunit.client.0.smithi098.stdout:8/630: dread d0/d33/d55/d8a/f27 [0,4194304] 0 2024-09-19T07:24:59.351 INFO:tasks.workunit.client.0.smithi098.stdout:2/677: creat d1/d9/d26/fe8 x:0 0 0 2024-09-19T07:24:59.353 INFO:tasks.workunit.client.0.smithi098.stdout:8/631: rmdir d0/d33/d55 39 2024-09-19T07:24:59.355 INFO:tasks.workunit.client.0.smithi098.stdout:7/760: dwrite d5/d10/f3f [0,4194304] 0 2024-09-19T07:24:59.355 INFO:tasks.workunit.client.0.smithi098.stdout:8/632: creat d0/d16/d65/d9a/fcb x:0 0 0 2024-09-19T07:24:59.356 INFO:tasks.workunit.client.0.smithi098.stdout:8/633: write d0/f5 [4894208,20461] 0 2024-09-19T07:24:59.357 INFO:tasks.workunit.client.0.smithi098.stdout:0/732: write d5/d20/d1f/d52/d64/d77/d79/d94/f99 [3062366,45177] 0 2024-09-19T07:24:59.361 INFO:tasks.workunit.client.0.smithi098.stdout:7/761: mkdir d5/d10/d1d/dff 0 2024-09-19T07:24:59.361 INFO:tasks.workunit.client.0.smithi098.stdout:7/762: rename d5/d10/d50 to d5/d10/d50/df8/d100 22 2024-09-19T07:24:59.361 INFO:tasks.workunit.client.0.smithi098.stdout:7/763: readlink d5/d10/l57 0 2024-09-19T07:24:59.362 INFO:tasks.workunit.client.0.smithi098.stdout:0/733: link d5/d20/d1f/d52/d64/c67 d5/d20/d14/d49/d62/ce7 0 2024-09-19T07:24:59.362 INFO:tasks.workunit.client.0.smithi098.stdout:0/734: chown d5/d20/d14/d49/cdb 13 1 2024-09-19T07:24:59.363 INFO:tasks.workunit.client.0.smithi098.stdout:0/735: link d5/d20/d14/f4a d5/d20/d1f/d47/db2/dbf/d6d/fe8 0 2024-09-19T07:24:59.364 INFO:tasks.workunit.client.0.smithi098.stdout:0/736: symlink d5/d20/d1f/de2/le9 0 2024-09-19T07:24:59.365 INFO:tasks.workunit.client.0.smithi098.stdout:5/556: dwrite dc/f87 [0,4194304] 0 2024-09-19T07:24:59.365 INFO:tasks.workunit.client.0.smithi098.stdout:5/557: chown dc/de/c28 1 1 2024-09-19T07:24:59.365 INFO:tasks.workunit.client.0.smithi098.stdout:0/737: mkdir d5/d20/d1f/d52/d64/dba/dd2/dea 0 2024-09-19T07:24:59.368 INFO:tasks.workunit.client.0.smithi098.stdout:0/738: creat d5/d20/d1f/d52/d64/dcc/feb x:0 0 0 2024-09-19T07:24:59.369 INFO:tasks.workunit.client.0.smithi098.stdout:8/634: dread d0/dc5/f51 [0,4194304] 0 2024-09-19T07:24:59.369 INFO:tasks.workunit.client.0.smithi098.stdout:0/739: mknod d5/d20/d1f/d52/d64/d77/d79/cec 0 2024-09-19T07:24:59.372 INFO:tasks.workunit.client.0.smithi098.stdout:0/740: link d5/d20/d1f/d47/db2/dbf/d6d/cc0 d5/d20/d1f/d52/d64/da0/ced 0 2024-09-19T07:24:59.372 INFO:tasks.workunit.client.0.smithi098.stdout:0/741: write d5/d20/d1f/d52/d64/fc3 [379039,93238] 0 2024-09-19T07:24:59.388 INFO:tasks.workunit.client.0.smithi098.stdout:0/742: dread d5/f7 [4194304,4194304] 0 2024-09-19T07:24:59.388 INFO:tasks.workunit.client.0.smithi098.stdout:7/764: dwrite d5/d10/dc2/dbd/fcf [0,4194304] 0 2024-09-19T07:24:59.388 INFO:tasks.workunit.client.0.smithi098.stdout:7/765: fdatasync d5/d3e/d62/f7a 0 2024-09-19T07:24:59.388 INFO:tasks.workunit.client.0.smithi098.stdout:7/766: truncate d5/d10/dc2/dbd/fcf 4816566 0 2024-09-19T07:24:59.389 INFO:tasks.workunit.client.0.smithi098.stdout:8/635: dwrite d0/d16/f23 [0,4194304] 0 2024-09-19T07:24:59.389 INFO:tasks.workunit.client.0.smithi098.stdout:0/743: link d5/l34 d5/d20/d1f/d52/d64/lee 0 2024-09-19T07:24:59.390 INFO:tasks.workunit.client.0.smithi098.stdout:8/636: dread d0/f7e [0,4194304] 0 2024-09-19T07:24:59.391 INFO:tasks.workunit.client.0.smithi098.stdout:8/637: mkdir d0/d16/d7d/dcc 0 2024-09-19T07:24:59.391 INFO:tasks.workunit.client.0.smithi098.stdout:9/666: sync 2024-09-19T07:24:59.391 INFO:tasks.workunit.client.0.smithi098.stdout:6/636: sync 2024-09-19T07:24:59.395 INFO:tasks.workunit.client.0.smithi098.stdout:8/638: getdents d0 0 2024-09-19T07:24:59.395 INFO:tasks.workunit.client.0.smithi098.stdout:8/639: chown d0/c8 64994530 1 2024-09-19T07:24:59.397 INFO:tasks.workunit.client.0.smithi098.stdout:7/767: read d5/d10/dc2/dbd/fef [3332163,21148] 0 2024-09-19T07:24:59.398 INFO:tasks.workunit.client.0.smithi098.stdout:7/768: mknod d5/d8/d52/db6/dc9/c101 0 2024-09-19T07:24:59.405 INFO:tasks.workunit.client.0.smithi098.stdout:9/667: dread d3/dc/df/d15/d2f/f4b [0,4194304] 0 2024-09-19T07:24:59.406 INFO:tasks.workunit.client.0.smithi098.stdout:9/668: mknod d3/d16/d43/d51/dd3/dc1/ce0 0 2024-09-19T07:24:59.408 INFO:tasks.workunit.client.0.smithi098.stdout:9/669: creat d3/d16/d43/d51/dd3/dc1/fe1 x:0 0 0 2024-09-19T07:24:59.420 INFO:tasks.workunit.client.0.smithi098.stdout:6/637: dwrite d2/d5/d1f/d26/d42/d48/d53/d64/d6d/f75 [0,4194304] 0 2024-09-19T07:24:59.421 INFO:tasks.workunit.client.0.smithi098.stdout:0/744: dwrite d5/d20/d1f/d8d/fc7 [0,4194304] 0 2024-09-19T07:24:59.422 INFO:tasks.workunit.client.0.smithi098.stdout:0/745: write d5/d20/d1f/d52/fa3 [421333,7346] 0 2024-09-19T07:24:59.423 INFO:tasks.workunit.client.0.smithi098.stdout:8/640: dwrite d0/d33/d44/dbe/fc8 [0,4194304] 0 2024-09-19T07:24:59.426 INFO:tasks.workunit.client.0.smithi098.stdout:0/746: truncate d5/fc5 2332259 0 2024-09-19T07:24:59.430 INFO:tasks.workunit.client.0.smithi098.stdout:8/641: rename d0/dc5/f76 to d0/d16/fcd 0 2024-09-19T07:24:59.430 INFO:tasks.workunit.client.0.smithi098.stdout:8/642: read - d0/d33/d44/fb1 zero size 2024-09-19T07:24:59.430 INFO:tasks.workunit.client.0.smithi098.stdout:0/747: symlink d5/d20/d1f/d52/d64/d77/d79/d94/lef 0 2024-09-19T07:24:59.433 INFO:tasks.workunit.client.0.smithi098.stdout:0/748: symlink d5/d20/d1f/d52/d64/lf0 0 2024-09-19T07:24:59.433 INFO:tasks.workunit.client.0.smithi098.stdout:0/749: write d5/d20/d1f/d52/d64/da0/fdc [594860,66603] 0 2024-09-19T07:24:59.433 INFO:tasks.workunit.client.0.smithi098.stdout:9/670: dwrite d3/d16/d43/d51/f6d [4194304,4194304] 0 2024-09-19T07:24:59.433 INFO:tasks.workunit.client.0.smithi098.stdout:7/769: dwrite d5/d3e/d62/da0/ff3 [0,4194304] 0 2024-09-19T07:24:59.433 INFO:tasks.workunit.client.0.smithi098.stdout:7/770: write d5/d8/dc/d16/f2e [5003620,32819] 0 2024-09-19T07:24:59.434 INFO:tasks.workunit.client.0.smithi098.stdout:0/750: creat d5/d20/d1f/d52/d64/d77/d79/ff1 x:0 0 0 2024-09-19T07:24:59.434 INFO:tasks.workunit.client.0.smithi098.stdout:0/751: chown d5/d20/d14/c4d 1889408 1 2024-09-19T07:24:59.434 INFO:tasks.workunit.client.0.smithi098.stdout:0/752: readlink d5/d20/d14/d49/d62/l68 0 2024-09-19T07:24:59.436 INFO:tasks.workunit.client.0.smithi098.stdout:9/671: symlink d3/d16/d43/d51/dd3/le2 0 2024-09-19T07:24:59.438 INFO:tasks.workunit.client.0.smithi098.stdout:7/771: creat d5/d10/f102 x:0 0 0 2024-09-19T07:24:59.440 INFO:tasks.workunit.client.0.smithi098.stdout:0/753: unlink d5/d20/d14/l28 0 2024-09-19T07:24:59.441 INFO:tasks.workunit.client.0.smithi098.stdout:0/754: write d5/d20/d1f/d47/db2/dbf/f89 [203119,9880] 0 2024-09-19T07:24:59.442 INFO:tasks.workunit.client.0.smithi098.stdout:7/772: getdents d5/d10/dc2/dbd 0 2024-09-19T07:24:59.443 INFO:tasks.workunit.client.0.smithi098.stdout:0/755: mkdir d5/d20/d1f/d52/d64/dba/dd2/dea/df2 0 2024-09-19T07:24:59.443 INFO:tasks.workunit.client.0.smithi098.stdout:0/756: write d5/d20/d1f/d52/d64/d77/d79/f7c [963717,1079] 0 2024-09-19T07:24:59.445 INFO:tasks.workunit.client.0.smithi098.stdout:7/773: mkdir d5/d3e/d103 0 2024-09-19T07:24:59.445 INFO:tasks.workunit.client.0.smithi098.stdout:7/774: readlink d5/d8/dc/d16/l2b 0 2024-09-19T07:24:59.446 INFO:tasks.workunit.client.0.smithi098.stdout:7/775: write d5/dce/dd6/fe5 [820856,12606] 0 2024-09-19T07:24:59.446 INFO:tasks.workunit.client.0.smithi098.stdout:0/757: mknod d5/d20/d14/dd9/cf3 0 2024-09-19T07:24:59.448 INFO:tasks.workunit.client.0.smithi098.stdout:6/638: dwrite d2/db0/f4f [0,4194304] 0 2024-09-19T07:24:59.448 INFO:tasks.workunit.client.0.smithi098.stdout:0/758: link d5/d20/l36 d5/d20/d1f/d52/d64/d77/d79/d92/lf4 0 2024-09-19T07:24:59.451 INFO:tasks.workunit.client.0.smithi098.stdout:9/672: write d3/d6/d46/d83/da9/fc8 [2928935,6883] 0 2024-09-19T07:24:59.451 INFO:tasks.workunit.client.0.smithi098.stdout:9/673: fdatasync d3/dc/df/d15/fb8 0 2024-09-19T07:24:59.451 INFO:tasks.workunit.client.0.smithi098.stdout:8/643: dwrite d0/d16/f94 [0,4194304] 0 2024-09-19T07:24:59.451 INFO:tasks.workunit.client.0.smithi098.stdout:7/776: dread d5/d3e/d62/da0/fc4 [0,4194304] 0 2024-09-19T07:24:59.455 INFO:tasks.workunit.client.0.smithi098.stdout:0/759: dread d5/f1e [0,4194304] 0 2024-09-19T07:24:59.456 INFO:tasks.workunit.client.0.smithi098.stdout:9/674: mknod d3/dc/df/d15/d1a/d2b/d49/d65/ce3 0 2024-09-19T07:24:59.458 INFO:tasks.workunit.client.0.smithi098.stdout:8/644: unlink d0/d33/d55/d8a/d21/d50/l59 0 2024-09-19T07:24:59.458 INFO:tasks.workunit.client.0.smithi098.stdout:8/645: chown d0/d33/d55/d8a/f75 621 1 2024-09-19T07:24:59.458 INFO:tasks.workunit.client.0.smithi098.stdout:8/646: chown d0/d16/f23 389993 1 2024-09-19T07:24:59.459 INFO:tasks.workunit.client.0.smithi098.stdout:7/777: creat d5/d10/d11/d9e/dee/f104 x:0 0 0 2024-09-19T07:24:59.460 INFO:tasks.workunit.client.0.smithi098.stdout:7/778: readlink d5/l75 0 2024-09-19T07:24:59.460 INFO:tasks.workunit.client.0.smithi098.stdout:6/639: rmdir d2/d1b 39 2024-09-19T07:24:59.462 INFO:tasks.workunit.client.0.smithi098.stdout:6/640: rename d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/cdc to d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/ceb 0 2024-09-19T07:24:59.462 INFO:tasks.workunit.client.0.smithi098.stdout:0/760: rename d5/d20/d14/d49/d62/ce7 to d5/d20/d1f/d47/cf5 0 2024-09-19T07:24:59.463 INFO:tasks.workunit.client.0.smithi098.stdout:9/675: truncate d3/d6/f91 625135 0 2024-09-19T07:24:59.465 INFO:tasks.workunit.client.0.smithi098.stdout:8/647: link d0/d2c/f5e d0/d16/d7d/fce 0 2024-09-19T07:24:59.465 INFO:tasks.workunit.client.0.smithi098.stdout:8/648: dread - d0/d33/d44/fb1 zero size 2024-09-19T07:24:59.468 INFO:tasks.workunit.client.0.smithi098.stdout:2/678: sync 2024-09-19T07:24:59.468 INFO:tasks.workunit.client.0.smithi098.stdout:5/558: sync 2024-09-19T07:24:59.468 INFO:tasks.workunit.client.0.smithi098.stdout:4/633: sync 2024-09-19T07:24:59.468 INFO:tasks.workunit.client.0.smithi098.stdout:1/749: sync 2024-09-19T07:24:59.468 INFO:tasks.workunit.client.0.smithi098.stdout:3/611: sync 2024-09-19T07:24:59.468 INFO:tasks.workunit.client.0.smithi098.stdout:2/679: stat d1/d9/f2a 0 2024-09-19T07:24:59.468 INFO:tasks.workunit.client.0.smithi098.stdout:2/680: fdatasync d1/d9/d3e/d41/d60/fbb 0 2024-09-19T07:24:59.468 INFO:tasks.workunit.client.0.smithi098.stdout:1/750: truncate dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f48 1090289 0 2024-09-19T07:24:59.473 INFO:tasks.workunit.client.0.smithi098.stdout:7/779: getdents d5/d10/d50 0 2024-09-19T07:24:59.473 INFO:tasks.workunit.client.0.smithi098.stdout:9/676: symlink d3/dc/df/d15/d1a/d2b/d49/d50/le4 0 2024-09-19T07:24:59.474 INFO:tasks.workunit.client.0.smithi098.stdout:5/559: creat dc/fb3 x:0 0 0 2024-09-19T07:24:59.474 INFO:tasks.workunit.client.0.smithi098.stdout:9/677: stat d3/dc/df/d15/d1a/d2d/c32 0 2024-09-19T07:24:59.474 INFO:tasks.workunit.client.0.smithi098.stdout:9/678: dread - d3/d16/d43/d51/dd3/d7e/f8e zero size 2024-09-19T07:24:59.482 INFO:tasks.workunit.client.0.smithi098.stdout:0/761: dwrite d5/d20/d1f/d52/d64/d77/d79/d92/fe6 [0,4194304] 0 2024-09-19T07:24:59.485 INFO:tasks.workunit.client.0.smithi098.stdout:6/641: dread d2/d5/d1f/d26/d42/d48/d53/f5f [0,4194304] 0 2024-09-19T07:24:59.486 INFO:tasks.workunit.client.0.smithi098.stdout:0/762: creat d5/d20/d1f/d52/d64/dba/dd2/dea/ff6 x:0 0 0 2024-09-19T07:24:59.486 INFO:tasks.workunit.client.0.smithi098.stdout:1/751: dread dc/de/d22/d31/f5b [0,4194304] 0 2024-09-19T07:24:59.486 INFO:tasks.workunit.client.0.smithi098.stdout:1/752: dread - dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/ffa zero size 2024-09-19T07:24:59.487 INFO:tasks.workunit.client.0.smithi098.stdout:6/642: creat d2/d5/d1f/d26/d42/d48/fec x:0 0 0 2024-09-19T07:24:59.488 INFO:tasks.workunit.client.0.smithi098.stdout:6/643: stat d2/d5/d1f/d26/d42/d48/d53/c5b 0 2024-09-19T07:24:59.488 INFO:tasks.workunit.client.0.smithi098.stdout:6/644: dread - d2/d11/daa/fb1 zero size 2024-09-19T07:24:59.488 INFO:tasks.workunit.client.0.smithi098.stdout:6/645: chown d2/d5/d1f/d26/d42/d48/dc3 112232 1 2024-09-19T07:24:59.488 INFO:tasks.workunit.client.0.smithi098.stdout:1/753: mknod dc/de/d50/d6c/c102 0 2024-09-19T07:24:59.488 INFO:tasks.workunit.client.0.smithi098.stdout:6/646: mknod d2/d5/d1f/d26/d7b/da3/ced 0 2024-09-19T07:24:59.488 INFO:tasks.workunit.client.0.smithi098.stdout:6/647: fdatasync d2/d5/d1f/d26/d42/d48/fce 0 2024-09-19T07:24:59.489 INFO:tasks.workunit.client.0.smithi098.stdout:1/754: creat dc/d17/d1b/d1d/d30/f103 x:0 0 0 2024-09-19T07:24:59.489 INFO:tasks.workunit.client.0.smithi098.stdout:1/755: chown dc/d17/d1b/d1d/d3d/dc4 3488203 1 2024-09-19T07:24:59.495 INFO:tasks.workunit.client.0.smithi098.stdout:5/560: dread dc/de/d13/d46/d2e/d37/f43 [0,4194304] 0 2024-09-19T07:24:59.495 INFO:tasks.workunit.client.0.smithi098.stdout:1/756: mknod dc/de/d22/d31/d5d/d6a/d6f/c104 0 2024-09-19T07:24:59.495 INFO:tasks.workunit.client.0.smithi098.stdout:1/757: write dc/de/d22/d31/f5b [3065279,76153] 0 2024-09-19T07:24:59.496 INFO:tasks.workunit.client.0.smithi098.stdout:1/758: write dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f4e [4432638,20284] 0 2024-09-19T07:24:59.496 INFO:tasks.workunit.client.0.smithi098.stdout:1/759: dread - dc/de/d22/d31/d5d/d6a/d6f/d4d/dc6/fe5 zero size 2024-09-19T07:24:59.496 INFO:tasks.workunit.client.0.smithi098.stdout:5/561: creat dc/de/d13/d46/d2e/d37/d67/d99/fb4 x:0 0 0 2024-09-19T07:24:59.496 INFO:tasks.workunit.client.0.smithi098.stdout:8/649: dwrite d0/f5 [4194304,4194304] 0 2024-09-19T07:24:59.498 INFO:tasks.workunit.client.0.smithi098.stdout:8/650: mkdir d0/d1a/dcf 0 2024-09-19T07:24:59.498 INFO:tasks.workunit.client.0.smithi098.stdout:8/651: write d0/d33/d55/d8a/d21/d3c/f52 [1011825,119123] 0 2024-09-19T07:24:59.499 INFO:tasks.workunit.client.0.smithi098.stdout:8/652: symlink d0/d16/d61/ld0 0 2024-09-19T07:24:59.501 INFO:tasks.workunit.client.0.smithi098.stdout:8/653: link d0/d33/d55/l93 d0/d33/d55/d8a/d12/dba/ld1 0 2024-09-19T07:24:59.502 INFO:tasks.workunit.client.0.smithi098.stdout:8/654: mkdir d0/d16/d7d/dcc/dd2 0 2024-09-19T07:24:59.504 INFO:tasks.workunit.client.0.smithi098.stdout:0/763: write d5/d20/d1f/d52/d64/d77/d79/fd6 [56587,65778] 0 2024-09-19T07:24:59.504 INFO:tasks.workunit.client.0.smithi098.stdout:8/655: symlink d0/d33/d55/d8a/d21/ld3 0 2024-09-19T07:24:59.509 INFO:tasks.workunit.client.0.smithi098.stdout:4/634: dwrite da/f4b [0,4194304] 0 2024-09-19T07:24:59.510 INFO:tasks.workunit.client.0.smithi098.stdout:2/681: dwrite d1/d9/d3e/d41/d60/da5/dd9/f30 [0,4194304] 0 2024-09-19T07:24:59.510 INFO:tasks.workunit.client.0.smithi098.stdout:2/682: stat d1/d9/d3e/d41/d60/fbb 0 2024-09-19T07:24:59.512 INFO:tasks.workunit.client.0.smithi098.stdout:2/683: rmdir d1/d9/d3e/d41/d60/dbe 39 2024-09-19T07:24:59.515 INFO:tasks.workunit.client.0.smithi098.stdout:9/679: dwrite d3/dc/df/d15/f28 [0,4194304] 0 2024-09-19T07:24:59.516 INFO:tasks.workunit.client.0.smithi098.stdout:9/680: dread - d3/dc/df/d15/d1a/d2b/d49/d55/fd9 zero size 2024-09-19T07:24:59.517 INFO:tasks.workunit.client.0.smithi098.stdout:9/681: dread d3/d16/f57 [0,4194304] 0 2024-09-19T07:24:59.519 INFO:tasks.workunit.client.0.smithi098.stdout:2/684: link d1/d9/fba d1/d9/d3e/d41/d60/da5/dd9/fe9 0 2024-09-19T07:24:59.519 INFO:tasks.workunit.client.0.smithi098.stdout:2/685: fdatasync d1/d5/d72/db5/f8e 0 2024-09-19T07:24:59.520 INFO:tasks.workunit.client.0.smithi098.stdout:2/686: chown d1/d5/d34/f7c 2488 1 2024-09-19T07:24:59.520 INFO:tasks.workunit.client.0.smithi098.stdout:2/687: readlink d1/d5/d34/d80/d93/le5 0 2024-09-19T07:24:59.520 INFO:tasks.workunit.client.0.smithi098.stdout:4/635: dread da/d31/d46/d80/f99 [0,4194304] 0 2024-09-19T07:24:59.520 INFO:tasks.workunit.client.0.smithi098.stdout:4/636: chown da/d31/l4e 106766 1 2024-09-19T07:24:59.525 INFO:tasks.workunit.client.0.smithi098.stdout:9/682: mknod d3/d30/d73/ce5 0 2024-09-19T07:24:59.526 INFO:tasks.workunit.client.0.smithi098.stdout:3/612: rename de/df/d31/d61/d69/f90 to de/df/d1f/fb6 0 2024-09-19T07:24:59.526 INFO:tasks.workunit.client.0.smithi098.stdout:3/613: chown de/d4e/f50 0 1 2024-09-19T07:24:59.527 INFO:tasks.workunit.client.0.smithi098.stdout:9/683: mkdir d3/d16/d43/d51/dd3/de6 0 2024-09-19T07:24:59.528 INFO:tasks.workunit.client.0.smithi098.stdout:6/648: dwrite d2/d5/d1f/d26/f33 [4194304,4194304] 0 2024-09-19T07:24:59.528 INFO:tasks.workunit.client.0.smithi098.stdout:6/649: fdatasync d2/d11/fb4 0 2024-09-19T07:24:59.528 INFO:tasks.workunit.client.0.smithi098.stdout:6/650: stat d2/db0/d4e/d6e/cd8 0 2024-09-19T07:24:59.528 INFO:tasks.workunit.client.0.smithi098.stdout:6/651: write d2/d11/fb4 [4194897,63453] 0 2024-09-19T07:24:59.528 INFO:tasks.workunit.client.0.smithi098.stdout:2/688: dread d1/d9/d26/d35/d58/f12 [4194304,4194304] 0 2024-09-19T07:24:59.530 INFO:tasks.workunit.client.0.smithi098.stdout:7/780: rename d5/d10/d1d/fc1 to d5/d10/d11/f105 0 2024-09-19T07:24:59.531 INFO:tasks.workunit.client.0.smithi098.stdout:2/689: mknod d1/d9/d26/d35/d48/ddf/cea 0 2024-09-19T07:24:59.531 INFO:tasks.workunit.client.0.smithi098.stdout:2/690: chown d1/d9/f1b 18 1 2024-09-19T07:24:59.531 INFO:tasks.workunit.client.0.smithi098.stdout:2/691: chown d1/d9/d26/d5c/f9c 2 1 2024-09-19T07:24:59.531 INFO:tasks.workunit.client.0.smithi098.stdout:0/764: dwrite d5/d20/d1f/d52/d64/d77/d79/d92/fda [0,4194304] 0 2024-09-19T07:24:59.535 INFO:tasks.workunit.client.0.smithi098.stdout:7/781: getdents d5/d10/dc2/d5c 0 2024-09-19T07:24:59.535 INFO:tasks.workunit.client.0.smithi098.stdout:7/782: stat d5/d8/d52/db6/dc9/c101 0 2024-09-19T07:24:59.537 INFO:tasks.workunit.client.0.smithi098.stdout:3/614: write de/df/d31/d61/f4c [3960093,56383] 0 2024-09-19T07:24:59.541 INFO:tasks.workunit.client.0.smithi098.stdout:6/652: write d2/d5/f62 [1443333,27126] 0 2024-09-19T07:24:59.541 INFO:tasks.workunit.client.0.smithi098.stdout:4/637: dwrite da/d31/d46/d5f/fd7 [0,4194304] 0 2024-09-19T07:24:59.541 INFO:tasks.workunit.client.0.smithi098.stdout:6/653: read d2/f1a [256916,79624] 0 2024-09-19T07:24:59.541 INFO:tasks.workunit.client.0.smithi098.stdout:4/638: dread - da/fc7 zero size 2024-09-19T07:24:59.541 INFO:tasks.workunit.client.0.smithi098.stdout:4/639: fsync da/d31/d46/d56/d5b/f69 0 2024-09-19T07:24:59.541 INFO:tasks.workunit.client.0.smithi098.stdout:4/640: chown da/d31/d46/l70 3550 1 2024-09-19T07:24:59.541 INFO:tasks.workunit.client.0.smithi098.stdout:4/641: write da/d31/d46/d56/fa0 [1026863,12298] 0 2024-09-19T07:24:59.541 INFO:tasks.workunit.client.0.smithi098.stdout:6/654: write d2/f58 [8624201,46825] 0 2024-09-19T07:24:59.541 INFO:tasks.workunit.client.0.smithi098.stdout:6/655: write d2/d11/f2a [9261300,97557] 0 2024-09-19T07:24:59.543 INFO:tasks.workunit.client.0.smithi098.stdout:0/765: mkdir d5/d20/d1f/d52/d64/d77/d79/d92/df7 0 2024-09-19T07:24:59.544 INFO:tasks.workunit.client.0.smithi098.stdout:0/766: read d5/f46 [273511,37904] 0 2024-09-19T07:24:59.545 INFO:tasks.workunit.client.0.smithi098.stdout:0/767: dread d5/d20/d14/d49/f72 [0,4194304] 0 2024-09-19T07:24:59.547 INFO:tasks.workunit.client.0.smithi098.stdout:0/768: rmdir d5/d20/d1f/d47/dae 39 2024-09-19T07:24:59.549 INFO:tasks.workunit.client.0.smithi098.stdout:6/656: mknod d2/d1b/cee 0 2024-09-19T07:24:59.550 INFO:tasks.workunit.client.0.smithi098.stdout:6/657: symlink d2/d5/d1f/d26/d42/lef 0 2024-09-19T07:24:59.550 INFO:tasks.workunit.client.0.smithi098.stdout:5/562: rename dc/de/d13/d46/d2e/d37/d81/f3c to dc/de/d36/d71/d84/fb5 0 2024-09-19T07:24:59.551 INFO:tasks.workunit.client.0.smithi098.stdout:6/658: getdents d2/d5/d1f/d26/d42/d48 0 2024-09-19T07:24:59.562 INFO:tasks.workunit.client.0.smithi098.stdout:9/684: dwrite d3/dc/df/d15/d1a/d2d/f42 [4194304,4194304] 0 2024-09-19T07:24:59.564 INFO:tasks.workunit.client.0.smithi098.stdout:1/760: link dc/d17/d1b/l5e dc/de/d22/d31/d5d/d6a/de0/l105 0 2024-09-19T07:24:59.565 INFO:tasks.workunit.client.0.smithi098.stdout:9/685: creat d3/dc/df/d15/db3/fe7 x:0 0 0 2024-09-19T07:24:59.565 INFO:tasks.workunit.client.0.smithi098.stdout:9/686: truncate d3/dc/df/d15/d1a/d2b/fd5 555345 0 2024-09-19T07:24:59.565 INFO:tasks.workunit.client.0.smithi098.stdout:5/563: write dc/de/d13/f21 [118699,123735] 0 2024-09-19T07:24:59.565 INFO:tasks.workunit.client.0.smithi098.stdout:2/692: dwrite d1/d9/d26/d5c/f9c [0,4194304] 0 2024-09-19T07:24:59.567 INFO:tasks.workunit.client.0.smithi098.stdout:1/761: dread dc/de/d22/fbb [0,4194304] 0 2024-09-19T07:24:59.567 INFO:tasks.workunit.client.0.smithi098.stdout:1/762: truncate dc/d2a/f67 2002218 0 2024-09-19T07:24:59.567 INFO:tasks.workunit.client.0.smithi098.stdout:1/763: fsync dc/de/d22/f4b 0 2024-09-19T07:24:59.571 INFO:tasks.workunit.client.0.smithi098.stdout:5/564: dread dc/de/d13/d46/d2e/d37/d81/d6a/f7c [0,4194304] 0 2024-09-19T07:24:59.572 INFO:tasks.workunit.client.0.smithi098.stdout:2/693: mkdir d1/d9/d26/d35/d88/deb 0 2024-09-19T07:24:59.572 INFO:tasks.workunit.client.0.smithi098.stdout:2/694: creat d1/d9/d26/d35/d88/fec x:0 0 0 2024-09-19T07:24:59.573 INFO:tasks.workunit.client.0.smithi098.stdout:2/695: write d1/d9/d3e/d41/fd5 [724433,10387] 0 2024-09-19T07:24:59.574 INFO:tasks.workunit.client.0.smithi098.stdout:2/696: truncate d1/d5/d34/d80/d93/f66 4161330 0 2024-09-19T07:24:59.575 INFO:tasks.workunit.client.0.smithi098.stdout:2/697: unlink d1/d9/d1d/d8c/cab 0 2024-09-19T07:24:59.575 INFO:tasks.workunit.client.0.smithi098.stdout:2/698: write d1/d9/d26/d35/d91/f94 [1295418,97340] 0 2024-09-19T07:24:59.577 INFO:tasks.workunit.client.0.smithi098.stdout:2/699: link d1/d5/c6f d1/d5/d34/ced 0 2024-09-19T07:24:59.577 INFO:tasks.workunit.client.0.smithi098.stdout:2/700: write d1/d9/f2d [1048877,67937] 0 2024-09-19T07:24:59.580 INFO:tasks.workunit.client.0.smithi098.stdout:0/769: dwrite d5/d20/d1f/d52/d64/d77/fa9 [0,4194304] 0 2024-09-19T07:24:59.585 INFO:tasks.workunit.client.0.smithi098.stdout:7/783: dwrite d5/d10/fcd [0,4194304] 0 2024-09-19T07:24:59.585 INFO:tasks.workunit.client.0.smithi098.stdout:7/784: write d5/d3e/d61/fca [1017182,10357] 0 2024-09-19T07:24:59.585 INFO:tasks.workunit.client.0.smithi098.stdout:7/785: write d5/d8/d52/db6/fd1 [487637,121227] 0 2024-09-19T07:24:59.585 INFO:tasks.workunit.client.0.smithi098.stdout:7/786: write d5/d10/d11/d9e/dee/f104 [148205,31386] 0 2024-09-19T07:24:59.585 INFO:tasks.workunit.client.0.smithi098.stdout:6/659: dwrite d2/db0/d4e/d6e/d9d/d94/fe7 [0,4194304] 0 2024-09-19T07:24:59.585 INFO:tasks.workunit.client.0.smithi098.stdout:6/660: readlink d2/d5/d1f/d26/d7b/l90 0 2024-09-19T07:24:59.586 INFO:tasks.workunit.client.0.smithi098.stdout:7/787: dread d5/d3e/d62/da0/fc4 [0,4194304] 0 2024-09-19T07:24:59.586 INFO:tasks.workunit.client.0.smithi098.stdout:7/788: chown d5/d10/d50/fb5 506 1 2024-09-19T07:24:59.586 INFO:tasks.workunit.client.0.smithi098.stdout:7/789: write d5/d3e/d62/f7a [1238911,7389] 0 2024-09-19T07:24:59.586 INFO:tasks.workunit.client.0.smithi098.stdout:7/790: dread - d5/d10/dc2/d5c/ff7 zero size 2024-09-19T07:24:59.588 INFO:tasks.workunit.client.0.smithi098.stdout:0/770: write d5/fc5 [3726,59532] 0 2024-09-19T07:24:59.588 INFO:tasks.workunit.client.0.smithi098.stdout:0/771: fsync d5/d20/d1f/d52/d64/d77/d79/f9e 0 2024-09-19T07:24:59.591 INFO:tasks.workunit.client.0.smithi098.stdout:4/642: mknod da/d31/d46/d5f/d8a/db6/dc2/cdd 0 2024-09-19T07:24:59.591 INFO:tasks.workunit.client.0.smithi098.stdout:4/643: chown da/d31/d46/d5f/l87 11042 1 2024-09-19T07:24:59.591 INFO:tasks.workunit.client.0.smithi098.stdout:0/772: dread f4 [0,4194304] 0 2024-09-19T07:24:59.593 INFO:tasks.workunit.client.0.smithi098.stdout:4/644: mknod da/d31/d46/d5f/d8a/db6/dc2/cde 0 2024-09-19T07:24:59.594 INFO:tasks.workunit.client.0.smithi098.stdout:4/645: rmdir da/d31/d46/d5f/d8a/db6 39 2024-09-19T07:24:59.594 INFO:tasks.workunit.client.0.smithi098.stdout:4/646: fsync da/f1d 0 2024-09-19T07:24:59.594 INFO:tasks.workunit.client.0.smithi098.stdout:4/647: chown da 368 1 2024-09-19T07:24:59.595 INFO:tasks.workunit.client.0.smithi098.stdout:4/648: write da/d31/d46/d56/d5b/d61/fb7 [761383,56114] 0 2024-09-19T07:24:59.595 INFO:tasks.workunit.client.0.smithi098.stdout:4/649: unlink da/d31/d46/fd3 0 2024-09-19T07:24:59.597 INFO:tasks.workunit.client.0.smithi098.stdout:7/791: creat d5/d3e/d61/f106 x:0 0 0 2024-09-19T07:24:59.597 INFO:tasks.workunit.client.0.smithi098.stdout:3/615: rename de/df/d1f/d2b/l41 to de/df/d31/d61/d3f/lb7 0 2024-09-19T07:24:59.599 INFO:tasks.workunit.client.0.smithi098.stdout:0/773: symlink d5/d20/d1f/d47/db2/dbf/d6d/lf8 0 2024-09-19T07:24:59.599 INFO:tasks.workunit.client.0.smithi098.stdout:5/565: dwrite dc/de/d13/d46/f3e [4194304,4194304] 0 2024-09-19T07:24:59.600 INFO:tasks.workunit.client.0.smithi098.stdout:6/661: rename d2/d1b/lc8 to d2/d5/d1f/lf0 0 2024-09-19T07:24:59.600 INFO:tasks.workunit.client.0.smithi098.stdout:2/701: dwrite d1/d9/d3e/d41/d60/da5/dd9/fe9 [0,4194304] 0 2024-09-19T07:24:59.601 INFO:tasks.workunit.client.0.smithi098.stdout:2/702: dread - d1/dcb/fe4 zero size 2024-09-19T07:24:59.601 INFO:tasks.workunit.client.0.smithi098.stdout:2/703: chown d1/d9/d1d/d8c/cc1 0 1 2024-09-19T07:24:59.601 INFO:tasks.workunit.client.0.smithi098.stdout:2/704: readlink d1/d5/d34/d80/d93/d61/l6c 0 2024-09-19T07:24:59.601 INFO:tasks.workunit.client.0.smithi098.stdout:2/705: chown d1/d9/d1d/l9e 10 1 2024-09-19T07:24:59.601 INFO:tasks.workunit.client.0.smithi098.stdout:5/566: truncate dc/de/d13/d5c/da2/f86 776411 0 2024-09-19T07:24:59.606 INFO:tasks.workunit.client.0.smithi098.stdout:9/687: dwrite d3/dc/df/d15/d1a/d2d/f3a [0,4194304] 0 2024-09-19T07:24:59.613 INFO:tasks.workunit.client.0.smithi098.stdout:5/567: symlink dc/de/d36/d71/lb6 0 2024-09-19T07:24:59.613 INFO:tasks.workunit.client.0.smithi098.stdout:8/656: sync 2024-09-19T07:24:59.617 INFO:tasks.workunit.client.0.smithi098.stdout:0/774: link d5/f4f d5/d20/d1f/d52/d64/ff9 0 2024-09-19T07:24:59.617 INFO:tasks.workunit.client.0.smithi098.stdout:0/775: chown d5/d20/d1f/d52/d9f 6506486 1 2024-09-19T07:24:59.618 INFO:tasks.workunit.client.0.smithi098.stdout:5/568: creat dc/de/d13/d5c/da2/fb7 x:0 0 0 2024-09-19T07:24:59.619 INFO:tasks.workunit.client.0.smithi098.stdout:8/657: creat d0/d33/d55/d8a/d21/d50/d9e/da4/db9/fd4 x:0 0 0 2024-09-19T07:24:59.620 INFO:tasks.workunit.client.0.smithi098.stdout:8/658: chown d0/fb5 43 1 2024-09-19T07:24:59.620 INFO:tasks.workunit.client.0.smithi098.stdout:8/659: chown d0/d16/l6a 2639379 1 2024-09-19T07:24:59.620 INFO:tasks.workunit.client.0.smithi098.stdout:2/706: mknod d1/d9/d1d/cee 0 2024-09-19T07:24:59.621 INFO:tasks.workunit.client.0.smithi098.stdout:2/707: chown d1/d9/d3e 23362 1 2024-09-19T07:24:59.621 INFO:tasks.workunit.client.0.smithi098.stdout:3/616: write de/df/d1f/d2b/f3a [2390896,33765] 0 2024-09-19T07:24:59.621 INFO:tasks.workunit.client.0.smithi098.stdout:3/617: getdents de/df 0 2024-09-19T07:24:59.622 INFO:tasks.workunit.client.0.smithi098.stdout:0/776: truncate d5/d20/d1f/d52/d64/d77/d79/f9e 3110169 0 2024-09-19T07:24:59.622 INFO:tasks.workunit.client.0.smithi098.stdout:5/569: readlink dc/de/d13/d46/d2e/d37/d81/l80 0 2024-09-19T07:24:59.623 INFO:tasks.workunit.client.0.smithi098.stdout:4/650: dwrite da/d31/d46/d56/d5b/db9/fcc [0,4194304] 0 2024-09-19T07:24:59.623 INFO:tasks.workunit.client.0.smithi098.stdout:4/651: fdatasync da/d31/d46/d56/d5b/d61/fa8 0 2024-09-19T07:24:59.623 INFO:tasks.workunit.client.0.smithi098.stdout:4/652: truncate da/d59/f86 9095125 0 2024-09-19T07:24:59.624 INFO:tasks.workunit.client.0.smithi098.stdout:8/660: mknod d0/d16/d7d/dcc/cd5 0 2024-09-19T07:24:59.624 INFO:tasks.workunit.client.0.smithi098.stdout:4/653: mkdir da/d31/d46/d80/ddf 0 2024-09-19T07:24:59.625 INFO:tasks.workunit.client.0.smithi098.stdout:2/708: mknod d1/d9/d3e/cef 0 2024-09-19T07:24:59.627 INFO:tasks.workunit.client.0.smithi098.stdout:0/777: rename d5/d20/l2a to d5/d20/d1f/d52/d64/d77/d79/d94/lfa 0 2024-09-19T07:24:59.629 INFO:tasks.workunit.client.0.smithi098.stdout:8/661: creat d0/d16/d65/fd6 x:0 0 0 2024-09-19T07:24:59.629 INFO:tasks.workunit.client.0.smithi098.stdout:6/662: dwrite d2/db0/d4e/d6e/d9d/d94/fa0 [0,4194304] 0 2024-09-19T07:24:59.629 INFO:tasks.workunit.client.0.smithi098.stdout:6/663: chown d2/d5/d1f/d26/d7b/de0/cea 3842 1 2024-09-19T07:24:59.630 INFO:tasks.workunit.client.0.smithi098.stdout:7/792: dwrite d5/d10/dc2/d5c/fdc [0,4194304] 0 2024-09-19T07:24:59.630 INFO:tasks.workunit.client.0.smithi098.stdout:7/793: chown d5/d8/dc/d16/f84 28 1 2024-09-19T07:24:59.630 INFO:tasks.workunit.client.0.smithi098.stdout:2/709: link d1/d9/d3e/d41/d60/da5/fc4 d1/d9/d26/d35/d88/deb/ff0 0 2024-09-19T07:24:59.632 INFO:tasks.workunit.client.0.smithi098.stdout:0/778: creat d5/d20/d1f/ffb x:0 0 0 2024-09-19T07:24:59.632 INFO:tasks.workunit.client.0.smithi098.stdout:9/688: dwrite d3/d16/f3e [0,4194304] 0 2024-09-19T07:24:59.633 INFO:tasks.workunit.client.0.smithi098.stdout:3/618: dread de/f1a [0,4194304] 0 2024-09-19T07:24:59.633 INFO:tasks.workunit.client.0.smithi098.stdout:8/662: getdents d0/d33/d55/d8a/d28 0 2024-09-19T07:24:59.639 INFO:tasks.workunit.client.0.smithi098.stdout:6/664: dread d2/db0/d4e/d6e/d9d/d94/fa0 [0,4194304] 0 2024-09-19T07:24:59.640 INFO:tasks.workunit.client.0.smithi098.stdout:2/710: symlink d1/d9/d26/d35/d48/ddf/lf1 0 2024-09-19T07:24:59.640 INFO:tasks.workunit.client.0.smithi098.stdout:2/711: truncate d1/d5/fe0 322051 0 2024-09-19T07:24:59.641 INFO:tasks.workunit.client.0.smithi098.stdout:2/712: chown d1/d9/d26/d35/c89 2745 1 2024-09-19T07:24:59.641 INFO:tasks.workunit.client.0.smithi098.stdout:6/665: creat d2/d5/ff1 x:0 0 0 2024-09-19T07:24:59.642 INFO:tasks.workunit.client.0.smithi098.stdout:6/666: write d2/db0/d8d/fdd [570662,65026] 0 2024-09-19T07:24:59.642 INFO:tasks.workunit.client.0.smithi098.stdout:4/654: write f8 [3226091,76283] 0 2024-09-19T07:24:59.642 INFO:tasks.workunit.client.0.smithi098.stdout:7/794: dread d5/f40 [0,4194304] 0 2024-09-19T07:24:59.643 INFO:tasks.workunit.client.0.smithi098.stdout:0/779: creat d5/d20/d1f/d47/dae/ffc x:0 0 0 2024-09-19T07:24:59.643 INFO:tasks.workunit.client.0.smithi098.stdout:0/780: fsync d5/d20/d1f/d8d/f9c 0 2024-09-19T07:24:59.644 INFO:tasks.workunit.client.0.smithi098.stdout:3/619: getdents de/df/d31/d61/d79 0 2024-09-19T07:24:59.645 INFO:tasks.workunit.client.0.smithi098.stdout:8/663: mknod d0/d16/d7d/cd7 0 2024-09-19T07:24:59.646 INFO:tasks.workunit.client.0.smithi098.stdout:8/664: write d0/d33/d55/d8a/d21/d50/d9e/da4/faf [250839,18074] 0 2024-09-19T07:24:59.646 INFO:tasks.workunit.client.0.smithi098.stdout:8/665: truncate d0/d33/d55/d8a/d21/d50/d9e/da4/db9/fd4 306440 0 2024-09-19T07:24:59.648 INFO:tasks.workunit.client.0.smithi098.stdout:4/655: symlink da/d31/d46/d56/d5b/db9/le0 0 2024-09-19T07:24:59.649 INFO:tasks.workunit.client.0.smithi098.stdout:0/781: creat d5/d20/d1f/d52/d64/d77/ffd x:0 0 0 2024-09-19T07:24:59.650 INFO:tasks.workunit.client.0.smithi098.stdout:4/656: unlink da/d31/d46/d5f/fb8 0 2024-09-19T07:24:59.651 INFO:tasks.workunit.client.0.smithi098.stdout:3/620: rename de/df/d31/d61/d3f/l5a to de/d4e/d6d/dad/lb8 0 2024-09-19T07:24:59.651 INFO:tasks.workunit.client.0.smithi098.stdout:7/795: write d5/d10/fcd [1207571,45421] 0 2024-09-19T07:24:59.652 INFO:tasks.workunit.client.0.smithi098.stdout:8/666: mkdir d0/d16/d65/dd8 0 2024-09-19T07:24:59.653 INFO:tasks.workunit.client.0.smithi098.stdout:4/657: dread da/d31/d46/d56/d5b/d63/f67 [0,4194304] 0 2024-09-19T07:24:59.653 INFO:tasks.workunit.client.0.smithi098.stdout:0/782: symlink d5/d20/d1f/d47/lfe 0 2024-09-19T07:24:59.653 INFO:tasks.workunit.client.0.smithi098.stdout:0/783: chown d5/d20/d1f/d47/db2/dbf/d6d/f9b 6 1 2024-09-19T07:24:59.654 INFO:tasks.workunit.client.0.smithi098.stdout:4/658: creat da/d31/dc5/fe1 x:0 0 0 2024-09-19T07:24:59.655 INFO:tasks.workunit.client.0.smithi098.stdout:3/621: creat de/df/d31/d61/d3f/fb9 x:0 0 0 2024-09-19T07:24:59.655 INFO:tasks.workunit.client.0.smithi098.stdout:3/622: getdents de/d4e/d6d/d8c/dab 0 2024-09-19T07:24:59.655 INFO:tasks.workunit.client.0.smithi098.stdout:3/623: write de/df/d16/f9f [457786,36916] 0 2024-09-19T07:24:59.655 INFO:tasks.workunit.client.0.smithi098.stdout:3/624: readlink de/df/d31/d61/l33 0 2024-09-19T07:24:59.655 INFO:tasks.workunit.client.0.smithi098.stdout:8/667: creat d0/d33/d55/fd9 x:0 0 0 2024-09-19T07:24:59.656 INFO:tasks.workunit.client.0.smithi098.stdout:3/625: creat de/df/d1f/d72/fba x:0 0 0 2024-09-19T07:24:59.657 INFO:tasks.workunit.client.0.smithi098.stdout:0/784: unlink d5/d20/d1f/d52/d9f/fd5 0 2024-09-19T07:24:59.657 INFO:tasks.workunit.client.0.smithi098.stdout:0/785: chown d5/d20/l36 69 1 2024-09-19T07:24:59.660 INFO:tasks.workunit.client.0.smithi098.stdout:0/786: truncate d5/d20/d14/fdd 4012490 0 2024-09-19T07:24:59.662 INFO:tasks.workunit.client.0.smithi098.stdout:0/787: unlink d5/d20/d14/d49/l53 0 2024-09-19T07:24:59.662 INFO:tasks.workunit.client.0.smithi098.stdout:0/788: chown d5/c13 7456426 1 2024-09-19T07:24:59.663 INFO:tasks.workunit.client.0.smithi098.stdout:0/789: chown d5/f31 4 1 2024-09-19T07:24:59.663 INFO:tasks.workunit.client.0.smithi098.stdout:0/790: write d5/f3e [1269288,71230] 0 2024-09-19T07:24:59.663 INFO:tasks.workunit.client.0.smithi098.stdout:0/791: truncate d5/f31 937680 0 2024-09-19T07:24:59.664 INFO:tasks.workunit.client.0.smithi098.stdout:8/668: write d0/d33/d55/d8a/f5f [1044202,41174] 0 2024-09-19T07:24:59.666 INFO:tasks.workunit.client.0.smithi098.stdout:0/792: creat d5/d20/d1f/d47/db2/dd3/fff x:0 0 0 2024-09-19T07:24:59.669 INFO:tasks.workunit.client.0.smithi098.stdout:8/669: rmdir d0/d16/dc2 0 2024-09-19T07:24:59.669 INFO:tasks.workunit.client.0.smithi098.stdout:3/626: truncate de/df/d1f/d2b/f3a 1005036 0 2024-09-19T07:24:59.669 INFO:tasks.workunit.client.0.smithi098.stdout:3/627: truncate de/df/d1f/fb6 1023243 0 2024-09-19T07:24:59.671 INFO:tasks.workunit.client.0.smithi098.stdout:0/793: creat d5/d20/d1f/d52/f100 x:0 0 0 2024-09-19T07:24:59.673 INFO:tasks.workunit.client.0.smithi098.stdout:3/628: mknod de/df/d31/d61/d69/cbb 0 2024-09-19T07:24:59.673 INFO:tasks.workunit.client.0.smithi098.stdout:3/629: fdatasync de/df/d1f/f99 0 2024-09-19T07:24:59.675 INFO:tasks.workunit.client.0.smithi098.stdout:8/670: write d0/f4e [3334070,66912] 0 2024-09-19T07:24:59.675 INFO:tasks.workunit.client.0.smithi098.stdout:0/794: mkdir d5/d20/d1f/d52/d101 0 2024-09-19T07:24:59.675 INFO:tasks.workunit.client.0.smithi098.stdout:4/659: rename da/d31/d46/d5f/f92 to da/d31/d46/d5f/d8a/db6/dc2/fe2 0 2024-09-19T07:24:59.676 INFO:tasks.workunit.client.0.smithi098.stdout:1/764: sync 2024-09-19T07:24:59.680 INFO:tasks.workunit.client.0.smithi098.stdout:8/671: link d0/d2c/f67 d0/d33/fda 0 2024-09-19T07:24:59.682 INFO:tasks.workunit.client.0.smithi098.stdout:0/795: rename d5/d20/d1f/d52/d64/d77/fa9 to d5/d20/d1f/d47/db2/dd3/f102 0 2024-09-19T07:24:59.682 INFO:tasks.workunit.client.0.smithi098.stdout:3/630: write de/df/f53 [10680287,78215] 0 2024-09-19T07:24:59.682 INFO:tasks.workunit.client.0.smithi098.stdout:3/631: fdatasync de/df/d31/f3d 0 2024-09-19T07:24:59.682 INFO:tasks.workunit.client.0.smithi098.stdout:3/632: truncate de/df/d31/d61/d3f/fb9 528807 0 2024-09-19T07:24:59.683 INFO:tasks.workunit.client.0.smithi098.stdout:1/765: mknod dc/d17/d1b/d71/d81/c106 0 2024-09-19T07:24:59.684 INFO:tasks.workunit.client.0.smithi098.stdout:8/672: rmdir d0/d16/d7d 39 2024-09-19T07:24:59.684 INFO:tasks.workunit.client.0.smithi098.stdout:8/673: fdatasync d0/d33/d55/d8a/d21/d50/d9e/da4/fc4 0 2024-09-19T07:24:59.685 INFO:tasks.workunit.client.0.smithi098.stdout:0/796: write d5/d20/d1f/d52/d64/da0/fbc [138408,66538] 0 2024-09-19T07:24:59.686 INFO:tasks.workunit.client.0.smithi098.stdout:3/633: symlink de/df/d31/d61/d69/lbc 0 2024-09-19T07:24:59.687 INFO:tasks.workunit.client.0.smithi098.stdout:1/766: dread dc/d17/fc7 [0,4194304] 0 2024-09-19T07:24:59.688 INFO:tasks.workunit.client.0.smithi098.stdout:8/674: truncate d0/d33/d55/d8a/d12/f64 14127 0 2024-09-19T07:24:59.693 INFO:tasks.workunit.client.0.smithi098.stdout:3/634: creat de/df/d31/d61/d79/fbd x:0 0 0 2024-09-19T07:24:59.693 INFO:tasks.workunit.client.0.smithi098.stdout:3/635: stat de/df/d1f/fa0 0 2024-09-19T07:24:59.697 INFO:tasks.workunit.client.0.smithi098.stdout:0/797: write d5/d20/d14/d49/f65 [2370791,125868] 0 2024-09-19T07:24:59.697 INFO:tasks.workunit.client.0.smithi098.stdout:0/798: read d5/d20/d14/d49/d62/da7/fab [346496,85532] 0 2024-09-19T07:24:59.697 INFO:tasks.workunit.client.0.smithi098.stdout:8/675: mknod d0/d33/d55/d8a/d12/cdb 0 2024-09-19T07:24:59.697 INFO:tasks.workunit.client.0.smithi098.stdout:8/676: dread - d0/d33/d55/fd9 zero size 2024-09-19T07:24:59.697 INFO:tasks.workunit.client.0.smithi098.stdout:8/677: chown d0/d33/d55/d8a/d21/d3c/f52 214 1 2024-09-19T07:24:59.698 INFO:tasks.workunit.client.0.smithi098.stdout:4/660: dwrite da/d31/d46/d56/f89 [0,4194304] 0 2024-09-19T07:24:59.699 INFO:tasks.workunit.client.0.smithi098.stdout:4/661: creat da/d31/d46/d5f/d8a/db6/dc9/fe3 x:0 0 0 2024-09-19T07:24:59.699 INFO:tasks.workunit.client.0.smithi098.stdout:4/662: read - da/d31/dc5/fe1 zero size 2024-09-19T07:24:59.699 INFO:tasks.workunit.client.0.smithi098.stdout:4/663: read - da/fc7 zero size 2024-09-19T07:24:59.700 INFO:tasks.workunit.client.0.smithi098.stdout:4/664: fdatasync da/d31/d46/d80/fa3 0 2024-09-19T07:24:59.700 INFO:tasks.workunit.client.0.smithi098.stdout:3/636: mknod de/df/d31/d61/d3f/cbe 0 2024-09-19T07:24:59.700 INFO:tasks.workunit.client.0.smithi098.stdout:4/665: link da/c37 da/d31/d46/d80/ce4 0 2024-09-19T07:24:59.703 INFO:tasks.workunit.client.0.smithi098.stdout:0/799: mknod d5/d20/d1f/d52/d64/d77/d79/d92/c103 0 2024-09-19T07:24:59.704 INFO:tasks.workunit.client.0.smithi098.stdout:1/767: unlink dc/f98 0 2024-09-19T07:24:59.704 INFO:tasks.workunit.client.0.smithi098.stdout:4/666: write da/d31/f40 [52609,128927] 0 2024-09-19T07:24:59.704 INFO:tasks.workunit.client.0.smithi098.stdout:0/800: write d5/fe [4874375,2945] 0 2024-09-19T07:24:59.705 INFO:tasks.workunit.client.0.smithi098.stdout:8/678: creat d0/d33/d55/d8a/d21/d50/fdc x:0 0 0 2024-09-19T07:24:59.709 INFO:tasks.workunit.client.0.smithi098.stdout:4/667: symlink da/le5 0 2024-09-19T07:24:59.709 INFO:tasks.workunit.client.0.smithi098.stdout:4/668: fdatasync da/d59/d5d/d82/f88 0 2024-09-19T07:24:59.709 INFO:tasks.workunit.client.0.smithi098.stdout:1/768: mkdir dc/d17/d1b/d71/d7a/d107 0 2024-09-19T07:24:59.711 INFO:tasks.workunit.client.0.smithi098.stdout:1/769: symlink dc/de/d22/d31/d5d/d6a/d6f/d5f/l108 0 2024-09-19T07:24:59.711 INFO:tasks.workunit.client.0.smithi098.stdout:1/770: chown dc/de/d22/d31/d5d/d6a/d6f/f101 1007066 1 2024-09-19T07:24:59.711 INFO:tasks.workunit.client.0.smithi098.stdout:1/771: read - dc/de/d22/d31/fb4 zero size 2024-09-19T07:24:59.713 INFO:tasks.workunit.client.0.smithi098.stdout:0/801: rename d5/d20/d14/d49/d62/da7/fc4 to d5/d20/d1f/d52/d64/dba/f104 0 2024-09-19T07:24:59.716 INFO:tasks.workunit.client.0.smithi098.stdout:0/802: mkdir d5/d20/d1f/d52/d64/dba/dd2/dea/df2/d105 0 2024-09-19T07:24:59.716 INFO:tasks.workunit.client.0.smithi098.stdout:0/803: fdatasync d5/d20/d1f/d52/d64/d77/d79/fd6 0 2024-09-19T07:24:59.729 INFO:tasks.workunit.client.0.smithi098.stdout:8/679: dwrite d0/d1a/f3b [0,4194304] 0 2024-09-19T07:24:59.730 INFO:tasks.workunit.client.0.smithi098.stdout:8/680: mknod d0/d1a/cdd 0 2024-09-19T07:24:59.730 INFO:tasks.workunit.client.0.smithi098.stdout:0/804: write d5/d20/f39 [1593168,68835] 0 2024-09-19T07:24:59.731 INFO:tasks.workunit.client.0.smithi098.stdout:8/681: mknod d0/d33/d55/d8a/d21/d50/d9e/da4/cde 0 2024-09-19T07:24:59.734 INFO:tasks.workunit.client.0.smithi098.stdout:8/682: creat d0/fdf x:0 0 0 2024-09-19T07:24:59.735 INFO:tasks.workunit.client.0.smithi098.stdout:8/683: rmdir d0/d33 39 2024-09-19T07:24:59.735 INFO:tasks.workunit.client.0.smithi098.stdout:8/684: stat d0/d16/d7d/fa0 0 2024-09-19T07:24:59.736 INFO:tasks.workunit.client.0.smithi098.stdout:8/685: symlink d0/d16/d65/dd8/le0 0 2024-09-19T07:24:59.737 INFO:tasks.workunit.client.0.smithi098.stdout:8/686: symlink d0/d33/le1 0 2024-09-19T07:24:59.737 INFO:tasks.workunit.client.0.smithi098.stdout:8/687: chown d0/d16/fbb 1 1 2024-09-19T07:24:59.737 INFO:tasks.workunit.client.0.smithi098.stdout:8/688: readlink d0/d33/d55/d8a/d12/l13 0 2024-09-19T07:24:59.738 INFO:tasks.workunit.client.0.smithi098.stdout:8/689: mknod d0/d33/d55/d8a/d12/d6c/ce2 0 2024-09-19T07:24:59.738 INFO:tasks.workunit.client.0.smithi098.stdout:8/690: dread - d0/d33/d44/fb1 zero size 2024-09-19T07:24:59.738 INFO:tasks.workunit.client.0.smithi098.stdout:1/772: dwrite dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/fde [0,4194304] 0 2024-09-19T07:24:59.738 INFO:tasks.workunit.client.0.smithi098.stdout:1/773: stat dc/de/d50/ca9 0 2024-09-19T07:24:59.738 INFO:tasks.workunit.client.0.smithi098.stdout:1/774: write dc/de/d22/d31/d5d/d6a/d6f/d5f/f78 [1417080,86361] 0 2024-09-19T07:24:59.739 INFO:tasks.workunit.client.0.smithi098.stdout:1/775: symlink dc/d17/d1b/l109 0 2024-09-19T07:24:59.740 INFO:tasks.workunit.client.0.smithi098.stdout:4/669: dwrite da/d31/d46/d56/fa0 [0,4194304] 0 2024-09-19T07:24:59.740 INFO:tasks.workunit.client.0.smithi098.stdout:4/670: chown da/d31/d46/d56/la6 7758866 1 2024-09-19T07:24:59.755 INFO:tasks.workunit.client.0.smithi098.stdout:5/570: sync 2024-09-19T07:24:59.758 INFO:tasks.workunit.client.0.smithi098.stdout:5/571: mkdir dc/de/d13/d46/d2e/d37/d81/db8 0 2024-09-19T07:24:59.759 INFO:tasks.workunit.client.0.smithi098.stdout:5/572: mkdir dc/de/d13/d5c/daf/db9 0 2024-09-19T07:24:59.761 INFO:tasks.workunit.client.0.smithi098.stdout:5/573: mkdir dc/de/d36/dba 0 2024-09-19T07:24:59.762 INFO:tasks.workunit.client.0.smithi098.stdout:5/574: mknod dc/de/d13/d46/d2e/d37/cbb 0 2024-09-19T07:24:59.763 INFO:tasks.workunit.client.0.smithi098.stdout:5/575: creat dc/de/d13/d46/fbc x:0 0 0 2024-09-19T07:24:59.764 INFO:tasks.workunit.client.0.smithi098.stdout:5/576: symlink dc/de/d13/d46/d2e/d37/d81/db8/lbd 0 2024-09-19T07:24:59.765 INFO:tasks.workunit.client.0.smithi098.stdout:0/805: dwrite d5/d20/d14/f61 [0,4194304] 0 2024-09-19T07:24:59.765 INFO:tasks.workunit.client.0.smithi098.stdout:5/577: chown dc/de/d13/d46/d2e/d37/d81/f56 65 1 2024-09-19T07:24:59.768 INFO:tasks.workunit.client.0.smithi098.stdout:4/671: dwrite da/d31/f45 [0,4194304] 0 2024-09-19T07:24:59.768 INFO:tasks.workunit.client.0.smithi098.stdout:8/691: dwrite d0/dc5/f91 [4194304,4194304] 0 2024-09-19T07:24:59.768 INFO:tasks.workunit.client.0.smithi098.stdout:1/776: dwrite dc/de/fb7 [0,4194304] 0 2024-09-19T07:24:59.771 INFO:tasks.workunit.client.0.smithi098.stdout:5/578: mknod dc/de/d13/d46/d2e/d37/d81/cbe 0 2024-09-19T07:24:59.771 INFO:tasks.workunit.client.0.smithi098.stdout:5/579: write dc/de/d13/d46/d2e/d37/d81/d6a/f76 [5041487,116122] 0 2024-09-19T07:24:59.773 INFO:tasks.workunit.client.0.smithi098.stdout:8/692: mkdir d0/d16/d65/de3 0 2024-09-19T07:24:59.775 INFO:tasks.workunit.client.0.smithi098.stdout:5/580: creat dc/de/d36/d71/fbf x:0 0 0 2024-09-19T07:24:59.776 INFO:tasks.workunit.client.0.smithi098.stdout:0/806: rename d5/d20/d1f/d52/d64/d77/d79 to d5/d20/d1f/d47/db2/dd3/d106 0 2024-09-19T07:24:59.776 INFO:tasks.workunit.client.0.smithi098.stdout:0/807: readlink d5/d20/d1f/l3f 0 2024-09-19T07:24:59.776 INFO:tasks.workunit.client.0.smithi098.stdout:0/808: write d5/d20/d1f/d52/d64/dcc/feb [800670,122146] 0 2024-09-19T07:24:59.777 INFO:tasks.workunit.client.0.smithi098.stdout:8/693: creat d0/dc5/fe4 x:0 0 0 2024-09-19T07:24:59.779 INFO:tasks.workunit.client.0.smithi098.stdout:0/809: truncate d5/d20/d1f/d47/db2/dd3/d106/fd6 900593 0 2024-09-19T07:24:59.782 INFO:tasks.workunit.client.0.smithi098.stdout:5/581: mkdir dc/de/dc0 0 2024-09-19T07:24:59.782 INFO:tasks.workunit.client.0.smithi098.stdout:5/582: getdents dc/de/d13/d5c/daf/db9 0 2024-09-19T07:24:59.784 INFO:tasks.workunit.client.0.smithi098.stdout:0/810: truncate d5/d20/d14/d49/d62/f6e 1559269 0 2024-09-19T07:24:59.784 INFO:tasks.workunit.client.0.smithi098.stdout:8/694: write d0/d16/f17 [7425144,127276] 0 2024-09-19T07:24:59.785 INFO:tasks.workunit.client.0.smithi098.stdout:5/583: mkdir dc/de/d13/d46/d23/dc1 0 2024-09-19T07:24:59.785 INFO:tasks.workunit.client.0.smithi098.stdout:8/695: mknod d0/d16/d61/ce5 0 2024-09-19T07:24:59.786 INFO:tasks.workunit.client.0.smithi098.stdout:8/696: write d0/d33/d55/d8a/d21/d50/f5a [4769,122422] 0 2024-09-19T07:24:59.790 INFO:tasks.workunit.client.0.smithi098.stdout:1/777: rename dc/de/d50/d6c to dc/de/d22/d31/d35/d58/dec/d10a 0 2024-09-19T07:24:59.792 INFO:tasks.workunit.client.0.smithi098.stdout:0/811: rename d5/d20/d14/l66 to d5/l107 0 2024-09-19T07:24:59.793 INFO:tasks.workunit.client.0.smithi098.stdout:1/778: symlink dc/d17/d1b/d1d/d30/l10b 0 2024-09-19T07:24:59.795 INFO:tasks.workunit.client.0.smithi098.stdout:1/779: creat dc/de/d22/d31/d5d/d6a/d6f/d5f/f10c x:0 0 0 2024-09-19T07:24:59.798 INFO:tasks.workunit.client.0.smithi098.stdout:5/584: read dc/de/d13/d46/d23/f5f [4023906,37455] 0 2024-09-19T07:24:59.800 INFO:tasks.workunit.client.0.smithi098.stdout:0/812: dread d5/d20/d14/fdd [0,4194304] 0 2024-09-19T07:24:59.802 INFO:tasks.workunit.client.0.smithi098.stdout:0/813: truncate d5/d20/f12 12205159 0 2024-09-19T07:24:59.802 INFO:tasks.workunit.client.0.smithi098.stdout:0/814: chown d5/d20/d14/d49/d62/da7/db7 16172 1 2024-09-19T07:24:59.802 INFO:tasks.workunit.client.0.smithi098.stdout:0/815: stat d5/d20/d1f/d47/db2/dbf/d6d/cc0 0 2024-09-19T07:24:59.803 INFO:tasks.workunit.client.0.smithi098.stdout:0/816: fsync d5/d20/d14/d49/d62/f6e 0 2024-09-19T07:24:59.803 INFO:tasks.workunit.client.0.smithi098.stdout:0/817: truncate d5/f8f 2752145 0 2024-09-19T07:24:59.805 INFO:tasks.workunit.client.0.smithi098.stdout:0/818: truncate d5/d20/d1f/d47/db2/dbf/d6d/f6f 3431490 0 2024-09-19T07:24:59.806 INFO:tasks.workunit.client.0.smithi098.stdout:0/819: chown d5/d20/d1f/d52/d64/da0/fdc 15454716 1 2024-09-19T07:24:59.806 INFO:tasks.workunit.client.0.smithi098.stdout:0/820: write d5/d20/d1f/d47/fe1 [1885698,91934] 0 2024-09-19T07:24:59.809 INFO:tasks.workunit.client.0.smithi098.stdout:2/713: sync 2024-09-19T07:24:59.809 INFO:tasks.workunit.client.0.smithi098.stdout:9/689: sync 2024-09-19T07:24:59.809 INFO:tasks.workunit.client.0.smithi098.stdout:6/667: sync 2024-09-19T07:24:59.809 INFO:tasks.workunit.client.0.smithi098.stdout:7/796: sync 2024-09-19T07:24:59.809 INFO:tasks.workunit.client.0.smithi098.stdout:7/797: stat d5/d3e/d61/fca 0 2024-09-19T07:24:59.810 INFO:tasks.workunit.client.0.smithi098.stdout:7/798: mknod d5/d8/c107 0 2024-09-19T07:24:59.811 INFO:tasks.workunit.client.0.smithi098.stdout:2/714: write d1/d9/d3e/d41/d60/d65/da0/faf [584585,65654] 0 2024-09-19T07:24:59.811 INFO:tasks.workunit.client.0.smithi098.stdout:2/715: stat d1/d9/d26/d5c/c7d 0 2024-09-19T07:24:59.812 INFO:tasks.workunit.client.0.smithi098.stdout:7/799: creat d5/d10/dc2/d5c/dc3/f108 x:0 0 0 2024-09-19T07:24:59.812 INFO:tasks.workunit.client.0.smithi098.stdout:7/800: write d5/d8/dc/da7/ffb [123393,95583] 0 2024-09-19T07:24:59.812 INFO:tasks.workunit.client.0.smithi098.stdout:7/801: fsync d5/d8/d8e/d59/f63 0 2024-09-19T07:24:59.813 INFO:tasks.workunit.client.0.smithi098.stdout:4/672: link da/d31/l32 da/d31/d46/d56/d5b/d66/le6 0 2024-09-19T07:24:59.813 INFO:tasks.workunit.client.0.smithi098.stdout:2/716: mknod d1/d9/cf2 0 2024-09-19T07:24:59.815 INFO:tasks.workunit.client.0.smithi098.stdout:7/802: mknod d5/d8/d5d/c109 0 2024-09-19T07:24:59.815 INFO:tasks.workunit.client.0.smithi098.stdout:4/673: mkdir da/d31/d46/d5f/d8a/db6/dc2/de7 0 2024-09-19T07:24:59.816 INFO:tasks.workunit.client.0.smithi098.stdout:2/717: truncate d1/d9/d26/d35/d58/f5b 3821044 0 2024-09-19T07:24:59.818 INFO:tasks.workunit.client.0.smithi098.stdout:2/718: creat d1/d9/d3e/d41/d60/ff3 x:0 0 0 2024-09-19T07:24:59.818 INFO:tasks.workunit.client.0.smithi098.stdout:2/719: write d1/d9/d26/d35/f6b [693864,500] 0 2024-09-19T07:24:59.819 INFO:tasks.workunit.client.0.smithi098.stdout:7/803: dread d5/d10/dc2/f96 [0,4194304] 0 2024-09-19T07:24:59.819 INFO:tasks.workunit.client.0.smithi098.stdout:7/804: chown d5/d3e/d103 10 1 2024-09-19T07:24:59.819 INFO:tasks.workunit.client.0.smithi098.stdout:7/805: readlink d5/d10/d11/la1 0 2024-09-19T07:24:59.819 INFO:tasks.workunit.client.0.smithi098.stdout:7/806: dread - d5/d10/dc2/faa zero size 2024-09-19T07:24:59.820 INFO:tasks.workunit.client.0.smithi098.stdout:2/720: mknod d1/d9/d26/d35/d48/d6e/cf4 0 2024-09-19T07:24:59.820 INFO:tasks.workunit.client.0.smithi098.stdout:4/674: symlink da/d31/d46/d56/d5b/d61/le8 0 2024-09-19T07:24:59.821 INFO:tasks.workunit.client.0.smithi098.stdout:4/675: symlink da/d31/d46/d5f/le9 0 2024-09-19T07:24:59.821 INFO:tasks.workunit.client.0.smithi098.stdout:7/807: mknod d5/d10/dc2/d5c/dc3/c10a 0 2024-09-19T07:24:59.822 INFO:tasks.workunit.client.0.smithi098.stdout:2/721: symlink d1/d5/d72/db5/lf5 0 2024-09-19T07:24:59.824 INFO:tasks.workunit.client.0.smithi098.stdout:1/780: link dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/fbf dc/de/d22/d31/d35/d58/dec/f10d 0 2024-09-19T07:24:59.824 INFO:tasks.workunit.client.0.smithi098.stdout:7/808: mkdir d5/d8/d8e/d59/d10b 0 2024-09-19T07:24:59.825 INFO:tasks.workunit.client.0.smithi098.stdout:2/722: symlink d1/dcb/lf6 0 2024-09-19T07:24:59.826 INFO:tasks.workunit.client.0.smithi098.stdout:8/697: dwrite d0/d16/f17 [0,4194304] 0 2024-09-19T07:24:59.827 INFO:tasks.workunit.client.0.smithi098.stdout:7/809: mkdir d5/d10/d11/d9e/dee/d10c 0 2024-09-19T07:24:59.828 INFO:tasks.workunit.client.0.smithi098.stdout:2/723: mknod d1/d9/d26/d35/d88/deb/cf7 0 2024-09-19T07:24:59.831 INFO:tasks.workunit.client.0.smithi098.stdout:8/698: truncate d0/d1a/f49 1530713 0 2024-09-19T07:24:59.832 INFO:tasks.workunit.client.0.smithi098.stdout:1/781: mkdir dc/de/d22/d31/d5d/d6a/d6f/d10e 0 2024-09-19T07:24:59.832 INFO:tasks.workunit.client.0.smithi098.stdout:1/782: truncate dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f4e 4956552 0 2024-09-19T07:24:59.832 INFO:tasks.workunit.client.0.smithi098.stdout:1/783: write dc/de/d22/d31/d35/d4f/fc5 [371791,123079] 0 2024-09-19T07:24:59.832 INFO:tasks.workunit.client.0.smithi098.stdout:8/699: creat d0/d16/d65/dd8/fe6 x:0 0 0 2024-09-19T07:24:59.832 INFO:tasks.workunit.client.0.smithi098.stdout:7/810: rmdir d5/d8/d8e/d59 39 2024-09-19T07:24:59.833 INFO:tasks.workunit.client.0.smithi098.stdout:1/784: mkdir dc/de/d22/d31/d35/d58/d10f 0 2024-09-19T07:24:59.833 INFO:tasks.workunit.client.0.smithi098.stdout:1/785: chown dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/lfc 222624 1 2024-09-19T07:24:59.834 INFO:tasks.workunit.client.0.smithi098.stdout:8/700: link d0/d33/d55/d8a/f75 d0/d2c/fe7 0 2024-09-19T07:24:59.835 INFO:tasks.workunit.client.0.smithi098.stdout:1/786: unlink dc/de/d22/d31/d5d/d6a/d6f/d5f/f78 0 2024-09-19T07:24:59.835 INFO:tasks.workunit.client.0.smithi098.stdout:1/787: readlink dc/d17/d1b/d1d/d3d/l89 0 2024-09-19T07:24:59.835 INFO:tasks.workunit.client.0.smithi098.stdout:7/811: mkdir d5/d10/dc2/d5c/d10d 0 2024-09-19T07:24:59.836 INFO:tasks.workunit.client.0.smithi098.stdout:8/701: symlink d0/d16/d7d/dcc/le8 0 2024-09-19T07:24:59.836 INFO:tasks.workunit.client.0.smithi098.stdout:1/788: truncate dc/d17/d1b/d1d/d3d/dc4/fdf 2703721 0 2024-09-19T07:24:59.837 INFO:tasks.workunit.client.0.smithi098.stdout:1/789: truncate dc/de/d22/fbb 197623 0 2024-09-19T07:24:59.837 INFO:tasks.workunit.client.0.smithi098.stdout:4/676: read da/f3a [3690051,101897] 0 2024-09-19T07:24:59.840 INFO:tasks.workunit.client.0.smithi098.stdout:1/790: dread dc/de/d22/d31/d35/d58/dec/f10d [0,4194304] 0 2024-09-19T07:24:59.843 INFO:tasks.workunit.client.0.smithi098.stdout:5/585: dwrite dc/de/d13/d46/d2e/f33 [0,4194304] 0 2024-09-19T07:24:59.845 INFO:tasks.workunit.client.0.smithi098.stdout:9/690: dwrite d3/d16/d38/f26 [0,4194304] 0 2024-09-19T07:24:59.846 INFO:tasks.workunit.client.0.smithi098.stdout:4/677: write da/d31/d46/d56/d5b/db9/fcc [985290,32614] 0 2024-09-19T07:24:59.847 INFO:tasks.workunit.client.0.smithi098.stdout:7/812: read d5/d8/d52/fc0 [41134,15716] 0 2024-09-19T07:24:59.848 INFO:tasks.workunit.client.0.smithi098.stdout:2/724: read d1/d5/d34/f96 [2112406,79069] 0 2024-09-19T07:24:59.848 INFO:tasks.workunit.client.0.smithi098.stdout:7/813: write d5/d3e/d61/f94 [688888,5631] 0 2024-09-19T07:24:59.848 INFO:tasks.workunit.client.0.smithi098.stdout:5/586: creat dc/de/d13/d46/d2e/fc2 x:0 0 0 2024-09-19T07:24:59.848 INFO:tasks.workunit.client.0.smithi098.stdout:9/691: dread d3/dc/df/d15/d1a/d2b/fd5 [0,4194304] 0 2024-09-19T07:24:59.849 INFO:tasks.workunit.client.0.smithi098.stdout:8/702: write d0/f22 [5203150,115791] 0 2024-09-19T07:24:59.849 INFO:tasks.workunit.client.0.smithi098.stdout:7/814: creat d5/d8/d5d/f10e x:0 0 0 2024-09-19T07:24:59.854 INFO:tasks.workunit.client.0.smithi098.stdout:5/587: creat dc/d6c/fc3 x:0 0 0 2024-09-19T07:24:59.855 INFO:tasks.workunit.client.0.smithi098.stdout:3/637: sync 2024-09-19T07:24:59.855 INFO:tasks.workunit.client.0.smithi098.stdout:3/638: fdatasync de/f25 0 2024-09-19T07:24:59.855 INFO:tasks.workunit.client.0.smithi098.stdout:3/639: fdatasync f4 0 2024-09-19T07:24:59.855 INFO:tasks.workunit.client.0.smithi098.stdout:3/640: chown de/d4e/d6d/dad 113483104 1 2024-09-19T07:24:59.856 INFO:tasks.workunit.client.0.smithi098.stdout:4/678: dread da/d31/d46/d5f/fd7 [0,4194304] 0 2024-09-19T07:24:59.858 INFO:tasks.workunit.client.0.smithi098.stdout:1/791: write dc/de/d22/d31/d5d/d6a/d6f/d5f/f91 [2050258,118560] 0 2024-09-19T07:24:59.859 INFO:tasks.workunit.client.0.smithi098.stdout:0/821: dwrite d5/d20/d1f/d47/db2/dd3/d106/f9e [0,4194304] 0 2024-09-19T07:24:59.861 INFO:tasks.workunit.client.0.smithi098.stdout:4/679: dread da/d31/d46/d56/d5b/d61/fb7 [0,4194304] 0 2024-09-19T07:24:59.864 INFO:tasks.workunit.client.0.smithi098.stdout:1/792: truncate dc/de/fb7 658048 0 2024-09-19T07:24:59.869 INFO:tasks.workunit.client.0.smithi098.stdout:3/641: dread de/df/d1f/d2b/f39 [0,4194304] 0 2024-09-19T07:24:59.870 INFO:tasks.workunit.client.0.smithi098.stdout:2/725: dread d1/d9/d26/d35/d58/f12 [0,4194304] 0 2024-09-19T07:24:59.871 INFO:tasks.workunit.client.0.smithi098.stdout:9/692: dwrite d3/d30/f88 [0,4194304] 0 2024-09-19T07:24:59.873 INFO:tasks.workunit.client.0.smithi098.stdout:3/642: dread de/df/d31/f7d [0,4194304] 0 2024-09-19T07:24:59.873 INFO:tasks.workunit.client.0.smithi098.stdout:2/726: mknod d1/d9/d26/d35/d48/cf8 0 2024-09-19T07:24:59.877 INFO:tasks.workunit.client.0.smithi098.stdout:9/693: mkdir d3/dc/df/d15/d2f/de8 0 2024-09-19T07:24:59.877 INFO:tasks.workunit.client.0.smithi098.stdout:1/793: dread dc/d17/d1b/faa [0,4194304] 0 2024-09-19T07:24:59.877 INFO:tasks.workunit.client.0.smithi098.stdout:1/794: fsync dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/f68 0 2024-09-19T07:24:59.877 INFO:tasks.workunit.client.0.smithi098.stdout:1/795: write dc/d2a/f42 [142157,52234] 0 2024-09-19T07:24:59.878 INFO:tasks.workunit.client.0.smithi098.stdout:2/727: truncate d1/d9/d26/d35/d48/f52 1506126 0 2024-09-19T07:24:59.879 INFO:tasks.workunit.client.0.smithi098.stdout:9/694: creat d3/dc/df/d15/d1a/dc9/fe9 x:0 0 0 2024-09-19T07:24:59.880 INFO:tasks.workunit.client.0.smithi098.stdout:1/796: creat dc/d17/d1b/d71/d81/f110 x:0 0 0 2024-09-19T07:24:59.880 INFO:tasks.workunit.client.0.smithi098.stdout:1/797: stat dc/d17/d1b/d1d/d30/l10b 0 2024-09-19T07:24:59.881 INFO:tasks.workunit.client.0.smithi098.stdout:9/695: rmdir d3/d16/d43 39 2024-09-19T07:24:59.881 INFO:tasks.workunit.client.0.smithi098.stdout:9/696: getdents d3/dc/df/da3 0 2024-09-19T07:24:59.882 INFO:tasks.workunit.client.0.smithi098.stdout:3/643: dread de/df/d31/f7d [0,4194304] 0 2024-09-19T07:24:59.882 INFO:tasks.workunit.client.0.smithi098.stdout:3/644: dread - de/df/d31/d61/d3f/f6f zero size 2024-09-19T07:24:59.883 INFO:tasks.workunit.client.0.smithi098.stdout:3/645: link de/df/d31/d61/d79/f91 de/d4e/d6d/d71/fbf 0 2024-09-19T07:24:59.884 INFO:tasks.workunit.client.0.smithi098.stdout:3/646: symlink de/df/d1f/d2b/lc0 0 2024-09-19T07:24:59.885 INFO:tasks.workunit.client.0.smithi098.stdout:3/647: truncate de/df/f53 7901180 0 2024-09-19T07:24:59.887 INFO:tasks.workunit.client.0.smithi098.stdout:8/703: dwrite d0/d33/fda [0,4194304] 0 2024-09-19T07:24:59.890 INFO:tasks.workunit.client.0.smithi098.stdout:8/704: symlink d0/d1a/dcf/le9 0 2024-09-19T07:24:59.891 INFO:tasks.workunit.client.0.smithi098.stdout:5/588: rename f5 to dc/de/d13/d46/d2e/d62/fc4 0 2024-09-19T07:24:59.892 INFO:tasks.workunit.client.0.smithi098.stdout:2/728: rename d1/d9/d26/d5c/fdb to d1/d5/d72/ff9 0 2024-09-19T07:24:59.893 INFO:tasks.workunit.client.0.smithi098.stdout:9/697: write d3/d16/d38/f26 [3603547,56707] 0 2024-09-19T07:24:59.893 INFO:tasks.workunit.client.0.smithi098.stdout:9/698: chown d3/dc/df/d31/fda 102120605 1 2024-09-19T07:24:59.893 INFO:tasks.workunit.client.0.smithi098.stdout:5/589: creat dc/de/d13/d46/d2e/fc5 x:0 0 0 2024-09-19T07:24:59.893 INFO:tasks.workunit.client.0.smithi098.stdout:5/590: write dc/de/d13/d46/d23/d5e/f97 [1748003,68538] 0 2024-09-19T07:24:59.894 INFO:tasks.workunit.client.0.smithi098.stdout:2/729: creat d1/d5/d34/d80/d93/d61/ffa x:0 0 0 2024-09-19T07:24:59.895 INFO:tasks.workunit.client.0.smithi098.stdout:5/591: creat dc/de/d13/d46/d2e/d37/d81/db8/fc6 x:0 0 0 2024-09-19T07:24:59.896 INFO:tasks.workunit.client.0.smithi098.stdout:5/592: mknod dc/de/d13/cc7 0 2024-09-19T07:24:59.896 INFO:tasks.workunit.client.0.smithi098.stdout:7/815: dwrite d5/f40 [0,4194304] 0 2024-09-19T07:24:59.896 INFO:tasks.workunit.client.0.smithi098.stdout:5/593: write dc/de/f2c [285719,106167] 0 2024-09-19T07:24:59.897 INFO:tasks.workunit.client.0.smithi098.stdout:5/594: chown dc/de/d13/d46/l59 0 1 2024-09-19T07:24:59.897 INFO:tasks.workunit.client.0.smithi098.stdout:4/680: dwrite da/d31/d46/d56/fa0 [0,4194304] 0 2024-09-19T07:24:59.900 INFO:tasks.workunit.client.0.smithi098.stdout:4/681: getdents da/d31/d46/d56/d5b/d66 0 2024-09-19T07:24:59.902 INFO:tasks.workunit.client.0.smithi098.stdout:9/699: dread d3/d16/f3c [4194304,4194304] 0 2024-09-19T07:24:59.904 INFO:tasks.workunit.client.0.smithi098.stdout:9/700: dread d3/d16/f57 [0,4194304] 0 2024-09-19T07:24:59.906 INFO:tasks.workunit.client.0.smithi098.stdout:4/682: symlink da/d31/d46/d56/d5b/d61/lea 0 2024-09-19T07:24:59.907 INFO:tasks.workunit.client.0.smithi098.stdout:4/683: write da/d31/f40 [1981960,29533] 0 2024-09-19T07:24:59.907 INFO:tasks.workunit.client.0.smithi098.stdout:4/684: chown da/d31/d46/d56/d5b/f69 16270 1 2024-09-19T07:24:59.908 INFO:tasks.workunit.client.0.smithi098.stdout:4/685: mkdir da/d59/deb 0 2024-09-19T07:24:59.909 INFO:tasks.workunit.client.0.smithi098.stdout:9/701: creat d3/dc/fea x:0 0 0 2024-09-19T07:24:59.909 INFO:tasks.workunit.client.0.smithi098.stdout:9/702: chown d3/dc/df/d15/db3/fe7 28 1 2024-09-19T07:24:59.909 INFO:tasks.workunit.client.0.smithi098.stdout:9/703: fsync d3/d16/d38/d48/f9d 0 2024-09-19T07:24:59.909 INFO:tasks.workunit.client.0.smithi098.stdout:9/704: dread - d3/d6/d46/d83/fdb zero size 2024-09-19T07:24:59.909 INFO:tasks.workunit.client.0.smithi098.stdout:9/705: fdatasync d3/dc/df/d15/fb8 0 2024-09-19T07:24:59.911 INFO:tasks.workunit.client.0.smithi098.stdout:4/686: unlink da/le 0 2024-09-19T07:24:59.911 INFO:tasks.workunit.client.0.smithi098.stdout:4/687: chown da/d31/d46/d56/d5b/db9/fcc 63006 1 2024-09-19T07:24:59.912 INFO:tasks.workunit.client.0.smithi098.stdout:4/688: write da/d31/d46/d56/d5b/d66/fca [185324,86136] 0 2024-09-19T07:24:59.912 INFO:tasks.workunit.client.0.smithi098.stdout:4/689: creat da/d31/d46/d56/d5b/d61/fec x:0 0 0 2024-09-19T07:24:59.917 INFO:tasks.workunit.client.0.smithi098.stdout:5/595: write dc/de/d13/f7e [1047722,80622] 0 2024-09-19T07:24:59.920 INFO:tasks.workunit.client.0.smithi098.stdout:5/596: symlink dc/de/d13/d46/d2e/d62/lc8 0 2024-09-19T07:24:59.922 INFO:tasks.workunit.client.0.smithi098.stdout:9/706: dread d3/d30/f88 [0,4194304] 0 2024-09-19T07:24:59.922 INFO:tasks.workunit.client.0.smithi098.stdout:8/705: dwrite d0/f7e [0,4194304] 0 2024-09-19T07:24:59.922 INFO:tasks.workunit.client.0.smithi098.stdout:5/597: creat dc/de/d13/fc9 x:0 0 0 2024-09-19T07:24:59.922 INFO:tasks.workunit.client.0.smithi098.stdout:5/598: write dc/de/d13/f21 [3499398,117867] 0 2024-09-19T07:24:59.923 INFO:tasks.workunit.client.0.smithi098.stdout:3/648: rename de/df/d1f/d72/la5 to de/d4e/d6d/lc1 0 2024-09-19T07:24:59.925 INFO:tasks.workunit.client.0.smithi098.stdout:9/707: symlink d3/dc/df/d15/d1a/leb 0 2024-09-19T07:24:59.926 INFO:tasks.workunit.client.0.smithi098.stdout:8/706: creat d0/d16/d65/dd8/fea x:0 0 0 2024-09-19T07:24:59.926 INFO:tasks.workunit.client.0.smithi098.stdout:8/707: write d0/d1a/f3b [5127030,28716] 0 2024-09-19T07:24:59.930 INFO:tasks.workunit.client.0.smithi098.stdout:2/730: rename d1/d9/d3e/d41 to d1/d9/d26/d35/d88/dc2/dfb 0 2024-09-19T07:24:59.930 INFO:tasks.workunit.client.0.smithi098.stdout:2/731: stat d1/d5/d72/db5/d4e/c8f 0 2024-09-19T07:24:59.930 INFO:tasks.workunit.client.0.smithi098.stdout:2/732: read - d1/d9/d26/fe8 zero size 2024-09-19T07:24:59.931 INFO:tasks.workunit.client.0.smithi098.stdout:2/733: mkdir d1/d9/d26/d35/d88/dc2/dfb/d60/db4/dfc 0 2024-09-19T07:24:59.933 INFO:tasks.workunit.client.0.smithi098.stdout:7/816: rename d5/d8/c7b to d5/d10/d1d/c10f 0 2024-09-19T07:24:59.934 INFO:tasks.workunit.client.0.smithi098.stdout:7/817: stat d5/d3e/d62/da0/ca6 0 2024-09-19T07:24:59.934 INFO:tasks.workunit.client.0.smithi098.stdout:7/818: stat d5/d10/d1d/dff 0 2024-09-19T07:24:59.934 INFO:tasks.workunit.client.0.smithi098.stdout:9/708: read d3/d16/d43/d51/f6d [6699952,25809] 0 2024-09-19T07:24:59.935 INFO:tasks.workunit.client.0.smithi098.stdout:8/708: dread d0/d33/d55/d8a/f15 [0,4194304] 0 2024-09-19T07:24:59.935 INFO:tasks.workunit.client.0.smithi098.stdout:8/709: write d0/dc5/fe4 [708040,88011] 0 2024-09-19T07:24:59.936 INFO:tasks.workunit.client.0.smithi098.stdout:2/734: rename d1/d5/d34/d80 to d1/dcb/dfd 0 2024-09-19T07:24:59.938 INFO:tasks.workunit.client.0.smithi098.stdout:9/709: creat d3/d16/d43/d51/dd3/de6/fec x:0 0 0 2024-09-19T07:24:59.940 INFO:tasks.workunit.client.0.smithi098.stdout:2/735: rename d1/d5/d34/ld2 to d1/d5/d34/d5a/lfe 0 2024-09-19T07:24:59.941 INFO:tasks.workunit.client.0.smithi098.stdout:9/710: getdents d3/dc/df/d15/db3 0 2024-09-19T07:24:59.942 INFO:tasks.workunit.client.0.smithi098.stdout:5/599: dwrite f4 [0,4194304] 0 2024-09-19T07:24:59.942 INFO:tasks.workunit.client.0.smithi098.stdout:5/600: stat dc/de/f34 0 2024-09-19T07:24:59.943 INFO:tasks.workunit.client.0.smithi098.stdout:9/711: symlink d3/led 0 2024-09-19T07:24:59.943 INFO:tasks.workunit.client.0.smithi098.stdout:9/712: chown d3/d16/d43/d51/dd3 14 1 2024-09-19T07:24:59.945 INFO:tasks.workunit.client.0.smithi098.stdout:5/601: symlink dc/de/d13/d46/d2e/d37/d81/db8/lca 0 2024-09-19T07:24:59.945 INFO:tasks.workunit.client.0.smithi098.stdout:5/602: chown dc/de/d13/l40 7 1 2024-09-19T07:24:59.946 INFO:tasks.workunit.client.0.smithi098.stdout:3/649: link de/df/d31/d61/c82 de/df/d1f/d72/cc2 0 2024-09-19T07:24:59.946 INFO:tasks.workunit.client.0.smithi098.stdout:7/819: write d5/d3e/d62/da0/dc5/fd7 [2769741,63983] 0 2024-09-19T07:24:59.946 INFO:tasks.workunit.client.0.smithi098.stdout:7/820: write d5/d8/f24 [1738194,103686] 0 2024-09-19T07:24:59.947 INFO:tasks.workunit.client.0.smithi098.stdout:9/713: rename d3/d30/f88 to d3/d30/d73/fee 0 2024-09-19T07:24:59.947 INFO:tasks.workunit.client.0.smithi098.stdout:4/690: dwrite da/d31/d46/d56/d5b/d66/fa9 [0,4194304] 0 2024-09-19T07:24:59.948 INFO:tasks.workunit.client.0.smithi098.stdout:5/603: creat dc/de/d13/d46/d2e/da5/fcb x:0 0 0 2024-09-19T07:24:59.949 INFO:tasks.workunit.client.0.smithi098.stdout:4/691: symlink da/d59/led 0 2024-09-19T07:24:59.949 INFO:tasks.workunit.client.0.smithi098.stdout:3/650: creat de/df/d1f/fc3 x:0 0 0 2024-09-19T07:24:59.949 INFO:tasks.workunit.client.0.smithi098.stdout:3/651: chown de/f19 695514273 1 2024-09-19T07:24:59.950 INFO:tasks.workunit.client.0.smithi098.stdout:9/714: mknod d3/d16/d38/cef 0 2024-09-19T07:24:59.952 INFO:tasks.workunit.client.0.smithi098.stdout:7/821: mkdir d5/d3e/d61/d110 0 2024-09-19T07:24:59.952 INFO:tasks.workunit.client.0.smithi098.stdout:7/822: chown d5/db0/cf9 140348936 1 2024-09-19T07:24:59.952 INFO:tasks.workunit.client.0.smithi098.stdout:7/823: write d5/d10/dc2/dbd/fef [3389524,119200] 0 2024-09-19T07:24:59.953 INFO:tasks.workunit.client.0.smithi098.stdout:9/715: creat d3/d6/d46/ff0 x:0 0 0 2024-09-19T07:24:59.953 INFO:tasks.workunit.client.0.smithi098.stdout:9/716: write d3/dc/df/d15/d1a/d2b/d49/d50/f98 [369923,105606] 0 2024-09-19T07:24:59.953 INFO:tasks.workunit.client.0.smithi098.stdout:9/717: read d3/dc/f19 [722625,51330] 0 2024-09-19T07:24:59.953 INFO:tasks.workunit.client.0.smithi098.stdout:9/718: fdatasync d3/dc/df/d15/d1a/d2d/f3a 0 2024-09-19T07:24:59.953 INFO:tasks.workunit.client.0.smithi098.stdout:9/719: readlink d3/d6/d8/l62 0 2024-09-19T07:24:59.954 INFO:tasks.workunit.client.0.smithi098.stdout:9/720: fdatasync d3/dc/f6a 0 2024-09-19T07:24:59.954 INFO:tasks.workunit.client.0.smithi098.stdout:2/736: write d1/d9/d26/d35/d58/f5b [1209126,18305] 0 2024-09-19T07:24:59.954 INFO:tasks.workunit.client.0.smithi098.stdout:7/824: symlink d5/d3e/df2/l111 0 2024-09-19T07:24:59.956 INFO:tasks.workunit.client.0.smithi098.stdout:4/692: stat da/d31/d46/d56/d5b 0 2024-09-19T07:24:59.956 INFO:tasks.workunit.client.0.smithi098.stdout:4/693: chown da/d31/d46/d5f/fd7 31664507 1 2024-09-19T07:24:59.957 INFO:tasks.workunit.client.0.smithi098.stdout:9/721: fsync d3/d16/d43/d51/dd3/de6/fec 0 2024-09-19T07:24:59.959 INFO:tasks.workunit.client.0.smithi098.stdout:5/604: dread dc/de/d13/d46/f24 [0,4194304] 0 2024-09-19T07:24:59.960 INFO:tasks.workunit.client.0.smithi098.stdout:4/694: creat da/d31/d46/d56/fee x:0 0 0 2024-09-19T07:24:59.960 INFO:tasks.workunit.client.0.smithi098.stdout:4/695: fdatasync da/fc7 0 2024-09-19T07:24:59.960 INFO:tasks.workunit.client.0.smithi098.stdout:4/696: stat da/d31 0 2024-09-19T07:24:59.961 INFO:tasks.workunit.client.0.smithi098.stdout:4/697: creat da/d31/d46/d56/fef x:0 0 0 2024-09-19T07:24:59.961 INFO:tasks.workunit.client.0.smithi098.stdout:4/698: stat da/d31/l4e 0 2024-09-19T07:24:59.962 INFO:tasks.workunit.client.0.smithi098.stdout:7/825: creat d5/d10/d11/d9e/f112 x:0 0 0 2024-09-19T07:24:59.963 INFO:tasks.workunit.client.0.smithi098.stdout:8/710: dwrite d0/d2c/fe7 [0,4194304] 0 2024-09-19T07:24:59.963 INFO:tasks.workunit.client.0.smithi098.stdout:3/652: write de/df/d1f/d2b/f3a [1665734,116495] 0 2024-09-19T07:24:59.965 INFO:tasks.workunit.client.0.smithi098.stdout:9/722: creat d3/d16/ff1 x:0 0 0 2024-09-19T07:24:59.968 INFO:tasks.workunit.client.0.smithi098.stdout:5/605: rename dc/de/d13/d46/d2e/d37/d81/db8/lbd to dc/de/d13/d46/d2e/lcc 0 2024-09-19T07:24:59.968 INFO:tasks.workunit.client.0.smithi098.stdout:3/653: rename de to de/d4e/d6d/d71/dc4 22 2024-09-19T07:24:59.968 INFO:tasks.workunit.client.0.smithi098.stdout:3/654: write de/df/d31/d61/f4c [1581446,21703] 0 2024-09-19T07:24:59.970 INFO:tasks.workunit.client.0.smithi098.stdout:3/655: mknod de/df/d1f/d72/cc5 0 2024-09-19T07:24:59.970 INFO:tasks.workunit.client.0.smithi098.stdout:4/699: mkdir da/d31/d46/d56/d5b/db9/df0 0 2024-09-19T07:24:59.971 INFO:tasks.workunit.client.0.smithi098.stdout:4/700: creat da/d31/d46/d5f/d8a/db6/dc2/de7/ff1 x:0 0 0 2024-09-19T07:24:59.973 INFO:tasks.workunit.client.0.smithi098.stdout:4/701: mkdir da/d31/d46/d80/ddf/df2 0 2024-09-19T07:24:59.973 INFO:tasks.workunit.client.0.smithi098.stdout:4/702: stat da/d31/d46/d56/c84 0 2024-09-19T07:24:59.973 INFO:tasks.workunit.client.0.smithi098.stdout:4/703: readlink da/d31/d46/d56/d5b/d61/l7d 0 2024-09-19T07:24:59.973 INFO:tasks.workunit.client.0.smithi098.stdout:9/723: creat d3/dc/df/d15/d1b/d90/ff2 x:0 0 0 2024-09-19T07:24:59.974 INFO:tasks.workunit.client.0.smithi098.stdout:5/606: symlink dc/de/d13/d46/lcd 0 2024-09-19T07:24:59.976 INFO:tasks.workunit.client.0.smithi098.stdout:3/656: unlink de/df/d31/f5c 0 2024-09-19T07:24:59.978 INFO:tasks.workunit.client.0.smithi098.stdout:5/607: creat dc/de/d13/d46/d2e/d37/fce x:0 0 0 2024-09-19T07:24:59.980 INFO:tasks.workunit.client.0.smithi098.stdout:9/724: rmdir d3/dc/df/d15/d1b 39 2024-09-19T07:24:59.982 INFO:tasks.workunit.client.0.smithi098.stdout:5/608: creat dc/de/d13/d46/d2e/fcf x:0 0 0 2024-09-19T07:24:59.984 INFO:tasks.workunit.client.0.smithi098.stdout:3/657: rmdir de/df/d31/d61 39 2024-09-19T07:24:59.985 INFO:tasks.workunit.client.0.smithi098.stdout:9/725: rmdir d3/dc/df/d15/d1a/d2d/d7f 39 2024-09-19T07:24:59.987 INFO:tasks.workunit.client.0.smithi098.stdout:5/609: unlink dc/f29 0 2024-09-19T07:24:59.991 INFO:tasks.workunit.client.0.smithi098.stdout:8/711: dwrite d0/d16/f79 [0,4194304] 0 2024-09-19T07:24:59.991 INFO:tasks.workunit.client.0.smithi098.stdout:8/712: chown d0/dc7 21 1 2024-09-19T07:24:59.992 INFO:tasks.workunit.client.0.smithi098.stdout:8/713: mkdir d0/d33/d55/d8a/d21/deb 0 2024-09-19T07:24:59.995 INFO:tasks.workunit.client.0.smithi098.stdout:4/704: dwrite da/d31/d46/d56/d5b/d66/fd0 [0,4194304] 0 2024-09-19T07:25:00.004 INFO:tasks.workunit.client.0.smithi098.stdout:4/705: truncate da/f3a 4575067 0 2024-09-19T07:25:00.008 INFO:tasks.workunit.client.0.smithi098.stdout:6/668: sync 2024-09-19T07:25:00.008 INFO:tasks.workunit.client.0.smithi098.stdout:7/826: link d5/d8/d5d/c7c d5/d3e/d62/da0/dc5/c113 0 2024-09-19T07:25:00.008 INFO:tasks.workunit.client.0.smithi098.stdout:7/827: dread - d5/d3e/d61/fd0 zero size 2024-09-19T07:25:00.008 INFO:tasks.workunit.client.0.smithi098.stdout:7/828: chown d5/dce/dd6 20 1 2024-09-19T07:25:00.008 INFO:tasks.workunit.client.0.smithi098.stdout:6/669: write d2/d5/d1f/d26/f55 [139485,75405] 0 2024-09-19T07:25:00.009 INFO:tasks.workunit.client.0.smithi098.stdout:7/829: truncate d5/d8/dc/d16/f78 897593 0 2024-09-19T07:25:00.010 INFO:tasks.workunit.client.0.smithi098.stdout:6/670: symlink d2/d1b/d8f/lf2 0 2024-09-19T07:25:00.010 INFO:tasks.workunit.client.0.smithi098.stdout:6/671: fsync d2/d5/f81 0 2024-09-19T07:25:00.016 INFO:tasks.workunit.client.0.smithi098.stdout:5/610: dwrite dc/de/d13/d5c/da2/f94 [0,4194304] 0 2024-09-19T07:25:00.019 INFO:tasks.workunit.client.0.smithi098.stdout:5/611: creat dc/de/d13/d46/d2e/fd0 x:0 0 0 2024-09-19T07:25:00.019 INFO:tasks.workunit.client.0.smithi098.stdout:6/672: dread d2/db0/d4e/f89 [0,4194304] 0 2024-09-19T07:25:00.019 INFO:tasks.workunit.client.0.smithi098.stdout:6/673: dread - d2/d5/d1f/d26/d42/d48/d53/d64/fa6 zero size 2024-09-19T07:25:00.020 INFO:tasks.workunit.client.0.smithi098.stdout:5/612: creat dc/de/d13/d46/d2e/d37/d81/fd1 x:0 0 0 2024-09-19T07:25:00.021 INFO:tasks.workunit.client.0.smithi098.stdout:5/613: rmdir dc/de/d13/d46/d2e/da5 39 2024-09-19T07:25:00.021 INFO:tasks.workunit.client.0.smithi098.stdout:7/830: fsync d5/d8/dc/d16/f78 0 2024-09-19T07:25:00.023 INFO:tasks.workunit.client.0.smithi098.stdout:5/614: rename dc/de/d13/d5c/c7f to dc/d6c/cd2 0 2024-09-19T07:25:00.023 INFO:tasks.workunit.client.0.smithi098.stdout:6/674: dread d2/d5/fb8 [0,4194304] 0 2024-09-19T07:25:00.024 INFO:tasks.workunit.client.0.smithi098.stdout:5/615: mknod dc/de/d36/d71/cd3 0 2024-09-19T07:25:00.024 INFO:tasks.workunit.client.0.smithi098.stdout:5/616: stat f1 0 2024-09-19T07:25:00.024 INFO:tasks.workunit.client.0.smithi098.stdout:5/617: chown dc/de/d36/d71/fbf 46 1 2024-09-19T07:25:00.024 INFO:tasks.workunit.client.0.smithi098.stdout:6/675: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/lf3 0 2024-09-19T07:25:00.024 INFO:tasks.workunit.client.0.smithi098.stdout:6/676: readlink d2/db0/d4e/d6e/lc0 0 2024-09-19T07:25:00.025 INFO:tasks.workunit.client.0.smithi098.stdout:4/706: link da/d31/d46/d56/d5b/fb2 da/d31/d46/d5f/d8a/db6/dc2/ff3 0 2024-09-19T07:25:00.026 INFO:tasks.workunit.client.0.smithi098.stdout:6/677: creat d2/db0/d8d/ff4 x:0 0 0 2024-09-19T07:25:00.026 INFO:tasks.workunit.client.0.smithi098.stdout:5/618: creat dc/de/d13/d46/d2e/d62/fd4 x:0 0 0 2024-09-19T07:25:00.027 INFO:tasks.workunit.client.0.smithi098.stdout:6/678: symlink d2/db0/d8d/lf5 0 2024-09-19T07:25:00.028 INFO:tasks.workunit.client.0.smithi098.stdout:8/714: dwrite d0/d2c/f66 [0,4194304] 0 2024-09-19T07:25:00.029 INFO:tasks.workunit.client.0.smithi098.stdout:9/726: dwrite d3/dc/df/d15/db3/dc5/fdc [0,4194304] 0 2024-09-19T07:25:00.029 INFO:tasks.workunit.client.0.smithi098.stdout:9/727: fdatasync d3/d16/d43/d51/f5a 0 2024-09-19T07:25:00.029 INFO:tasks.workunit.client.0.smithi098.stdout:9/728: write d3/dc/df/d15/d1a/d2b/d49/d50/f98 [552723,1875] 0 2024-09-19T07:25:00.029 INFO:tasks.workunit.client.0.smithi098.stdout:9/729: write d3/dc/df/d15/db3/fe7 [369514,85663] 0 2024-09-19T07:25:00.031 INFO:tasks.workunit.client.0.smithi098.stdout:5/619: mknod dc/de/d13/d46/d23/d5e/cd5 0 2024-09-19T07:25:00.031 INFO:tasks.workunit.client.0.smithi098.stdout:3/658: dwrite de/df/d31/d61/d69/f89 [0,4194304] 0 2024-09-19T07:25:00.031 INFO:tasks.workunit.client.0.smithi098.stdout:7/831: unlink d5/d8/dc/d16/f67 0 2024-09-19T07:25:00.031 INFO:tasks.workunit.client.0.smithi098.stdout:6/679: readlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/ld9 0 2024-09-19T07:25:00.033 INFO:tasks.workunit.client.0.smithi098.stdout:6/680: symlink d2/db0/d4e/d6e/lf6 0 2024-09-19T07:25:00.033 INFO:tasks.workunit.client.0.smithi098.stdout:8/715: creat d0/d33/d55/d8a/d12/dba/fec x:0 0 0 2024-09-19T07:25:00.035 INFO:tasks.workunit.client.0.smithi098.stdout:9/730: link d3/d16/d38/l70 d3/d16/d38/d22/lf3 0 2024-09-19T07:25:00.036 INFO:tasks.workunit.client.0.smithi098.stdout:6/681: creat d2/ff7 x:0 0 0 2024-09-19T07:25:00.036 INFO:tasks.workunit.client.0.smithi098.stdout:5/620: creat dc/de/d13/d5c/fd6 x:0 0 0 2024-09-19T07:25:00.037 INFO:tasks.workunit.client.0.smithi098.stdout:5/621: truncate dc/de/d13/d46/d2e/d62/fc4 5029609 0 2024-09-19T07:25:00.037 INFO:tasks.workunit.client.0.smithi098.stdout:6/682: creat d2/d5/d1f/d26/d7b/ff8 x:0 0 0 2024-09-19T07:25:00.038 INFO:tasks.workunit.client.0.smithi098.stdout:3/659: truncate de/f1a 3214838 0 2024-09-19T07:25:00.039 INFO:tasks.workunit.client.0.smithi098.stdout:3/660: symlink de/df/d1f/d72/lc6 0 2024-09-19T07:25:00.040 INFO:tasks.workunit.client.0.smithi098.stdout:9/731: mknod d3/dc/df/d15/d2f/cf4 0 2024-09-19T07:25:00.041 INFO:tasks.workunit.client.0.smithi098.stdout:5/622: mknod dc/de/dc0/cd7 0 2024-09-19T07:25:00.042 INFO:tasks.workunit.client.0.smithi098.stdout:8/716: rmdir d0/d16/d65 39 2024-09-19T07:25:00.042 INFO:tasks.workunit.client.0.smithi098.stdout:8/717: write d0/d33/d55/d8a/d21/d3c/f52 [1790914,44049] 0 2024-09-19T07:25:00.043 INFO:tasks.workunit.client.0.smithi098.stdout:7/832: write d5/d3e/d62/f65 [1437765,34317] 0 2024-09-19T07:25:00.043 INFO:tasks.workunit.client.0.smithi098.stdout:7/833: fsync d5/d8/f24 0 2024-09-19T07:25:00.043 INFO:tasks.workunit.client.0.smithi098.stdout:7/834: fsync d5/dce/ff5 0 2024-09-19T07:25:00.045 INFO:tasks.workunit.client.0.smithi098.stdout:9/732: creat d3/d16/d43/db1/ff5 x:0 0 0 2024-09-19T07:25:00.046 INFO:tasks.workunit.client.0.smithi098.stdout:6/683: dread d2/fe [0,4194304] 0 2024-09-19T07:25:00.046 INFO:tasks.workunit.client.0.smithi098.stdout:6/684: dread - d2/d5/d1f/d26/d42/da4/fca zero size 2024-09-19T07:25:00.046 INFO:tasks.workunit.client.0.smithi098.stdout:4/707: dwrite da/d31/d46/fd8 [0,4194304] 0 2024-09-19T07:25:00.047 INFO:tasks.workunit.client.0.smithi098.stdout:8/718: creat d0/d33/d55/fed x:0 0 0 2024-09-19T07:25:00.048 INFO:tasks.workunit.client.0.smithi098.stdout:3/661: rmdir de/df/d31/d61/d79 39 2024-09-19T07:25:00.049 INFO:tasks.workunit.client.0.smithi098.stdout:6/685: unlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/ceb 0 2024-09-19T07:25:00.049 INFO:tasks.workunit.client.0.smithi098.stdout:6/686: dread - d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/fae zero size 2024-09-19T07:25:00.050 INFO:tasks.workunit.client.0.smithi098.stdout:7/835: link d5/d10/f32 d5/d8/dc/da7/dd4/f114 0 2024-09-19T07:25:00.053 INFO:tasks.workunit.client.0.smithi098.stdout:9/733: creat d3/d6/d46/d83/da9/dbc/ff6 x:0 0 0 2024-09-19T07:25:00.055 INFO:tasks.workunit.client.0.smithi098.stdout:8/719: mknod d0/dc7/cee 0 2024-09-19T07:25:00.056 INFO:tasks.workunit.client.0.smithi098.stdout:9/734: symlink d3/d16/d43/d51/d6e/lf7 0 2024-09-19T07:25:00.058 INFO:tasks.workunit.client.0.smithi098.stdout:4/708: dread da/f2a [0,4194304] 0 2024-09-19T07:25:00.058 INFO:tasks.workunit.client.0.smithi098.stdout:9/735: creat d3/dc/df/d15/d1a/d2d/d7f/ff8 x:0 0 0 2024-09-19T07:25:00.059 INFO:tasks.workunit.client.0.smithi098.stdout:3/662: dread f5 [0,4194304] 0 2024-09-19T07:25:00.061 INFO:tasks.workunit.client.0.smithi098.stdout:9/736: unlink d3/dc/df/d15/d1a/d2b/l79 0 2024-09-19T07:25:00.062 INFO:tasks.workunit.client.0.smithi098.stdout:4/709: symlink da/d31/d46/d5f/d8a/db6/dc2/lf4 0 2024-09-19T07:25:00.062 INFO:tasks.workunit.client.0.smithi098.stdout:4/710: write da/d31/d46/fdc [836081,130795] 0 2024-09-19T07:25:00.063 INFO:tasks.workunit.client.0.smithi098.stdout:3/663: mknod de/df/d31/d61/d79/cc7 0 2024-09-19T07:25:00.067 INFO:tasks.workunit.client.0.smithi098.stdout:0/822: sync 2024-09-19T07:25:00.068 INFO:tasks.workunit.client.0.smithi098.stdout:0/823: creat d5/d20/d1f/d47/dae/dca/f108 x:0 0 0 2024-09-19T07:25:00.070 INFO:tasks.workunit.client.0.smithi098.stdout:5/623: dwrite dc/de/d13/d46/d2e/d37/d81/fd1 [0,4194304] 0 2024-09-19T07:25:00.072 INFO:tasks.workunit.client.0.smithi098.stdout:7/836: dwrite d5/d3e/d61/f91 [0,4194304] 0 2024-09-19T07:25:00.083 INFO:tasks.workunit.client.0.smithi098.stdout:5/624: write fa [700671,63168] 0 2024-09-19T07:25:00.086 INFO:tasks.workunit.client.0.smithi098.stdout:7/837: dread d5/d3e/d62/fb1 [0,4194304] 0 2024-09-19T07:25:00.087 INFO:tasks.workunit.client.0.smithi098.stdout:7/838: symlink d5/d8/dc/d16/l115 0 2024-09-19T07:25:00.088 INFO:tasks.workunit.client.0.smithi098.stdout:7/839: mkdir d5/d10/d50/dad/d116 0 2024-09-19T07:25:00.088 INFO:tasks.workunit.client.0.smithi098.stdout:8/720: dwrite d0/d33/d55/d8a/d21/d50/fdc [0,4194304] 0 2024-09-19T07:25:00.089 INFO:tasks.workunit.client.0.smithi098.stdout:7/840: mknod d5/d8/d52/c117 0 2024-09-19T07:25:00.090 INFO:tasks.workunit.client.0.smithi098.stdout:8/721: unlink d0/d16/d7d/fa0 0 2024-09-19T07:25:00.091 INFO:tasks.workunit.client.0.smithi098.stdout:7/841: mknod d5/d8/d8e/d59/d10b/c118 0 2024-09-19T07:25:00.091 INFO:tasks.workunit.client.0.smithi098.stdout:7/842: chown d5/d3e/d61/f106 2514 1 2024-09-19T07:25:00.091 INFO:tasks.workunit.client.0.smithi098.stdout:7/843: chown d5/d8/d8e/d59 4 1 2024-09-19T07:25:00.092 INFO:tasks.workunit.client.0.smithi098.stdout:7/844: rmdir d5/d10/dc2/d5c/d10d 0 2024-09-19T07:25:00.093 INFO:tasks.workunit.client.0.smithi098.stdout:7/845: creat d5/d10/dc2/d5c/f119 x:0 0 0 2024-09-19T07:25:00.094 INFO:tasks.workunit.client.0.smithi098.stdout:7/846: mkdir d5/d10/d50/df8/d11a 0 2024-09-19T07:25:00.098 INFO:tasks.workunit.client.0.smithi098.stdout:0/824: dwrite d5/d20/f12 [8388608,4194304] 0 2024-09-19T07:25:00.098 INFO:tasks.workunit.client.0.smithi098.stdout:9/737: dwrite d3/d16/d38/d48/f96 [0,4194304] 0 2024-09-19T07:25:00.098 INFO:tasks.workunit.client.0.smithi098.stdout:9/738: fsync d3/d16/d43/d61/f66 0 2024-09-19T07:25:00.100 INFO:tasks.workunit.client.0.smithi098.stdout:9/739: mknod d3/d30/cf9 0 2024-09-19T07:25:00.103 INFO:tasks.workunit.client.0.smithi098.stdout:8/722: dread d0/d33/d55/d8a/f15 [4194304,4194304] 0 2024-09-19T07:25:00.103 INFO:tasks.workunit.client.0.smithi098.stdout:4/711: dwrite da/d31/d46/d5f/fd7 [0,4194304] 0 2024-09-19T07:25:00.103 INFO:tasks.workunit.client.0.smithi098.stdout:0/825: dread d5/d20/d14/d49/d62/f6e [0,4194304] 0 2024-09-19T07:25:00.105 INFO:tasks.workunit.client.0.smithi098.stdout:8/723: mknod d0/d2c/cef 0 2024-09-19T07:25:00.106 INFO:tasks.workunit.client.0.smithi098.stdout:8/724: fdatasync d0/d16/d65/fd6 0 2024-09-19T07:25:00.106 INFO:tasks.workunit.client.0.smithi098.stdout:4/712: dread da/d31/d46/d5f/f8d [0,4194304] 0 2024-09-19T07:25:00.106 INFO:tasks.workunit.client.0.smithi098.stdout:4/713: dread - da/d59/d5d/d82/f8b zero size 2024-09-19T07:25:00.106 INFO:tasks.workunit.client.0.smithi098.stdout:4/714: chown da/l65 2 1 2024-09-19T07:25:00.106 INFO:tasks.workunit.client.0.smithi098.stdout:1/798: sync 2024-09-19T07:25:00.106 INFO:tasks.workunit.client.0.smithi098.stdout:2/737: sync 2024-09-19T07:25:00.106 INFO:tasks.workunit.client.0.smithi098.stdout:8/725: creat d0/d33/d44/dbe/ff0 x:0 0 0 2024-09-19T07:25:00.107 INFO:tasks.workunit.client.0.smithi098.stdout:2/738: mkdir d1/d9/d3e/dff 0 2024-09-19T07:25:00.108 INFO:tasks.workunit.client.0.smithi098.stdout:1/799: rmdir dc/d17/d1b/d71 39 2024-09-19T07:25:00.109 INFO:tasks.workunit.client.0.smithi098.stdout:0/826: dread d5/d20/d1f/d47/db2/dbf/d6d/f6f [0,4194304] 0 2024-09-19T07:25:00.109 INFO:tasks.workunit.client.0.smithi098.stdout:0/827: chown d5/d20/d1f/l63 1894195138 1 2024-09-19T07:25:00.109 INFO:tasks.workunit.client.0.smithi098.stdout:2/739: creat d1/d9/d26/d35/d88/dc2/f100 x:0 0 0 2024-09-19T07:25:00.111 INFO:tasks.workunit.client.0.smithi098.stdout:1/800: symlink dc/de/d22/d31/d5d/l111 0 2024-09-19T07:25:00.112 INFO:tasks.workunit.client.0.smithi098.stdout:0/828: rename d5/d20/d1f/d52/d64/dcc/fdf to d5/d20/d1f/f109 0 2024-09-19T07:25:00.114 INFO:tasks.workunit.client.0.smithi098.stdout:9/740: write d3/d16/f3c [2955498,10336] 0 2024-09-19T07:25:00.114 INFO:tasks.workunit.client.0.smithi098.stdout:0/829: symlink d5/d20/d1f/d52/d64/dba/dd2/dea/df2/l10a 0 2024-09-19T07:25:00.115 INFO:tasks.workunit.client.0.smithi098.stdout:9/741: link d3/dc/df/d15/d1b/f9a d3/dc/ffa 0 2024-09-19T07:25:00.116 INFO:tasks.workunit.client.0.smithi098.stdout:2/740: dread d1/f8 [4194304,4194304] 0 2024-09-19T07:25:00.117 INFO:tasks.workunit.client.0.smithi098.stdout:9/742: mkdir d3/d16/d43/d61/da6/dfb 0 2024-09-19T07:25:00.117 INFO:tasks.workunit.client.0.smithi098.stdout:0/830: mkdir d5/d20/d1f/d52/d64/d10b 0 2024-09-19T07:25:00.119 INFO:tasks.workunit.client.0.smithi098.stdout:2/741: creat d1/d9/d26/d35/d88/dc2/dfb/d60/f101 x:0 0 0 2024-09-19T07:25:00.119 INFO:tasks.workunit.client.0.smithi098.stdout:9/743: getdents d3/dc/df/d15/d1a/db7 0 2024-09-19T07:25:00.120 INFO:tasks.workunit.client.0.smithi098.stdout:8/726: dread d0/d33/d55/d8a/d21/d50/f6f [0,4194304] 0 2024-09-19T07:25:00.120 INFO:tasks.workunit.client.0.smithi098.stdout:0/831: mknod d5/d20/d1f/d47/dae/c10c 0 2024-09-19T07:25:00.122 INFO:tasks.workunit.client.0.smithi098.stdout:2/742: creat d1/d9/d26/d35/d88/dc2/dfb/d60/db4/f102 x:0 0 0 2024-09-19T07:25:00.122 INFO:tasks.workunit.client.0.smithi098.stdout:2/743: readlink d1/d9/d3e/la6 0 2024-09-19T07:25:00.122 INFO:tasks.workunit.client.0.smithi098.stdout:8/727: truncate d0/dc5/f51 3011268 0 2024-09-19T07:25:00.124 INFO:tasks.workunit.client.0.smithi098.stdout:0/832: rename d5/d20/d1f/d47/dae/dca/fce to d5/d20/d1f/d47/db2/dd3/f10d 0 2024-09-19T07:25:00.125 INFO:tasks.workunit.client.0.smithi098.stdout:0/833: dread f4 [0,4194304] 0 2024-09-19T07:25:00.125 INFO:tasks.workunit.client.0.smithi098.stdout:0/834: write d5/d20/d1f/d47/db2/dd3/d106/d94/f99 [1994367,129696] 0 2024-09-19T07:25:00.125 INFO:tasks.workunit.client.0.smithi098.stdout:2/744: rename d1/d9/d1d/f4a to d1/d9/d26/d35/d48/d7f/f103 0 2024-09-19T07:25:00.126 INFO:tasks.workunit.client.0.smithi098.stdout:2/745: chown d1/d9/c83 0 1 2024-09-19T07:25:00.129 INFO:tasks.workunit.client.0.smithi098.stdout:4/715: dwrite da/d31/d46/d56/d5b/db9/fd9 [0,4194304] 0 2024-09-19T07:25:00.132 INFO:tasks.workunit.client.0.smithi098.stdout:2/746: dread d1/d9/d26/d35/d88/dc2/dfb/f4b [0,4194304] 0 2024-09-19T07:25:00.132 INFO:tasks.workunit.client.0.smithi098.stdout:2/747: fsync d1/d9/d26/d35/d48/f52 0 2024-09-19T07:25:00.137 INFO:tasks.workunit.client.0.smithi098.stdout:9/744: write d3/dc/df/d15/d1a/d2b/d49/f76 [1911979,127882] 0 2024-09-19T07:25:00.137 INFO:tasks.workunit.client.0.smithi098.stdout:9/745: chown d3/dc/df/d15/db3/dc5/fdc 3056 1 2024-09-19T07:25:00.139 INFO:tasks.workunit.client.0.smithi098.stdout:9/746: symlink d3/dc/df/d15/d1a/d2d/d7f/lfc 0 2024-09-19T07:25:00.139 INFO:tasks.workunit.client.0.smithi098.stdout:9/747: write d3/dc/df/d15/d2f/f5f [1908757,74439] 0 2024-09-19T07:25:00.145 INFO:tasks.workunit.client.0.smithi098.stdout:8/728: dwrite d0/d16/f3a [0,4194304] 0 2024-09-19T07:25:00.145 INFO:tasks.workunit.client.0.smithi098.stdout:8/729: chown d0/d16/f3a 20118 1 2024-09-19T07:25:00.149 INFO:tasks.workunit.client.0.smithi098.stdout:4/716: dread da/d31/d46/d56/d5b/d66/fa9 [0,4194304] 0 2024-09-19T07:25:00.149 INFO:tasks.workunit.client.0.smithi098.stdout:8/730: truncate d0/dc5/f96 1236581 0 2024-09-19T07:25:00.152 INFO:tasks.workunit.client.0.smithi098.stdout:8/731: getdents d0/d33/d55/d8a/d21/d50/d9e 0 2024-09-19T07:25:00.152 INFO:tasks.workunit.client.0.smithi098.stdout:4/717: creat da/d31/d46/d5f/d8a/ff5 x:0 0 0 2024-09-19T07:25:00.154 INFO:tasks.workunit.client.0.smithi098.stdout:8/732: creat d0/d1a/dcf/ff1 x:0 0 0 2024-09-19T07:25:00.158 INFO:tasks.workunit.client.0.smithi098.stdout:2/748: dwrite d1/d5/d34/f7c [0,4194304] 0 2024-09-19T07:25:00.159 INFO:tasks.workunit.client.0.smithi098.stdout:8/733: rename d0/d33/d55/d8a/d21/d50 to d0/d33/d55/d8a/d12/dba/df2 0 2024-09-19T07:25:00.161 INFO:tasks.workunit.client.0.smithi098.stdout:1/801: link dc/d17/d1b/d1d/f3f dc/de/d22/d31/d5d/d6a/f112 0 2024-09-19T07:25:00.164 INFO:tasks.workunit.client.0.smithi098.stdout:8/734: mkdir d0/d33/df3 0 2024-09-19T07:25:00.166 INFO:tasks.workunit.client.0.smithi098.stdout:1/802: creat dc/d17/d1b/d1d/d3d/dc4/f113 x:0 0 0 2024-09-19T07:25:00.166 INFO:tasks.workunit.client.0.smithi098.stdout:1/803: write dc/de/d22/d31/d5d/d6a/d6f/d4d/f54 [731353,51743] 0 2024-09-19T07:25:00.166 INFO:tasks.workunit.client.0.smithi098.stdout:1/804: dread - dc/de/d22/d31/d5d/d6a/d6f/d5f/f10c zero size 2024-09-19T07:25:00.167 INFO:tasks.workunit.client.0.smithi098.stdout:8/735: creat d0/d33/d55/d8a/d28/ff4 x:0 0 0 2024-09-19T07:25:00.169 INFO:tasks.workunit.client.0.smithi098.stdout:1/805: link dc/d17/d1b/d71/ld9 dc/d17/d9c/l114 0 2024-09-19T07:25:00.171 INFO:tasks.workunit.client.0.smithi098.stdout:1/806: creat dc/d17/d1b/d1d/d30/f115 x:0 0 0 2024-09-19T07:25:00.171 INFO:tasks.workunit.client.0.smithi098.stdout:1/807: fsync dc/de/d50/f61 0 2024-09-19T07:25:00.173 INFO:tasks.workunit.client.0.smithi098.stdout:9/748: dwrite d3/d16/d43/d51/f6d [0,4194304] 0 2024-09-19T07:25:00.173 INFO:tasks.workunit.client.0.smithi098.stdout:1/808: creat dc/de/d22/d31/d5d/f116 x:0 0 0 2024-09-19T07:25:00.174 INFO:tasks.workunit.client.0.smithi098.stdout:9/749: mknod d3/d16/d38/cfd 0 2024-09-19T07:25:00.176 INFO:tasks.workunit.client.0.smithi098.stdout:9/750: link d3/d16/d38/d48/la1 d3/dc/df/d15/d1a/d2d/d7f/lfe 0 2024-09-19T07:25:00.178 INFO:tasks.workunit.client.0.smithi098.stdout:1/809: creat dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/f117 x:0 0 0 2024-09-19T07:25:00.178 INFO:tasks.workunit.client.0.smithi098.stdout:1/810: write dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/db1/fc1 [364654,52579] 0 2024-09-19T07:25:00.178 INFO:tasks.workunit.client.0.smithi098.stdout:1/811: chown dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/fbf 7837725 1 2024-09-19T07:25:00.178 INFO:tasks.workunit.client.0.smithi098.stdout:1/812: readlink dc/d17/d1b/d71/d81/le7 0 2024-09-19T07:25:00.180 INFO:tasks.workunit.client.0.smithi098.stdout:9/751: rename d3/dc/df/d15/d1a/d2d/d7f/lcb to d3/d16/d43/d61/da6/lff 0 2024-09-19T07:25:00.180 INFO:tasks.workunit.client.0.smithi098.stdout:9/752: chown d3/dc/df/d15/d1a/d2d/c35 41987489 1 2024-09-19T07:25:00.181 INFO:tasks.workunit.client.0.smithi098.stdout:9/753: chown d3/d16/d43/d51/dd3/dc1 376626960 1 2024-09-19T07:25:00.182 INFO:tasks.workunit.client.0.smithi098.stdout:4/718: dwrite da/d31/dc5/fe1 [0,4194304] 0 2024-09-19T07:25:00.182 INFO:tasks.workunit.client.0.smithi098.stdout:9/754: mknod d3/d30/d73/dc7/c100 0 2024-09-19T07:25:00.182 INFO:tasks.workunit.client.0.smithi098.stdout:9/755: fsync d3/dc/df/d15/d1a/f9c 0 2024-09-19T07:25:00.182 INFO:tasks.workunit.client.0.smithi098.stdout:9/756: chown d3/dc/df/d15/d1a/d2b/fd5 2346 1 2024-09-19T07:25:00.183 INFO:tasks.workunit.client.0.smithi098.stdout:4/719: creat da/d31/d46/d56/d5b/db9/ff6 x:0 0 0 2024-09-19T07:25:00.184 INFO:tasks.workunit.client.0.smithi098.stdout:9/757: getdents d3/dc/df 0 2024-09-19T07:25:00.185 INFO:tasks.workunit.client.0.smithi098.stdout:2/749: dwrite d1/d5/d72/ff9 [0,4194304] 0 2024-09-19T07:25:00.186 INFO:tasks.workunit.client.0.smithi098.stdout:9/758: symlink d3/dc/df/da3/l101 0 2024-09-19T07:25:00.186 INFO:tasks.workunit.client.0.smithi098.stdout:9/759: chown d3/d16/d43/d51/d6e 22 1 2024-09-19T07:25:00.186 INFO:tasks.workunit.client.0.smithi098.stdout:9/760: fdatasync d3/dc/df/d15/d1a/d2b/f33 0 2024-09-19T07:25:00.186 INFO:tasks.workunit.client.0.smithi098.stdout:9/761: write d3/d16/d43/d51/dd3/d7e/f8e [118868,25203] 0 2024-09-19T07:25:00.186 INFO:tasks.workunit.client.0.smithi098.stdout:9/762: truncate d3/dc/df/d15/d1a/dc9/fe9 571460 0 2024-09-19T07:25:00.186 INFO:tasks.workunit.client.0.smithi098.stdout:9/763: rename d3/d6/d46/d83 to d3/d6/d46/d83/da9/d102 22 2024-09-19T07:25:00.196 INFO:tasks.workunit.client.0.smithi098.stdout:2/750: dread d1/d9/d26/d5c/f9c [0,4194304] 0 2024-09-19T07:25:00.196 INFO:tasks.workunit.client.0.smithi098.stdout:8/736: dwrite d0/d33/d55/d8a/d12/dba/fec [0,4194304] 0 2024-09-19T07:25:00.197 INFO:tasks.workunit.client.0.smithi098.stdout:4/720: write da/d31/f71 [133126,39688] 0 2024-09-19T07:25:00.197 INFO:tasks.workunit.client.0.smithi098.stdout:9/764: dread d3/d16/d38/d48/f96 [0,4194304] 0 2024-09-19T07:25:00.198 INFO:tasks.workunit.client.0.smithi098.stdout:2/751: creat d1/d5/d34/d5a/db2/f104 x:0 0 0 2024-09-19T07:25:00.198 INFO:tasks.workunit.client.0.smithi098.stdout:2/752: dread - d1/d9/d26/d35/fd0 zero size 2024-09-19T07:25:00.204 INFO:tasks.workunit.client.0.smithi098.stdout:4/721: dread da/f30 [0,4194304] 0 2024-09-19T07:25:00.204 INFO:tasks.workunit.client.0.smithi098.stdout:4/722: fsync da/f3a 0 2024-09-19T07:25:00.204 INFO:tasks.workunit.client.0.smithi098.stdout:9/765: dread d3/d30/d73/fee [0,4194304] 0 2024-09-19T07:25:00.205 INFO:tasks.workunit.client.0.smithi098.stdout:1/813: dwrite dc/de/d22/d31/d5d/d6a/d6f/d4d/dc6/fef [0,4194304] 0 2024-09-19T07:25:00.206 INFO:tasks.workunit.client.0.smithi098.stdout:9/766: symlink d3/dc/df/da3/l103 0 2024-09-19T07:25:00.206 INFO:tasks.workunit.client.0.smithi098.stdout:1/814: rename dc/de/d22/d31/d35/d58/dec/d10a/ddb/cea to dc/de/d22/d31/d5d/d6a/c118 0 2024-09-19T07:25:00.208 INFO:tasks.workunit.client.0.smithi098.stdout:2/753: dread d1/d9/f2a [0,4194304] 0 2024-09-19T07:25:00.208 INFO:tasks.workunit.client.0.smithi098.stdout:2/754: truncate d1/d5/d72/db5/dad/fc9 500979 0 2024-09-19T07:25:00.208 INFO:tasks.workunit.client.0.smithi098.stdout:9/767: mkdir d3/dc/df/d15/d1a/d2b/d92/d104 0 2024-09-19T07:25:00.209 INFO:tasks.workunit.client.0.smithi098.stdout:1/815: symlink dc/d2a/l119 0 2024-09-19T07:25:00.209 INFO:tasks.workunit.client.0.smithi098.stdout:1/816: write dc/d2a/f67 [2934626,84162] 0 2024-09-19T07:25:00.210 INFO:tasks.workunit.client.0.smithi098.stdout:4/723: dread da/d31/f71 [0,4194304] 0 2024-09-19T07:25:00.211 INFO:tasks.workunit.client.0.smithi098.stdout:4/724: fsync da/d31/d46/d56/d5b/d61/fb7 0 2024-09-19T07:25:00.211 INFO:tasks.workunit.client.0.smithi098.stdout:2/755: symlink d1/d9/d26/d35/d88/dc2/dfb/d60/l105 0 2024-09-19T07:25:00.211 INFO:tasks.workunit.client.0.smithi098.stdout:4/725: write da/d31/d46/d5f/d8a/db6/dc2/de7/ff1 [69010,1021] 0 2024-09-19T07:25:00.211 INFO:tasks.workunit.client.0.smithi098.stdout:4/726: fdatasync da/d31/d46/d56/d5b/d66/fca 0 2024-09-19T07:25:00.211 INFO:tasks.workunit.client.0.smithi098.stdout:9/768: link d3/d16/d38/d22/l53 d3/dc/df/d15/d1b/d90/l105 0 2024-09-19T07:25:00.211 INFO:tasks.workunit.client.0.smithi098.stdout:9/769: truncate d3/d16/d43/d51/dd3/de6/fec 556328 0 2024-09-19T07:25:00.213 INFO:tasks.workunit.client.0.smithi098.stdout:2/756: symlink d1/d9/d26/d35/d88/dc2/dfb/d60/db4/dfc/l106 0 2024-09-19T07:25:00.214 INFO:tasks.workunit.client.0.smithi098.stdout:8/737: dread d0/d33/d55/d8a/f18 [0,4194304] 0 2024-09-19T07:25:00.214 INFO:tasks.workunit.client.0.smithi098.stdout:8/738: fdatasync d0/d33/d55/fed 0 2024-09-19T07:25:00.214 INFO:tasks.workunit.client.0.smithi098.stdout:1/817: rmdir dc/d2a 39 2024-09-19T07:25:00.215 INFO:tasks.workunit.client.0.smithi098.stdout:1/818: chown dc/de/d22/ca0 3242 1 2024-09-19T07:25:00.215 INFO:tasks.workunit.client.0.smithi098.stdout:8/739: mkdir d0/d16/d7d/dcc/dd2/df5 0 2024-09-19T07:25:00.216 INFO:tasks.workunit.client.0.smithi098.stdout:1/819: mknod dc/d17/d1b/d71/d7a/c11a 0 2024-09-19T07:25:00.216 INFO:tasks.workunit.client.0.smithi098.stdout:9/770: rmdir d3/d16/d43/d51/dd3/d7e 39 2024-09-19T07:25:00.216 INFO:tasks.workunit.client.0.smithi098.stdout:9/771: fdatasync d3/dc/df/d15/db3/dc5/fdc 0 2024-09-19T07:25:00.217 INFO:tasks.workunit.client.0.smithi098.stdout:1/820: write dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/f55 [1054060,120420] 0 2024-09-19T07:25:00.218 INFO:tasks.workunit.client.0.smithi098.stdout:9/772: dread d3/d16/d43/d61/f66 [0,4194304] 0 2024-09-19T07:25:00.218 INFO:tasks.workunit.client.0.smithi098.stdout:9/773: write d3/d16/d43/d51/dd3/dc1/fe1 [1047959,116599] 0 2024-09-19T07:25:00.218 INFO:tasks.workunit.client.0.smithi098.stdout:9/774: write d3/dc/df/d15/d2f/f5f [3852610,124070] 0 2024-09-19T07:25:00.220 INFO:tasks.workunit.client.0.smithi098.stdout:9/775: mkdir d3/dc/df/d15/d1a/d2b/d49/d50/d106 0 2024-09-19T07:25:00.220 INFO:tasks.workunit.client.0.smithi098.stdout:9/776: write d3/d6/d46/d83/da9/dbc/ff6 [17366,95258] 0 2024-09-19T07:25:00.221 INFO:tasks.workunit.client.0.smithi098.stdout:9/777: write d3/dc/df/d15/d1a/f9c [1101561,104016] 0 2024-09-19T07:25:00.223 INFO:tasks.workunit.client.0.smithi098.stdout:9/778: unlink d3/d16/f3e 0 2024-09-19T07:25:00.223 INFO:tasks.workunit.client.0.smithi098.stdout:9/779: write d3/dc/f19 [1873577,81499] 0 2024-09-19T07:25:00.223 INFO:tasks.workunit.client.0.smithi098.stdout:9/780: chown d3/dc/df/d15/d1b/d90/laf 141 1 2024-09-19T07:25:00.223 INFO:tasks.workunit.client.0.smithi098.stdout:9/781: chown d3/dc/lcd 63 1 2024-09-19T07:25:00.226 INFO:tasks.workunit.client.0.smithi098.stdout:9/782: creat d3/d30/f107 x:0 0 0 2024-09-19T07:25:00.226 INFO:tasks.workunit.client.0.smithi098.stdout:9/783: stat d3/d16/d43/d61/f66 0 2024-09-19T07:25:00.227 INFO:tasks.workunit.client.0.smithi098.stdout:9/784: rename d3/d16/d38/f4f to d3/d6/d8/f108 0 2024-09-19T07:25:00.229 INFO:tasks.workunit.client.0.smithi098.stdout:8/740: write d0/f7e [2561757,128087] 0 2024-09-19T07:25:00.236 INFO:tasks.workunit.client.0.smithi098.stdout:4/727: dread da/d31/d46/d56/d5b/fb2 [0,4194304] 0 2024-09-19T07:25:00.237 INFO:tasks.workunit.client.0.smithi098.stdout:1/821: read dc/de/d22/d31/d5d/d6a/d6f/d4d/f73 [166322,68368] 0 2024-09-19T07:25:00.237 INFO:tasks.workunit.client.0.smithi098.stdout:2/757: dwrite d1/d9/fba [0,4194304] 0 2024-09-19T07:25:00.237 INFO:tasks.workunit.client.0.smithi098.stdout:2/758: write d1/d9/d26/d35/d91/fb0 [477260,115689] 0 2024-09-19T07:25:00.238 INFO:tasks.workunit.client.0.smithi098.stdout:1/822: mkdir dc/de/d50/d11b 0 2024-09-19T07:25:00.238 INFO:tasks.workunit.client.0.smithi098.stdout:1/823: chown dc/de/d22/fbb 10359709 1 2024-09-19T07:25:00.242 INFO:tasks.workunit.client.0.smithi098.stdout:2/759: truncate d1/d9/d26/d35/d48/d7f/f103 3714054 0 2024-09-19T07:25:00.244 INFO:tasks.workunit.client.0.smithi098.stdout:2/760: rename d1/d9/d26/d5c to d1/dcb/dfd/d93/d61/d62/d107 0 2024-09-19T07:25:00.246 INFO:tasks.workunit.client.0.smithi098.stdout:2/761: rename d1/d9/d3e/fb3 to d1/d9/d26/d35/d88/f108 0 2024-09-19T07:25:00.247 INFO:tasks.workunit.client.0.smithi098.stdout:2/762: chown d1/d9/d26/d35/d88/dc2/dfb/d60/l105 103 1 2024-09-19T07:25:00.251 INFO:tasks.workunit.client.0.smithi098.stdout:2/763: dread d1/d9/d26/d35/d48/d7f/fc6 [0,4194304] 0 2024-09-19T07:25:00.252 INFO:tasks.workunit.client.0.smithi098.stdout:2/764: write d1/d9/d26/d35/d88/dc2/dfb/d60/d65/da0/faf [811312,79478] 0 2024-09-19T07:25:00.252 INFO:tasks.workunit.client.0.smithi098.stdout:2/765: truncate d1/d5/d72/db5/dad/fc9 1158048 0 2024-09-19T07:25:00.253 INFO:tasks.workunit.client.0.smithi098.stdout:2/766: mknod d1/d9/d26/d35/c109 0 2024-09-19T07:25:00.254 INFO:tasks.workunit.client.0.smithi098.stdout:8/741: dwrite d0/d33/d44/dbe/ff0 [0,4194304] 0 2024-09-19T07:25:00.255 INFO:tasks.workunit.client.0.smithi098.stdout:2/767: mkdir d1/d5/d72/db5/dad/d10a 0 2024-09-19T07:25:00.255 INFO:tasks.workunit.client.0.smithi098.stdout:9/785: dwrite d3/d30/f107 [0,4194304] 0 2024-09-19T07:25:00.255 INFO:tasks.workunit.client.0.smithi098.stdout:3/664: sync 2024-09-19T07:25:00.256 INFO:tasks.workunit.client.0.smithi098.stdout:6/687: sync 2024-09-19T07:25:00.256 INFO:tasks.workunit.client.0.smithi098.stdout:3/665: dread - de/df/d31/d61/d3f/f6f zero size 2024-09-19T07:25:00.258 INFO:tasks.workunit.client.0.smithi098.stdout:8/742: creat d0/d33/d55/d8a/d12/dba/df2/d9e/da4/db9/ff6 x:0 0 0 2024-09-19T07:25:00.261 INFO:tasks.workunit.client.0.smithi098.stdout:2/768: mkdir d1/dcb/dfd/d10b 0 2024-09-19T07:25:00.262 INFO:tasks.workunit.client.0.smithi098.stdout:9/786: creat d3/d6/d46/d83/da9/dbc/f109 x:0 0 0 2024-09-19T07:25:00.264 INFO:tasks.workunit.client.0.smithi098.stdout:8/743: rmdir d0/d33/d55/d8a/d12/dba/df2/d9e/da4/db9 39 2024-09-19T07:25:00.265 INFO:tasks.workunit.client.0.smithi098.stdout:4/728: dwrite da/d31/f3c [0,4194304] 0 2024-09-19T07:25:00.265 INFO:tasks.workunit.client.0.smithi098.stdout:2/769: mknod d1/d9/dd7/c10c 0 2024-09-19T07:25:00.266 INFO:tasks.workunit.client.0.smithi098.stdout:6/688: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/ff9 x:0 0 0 2024-09-19T07:25:00.267 INFO:tasks.workunit.client.0.smithi098.stdout:4/729: creat da/d31/d46/d80/ff7 x:0 0 0 2024-09-19T07:25:00.267 INFO:tasks.workunit.client.0.smithi098.stdout:4/730: chown da/d31/d46/d80/fa3 4711 1 2024-09-19T07:25:00.267 INFO:tasks.workunit.client.0.smithi098.stdout:8/744: mknod d0/d33/d55/d8a/d12/dba/df2/d9e/da4/db9/cf7 0 2024-09-19T07:25:00.268 INFO:tasks.workunit.client.0.smithi098.stdout:2/770: mknod d1/d9/dd7/c10d 0 2024-09-19T07:25:00.268 INFO:tasks.workunit.client.0.smithi098.stdout:2/771: truncate d1/d5/d72/db5/d4e/fae 1217103 0 2024-09-19T07:25:00.269 INFO:tasks.workunit.client.0.smithi098.stdout:2/772: write d1/dcb/dfd/d93/d61/d62/fa2 [326509,32112] 0 2024-09-19T07:25:00.269 INFO:tasks.workunit.client.0.smithi098.stdout:2/773: stat d1/d9/d26/d35/d88/dc2/dfb/d60/l105 0 2024-09-19T07:25:00.271 INFO:tasks.workunit.client.0.smithi098.stdout:9/787: dread d3/d30/d73/fee [0,4194304] 0 2024-09-19T07:25:00.271 INFO:tasks.workunit.client.0.smithi098.stdout:9/788: write d3/dc/df/d15/f5b [1860185,70073] 0 2024-09-19T07:25:00.271 INFO:tasks.workunit.client.0.smithi098.stdout:9/789: fsync d3/d6/d8/f77 0 2024-09-19T07:25:00.271 INFO:tasks.workunit.client.0.smithi098.stdout:8/745: creat d0/d33/d55/d8a/ff8 x:0 0 0 2024-09-19T07:25:00.271 INFO:tasks.workunit.client.0.smithi098.stdout:1/824: dwrite dc/de/d22/d31/d35/ff4 [0,4194304] 0 2024-09-19T07:25:00.272 INFO:tasks.workunit.client.0.smithi098.stdout:9/790: truncate d3/dc/df/d15/d1a/d2b/d49/d50/f98 292302 0 2024-09-19T07:25:00.273 INFO:tasks.workunit.client.0.smithi098.stdout:9/791: read d3/d16/d43/d51/dd3/de6/fec [134394,119877] 0 2024-09-19T07:25:00.273 INFO:tasks.workunit.client.0.smithi098.stdout:8/746: truncate d0/d33/d55/d8a/f15 6123713 0 2024-09-19T07:25:00.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:24:59 smithi098 ceph-mon[30950]: pgmap v91: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 201 MiB/s rd, 238 MiB/s wr, 2.06k op/s 2024-09-19T07:25:00.274 INFO:tasks.workunit.client.0.smithi098.stdout:1/825: getdents dc/d17/d1b/d71/d81 0 2024-09-19T07:25:00.275 INFO:tasks.workunit.client.0.smithi098.stdout:1/826: truncate dc/de/d22/d31/d5d/d6a/d6f/d4d/dc6/fe5 874525 0 2024-09-19T07:25:00.276 INFO:tasks.workunit.client.0.smithi098.stdout:9/792: getdents d3/d6/d8 0 2024-09-19T07:25:00.276 INFO:tasks.workunit.client.0.smithi098.stdout:9/793: truncate d3/dc/df/d15/f5b 9022943 0 2024-09-19T07:25:00.276 INFO:tasks.workunit.client.0.smithi098.stdout:4/731: dread da/d59/f86 [4194304,4194304] 0 2024-09-19T07:25:00.277 INFO:tasks.workunit.client.0.smithi098.stdout:4/732: chown da/d31/d46/d5f/c8e 35193 1 2024-09-19T07:25:00.278 INFO:tasks.workunit.client.0.smithi098.stdout:8/747: mknod d0/d33/d55/d8a/d21/d3c/cf9 0 2024-09-19T07:25:00.278 INFO:tasks.workunit.client.0.smithi098.stdout:7/847: sync 2024-09-19T07:25:00.278 INFO:tasks.workunit.client.0.smithi098.stdout:5/625: sync 2024-09-19T07:25:00.279 INFO:tasks.workunit.client.0.smithi098.stdout:0/835: sync 2024-09-19T07:25:00.279 INFO:tasks.workunit.client.0.smithi098.stdout:5/626: fdatasync dc/de/d36/d71/d84/f8f 0 2024-09-19T07:25:00.279 INFO:tasks.workunit.client.0.smithi098.stdout:5/627: write dc/de/d13/d5c/da2/fb0 [282015,19550] 0 2024-09-19T07:25:00.281 INFO:tasks.workunit.client.0.smithi098.stdout:9/794: symlink d3/d6/d46/l10a 0 2024-09-19T07:25:00.283 INFO:tasks.workunit.client.0.smithi098.stdout:5/628: mkdir dc/de/dc0/dd8 0 2024-09-19T07:25:00.286 INFO:tasks.workunit.client.0.smithi098.stdout:5/629: symlink dc/ld9 0 2024-09-19T07:25:00.288 INFO:tasks.workunit.client.0.smithi098.stdout:5/630: creat dc/de/d13/d46/d2e/d37/d67/d99/fda x:0 0 0 2024-09-19T07:25:00.289 INFO:tasks.workunit.client.0.smithi098.stdout:5/631: write dc/de/d13/d46/d2e/da5/fcb [794099,42185] 0 2024-09-19T07:25:00.289 INFO:tasks.workunit.client.0.smithi098.stdout:3/666: dwrite de/df/d1f/f56 [0,4194304] 0 2024-09-19T07:25:00.290 INFO:tasks.workunit.client.0.smithi098.stdout:4/733: truncate da/d31/d46/d56/d5b/fb2 1534986 0 2024-09-19T07:25:00.290 INFO:tasks.workunit.client.0.smithi098.stdout:5/632: rmdir dc/de/d13/d46/d2e/d37/d67/d75 39 2024-09-19T07:25:00.290 INFO:tasks.workunit.client.0.smithi098.stdout:2/774: dwrite d1/d5/d34/d5a/db2/fd1 [0,4194304] 0 2024-09-19T07:25:00.290 INFO:tasks.workunit.client.0.smithi098.stdout:2/775: fsync d1/d9/d26/d35/d58/f4d 0 2024-09-19T07:25:00.291 INFO:tasks.workunit.client.0.smithi098.stdout:2/776: stat d1/d9/d26/d35/d48/d6e/fcd 0 2024-09-19T07:25:00.291 INFO:tasks.workunit.client.0.smithi098.stdout:5/633: creat dc/de/d36/dba/fdb x:0 0 0 2024-09-19T07:25:00.292 INFO:tasks.workunit.client.0.smithi098.stdout:4/734: dread da/d7e/f97 [0,4194304] 0 2024-09-19T07:25:00.292 INFO:tasks.workunit.client.0.smithi098.stdout:2/777: mkdir d1/d9/d26/d35/d88/dc2/dfb/d60/da5/d10e 0 2024-09-19T07:25:00.292 INFO:tasks.workunit.client.0.smithi098.stdout:2/778: fdatasync d1/f8 0 2024-09-19T07:25:00.294 INFO:tasks.workunit.client.0.smithi098.stdout:5/634: getdents dc/de/d13/d46/d2e/d37/d81/db8 0 2024-09-19T07:25:00.294 INFO:tasks.workunit.client.0.smithi098.stdout:3/667: dread de/df/d1f/d2b/d93/fa7 [0,4194304] 0 2024-09-19T07:25:00.295 INFO:tasks.workunit.client.0.smithi098.stdout:5/635: mkdir dc/de/d13/d5c/daf/db9/ddc 0 2024-09-19T07:25:00.296 INFO:tasks.workunit.client.0.smithi098.stdout:5/636: chown dc/de/d13/d46/f3e 2289 1 2024-09-19T07:25:00.296 INFO:tasks.workunit.client.0.smithi098.stdout:9/795: truncate d3/dc/df/d15/d1a/d2d/f42 7249359 0 2024-09-19T07:25:00.297 INFO:tasks.workunit.client.0.smithi098.stdout:3/668: getdents de/d4e/d6d/d8c 0 2024-09-19T07:25:00.297 INFO:tasks.workunit.client.0.smithi098.stdout:3/669: chown de/d4e/d6d/dad/lb8 30929068 1 2024-09-19T07:25:00.297 INFO:tasks.workunit.client.0.smithi098.stdout:3/670: stat de/d4e/d6d/d8c/dab 0 2024-09-19T07:25:00.299 INFO:tasks.workunit.client.0.smithi098.stdout:9/796: mknod d3/dc/df/d15/d1a/d2b/d92/c10b 0 2024-09-19T07:25:00.299 INFO:tasks.workunit.client.0.smithi098.stdout:9/797: stat d3/dc/df/d15/d1a/d2b/f33 0 2024-09-19T07:25:00.299 INFO:tasks.workunit.client.0.smithi098.stdout:6/689: dwrite d2/db0/d8d/fdd [0,4194304] 0 2024-09-19T07:25:00.300 INFO:tasks.workunit.client.0.smithi098.stdout:3/671: getdents de/d4e 0 2024-09-19T07:25:00.300 INFO:tasks.workunit.client.0.smithi098.stdout:3/672: chown de/df/d1f/l30 10 1 2024-09-19T07:25:00.300 INFO:tasks.workunit.client.0.smithi098.stdout:4/735: dread da/d59/d5d/f6c [0,4194304] 0 2024-09-19T07:25:00.300 INFO:tasks.workunit.client.0.smithi098.stdout:5/637: dread dc/de/d13/d46/d2e/d37/d81/f56 [0,4194304] 0 2024-09-19T07:25:00.301 INFO:tasks.workunit.client.0.smithi098.stdout:6/690: mknod d2/db0/d4e/d6e/cfa 0 2024-09-19T07:25:00.302 INFO:tasks.workunit.client.0.smithi098.stdout:4/736: truncate da/f1d 577710 0 2024-09-19T07:25:00.303 INFO:tasks.workunit.client.0.smithi098.stdout:6/691: creat d2/db0/d4e/d6e/d9d/ffb x:0 0 0 2024-09-19T07:25:00.305 INFO:tasks.workunit.client.0.smithi098.stdout:9/798: creat d3/d16/d43/dce/f10c x:0 0 0 2024-09-19T07:25:00.309 INFO:tasks.workunit.client.0.smithi098.stdout:9/799: mknod d3/c10d 0 2024-09-19T07:25:00.311 INFO:tasks.workunit.client.0.smithi098.stdout:6/692: read d2/d5/d1f/d26/d42/d48/fab [2226527,99409] 0 2024-09-19T07:25:00.313 INFO:tasks.workunit.client.0.smithi098.stdout:5/638: dread dc/de/f34 [0,4194304] 0 2024-09-19T07:25:00.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:24:59 smithi139 ceph-mon[35039]: pgmap v91: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 201 MiB/s rd, 238 MiB/s wr, 2.06k op/s 2024-09-19T07:25:00.318 INFO:tasks.workunit.client.0.smithi098.stdout:6/693: dread d2/d11/f56 [0,4194304] 0 2024-09-19T07:25:00.319 INFO:tasks.workunit.client.0.smithi098.stdout:8/748: dwrite d0/d16/d65/d9a/fcb [0,4194304] 0 2024-09-19T07:25:00.320 INFO:tasks.workunit.client.0.smithi098.stdout:0/836: dwrite d5/fc5 [0,4194304] 0 2024-09-19T07:25:00.320 INFO:tasks.workunit.client.0.smithi098.stdout:4/737: write f8 [5528857,57125] 0 2024-09-19T07:25:00.320 INFO:tasks.workunit.client.0.smithi098.stdout:4/738: chown da/c2f 305976999 1 2024-09-19T07:25:00.320 INFO:tasks.workunit.client.0.smithi098.stdout:6/694: unlink d2/d5/d1f/d26/d7b/da3/ced 0 2024-09-19T07:25:00.320 INFO:tasks.workunit.client.0.smithi098.stdout:6/695: write d2/d5/d1f/d26/d42/d48/fce [766546,92166] 0 2024-09-19T07:25:00.321 INFO:tasks.workunit.client.0.smithi098.stdout:6/696: fdatasync d2/d5/d1f/d26/f33 0 2024-09-19T07:25:00.322 INFO:tasks.workunit.client.0.smithi098.stdout:4/739: creat da/d31/dc5/ff8 x:0 0 0 2024-09-19T07:25:00.322 INFO:tasks.workunit.client.0.smithi098.stdout:4/740: dread - da/d31/d46/d56/d5b/d61/fbb zero size 2024-09-19T07:25:00.326 INFO:tasks.workunit.client.0.smithi098.stdout:4/741: creat da/d31/d46/d5f/d8a/db6/dc2/ff9 x:0 0 0 2024-09-19T07:25:00.326 INFO:tasks.workunit.client.0.smithi098.stdout:4/742: write da/d31/d46/fcd [826478,5459] 0 2024-09-19T07:25:00.327 INFO:tasks.workunit.client.0.smithi098.stdout:3/673: link de/df/d1f/f56 de/d4e/d6d/d8c/fc8 0 2024-09-19T07:25:00.331 INFO:tasks.workunit.client.0.smithi098.stdout:5/639: dwrite dc/de/d13/d46/d2e/d37/d81/d6a/f7c [0,4194304] 0 2024-09-19T07:25:00.331 INFO:tasks.workunit.client.0.smithi098.stdout:5/640: readlink dc/de/d13/d46/d2e/d62/lc8 0 2024-09-19T07:25:00.333 INFO:tasks.workunit.client.0.smithi098.stdout:5/641: creat dc/de/d13/d46/d2e/d37/d81/db8/fdd x:0 0 0 2024-09-19T07:25:00.333 INFO:tasks.workunit.client.0.smithi098.stdout:5/642: chown dc/de/d13/d46/d2e/d62/fd4 1590902 1 2024-09-19T07:25:00.336 INFO:tasks.workunit.client.0.smithi098.stdout:5/643: rmdir dc/de/d13/d5c/daf/db9/ddc 0 2024-09-19T07:25:00.337 INFO:tasks.workunit.client.0.smithi098.stdout:5/644: chown dc/de/d13/d46/d2e/d37/c51 502 1 2024-09-19T07:25:00.339 INFO:tasks.workunit.client.0.smithi098.stdout:1/827: rename dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/c83 to dc/de/d50/d11b/c11c 0 2024-09-19T07:25:00.339 INFO:tasks.workunit.client.0.smithi098.stdout:1/828: chown dc/d17/d1b/d71/d81/f110 13 1 2024-09-19T07:25:00.339 INFO:tasks.workunit.client.0.smithi098.stdout:1/829: truncate dc/de/d22/d31/d5d/d6a/fee 85764 0 2024-09-19T07:25:00.339 INFO:tasks.workunit.client.0.smithi098.stdout:5/645: getdents dc/de/d13 0 2024-09-19T07:25:00.340 INFO:tasks.workunit.client.0.smithi098.stdout:5/646: chown dc/de/d13/d46/d2e/d62 63 1 2024-09-19T07:25:00.341 INFO:tasks.workunit.client.0.smithi098.stdout:1/830: creat dc/de/d22/d31/f11d x:0 0 0 2024-09-19T07:25:00.341 INFO:tasks.workunit.client.0.smithi098.stdout:5/647: dread dc/de/d13/d46/d2e/da5/fcb [0,4194304] 0 2024-09-19T07:25:00.346 INFO:tasks.workunit.client.0.smithi098.stdout:8/749: dwrite d0/d16/fcd [0,4194304] 0 2024-09-19T07:25:00.348 INFO:tasks.workunit.client.0.smithi098.stdout:8/750: rmdir d0/d2c 39 2024-09-19T07:25:00.352 INFO:tasks.workunit.client.0.smithi098.stdout:8/751: getdents d0/d2c 0 2024-09-19T07:25:00.355 INFO:tasks.workunit.client.0.smithi098.stdout:3/674: dwrite de/faa [0,4194304] 0 2024-09-19T07:25:00.357 INFO:tasks.workunit.client.0.smithi098.stdout:3/675: mknod de/df/d31/d61/cc9 0 2024-09-19T07:25:00.358 INFO:tasks.workunit.client.0.smithi098.stdout:4/743: dwrite da/d31/d46/fd8 [0,4194304] 0 2024-09-19T07:25:00.359 INFO:tasks.workunit.client.0.smithi098.stdout:1/831: dwrite dc/de/d22/ff1 [0,4194304] 0 2024-09-19T07:25:00.360 INFO:tasks.workunit.client.0.smithi098.stdout:1/832: mkdir dc/d17/d1b/d1d/d11e 0 2024-09-19T07:25:00.362 INFO:tasks.workunit.client.0.smithi098.stdout:1/833: creat dc/d17/f11f x:0 0 0 2024-09-19T07:25:00.363 INFO:tasks.workunit.client.0.smithi098.stdout:3/676: unlink de/df/d1f/fb6 0 2024-09-19T07:25:00.364 INFO:tasks.workunit.client.0.smithi098.stdout:3/677: getdents de/df/d31/d61/d3f/d64 0 2024-09-19T07:25:00.365 INFO:tasks.workunit.client.0.smithi098.stdout:4/744: dread da/d31/d46/fd8 [0,4194304] 0 2024-09-19T07:25:00.366 INFO:tasks.workunit.client.0.smithi098.stdout:4/745: mknod da/d7e/cfa 0 2024-09-19T07:25:00.367 INFO:tasks.workunit.client.0.smithi098.stdout:3/678: rmdir de/df/d16 39 2024-09-19T07:25:00.368 INFO:tasks.workunit.client.0.smithi098.stdout:7/848: rename d5/d3e/d62/da0/c9c to d5/d8/dc/d16/c11b 0 2024-09-19T07:25:00.369 INFO:tasks.workunit.client.0.smithi098.stdout:4/746: dread da/d31/d46/d56/d5b/d66/f7a [0,4194304] 0 2024-09-19T07:25:00.371 INFO:tasks.workunit.client.0.smithi098.stdout:2/779: rename d1/d5/d34/d39/fd6 to d1/d5/d34/f10f 0 2024-09-19T07:25:00.372 INFO:tasks.workunit.client.0.smithi098.stdout:3/679: mknod de/df/d31/d61/cca 0 2024-09-19T07:25:00.372 INFO:tasks.workunit.client.0.smithi098.stdout:3/680: chown de/df/d1f/f56 2076106 1 2024-09-19T07:25:00.372 INFO:tasks.workunit.client.0.smithi098.stdout:3/681: chown f0 1 1 2024-09-19T07:25:00.373 INFO:tasks.workunit.client.0.smithi098.stdout:3/682: stat de/df/d1f/d2b 0 2024-09-19T07:25:00.373 INFO:tasks.workunit.client.0.smithi098.stdout:6/697: rename d2/d1b/d8f/dcb/fe2 to d2/db0/d4e/d6e/d9d/ffc 0 2024-09-19T07:25:00.373 INFO:tasks.workunit.client.0.smithi098.stdout:4/747: symlink da/d31/d46/d56/lfb 0 2024-09-19T07:25:00.373 INFO:tasks.workunit.client.0.smithi098.stdout:3/683: creat de/df/d31/d61/d69/fcb x:0 0 0 2024-09-19T07:25:00.374 INFO:tasks.workunit.client.0.smithi098.stdout:6/698: rename d2/db0/d4e/f7e to d2/d5/d1f/d26/d42/d48/d53/d64/d6d/ffd 0 2024-09-19T07:25:00.374 INFO:tasks.workunit.client.0.smithi098.stdout:6/699: fsync d2/d11/daa/fb1 0 2024-09-19T07:25:00.374 INFO:tasks.workunit.client.0.smithi098.stdout:6/700: fsync d2/f8e 0 2024-09-19T07:25:00.374 INFO:tasks.workunit.client.0.smithi098.stdout:6/701: chown d2/d5/d1f/d26/d42/d48/d53/d64/d6d/le1 7269590 1 2024-09-19T07:25:00.375 INFO:tasks.workunit.client.0.smithi098.stdout:4/748: mknod da/d7e/cfc 0 2024-09-19T07:25:00.375 INFO:tasks.workunit.client.0.smithi098.stdout:3/684: symlink de/d4e/d6d/dad/lcc 0 2024-09-19T07:25:00.375 INFO:tasks.workunit.client.0.smithi098.stdout:3/685: dread - de/df/d31/d61/d3f/d64/f96 zero size 2024-09-19T07:25:00.376 INFO:tasks.workunit.client.0.smithi098.stdout:6/702: creat d2/d5/d1f/d26/d7b/de0/ffe x:0 0 0 2024-09-19T07:25:00.376 INFO:tasks.workunit.client.0.smithi098.stdout:6/703: getdents d2/d5/d1f/d26/d42/d48 0 2024-09-19T07:25:00.376 INFO:tasks.workunit.client.0.smithi098.stdout:3/686: truncate f4 1327007 0 2024-09-19T07:25:00.376 INFO:tasks.workunit.client.0.smithi098.stdout:2/780: dread d1/d9/f2d [0,4194304] 0 2024-09-19T07:25:00.377 INFO:tasks.workunit.client.0.smithi098.stdout:2/781: chown d1/d9/d26/d35/d88/dc2/dfb/d60/d65 55740 1 2024-09-19T07:25:00.377 INFO:tasks.workunit.client.0.smithi098.stdout:6/704: creat d2/d5/d1f/d26/d42/da4/fff x:0 0 0 2024-09-19T07:25:00.378 INFO:tasks.workunit.client.0.smithi098.stdout:4/749: creat da/ffd x:0 0 0 2024-09-19T07:25:00.380 INFO:tasks.workunit.client.0.smithi098.stdout:3/687: dread de/df/d1f/f99 [0,4194304] 0 2024-09-19T07:25:00.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:24:59 smithi162 ceph-mon[35726]: pgmap v91: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 201 MiB/s rd, 238 MiB/s wr, 2.06k op/s 2024-09-19T07:25:00.386 INFO:tasks.workunit.client.0.smithi098.stdout:1/834: dwrite dc/de/d22/d31/d5d/d6a/fee [0,4194304] 0 2024-09-19T07:25:00.388 INFO:tasks.workunit.client.0.smithi098.stdout:1/835: creat dc/d17/d1b/f120 x:0 0 0 2024-09-19T07:25:00.388 INFO:tasks.workunit.client.0.smithi098.stdout:6/705: dread f1 [0,4194304] 0 2024-09-19T07:25:00.389 INFO:tasks.workunit.client.0.smithi098.stdout:1/836: dread dc/da5/fa6 [0,4194304] 0 2024-09-19T07:25:00.390 INFO:tasks.workunit.client.0.smithi098.stdout:6/706: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/f100 x:0 0 0 2024-09-19T07:25:00.390 INFO:tasks.workunit.client.0.smithi098.stdout:6/707: stat d2/d5/d1f/fd3 0 2024-09-19T07:25:00.391 INFO:tasks.workunit.client.0.smithi098.stdout:4/750: write da/d59/f6f [963284,5188] 0 2024-09-19T07:25:00.391 INFO:tasks.workunit.client.0.smithi098.stdout:7/849: dwrite d5/d3e/d62/f70 [4194304,4194304] 0 2024-09-19T07:25:00.391 INFO:tasks.workunit.client.0.smithi098.stdout:7/850: readlink d5/d10/d11/l19 0 2024-09-19T07:25:00.392 INFO:tasks.workunit.client.0.smithi098.stdout:4/751: creat da/d31/d46/d56/ffe x:0 0 0 2024-09-19T07:25:00.392 INFO:tasks.workunit.client.0.smithi098.stdout:4/752: fdatasync da/d31/d46/d5f/d8a/fc4 0 2024-09-19T07:25:00.393 INFO:tasks.workunit.client.0.smithi098.stdout:4/753: mknod da/d31/d46/d5f/dc8/cff 0 2024-09-19T07:25:00.393 INFO:tasks.workunit.client.0.smithi098.stdout:4/754: chown da/d31/d46/d5f/d8a/db6/dc2/cd1 3 1 2024-09-19T07:25:00.394 INFO:tasks.workunit.client.0.smithi098.stdout:6/708: mkdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101 0 2024-09-19T07:25:00.394 INFO:tasks.workunit.client.0.smithi098.stdout:6/709: fsync d2/d5/d1f/d26/d42/d48/d53/d64/fb5 0 2024-09-19T07:25:00.394 INFO:tasks.workunit.client.0.smithi098.stdout:1/837: mknod dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/c121 0 2024-09-19T07:25:00.395 INFO:tasks.workunit.client.0.smithi098.stdout:6/710: rmdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80 39 2024-09-19T07:25:00.396 INFO:tasks.workunit.client.0.smithi098.stdout:6/711: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98/l102 0 2024-09-19T07:25:00.399 INFO:tasks.workunit.client.0.smithi098.stdout:6/712: rename d2/d5/c25 to d2/d11/dd0/c103 0 2024-09-19T07:25:00.399 INFO:tasks.workunit.client.0.smithi098.stdout:6/713: fdatasync d2/d5/d1f/d26/d42/d48/fab 0 2024-09-19T07:25:00.399 INFO:tasks.workunit.client.0.smithi098.stdout:6/714: read - d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/fae zero size 2024-09-19T07:25:00.399 INFO:tasks.workunit.client.0.smithi098.stdout:2/782: dwrite d1/d9/d26/d35/d58/fb9 [4194304,4194304] 0 2024-09-19T07:25:00.399 INFO:tasks.workunit.client.0.smithi098.stdout:3/688: write de/df/d1f/d2b/f3a [452249,51999] 0 2024-09-19T07:25:00.409 INFO:tasks.workunit.client.0.smithi098.stdout:6/715: write d2/db0/d4e/d6e/d9d/fb7 [98947,117260] 0 2024-09-19T07:25:00.410 INFO:tasks.workunit.client.0.smithi098.stdout:9/800: sync 2024-09-19T07:25:00.411 INFO:tasks.workunit.client.0.smithi098.stdout:9/801: creat d3/d16/d43/d51/d6e/f10e x:0 0 0 2024-09-19T07:25:00.411 INFO:tasks.workunit.client.0.smithi098.stdout:6/716: rename d2/db0/d4e/d6e/d9d/fb7 to d2/d11/dd0/f104 0 2024-09-19T07:25:00.413 INFO:tasks.workunit.client.0.smithi098.stdout:6/717: mkdir d2/d5/d1f/d105 0 2024-09-19T07:25:00.418 INFO:tasks.workunit.client.0.smithi098.stdout:6/718: rmdir d2/d1b/d8f/dcb 0 2024-09-19T07:25:00.427 INFO:tasks.workunit.client.0.smithi098.stdout:7/851: dwrite d5/d10/d11/f105 [0,4194304] 0 2024-09-19T07:25:00.429 INFO:tasks.workunit.client.0.smithi098.stdout:7/852: rename d5/d8/d52/db6/dc9/fdb to d5/d10/d11/d9e/dee/d10c/f11c 0 2024-09-19T07:25:00.429 INFO:tasks.workunit.client.0.smithi098.stdout:7/853: readlink d5/d8/l8a 0 2024-09-19T07:25:00.436 INFO:tasks.workunit.client.0.smithi098.stdout:3/689: dwrite de/df/d1f/d2b/d93/fa7 [0,4194304] 0 2024-09-19T07:25:00.436 INFO:tasks.workunit.client.0.smithi098.stdout:3/690: stat de/d4e/d6d/dad/lcc 0 2024-09-19T07:25:00.436 INFO:tasks.workunit.client.0.smithi098.stdout:3/691: stat de/df/f63 0 2024-09-19T07:25:00.436 INFO:tasks.workunit.client.0.smithi098.stdout:7/854: dread d5/d10/dc2/dbd/ffa [0,4194304] 0 2024-09-19T07:25:00.436 INFO:tasks.workunit.client.0.smithi098.stdout:7/855: write d5/d3e/d61/f106 [695944,98238] 0 2024-09-19T07:25:00.437 INFO:tasks.workunit.client.0.smithi098.stdout:3/692: mkdir de/df/d31/d61/d69/dcd 0 2024-09-19T07:25:00.438 INFO:tasks.workunit.client.0.smithi098.stdout:7/856: creat d5/d10/d50/df8/f11d x:0 0 0 2024-09-19T07:25:00.438 INFO:tasks.workunit.client.0.smithi098.stdout:7/857: fsync d5/d3e/d62/da0/f8f 0 2024-09-19T07:25:00.440 INFO:tasks.workunit.client.0.smithi098.stdout:3/693: dread de/df/f2c [0,4194304] 0 2024-09-19T07:25:00.441 INFO:tasks.workunit.client.0.smithi098.stdout:3/694: stat de/d4e/d6d/dad/lb8 0 2024-09-19T07:25:00.442 INFO:tasks.workunit.client.0.smithi098.stdout:3/695: creat de/df/d31/d61/d79/fce x:0 0 0 2024-09-19T07:25:00.442 INFO:tasks.workunit.client.0.smithi098.stdout:3/696: dread - de/d4e/d6d/d71/fbf zero size 2024-09-19T07:25:00.442 INFO:tasks.workunit.client.0.smithi098.stdout:7/858: read d5/d8/d52/fbc [920905,21127] 0 2024-09-19T07:25:00.442 INFO:tasks.workunit.client.0.smithi098.stdout:1/838: dwrite dc/de/d22/d31/d5d/f116 [0,4194304] 0 2024-09-19T07:25:00.442 INFO:tasks.workunit.client.0.smithi098.stdout:3/697: symlink de/df/d1f/d72/lcf 0 2024-09-19T07:25:00.444 INFO:tasks.workunit.client.0.smithi098.stdout:1/839: truncate dc/de/d22/ff1 394919 0 2024-09-19T07:25:00.444 INFO:tasks.workunit.client.0.smithi098.stdout:3/698: read de/d4e/f6a [289150,81474] 0 2024-09-19T07:25:00.445 INFO:tasks.workunit.client.0.smithi098.stdout:1/840: mknod dc/d17/d1b/d71/d7a/d107/c122 0 2024-09-19T07:25:00.445 INFO:tasks.workunit.client.0.smithi098.stdout:3/699: creat de/df/d31/d61/d69/fd0 x:0 0 0 2024-09-19T07:25:00.446 INFO:tasks.workunit.client.0.smithi098.stdout:1/841: write dc/f49 [237132,51622] 0 2024-09-19T07:25:00.447 INFO:tasks.workunit.client.0.smithi098.stdout:4/755: dwrite da/d31/d46/d5f/f74 [4194304,4194304] 0 2024-09-19T07:25:00.447 INFO:tasks.workunit.client.0.smithi098.stdout:3/700: unlink de/df/f2c 0 2024-09-19T07:25:00.449 INFO:tasks.workunit.client.0.smithi098.stdout:1/842: getdents dc/de/d22/d31/d5d/d6a/de0 0 2024-09-19T07:25:00.449 INFO:tasks.workunit.client.0.smithi098.stdout:1/843: readlink dc/l16 0 2024-09-19T07:25:00.449 INFO:tasks.workunit.client.0.smithi098.stdout:1/844: read - dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/db1/ffd zero size 2024-09-19T07:25:00.450 INFO:tasks.workunit.client.0.smithi098.stdout:1/845: creat dc/d17/d1b/d1d/d3d/f123 x:0 0 0 2024-09-19T07:25:00.450 INFO:tasks.workunit.client.0.smithi098.stdout:4/756: mknod da/d31/d46/d56/c100 0 2024-09-19T07:25:00.452 INFO:tasks.workunit.client.0.smithi098.stdout:1/846: dread dc/de/d22/d31/d5d/d6a/d6f/d5f/fb8 [0,4194304] 0 2024-09-19T07:25:00.453 INFO:tasks.workunit.client.0.smithi098.stdout:1/847: truncate dc/d17/d1b/d1d/d30/fe2 533629 0 2024-09-19T07:25:00.453 INFO:tasks.workunit.client.0.smithi098.stdout:1/848: fsync dc/de/d22/d31/d5d/d6a/d6f/ffe 0 2024-09-19T07:25:00.453 INFO:tasks.workunit.client.0.smithi098.stdout:9/802: dwrite d3/d6/d46/ff0 [0,4194304] 0 2024-09-19T07:25:00.453 INFO:tasks.workunit.client.0.smithi098.stdout:1/849: mknod dc/d17/d1b/d1d/d3d/dc4/c124 0 2024-09-19T07:25:00.453 INFO:tasks.workunit.client.0.smithi098.stdout:2/783: dwrite d1/d9/d26/d35/d58/f5b [0,4194304] 0 2024-09-19T07:25:00.456 INFO:tasks.workunit.client.0.smithi098.stdout:3/701: dread de/f19 [0,4194304] 0 2024-09-19T07:25:00.457 INFO:tasks.workunit.client.0.smithi098.stdout:3/702: creat de/df/d1f/d2b/fd1 x:0 0 0 2024-09-19T07:25:00.469 INFO:tasks.workunit.client.0.smithi098.stdout:1/850: dread dc/de/d22/d31/d5d/d6a/d6f/d4d/f8a [0,4194304] 0 2024-09-19T07:25:00.469 INFO:tasks.workunit.client.0.smithi098.stdout:1/851: readlink dc/d17/d1b/d71/ld9 0 2024-09-19T07:25:00.472 INFO:tasks.workunit.client.0.smithi098.stdout:7/859: dwrite d5/d10/dc2/dbd/ffa [0,4194304] 0 2024-09-19T07:25:00.472 INFO:tasks.workunit.client.0.smithi098.stdout:7/860: chown d5/d8/d5d/c7c 19 1 2024-09-19T07:25:00.472 INFO:tasks.workunit.client.0.smithi098.stdout:2/784: rename d1/d9/d26/d35/d91/cbd to d1/d9/d26/c110 0 2024-09-19T07:25:00.472 INFO:tasks.workunit.client.0.smithi098.stdout:2/785: fdatasync d1/d9/fba 0 2024-09-19T07:25:00.472 INFO:tasks.workunit.client.0.smithi098.stdout:2/786: readlink d1/d9/d1d/l29 0 2024-09-19T07:25:00.474 INFO:tasks.workunit.client.0.smithi098.stdout:3/703: rename de/df/d16/f9f to de/df/d16/fd2 0 2024-09-19T07:25:00.475 INFO:tasks.workunit.client.0.smithi098.stdout:6/719: link d2/d5/d1f/lf0 d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/l106 0 2024-09-19T07:25:00.476 INFO:tasks.workunit.client.0.smithi098.stdout:3/704: mknod de/df/d16/cd3 0 2024-09-19T07:25:00.478 INFO:tasks.workunit.client.0.smithi098.stdout:1/852: rename dc/d17/d1b/d1d/d3d/c64 to dc/da5/dcf/c125 0 2024-09-19T07:25:00.479 INFO:tasks.workunit.client.0.smithi098.stdout:6/720: rmdir d2/d5 39 2024-09-19T07:25:00.480 INFO:tasks.workunit.client.0.smithi098.stdout:6/721: truncate d2/d5/ff1 629902 0 2024-09-19T07:25:00.480 INFO:tasks.workunit.client.0.smithi098.stdout:6/722: write d2/d5/d1f/d26/d7b/da3/fe5 [993661,68069] 0 2024-09-19T07:25:00.480 INFO:tasks.workunit.client.0.smithi098.stdout:6/723: write d2/d11/f56 [3039924,113060] 0 2024-09-19T07:25:00.481 INFO:tasks.workunit.client.0.smithi098.stdout:2/787: rename d1/d9/d26/d35/d88/dc2/dfb/c73 to d1/d5/c111 0 2024-09-19T07:25:00.481 INFO:tasks.workunit.client.0.smithi098.stdout:2/788: chown d1/d9/d26/d35/d48/d6e/fcd 0 1 2024-09-19T07:25:00.482 INFO:tasks.workunit.client.0.smithi098.stdout:6/724: link d2/d5/d1f/d26/l4b d2/d5/d1f/d26/l107 0 2024-09-19T07:25:00.482 INFO:tasks.workunit.client.0.smithi098.stdout:6/725: dread - d2/d5/d1f/d26/d42/da4/fca zero size 2024-09-19T07:25:00.482 INFO:tasks.workunit.client.0.smithi098.stdout:6/726: write d2/d5/d1f/d26/fa7 [250475,114343] 0 2024-09-19T07:25:00.482 INFO:tasks.workunit.client.0.smithi098.stdout:1/853: creat dc/d17/d1b/d1d/d3d/dc4/f126 x:0 0 0 2024-09-19T07:25:00.483 INFO:tasks.workunit.client.0.smithi098.stdout:2/789: symlink d1/d9/d26/d35/d88/dc2/dfb/l112 0 2024-09-19T07:25:00.483 INFO:tasks.workunit.client.0.smithi098.stdout:1/854: creat dc/de/d22/d31/d5d/d6a/d6f/d5f/db0/f127 x:0 0 0 2024-09-19T07:25:00.484 INFO:tasks.workunit.client.0.smithi098.stdout:3/705: dread f9 [0,4194304] 0 2024-09-19T07:25:00.484 INFO:tasks.workunit.client.0.smithi098.stdout:2/790: truncate d1/d9/d26/d35/d48/f52 819277 0 2024-09-19T07:25:00.485 INFO:tasks.workunit.client.0.smithi098.stdout:4/757: dwrite da/d31/d46/d56/fee [0,4194304] 0 2024-09-19T07:25:00.485 INFO:tasks.workunit.client.0.smithi098.stdout:4/758: readlink da/l27 0 2024-09-19T07:25:00.485 INFO:tasks.workunit.client.0.smithi098.stdout:1/855: rename dc/de/d22/d31/d35/d58/dec/d10a/ddb to dc/de/d22/d128 0 2024-09-19T07:25:00.485 INFO:tasks.workunit.client.0.smithi098.stdout:7/861: write d5/d3e/d62/da0/fc8 [171202,88342] 0 2024-09-19T07:25:00.486 INFO:tasks.workunit.client.0.smithi098.stdout:6/727: write d2/db0/d4e/d6e/d9d/d94/fa0 [2459913,18603] 0 2024-09-19T07:25:00.486 INFO:tasks.workunit.client.0.smithi098.stdout:1/856: creat dc/de/d50/d11b/f129 x:0 0 0 2024-09-19T07:25:00.486 INFO:tasks.workunit.client.0.smithi098.stdout:3/706: creat de/df/d1f/d2b/fd4 x:0 0 0 2024-09-19T07:25:00.486 INFO:tasks.workunit.client.0.smithi098.stdout:3/707: dread - de/df/d31/d61/d69/fcb zero size 2024-09-19T07:25:00.486 INFO:tasks.workunit.client.0.smithi098.stdout:9/803: dwrite d3/dc/df/d15/fb8 [0,4194304] 0 2024-09-19T07:25:00.486 INFO:tasks.workunit.client.0.smithi098.stdout:9/804: chown d3/dc/df/d15/d1a/d2d/c35 1964880 1 2024-09-19T07:25:00.486 INFO:tasks.workunit.client.0.smithi098.stdout:9/805: chown d3/dc/fea 206194134 1 2024-09-19T07:25:00.488 INFO:tasks.workunit.client.0.smithi098.stdout:6/728: creat d2/d5/d1f/d26/d42/f108 x:0 0 0 2024-09-19T07:25:00.488 INFO:tasks.workunit.client.0.smithi098.stdout:6/729: fsync d2/d5/d1f/d26/f33 0 2024-09-19T07:25:00.488 INFO:tasks.workunit.client.0.smithi098.stdout:6/730: truncate d2/d1b/f57 828851 0 2024-09-19T07:25:00.488 INFO:tasks.workunit.client.0.smithi098.stdout:3/708: mknod de/d4e/d6d/d71/cd5 0 2024-09-19T07:25:00.488 INFO:tasks.workunit.client.0.smithi098.stdout:3/709: write f4 [420646,111616] 0 2024-09-19T07:25:00.488 INFO:tasks.workunit.client.0.smithi098.stdout:3/710: chown de/df/d1f/l78 8039621 1 2024-09-19T07:25:00.489 INFO:tasks.workunit.client.0.smithi098.stdout:9/806: mknod d3/dc/df/d15/db3/dc5/c10f 0 2024-09-19T07:25:00.489 INFO:tasks.workunit.client.0.smithi098.stdout:9/807: fsync d3/d16/d38/d22/f95 0 2024-09-19T07:25:00.489 INFO:tasks.workunit.client.0.smithi098.stdout:9/808: chown d3/d16/d43/d61 37 1 2024-09-19T07:25:00.491 INFO:tasks.workunit.client.0.smithi098.stdout:3/711: creat de/d4e/d6d/fd6 x:0 0 0 2024-09-19T07:25:00.492 INFO:tasks.workunit.client.0.smithi098.stdout:0/837: sync 2024-09-19T07:25:00.492 INFO:tasks.workunit.client.0.smithi098.stdout:5/648: sync 2024-09-19T07:25:00.492 INFO:tasks.workunit.client.0.smithi098.stdout:8/752: sync 2024-09-19T07:25:00.492 INFO:tasks.workunit.client.0.smithi098.stdout:5/649: fsync dc/de/d13/d5c/da2/f7b 0 2024-09-19T07:25:00.492 INFO:tasks.workunit.client.0.smithi098.stdout:8/753: chown d0/d33/d55/d8a/d12/dba 2636728 1 2024-09-19T07:25:00.492 INFO:tasks.workunit.client.0.smithi098.stdout:8/754: write d0/d16/d7d/f99 [495733,63794] 0 2024-09-19T07:25:00.492 INFO:tasks.workunit.client.0.smithi098.stdout:8/755: fdatasync d0/d16/d65/dd8/fea 0 2024-09-19T07:25:00.493 INFO:tasks.workunit.client.0.smithi098.stdout:3/712: mknod de/df/d1f/d72/cd7 0 2024-09-19T07:25:00.496 INFO:tasks.workunit.client.0.smithi098.stdout:0/838: rename d5/d20/d1f/d52/d64/f81 to d5/d20/d1f/d52/d9f/f10e 0 2024-09-19T07:25:00.498 INFO:tasks.workunit.client.0.smithi098.stdout:0/839: creat d5/d20/d1f/d52/d64/dba/dd2/f10f x:0 0 0 2024-09-19T07:25:00.498 INFO:tasks.workunit.client.0.smithi098.stdout:0/840: stat d5/d20/d1f/f4c 0 2024-09-19T07:25:00.500 INFO:tasks.workunit.client.0.smithi098.stdout:1/857: dread dc/d17/f76 [0,4194304] 0 2024-09-19T07:25:00.501 INFO:tasks.workunit.client.0.smithi098.stdout:0/841: link d5/d20/d1f/d47/db2/dd3/d106/d92/cb8 d5/d20/d1f/d52/d64/dcc/c110 0 2024-09-19T07:25:00.502 INFO:tasks.workunit.client.0.smithi098.stdout:8/756: write d0/d33/d55/d8a/f75 [2708059,94538] 0 2024-09-19T07:25:00.502 INFO:tasks.workunit.client.0.smithi098.stdout:8/757: fsync d0/d33/f6e 0 2024-09-19T07:25:00.502 INFO:tasks.workunit.client.0.smithi098.stdout:8/758: readlink d0/d33/d55/d8a/d12/l43 0 2024-09-19T07:25:00.502 INFO:tasks.workunit.client.0.smithi098.stdout:7/862: write d5/dce/fd2 [311113,106057] 0 2024-09-19T07:25:00.506 INFO:tasks.workunit.client.0.smithi098.stdout:7/863: dread d5/d3e/d62/da0/f8f [0,4194304] 0 2024-09-19T07:25:00.510 INFO:tasks.workunit.client.0.smithi098.stdout:9/809: dread d3/dc/df/d15/d2f/f5f [4194304,4194304] 0 2024-09-19T07:25:00.511 INFO:tasks.workunit.client.0.smithi098.stdout:3/713: dread de/df/d31/f5b [0,4194304] 0 2024-09-19T07:25:00.511 INFO:tasks.workunit.client.0.smithi098.stdout:2/791: dwrite d1/d5/d72/db5/d4e/fde [0,4194304] 0 2024-09-19T07:25:00.511 INFO:tasks.workunit.client.0.smithi098.stdout:2/792: stat d1/d9/d26/d35/f71 0 2024-09-19T07:25:00.512 INFO:tasks.workunit.client.0.smithi098.stdout:9/810: symlink d3/d16/d43/d61/da6/dd8/l110 0 2024-09-19T07:25:00.512 INFO:tasks.workunit.client.0.smithi098.stdout:4/759: dwrite da/d31/d46/d56/d5b/db9/fcc [0,4194304] 0 2024-09-19T07:25:00.515 INFO:tasks.workunit.client.0.smithi098.stdout:0/842: dread d5/f7 [4194304,4194304] 0 2024-09-19T07:25:00.515 INFO:tasks.workunit.client.0.smithi098.stdout:0/843: read d5/d20/d1f/d47/db2/dbf/d6d/f6f [484208,55870] 0 2024-09-19T07:25:00.515 INFO:tasks.workunit.client.0.smithi098.stdout:0/844: chown d5/l107 2140 1 2024-09-19T07:25:00.515 INFO:tasks.workunit.client.0.smithi098.stdout:1/858: getdents dc/de/d22/d31/d35/d58/dec/d10a 0 2024-09-19T07:25:00.517 INFO:tasks.workunit.client.0.smithi098.stdout:0/845: dread d5/d20/d1f/d52/d64/dcc/feb [0,4194304] 0 2024-09-19T07:25:00.519 INFO:tasks.workunit.client.0.smithi098.stdout:6/731: dwrite d2/db0/d4e/f89 [0,4194304] 0 2024-09-19T07:25:00.519 INFO:tasks.workunit.client.0.smithi098.stdout:0/846: mkdir d5/d20/d1f/d52/d101/d111 0 2024-09-19T07:25:00.519 INFO:tasks.workunit.client.0.smithi098.stdout:0/847: stat d5/d20/d1f/d47/db2/dbf/d6d/f7b 0 2024-09-19T07:25:00.522 INFO:tasks.workunit.client.0.smithi098.stdout:0/848: creat d5/d20/d1f/d52/d64/dcc/f112 x:0 0 0 2024-09-19T07:25:00.522 INFO:tasks.workunit.client.0.smithi098.stdout:6/732: creat d2/d5/d1f/d26/d42/d48/f109 x:0 0 0 2024-09-19T07:25:00.522 INFO:tasks.workunit.client.0.smithi098.stdout:9/811: dread d3/d6/d8/f77 [0,4194304] 0 2024-09-19T07:25:00.522 INFO:tasks.workunit.client.0.smithi098.stdout:9/812: fsync d3/dc/df/d15/fb8 0 2024-09-19T07:25:00.523 INFO:tasks.workunit.client.0.smithi098.stdout:3/714: read de/df/d16/f4a [7757228,41492] 0 2024-09-19T07:25:00.524 INFO:tasks.workunit.client.0.smithi098.stdout:9/813: creat d3/d16/d43/d51/dd3/dc1/f111 x:0 0 0 2024-09-19T07:25:00.524 INFO:tasks.workunit.client.0.smithi098.stdout:3/715: mknod de/df/d1f/d2b/d93/cd8 0 2024-09-19T07:25:00.524 INFO:tasks.workunit.client.0.smithi098.stdout:3/716: dread - de/df/d1f/d2b/d93/fb2 zero size 2024-09-19T07:25:00.524 INFO:tasks.workunit.client.0.smithi098.stdout:0/849: dread d5/d20/d1f/d47/db2/dd3/d106/f7c [0,4194304] 0 2024-09-19T07:25:00.526 INFO:tasks.workunit.client.0.smithi098.stdout:1/859: creat dc/d17/d1b/d1d/d30/df7/f12a x:0 0 0 2024-09-19T07:25:00.529 INFO:tasks.workunit.client.0.smithi098.stdout:1/860: unlink dc/de/d22/d31/d5d/d6a/d6f/f56 0 2024-09-19T07:25:00.530 INFO:tasks.workunit.client.0.smithi098.stdout:5/650: rename dc/de/d13/d46/d23/f5d to dc/de/d13/d46/d2e/d37/d67/d75/fde 0 2024-09-19T07:25:00.530 INFO:tasks.workunit.client.0.smithi098.stdout:5/651: stat dc/de/d13/d46/d23/f9b 0 2024-09-19T07:25:00.531 INFO:tasks.workunit.client.0.smithi098.stdout:1/861: mknod dc/de/d22/d31/d35/d58/c12b 0 2024-09-19T07:25:00.533 INFO:tasks.workunit.client.0.smithi098.stdout:5/652: symlink dc/de/d13/d46/d2e/d37/d67/d75/ldf 0 2024-09-19T07:25:00.534 INFO:tasks.workunit.client.0.smithi098.stdout:7/864: rename d5/d8/dc/d16/f1e to d5/d10/dc2/d5c/dc3/f11e 0 2024-09-19T07:25:00.535 INFO:tasks.workunit.client.0.smithi098.stdout:7/865: truncate d5/d3e/d62/da0/fa9 636369 0 2024-09-19T07:25:00.535 INFO:tasks.workunit.client.0.smithi098.stdout:7/866: fdatasync d5/d10/f3f 0 2024-09-19T07:25:00.535 INFO:tasks.workunit.client.0.smithi098.stdout:7/867: write d5/d10/dc2/d5c/dc3/f11e [1066844,36483] 0 2024-09-19T07:25:00.536 INFO:tasks.workunit.client.0.smithi098.stdout:7/868: fsync d5/d3e/d62/f65 0 2024-09-19T07:25:00.536 INFO:tasks.workunit.client.0.smithi098.stdout:9/814: write d3/d6/d46/ff0 [1945158,104419] 0 2024-09-19T07:25:00.536 INFO:tasks.workunit.client.0.smithi098.stdout:3/717: dread de/df/d1f/f56 [0,4194304] 0 2024-09-19T07:25:00.538 INFO:tasks.workunit.client.0.smithi098.stdout:9/815: mkdir d3/d16/d38/d48/d112 0 2024-09-19T07:25:00.538 INFO:tasks.workunit.client.0.smithi098.stdout:9/816: write d3/dc/df/d15/d1a/d2d/f42 [1219328,44781] 0 2024-09-19T07:25:00.539 INFO:tasks.workunit.client.0.smithi098.stdout:9/817: dread - d3/d6/d46/d83/da9/dbc/f109 zero size 2024-09-19T07:25:00.539 INFO:tasks.workunit.client.0.smithi098.stdout:3/718: creat de/df/d1f/fd9 x:0 0 0 2024-09-19T07:25:00.540 INFO:tasks.workunit.client.0.smithi098.stdout:9/818: symlink d3/dc/df/d15/d1a/d2b/d49/d65/l113 0 2024-09-19T07:25:00.541 INFO:tasks.workunit.client.0.smithi098.stdout:9/819: truncate d3/dc/df/d15/fb8 4325877 0 2024-09-19T07:25:00.541 INFO:tasks.workunit.client.0.smithi098.stdout:1/862: write dc/de/d22/d31/d35/ff4 [3433170,103700] 0 2024-09-19T07:25:00.543 INFO:tasks.workunit.client.0.smithi098.stdout:3/719: truncate de/df/d1f/f56 4723289 0 2024-09-19T07:25:00.543 INFO:tasks.workunit.client.0.smithi098.stdout:3/720: dread - de/df/d1f/d72/fba zero size 2024-09-19T07:25:00.545 INFO:tasks.workunit.client.0.smithi098.stdout:1/863: write dc/de/d22/d31/d35/fa1 [47578,39065] 0 2024-09-19T07:25:00.547 INFO:tasks.workunit.client.0.smithi098.stdout:6/733: rmdir d2 39 2024-09-19T07:25:00.547 INFO:tasks.workunit.client.0.smithi098.stdout:1/864: symlink dc/de/d22/d31/d35/d58/d10f/l12c 0 2024-09-19T07:25:00.547 INFO:tasks.workunit.client.0.smithi098.stdout:0/850: dwrite d5/d20/f12 [8388608,4194304] 0 2024-09-19T07:25:00.548 INFO:tasks.workunit.client.0.smithi098.stdout:1/865: creat dc/f12d x:0 0 0 2024-09-19T07:25:00.549 INFO:tasks.workunit.client.0.smithi098.stdout:0/851: symlink d5/l113 0 2024-09-19T07:25:00.551 INFO:tasks.workunit.client.0.smithi098.stdout:0/852: unlink d5/l34 0 2024-09-19T07:25:00.554 INFO:tasks.workunit.client.0.smithi098.stdout:0/853: symlink d5/d20/d1f/d47/db2/dbf/de5/l114 0 2024-09-19T07:25:00.554 INFO:tasks.workunit.client.0.smithi098.stdout:0/854: chown d5/d20/d1f/c54 272769393 1 2024-09-19T07:25:00.564 INFO:tasks.workunit.client.0.smithi098.stdout:4/760: rename da/d31/d46/l5a to da/d31/d46/d5f/d8a/db6/dc2/de7/l101 0 2024-09-19T07:25:00.564 INFO:tasks.workunit.client.0.smithi098.stdout:1/866: write dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/fde [2551669,84968] 0 2024-09-19T07:25:00.564 INFO:tasks.workunit.client.0.smithi098.stdout:7/869: dwrite d5/d10/d11/f73 [0,4194304] 0 2024-09-19T07:25:00.564 INFO:tasks.workunit.client.0.smithi098.stdout:7/870: fdatasync d5/d8/d8e/d59/f83 0 2024-09-19T07:25:00.565 INFO:tasks.workunit.client.0.smithi098.stdout:4/761: link da/l65 da/d31/d46/d80/ddf/l102 0 2024-09-19T07:25:00.565 INFO:tasks.workunit.client.0.smithi098.stdout:4/762: chown da/d59/d5d/d82/c83 595 1 2024-09-19T07:25:00.566 INFO:tasks.workunit.client.0.smithi098.stdout:5/653: rename dc/fa0 to dc/de/d13/d46/d23/dc1/fe0 0 2024-09-19T07:25:00.568 INFO:tasks.workunit.client.0.smithi098.stdout:6/734: rename d2/db0/f4f to d2/d5/f10a 0 2024-09-19T07:25:00.568 INFO:tasks.workunit.client.0.smithi098.stdout:6/735: chown d2/d5/d1f/d26/d42/d48/dc3/cc5 1378 1 2024-09-19T07:25:00.569 INFO:tasks.workunit.client.0.smithi098.stdout:5/654: rmdir dc/de/d13/d5c 39 2024-09-19T07:25:00.573 INFO:tasks.workunit.client.0.smithi098.stdout:4/763: getdents da/d31/d46/d56/d5b 0 2024-09-19T07:25:00.574 INFO:tasks.workunit.client.0.smithi098.stdout:3/721: dwrite de/d4e/f50 [0,4194304] 0 2024-09-19T07:25:00.578 INFO:tasks.workunit.client.0.smithi098.stdout:0/855: dwrite d5/d20/d1f/d47/db2/dd3/d106/d94/f99 [0,4194304] 0 2024-09-19T07:25:00.578 INFO:tasks.workunit.client.0.smithi098.stdout:4/764: mknod da/d31/d46/d56/d5b/d63/c103 0 2024-09-19T07:25:00.580 INFO:tasks.workunit.client.0.smithi098.stdout:1/867: dread dc/f33 [4194304,4194304] 0 2024-09-19T07:25:00.587 INFO:tasks.workunit.client.0.smithi098.stdout:1/868: creat dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/ddd/f12e x:0 0 0 2024-09-19T07:25:00.589 INFO:tasks.workunit.client.0.smithi098.stdout:0/856: mkdir d5/d20/d1f/d52/d64/d115 0 2024-09-19T07:25:00.591 INFO:tasks.workunit.client.0.smithi098.stdout:1/869: rename dc/d17/f11f to dc/d2a/f12f 0 2024-09-19T07:25:00.592 INFO:tasks.workunit.client.0.smithi098.stdout:0/857: symlink d5/d20/l116 0 2024-09-19T07:25:00.592 INFO:tasks.workunit.client.0.smithi098.stdout:2/793: sync 2024-09-19T07:25:00.592 INFO:tasks.workunit.client.0.smithi098.stdout:8/759: sync 2024-09-19T07:25:00.593 INFO:tasks.workunit.client.0.smithi098.stdout:2/794: readlink d1/d9/d26/l50 0 2024-09-19T07:25:00.593 INFO:tasks.workunit.client.0.smithi098.stdout:1/870: mkdir dc/d17/d1b/d1d/d3d/dc4/d130 0 2024-09-19T07:25:00.599 INFO:tasks.workunit.client.0.smithi098.stdout:2/795: dread d1/d9/d26/d35/d88/dc2/dfb/d60/fbb [0,4194304] 0 2024-09-19T07:25:00.600 INFO:tasks.workunit.client.0.smithi098.stdout:3/722: dread de/df/d31/d61/f4c [0,4194304] 0 2024-09-19T07:25:00.600 INFO:tasks.workunit.client.0.smithi098.stdout:3/723: truncate de/f26 4795671 0 2024-09-19T07:25:00.600 INFO:tasks.workunit.client.0.smithi098.stdout:2/796: rename d1/d9/d26/d35/d88/dc2/dfb/d60/da5/dd9/cce to d1/d9/d26/d35/d58/c113 0 2024-09-19T07:25:00.601 INFO:tasks.workunit.client.0.smithi098.stdout:3/724: getdents de 0 2024-09-19T07:25:00.601 INFO:tasks.workunit.client.0.smithi098.stdout:3/725: write de/df/d31/d61/d3f/fb9 [1150790,12560] 0 2024-09-19T07:25:00.602 INFO:tasks.workunit.client.0.smithi098.stdout:2/797: rmdir d1/d9/d26/d35/d88/deb 39 2024-09-19T07:25:00.602 INFO:tasks.workunit.client.0.smithi098.stdout:2/798: dread - d1/d9/d3e/f55 zero size 2024-09-19T07:25:00.603 INFO:tasks.workunit.client.0.smithi098.stdout:3/726: symlink de/d4e/d6d/d8c/lda 0 2024-09-19T07:25:00.603 INFO:tasks.workunit.client.0.smithi098.stdout:8/760: dread d0/d33/fda [0,4194304] 0 2024-09-19T07:25:00.604 INFO:tasks.workunit.client.0.smithi098.stdout:7/871: dwrite d5/d8/dc/d16/f2e [0,4194304] 0 2024-09-19T07:25:00.605 INFO:tasks.workunit.client.0.smithi098.stdout:3/727: creat de/df/d16/fdb x:0 0 0 2024-09-19T07:25:00.606 INFO:tasks.workunit.client.0.smithi098.stdout:3/728: link de/df/d1f/f83 de/df/d1f/d2b/fdc 0 2024-09-19T07:25:00.607 INFO:tasks.workunit.client.0.smithi098.stdout:3/729: fdatasync de/d4e/f50 0 2024-09-19T07:25:00.607 INFO:tasks.workunit.client.0.smithi098.stdout:3/730: write de/df/d1f/f99 [1292491,44838] 0 2024-09-19T07:25:00.607 INFO:tasks.workunit.client.0.smithi098.stdout:8/761: rename d0/dc5/fb6 to d0/d33/d55/d8a/d21/deb/ffa 0 2024-09-19T07:25:00.617 INFO:tasks.workunit.client.0.smithi098.stdout:2/799: dread d1/d9/d3e/fd [0,4194304] 0 2024-09-19T07:25:00.617 INFO:tasks.workunit.client.0.smithi098.stdout:2/800: write d1/d9/d26/d35/d88/dc2/dfb/f4b [1681828,48380] 0 2024-09-19T07:25:00.617 INFO:tasks.workunit.client.0.smithi098.stdout:2/801: dread - d1/d5/d72/fe6 zero size 2024-09-19T07:25:00.617 INFO:tasks.workunit.client.0.smithi098.stdout:2/802: dread - d1/d9/d26/fe8 zero size 2024-09-19T07:25:00.618 INFO:tasks.workunit.client.0.smithi098.stdout:2/803: creat d1/d9/d26/d35/f114 x:0 0 0 2024-09-19T07:25:00.618 INFO:tasks.workunit.client.0.smithi098.stdout:2/804: dread - d1/d9/d26/d35/d88/dc2/dfb/d60/db4/f102 zero size 2024-09-19T07:25:00.621 INFO:tasks.workunit.client.0.smithi098.stdout:7/872: read d5/d3e/d62/f70 [3273303,51323] 0 2024-09-19T07:25:00.622 INFO:tasks.workunit.client.0.smithi098.stdout:7/873: link d5/d10/fcd d5/d10/d1d/dff/f11f 0 2024-09-19T07:25:00.624 INFO:tasks.workunit.client.0.smithi098.stdout:7/874: truncate d5/d10/dc2/d5c/dc3/fdf 3223198 0 2024-09-19T07:25:00.624 INFO:tasks.workunit.client.0.smithi098.stdout:2/805: write d1/dcb/dfd/d93/d61/d62/d107/f9c [3474924,126367] 0 2024-09-19T07:25:00.626 INFO:tasks.workunit.client.0.smithi098.stdout:2/806: mknod d1/d5/d34/d5a/db2/c115 0 2024-09-19T07:25:00.627 INFO:tasks.workunit.client.0.smithi098.stdout:2/807: dread d1/d5/d72/db5/d4e/fae [0,4194304] 0 2024-09-19T07:25:00.627 INFO:tasks.workunit.client.0.smithi098.stdout:2/808: fdatasync d1/dcb/dfd/d93/f74 0 2024-09-19T07:25:00.628 INFO:tasks.workunit.client.0.smithi098.stdout:2/809: mknod d1/dcb/dfd/d10b/c116 0 2024-09-19T07:25:00.630 INFO:tasks.workunit.client.0.smithi098.stdout:2/810: creat d1/d9/d26/d35/d88/dc2/dfb/f117 x:0 0 0 2024-09-19T07:25:00.630 INFO:tasks.workunit.client.0.smithi098.stdout:2/811: chown d1/d9/d26/d35/d88/dc2/dfb/d60/da5/dd9/fe9 0 1 2024-09-19T07:25:00.631 INFO:tasks.workunit.client.0.smithi098.stdout:2/812: creat d1/d5/d34/d39/f118 x:0 0 0 2024-09-19T07:25:00.633 INFO:tasks.workunit.client.0.smithi098.stdout:4/765: dwrite da/d31/d46/f51 [0,4194304] 0 2024-09-19T07:25:00.633 INFO:tasks.workunit.client.0.smithi098.stdout:0/858: dwrite d5/d20/d1f/d47/db2/dbf/f89 [0,4194304] 0 2024-09-19T07:25:00.633 INFO:tasks.workunit.client.0.smithi098.stdout:5/655: dwrite dc/de/d13/d46/d2e/da5/fcb [0,4194304] 0 2024-09-19T07:25:00.633 INFO:tasks.workunit.client.0.smithi098.stdout:0/859: chown d5/d20/f42 0 1 2024-09-19T07:25:00.633 INFO:tasks.workunit.client.0.smithi098.stdout:6/736: dwrite d2/d5/d1f/d26/d42/d48/f63 [0,4194304] 0 2024-09-19T07:25:00.633 INFO:tasks.workunit.client.0.smithi098.stdout:3/731: dwrite de/d4e/fae [0,4194304] 0 2024-09-19T07:25:00.633 INFO:tasks.workunit.client.0.smithi098.stdout:8/762: dwrite d0/d33/d44/fb1 [0,4194304] 0 2024-09-19T07:25:00.634 INFO:tasks.workunit.client.0.smithi098.stdout:2/813: creat d1/dcb/dfd/d93/d61/f119 x:0 0 0 2024-09-19T07:25:00.638 INFO:tasks.workunit.client.0.smithi098.stdout:1/871: getdents dc/d2a 0 2024-09-19T07:25:00.642 INFO:tasks.workunit.client.0.smithi098.stdout:1/872: mkdir dc/de/d22/d31/d35/d58/d10f/d131 0 2024-09-19T07:25:00.643 INFO:tasks.workunit.client.0.smithi098.stdout:6/737: unlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/dbf/cd4 0 2024-09-19T07:25:00.643 INFO:tasks.workunit.client.0.smithi098.stdout:6/738: chown d2/db0/f88 323712035 1 2024-09-19T07:25:00.644 INFO:tasks.workunit.client.0.smithi098.stdout:6/739: mkdir d2/d5/d1f/d105/d10b 0 2024-09-19T07:25:00.644 INFO:tasks.workunit.client.0.smithi098.stdout:6/740: readlink d2/d5/d1f/l29 0 2024-09-19T07:25:00.650 INFO:tasks.workunit.client.0.smithi098.stdout:7/875: dwrite d5/dce/ff5 [0,4194304] 0 2024-09-19T07:25:00.650 INFO:tasks.workunit.client.0.smithi098.stdout:7/876: chown d5/d10/d1d/dff/f11f 939106 1 2024-09-19T07:25:00.653 INFO:tasks.workunit.client.0.smithi098.stdout:3/732: dwrite de/df/d31/d61/d79/fb5 [0,4194304] 0 2024-09-19T07:25:00.665 INFO:tasks.workunit.client.0.smithi098.stdout:5/656: mkdir dc/de/d13/d7d/de1 0 2024-09-19T07:25:00.665 INFO:tasks.workunit.client.0.smithi098.stdout:5/657: fdatasync dc/de/d13/d46/d2e/d37/d81/d6a/f76 0 2024-09-19T07:25:00.665 INFO:tasks.workunit.client.0.smithi098.stdout:6/741: rename d2/db0/d4e/d6e/cfa to d2/d5/d1f/d26/d42/d48/dc3/c10c 0 2024-09-19T07:25:00.665 INFO:tasks.workunit.client.0.smithi098.stdout:6/742: readlink d2/d5/d1f/d26/d7b/lbe 0 2024-09-19T07:25:00.666 INFO:tasks.workunit.client.0.smithi098.stdout:0/860: mknod d5/d20/d1f/d47/c117 0 2024-09-19T07:25:00.666 INFO:tasks.workunit.client.0.smithi098.stdout:8/763: mkdir d0/d2c/dfb 0 2024-09-19T07:25:00.667 INFO:tasks.workunit.client.0.smithi098.stdout:6/743: getdents d2/d5/d1f/d26/d42/d48/d53/d64/d6d 0 2024-09-19T07:25:00.667 INFO:tasks.workunit.client.0.smithi098.stdout:6/744: write d2/d5/d1f/d26/d42/f108 [533590,70326] 0 2024-09-19T07:25:00.667 INFO:tasks.workunit.client.0.smithi098.stdout:2/814: mkdir d1/dcb/dfd/d93/d61/d11a 0 2024-09-19T07:25:00.668 INFO:tasks.workunit.client.0.smithi098.stdout:1/873: mknod dc/d17/d1b/d71/d7a/d107/c132 0 2024-09-19T07:25:00.668 INFO:tasks.workunit.client.0.smithi098.stdout:1/874: write dc/de/d22/d31/d5d/f116 [4822046,81961] 0 2024-09-19T07:25:00.669 INFO:tasks.workunit.client.0.smithi098.stdout:7/877: dread d5/d3e/d62/da0/f8c [0,4194304] 0 2024-09-19T07:25:00.669 INFO:tasks.workunit.client.0.smithi098.stdout:3/733: unlink de/d4e/d6d/d8c/lda 0 2024-09-19T07:25:00.670 INFO:tasks.workunit.client.0.smithi098.stdout:1/875: write dc/d17/d1b/d1d/f3f [1435770,55598] 0 2024-09-19T07:25:00.671 INFO:tasks.workunit.client.0.smithi098.stdout:5/658: rmdir dc/de/d13/d46 39 2024-09-19T07:25:00.673 INFO:tasks.workunit.client.0.smithi098.stdout:2/815: dread d1/d5/d34/f96 [0,4194304] 0 2024-09-19T07:25:00.673 INFO:tasks.workunit.client.0.smithi098.stdout:7/878: link d5/f40 d5/d10/d1d/dff/f120 0 2024-09-19T07:25:00.675 INFO:tasks.workunit.client.0.smithi098.stdout:1/876: mkdir dc/d17/d1b/d1d/d133 0 2024-09-19T07:25:00.677 INFO:tasks.workunit.client.0.smithi098.stdout:5/659: creat dc/de/d36/fe2 x:0 0 0 2024-09-19T07:25:00.677 INFO:tasks.workunit.client.0.smithi098.stdout:3/734: rmdir de/df/d31 39 2024-09-19T07:25:00.677 INFO:tasks.workunit.client.0.smithi098.stdout:3/735: stat de/df/d16/fd2 0 2024-09-19T07:25:00.677 INFO:tasks.workunit.client.0.smithi098.stdout:6/745: dread d2/d5/d1f/d26/d42/d48/d53/f5f [0,4194304] 0 2024-09-19T07:25:00.679 INFO:tasks.workunit.client.0.smithi098.stdout:0/861: dread d5/d20/d1f/d52/d64/f95 [0,4194304] 0 2024-09-19T07:25:00.679 INFO:tasks.workunit.client.0.smithi098.stdout:0/862: read d5/d20/d1f/d47/db2/dbf/d6d/f6f [2860472,86227] 0 2024-09-19T07:25:00.679 INFO:tasks.workunit.client.0.smithi098.stdout:2/816: rename d1/dbf/fe3 to d1/d9/d3e/dff/f11b 0 2024-09-19T07:25:00.679 INFO:tasks.workunit.client.0.smithi098.stdout:6/746: write d2/d5/d1f/d26/d42/f108 [235851,113014] 0 2024-09-19T07:25:00.680 INFO:tasks.workunit.client.0.smithi098.stdout:7/879: link d5/d10/d11/d9e/fab d5/d8/d8e/d59/d10b/f121 0 2024-09-19T07:25:00.681 INFO:tasks.workunit.client.0.smithi098.stdout:3/736: getdents de/df 0 2024-09-19T07:25:00.682 INFO:tasks.workunit.client.0.smithi098.stdout:0/863: getdents d5/d20/d1f/d47/db2/dbf 0 2024-09-19T07:25:00.683 INFO:tasks.workunit.client.0.smithi098.stdout:6/747: mknod d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/dbf/c10d 0 2024-09-19T07:25:00.684 INFO:tasks.workunit.client.0.smithi098.stdout:3/737: dread de/df/d1f/d72/f8a [0,4194304] 0 2024-09-19T07:25:00.684 INFO:tasks.workunit.client.0.smithi098.stdout:7/880: mknod d5/dce/c122 0 2024-09-19T07:25:00.687 INFO:tasks.workunit.client.0.smithi098.stdout:0/864: truncate d5/d20/d14/d49/f56 419374 0 2024-09-19T07:25:00.688 INFO:tasks.workunit.client.0.smithi098.stdout:2/817: dread d1/d5/fca [0,4194304] 0 2024-09-19T07:25:00.688 INFO:tasks.workunit.client.0.smithi098.stdout:7/881: mkdir d5/d10/d11/d123 0 2024-09-19T07:25:00.690 INFO:tasks.workunit.client.0.smithi098.stdout:9/820: sync 2024-09-19T07:25:00.690 INFO:tasks.workunit.client.0.smithi098.stdout:2/818: symlink d1/d5/d72/l11c 0 2024-09-19T07:25:00.692 INFO:tasks.workunit.client.0.smithi098.stdout:0/865: mknod d5/d20/d1f/d52/d64/dba/dd2/c118 0 2024-09-19T07:25:00.694 INFO:tasks.workunit.client.0.smithi098.stdout:9/821: dread d3/dc/df/d15/d1a/d2b/d49/d65/f7c [4194304,4194304] 0 2024-09-19T07:25:00.694 INFO:tasks.workunit.client.0.smithi098.stdout:0/866: creat d5/d20/d1f/d47/db2/dd3/d106/d94/f119 x:0 0 0 2024-09-19T07:25:00.694 INFO:tasks.workunit.client.0.smithi098.stdout:0/867: chown d5/d20/d14/d49/f5e 62283215 1 2024-09-19T07:25:00.695 INFO:tasks.workunit.client.0.smithi098.stdout:9/822: rmdir d3/dc/df/da3 39 2024-09-19T07:25:00.698 INFO:tasks.workunit.client.0.smithi098.stdout:0/868: write d5/d20/d1f/d52/d64/d77/fcb [228241,95917] 0 2024-09-19T07:25:00.699 INFO:tasks.workunit.client.0.smithi098.stdout:5/660: dwrite dc/de/d13/d46/d23/d5e/f83 [0,4194304] 0 2024-09-19T07:25:00.700 INFO:tasks.workunit.client.0.smithi098.stdout:7/882: write d5/d10/f3f [3573122,52756] 0 2024-09-19T07:25:00.701 INFO:tasks.workunit.client.0.smithi098.stdout:9/823: symlink d3/l114 0 2024-09-19T07:25:00.701 INFO:tasks.workunit.client.0.smithi098.stdout:9/824: truncate d3/dc/df/d15/d2f/f5f 7693740 0 2024-09-19T07:25:00.702 INFO:tasks.workunit.client.0.smithi098.stdout:5/661: creat dc/de/d13/fe3 x:0 0 0 2024-09-19T07:25:00.703 INFO:tasks.workunit.client.0.smithi098.stdout:2/819: write d1/d9/f24 [1456436,14886] 0 2024-09-19T07:25:00.706 INFO:tasks.workunit.client.0.smithi098.stdout:9/825: read d3/d16/d43/d51/dd3/d8a/fa8 [1085100,20257] 0 2024-09-19T07:25:00.706 INFO:tasks.workunit.client.0.smithi098.stdout:9/826: write d3/d6/d8/f108 [1247185,101850] 0 2024-09-19T07:25:00.712 INFO:tasks.workunit.client.0.smithi098.stdout:2/820: dread d1/d9/d26/d35/d48/f56 [0,4194304] 0 2024-09-19T07:25:00.712 INFO:tasks.workunit.client.0.smithi098.stdout:2/821: fsync d1/d5/d34/d5a/db2/f104 0 2024-09-19T07:25:00.719 INFO:tasks.workunit.client.0.smithi098.stdout:0/869: dwrite d5/d20/d14/d49/d62/da7/fac [0,4194304] 0 2024-09-19T07:25:00.722 INFO:tasks.workunit.client.0.smithi098.stdout:0/870: mknod d5/d20/d1f/d52/d64/d77/c11a 0 2024-09-19T07:25:00.723 INFO:tasks.workunit.client.0.smithi098.stdout:0/871: mkdir d5/d20/d1f/d11b 0 2024-09-19T07:25:00.724 INFO:tasks.workunit.client.0.smithi098.stdout:0/872: getdents d5/d20/d1f/d52/d64/dba/dd2/dea/df2 0 2024-09-19T07:25:00.724 INFO:tasks.workunit.client.0.smithi098.stdout:9/827: dread d3/d16/d38/f2e [0,4194304] 0 2024-09-19T07:25:00.724 INFO:tasks.workunit.client.0.smithi098.stdout:9/828: fdatasync d3/dc/df/d15/d1a/d2b/d49/f76 0 2024-09-19T07:25:00.725 INFO:tasks.workunit.client.0.smithi098.stdout:0/873: symlink d5/d20/d1f/d47/db2/l11c 0 2024-09-19T07:25:00.726 INFO:tasks.workunit.client.0.smithi098.stdout:1/877: rename dc/de/d22/d31/d5d/d6a/d6f/cb2 to dc/d17/d9c/c134 0 2024-09-19T07:25:00.730 INFO:tasks.workunit.client.0.smithi098.stdout:7/883: dwrite d5/dce/dd5/fea [0,4194304] 0 2024-09-19T07:25:00.731 INFO:tasks.workunit.client.0.smithi098.stdout:7/884: dread - d5/d10/d50/df8/f11d zero size 2024-09-19T07:25:00.731 INFO:tasks.workunit.client.0.smithi098.stdout:4/766: sync 2024-09-19T07:25:00.733 INFO:tasks.workunit.client.0.smithi098.stdout:6/748: rename d2/d1b to d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e 0 2024-09-19T07:25:00.733 INFO:tasks.workunit.client.0.smithi098.stdout:9/829: read d3/dc/df/d15/fb8 [2735875,31159] 0 2024-09-19T07:25:00.733 INFO:tasks.workunit.client.0.smithi098.stdout:9/830: write d3/dc/df/d15/d1a/d2b/d49/d65/f7c [7783997,106756] 0 2024-09-19T07:25:00.734 INFO:tasks.workunit.client.0.smithi098.stdout:5/662: rename dc/de/d13/d46/f24 to dc/de/d13/d46/d2e/d37/d81/db8/fe4 0 2024-09-19T07:25:00.736 INFO:tasks.workunit.client.0.smithi098.stdout:9/831: mkdir d3/d16/d43/d115 0 2024-09-19T07:25:00.736 INFO:tasks.workunit.client.0.smithi098.stdout:9/832: fsync d3/d16/d43/dce/f10c 0 2024-09-19T07:25:00.736 INFO:tasks.workunit.client.0.smithi098.stdout:6/749: dread d2/f86 [0,4194304] 0 2024-09-19T07:25:00.738 INFO:tasks.workunit.client.0.smithi098.stdout:4/767: mknod da/d31/d46/d56/d5b/d61/c104 0 2024-09-19T07:25:00.739 INFO:tasks.workunit.client.0.smithi098.stdout:4/768: dread - da/fc7 zero size 2024-09-19T07:25:00.739 INFO:tasks.workunit.client.0.smithi098.stdout:4/769: write da/d31/d46/d5f/d8a/db6/dc2/ff9 [462548,128997] 0 2024-09-19T07:25:00.739 INFO:tasks.workunit.client.0.smithi098.stdout:4/770: stat da/d31/d46/d56/fa0 0 2024-09-19T07:25:00.739 INFO:tasks.workunit.client.0.smithi098.stdout:9/833: dread d3/dc/df/d15/db3/fe7 [0,4194304] 0 2024-09-19T07:25:00.739 INFO:tasks.workunit.client.0.smithi098.stdout:4/771: creat da/d31/d46/d80/ddf/f105 x:0 0 0 2024-09-19T07:25:00.739 INFO:tasks.workunit.client.0.smithi098.stdout:2/822: rename d1/d5/d34/d5a/db2/ld4 to d1/dbf/l11d 0 2024-09-19T07:25:00.740 INFO:tasks.workunit.client.0.smithi098.stdout:2/823: read d1/d9/f2a [1704151,121541] 0 2024-09-19T07:25:00.741 INFO:tasks.workunit.client.0.smithi098.stdout:5/663: creat dc/de/d13/d5c/daf/db9/fe5 x:0 0 0 2024-09-19T07:25:00.741 INFO:tasks.workunit.client.0.smithi098.stdout:6/750: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/l10f 0 2024-09-19T07:25:00.741 INFO:tasks.workunit.client.0.smithi098.stdout:9/834: mknod d3/d16/d43/db1/c116 0 2024-09-19T07:25:00.742 INFO:tasks.workunit.client.0.smithi098.stdout:5/664: mkdir dc/de/d13/d46/d2e/d37/de6 0 2024-09-19T07:25:00.742 INFO:tasks.workunit.client.0.smithi098.stdout:4/772: creat da/d31/d46/d56/d5b/d66/f106 x:0 0 0 2024-09-19T07:25:00.743 INFO:tasks.workunit.client.0.smithi098.stdout:2/824: creat d1/dcb/dfd/f11e x:0 0 0 2024-09-19T07:25:00.744 INFO:tasks.workunit.client.0.smithi098.stdout:4/773: creat da/d59/d5d/f107 x:0 0 0 2024-09-19T07:25:00.744 INFO:tasks.workunit.client.0.smithi098.stdout:2/825: truncate d1/d5/f37 3254994 0 2024-09-19T07:25:00.745 INFO:tasks.workunit.client.0.smithi098.stdout:2/826: symlink d1/d9/dd7/l11f 0 2024-09-19T07:25:00.745 INFO:tasks.workunit.client.0.smithi098.stdout:1/878: rename dc/de/d22/d31/d5d/d6a/d6f/ce8 to dc/de/d22/d31/d5d/d6a/d6f/d4d/dc6/c135 0 2024-09-19T07:25:00.746 INFO:tasks.workunit.client.0.smithi098.stdout:1/879: truncate dc/de/d22/d31/d5d/f6e 1014245 0 2024-09-19T07:25:00.748 INFO:tasks.workunit.client.0.smithi098.stdout:0/874: dwrite d5/d20/d1f/d47/f90 [0,4194304] 0 2024-09-19T07:25:00.748 INFO:tasks.workunit.client.0.smithi098.stdout:0/875: truncate d5/d20/d1f/d47/dae/ffc 102935 0 2024-09-19T07:25:00.750 INFO:tasks.workunit.client.0.smithi098.stdout:7/885: rename d5/d8/dc/fb2 to d5/f124 0 2024-09-19T07:25:00.751 INFO:tasks.workunit.client.0.smithi098.stdout:0/876: symlink d5/d20/d1f/d52/d101/d111/l11d 0 2024-09-19T07:25:00.751 INFO:tasks.workunit.client.0.smithi098.stdout:0/877: fdatasync d5/d20/d1f/d47/db2/dd3/d106/f7c 0 2024-09-19T07:25:00.752 INFO:tasks.workunit.client.0.smithi098.stdout:7/886: creat d5/d10/d11/d123/f125 x:0 0 0 2024-09-19T07:25:00.754 INFO:tasks.workunit.client.0.smithi098.stdout:1/880: dread dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f86 [0,4194304] 0 2024-09-19T07:25:00.755 INFO:tasks.workunit.client.0.smithi098.stdout:4/774: write da/d31/f57 [100946,90828] 0 2024-09-19T07:25:00.762 INFO:tasks.workunit.client.0.smithi098.stdout:1/881: mkdir dc/d17/d1b/d71/d7a/d136 0 2024-09-19T07:25:00.762 INFO:tasks.workunit.client.0.smithi098.stdout:1/882: fdatasync dc/de/d22/d31/d5d/f116 0 2024-09-19T07:25:00.771 INFO:tasks.workunit.client.0.smithi098.stdout:6/751: dwrite d2/d5/d1f/d26/f69 [4194304,4194304] 0 2024-09-19T07:25:00.776 INFO:tasks.workunit.client.0.smithi098.stdout:6/752: creat d2/d5/d1f/d26/d42/da4/f110 x:0 0 0 2024-09-19T07:25:00.778 INFO:tasks.workunit.client.0.smithi098.stdout:6/753: symlink d2/db0/d4e/d6e/l111 0 2024-09-19T07:25:00.778 INFO:tasks.workunit.client.0.smithi098.stdout:6/754: write d2/d5/d1f/d26/d42/d48/f109 [1034483,120575] 0 2024-09-19T07:25:00.778 INFO:tasks.workunit.client.0.smithi098.stdout:6/755: stat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/ff9 0 2024-09-19T07:25:00.779 INFO:tasks.workunit.client.0.smithi098.stdout:6/756: symlink d2/d5/d1f/d26/d42/l112 0 2024-09-19T07:25:00.780 INFO:tasks.workunit.client.0.smithi098.stdout:6/757: creat d2/d5/d1f/d26/f113 x:0 0 0 2024-09-19T07:25:00.781 INFO:tasks.workunit.client.0.smithi098.stdout:6/758: link d2/d5/d1f/f83 d2/d5/d1f/d26/d42/f114 0 2024-09-19T07:25:00.781 INFO:tasks.workunit.client.0.smithi098.stdout:6/759: chown d2/d5/d1f/d26/d42/d48/d53/d64/fa6 246820 1 2024-09-19T07:25:00.781 INFO:tasks.workunit.client.0.smithi098.stdout:6/760: dread - d2/d5/d1f/d26/d42/d48/fec zero size 2024-09-19T07:25:00.782 INFO:tasks.workunit.client.0.smithi098.stdout:2/827: dwrite d1/d9/d26/d35/d58/fb9 [0,4194304] 0 2024-09-19T07:25:00.783 INFO:tasks.workunit.client.0.smithi098.stdout:2/828: truncate d1/d9/d26/d35/d88/dc2/dfb/d60/db4/f102 801206 0 2024-09-19T07:25:00.784 INFO:tasks.workunit.client.0.smithi098.stdout:2/829: creat d1/d9/d26/d35/d48/d6e/f120 x:0 0 0 2024-09-19T07:25:00.784 INFO:tasks.workunit.client.0.smithi098.stdout:2/830: stat d1/d5/fe2 0 2024-09-19T07:25:00.784 INFO:tasks.workunit.client.0.smithi098.stdout:2/831: fsync d1/d9/d26/fe8 0 2024-09-19T07:25:00.785 INFO:tasks.workunit.client.0.smithi098.stdout:2/832: link d1/d5/fca d1/d9/d26/d35/d88/dc2/dfb/d60/da5/f121 0 2024-09-19T07:25:00.785 INFO:tasks.workunit.client.0.smithi098.stdout:2/833: truncate d1/d9/d26/d35/d88/dc2/dfb/d60/f101 158162 0 2024-09-19T07:25:00.786 INFO:tasks.workunit.client.0.smithi098.stdout:2/834: link d1/d9/dd7/c10c d1/d9/d26/d35/d48/d7f/c122 0 2024-09-19T07:25:00.789 INFO:tasks.workunit.client.0.smithi098.stdout:7/887: dwrite d5/d3e/d61/fca [0,4194304] 0 2024-09-19T07:25:00.790 INFO:tasks.workunit.client.0.smithi098.stdout:7/888: mknod d5/d10/d11/c126 0 2024-09-19T07:25:00.792 INFO:tasks.workunit.client.0.smithi098.stdout:4/775: dwrite da/d31/d46/d80/fad [0,4194304] 0 2024-09-19T07:25:00.793 INFO:tasks.workunit.client.0.smithi098.stdout:1/883: dwrite dc/de/d22/d31/d5d/d6a/d6f/d4d/f54 [0,4194304] 0 2024-09-19T07:25:00.797 INFO:tasks.workunit.client.0.smithi098.stdout:7/889: write d5/f3c [2386248,117743] 0 2024-09-19T07:25:00.797 INFO:tasks.workunit.client.0.smithi098.stdout:7/890: stat d5/d10/dc2/d5c/f119 0 2024-09-19T07:25:00.797 INFO:tasks.workunit.client.0.smithi098.stdout:7/891: read d5/d10/d11/f58 [3866736,101473] 0 2024-09-19T07:25:00.798 INFO:tasks.workunit.client.0.smithi098.stdout:7/892: dread - d5/d10/d11/d9e/f112 zero size 2024-09-19T07:25:00.799 INFO:tasks.workunit.client.0.smithi098.stdout:1/884: symlink dc/d17/d1b/d71/d7a/d107/l137 0 2024-09-19T07:25:00.800 INFO:tasks.workunit.client.0.smithi098.stdout:7/893: mknod d5/d10/dc2/dbd/c127 0 2024-09-19T07:25:00.800 INFO:tasks.workunit.client.0.smithi098.stdout:1/885: link dc/de/d50/f61 dc/de/d22/d31/d35/d58/dec/d10a/f138 0 2024-09-19T07:25:00.801 INFO:tasks.workunit.client.0.smithi098.stdout:1/886: fsync dc/f12d 0 2024-09-19T07:25:00.801 INFO:tasks.workunit.client.0.smithi098.stdout:1/887: fsync dc/de/d22/d31/d5d/d6a/d6f/ffe 0 2024-09-19T07:25:00.802 INFO:tasks.workunit.client.0.smithi098.stdout:7/894: creat d5/d10/dc2/dbd/dfc/f128 x:0 0 0 2024-09-19T07:25:00.802 INFO:tasks.workunit.client.0.smithi098.stdout:7/895: fdatasync d5/d8/d5d/f10e 0 2024-09-19T07:25:00.802 INFO:tasks.workunit.client.0.smithi098.stdout:1/888: truncate dc/de/d50/f61 1949619 0 2024-09-19T07:25:00.803 INFO:tasks.workunit.client.0.smithi098.stdout:1/889: write dc/de/d22/d31/d5d/d6a/de0/fff [249100,57851] 0 2024-09-19T07:25:00.803 INFO:tasks.workunit.client.0.smithi098.stdout:1/890: creat dc/de/d22/d31/d35/f139 x:0 0 0 2024-09-19T07:25:00.809 INFO:tasks.workunit.client.0.smithi098.stdout:2/835: dwrite d1/d9/d26/d35/d48/d7f/fc5 [0,4194304] 0 2024-09-19T07:25:00.810 INFO:tasks.workunit.client.0.smithi098.stdout:2/836: write d1/d9/f27 [176800,87600] 0 2024-09-19T07:25:00.811 INFO:tasks.workunit.client.0.smithi098.stdout:5/665: rename dc/de/d13/d46/d2e/d37/c60 to dc/de/d13/d46/d2e/d37/d81/ce7 0 2024-09-19T07:25:00.814 INFO:tasks.workunit.client.0.smithi098.stdout:2/837: creat d1/d9/d26/d35/d88/dc2/dfb/d60/d65/da0/f123 x:0 0 0 2024-09-19T07:25:00.814 INFO:tasks.workunit.client.0.smithi098.stdout:2/838: fdatasync d1/d9/d26/d35/d88/dc2/dfb/d60/da5/dd9/fe9 0 2024-09-19T07:25:00.815 INFO:tasks.workunit.client.0.smithi098.stdout:4/776: rename da/d59/f6a to da/d31/d46/d80/ddf/df2/f108 0 2024-09-19T07:25:00.815 INFO:tasks.workunit.client.0.smithi098.stdout:1/891: write dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/f44 [2504628,69021] 0 2024-09-19T07:25:00.815 INFO:tasks.workunit.client.0.smithi098.stdout:1/892: fdatasync dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/fde 0 2024-09-19T07:25:00.815 INFO:tasks.workunit.client.0.smithi098.stdout:2/839: truncate d1/d5/d34/f7c 3342541 0 2024-09-19T07:25:00.815 INFO:tasks.workunit.client.0.smithi098.stdout:1/893: mkdir dc/de/d22/d31/d5d/d6a/d13a 0 2024-09-19T07:25:00.816 INFO:tasks.workunit.client.0.smithi098.stdout:8/764: sync 2024-09-19T07:25:00.821 INFO:tasks.workunit.client.0.smithi098.stdout:5/666: rename dc/de/d13/d46/f5a to dc/de/d13/d5c/daf/db9/fe8 0 2024-09-19T07:25:00.821 INFO:tasks.workunit.client.0.smithi098.stdout:2/840: symlink d1/d9/d26/d35/d88/dc2/dfb/d60/da5/d10e/l124 0 2024-09-19T07:25:00.821 INFO:tasks.workunit.client.0.smithi098.stdout:2/841: write d1/d9/d26/d35/d48/d6e/f120 [277625,95829] 0 2024-09-19T07:25:00.821 INFO:tasks.workunit.client.0.smithi098.stdout:1/894: truncate dc/f33 2241420 0 2024-09-19T07:25:00.822 INFO:tasks.workunit.client.0.smithi098.stdout:8/765: creat d0/d33/d55/d8a/d21/deb/ffc x:0 0 0 2024-09-19T07:25:00.822 INFO:tasks.workunit.client.0.smithi098.stdout:5/667: getdents dc/de/dc0 0 2024-09-19T07:25:00.824 INFO:tasks.workunit.client.0.smithi098.stdout:2/842: truncate d1/d9/d26/d35/d58/f12 5662211 0 2024-09-19T07:25:00.824 INFO:tasks.workunit.client.0.smithi098.stdout:2/843: chown d1/d9/d26/d35/d88/dc2/dfb/d60/f101 60669573 1 2024-09-19T07:25:00.826 INFO:tasks.workunit.client.0.smithi098.stdout:1/895: symlink dc/d17/d1b/d71/d7a/l13b 0 2024-09-19T07:25:00.828 INFO:tasks.workunit.client.0.smithi098.stdout:1/896: unlink dc/de/d22/d31/d5d/d6a/c118 0 2024-09-19T07:25:00.829 INFO:tasks.workunit.client.0.smithi098.stdout:8/766: symlink d0/d33/d55/d8a/d12/d6c/lfd 0 2024-09-19T07:25:00.829 INFO:tasks.workunit.client.0.smithi098.stdout:1/897: creat dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f13c x:0 0 0 2024-09-19T07:25:00.831 INFO:tasks.workunit.client.0.smithi098.stdout:7/896: link d5/d3e/d62/da0/dc5/fd7 d5/d8/dc/da7/f129 0 2024-09-19T07:25:00.831 INFO:tasks.workunit.client.0.smithi098.stdout:7/897: stat d5/d8/d52/c117 0 2024-09-19T07:25:00.832 INFO:tasks.workunit.client.0.smithi098.stdout:1/898: rmdir dc/de/d22/d31/d5d/d6a/d13a 0 2024-09-19T07:25:00.833 INFO:tasks.workunit.client.0.smithi098.stdout:1/899: write dc/de/d22/d31/f4c [308172,35502] 0 2024-09-19T07:25:00.836 INFO:tasks.workunit.client.0.smithi098.stdout:5/668: creat dc/de/d13/d46/d2e/d62/fe9 x:0 0 0 2024-09-19T07:25:00.836 INFO:tasks.workunit.client.0.smithi098.stdout:5/669: write dc/de/d36/fe2 [342616,106125] 0 2024-09-19T07:25:00.836 INFO:tasks.workunit.client.0.smithi098.stdout:8/767: creat d0/d33/d44/ffe x:0 0 0 2024-09-19T07:25:00.838 INFO:tasks.workunit.client.0.smithi098.stdout:7/898: truncate d5/d8/dc/d16/f2e 1776387 0 2024-09-19T07:25:00.838 INFO:tasks.workunit.client.0.smithi098.stdout:7/899: readlink d5/d8/dc/d16/l3b 0 2024-09-19T07:25:00.841 INFO:tasks.workunit.client.0.smithi098.stdout:5/670: creat dc/de/d13/d5c/fea x:0 0 0 2024-09-19T07:25:00.841 INFO:tasks.workunit.client.0.smithi098.stdout:1/900: chown dc/de/d22/d31/d5d/d6a/d6f/f39 35486118 1 2024-09-19T07:25:00.841 INFO:tasks.workunit.client.0.smithi098.stdout:1/901: write dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/db1/fc1 [1167815,117225] 0 2024-09-19T07:25:00.842 INFO:tasks.workunit.client.0.smithi098.stdout:8/768: dread d0/f22 [4194304,4194304] 0 2024-09-19T07:25:00.847 INFO:tasks.workunit.client.0.smithi098.stdout:8/769: rmdir d0/d33/d55/d8a/d21/deb 39 2024-09-19T07:25:00.848 INFO:tasks.workunit.client.0.smithi098.stdout:7/900: dread d5/dce/fd2 [0,4194304] 0 2024-09-19T07:25:00.851 INFO:tasks.workunit.client.0.smithi098.stdout:7/901: creat d5/dce/f12a x:0 0 0 2024-09-19T07:25:00.857 INFO:tasks.workunit.client.0.smithi098.stdout:7/902: write d5/d8/dc/fe [1105222,45076] 0 2024-09-19T07:25:00.858 INFO:tasks.workunit.client.0.smithi098.stdout:7/903: dread - d5/d10/d11/d123/f125 zero size 2024-09-19T07:25:00.858 INFO:tasks.workunit.client.0.smithi098.stdout:7/904: write d5/d3e/d62/da0/f88 [3107704,6241] 0 2024-09-19T07:25:00.862 INFO:tasks.workunit.client.0.smithi098.stdout:3/738: sync 2024-09-19T07:25:00.862 INFO:tasks.workunit.client.0.smithi098.stdout:4/777: rename da/d31/d46/d80 to da/d31/d46/d5f/d8a/db6/dc2/de7/d109 0 2024-09-19T07:25:00.863 INFO:tasks.workunit.client.0.smithi098.stdout:4/778: readlink da/d31/l4c 0 2024-09-19T07:25:00.863 INFO:tasks.workunit.client.0.smithi098.stdout:4/779: stat da/l27 0 2024-09-19T07:25:00.863 INFO:tasks.workunit.client.0.smithi098.stdout:3/739: mkdir de/df/d31/d61/d69/ddd 0 2024-09-19T07:25:00.864 INFO:tasks.workunit.client.0.smithi098.stdout:4/780: rmdir da/d59/d5d 39 2024-09-19T07:25:00.866 INFO:tasks.workunit.client.0.smithi098.stdout:7/905: read d5/d3e/d62/fb1 [265366,29932] 0 2024-09-19T07:25:00.866 INFO:tasks.workunit.client.0.smithi098.stdout:7/906: dread - d5/d10/d11/d9e/fab zero size 2024-09-19T07:25:00.866 INFO:tasks.workunit.client.0.smithi098.stdout:4/781: mkdir da/d31/d46/d56/d5b/db9/df0/d10a 0 2024-09-19T07:25:00.866 INFO:tasks.workunit.client.0.smithi098.stdout:5/671: dwrite dc/de/d13/d5c/fea [0,4194304] 0 2024-09-19T07:25:00.867 INFO:tasks.workunit.client.0.smithi098.stdout:7/907: creat d5/d3e/df2/f12b x:0 0 0 2024-09-19T07:25:00.870 INFO:tasks.workunit.client.0.smithi098.stdout:5/672: rename dc/de/d13/c2b to dc/ceb 0 2024-09-19T07:25:00.871 INFO:tasks.workunit.client.0.smithi098.stdout:7/908: creat d5/d8/d52/f12c x:0 0 0 2024-09-19T07:25:00.873 INFO:tasks.workunit.client.0.smithi098.stdout:5/673: dread dc/de/d36/fe2 [0,4194304] 0 2024-09-19T07:25:00.873 INFO:tasks.workunit.client.0.smithi098.stdout:5/674: fsync dc/de/d13/d46/f26 0 2024-09-19T07:25:00.873 INFO:tasks.workunit.client.0.smithi098.stdout:5/675: fdatasync dc/de/d13/d46/d2e/d37/d81/db8/fdd 0 2024-09-19T07:25:00.873 INFO:tasks.workunit.client.0.smithi098.stdout:7/909: symlink d5/d10/d1d/dff/l12d 0 2024-09-19T07:25:00.887 INFO:tasks.workunit.client.0.smithi098.stdout:5/676: write dc/de/d13/d5c/da2/f94 [1323843,79851] 0 2024-09-19T07:25:00.889 INFO:tasks.workunit.client.0.smithi098.stdout:5/677: creat dc/de/d13/d46/d23/d5e/fec x:0 0 0 2024-09-19T07:25:00.889 INFO:tasks.workunit.client.0.smithi098.stdout:7/910: dread d5/d10/d11/f105 [0,4194304] 0 2024-09-19T07:25:00.889 INFO:tasks.workunit.client.0.smithi098.stdout:7/911: write d5/d10/d11/d9e/f112 [570638,51107] 0 2024-09-19T07:25:00.892 INFO:tasks.workunit.client.0.smithi098.stdout:8/770: dwrite d0/d16/d65/fd6 [0,4194304] 0 2024-09-19T07:25:00.893 INFO:tasks.workunit.client.0.smithi098.stdout:3/740: dwrite de/df/d1f/f7f [0,4194304] 0 2024-09-19T07:25:00.893 INFO:tasks.workunit.client.0.smithi098.stdout:4/782: dwrite da/d31/d46/d5f/d8a/db6/dc2/de7/d109/fa3 [0,4194304] 0 2024-09-19T07:25:00.893 INFO:tasks.workunit.client.0.smithi098.stdout:4/783: write da/d31/d46/d5f/d8a/ff5 [608011,119008] 0 2024-09-19T07:25:00.894 INFO:tasks.workunit.client.0.smithi098.stdout:5/678: dread dc/de/f34 [0,4194304] 0 2024-09-19T07:25:00.896 INFO:tasks.workunit.client.0.smithi098.stdout:4/784: dread da/d31/d46/d5f/d8a/db6/dc2/ff9 [0,4194304] 0 2024-09-19T07:25:00.896 INFO:tasks.workunit.client.0.smithi098.stdout:4/785: write da/d59/d5d/f68 [813639,3016] 0 2024-09-19T07:25:00.900 INFO:tasks.workunit.client.0.smithi098.stdout:5/679: rmdir dc/de/d13/d7d/de1 0 2024-09-19T07:25:00.904 INFO:tasks.workunit.client.0.smithi098.stdout:4/786: write da/d31/d46/d56/d5b/db9/fd9 [3448929,118085] 0 2024-09-19T07:25:00.907 INFO:tasks.workunit.client.0.smithi098.stdout:4/787: mkdir da/d10b 0 2024-09-19T07:25:00.908 INFO:tasks.workunit.client.0.smithi098.stdout:3/741: dread f0 [0,4194304] 0 2024-09-19T07:25:00.909 INFO:tasks.workunit.client.0.smithi098.stdout:3/742: creat de/d4e/fde x:0 0 0 2024-09-19T07:25:00.916 INFO:tasks.workunit.client.0.smithi098.stdout:4/788: write da/f4b [2194852,23650] 0 2024-09-19T07:25:00.916 INFO:tasks.workunit.client.0.smithi098.stdout:4/789: fdatasync da/d31/d46/d56/d5b/d66/f7a 0 2024-09-19T07:25:00.919 INFO:tasks.workunit.client.0.smithi098.stdout:4/790: dread da/d31/d46/fdc [0,4194304] 0 2024-09-19T07:25:00.920 INFO:tasks.workunit.client.0.smithi098.stdout:4/791: creat da/d59/deb/f10c x:0 0 0 2024-09-19T07:25:00.920 INFO:tasks.workunit.client.0.smithi098.stdout:8/771: dwrite d0/d33/d55/d8a/d12/dba/df2/d9e/da4/db9/ff6 [0,4194304] 0 2024-09-19T07:25:00.922 INFO:tasks.workunit.client.0.smithi098.stdout:5/680: rename dc/de/d13/d5c/daf/db9/fe5 to dc/de/d13/d46/d2e/d37/d67/d75/fed 0 2024-09-19T07:25:00.924 INFO:tasks.workunit.client.0.smithi098.stdout:5/681: mkdir dc/de/d13/d46/d2e/d37/d6d/dee 0 2024-09-19T07:25:00.925 INFO:tasks.workunit.client.0.smithi098.stdout:5/682: rmdir dc/de/d13/d46/d2e/d37/d67/d75 39 2024-09-19T07:25:00.931 INFO:tasks.workunit.client.0.smithi098.stdout:3/743: dwrite de/df/f37 [4194304,4194304] 0 2024-09-19T07:25:00.934 INFO:tasks.workunit.client.0.smithi098.stdout:8/772: write d0/d1a/f3b [3600642,65305] 0 2024-09-19T07:25:00.934 INFO:tasks.workunit.client.0.smithi098.stdout:3/744: rename de/d4e/f6a to de/d4e/fdf 0 2024-09-19T07:25:00.935 INFO:tasks.workunit.client.0.smithi098.stdout:8/773: rmdir d0/d33/df3 0 2024-09-19T07:25:00.936 INFO:tasks.workunit.client.0.smithi098.stdout:8/774: fdatasync d0/f25 0 2024-09-19T07:25:00.937 INFO:tasks.workunit.client.0.smithi098.stdout:3/745: creat de/d4e/fe0 x:0 0 0 2024-09-19T07:25:00.937 INFO:tasks.workunit.client.0.smithi098.stdout:3/746: getdents de 0 2024-09-19T07:25:00.937 INFO:tasks.workunit.client.0.smithi098.stdout:8/775: mknod d0/d16/d65/cff 0 2024-09-19T07:25:00.937 INFO:tasks.workunit.client.0.smithi098.stdout:3/747: creat de/df/d1f/d2b/d93/fe1 x:0 0 0 2024-09-19T07:25:00.938 INFO:tasks.workunit.client.0.smithi098.stdout:3/748: mkdir de/df/d31/d61/d69/ddd/de2 0 2024-09-19T07:25:00.948 INFO:tasks.workunit.client.0.smithi098.stdout:5/683: dwrite dc/de/d13/d46/d2e/d37/d81/fd1 [0,4194304] 0 2024-09-19T07:25:00.949 INFO:tasks.workunit.client.0.smithi098.stdout:5/684: symlink dc/de/dc0/lef 0 2024-09-19T07:25:00.951 INFO:tasks.workunit.client.0.smithi098.stdout:9/835: sync 2024-09-19T07:25:00.951 INFO:tasks.workunit.client.0.smithi098.stdout:9/836: write d3/dc/df/d31/fda [709192,79368] 0 2024-09-19T07:25:00.951 INFO:tasks.workunit.client.0.smithi098.stdout:5/685: truncate dc/de/d36/d71/d84/f8f 366174 0 2024-09-19T07:25:00.951 INFO:tasks.workunit.client.0.smithi098.stdout:5/686: stat dc/de/d13/d46/d2e/d62/lc8 0 2024-09-19T07:25:00.952 INFO:tasks.workunit.client.0.smithi098.stdout:5/687: mknod dc/de/d13/d46/d2e/da5/cf0 0 2024-09-19T07:25:00.955 INFO:tasks.workunit.client.0.smithi098.stdout:8/776: dwrite d0/dc5/fe4 [0,4194304] 0 2024-09-19T07:25:00.955 INFO:tasks.workunit.client.0.smithi098.stdout:8/777: read d0/d33/d55/d8a/f75 [4164889,82951] 0 2024-09-19T07:25:00.956 INFO:tasks.workunit.client.0.smithi098.stdout:4/792: rename da/d31/d46/d5f/d8a/db6/dc2/ff3 to da/d31/d46/d5f/d8a/db6/dc2/de7/d109/ddf/df2/f10d 0 2024-09-19T07:25:00.958 INFO:tasks.workunit.client.0.smithi098.stdout:5/688: write dc/de/d13/d46/d2e/f77 [54726,71143] 0 2024-09-19T07:25:00.958 INFO:tasks.workunit.client.0.smithi098.stdout:5/689: chown dc/de/d13/f14 5 1 2024-09-19T07:25:00.959 INFO:tasks.workunit.client.0.smithi098.stdout:5/690: read dc/de/d13/d46/f64 [17373,70084] 0 2024-09-19T07:25:00.959 INFO:tasks.workunit.client.0.smithi098.stdout:5/691: write dc/de/d13/d46/d2e/fc2 [519557,80160] 0 2024-09-19T07:25:00.960 INFO:tasks.workunit.client.0.smithi098.stdout:8/778: mknod d0/d33/d55/d8a/d12/dba/df2/d9e/c100 0 2024-09-19T07:25:00.964 INFO:tasks.workunit.client.0.smithi098.stdout:8/779: truncate d0/d33/d55/d8a/d12/dba/fec 4093650 0 2024-09-19T07:25:00.964 INFO:tasks.workunit.client.0.smithi098.stdout:8/780: chown d0/c42 263062235 1 2024-09-19T07:25:00.966 INFO:tasks.workunit.client.0.smithi098.stdout:3/749: dwrite de/df/d1f/d2b/f5e [0,4194304] 0 2024-09-19T07:25:00.966 INFO:tasks.workunit.client.0.smithi098.stdout:3/750: write de/df/d31/d61/d79/fce [584162,74458] 0 2024-09-19T07:25:00.966 INFO:tasks.workunit.client.0.smithi098.stdout:8/781: creat d0/d2c/dfb/f101 x:0 0 0 2024-09-19T07:25:00.966 INFO:tasks.workunit.client.0.smithi098.stdout:8/782: readlink d0/d33/d44/l98 0 2024-09-19T07:25:00.966 INFO:tasks.workunit.client.0.smithi098.stdout:3/751: write de/df/f63 [805889,27459] 0 2024-09-19T07:25:00.972 INFO:tasks.workunit.client.0.smithi098.stdout:5/692: dread dc/de/d13/d46/d2e/d37/d81/d6a/f76 [0,4194304] 0 2024-09-19T07:25:00.972 INFO:tasks.workunit.client.0.smithi098.stdout:5/693: readlink dc/de/d13/d46/d2e/d62/l8b 0 2024-09-19T07:25:00.973 INFO:tasks.workunit.client.0.smithi098.stdout:8/783: link d0/d33/d55/d8a/d12/dba/fec d0/d33/d55/d8a/d12/f102 0 2024-09-19T07:25:00.975 INFO:tasks.workunit.client.0.smithi098.stdout:8/784: truncate d0/d16/f79 3181609 0 2024-09-19T07:25:00.975 INFO:tasks.workunit.client.0.smithi098.stdout:8/785: write d0/fdf [795998,53111] 0 2024-09-19T07:25:00.977 INFO:tasks.workunit.client.0.smithi098.stdout:8/786: creat d0/d16/d7d/f103 x:0 0 0 2024-09-19T07:25:00.979 INFO:tasks.workunit.client.0.smithi098.stdout:8/787: link d0/dc5/c84 d0/d33/d55/d8a/d12/dba/df2/c104 0 2024-09-19T07:25:00.979 INFO:tasks.workunit.client.0.smithi098.stdout:8/788: stat d0/d16/d65/d9a/fb4 0 2024-09-19T07:25:00.979 INFO:tasks.workunit.client.0.smithi098.stdout:8/789: write d0/d1a/dcf/ff1 [348788,39524] 0 2024-09-19T07:25:00.979 INFO:tasks.workunit.client.0.smithi098.stdout:8/790: chown d0/d1a/f49 832 1 2024-09-19T07:25:00.979 INFO:tasks.workunit.client.0.smithi098.stdout:8/791: write d0/d2c/dfb/f101 [509283,37911] 0 2024-09-19T07:25:00.980 INFO:tasks.workunit.client.0.smithi098.stdout:8/792: chown d0/d16 3648291 1 2024-09-19T07:25:00.980 INFO:tasks.workunit.client.0.smithi098.stdout:1/902: sync 2024-09-19T07:25:00.980 INFO:tasks.workunit.client.0.smithi098.stdout:0/878: sync 2024-09-19T07:25:00.980 INFO:tasks.workunit.client.0.smithi098.stdout:6/761: sync 2024-09-19T07:25:00.980 INFO:tasks.workunit.client.0.smithi098.stdout:2/844: sync 2024-09-19T07:25:00.980 INFO:tasks.workunit.client.0.smithi098.stdout:6/762: truncate d2/d5/d1f/d26/d7b/ff8 865441 0 2024-09-19T07:25:00.980 INFO:tasks.workunit.client.0.smithi098.stdout:1/903: write dc/f49 [1371829,33252] 0 2024-09-19T07:25:00.980 INFO:tasks.workunit.client.0.smithi098.stdout:8/793: symlink d0/d16/d61/l105 0 2024-09-19T07:25:00.981 INFO:tasks.workunit.client.0.smithi098.stdout:8/794: chown d0/d1a/f3b 1111814 1 2024-09-19T07:25:00.981 INFO:tasks.workunit.client.0.smithi098.stdout:9/837: dwrite d3/d16/d43/d51/d6e/f10e [0,4194304] 0 2024-09-19T07:25:00.982 INFO:tasks.workunit.client.0.smithi098.stdout:1/904: symlink dc/d17/d1b/d1d/l13d 0 2024-09-19T07:25:00.983 INFO:tasks.workunit.client.0.smithi098.stdout:1/905: link dc/de/d22/d31/d5d/d6a/d6f/d4d/f54 dc/de/d22/d128/f13e 0 2024-09-19T07:25:00.984 INFO:tasks.workunit.client.0.smithi098.stdout:8/795: mkdir d0/dc5/d106 0 2024-09-19T07:25:00.984 INFO:tasks.workunit.client.0.smithi098.stdout:8/796: chown d0/cd 1 1 2024-09-19T07:25:00.985 INFO:tasks.workunit.client.0.smithi098.stdout:6/763: rmdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e/d8f 39 2024-09-19T07:25:00.985 INFO:tasks.workunit.client.0.smithi098.stdout:6/764: truncate d2/d5/d1f/d26/f55 1587813 0 2024-09-19T07:25:00.985 INFO:tasks.workunit.client.0.smithi098.stdout:6/765: chown d2/db0/d8d/lcf 327576 1 2024-09-19T07:25:00.985 INFO:tasks.workunit.client.0.smithi098.stdout:6/766: dread - d2/db0/d8d/ff4 zero size 2024-09-19T07:25:00.986 INFO:tasks.workunit.client.0.smithi098.stdout:6/767: link d2/d5/d1f/d26/f67 d2/d5/d1f/d26/d42/d48/d53/da2/f115 0 2024-09-19T07:25:00.988 INFO:tasks.workunit.client.0.smithi098.stdout:9/838: link d3/dc/df/d31/c39 d3/d16/c117 0 2024-09-19T07:25:00.988 INFO:tasks.workunit.client.0.smithi098.stdout:8/797: mknod d0/d16/c107 0 2024-09-19T07:25:00.989 INFO:tasks.workunit.client.0.smithi098.stdout:4/793: dwrite da/d31/d46/d5f/d8a/db6/dc2/de7/d109/ff7 [0,4194304] 0 2024-09-19T07:25:00.989 INFO:tasks.workunit.client.0.smithi098.stdout:4/794: fdatasync f8 0 2024-09-19T07:25:00.993 INFO:tasks.workunit.client.0.smithi098.stdout:9/839: creat d3/d16/d43/d61/da6/f118 x:0 0 0 2024-09-19T07:25:00.993 INFO:tasks.workunit.client.0.smithi098.stdout:9/840: write d3/d6/d46/d83/fdb [771951,70816] 0 2024-09-19T07:25:01.003 INFO:tasks.workunit.client.0.smithi098.stdout:5/694: dwrite dc/de/d13/d46/d2e/fcf [0,4194304] 0 2024-09-19T07:25:01.006 INFO:tasks.workunit.client.0.smithi098.stdout:3/752: dwrite de/df/f63 [0,4194304] 0 2024-09-19T07:25:01.006 INFO:tasks.workunit.client.0.smithi098.stdout:5/695: rename dc/de/d13/d46/f26 to dc/de/d13/d46/d2e/d37/d81/db8/ff1 0 2024-09-19T07:25:01.008 INFO:tasks.workunit.client.0.smithi098.stdout:5/696: creat dc/de/d13/d46/d2e/da5/ff2 x:0 0 0 2024-09-19T07:25:01.009 INFO:tasks.workunit.client.0.smithi098.stdout:5/697: fsync dc/de/d13/d46/d2e/d37/d81/d6a/f7c 0 2024-09-19T07:25:01.009 INFO:tasks.workunit.client.0.smithi098.stdout:1/906: read dc/de/d22/f4b [656175,130350] 0 2024-09-19T07:25:01.009 INFO:tasks.workunit.client.0.smithi098.stdout:1/907: chown dc/da5/dcf 414578406 1 2024-09-19T07:25:01.009 INFO:tasks.workunit.client.0.smithi098.stdout:3/753: rename de/df/d31 to de/df/d31/d61/de3 22 2024-09-19T07:25:01.009 INFO:tasks.workunit.client.0.smithi098.stdout:5/698: truncate dc/de/f34 1398714 0 2024-09-19T07:25:01.010 INFO:tasks.workunit.client.0.smithi098.stdout:8/798: dread d0/d2c/dfb/f101 [0,4194304] 0 2024-09-19T07:25:01.010 INFO:tasks.workunit.client.0.smithi098.stdout:1/908: symlink dc/de/d22/d31/d35/d58/d10f/l13f 0 2024-09-19T07:25:01.010 INFO:tasks.workunit.client.0.smithi098.stdout:3/754: symlink de/df/d1f/d2b/d93/le4 0 2024-09-19T07:25:01.010 INFO:tasks.workunit.client.0.smithi098.stdout:5/699: mknod dc/cf3 0 2024-09-19T07:25:01.011 INFO:tasks.workunit.client.0.smithi098.stdout:8/799: rmdir d0/d33/d55/d8a/d12/dba/df2/d9e/da4 39 2024-09-19T07:25:01.012 INFO:tasks.workunit.client.0.smithi098.stdout:1/909: creat dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f140 x:0 0 0 2024-09-19T07:25:01.012 INFO:tasks.workunit.client.0.smithi098.stdout:1/910: fdatasync dc/de/d22/d31/d35/d58/dec/d10a/f138 0 2024-09-19T07:25:01.013 INFO:tasks.workunit.client.0.smithi098.stdout:5/700: creat dc/de/d13/d46/d23/dc1/ff4 x:0 0 0 2024-09-19T07:25:01.014 INFO:tasks.workunit.client.0.smithi098.stdout:8/800: symlink d0/d16/d65/de3/l108 0 2024-09-19T07:25:01.014 INFO:tasks.workunit.client.0.smithi098.stdout:1/911: creat dc/d17/d1b/d1d/d3d/dc4/d130/f141 x:0 0 0 2024-09-19T07:25:01.015 INFO:tasks.workunit.client.0.smithi098.stdout:8/801: truncate d0/d33/d55/d8a/f75 3481848 0 2024-09-19T07:25:01.016 INFO:tasks.workunit.client.0.smithi098.stdout:8/802: dread - d0/d33/d55/fc3 zero size 2024-09-19T07:25:01.023 INFO:tasks.workunit.client.0.smithi098.stdout:4/795: dwrite da/d31/d46/d56/d5b/db9/fd9 [0,4194304] 0 2024-09-19T07:25:01.023 INFO:tasks.workunit.client.0.smithi098.stdout:4/796: truncate da/d31/f45 5112088 0 2024-09-19T07:25:01.024 INFO:tasks.workunit.client.0.smithi098.stdout:4/797: chown da/d31/d46/d56/d5b/d66/cb3 23930 1 2024-09-19T07:25:01.024 INFO:tasks.workunit.client.0.smithi098.stdout:4/798: write da/d31/d46/d5f/d8a/db6/dc9/fe3 [265502,128753] 0 2024-09-19T07:25:01.024 INFO:tasks.workunit.client.0.smithi098.stdout:0/879: dwrite d5/d20/d1f/d52/d64/ff9 [0,4194304] 0 2024-09-19T07:25:01.024 INFO:tasks.workunit.client.0.smithi098.stdout:0/880: readlink d5/d20/d1f/d47/db2/dbf/d6d/la2 0 2024-09-19T07:25:01.024 INFO:tasks.workunit.client.0.smithi098.stdout:0/881: read - d5/d20/d1f/ffb zero size 2024-09-19T07:25:01.024 INFO:tasks.workunit.client.0.smithi098.stdout:0/882: stat d5/d20/d1f/d47/db2/dd3/d106/d94 0 2024-09-19T07:25:01.025 INFO:tasks.workunit.client.0.smithi098.stdout:4/799: creat da/d31/d46/d5f/d8a/f10e x:0 0 0 2024-09-19T07:25:01.025 INFO:tasks.workunit.client.0.smithi098.stdout:4/800: symlink da/d31/d46/d5f/d8a/db6/dc9/l10f 0 2024-09-19T07:25:01.026 INFO:tasks.workunit.client.0.smithi098.stdout:6/768: dwrite d2/d11/f56 [0,4194304] 0 2024-09-19T07:25:01.027 INFO:tasks.workunit.client.0.smithi098.stdout:6/769: truncate d2/db0/d4e/d6e/d9d/d94/fa0 956430 0 2024-09-19T07:25:01.028 INFO:tasks.workunit.client.0.smithi098.stdout:4/801: mknod da/d31/d46/d56/d5b/db9/c110 0 2024-09-19T07:25:01.028 INFO:tasks.workunit.client.0.smithi098.stdout:6/770: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/l116 0 2024-09-19T07:25:01.030 INFO:tasks.workunit.client.0.smithi098.stdout:9/841: dwrite d3/d16/d38/d48/f9d [0,4194304] 0 2024-09-19T07:25:01.036 INFO:tasks.workunit.client.0.smithi098.stdout:9/842: mkdir d3/d16/d43/d61/da6/dfb/d119 0 2024-09-19T07:25:01.036 INFO:tasks.workunit.client.0.smithi098.stdout:7/912: sync 2024-09-19T07:25:01.036 INFO:tasks.workunit.client.0.smithi098.stdout:2/845: link d1/d5/d72/lcf d1/d5/d72/db5/d4e/l125 0 2024-09-19T07:25:01.037 INFO:tasks.workunit.client.0.smithi098.stdout:9/843: dread d3/d16/d43/d61/f66 [0,4194304] 0 2024-09-19T07:25:01.039 INFO:tasks.workunit.client.0.smithi098.stdout:2/846: mknod d1/d9/d26/d35/d88/dc2/dfb/d60/da5/c126 0 2024-09-19T07:25:01.040 INFO:tasks.workunit.client.0.smithi098.stdout:7/913: creat d5/d10/d11/d123/f12e x:0 0 0 2024-09-19T07:25:01.041 INFO:tasks.workunit.client.0.smithi098.stdout:8/803: write d0/d16/d7d/fb2 [1603882,19700] 0 2024-09-19T07:25:01.041 INFO:tasks.workunit.client.0.smithi098.stdout:8/804: chown d0/d33/d55/d8a/d28/l32 218535 1 2024-09-19T07:25:01.041 INFO:tasks.workunit.client.0.smithi098.stdout:8/805: read - d0/d16/d65/dd8/fe6 zero size 2024-09-19T07:25:01.041 INFO:tasks.workunit.client.0.smithi098.stdout:5/701: dread dc/de/d13/d46/d2e/d37/d67/f89 [0,4194304] 0 2024-09-19T07:25:01.042 INFO:tasks.workunit.client.0.smithi098.stdout:9/844: unlink d3/d6/ld 0 2024-09-19T07:25:01.044 INFO:tasks.workunit.client.0.smithi098.stdout:7/914: unlink d5/d10/d1d/dff/f120 0 2024-09-19T07:25:01.046 INFO:tasks.workunit.client.0.smithi098.stdout:8/806: truncate d0/d1a/f1c 3976404 0 2024-09-19T07:25:01.047 INFO:tasks.workunit.client.0.smithi098.stdout:9/845: symlink d3/d16/d38/l11a 0 2024-09-19T07:25:01.047 INFO:tasks.workunit.client.0.smithi098.stdout:9/846: stat d3/d16/f57 0 2024-09-19T07:25:01.047 INFO:tasks.workunit.client.0.smithi098.stdout:9/847: dread - d3/d16/ff1 zero size 2024-09-19T07:25:01.047 INFO:tasks.workunit.client.0.smithi098.stdout:9/848: write d3/d16/d43/d51/dd3/dc1/f111 [713362,53164] 0 2024-09-19T07:25:01.047 INFO:tasks.workunit.client.0.smithi098.stdout:9/849: write d3/d16/d43/dce/f10c [398719,41052] 0 2024-09-19T07:25:01.048 INFO:tasks.workunit.client.0.smithi098.stdout:9/850: chown d3/dc/df/d15/d1a/dc9/fe9 15149104 1 2024-09-19T07:25:01.049 INFO:tasks.workunit.client.0.smithi098.stdout:8/807: unlink d0/fa5 0 2024-09-19T07:25:01.053 INFO:tasks.workunit.client.0.smithi098.stdout:0/883: dwrite d5/d20/d1f/d52/fb4 [0,4194304] 0 2024-09-19T07:25:01.062 INFO:tasks.workunit.client.0.smithi098.stdout:0/884: write d5/f25 [3882416,116646] 0 2024-09-19T07:25:01.062 INFO:tasks.workunit.client.0.smithi098.stdout:0/885: fsync f4 0 2024-09-19T07:25:01.062 INFO:tasks.workunit.client.0.smithi098.stdout:2/847: dread d1/f57 [0,4194304] 0 2024-09-19T07:25:01.063 INFO:tasks.workunit.client.0.smithi098.stdout:2/848: chown d1/d9/d26/d35/d88/dc2/dfb 844 1 2024-09-19T07:25:01.063 INFO:tasks.workunit.client.0.smithi098.stdout:1/912: dwrite dc/d17/d1b/d71/d81/f96 [0,4194304] 0 2024-09-19T07:25:01.063 INFO:tasks.workunit.client.0.smithi098.stdout:1/913: chown dc/d17/d1b/d71/d81/f110 0 1 2024-09-19T07:25:01.065 INFO:tasks.workunit.client.0.smithi098.stdout:4/802: dwrite da/d31/d46/fdc [0,4194304] 0 2024-09-19T07:25:01.065 INFO:tasks.workunit.client.0.smithi098.stdout:1/914: creat dc/de/d22/d31/d35/d4f/f142 x:0 0 0 2024-09-19T07:25:01.066 INFO:tasks.workunit.client.0.smithi098.stdout:6/771: dwrite d2/d11/daa/fb1 [0,4194304] 0 2024-09-19T07:25:01.066 INFO:tasks.workunit.client.0.smithi098.stdout:6/772: fsync d2/d5/d1f/d26/d7b/ff8 0 2024-09-19T07:25:01.068 INFO:tasks.workunit.client.0.smithi098.stdout:4/803: creat da/d31/f111 x:0 0 0 2024-09-19T07:25:01.068 INFO:tasks.workunit.client.0.smithi098.stdout:4/804: chown da/d59/d5d/f107 287 1 2024-09-19T07:25:01.068 INFO:tasks.workunit.client.0.smithi098.stdout:4/805: chown da/d31/c36 524045562 1 2024-09-19T07:25:01.068 INFO:tasks.workunit.client.0.smithi098.stdout:3/755: rename de/df/d16 to de/df/d1f/d2b/d93/de5 0 2024-09-19T07:25:01.071 INFO:tasks.workunit.client.0.smithi098.stdout:4/806: mknod da/d31/d46/d5f/dc8/c112 0 2024-09-19T07:25:01.072 INFO:tasks.workunit.client.0.smithi098.stdout:4/807: dread - da/d31/d46/d56/d5b/d61/fec zero size 2024-09-19T07:25:01.076 INFO:tasks.workunit.client.0.smithi098.stdout:0/886: dread d5/d20/d1f/d52/d64/da0/fdc [0,4194304] 0 2024-09-19T07:25:01.078 INFO:tasks.workunit.client.0.smithi098.stdout:6/773: dread d2/db0/d4e/f65 [0,4194304] 0 2024-09-19T07:25:01.078 INFO:tasks.workunit.client.0.smithi098.stdout:6/774: chown d2/db0/d8d/fdd 421 1 2024-09-19T07:25:01.079 INFO:tasks.workunit.client.0.smithi098.stdout:6/775: chown d2/d5/d1f/d26/d42/d48/d53/d64/d79/f8c 1 1 2024-09-19T07:25:01.079 INFO:tasks.workunit.client.0.smithi098.stdout:5/702: dwrite dc/de/d13/d46/fbc [0,4194304] 0 2024-09-19T07:25:01.079 INFO:tasks.workunit.client.0.smithi098.stdout:5/703: write dc/de/d13/d46/d23/f5f [475363,22446] 0 2024-09-19T07:25:01.079 INFO:tasks.workunit.client.0.smithi098.stdout:5/704: fdatasync f1 0 2024-09-19T07:25:01.079 INFO:tasks.workunit.client.0.smithi098.stdout:7/915: dwrite d5/d8/dc/fe [0,4194304] 0 2024-09-19T07:25:01.080 INFO:tasks.workunit.client.0.smithi098.stdout:6/776: truncate d2/db0/d4e/d6e/d9d/fa1 397771 0 2024-09-19T07:25:01.084 INFO:tasks.workunit.client.0.smithi098.stdout:1/915: mkdir dc/d17/d1b/d71/d143 0 2024-09-19T07:25:01.086 INFO:tasks.workunit.client.0.smithi098.stdout:3/756: dread de/df/d31/d61/d3f/f5d [0,4194304] 0 2024-09-19T07:25:01.089 INFO:tasks.workunit.client.0.smithi098.stdout:1/916: dread dc/d2a/f42 [0,4194304] 0 2024-09-19T07:25:01.092 INFO:tasks.workunit.client.0.smithi098.stdout:2/849: unlink d1/d5/f37 0 2024-09-19T07:25:01.101 INFO:tasks.workunit.client.0.smithi098.stdout:8/808: rename d0/d16/d61/l83 to d0/d33/d44/dbe/l109 0 2024-09-19T07:25:01.104 INFO:tasks.workunit.client.0.smithi098.stdout:6/777: dwrite d2/d5/d1f/d26/d7b/ff8 [0,4194304] 0 2024-09-19T07:25:01.108 INFO:tasks.workunit.client.0.smithi098.stdout:6/778: symlink d2/d11/l117 0 2024-09-19T07:25:01.115 INFO:tasks.workunit.client.0.smithi098.stdout:6/779: dread d2/db0/d8d/fcc [0,4194304] 0 2024-09-19T07:25:01.117 INFO:tasks.workunit.client.0.smithi098.stdout:5/705: symlink dc/de/d13/lf5 0 2024-09-19T07:25:01.117 INFO:tasks.workunit.client.0.smithi098.stdout:6/780: symlink d2/d5/d1f/d26/d7b/de0/l118 0 2024-09-19T07:25:01.125 INFO:tasks.workunit.client.0.smithi098.stdout:7/916: mknod d5/d3e/d103/c12f 0 2024-09-19T07:25:01.125 INFO:tasks.workunit.client.0.smithi098.stdout:7/917: write d5/d8/d52/fc0 [1066258,85683] 0 2024-09-19T07:25:01.128 INFO:tasks.workunit.client.0.smithi098.stdout:3/757: mkdir de/d4e/d6d/d8c/dab/de6 0 2024-09-19T07:25:01.130 INFO:tasks.workunit.client.0.smithi098.stdout:1/917: symlink dc/d17/d1b/d71/d7a/d136/l144 0 2024-09-19T07:25:01.133 INFO:tasks.workunit.client.0.smithi098.stdout:2/850: getdents d1/d9/d26/d35/d88/dc2/dfb 0 2024-09-19T07:25:01.139 INFO:tasks.workunit.client.0.smithi098.stdout:8/809: creat d0/dc5/d106/f10a x:0 0 0 2024-09-19T07:25:01.146 INFO:tasks.workunit.client.0.smithi098.stdout:7/918: getdents d5/dce/dd5 0 2024-09-19T07:25:01.148 INFO:tasks.workunit.client.0.smithi098.stdout:3/758: truncate de/f46 831245 0 2024-09-19T07:25:01.149 INFO:tasks.workunit.client.0.smithi098.stdout:1/918: symlink dc/d17/d1b/d71/d143/l145 0 2024-09-19T07:25:01.150 INFO:tasks.workunit.client.0.smithi098.stdout:2/851: creat d1/d5/d34/d5a/db2/f127 x:0 0 0 2024-09-19T07:25:01.150 INFO:tasks.workunit.client.0.smithi098.stdout:2/852: readlink d1/dcb/dfd/d93/le5 0 2024-09-19T07:25:01.154 INFO:tasks.workunit.client.0.smithi098.stdout:7/919: mkdir d5/d10/dc2/d5c/dc3/d130 0 2024-09-19T07:25:01.159 INFO:tasks.workunit.client.0.smithi098.stdout:2/853: unlink d1/d9/d26/c110 0 2024-09-19T07:25:01.159 INFO:tasks.workunit.client.0.smithi098.stdout:2/854: readlink d1/d9/d3e/la6 0 2024-09-19T07:25:01.164 INFO:tasks.workunit.client.0.smithi098.stdout:7/920: dread d5/d8/dc/f42 [4194304,4194304] 0 2024-09-19T07:25:01.166 INFO:tasks.workunit.client.0.smithi098.stdout:7/921: mkdir d5/d10/dc2/d131 0 2024-09-19T07:25:01.175 INFO:tasks.workunit.client.0.smithi098.stdout:2/855: dwrite d1/d5/d72/fe6 [0,4194304] 0 2024-09-19T07:25:01.175 INFO:tasks.workunit.client.0.smithi098.stdout:7/922: write d5/d10/dc2/dbd/fcf [4122202,85818] 0 2024-09-19T07:25:01.176 INFO:tasks.workunit.client.0.smithi098.stdout:4/808: read da/d31/d46/d56/d5b/fb2 [199316,107701] 0 2024-09-19T07:25:01.176 INFO:tasks.workunit.client.0.smithi098.stdout:4/809: write da/d31/d46/d56/ffe [112709,59327] 0 2024-09-19T07:25:01.176 INFO:tasks.workunit.client.0.smithi098.stdout:7/923: unlink d5/d3e/d62/da0/dc5/le9 0 2024-09-19T07:25:01.179 INFO:tasks.workunit.client.0.smithi098.stdout:2/856: mknod d1/dcb/c128 0 2024-09-19T07:25:01.180 INFO:tasks.workunit.client.0.smithi098.stdout:7/924: fdatasync d5/d10/dc2/dbd/fcf 0 2024-09-19T07:25:01.181 INFO:tasks.workunit.client.0.smithi098.stdout:3/759: getdents de/df/d31/d61 0 2024-09-19T07:25:01.183 INFO:tasks.workunit.client.0.smithi098.stdout:7/925: dread d5/f53 [4194304,4194304] 0 2024-09-19T07:25:01.183 INFO:tasks.workunit.client.0.smithi098.stdout:7/926: dread - d5/d10/d11/d123/f12e zero size 2024-09-19T07:25:01.183 INFO:tasks.workunit.client.0.smithi098.stdout:7/927: chown d5/d10/dc2/d5c/dc3/d130 54 1 2024-09-19T07:25:01.183 INFO:tasks.workunit.client.0.smithi098.stdout:7/928: chown d5/d8/dc/f42 0 1 2024-09-19T07:25:01.184 INFO:tasks.workunit.client.0.smithi098.stdout:7/929: write d5/d10/dc2/d5c/f119 [41698,112465] 0 2024-09-19T07:25:01.187 INFO:tasks.workunit.client.0.smithi098.stdout:7/930: creat d5/d10/d50/dad/f132 x:0 0 0 2024-09-19T07:25:01.190 INFO:tasks.workunit.client.0.smithi098.stdout:4/810: dread da/d31/d46/d56/fa0 [0,4194304] 0 2024-09-19T07:25:01.191 INFO:tasks.workunit.client.0.smithi098.stdout:4/811: stat da/d31/d46/d56/f89 0 2024-09-19T07:25:01.192 INFO:tasks.workunit.client.0.smithi098.stdout:7/931: getdents d5/d3e/d103 0 2024-09-19T07:25:01.192 INFO:tasks.workunit.client.0.smithi098.stdout:7/932: chown d5/d8/d52/db6/fd1 253 1 2024-09-19T07:25:01.197 INFO:tasks.workunit.client.0.smithi098.stdout:4/812: mkdir da/d31/d46/d56/d5b/db9/df0/d10a/d113 0 2024-09-19T07:25:01.197 INFO:tasks.workunit.client.0.smithi098.stdout:4/813: chown da/d7e/f97 0 1 2024-09-19T07:25:01.197 INFO:tasks.workunit.client.0.smithi098.stdout:4/814: fdatasync da/d31/d46/d56/d5b/d66/fca 0 2024-09-19T07:25:01.197 INFO:tasks.workunit.client.0.smithi098.stdout:4/815: chown da/d31/d46/c47 34 1 2024-09-19T07:25:01.198 INFO:tasks.workunit.client.0.smithi098.stdout:4/816: mkdir da/d31/d46/d114 0 2024-09-19T07:25:01.205 INFO:tasks.workunit.client.0.smithi098.stdout:2/857: dwrite d1/d9/f28 [0,4194304] 0 2024-09-19T07:25:01.213 INFO:tasks.workunit.client.0.smithi098.stdout:2/858: creat d1/d9/d26/d35/d88/f129 x:0 0 0 2024-09-19T07:25:01.218 INFO:tasks.workunit.client.0.smithi098.stdout:4/817: dwrite da/f1d [0,4194304] 0 2024-09-19T07:25:01.220 INFO:tasks.workunit.client.0.smithi098.stdout:4/818: rmdir da/d31/d46/d56/d5b/d61/daa 0 2024-09-19T07:25:01.221 INFO:tasks.workunit.client.0.smithi098.stdout:2/859: dread d1/d9/f14 [0,4194304] 0 2024-09-19T07:25:01.224 INFO:tasks.workunit.client.0.smithi098.stdout:2/860: write d1/d5/d34/fb8 [643110,53313] 0 2024-09-19T07:25:01.225 INFO:tasks.workunit.client.0.smithi098.stdout:2/861: getdents d1/dcb/dfd/d93/d61/d11a 0 2024-09-19T07:25:01.225 INFO:tasks.workunit.client.0.smithi098.stdout:4/819: creat da/d59/d5d/f115 x:0 0 0 2024-09-19T07:25:01.226 INFO:tasks.workunit.client.0.smithi098.stdout:0/887: sync 2024-09-19T07:25:01.226 INFO:tasks.workunit.client.0.smithi098.stdout:6/781: rename d2/d5/d1f/lcd to d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/l119 0 2024-09-19T07:25:01.226 INFO:tasks.workunit.client.0.smithi098.stdout:9/851: sync 2024-09-19T07:25:01.230 INFO:tasks.workunit.client.0.smithi098.stdout:7/933: rename d5/d10/d50/df8/f11d to d5/d3e/f133 0 2024-09-19T07:25:01.230 INFO:tasks.workunit.client.0.smithi098.stdout:7/934: read d5/d3e/d62/f7a [829577,93429] 0 2024-09-19T07:25:01.230 INFO:tasks.workunit.client.0.smithi098.stdout:7/935: dread - d5/d8/d5d/f10e zero size 2024-09-19T07:25:01.231 INFO:tasks.workunit.client.0.smithi098.stdout:0/888: unlink d5/l107 0 2024-09-19T07:25:01.232 INFO:tasks.workunit.client.0.smithi098.stdout:6/782: rename d2/d11/l117 to d2/d11/daa/l11a 0 2024-09-19T07:25:01.232 INFO:tasks.workunit.client.0.smithi098.stdout:6/783: write d2/d5/d1f/d26/d42/d48/fec [804435,27735] 0 2024-09-19T07:25:01.234 INFO:tasks.workunit.client.0.smithi098.stdout:7/936: creat d5/d10/d11/f134 x:0 0 0 2024-09-19T07:25:01.234 INFO:tasks.workunit.client.0.smithi098.stdout:7/937: chown d5/d8/l8a 253242452 1 2024-09-19T07:25:01.234 INFO:tasks.workunit.client.0.smithi098.stdout:6/784: creat d2/d5/d1f/d26/d7b/da3/f11b x:0 0 0 2024-09-19T07:25:01.235 INFO:tasks.workunit.client.0.smithi098.stdout:9/852: dread d3/d6/d46/d83/da9/fc8 [0,4194304] 0 2024-09-19T07:25:01.238 INFO:tasks.workunit.client.0.smithi098.stdout:6/785: rename d2/d11/l78 to d2/d5/d1f/d26/d42/l11c 0 2024-09-19T07:25:01.240 INFO:tasks.workunit.client.0.smithi098.stdout:3/760: chown de/df/d1f/d2b/d93/de5/fdb 742432394 1 2024-09-19T07:25:01.240 INFO:tasks.workunit.client.0.smithi098.stdout:6/786: write d2/d5/f81 [789856,83896] 0 2024-09-19T07:25:01.240 INFO:tasks.workunit.client.0.smithi098.stdout:6/787: fsync d2/d5/d1f/d26/f69 0 2024-09-19T07:25:01.243 INFO:tasks.workunit.client.0.smithi098.stdout:3/761: mkdir de/d4e/de7 0 2024-09-19T07:25:01.243 INFO:tasks.workunit.client.0.smithi098.stdout:3/762: chown de/d4e/d6d/d8c 10890248 1 2024-09-19T07:25:01.243 INFO:tasks.workunit.client.0.smithi098.stdout:3/763: dread - de/df/d1f/d72/f95 zero size 2024-09-19T07:25:01.243 INFO:tasks.workunit.client.0.smithi098.stdout:0/889: read d5/d20/d1f/d47/db2/dd3/d106/d92/fe6 [340376,86499] 0 2024-09-19T07:25:01.243 INFO:tasks.workunit.client.0.smithi098.stdout:6/788: truncate d2/d5/d1f/d26/d42/d48/d53/f5f 3434882 0 2024-09-19T07:25:01.243 INFO:tasks.workunit.client.0.smithi098.stdout:6/789: read - d2/d5/d1f/d26/d42/da4/f110 zero size 2024-09-19T07:25:01.243 INFO:tasks.workunit.client.0.smithi098.stdout:3/764: creat de/df/d1f/d2b/d93/fe8 x:0 0 0 2024-09-19T07:25:01.245 INFO:tasks.workunit.client.0.smithi098.stdout:4/820: dwrite da/d31/d46/d5f/d8a/f10e [0,4194304] 0 2024-09-19T07:25:01.245 INFO:tasks.workunit.client.0.smithi098.stdout:6/790: creat d2/d11/f11d x:0 0 0 2024-09-19T07:25:01.245 INFO:tasks.workunit.client.0.smithi098.stdout:6/791: fdatasync d2/d5/d1f/d26/d42/d48/fab 0 2024-09-19T07:25:01.245 INFO:tasks.workunit.client.0.smithi098.stdout:6/792: chown d2/db0/d8d/lcf 1 1 2024-09-19T07:25:01.245 INFO:tasks.workunit.client.0.smithi098.stdout:6/793: stat d2/d11/c40 0 2024-09-19T07:25:01.245 INFO:tasks.workunit.client.0.smithi098.stdout:3/765: creat de/d4e/d6d/d8c/dab/fe9 x:0 0 0 2024-09-19T07:25:01.246 INFO:tasks.workunit.client.0.smithi098.stdout:3/766: readlink de/df/d31/d61/la8 0 2024-09-19T07:25:01.246 INFO:tasks.workunit.client.0.smithi098.stdout:3/767: stat de/df/d31/d61/d69/ddd/de2 0 2024-09-19T07:25:01.247 INFO:tasks.workunit.client.0.smithi098.stdout:6/794: rmdir d2/d5/d1f/d26/d7b/de0 39 2024-09-19T07:25:01.250 INFO:tasks.workunit.client.0.smithi098.stdout:2/862: dwrite d1/dcb/dfd/f11e [0,4194304] 0 2024-09-19T07:25:01.250 INFO:tasks.workunit.client.0.smithi098.stdout:2/863: fsync d1/d9/d26/d35/d48/d7f/fcc 0 2024-09-19T07:25:01.253 INFO:tasks.workunit.client.0.smithi098.stdout:2/864: getdents d1/d5/d34/d5a/db2 0 2024-09-19T07:25:01.254 INFO:tasks.workunit.client.0.smithi098.stdout:2/865: readlink d1/d9/d26/d35/d48/ddf/lf1 0 2024-09-19T07:25:01.255 INFO:tasks.workunit.client.0.smithi098.stdout:2/866: creat d1/d9/d26/d35/d88/dc2/dfb/d60/da5/dd9/f12a x:0 0 0 2024-09-19T07:25:01.261 INFO:tasks.workunit.client.0.smithi098.stdout:6/795: dread d2/f8e [0,4194304] 0 2024-09-19T07:25:01.261 INFO:tasks.workunit.client.0.smithi098.stdout:6/796: fdatasync d2/d5/d1f/d26/d42/f108 0 2024-09-19T07:25:01.261 INFO:tasks.workunit.client.0.smithi098.stdout:4/821: link da/d31/d46/d5f/ld6 da/d31/d46/d5f/d8a/db6/dc2/l116 0 2024-09-19T07:25:01.261 INFO:tasks.workunit.client.0.smithi098.stdout:6/797: truncate d2/f58 5993139 0 2024-09-19T07:25:01.267 INFO:tasks.workunit.client.0.smithi098.stdout:4/822: rmdir da/d31/d46/d56/d5b 39 2024-09-19T07:25:01.268 INFO:tasks.workunit.client.0.smithi098.stdout:4/823: creat da/d59/deb/f117 x:0 0 0 2024-09-19T07:25:01.270 INFO:tasks.workunit.client.0.smithi098.stdout:6/798: dread d2/d11/f2a [0,4194304] 0 2024-09-19T07:25:01.270 INFO:tasks.workunit.client.0.smithi098.stdout:6/799: truncate d2/d5/d1f/d26/d42/da4/f110 438009 0 2024-09-19T07:25:01.271 INFO:tasks.workunit.client.0.smithi098.stdout:6/800: chown d2/d5/d1f/d26/f33 91519532 1 2024-09-19T07:25:01.271 INFO:tasks.workunit.client.0.smithi098.stdout:6/801: write d2/d5/d1f/d26/fd1 [597882,77035] 0 2024-09-19T07:25:01.273 INFO:tasks.workunit.client.0.smithi098.stdout:2/867: dwrite d1/d9/d3e/dff/f11b [0,4194304] 0 2024-09-19T07:25:01.273 INFO:tasks.workunit.client.0.smithi098.stdout:2/868: fsync d1/d5/d34/d5a/db2/f104 0 2024-09-19T07:25:01.273 INFO:tasks.workunit.client.0.smithi098.stdout:8/810: sync 2024-09-19T07:25:01.273 INFO:tasks.workunit.client.0.smithi098.stdout:0/890: rename d5/d20/d1f/d47/db2/dd3/f102 to d5/d20/d14/d49/f11e 0 2024-09-19T07:25:01.274 INFO:tasks.workunit.client.0.smithi098.stdout:0/891: fdatasync d5/f46 0 2024-09-19T07:25:01.274 INFO:tasks.workunit.client.0.smithi098.stdout:0/892: truncate d5/d20/d1f/d47/db2/dd3/d106/d94/fe0 485498 0 2024-09-19T07:25:01.275 INFO:tasks.workunit.client.0.smithi098.stdout:2/869: symlink d1/dcb/dfd/d93/d61/l12b 0 2024-09-19T07:25:01.276 INFO:tasks.workunit.client.0.smithi098.stdout:0/893: creat d5/d20/d1f/d47/f11f x:0 0 0 2024-09-19T07:25:01.277 INFO:tasks.workunit.client.0.smithi098.stdout:2/870: mknod d1/d9/d26/d35/c12c 0 2024-09-19T07:25:01.279 INFO:tasks.workunit.client.0.smithi098.stdout:2/871: mknod d1/dcb/dfd/d93/d61/d62/c12d 0 2024-09-19T07:25:01.279 INFO:tasks.workunit.client.0.smithi098.stdout:2/872: read d1/d5/d34/f10f [1691170,121968] 0 2024-09-19T07:25:01.279 INFO:tasks.workunit.client.0.smithi098.stdout:2/873: write d1/d9/d26/d35/d88/dc2/dfb/d60/da5/dd9/f12a [927160,50840] 0 2024-09-19T07:25:01.280 INFO:tasks.workunit.client.0.smithi098.stdout:2/874: creat d1/d9/d26/d35/f12e x:0 0 0 2024-09-19T07:25:01.280 INFO:tasks.workunit.client.0.smithi098.stdout:6/802: write d2/d5/d1f/d26/f69 [3221715,49782] 0 2024-09-19T07:25:01.282 INFO:tasks.workunit.client.0.smithi098.stdout:6/803: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e/f11e x:0 0 0 2024-09-19T07:25:01.282 INFO:tasks.workunit.client.0.smithi098.stdout:4/824: rename da/d31/d46/d5f/d8a/db6/dc2/de7/d109/ddf to da/d31/d46/d5f/d118 0 2024-09-19T07:25:01.288 INFO:tasks.workunit.client.0.smithi098.stdout:6/804: write d2/f8e [4032512,57943] 0 2024-09-19T07:25:01.289 INFO:tasks.workunit.client.0.smithi098.stdout:0/894: dread d5/d20/d1f/d52/fb4 [0,4194304] 0 2024-09-19T07:25:01.295 INFO:tasks.workunit.client.0.smithi098.stdout:2/875: dread d1/d9/d26/d35/d48/d7f/fc5 [0,4194304] 0 2024-09-19T07:25:01.295 INFO:tasks.workunit.client.0.smithi098.stdout:2/876: dread - d1/dcb/dfd/d93/d61/f119 zero size 2024-09-19T07:25:01.296 INFO:tasks.workunit.client.0.smithi098.stdout:2/877: getdents d1/d5/d72/db5 0 2024-09-19T07:25:01.297 INFO:tasks.workunit.client.0.smithi098.stdout:2/878: write d1/d9/d26/d35/d58/f4d [2827226,96760] 0 2024-09-19T07:25:01.299 INFO:tasks.workunit.client.0.smithi098.stdout:0/895: read d5/d20/d1f/d47/db2/dd3/d106/f9e [2580288,17292] 0 2024-09-19T07:25:01.299 INFO:tasks.workunit.client.0.smithi098.stdout:0/896: read d5/d20/d1f/d52/d64/da0/fbc [140056,120829] 0 2024-09-19T07:25:01.299 INFO:tasks.workunit.client.0.smithi098.stdout:2/879: mkdir d1/d5/d72/db5/dad/d12f 0 2024-09-19T07:25:01.300 INFO:tasks.workunit.client.0.smithi098.stdout:2/880: write d1/d5/f54 [883124,106279] 0 2024-09-19T07:25:01.300 INFO:tasks.workunit.client.0.smithi098.stdout:2/881: chown d1/dcb/dfd/f11e 1538966 1 2024-09-19T07:25:01.300 INFO:tasks.workunit.client.0.smithi098.stdout:2/882: chown d1/faa 0 1 2024-09-19T07:25:01.300 INFO:tasks.workunit.client.0.smithi098.stdout:2/883: mkdir d1/d9/d26/d130 0 2024-09-19T07:25:01.302 INFO:tasks.workunit.client.0.smithi098.stdout:2/884: creat d1/d9/d26/d35/d88/dc2/dfb/f131 x:0 0 0 2024-09-19T07:25:01.302 INFO:tasks.workunit.client.0.smithi098.stdout:2/885: dread - d1/d9/d3e/f55 zero size 2024-09-19T07:25:01.306 INFO:tasks.workunit.client.0.smithi098.stdout:4/825: dwrite da/d31/d46/d5f/d8a/db6/dc9/fe3 [0,4194304] 0 2024-09-19T07:25:01.306 INFO:tasks.workunit.client.0.smithi098.stdout:4/826: chown da/d31 101904826 1 2024-09-19T07:25:01.307 INFO:tasks.workunit.client.0.smithi098.stdout:4/827: read da/d31/d46/d56/d5b/db9/fcc [1642654,53632] 0 2024-09-19T07:25:01.308 INFO:tasks.workunit.client.0.smithi098.stdout:4/828: mkdir da/d31/d46/d56/d5b/db9/df0/d10a/d119 0 2024-09-19T07:25:01.311 INFO:tasks.workunit.client.0.smithi098.stdout:8/811: rename d0/d16/d65/f7f to d0/d16/d7d/dcc/dd2/f10b 0 2024-09-19T07:25:01.313 INFO:tasks.workunit.client.0.smithi098.stdout:8/812: creat d0/d33/d55/d8a/d21/deb/f10c x:0 0 0 2024-09-19T07:25:01.319 INFO:tasks.workunit.client.0.smithi098.stdout:6/805: dwrite d2/d5/d1f/d26/d42/d48/f70 [0,4194304] 0 2024-09-19T07:25:01.319 INFO:tasks.workunit.client.0.smithi098.stdout:6/806: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/l11f 0 2024-09-19T07:25:01.320 INFO:tasks.workunit.client.0.smithi098.stdout:0/897: dwrite d5/d20/d1f/faf [0,4194304] 0 2024-09-19T07:25:01.320 INFO:tasks.workunit.client.0.smithi098.stdout:0/898: chown d5/d20/d1f/d47/lad 25520 1 2024-09-19T07:25:01.321 INFO:tasks.workunit.client.0.smithi098.stdout:6/807: mknod d2/d5/c120 0 2024-09-19T07:25:01.321 INFO:tasks.workunit.client.0.smithi098.stdout:6/808: dread - d2/d5/d1f/d26/d42/d48/d53/f5d zero size 2024-09-19T07:25:01.321 INFO:tasks.workunit.client.0.smithi098.stdout:2/886: dwrite d1/d9/d26/d35/d58/f1a [0,4194304] 0 2024-09-19T07:25:01.321 INFO:tasks.workunit.client.0.smithi098.stdout:6/809: truncate d2/db0/d4e/d6e/d9d/d94/fa0 1267155 0 2024-09-19T07:25:01.321 INFO:tasks.workunit.client.0.smithi098.stdout:6/810: write d2/d5/d1f/d26/d42/da4/fca [950774,18066] 0 2024-09-19T07:25:01.321 INFO:tasks.workunit.client.0.smithi098.stdout:2/887: write d1/d9/d26/d35/d88/dc2/dfb/f4b [1727310,78615] 0 2024-09-19T07:25:01.322 INFO:tasks.workunit.client.0.smithi098.stdout:2/888: chown d1/d9/d26/d35/f114 1891547 1 2024-09-19T07:25:01.322 INFO:tasks.workunit.client.0.smithi098.stdout:2/889: write d1/d9/f33 [149939,130673] 0 2024-09-19T07:25:01.324 INFO:tasks.workunit.client.0.smithi098.stdout:6/811: link d2/d5/f3b d2/d11/dd0/f121 0 2024-09-19T07:25:01.330 INFO:tasks.workunit.client.0.smithi098.stdout:2/890: dread d1/d5/d34/f7c [0,4194304] 0 2024-09-19T07:25:01.331 INFO:tasks.workunit.client.0.smithi098.stdout:1/919: sync 2024-09-19T07:25:01.331 INFO:tasks.workunit.client.0.smithi098.stdout:4/829: rename da/d31/d46/d56/d5b/d66/fa9 to da/d31/d46/d56/d5b/d63/f11a 0 2024-09-19T07:25:01.331 INFO:tasks.workunit.client.0.smithi098.stdout:4/830: chown da/d59/d5d/d82 4467 1 2024-09-19T07:25:01.332 INFO:tasks.workunit.client.0.smithi098.stdout:1/920: chown dc/d17/d1b/f120 210906624 1 2024-09-19T07:25:01.332 INFO:tasks.workunit.client.0.smithi098.stdout:4/831: stat da/d7e/cfc 0 2024-09-19T07:25:01.332 INFO:tasks.workunit.client.0.smithi098.stdout:1/921: chown dc/de/d22/d31/f4c 469991 1 2024-09-19T07:25:01.333 INFO:tasks.workunit.client.0.smithi098.stdout:8/813: rename d0/d2c/cef to d0/d16/d65/dd8/c10d 0 2024-09-19T07:25:01.336 INFO:tasks.workunit.client.0.smithi098.stdout:1/922: creat dc/de/d22/d31/d5d/d6a/d6f/f146 x:0 0 0 2024-09-19T07:25:01.338 INFO:tasks.workunit.client.0.smithi098.stdout:1/923: rename dc/de/d22/d31/d5d/d6a/fee to dc/de/d22/d31/d5d/d6a/d6f/d4d/dc6/f147 0 2024-09-19T07:25:01.341 INFO:tasks.workunit.client.0.smithi098.stdout:1/924: unlink dc/d17/d9c/c134 0 2024-09-19T07:25:01.342 INFO:tasks.workunit.client.0.smithi098.stdout:1/925: chown dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/lad 32008 1 2024-09-19T07:25:01.342 INFO:tasks.workunit.client.0.smithi098.stdout:1/926: dread - dc/de/d22/d31/d5d/d6a/d6f/d5f/fc2 zero size 2024-09-19T07:25:01.342 INFO:tasks.workunit.client.0.smithi098.stdout:1/927: readlink dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/l8e 0 2024-09-19T07:25:01.346 INFO:tasks.workunit.client.0.smithi098.stdout:1/928: dread dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/f55 [0,4194304] 0 2024-09-19T07:25:01.348 INFO:tasks.workunit.client.0.smithi098.stdout:1/929: rmdir dc/d17/d9c 39 2024-09-19T07:25:01.359 INFO:tasks.workunit.client.0.smithi098.stdout:6/812: dwrite d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e/f1d [0,4194304] 0 2024-09-19T07:25:01.360 INFO:tasks.workunit.client.0.smithi098.stdout:6/813: write d2/d5/f3b [451382,128126] 0 2024-09-19T07:25:01.361 INFO:tasks.workunit.client.0.smithi098.stdout:4/832: dwrite da/fc7 [0,4194304] 0 2024-09-19T07:25:01.362 INFO:tasks.workunit.client.0.smithi098.stdout:4/833: symlink da/d31/d46/d56/d5b/d66/l11b 0 2024-09-19T07:25:01.364 INFO:tasks.workunit.client.0.smithi098.stdout:8/814: dwrite d0/d33/d55/d8a/d12/f64 [0,4194304] 0 2024-09-19T07:25:01.364 INFO:tasks.workunit.client.0.smithi098.stdout:8/815: fsync d0/d33/d55/fc3 0 2024-09-19T07:25:01.364 INFO:tasks.workunit.client.0.smithi098.stdout:6/814: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/l122 0 2024-09-19T07:25:01.364 INFO:tasks.workunit.client.0.smithi098.stdout:6/815: write d2/d11/fb4 [2127693,70923] 0 2024-09-19T07:25:01.364 INFO:tasks.workunit.client.0.smithi098.stdout:6/816: fsync d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e/f11e 0 2024-09-19T07:25:01.364 INFO:tasks.workunit.client.0.smithi098.stdout:6/817: write d2/d11/f11d [848939,64415] 0 2024-09-19T07:25:01.366 INFO:tasks.workunit.client.0.smithi098.stdout:8/816: creat d0/d33/d55/d8a/f10e x:0 0 0 2024-09-19T07:25:01.366 INFO:tasks.workunit.client.0.smithi098.stdout:8/817: chown d0/d33/d55/d8a/d28/l30 359370519 1 2024-09-19T07:25:01.366 INFO:tasks.workunit.client.0.smithi098.stdout:6/818: truncate d2/d5/d1f/d26/f69 1310211 0 2024-09-19T07:25:01.366 INFO:tasks.workunit.client.0.smithi098.stdout:6/819: stat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e/d8f/lf2 0 2024-09-19T07:25:01.367 INFO:tasks.workunit.client.0.smithi098.stdout:2/891: dwrite d1/d9/f33 [0,4194304] 0 2024-09-19T07:25:01.367 INFO:tasks.workunit.client.0.smithi098.stdout:2/892: truncate d1/d9/f2d 1847748 0 2024-09-19T07:25:01.367 INFO:tasks.workunit.client.0.smithi098.stdout:2/893: chown d1/d5/d72/db5/dad/fc9 405573 1 2024-09-19T07:25:01.369 INFO:tasks.workunit.client.0.smithi098.stdout:2/894: creat d1/d9/d1d/f132 x:0 0 0 2024-09-19T07:25:01.373 INFO:tasks.workunit.client.0.smithi098.stdout:4/834: dread da/f1d [0,4194304] 0 2024-09-19T07:25:01.373 INFO:tasks.workunit.client.0.smithi098.stdout:4/835: dread - da/d59/deb/f10c zero size 2024-09-19T07:25:01.374 INFO:tasks.workunit.client.0.smithi098.stdout:4/836: truncate da/d31/d46/d5f/f74 3129131 0 2024-09-19T07:25:01.375 INFO:tasks.workunit.client.0.smithi098.stdout:7/938: sync 2024-09-19T07:25:01.376 INFO:tasks.workunit.client.0.smithi098.stdout:1/930: link dc/de/d22/d31/d35/d58/d10f/l13f dc/d17/d1b/d71/d7a/d136/l148 0 2024-09-19T07:25:01.376 INFO:tasks.workunit.client.0.smithi098.stdout:3/768: sync 2024-09-19T07:25:01.376 INFO:tasks.workunit.client.0.smithi098.stdout:1/931: dread - dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/ddd/f12e zero size 2024-09-19T07:25:01.377 INFO:tasks.workunit.client.0.smithi098.stdout:7/939: creat d5/d3e/f135 x:0 0 0 2024-09-19T07:25:01.378 INFO:tasks.workunit.client.0.smithi098.stdout:1/932: mkdir dc/d17/d1b/d71/d81/d149 0 2024-09-19T07:25:01.378 INFO:tasks.workunit.client.0.smithi098.stdout:1/933: write dc/d17/d1b/d1d/d30/df7/f12a [284634,59862] 0 2024-09-19T07:25:01.378 INFO:tasks.workunit.client.0.smithi098.stdout:1/934: write dc/d17/d1b/d1d/d30/fe2 [52181,59860] 0 2024-09-19T07:25:01.380 INFO:tasks.workunit.client.0.smithi098.stdout:3/769: readlink de/df/d1f/d2b/d93/de5/l6c 0 2024-09-19T07:25:01.380 INFO:tasks.workunit.client.0.smithi098.stdout:3/770: chown de/l49 1252 1 2024-09-19T07:25:01.381 INFO:tasks.workunit.client.0.smithi098.stdout:3/771: readlink de/df/l40 0 2024-09-19T07:25:01.384 INFO:tasks.workunit.client.0.smithi098.stdout:1/935: link dc/d17/d1b/d71/d7a/d136/l148 dc/de/de9/l14a 0 2024-09-19T07:25:01.384 INFO:tasks.workunit.client.0.smithi098.stdout:1/936: stat dc/d2a/f12f 0 2024-09-19T07:25:01.393 INFO:tasks.workunit.client.0.smithi098.stdout:8/818: rename d0/d33/d55/d8a/d12/d6c to d0/d2c/dfb/d10f 0 2024-09-19T07:25:01.396 INFO:tasks.workunit.client.0.smithi098.stdout:6/820: rename d2/db0/d4e/d6e/d9d/d94 to d2/d5/d1f/d26/d42/d48/d123 0 2024-09-19T07:25:01.396 INFO:tasks.workunit.client.0.smithi098.stdout:6/821: fsync d2/d5/d1f/d26/d42/d48/d123/fe7 0 2024-09-19T07:25:01.396 INFO:tasks.workunit.client.0.smithi098.stdout:6/822: write d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e/f11e [1047209,105118] 0 2024-09-19T07:25:01.396 INFO:tasks.workunit.client.0.smithi098.stdout:6/823: write d2/d11/daa/fb1 [4329436,43878] 0 2024-09-19T07:25:01.396 INFO:tasks.workunit.client.0.smithi098.stdout:4/837: dwrite da/d31/d46/d5f/d8a/db6/dc2/de7/ff1 [0,4194304] 0 2024-09-19T07:25:01.398 INFO:tasks.workunit.client.0.smithi098.stdout:4/838: creat da/d31/d46/d56/d5b/db9/df0/f11c x:0 0 0 2024-09-19T07:25:01.398 INFO:tasks.workunit.client.0.smithi098.stdout:6/824: mknod d2/db0/c124 0 2024-09-19T07:25:01.398 INFO:tasks.workunit.client.0.smithi098.stdout:6/825: chown f1 118551033 1 2024-09-19T07:25:01.399 INFO:tasks.workunit.client.0.smithi098.stdout:4/839: creat da/d59/deb/f11d x:0 0 0 2024-09-19T07:25:01.399 INFO:tasks.workunit.client.0.smithi098.stdout:4/840: chown da/d31/d46/d5f/d118/f105 484 1 2024-09-19T07:25:01.400 INFO:tasks.workunit.client.0.smithi098.stdout:8/819: creat d0/d16/d7d/dcc/dd2/f110 x:0 0 0 2024-09-19T07:25:01.400 INFO:tasks.workunit.client.0.smithi098.stdout:4/841: dread - da/d31/d46/d56/d5b/d61/fa1 zero size 2024-09-19T07:25:01.400 INFO:tasks.workunit.client.0.smithi098.stdout:8/820: mkdir d0/d16/d65/d111 0 2024-09-19T07:25:01.401 INFO:tasks.workunit.client.0.smithi098.stdout:4/842: creat da/d31/f11e x:0 0 0 2024-09-19T07:25:01.401 INFO:tasks.workunit.client.0.smithi098.stdout:4/843: write da/d59/fcf [354305,129333] 0 2024-09-19T07:25:01.401 INFO:tasks.workunit.client.0.smithi098.stdout:4/844: chown da/d31/d46/d56/d5b/db9 6715264 1 2024-09-19T07:25:01.402 INFO:tasks.workunit.client.0.smithi098.stdout:8/821: creat d0/d2c/dfb/f112 x:0 0 0 2024-09-19T07:25:01.403 INFO:tasks.workunit.client.0.smithi098.stdout:8/822: link d0/d33/c58 d0/d33/d55/d8a/d21/deb/c113 0 2024-09-19T07:25:01.403 INFO:tasks.workunit.client.0.smithi098.stdout:8/823: dread - d0/d16/d65/dd8/fea zero size 2024-09-19T07:25:01.404 INFO:tasks.workunit.client.0.smithi098.stdout:7/940: rename d5/d8/d8e to d5/d3e/d136 0 2024-09-19T07:25:01.404 INFO:tasks.workunit.client.0.smithi098.stdout:8/824: dread d0/d16/d7d/dcc/dd2/f10b [0,4194304] 0 2024-09-19T07:25:01.404 INFO:tasks.workunit.client.0.smithi098.stdout:8/825: dread - d0/d33/d55/d8a/d28/ff4 zero size 2024-09-19T07:25:01.404 INFO:tasks.workunit.client.0.smithi098.stdout:8/826: truncate d0/d16/d7d/dcc/dd2/f10b 618033 0 2024-09-19T07:25:01.404 INFO:tasks.workunit.client.0.smithi098.stdout:1/937: dwrite dc/de/d22/d31/d5d/d6a/d6f/d4d/dc6/f147 [0,4194304] 0 2024-09-19T07:25:01.405 INFO:tasks.workunit.client.0.smithi098.stdout:7/941: mknod d5/c137 0 2024-09-19T07:25:01.405 INFO:tasks.workunit.client.0.smithi098.stdout:7/942: chown d5/d10/d50/df8 160 1 2024-09-19T07:25:01.406 INFO:tasks.workunit.client.0.smithi098.stdout:8/827: getdents d0/d33/d55/d8a/d12 0 2024-09-19T07:25:01.407 INFO:tasks.workunit.client.0.smithi098.stdout:6/826: dread d2/d5/d1f/fd3 [4194304,4194304] 0 2024-09-19T07:25:01.407 INFO:tasks.workunit.client.0.smithi098.stdout:7/943: creat d5/d3e/d136/d59/f138 x:0 0 0 2024-09-19T07:25:01.407 INFO:tasks.workunit.client.0.smithi098.stdout:7/944: chown d5/d3e/d62 592813 1 2024-09-19T07:25:01.408 INFO:tasks.workunit.client.0.smithi098.stdout:4/845: dread da/d31/d46/fd8 [0,4194304] 0 2024-09-19T07:25:01.408 INFO:tasks.workunit.client.0.smithi098.stdout:8/828: creat d0/d16/d65/de3/f114 x:0 0 0 2024-09-19T07:25:01.409 INFO:tasks.workunit.client.0.smithi098.stdout:4/846: mkdir da/d31/d46/d5f/d118/d11f 0 2024-09-19T07:25:01.409 INFO:tasks.workunit.client.0.smithi098.stdout:4/847: write da/d31/dc5/ff8 [730377,35846] 0 2024-09-19T07:25:01.409 INFO:tasks.workunit.client.0.smithi098.stdout:8/829: getdents d0/d33/d55/d8a/d12/dba 0 2024-09-19T07:25:01.415 INFO:tasks.workunit.client.0.smithi098.stdout:8/830: mkdir d0/d16/d7d/dcc/dd2/df5/d115 0 2024-09-19T07:25:01.431 INFO:tasks.workunit.client.0.smithi098.stdout:1/938: dwrite dc/de/fb7 [0,4194304] 0 2024-09-19T07:25:01.432 INFO:tasks.workunit.client.0.smithi098.stdout:1/939: getdents dc/de/de9 0 2024-09-19T07:25:01.437 INFO:tasks.workunit.client.0.smithi098.stdout:3/772: rename de/df/d1f/d2b/c48 to de/d4e/d6d/cea 0 2024-09-19T07:25:01.437 INFO:tasks.workunit.client.0.smithi098.stdout:1/940: unlink dc/de/d50/ca9 0 2024-09-19T07:25:01.439 INFO:tasks.workunit.client.0.smithi098.stdout:0/899: sync 2024-09-19T07:25:01.439 INFO:tasks.workunit.client.0.smithi098.stdout:3/773: getdents de/df 0 2024-09-19T07:25:01.439 INFO:tasks.workunit.client.0.smithi098.stdout:3/774: truncate de/f2f 4712167 0 2024-09-19T07:25:01.439 INFO:tasks.workunit.client.0.smithi098.stdout:3/775: getdents de/df/d31/d61/d69/ddd/de2 0 2024-09-19T07:25:01.439 INFO:tasks.workunit.client.0.smithi098.stdout:3/776: read - de/d4e/d6d/d71/f88 zero size 2024-09-19T07:25:01.440 INFO:tasks.workunit.client.0.smithi098.stdout:0/900: rmdir d5/d20/d1f/d47/dae 39 2024-09-19T07:25:01.441 INFO:tasks.workunit.client.0.smithi098.stdout:1/941: mknod dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/c14b 0 2024-09-19T07:25:01.442 INFO:tasks.workunit.client.0.smithi098.stdout:1/942: symlink dc/l14c 0 2024-09-19T07:25:01.442 INFO:tasks.workunit.client.0.smithi098.stdout:1/943: chown dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f4e 1842727553 1 2024-09-19T07:25:01.445 INFO:tasks.workunit.client.0.smithi098.stdout:1/944: mknod dc/de/d22/d31/d5d/d6a/d6f/c14d 0 2024-09-19T07:25:01.448 INFO:tasks.workunit.client.0.smithi098.stdout:1/945: getdents dc/de 0 2024-09-19T07:25:01.451 INFO:tasks.workunit.client.0.smithi098.stdout:1/946: link dc/de/de9/l14a dc/de/d22/d128/df0/l14e 0 2024-09-19T07:25:01.452 INFO:tasks.workunit.client.0.smithi098.stdout:1/947: mknod dc/de/d22/d31/d5d/d6a/d6f/d4d/dc6/c14f 0 2024-09-19T07:25:01.455 INFO:tasks.workunit.client.0.smithi098.stdout:4/848: dwrite da/d31/d46/fdc [0,4194304] 0 2024-09-19T07:25:01.455 INFO:tasks.workunit.client.0.smithi098.stdout:4/849: write da/d31/d46/d56/d5b/d66/f7a [1594393,11789] 0 2024-09-19T07:25:01.455 INFO:tasks.workunit.client.0.smithi098.stdout:6/827: dwrite d2/db0/d8d/fdd [0,4194304] 0 2024-09-19T07:25:01.455 INFO:tasks.workunit.client.0.smithi098.stdout:8/831: dwrite d0/d33/d44/dbe/fc8 [4194304,4194304] 0 2024-09-19T07:25:01.456 INFO:tasks.workunit.client.0.smithi098.stdout:8/832: readlink d0/d33/d44/l8f 0 2024-09-19T07:25:01.456 INFO:tasks.workunit.client.0.smithi098.stdout:7/945: dwrite d5/d10/f32 [0,4194304] 0 2024-09-19T07:25:01.456 INFO:tasks.workunit.client.0.smithi098.stdout:6/828: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e/d8f/f125 x:0 0 0 2024-09-19T07:25:01.457 INFO:tasks.workunit.client.0.smithi098.stdout:1/948: write dc/d17/d1b/fdc [1218895,21489] 0 2024-09-19T07:25:01.459 INFO:tasks.workunit.client.0.smithi098.stdout:8/833: rename d0/d33/d55/d8a/f5f to d0/d33/d55/d8a/d21/f116 0 2024-09-19T07:25:01.459 INFO:tasks.workunit.client.0.smithi098.stdout:8/834: read - d0/dc5/d106/f10a zero size 2024-09-19T07:25:01.460 INFO:tasks.workunit.client.0.smithi098.stdout:3/777: dwrite de/f2f [0,4194304] 0 2024-09-19T07:25:01.461 INFO:tasks.workunit.client.0.smithi098.stdout:7/946: rename d5/d8/l18 to d5/d8/dc/l139 0 2024-09-19T07:25:01.465 INFO:tasks.workunit.client.0.smithi098.stdout:3/778: unlink de/df/d1f/fd9 0 2024-09-19T07:25:01.467 INFO:tasks.workunit.client.0.smithi098.stdout:3/779: mkdir de/deb 0 2024-09-19T07:25:01.467 INFO:tasks.workunit.client.0.smithi098.stdout:3/780: dread - de/d4e/d6d/d71/f88 zero size 2024-09-19T07:25:01.467 INFO:tasks.workunit.client.0.smithi098.stdout:4/850: write da/d31/d46/d56/d5b/db9/fcc [59944,55654] 0 2024-09-19T07:25:01.468 INFO:tasks.workunit.client.0.smithi098.stdout:4/851: chown da/d31/d46/d56/fae 86245 1 2024-09-19T07:25:01.468 INFO:tasks.workunit.client.0.smithi098.stdout:3/781: rmdir de/d4e 39 2024-09-19T07:25:01.469 INFO:tasks.workunit.client.0.smithi098.stdout:2/895: sync 2024-09-19T07:25:01.469 INFO:tasks.workunit.client.0.smithi098.stdout:0/901: link d5/d20/d1f/d47/c78 d5/d20/d1f/d47/db2/dd3/d106/d94/c120 0 2024-09-19T07:25:01.469 INFO:tasks.workunit.client.0.smithi098.stdout:2/896: fdatasync d1/d9/d3e/f55 0 2024-09-19T07:25:01.469 INFO:tasks.workunit.client.0.smithi098.stdout:0/902: getdents d5/d20/d1f/d11b 0 2024-09-19T07:25:01.471 INFO:tasks.workunit.client.0.smithi098.stdout:1/949: dread dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f4e [0,4194304] 0 2024-09-19T07:25:01.471 INFO:tasks.workunit.client.0.smithi098.stdout:2/897: getdents d1/d5/d72 0 2024-09-19T07:25:01.472 INFO:tasks.workunit.client.0.smithi098.stdout:2/898: truncate d1/d9/d26/d35/d88/dc2/dfb/d60/da5/dd9/f12a 858325 0 2024-09-19T07:25:01.474 INFO:tasks.workunit.client.0.smithi098.stdout:2/899: getdents d1/d9/d26/d35/d88/dc2/dfb/d60/db4 0 2024-09-19T07:25:01.475 INFO:tasks.workunit.client.0.smithi098.stdout:1/950: rename dc/de/d22/fd2 to dc/de/d22/d31/f150 0 2024-09-19T07:25:01.475 INFO:tasks.workunit.client.0.smithi098.stdout:1/951: dread - dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f13c zero size 2024-09-19T07:25:01.475 INFO:tasks.workunit.client.0.smithi098.stdout:1/952: fdatasync dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/ddd/f12e 0 2024-09-19T07:25:01.476 INFO:tasks.workunit.client.0.smithi098.stdout:2/900: creat d1/dcb/dfd/d93/d61/d62/f133 x:0 0 0 2024-09-19T07:25:01.479 INFO:tasks.workunit.client.0.smithi098.stdout:2/901: rmdir d1/d9/d26 39 2024-09-19T07:25:01.479 INFO:tasks.workunit.client.0.smithi098.stdout:2/902: write d1/d9/d26/d35/d91/fb0 [1530891,120727] 0 2024-09-19T07:25:01.481 INFO:tasks.workunit.client.0.smithi098.stdout:2/903: symlink d1/dcb/dfd/d93/d61/d62/l134 0 2024-09-19T07:25:01.482 INFO:tasks.workunit.client.0.smithi098.stdout:2/904: mkdir d1/dcb/d135 0 2024-09-19T07:25:01.482 INFO:tasks.workunit.client.0.smithi098.stdout:4/852: dread da/d31/d46/d56/d5b/d66/fd0 [0,4194304] 0 2024-09-19T07:25:01.484 INFO:tasks.workunit.client.0.smithi098.stdout:4/853: mkdir da/d31/d46/d120 0 2024-09-19T07:25:01.486 INFO:tasks.workunit.client.0.smithi098.stdout:0/903: stat d5/d20/d1f/d47/c78 0 2024-09-19T07:25:01.488 INFO:tasks.workunit.client.0.smithi098.stdout:8/835: dwrite d0/d33/d55/fd9 [0,4194304] 0 2024-09-19T07:25:01.488 INFO:tasks.workunit.client.0.smithi098.stdout:4/854: creat da/d31/d46/d56/d5b/db9/df0/d10a/d119/f121 x:0 0 0 2024-09-19T07:25:01.488 INFO:tasks.workunit.client.0.smithi098.stdout:4/855: chown da/d31/d46/d5f/d118/df2/f108 43721 1 2024-09-19T07:25:01.489 INFO:tasks.workunit.client.0.smithi098.stdout:0/904: mkdir d5/d20/d1f/d47/db2/dd3/d106/d94/d121 0 2024-09-19T07:25:01.491 INFO:tasks.workunit.client.0.smithi098.stdout:0/905: creat d5/d20/d1f/d47/db2/dd3/f122 x:0 0 0 2024-09-19T07:25:01.491 INFO:tasks.workunit.client.0.smithi098.stdout:0/906: chown d5/d20/d1f/d47/db2/dd3/d106/cec 73110 1 2024-09-19T07:25:01.491 INFO:tasks.workunit.client.0.smithi098.stdout:0/907: read d5/f1e [2586609,14336] 0 2024-09-19T07:25:01.493 INFO:tasks.workunit.client.0.smithi098.stdout:0/908: mknod d5/d20/d1f/d47/db2/dd3/d106/d92/c123 0 2024-09-19T07:25:01.493 INFO:tasks.workunit.client.0.smithi098.stdout:0/909: getdents d5/d20/d14/de3 0 2024-09-19T07:25:01.493 INFO:tasks.workunit.client.0.smithi098.stdout:0/910: read d5/d20/d1f/d52/d64/d77/fcb [307443,27427] 0 2024-09-19T07:25:01.493 INFO:tasks.workunit.client.0.smithi098.stdout:0/911: chown d5/d20/d1f/d52/d64/dba/dd2/dea/df2 292180 1 2024-09-19T07:25:01.499 INFO:tasks.workunit.client.0.smithi098.stdout:0/912: dread d5/d20/d14/fdd [0,4194304] 0 2024-09-19T07:25:01.501 INFO:tasks.workunit.client.0.smithi098.stdout:6/829: dwrite d2/fc [0,4194304] 0 2024-09-19T07:25:01.503 INFO:tasks.workunit.client.0.smithi098.stdout:3/782: dwrite de/df/d1f/d2b/d93/fa7 [4194304,4194304] 0 2024-09-19T07:25:01.503 INFO:tasks.workunit.client.0.smithi098.stdout:3/783: stat de/f1a 0 2024-09-19T07:25:01.504 INFO:tasks.workunit.client.0.smithi098.stdout:0/913: link d5/d20/d1f/d52/d64/da0/lde d5/d20/d1f/d47/db2/dbf/de5/l124 0 2024-09-19T07:25:01.504 INFO:tasks.workunit.client.0.smithi098.stdout:0/914: chown d5 1808 1 2024-09-19T07:25:01.504 INFO:tasks.workunit.client.0.smithi098.stdout:0/915: readlink d5/d20/d14/d49/d62/lb3 0 2024-09-19T07:25:01.505 INFO:tasks.workunit.client.0.smithi098.stdout:0/916: rmdir d5/d20/d1f/d47/dae 39 2024-09-19T07:25:01.505 INFO:tasks.workunit.client.0.smithi098.stdout:0/917: write d5/d20/d1f/d47/db2/dd3/d106/d92/fe6 [2549891,13004] 0 2024-09-19T07:25:01.505 INFO:tasks.workunit.client.0.smithi098.stdout:0/918: chown d5/d20/d1f/de2/le9 53 1 2024-09-19T07:25:01.505 INFO:tasks.workunit.client.0.smithi098.stdout:7/947: dwrite d5/d10/d11/f134 [0,4194304] 0 2024-09-19T07:25:01.510 INFO:tasks.workunit.client.0.smithi098.stdout:0/919: unlink d5/d20/f4e 0 2024-09-19T07:25:01.510 INFO:tasks.workunit.client.0.smithi098.stdout:3/784: dread de/df/f15 [0,4194304] 0 2024-09-19T07:25:01.510 INFO:tasks.workunit.client.0.smithi098.stdout:8/836: dwrite d0/f53 [0,4194304] 0 2024-09-19T07:25:01.510 INFO:tasks.workunit.client.0.smithi098.stdout:0/920: symlink d5/d20/d1f/d47/db2/dd3/d106/d92/l125 0 2024-09-19T07:25:01.511 INFO:tasks.workunit.client.0.smithi098.stdout:7/948: creat d5/d3e/d136/d59/f13a x:0 0 0 2024-09-19T07:25:01.511 INFO:tasks.workunit.client.0.smithi098.stdout:7/949: fsync d5/f53 0 2024-09-19T07:25:01.513 INFO:tasks.workunit.client.0.smithi098.stdout:3/785: rmdir de/d4e/d6d/dad 39 2024-09-19T07:25:01.514 INFO:tasks.workunit.client.0.smithi098.stdout:2/905: dwrite d1/d5/d34/fb8 [0,4194304] 0 2024-09-19T07:25:01.514 INFO:tasks.workunit.client.0.smithi098.stdout:2/906: write d1/d5/d34/d5a/db2/f104 [702867,117482] 0 2024-09-19T07:25:01.514 INFO:tasks.workunit.client.0.smithi098.stdout:2/907: write d1/d5/d72/db5/d4e/fae [2234296,113825] 0 2024-09-19T07:25:01.515 INFO:tasks.workunit.client.0.smithi098.stdout:8/837: unlink d0/d16/c1d 0 2024-09-19T07:25:01.516 INFO:tasks.workunit.client.0.smithi098.stdout:4/856: rename da/c2d to da/d31/d46/d56/d5b/db9/c122 0 2024-09-19T07:25:01.517 INFO:tasks.workunit.client.0.smithi098.stdout:7/950: rmdir d5/d10/d50/df8 39 2024-09-19T07:25:01.517 INFO:tasks.workunit.client.0.smithi098.stdout:7/951: chown d5/d10/d11/fc6 288647766 1 2024-09-19T07:25:01.518 INFO:tasks.workunit.client.0.smithi098.stdout:0/921: creat d5/d20/d1f/d47/db2/dd3/d106/f126 x:0 0 0 2024-09-19T07:25:01.518 INFO:tasks.workunit.client.0.smithi098.stdout:0/922: read d5/d20/d1f/d47/db2/dd3/d106/fd6 [652643,5773] 0 2024-09-19T07:25:01.521 INFO:tasks.workunit.client.0.smithi098.stdout:7/952: creat d5/d8/dc/da7/dd4/f13b x:0 0 0 2024-09-19T07:25:01.526 INFO:tasks.workunit.client.0.smithi098.stdout:4/857: link da/d31/d46/d56/f89 da/d31/d46/d5f/d8a/db6/dc9/f123 0 2024-09-19T07:25:01.527 INFO:tasks.workunit.client.0.smithi098.stdout:4/858: getdents da/d31/d46/d5f/d8a/db6 0 2024-09-19T07:25:01.542 INFO:tasks.workunit.client.0.smithi098.stdout:7/953: dread d5/d3e/d62/f7a [0,4194304] 0 2024-09-19T07:25:01.543 INFO:tasks.workunit.client.0.smithi098.stdout:7/954: creat d5/d3e/d62/f13c x:0 0 0 2024-09-19T07:25:01.543 INFO:tasks.workunit.client.0.smithi098.stdout:7/955: fdatasync d5/d3e/d62/f7a 0 2024-09-19T07:25:01.543 INFO:tasks.workunit.client.0.smithi098.stdout:7/956: truncate d5/d10/dc2/faa 840712 0 2024-09-19T07:25:01.544 INFO:tasks.workunit.client.0.smithi098.stdout:3/786: rename de/df/d1f/d2b/l36 to de/d4e/d6d/d8c/lec 0 2024-09-19T07:25:01.544 INFO:tasks.workunit.client.0.smithi098.stdout:7/957: rename d5/d10 to d5/d10/d50/dad/d13d 22 2024-09-19T07:25:01.544 INFO:tasks.workunit.client.0.smithi098.stdout:3/787: stat de/df/d1f/lb4 0 2024-09-19T07:25:01.544 INFO:tasks.workunit.client.0.smithi098.stdout:3/788: write de/df/d1f/d2b/f77 [1172519,130264] 0 2024-09-19T07:25:01.545 INFO:tasks.workunit.client.0.smithi098.stdout:7/958: symlink d5/d8/dc/da7/dd4/l13e 0 2024-09-19T07:25:01.545 INFO:tasks.workunit.client.0.smithi098.stdout:8/838: dread d0/f7e [0,4194304] 0 2024-09-19T07:25:01.546 INFO:tasks.workunit.client.0.smithi098.stdout:3/789: symlink de/df/led 0 2024-09-19T07:25:01.546 INFO:tasks.workunit.client.0.smithi098.stdout:3/790: write de/df/d31/d61/d3f/f85 [455039,6478] 0 2024-09-19T07:25:01.546 INFO:tasks.workunit.client.0.smithi098.stdout:7/959: truncate d5/d3e/d62/f70 2476903 0 2024-09-19T07:25:01.547 INFO:tasks.workunit.client.0.smithi098.stdout:8/839: creat d0/d2c/d81/f117 x:0 0 0 2024-09-19T07:25:01.547 INFO:tasks.workunit.client.0.smithi098.stdout:8/840: write d0/d1a/f49 [2250367,24011] 0 2024-09-19T07:25:01.548 INFO:tasks.workunit.client.0.smithi098.stdout:8/841: mkdir d0/d33/d55/d8a/d28/d118 0 2024-09-19T07:25:01.548 INFO:tasks.workunit.client.0.smithi098.stdout:7/960: creat d5/d3e/d62/f13f x:0 0 0 2024-09-19T07:25:01.550 INFO:tasks.workunit.client.0.smithi098.stdout:2/908: dwrite d1/d9/d26/d35/d88/dc2/dfb/f117 [0,4194304] 0 2024-09-19T07:25:01.550 INFO:tasks.workunit.client.0.smithi098.stdout:2/909: chown d1/dcb/c128 9973 1 2024-09-19T07:25:01.553 INFO:tasks.workunit.client.0.smithi098.stdout:7/961: creat d5/d8/d52/db6/dc9/f140 x:0 0 0 2024-09-19T07:25:01.555 INFO:tasks.workunit.client.0.smithi098.stdout:2/910: unlink d1/dcb/dfd/d93/d61/l6c 0 2024-09-19T07:25:01.555 INFO:tasks.workunit.client.0.smithi098.stdout:2/911: chown d1/f4c 394522 1 2024-09-19T07:25:01.557 INFO:tasks.workunit.client.0.smithi098.stdout:8/842: dread d0/d2c/fe7 [0,4194304] 0 2024-09-19T07:25:01.557 INFO:tasks.workunit.client.0.smithi098.stdout:8/843: readlink d0/d2c/l38 0 2024-09-19T07:25:01.557 INFO:tasks.workunit.client.0.smithi098.stdout:7/962: unlink d5/d8/dc/l2d 0 2024-09-19T07:25:01.557 INFO:tasks.workunit.client.0.smithi098.stdout:7/963: truncate d5/d8/dc/da7/ffb 579274 0 2024-09-19T07:25:01.559 INFO:tasks.workunit.client.0.smithi098.stdout:2/912: mknod d1/d9/d26/d35/d48/c136 0 2024-09-19T07:25:01.561 INFO:tasks.workunit.client.0.smithi098.stdout:7/964: link d5/d10/dc2/f96 d5/d10/d50/dad/f141 0 2024-09-19T07:25:01.563 INFO:tasks.workunit.client.0.smithi098.stdout:2/913: dread d1/d5/fca [0,4194304] 0 2024-09-19T07:25:01.563 INFO:tasks.workunit.client.0.smithi098.stdout:2/914: stat d1/d9/d26/d35/d88/dc2/dfb/l112 0 2024-09-19T07:25:01.564 INFO:tasks.workunit.client.0.smithi098.stdout:2/915: write d1/d9/d26/d35/d58/f25 [826877,111392] 0 2024-09-19T07:25:01.564 INFO:tasks.workunit.client.0.smithi098.stdout:8/844: write d0/d2c/f67 [632870,49038] 0 2024-09-19T07:25:01.565 INFO:tasks.workunit.client.0.smithi098.stdout:2/916: dread d1/d9/d26/d35/d88/dc2/dfb/d60/f101 [0,4194304] 0 2024-09-19T07:25:01.565 INFO:tasks.workunit.client.0.smithi098.stdout:8/845: getdents d0/d33 0 2024-09-19T07:25:01.566 INFO:tasks.workunit.client.0.smithi098.stdout:2/917: rmdir d1 39 2024-09-19T07:25:01.568 INFO:tasks.workunit.client.0.smithi098.stdout:7/965: dread d5/d10/d1d/f51 [0,4194304] 0 2024-09-19T07:25:01.568 INFO:tasks.workunit.client.0.smithi098.stdout:7/966: chown d5/d8/dc/fe 17 1 2024-09-19T07:25:01.568 INFO:tasks.workunit.client.0.smithi098.stdout:7/967: readlink d5/d10/d11/l90 0 2024-09-19T07:25:01.568 INFO:tasks.workunit.client.0.smithi098.stdout:7/968: truncate d5/dce/f12a 193795 0 2024-09-19T07:25:01.574 INFO:tasks.workunit.client.0.smithi098.stdout:8/846: read d0/d16/f23 [699432,117251] 0 2024-09-19T07:25:01.575 INFO:tasks.workunit.client.0.smithi098.stdout:8/847: getdents d0/d33/d44/dbe 0 2024-09-19T07:25:01.576 INFO:tasks.workunit.client.0.smithi098.stdout:8/848: creat d0/d16/d7d/dcc/dd2/df5/d115/f119 x:0 0 0 2024-09-19T07:25:01.577 INFO:tasks.workunit.client.0.smithi098.stdout:2/918: write d1/d9/d26/d35/d58/f5b [2030185,110088] 0 2024-09-19T07:25:01.577 INFO:tasks.workunit.client.0.smithi098.stdout:8/849: mkdir d0/dc5/d11a 0 2024-09-19T07:25:01.577 INFO:tasks.workunit.client.0.smithi098.stdout:3/791: dwrite de/df/d31/d61/d3f/f6f [0,4194304] 0 2024-09-19T07:25:01.577 INFO:tasks.workunit.client.0.smithi098.stdout:3/792: write de/df/d1f/d2b/d93/fe8 [328971,73540] 0 2024-09-19T07:25:01.578 INFO:tasks.workunit.client.0.smithi098.stdout:8/850: symlink d0/d16/d65/l11b 0 2024-09-19T07:25:01.580 INFO:tasks.workunit.client.0.smithi098.stdout:2/919: creat d1/d9/d26/d35/f137 x:0 0 0 2024-09-19T07:25:01.581 INFO:tasks.workunit.client.0.smithi098.stdout:2/920: mknod d1/d9/d1d/d8c/c138 0 2024-09-19T07:25:01.587 INFO:tasks.workunit.client.0.smithi098.stdout:3/793: write de/f26 [1227070,13913] 0 2024-09-19T07:25:01.591 INFO:tasks.workunit.client.0.smithi098.stdout:3/794: mknod de/df/d31/d61/d69/cee 0 2024-09-19T07:25:01.593 INFO:tasks.workunit.client.0.smithi098.stdout:3/795: write de/df/f22 [90554,129923] 0 2024-09-19T07:25:01.602 INFO:tasks.workunit.client.0.smithi098.stdout:7/969: dwrite d5/d3e/f135 [0,4194304] 0 2024-09-19T07:25:01.604 INFO:tasks.workunit.client.0.smithi098.stdout:8/851: dwrite d0/fb5 [0,4194304] 0 2024-09-19T07:25:01.604 INFO:tasks.workunit.client.0.smithi098.stdout:8/852: readlink d0/d16/d65/de3/l108 0 2024-09-19T07:25:01.604 INFO:tasks.workunit.client.0.smithi098.stdout:8/853: chown d0/d1a/cdd 1091 1 2024-09-19T07:25:01.609 INFO:tasks.workunit.client.0.smithi098.stdout:7/970: unlink d5/d3e/d61/f94 0 2024-09-19T07:25:01.612 INFO:tasks.workunit.client.0.smithi098.stdout:8/854: rmdir d0/d16/d65 39 2024-09-19T07:25:01.613 INFO:tasks.workunit.client.0.smithi098.stdout:7/971: mknod d5/d8/dc/da7/dd4/c142 0 2024-09-19T07:25:01.614 INFO:tasks.workunit.client.0.smithi098.stdout:8/855: mkdir d0/d33/d55/d8a/d12/dba/df2/d9e/da4/d11c 0 2024-09-19T07:25:01.615 INFO:tasks.workunit.client.0.smithi098.stdout:7/972: rmdir d5/d3e/d136 39 2024-09-19T07:25:01.616 INFO:tasks.workunit.client.0.smithi098.stdout:8/856: mknod d0/d16/d7d/dcc/dd2/c11d 0 2024-09-19T07:25:01.616 INFO:tasks.workunit.client.0.smithi098.stdout:7/973: dread d5/d8/dc/da7/dd4/fdd [0,4194304] 0 2024-09-19T07:25:01.616 INFO:tasks.workunit.client.0.smithi098.stdout:7/974: chown d5/f124 13382 1 2024-09-19T07:25:01.616 INFO:tasks.workunit.client.0.smithi098.stdout:3/796: dwrite de/d4e/f51 [0,4194304] 0 2024-09-19T07:25:01.617 INFO:tasks.workunit.client.0.smithi098.stdout:8/857: truncate d0/d33/d55/d8a/d12/dba/df2/fdc 885636 0 2024-09-19T07:25:01.617 INFO:tasks.workunit.client.0.smithi098.stdout:7/975: creat d5/d10/d50/dad/d116/f143 x:0 0 0 2024-09-19T07:25:01.619 INFO:tasks.workunit.client.0.smithi098.stdout:3/797: truncate de/df/f15 429645 0 2024-09-19T07:25:01.621 INFO:tasks.workunit.client.0.smithi098.stdout:8/858: mknod d0/d16/d7d/dcc/dd2/c11e 0 2024-09-19T07:25:01.622 INFO:tasks.workunit.client.0.smithi098.stdout:3/798: mkdir de/df/d31/d61/d69/def 0 2024-09-19T07:25:01.623 INFO:tasks.workunit.client.0.smithi098.stdout:8/859: mkdir d0/d33/d55/d8a/d12/dba/df2/d11f 0 2024-09-19T07:25:01.629 INFO:tasks.workunit.client.0.smithi098.stdout:7/976: rename d5/d8/dc/d16 to d5/d8/dc/da7/dd4/d144 0 2024-09-19T07:25:01.629 INFO:tasks.workunit.client.0.smithi098.stdout:7/977: chown d5/d10/dc2/d5c/dc3/fdf 0 1 2024-09-19T07:25:01.629 INFO:tasks.workunit.client.0.smithi098.stdout:7/978: dread - d5/d8/d5d/f10e zero size 2024-09-19T07:25:01.631 INFO:tasks.workunit.client.0.smithi098.stdout:8/860: rename d0/d33/d55/d8a/d12/dba/df2/f5a to d0/d33/d55/d8a/f120 0 2024-09-19T07:25:01.632 INFO:tasks.workunit.client.0.smithi098.stdout:8/861: fsync d0/d2c/dfb/f101 0 2024-09-19T07:25:01.636 INFO:tasks.workunit.client.0.smithi098.stdout:8/862: unlink d0/d16/la1 0 2024-09-19T07:25:01.639 INFO:tasks.workunit.client.0.smithi098.stdout:1/953: sync 2024-09-19T07:25:01.639 INFO:tasks.workunit.client.0.smithi098.stdout:6/830: sync 2024-09-19T07:25:01.639 INFO:tasks.workunit.client.0.smithi098.stdout:4/859: sync 2024-09-19T07:25:01.639 INFO:tasks.workunit.client.0.smithi098.stdout:6/831: stat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/l116 0 2024-09-19T07:25:01.641 INFO:tasks.workunit.client.0.smithi098.stdout:6/832: dread d2/d5/d1f/f83 [0,4194304] 0 2024-09-19T07:25:01.643 INFO:tasks.workunit.client.0.smithi098.stdout:6/833: truncate d2/d5/d1f/d26/d42/d48/d53/da2/f115 3682764 0 2024-09-19T07:25:01.644 INFO:tasks.workunit.client.0.smithi098.stdout:6/834: creat d2/d5/d1f/d26/f126 x:0 0 0 2024-09-19T07:25:01.646 INFO:tasks.workunit.client.0.smithi098.stdout:8/863: write d0/d33/d55/d8a/f15 [3592196,17144] 0 2024-09-19T07:25:01.646 INFO:tasks.workunit.client.0.smithi098.stdout:8/864: write d0/d33/d55/d8a/d12/dba/df2/d9e/da4/db9/ff6 [4445130,4932] 0 2024-09-19T07:25:01.648 INFO:tasks.workunit.client.0.smithi098.stdout:6/835: dread d2/d5/d1f/d26/f69 [0,4194304] 0 2024-09-19T07:25:01.650 INFO:tasks.workunit.client.0.smithi098.stdout:6/836: mkdir d2/d5/d1f/d127 0 2024-09-19T07:25:01.650 INFO:tasks.workunit.client.0.smithi098.stdout:6/837: write d2/d5/d1f/fc7 [1375673,85462] 0 2024-09-19T07:25:01.658 INFO:tasks.workunit.client.0.smithi098.stdout:7/979: dwrite d5/d10/dc2/dbd/dfc/f128 [0,4194304] 0 2024-09-19T07:25:01.658 INFO:tasks.workunit.client.0.smithi098.stdout:8/865: dread d0/d33/d55/d8a/d21/f116 [0,4194304] 0 2024-09-19T07:25:01.674 INFO:tasks.workunit.client.0.smithi098.stdout:4/860: dwrite da/f2a [0,4194304] 0 2024-09-19T07:25:01.674 INFO:tasks.workunit.client.0.smithi098.stdout:4/861: readlink da/d31/d46/d56/d5b/db9/le0 0 2024-09-19T07:25:01.674 INFO:tasks.workunit.client.0.smithi098.stdout:4/862: fsync da/d7e/fb0 0 2024-09-19T07:25:01.674 INFO:tasks.workunit.client.0.smithi098.stdout:6/838: dwrite d2/d5/d1f/d26/f67 [0,4194304] 0 2024-09-19T07:25:01.676 INFO:tasks.workunit.client.0.smithi098.stdout:4/863: creat da/d59/f124 x:0 0 0 2024-09-19T07:25:01.676 INFO:tasks.workunit.client.0.smithi098.stdout:8/866: link d0/d16/d65/dd8/fea d0/d16/d7d/dcc/dd2/f121 0 2024-09-19T07:25:01.677 INFO:tasks.workunit.client.0.smithi098.stdout:6/839: getdents d2/d5/d1f/d26/d7b/da3 0 2024-09-19T07:25:01.677 INFO:tasks.workunit.client.0.smithi098.stdout:6/840: fdatasync d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e/d8f/f125 0 2024-09-19T07:25:01.679 INFO:tasks.workunit.client.0.smithi098.stdout:8/867: rename d0/dc5/f51 to d0/d16/d65/dd8/f122 0 2024-09-19T07:25:01.679 INFO:tasks.workunit.client.0.smithi098.stdout:8/868: chown d0/d33/d55/d8a/d12/l43 452 1 2024-09-19T07:25:01.684 INFO:tasks.workunit.client.0.smithi098.stdout:7/980: dwrite d5/d3e/d136/d59/f138 [0,4194304] 0 2024-09-19T07:25:01.685 INFO:tasks.workunit.client.0.smithi098.stdout:7/981: truncate d5/dce/f12a 975242 0 2024-09-19T07:25:01.687 INFO:tasks.workunit.client.0.smithi098.stdout:7/982: creat d5/d10/d1d/f145 x:0 0 0 2024-09-19T07:25:01.688 INFO:tasks.workunit.client.0.smithi098.stdout:7/983: stat d5/d8/l2f 0 2024-09-19T07:25:01.688 INFO:tasks.workunit.client.0.smithi098.stdout:7/984: stat d5/d3e/d61/fca 0 2024-09-19T07:25:01.690 INFO:tasks.workunit.client.0.smithi098.stdout:7/985: rename d5/d8/dc/da7/dd4/d144/f84 to d5/d3e/f146 0 2024-09-19T07:25:01.692 INFO:tasks.workunit.client.0.smithi098.stdout:2/921: sync 2024-09-19T07:25:01.693 INFO:tasks.workunit.client.0.smithi098.stdout:4/864: dwrite da/d59/fcf [0,4194304] 0 2024-09-19T07:25:01.693 INFO:tasks.workunit.client.0.smithi098.stdout:2/922: creat d1/d9/d26/d35/d88/f139 x:0 0 0 2024-09-19T07:25:01.694 INFO:tasks.workunit.client.0.smithi098.stdout:2/923: mknod d1/d9/d1d/d8c/c13a 0 2024-09-19T07:25:01.694 INFO:tasks.workunit.client.0.smithi098.stdout:2/924: dread - d1/d9/d26/d35/d88/fec zero size 2024-09-19T07:25:01.695 INFO:tasks.workunit.client.0.smithi098.stdout:2/925: getdents d1/d5/d34/d39 0 2024-09-19T07:25:01.696 INFO:tasks.workunit.client.0.smithi098.stdout:4/865: creat da/d31/d46/d5f/d8a/db6/dc2/de7/f125 x:0 0 0 2024-09-19T07:25:01.696 INFO:tasks.workunit.client.0.smithi098.stdout:4/866: write da/d31/d46/d5f/d8a/db6/dc9/fda [169041,42185] 0 2024-09-19T07:25:01.696 INFO:tasks.workunit.client.0.smithi098.stdout:2/926: truncate d1/d9/f14 649488 0 2024-09-19T07:25:01.697 INFO:tasks.workunit.client.0.smithi098.stdout:2/927: chown d1/d9/d26/d35/d58/f5b 44712877 1 2024-09-19T07:25:01.699 INFO:tasks.workunit.client.0.smithi098.stdout:2/928: mkdir d1/d9/d26/d35/d48/d6e/d13b 0 2024-09-19T07:25:01.699 INFO:tasks.workunit.client.0.smithi098.stdout:2/929: fsync d1/d5/d72/db5/dad/fc0 0 2024-09-19T07:25:01.714 INFO:tasks.workunit.client.0.smithi098.stdout:7/986: link d5/dce/fd2 d5/d3e/d62/da0/dc5/f147 0 2024-09-19T07:25:01.715 INFO:tasks.workunit.client.0.smithi098.stdout:7/987: mknod d5/d10/d11/d9e/c148 0 2024-09-19T07:25:01.717 INFO:tasks.workunit.client.0.smithi098.stdout:8/869: dwrite d0/d33/f6e [0,4194304] 0 2024-09-19T07:25:01.717 INFO:tasks.workunit.client.0.smithi098.stdout:7/988: rename d5/d10/d50/dad/d116/f143 to d5/dce/f149 0 2024-09-19T07:25:01.717 INFO:tasks.workunit.client.0.smithi098.stdout:7/989: chown d5/f124 53481402 1 2024-09-19T07:25:01.717 INFO:tasks.workunit.client.0.smithi098.stdout:7/990: chown d5/d10/l56 2814294 1 2024-09-19T07:25:01.718 INFO:tasks.workunit.client.0.smithi098.stdout:7/991: chown d5/d3e/d62/da0/fc4 283 1 2024-09-19T07:25:01.718 INFO:tasks.workunit.client.0.smithi098.stdout:7/992: truncate d5/dce/dd5/ff0 426335 0 2024-09-19T07:25:01.718 INFO:tasks.workunit.client.0.smithi098.stdout:7/993: dread d5/d3e/d62/da0/fc4 [0,4194304] 0 2024-09-19T07:25:01.724 INFO:tasks.workunit.client.0.smithi098.stdout:4/867: dwrite da/d31/d46/d5f/d8a/db6/dc2/de7/d109/fa3 [0,4194304] 0 2024-09-19T07:25:01.724 INFO:tasks.workunit.client.0.smithi098.stdout:4/868: chown da/c2f 5 1 2024-09-19T07:25:01.724 INFO:tasks.workunit.client.0.smithi098.stdout:4/869: mkdir da/d31/d46/d56/d5b/db9/df0/d126 0 2024-09-19T07:25:01.724 INFO:tasks.workunit.client.0.smithi098.stdout:4/870: chown da/d31/d46/d56/d5b/d66/cb3 13927 1 2024-09-19T07:25:01.729 INFO:tasks.workunit.client.0.smithi098.stdout:4/871: write da/d31/d46/d56/d5b/d66/fd0 [2662748,65381] 0 2024-09-19T07:25:01.729 INFO:tasks.workunit.client.0.smithi098.stdout:4/872: chown da/d31/d46/d56/fef 4 1 2024-09-19T07:25:01.730 INFO:tasks.workunit.client.0.smithi098.stdout:4/873: truncate da/d31/d46/d5f/d8a/db6/dc2/de7/d109/fa3 4545423 0 2024-09-19T07:25:01.731 INFO:tasks.workunit.client.0.smithi098.stdout:4/874: creat da/d59/f127 x:0 0 0 2024-09-19T07:25:01.731 INFO:tasks.workunit.client.0.smithi098.stdout:4/875: readlink da/d31/d46/d5f/ldb 0 2024-09-19T07:25:01.733 INFO:tasks.workunit.client.0.smithi098.stdout:4/876: dread da/d59/f86 [8388608,4194304] 0 2024-09-19T07:25:01.733 INFO:tasks.workunit.client.0.smithi098.stdout:4/877: symlink da/d31/d46/d56/d5b/db9/df0/d10a/l128 0 2024-09-19T07:25:01.740 INFO:tasks.workunit.client.0.smithi098.stdout:4/878: dread da/d31/d46/d5f/d8a/db6/dc2/de7/ff1 [0,4194304] 0 2024-09-19T07:25:01.740 INFO:tasks.workunit.client.0.smithi098.stdout:4/879: readlink da/d31/d46/d56/d5b/d66/l11b 0 2024-09-19T07:25:01.742 INFO:tasks.workunit.client.0.smithi098.stdout:4/880: creat da/d31/d46/d114/f129 x:0 0 0 2024-09-19T07:25:01.742 INFO:tasks.workunit.client.0.smithi098.stdout:4/881: write da/d31/d46/d56/d5b/db9/df0/f11c [848744,20842] 0 2024-09-19T07:25:01.750 INFO:tasks.workunit.client.0.smithi098.stdout:8/870: dwrite d0/d33/d55/fc3 [0,4194304] 0 2024-09-19T07:25:01.750 INFO:tasks.workunit.client.0.smithi098.stdout:8/871: fdatasync d0/d16/d65/dd8/fe6 0 2024-09-19T07:25:01.771 INFO:tasks.workunit.client.0.smithi098.stdout:4/882: dwrite da/d31/d46/d56/d5b/d66/f7a [0,4194304] 0 2024-09-19T07:25:01.771 INFO:tasks.workunit.client.0.smithi098.stdout:4/883: write da/d31/d46/d114/f129 [69797,73560] 0 2024-09-19T07:25:01.772 INFO:tasks.workunit.client.0.smithi098.stdout:4/884: rmdir da/d31/d46/d5f/dc8 39 2024-09-19T07:25:01.773 INFO:tasks.workunit.client.0.smithi098.stdout:4/885: truncate da/d31/d46/d56/d5b/d61/fb4 459968 0 2024-09-19T07:25:01.773 INFO:tasks.workunit.client.0.smithi098.stdout:4/886: dread - da/d59/f124 zero size 2024-09-19T07:25:01.775 INFO:tasks.workunit.client.0.smithi098.stdout:4/887: truncate da/f4b 3795023 0 2024-09-19T07:25:01.776 INFO:tasks.workunit.client.0.smithi098.stdout:4/888: truncate da/d59/d5d/f6c 3528625 0 2024-09-19T07:25:01.776 INFO:tasks.workunit.client.0.smithi098.stdout:4/889: read - da/d31/d46/d5f/d118/df2/f108 zero size 2024-09-19T07:25:01.795 INFO:tasks.workunit.client.0.smithi098.stdout:4/890: dwrite da/d59/f86 [8388608,4194304] 0 2024-09-19T07:25:01.796 INFO:tasks.workunit.client.0.smithi098.stdout:4/891: mkdir da/d31/d46/d56/d5b/db9/df0/d10a/d12a 0 2024-09-19T07:25:01.801 INFO:tasks.workunit.client.0.smithi098.stdout:6/841: sync 2024-09-19T07:25:01.801 INFO:tasks.workunit.client.0.smithi098.stdout:1/954: sync 2024-09-19T07:25:01.801 INFO:tasks.workunit.client.0.smithi098.stdout:1/955: truncate dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/f95 606619 0 2024-09-19T07:25:01.802 INFO:tasks.workunit.client.0.smithi098.stdout:6/842: mkdir d2/d5/d128 0 2024-09-19T07:25:01.804 INFO:tasks.workunit.client.0.smithi098.stdout:1/956: creat dc/da5/f151 x:0 0 0 2024-09-19T07:25:01.804 INFO:tasks.workunit.client.0.smithi098.stdout:4/892: read da/d31/d46/d56/f89 [3741010,90285] 0 2024-09-19T07:25:01.805 INFO:tasks.workunit.client.0.smithi098.stdout:6/843: mknod d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e/c129 0 2024-09-19T07:25:01.805 INFO:tasks.workunit.client.0.smithi098.stdout:6/844: chown d2/db0 27870002 1 2024-09-19T07:25:01.808 INFO:tasks.workunit.client.0.smithi098.stdout:6/845: dread d2/d5/f81 [0,4194304] 0 2024-09-19T07:25:01.808 INFO:tasks.workunit.client.0.smithi098.stdout:1/957: unlink dc/de/d22/d31/d35/d4f/f7e 0 2024-09-19T07:25:01.808 INFO:tasks.workunit.client.0.smithi098.stdout:1/958: readlink dc/d17/d1b/d71/d7a/d136/l144 0 2024-09-19T07:25:01.808 INFO:tasks.workunit.client.0.smithi098.stdout:1/959: write dc/de/d22/d31/d5d/d6a/d6f/d4d/f73 [916818,84297] 0 2024-09-19T07:25:01.808 INFO:tasks.workunit.client.0.smithi098.stdout:1/960: write dc/de/d22/d31/d35/ff4 [3973162,75784] 0 2024-09-19T07:25:01.809 INFO:tasks.workunit.client.0.smithi098.stdout:6/846: creat d2/d5/d1f/d26/d42/d48/d53/f12a x:0 0 0 2024-09-19T07:25:01.810 INFO:tasks.workunit.client.0.smithi098.stdout:1/961: unlink dc/d2a/cc0 0 2024-09-19T07:25:01.810 INFO:tasks.workunit.client.0.smithi098.stdout:1/962: chown dc/d17/d1b/d1d/d30/l10b 141 1 2024-09-19T07:25:01.811 INFO:tasks.workunit.client.0.smithi098.stdout:4/893: dread da/d31/f40 [0,4194304] 0 2024-09-19T07:25:01.811 INFO:tasks.workunit.client.0.smithi098.stdout:6/847: rename d2/d5/d1f/d26/d42/d48/f109 to d2/db0/d8d/f12b 0 2024-09-19T07:25:01.812 INFO:tasks.workunit.client.0.smithi098.stdout:1/963: getdents dc/de/d22/d31/d5d/d6a/d6f/d5f/db0 0 2024-09-19T07:25:01.820 INFO:tasks.workunit.client.0.smithi098.stdout:6/848: dread d2/d5/f10a [0,4194304] 0 2024-09-19T07:25:01.820 INFO:tasks.workunit.client.0.smithi098.stdout:6/849: truncate d2/db0/d4e/d6e/d9d/ffb 785209 0 2024-09-19T07:25:01.839 INFO:tasks.workunit.client.0.smithi098.stdout:1/964: dwrite dc/de/d22/d31/d5d/d6a/d6f/d4d/dc6/fe5 [0,4194304] 0 2024-09-19T07:25:01.840 INFO:tasks.workunit.client.0.smithi098.stdout:1/965: dread - dc/de/d22/d31/d5d/d6a/d6f/d5f/fc2 zero size 2024-09-19T07:25:01.840 INFO:tasks.workunit.client.0.smithi098.stdout:1/966: truncate dc/f12d 1006654 0 2024-09-19T07:25:01.840 INFO:tasks.workunit.client.0.smithi098.stdout:1/967: write dc/de/d22/d31/ff8 [837330,4079] 0 2024-09-19T07:25:01.844 INFO:tasks.workunit.client.0.smithi098.stdout:1/968: write dc/de/d22/d31/d5d/d6a/f112 [966366,38147] 0 2024-09-19T07:25:01.844 INFO:tasks.workunit.client.0.smithi098.stdout:1/969: read - dc/d17/d1b/d71/fb9 zero size 2024-09-19T07:25:01.844 INFO:tasks.workunit.client.0.smithi098.stdout:1/970: mknod dc/de/d50/c152 0 2024-09-19T07:25:01.844 INFO:tasks.workunit.client.0.smithi098.stdout:1/971: readlink dc/l11 0 2024-09-19T07:25:01.849 INFO:tasks.workunit.client.0.smithi098.stdout:6/850: dwrite d2/d5/d1f/d26/f113 [0,4194304] 0 2024-09-19T07:25:01.851 INFO:tasks.workunit.client.0.smithi098.stdout:6/851: mkdir d2/d5/d1f/d26/d7b/da3/d12c 0 2024-09-19T07:25:01.852 INFO:tasks.workunit.client.0.smithi098.stdout:6/852: symlink d2/d5/d1f/d26/d7b/da3/d12c/l12d 0 2024-09-19T07:25:01.853 INFO:tasks.workunit.client.0.smithi098.stdout:6/853: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/dbf/f12e x:0 0 0 2024-09-19T07:25:01.872 INFO:tasks.workunit.client.0.smithi098.stdout:1/972: dwrite dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/f55 [0,4194304] 0 2024-09-19T07:25:01.874 INFO:tasks.workunit.client.0.smithi098.stdout:1/973: symlink dc/d17/d1b/d1d/d3d/l153 0 2024-09-19T07:25:01.875 INFO:tasks.workunit.client.0.smithi098.stdout:6/854: dwrite d2/d5/d1f/d26/f126 [0,4194304] 0 2024-09-19T07:25:01.875 INFO:tasks.workunit.client.0.smithi098.stdout:6/855: stat d2/d5/d1f/d26/d7b/da3/ld2 0 2024-09-19T07:25:01.879 INFO:tasks.workunit.client.0.smithi098.stdout:1/974: symlink dc/da5/dcf/l154 0 2024-09-19T07:25:01.879 INFO:tasks.workunit.client.0.smithi098.stdout:1/975: readlink dc/d17/d1b/d1d/d30/l10b 0 2024-09-19T07:25:01.880 INFO:tasks.workunit.client.0.smithi098.stdout:2/930: sync 2024-09-19T07:25:01.880 INFO:tasks.workunit.client.0.smithi098.stdout:8/872: sync 2024-09-19T07:25:01.880 INFO:tasks.workunit.client.0.smithi098.stdout:4/894: sync 2024-09-19T07:25:01.880 INFO:tasks.workunit.client.0.smithi098.stdout:7/994: sync 2024-09-19T07:25:01.881 INFO:tasks.workunit.client.0.smithi098.stdout:7/995: readlink d5/d3e/d61/le1 0 2024-09-19T07:25:01.881 INFO:tasks.workunit.client.0.smithi098.stdout:2/931: mknod d1/d5/d34/d39/c13c 0 2024-09-19T07:25:01.882 INFO:tasks.workunit.client.0.smithi098.stdout:8/873: creat d0/d16/d61/f123 x:0 0 0 2024-09-19T07:25:01.882 INFO:tasks.workunit.client.0.smithi098.stdout:8/874: chown d0/d33/d44/fb1 0 1 2024-09-19T07:25:01.884 INFO:tasks.workunit.client.0.smithi098.stdout:2/932: mkdir d1/d9/d26/d35/d88/dc2/d13d 0 2024-09-19T07:25:01.884 INFO:tasks.workunit.client.0.smithi098.stdout:2/933: write d1/dcb/dfd/d93/d61/d62/f133 [881372,79280] 0 2024-09-19T07:25:01.884 INFO:tasks.workunit.client.0.smithi098.stdout:2/934: truncate d1/d9/d26/d35/d88/f108 291863 0 2024-09-19T07:25:01.884 INFO:tasks.workunit.client.0.smithi098.stdout:8/875: mkdir d0/d33/d55/d8a/d12/dba/df2/d9e/d124 0 2024-09-19T07:25:01.885 INFO:tasks.workunit.client.0.smithi098.stdout:7/996: getdents d5/d3e/d61 0 2024-09-19T07:25:01.887 INFO:tasks.workunit.client.0.smithi098.stdout:7/997: unlink d5/d8/dc/f9b 0 2024-09-19T07:25:01.887 INFO:tasks.workunit.client.0.smithi098.stdout:7/998: fdatasync d5/d3e/d62/f65 0 2024-09-19T07:25:01.887 INFO:tasks.workunit.client.0.smithi098.stdout:7/999: truncate d5/d10/dc2/d5c/dc3/f108 50521 0 2024-09-19T07:25:01.888 INFO:tasks.workunit.client.0.smithi098.stdout:8/876: dread d0/d33/d55/d8a/d12/dba/df2/d9e/da4/faf [0,4194304] 0 2024-09-19T07:25:01.888 INFO:tasks.workunit.client.0.smithi098.stdout:8/877: rmdir d0/d16/d7d/dcc/dd2/df5 39 2024-09-19T07:25:01.891 INFO:tasks.workunit.client.0.smithi098.stdout:8/878: symlink d0/d33/d55/d8a/d28/l125 0 2024-09-19T07:25:01.891 INFO:tasks.workunit.client.0.smithi098.stdout:8/879: write d0/d33/d55/d8a/f18 [2324037,40070] 0 2024-09-19T07:25:01.892 INFO:tasks.workunit.client.0.smithi098.stdout:8/880: creat d0/d33/d55/d8a/d28/d118/f126 x:0 0 0 2024-09-19T07:25:01.896 INFO:tasks.workunit.client.0.smithi098.stdout:6/856: dwrite d2/d5/d1f/d26/d7b/ff8 [4194304,4194304] 0 2024-09-19T07:25:01.898 INFO:tasks.workunit.client.0.smithi098.stdout:6/857: read d2/d5/d1f/d26/fd1 [122002,70713] 0 2024-09-19T07:25:01.901 INFO:tasks.workunit.client.0.smithi098.stdout:6/858: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/f12f x:0 0 0 2024-09-19T07:25:01.903 INFO:tasks.workunit.client.0.smithi098.stdout:6/859: mknod d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/c130 0 2024-09-19T07:25:01.903 INFO:tasks.workunit.client.0.smithi098.stdout:6/860: write d2/d5/f16 [3204204,115060] 0 2024-09-19T07:25:01.906 INFO:tasks.workunit.client.0.smithi098.stdout:6/861: dread d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e/f11e [0,4194304] 0 2024-09-19T07:25:01.908 INFO:tasks.workunit.client.0.smithi098.stdout:2/935: dwrite d1/d9/d26/d35/d88/dc2/dfb/d60/dbe/fc7 [0,4194304] 0 2024-09-19T07:25:01.910 INFO:tasks.workunit.client.0.smithi098.stdout:2/936: creat d1/d9/d26/d35/d91/f13e x:0 0 0 2024-09-19T07:25:01.912 INFO:tasks.workunit.client.0.smithi098.stdout:1/976: rename dc/d17/d1b/d71/d7a/d107/c122 to dc/de/d22/d31/c155 0 2024-09-19T07:25:01.912 INFO:tasks.workunit.client.0.smithi098.stdout:8/881: dwrite d0/d33/d55/d8a/f120 [0,4194304] 0 2024-09-19T07:25:01.914 INFO:tasks.workunit.client.0.smithi098.stdout:8/882: creat d0/d16/d7d/dcc/dd2/df5/d115/f127 x:0 0 0 2024-09-19T07:25:01.920 INFO:tasks.workunit.client.0.smithi098.stdout:1/977: dread dc/de/d22/d31/d35/d58/dec/d10a/f138 [0,4194304] 0 2024-09-19T07:25:01.920 INFO:tasks.workunit.client.0.smithi098.stdout:1/978: dread - dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/fa7 zero size 2024-09-19T07:25:01.920 INFO:tasks.workunit.client.0.smithi098.stdout:1/979: write dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/ddd/f12e [276876,126165] 0 2024-09-19T07:25:01.920 INFO:tasks.workunit.client.0.smithi098.stdout:1/980: write dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f13c [613523,109553] 0 2024-09-19T07:25:01.926 INFO:tasks.workunit.client.0.smithi098.stdout:1/981: dread dc/d17/d1b/d1d/f3f [0,4194304] 0 2024-09-19T07:25:01.926 INFO:tasks.workunit.client.0.smithi098.stdout:1/982: stat dc/de/d22/d31/d5d/d6a/d6f/c104 0 2024-09-19T07:25:01.928 INFO:tasks.workunit.client.0.smithi098.stdout:4/895: rename da/d31/f39 to da/d31/d46/d56/d5b/db9/df0/d126/f12b 0 2024-09-19T07:25:01.930 INFO:tasks.workunit.client.0.smithi098.stdout:6/862: rename d2/d5/d1f/d26/d42/da4 to d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/d131 0 2024-09-19T07:25:01.932 INFO:tasks.workunit.client.0.smithi098.stdout:2/937: rename d1/d9/d3e/la6 to d1/d9/d26/d35/d48/d6e/d13b/l13f 0 2024-09-19T07:25:01.933 INFO:tasks.workunit.client.0.smithi098.stdout:4/896: truncate da/d31/d46/d5f/d8a/db6/dc9/f123 2878475 0 2024-09-19T07:25:01.935 INFO:tasks.workunit.client.0.smithi098.stdout:2/938: rename d1/dcb/dfd/c86 to d1/d9/d26/d35/d88/dc2/dfb/d60/d65/c140 0 2024-09-19T07:25:01.935 INFO:tasks.workunit.client.0.smithi098.stdout:2/939: read - d1/d9/d26/d35/d48/d7f/fcc zero size 2024-09-19T07:25:01.937 INFO:tasks.workunit.client.0.smithi098.stdout:8/883: dwrite d0/d2c/fe7 [4194304,4194304] 0 2024-09-19T07:25:01.938 INFO:tasks.workunit.client.0.smithi098.stdout:2/940: unlink d1/d5/fe2 0 2024-09-19T07:25:01.940 INFO:tasks.workunit.client.0.smithi098.stdout:2/941: mknod d1/d9/d26/d35/d48/d6e/d13b/c141 0 2024-09-19T07:25:01.941 INFO:tasks.workunit.client.0.smithi098.stdout:2/942: mkdir d1/d5/d72/db5/dad/d10a/d142 0 2024-09-19T07:25:01.945 INFO:tasks.workunit.client.0.smithi098.stdout:2/943: symlink d1/d9/d26/d35/d58/l143 0 2024-09-19T07:25:01.947 INFO:tasks.workunit.client.0.smithi098.stdout:8/884: dread d0/d33/d55/d8a/d12/fab [0,4194304] 0 2024-09-19T07:25:01.947 INFO:tasks.workunit.client.0.smithi098.stdout:2/944: mkdir d1/dcb/dfd/d144 0 2024-09-19T07:25:01.949 INFO:tasks.workunit.client.0.smithi098.stdout:8/885: link d0/d33/d55/d8a/d28/l30 d0/d33/d55/d8a/d28/l128 0 2024-09-19T07:25:01.949 INFO:tasks.workunit.client.0.smithi098.stdout:8/886: fdatasync d0/d2c/f66 0 2024-09-19T07:25:01.954 INFO:tasks.workunit.client.0.smithi098.stdout:4/897: dwrite da/d31/d46/d56/fef [0,4194304] 0 2024-09-19T07:25:01.954 INFO:tasks.workunit.client.0.smithi098.stdout:4/898: fdatasync da/d31/d46/d5f/f8d 0 2024-09-19T07:25:01.954 INFO:tasks.workunit.client.0.smithi098.stdout:4/899: chown da/d59/f127 5 1 2024-09-19T07:25:01.955 INFO:tasks.workunit.client.0.smithi098.stdout:4/900: getdents da/d31/d46/d5f/d118 0 2024-09-19T07:25:01.956 INFO:tasks.workunit.client.0.smithi098.stdout:4/901: stat da/d31/d46/d56/d5b/db9/fcc 0 2024-09-19T07:25:01.956 INFO:tasks.workunit.client.0.smithi098.stdout:4/902: fsync da/d31/d46/d56/d5b/d63/f11a 0 2024-09-19T07:25:01.957 INFO:tasks.workunit.client.0.smithi098.stdout:4/903: read da/f30 [733566,26751] 0 2024-09-19T07:25:01.957 INFO:tasks.workunit.client.0.smithi098.stdout:4/904: write da/d59/d5d/f68 [486743,3779] 0 2024-09-19T07:25:01.961 INFO:tasks.workunit.client.0.smithi098.stdout:4/905: unlink da/d31/d46/d56/c84 0 2024-09-19T07:25:01.962 INFO:tasks.workunit.client.0.smithi098.stdout:6/863: dwrite d2/d5/d1f/d26/d42/d48/fab [0,4194304] 0 2024-09-19T07:25:01.962 INFO:tasks.workunit.client.0.smithi098.stdout:6/864: write d2/d5/d1f/d26/d42/d48/d53/d64/d6d/ffd [6229,60631] 0 2024-09-19T07:25:01.965 INFO:tasks.workunit.client.0.smithi098.stdout:6/865: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/l132 0 2024-09-19T07:25:01.967 INFO:tasks.workunit.client.0.smithi098.stdout:4/906: mkdir da/d31/d46/d5f/d8a/db6/dc2/de7/d109/d12c 0 2024-09-19T07:25:01.967 INFO:tasks.workunit.client.0.smithi098.stdout:4/907: fsync da/d31/f111 0 2024-09-19T07:25:01.975 INFO:tasks.workunit.client.0.smithi098.stdout:6/866: dread d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e/f1d [0,4194304] 0 2024-09-19T07:25:01.975 INFO:tasks.workunit.client.0.smithi098.stdout:8/887: read d0/d33/d55/d8a/d12/dba/df2/d9e/da4/db9/ff6 [3842029,29461] 0 2024-09-19T07:25:01.984 INFO:tasks.workunit.client.0.smithi098.stdout:8/888: dread d0/d2c/dfb/f101 [0,4194304] 0 2024-09-19T07:25:01.986 INFO:tasks.workunit.client.0.smithi098.stdout:6/867: read d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/d131/fca [851168,63103] 0 2024-09-19T07:25:01.989 INFO:tasks.workunit.client.0.smithi098.stdout:8/889: dread d0/dc5/f91 [4194304,4194304] 0 2024-09-19T07:25:01.989 INFO:tasks.workunit.client.0.smithi098.stdout:8/890: fdatasync d0/d33/d55/d8a/d21/deb/ffc 0 2024-09-19T07:25:01.989 INFO:tasks.workunit.client.0.smithi098.stdout:8/891: write d0/d33/d44/ffe [657297,56741] 0 2024-09-19T07:25:01.989 INFO:tasks.workunit.client.0.smithi098.stdout:6/868: write d2/d11/f66 [200405,100958] 0 2024-09-19T07:25:01.989 INFO:tasks.workunit.client.0.smithi098.stdout:6/869: read - d2/d5/d1f/d26/d42/d48/d53/f12a zero size 2024-09-19T07:25:01.993 INFO:tasks.workunit.client.0.smithi098.stdout:4/908: dwrite da/d7e/fb0 [0,4194304] 0 2024-09-19T07:25:01.996 INFO:tasks.workunit.client.0.smithi098.stdout:6/870: rmdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101 39 2024-09-19T07:25:01.996 INFO:tasks.workunit.client.0.smithi098.stdout:6/871: chown d2/d5 5927742 1 2024-09-19T07:25:01.996 INFO:tasks.workunit.client.0.smithi098.stdout:6/872: truncate d2/d5/d1f/d26/d7b/da3/f11b 313087 0 2024-09-19T07:25:01.997 INFO:tasks.workunit.client.0.smithi098.stdout:6/873: link d2/d5/d1f/d26/d42/d48/d53/d64/d79/le3 d2/d5/d1f/d105/d10b/l133 0 2024-09-19T07:25:01.997 INFO:tasks.workunit.client.0.smithi098.stdout:6/874: write d2/d5/fb8 [4023952,43212] 0 2024-09-19T07:25:01.997 INFO:tasks.workunit.client.0.smithi098.stdout:6/875: rmdir d2/d5/d1f/d105 39 2024-09-19T07:25:01.998 INFO:tasks.workunit.client.0.smithi098.stdout:6/876: creat d2/d5/d1f/d105/d10b/f134 x:0 0 0 2024-09-19T07:25:01.999 INFO:tasks.workunit.client.0.smithi098.stdout:6/877: rename d2/d5/d1f/d26/d42/d48/d53/d64/fb5 to d2/d5/d1f/d26/d42/d48/f135 0 2024-09-19T07:25:02.002 INFO:tasks.workunit.client.0.smithi098.stdout:6/878: rename d2/db0/d8d/fdd to d2/d5/d1f/d26/d42/d48/dc3/f136 0 2024-09-19T07:25:02.002 INFO:tasks.workunit.client.0.smithi098.stdout:8/892: dread d0/f7e [0,4194304] 0 2024-09-19T07:25:02.005 INFO:tasks.workunit.client.0.smithi098.stdout:8/893: rename d0/d2c/d81/l8b to d0/d16/d65/l129 0 2024-09-19T07:25:02.005 INFO:tasks.workunit.client.0.smithi098.stdout:8/894: fdatasync d0/d16/d65/d9a/fcb 0 2024-09-19T07:25:02.007 INFO:tasks.workunit.client.0.smithi098.stdout:8/895: unlink d0/d16/d61/ld0 0 2024-09-19T07:25:02.026 INFO:tasks.workunit.client.0.smithi098.stdout:4/909: dwrite da/d31/d46/d5f/d8a/db6/dc9/f123 [0,4194304] 0 2024-09-19T07:25:02.031 INFO:tasks.workunit.client.0.smithi098.stdout:8/896: dwrite d0/d33/d55/d8a/d21/deb/ffc [0,4194304] 0 2024-09-19T07:25:02.033 INFO:tasks.workunit.client.0.smithi098.stdout:8/897: creat d0/d16/d7d/dcc/dd2/f12a x:0 0 0 2024-09-19T07:25:02.044 INFO:tasks.workunit.client.0.smithi098.stdout:8/898: dread d0/d33/d55/d8a/f27 [0,4194304] 0 2024-09-19T07:25:02.044 INFO:tasks.workunit.client.0.smithi098.stdout:6/879: dwrite d2/d5/d1f/d26/d42/d48/fab [0,4194304] 0 2024-09-19T07:25:02.048 INFO:tasks.workunit.client.0.smithi098.stdout:4/910: dwrite da/d31/d46/d5f/d8a/db6/dc9/fe3 [0,4194304] 0 2024-09-19T07:25:02.049 INFO:tasks.workunit.client.0.smithi098.stdout:8/899: rename d0/d16/d7d/fce to d0/d33/f12b 0 2024-09-19T07:25:02.049 INFO:tasks.workunit.client.0.smithi098.stdout:8/900: getdents d0/d33/d55/d8a/d12/dba/df2/d9e/da4/db9 0 2024-09-19T07:25:02.049 INFO:tasks.workunit.client.0.smithi098.stdout:6/880: unlink d2/d11/f2a 0 2024-09-19T07:25:02.049 INFO:tasks.workunit.client.0.smithi098.stdout:6/881: chown d2/d11/f11d 6325731 1 2024-09-19T07:25:02.050 INFO:tasks.workunit.client.0.smithi098.stdout:8/901: rename d0/d33/c58 to d0/d16/d65/c12c 0 2024-09-19T07:25:02.050 INFO:tasks.workunit.client.0.smithi098.stdout:4/911: getdents da/d31/d46/d5f/dc8 0 2024-09-19T07:25:02.051 INFO:tasks.workunit.client.0.smithi098.stdout:4/912: fsync da/d31/f111 0 2024-09-19T07:25:02.053 INFO:tasks.workunit.client.0.smithi098.stdout:6/882: creat d2/d5/d1f/d26/d42/d48/f137 x:0 0 0 2024-09-19T07:25:02.054 INFO:tasks.workunit.client.0.smithi098.stdout:4/913: creat da/d31/d46/d56/d5b/db9/df0/d10a/d119/f12d x:0 0 0 2024-09-19T07:25:02.054 INFO:tasks.workunit.client.0.smithi098.stdout:4/914: chown da/d31/d46/ld4 2772 1 2024-09-19T07:25:02.055 INFO:tasks.workunit.client.0.smithi098.stdout:4/915: symlink da/d31/d46/d56/d5b/db9/df0/l12e 0 2024-09-19T07:25:02.058 INFO:tasks.workunit.client.0.smithi098.stdout:4/916: mkdir da/d31/d46/d114/d12f 0 2024-09-19T07:25:02.060 INFO:tasks.workunit.client.0.smithi098.stdout:6/883: rename d2/l52 to d2/d5/d1f/d26/d42/d48/d53/d64/d6d/l138 0 2024-09-19T07:25:02.068 INFO:tasks.workunit.client.0.smithi098.stdout:6/884: rename d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/d10e to d2/d5/d1f/d26/d42/d48/d53/da2/d139 0 2024-09-19T07:25:02.071 INFO:tasks.workunit.client.0.smithi098.stdout:8/902: dwrite d0/d16/d7d/dcc/dd2/df5/d115/f119 [0,4194304] 0 2024-09-19T07:25:02.075 INFO:tasks.workunit.client.0.smithi098.stdout:6/885: dread d2/d5/d1f/d26/d42/d48/d123/fac [0,4194304] 0 2024-09-19T07:25:02.077 INFO:tasks.workunit.client.0.smithi098.stdout:4/917: rmdir da/d31/d46/d56 39 2024-09-19T07:25:02.078 INFO:tasks.workunit.client.0.smithi098.stdout:4/918: write da/d31/d46/d56/d5b/d61/fec [969214,78464] 0 2024-09-19T07:25:02.085 INFO:tasks.workunit.client.0.smithi098.stdout:4/919: write da/d59/f86 [1482940,127877] 0 2024-09-19T07:25:02.087 INFO:tasks.workunit.client.0.smithi098.stdout:4/920: symlink da/d31/d46/d56/d5b/db9/df0/l130 0 2024-09-19T07:25:02.087 INFO:tasks.workunit.client.0.smithi098.stdout:4/921: chown da/d31/d46/d56/d5b/db9/df0/d10a/d119/f12d 1904289 1 2024-09-19T07:25:02.094 INFO:tasks.workunit.client.0.smithi098.stdout:4/922: dread da/d31/d46/d5f/d8a/f10e [0,4194304] 0 2024-09-19T07:25:02.095 INFO:tasks.workunit.client.0.smithi098.stdout:4/923: creat da/d31/d46/d56/d5b/db9/df0/d10a/d113/f131 x:0 0 0 2024-09-19T07:25:02.100 INFO:tasks.workunit.client.0.smithi098.stdout:8/903: dwrite d0/d2c/dfb/f101 [0,4194304] 0 2024-09-19T07:25:02.127 INFO:tasks.workunit.client.0.smithi098.stdout:8/904: dwrite d0/dc5/f96 [0,4194304] 0 2024-09-19T07:25:02.127 INFO:tasks.workunit.client.0.smithi098.stdout:4/924: dwrite da/d31/dc5/fe1 [0,4194304] 0 2024-09-19T07:25:02.127 INFO:tasks.workunit.client.0.smithi098.stdout:4/925: chown da/c81 990253534 1 2024-09-19T07:25:02.127 INFO:tasks.workunit.client.0.smithi098.stdout:4/926: chown da/d31/d46/d5f/d8a/db6/dc9/l10f 5 1 2024-09-19T07:25:02.128 INFO:tasks.workunit.client.0.smithi098.stdout:8/905: creat d0/d33/d55/d8a/d21/d3c/f12d x:0 0 0 2024-09-19T07:25:02.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:01 smithi162 ceph-mon[35726]: pgmap v92: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 188 MiB/s rd, 216 MiB/s wr, 1.02k op/s 2024-09-19T07:25:02.133 INFO:tasks.workunit.client.0.smithi098.stdout:8/906: rename d0/d33/d55/d8a/d28/c4f to d0/d2c/dfb/d10f/c12e 0 2024-09-19T07:25:02.135 INFO:tasks.workunit.client.0.smithi098.stdout:8/907: unlink d0/d1a/f1c 0 2024-09-19T07:25:02.135 INFO:tasks.workunit.client.0.smithi098.stdout:8/908: write d0/d16/d61/f123 [374015,126102] 0 2024-09-19T07:25:02.136 INFO:tasks.workunit.client.0.smithi098.stdout:8/909: symlink d0/d33/d55/d8a/d12/dba/df2/d9e/da4/d11c/l12f 0 2024-09-19T07:25:02.145 INFO:tasks.workunit.client.0.smithi098.stdout:4/927: dwrite da/fb [8388608,4194304] 0 2024-09-19T07:25:02.145 INFO:tasks.workunit.client.0.smithi098.stdout:4/928: fsync da/fb 0 2024-09-19T07:25:02.147 INFO:tasks.workunit.client.0.smithi098.stdout:4/929: creat da/d59/d5d/f132 x:0 0 0 2024-09-19T07:25:02.153 INFO:tasks.workunit.client.0.smithi098.stdout:4/930: write da/d31/d46/d56/d5b/db9/fd9 [1703543,49100] 0 2024-09-19T07:25:02.154 INFO:tasks.workunit.client.0.smithi098.stdout:4/931: mkdir da/d31/d46/d56/d5b/db9/d133 0 2024-09-19T07:25:02.155 INFO:tasks.workunit.client.0.smithi098.stdout:4/932: readlink da/d31/d46/d56/d5b/d61/lce 0 2024-09-19T07:25:02.161 INFO:tasks.workunit.client.0.smithi098.stdout:4/933: dread da/d31/d46/d5f/fd7 [0,4194304] 0 2024-09-19T07:25:02.168 INFO:tasks.workunit.client.0.smithi098.stdout:4/934: dread da/d31/dc5/fe1 [0,4194304] 0 2024-09-19T07:25:02.169 INFO:tasks.workunit.client.0.smithi098.stdout:4/935: symlink da/d31/d46/d56/d5b/db9/df0/d10a/d119/l134 0 2024-09-19T07:25:02.170 INFO:tasks.workunit.client.0.smithi098.stdout:4/936: creat da/d31/d46/d56/d5b/db9/df0/d10a/d113/f135 x:0 0 0 2024-09-19T07:25:02.181 INFO:tasks.workunit.client.0.smithi098.stdout:4/937: rename da/d31/d46/d5f/dc8/c112 to da/d31/d46/d5f/d8a/db6/dc2/de7/c136 0 2024-09-19T07:25:02.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:01 smithi098 ceph-mon[30950]: pgmap v92: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 188 MiB/s rd, 216 MiB/s wr, 1.02k op/s 2024-09-19T07:25:02.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:01 smithi139 ceph-mon[35039]: pgmap v92: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 188 MiB/s rd, 216 MiB/s wr, 1.02k op/s 2024-09-19T07:25:04.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:03 smithi162 ceph-mon[35726]: pgmap v93: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 188 MiB/s rd, 216 MiB/s wr, 1.02k op/s 2024-09-19T07:25:04.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:03 smithi098 ceph-mon[30950]: pgmap v93: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 188 MiB/s rd, 216 MiB/s wr, 1.02k op/s 2024-09-19T07:25:04.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:03 smithi139 ceph-mon[35039]: pgmap v93: 97 pgs: 97 active+clean; 1.5 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 188 MiB/s rd, 216 MiB/s wr, 1.02k op/s 2024-09-19T07:25:06.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:05 smithi162 ceph-mon[35726]: pgmap v94: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 244 MiB/s rd, 275 MiB/s wr, 1.16k op/s 2024-09-19T07:25:06.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:05 smithi098 ceph-mon[30950]: pgmap v94: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 244 MiB/s rd, 275 MiB/s wr, 1.16k op/s 2024-09-19T07:25:06.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:05 smithi139 ceph-mon[35039]: pgmap v94: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 244 MiB/s rd, 275 MiB/s wr, 1.16k op/s 2024-09-19T07:25:08.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:07 smithi162 ceph-mon[35726]: pgmap v95: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 149 MiB/s rd, 167 MiB/s wr, 987 op/s 2024-09-19T07:25:08.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:07 smithi098 ceph-mon[30950]: pgmap v95: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 149 MiB/s rd, 167 MiB/s wr, 987 op/s 2024-09-19T07:25:08.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:07 smithi139 ceph-mon[35039]: pgmap v95: 97 pgs: 97 active+clean; 2.0 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 149 MiB/s rd, 167 MiB/s wr, 987 op/s 2024-09-19T07:25:09.082 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.079+0000 7fafbc47b640 1 -- 172.21.15.98:0/2303411749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb41069e0 msgr2=0x7fafb4106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.079+0000 7fafbc47b640 1 --2- 172.21.15.98:0/2303411749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb41069e0 0x7fafb4106dc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009930 tx=0x7fafb002a420 comp rx=0 tx=0).stop 2024-09-19T07:25:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.080+0000 7fafbc47b640 1 -- 172.21.15.98:0/2303411749 shutdown_connections 2024-09-19T07:25:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.080+0000 7fafbc47b640 1 --2- 172.21.15.98:0/2303411749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4101370 0x7fafb410d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.080+0000 7fafbc47b640 1 --2- 172.21.15.98:0/2303411749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb41009d0 0x7fafb4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.080+0000 7fafbc47b640 1 --2- 172.21.15.98:0/2303411749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb41069e0 0x7fafb4106dc0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.080+0000 7fafbc47b640 1 -- 172.21.15.98:0/2303411749 >> 172.21.15.98:0/2303411749 conn(0x7fafb40fc6b0 msgr2=0x7fafb40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.080+0000 7fafbc47b640 1 -- 172.21.15.98:0/2303411749 shutdown_connections 2024-09-19T07:25:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.080+0000 7fafbc47b640 1 -- 172.21.15.98:0/2303411749 wait complete. 2024-09-19T07:25:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.080+0000 7fafbc47b640 1 Processor -- start 2024-09-19T07:25:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.080+0000 7fafbc47b640 1 -- start start 2024-09-19T07:25:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.080+0000 7fafbc47b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb41009d0 0x7fafb41972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.083 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbc47b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4101370 0x7fafb4197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbc47b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb41069e0 0x7fafb419bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbc47b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4110de0 con 0x7fafb41069e0 2024-09-19T07:25:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbc47b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4110c60 con 0x7fafb4101370 2024-09-19T07:25:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbc47b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4110f60 con 0x7fafb41009d0 2024-09-19T07:25:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbaa18640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb41069e0 0x7fafb419bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbaa18640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb41069e0 0x7fafb419bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51524/0 (socket says 172.21.15.98:51524) 2024-09-19T07:25:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbaa18640 1 -- 172.21.15.98:0/991563535 learned_addr learned my addr 172.21.15.98:0/991563535 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafb9a16640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4101370 0x7fafb4197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafba217640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb41009d0 0x7fafb41972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbaa18640 1 -- 172.21.15.98:0/991563535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb41009d0 msgr2=0x7fafb41972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbaa18640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb41009d0 0x7fafb41972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.084 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbaa18640 1 -- 172.21.15.98:0/991563535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4101370 msgr2=0x7fafb4197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:09.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbaa18640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4101370 0x7fafb4197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbaa18640 1 -- 172.21.15.98:0/991563535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb419c2c0 con 0x7fafb41069e0 2024-09-19T07:25:09.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafba217640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb41009d0 0x7fafb41972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:09.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbaa18640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb41069e0 0x7fafb419bb90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fafac00cad0 tx=0x7fafac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:09.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafab7fe640 1 -- 172.21.15.98:0/991563535 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac00ae20 con 0x7fafb41069e0 2024-09-19T07:25:09.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafab7fe640 1 -- 172.21.15.98:0/991563535 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafac005020 con 0x7fafb41069e0 2024-09-19T07:25:09.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbc47b640 1 -- 172.21.15.98:0/991563535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb419c5b0 con 0x7fafb41069e0 2024-09-19T07:25:09.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafab7fe640 1 -- 172.21.15.98:0/991563535 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac00f6f0 con 0x7fafb41069e0 2024-09-19T07:25:09.085 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.081+0000 7fafbc47b640 1 -- 172.21.15.98:0/991563535 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb41a3e40 con 0x7fafb41069e0 2024-09-19T07:25:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.084+0000 7fafab7fe640 1 -- 172.21.15.98:0/991563535 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fafac0051d0 con 0x7fafb41069e0 2024-09-19T07:25:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.084+0000 7fafbf21c740 1 Processor -- start 2024-09-19T07:25:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafbf21c740 1 -- start start 2024-09-19T07:25:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafab7fe640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fafa00a3460 0x7fafa00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafbf21c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4056d970 0x55ee4056dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.091 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafbf21c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee4057a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.092 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafbf21c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4057aec0 0x55ee4057d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.092 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafbf21c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ee404d22f0 con 0x55ee4056e290 2024-09-19T07:25:09.092 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafbf21c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee4047a270 con 0x55ee4057aec0 2024-09-19T07:25:09.092 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafbf21c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ee404ce2b0 con 0x55ee4056d970 2024-09-19T07:25:09.092 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafb9a16640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fafa00a3460 0x7fafa00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.092 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafab7fe640 1 -- 172.21.15.98:0/991563535 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fafac0cfda0 con 0x7fafb41069e0 2024-09-19T07:25:09.092 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafb9a16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee4057a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.092 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafba217640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4056d970 0x55ee4056dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.092 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafb9a16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee4057a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51534/0 (socket says 172.21.15.98:51534) 2024-09-19T07:25:09.092 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafb9a16640 1 -- 172.21.15.98:0/3998036366 learned_addr learned my addr 172.21.15.98:0/3998036366 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:09.092 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafbaa18640 1 --2- 172.21.15.98:0/3998036366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4057aec0 0x55ee4057d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.092 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafb9a16640 1 -- 172.21.15.98:0/3998036366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4056d970 msgr2=0x55ee4056dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafb9a16640 1 --2- 172.21.15.98:0/3998036366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4056d970 0x55ee4056dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafb9a16640 1 -- 172.21.15.98:0/3998036366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4057aec0 msgr2=0x55ee4057d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafb9a16640 1 --2- 172.21.15.98:0/3998036366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4057aec0 0x55ee4057d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafb9a16640 1 -- 172.21.15.98:0/3998036366 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee40479340 con 0x55ee4056e290 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.085+0000 7fafbaa18640 1 --2- 172.21.15.98:0/3998036366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4057aec0 0x55ee4057d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.086+0000 7fafb9a16640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fafa00a3460 0x7fafa00a5920 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fafa4012980 tx=0x7fafa400bb80 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.086+0000 7fafb9a16640 1 --2- 172.21.15.98:0/3998036366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee4057a980 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fafa4010740 tx=0x7fafa401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a65656a844ed1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.086+0000 7fafa8bfe640 1 -- 172.21.15.98:0/3998036366 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa400b710 con 0x55ee4056e290 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.086+0000 7fafa8bfe640 1 -- 172.21.15.98:0/3998036366 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafa4025070 con 0x55ee4056e290 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.086+0000 7fafa8bfe640 1 -- 172.21.15.98:0/3998036366 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4020690 con 0x55ee4056e290 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 -- 172.21.15.98:0/3998036366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 msgr2=0x55ee4057a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 --2- 172.21.15.98:0/3998036366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee4057a980 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fafa4010740 tx=0x7fafa401c000 comp rx=0 tx=0).stop 2024-09-19T07:25:09.093 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 -- 172.21.15.98:0/3998036366 shutdown_connections 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 --2- 172.21.15.98:0/3998036366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4057aec0 0x55ee4057d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 --2- 172.21.15.98:0/3998036366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee4057a980 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 --2- 172.21.15.98:0/3998036366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4056d970 0x55ee4056dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 -- 172.21.15.98:0/3998036366 >> 172.21.15.98:0/3998036366 conn(0x55ee4056a060 msgr2=0x55ee4056a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 -- 172.21.15.98:0/3998036366 shutdown_connections 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 -- 172.21.15.98:0/3998036366 wait complete. 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 -- start start 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 Processor -- start 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4056d970 0x55ee40577e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee405783a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4057aec0 0x55ee405788e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ee4057da90 con 0x55ee4056e290 2024-09-19T07:25:09.094 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee4045b290 con 0x55ee4056d970 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.087+0000 7fafbf21c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ee4057dc10 con 0x55ee4057aec0 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafbf21c740 10 client.0 _ll_register_callbacks cb 0x55ee4048c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafb9a16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee405783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafb9a16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee405783a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51546/0 (socket says 172.21.15.98:51546) 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafb9a16640 1 -- 172.21.15.98:0/2305692769 learned_addr learned my addr 172.21.15.98:0/2305692769 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafba217640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4056d970 0x55ee40577e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafbaa18640 1 --2- 172.21.15.98:0/2305692769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4057aec0 0x55ee405788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafb9a16640 1 -- 172.21.15.98:0/2305692769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4057aec0 msgr2=0x55ee405788e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafb9a16640 1 --2- 172.21.15.98:0/2305692769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4057aec0 0x55ee405788e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafb9a16640 1 -- 172.21.15.98:0/2305692769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4056d970 msgr2=0x55ee40577e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafb9a16640 1 --2- 172.21.15.98:0/2305692769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4056d970 0x55ee40577e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafb9a16640 1 -- 172.21.15.98:0/2305692769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee401e5210 con 0x55ee4056e290 2024-09-19T07:25:09.095 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafb9a16640 1 --2- 172.21.15.98:0/2305692769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee405783a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fafa400b470 tx=0x7fafa4010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b34ac5c31a0bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7faf9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7faf9dffb640 1 -- 172.21.15.98:0/2305692769 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa402f020 con 0x55ee4056e290 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7faf9dffb640 1 -- 172.21.15.98:0/2305692769 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fafa4005040 con 0x55ee4056e290 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafbf21c740 1 -- 172.21.15.98:0/2305692769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafa4025070 con 0x55ee4056e290 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7faf9dffb640 1 -- 172.21.15.98:0/2305692769 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fafa403a050 con 0x55ee4056e290 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafbf21c740 10 client.16233 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.088+0000 7fafbf21c740 1 -- 172.21.15.98:0/2305692769 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ee402b1620 con 0x55ee4056e290 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.089+0000 7faf9dffb640 1 -- 172.21.15.98:0/2305692769 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafa4025070 con 0x55ee4056e290 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.089+0000 7faf9dffb640 1 -- 172.21.15.98:0/2305692769 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fafa401f070 con 0x55ee4056e290 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.089+0000 7fafbf21c740 10 client.16233 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.089+0000 7fafbf21c740 10 client.16233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.089+0000 7fafbf21c740 20 client.16233 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:09.096 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.089+0000 7fafbf21c740 1 --2- 172.21.15.98:0/2305692769 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ee4058ae20 0x55ee4058d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.089+0000 7fafbf21c740 4 client.16233 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.089+0000 7fafbf21c740 1 -- 172.21.15.98:0/2305692769 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee404dfa20 con 0x55ee4058ae20 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.089+0000 7fafba217640 1 --2- 172.21.15.98:0/2305692769 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ee4058ae20 0x55ee4058d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.089+0000 7faf9dffb640 10 client.16233 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.089+0000 7fafba217640 1 --2- 172.21.15.98:0/2305692769 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ee4058ae20 0x55ee4058d210 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc74539f4090dbd server_cookie=9a119f1a8d84f6bd in_seq=0 out_seq=0 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7faf9dffb640 1 -- 172.21.15.98:0/2305692769 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee404dfa20 con 0x55ee4058ae20 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7faf9dffb640 10 client.16233 handle_command_reply: tid=0 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7fafbf21c740 1 client.16233 shutdown 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7fafbf21c740 1 -- 172.21.15.98:0/2305692769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 msgr2=0x55ee405783a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7fafbf21c740 1 --2- 172.21.15.98:0/2305692769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee405783a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fafa400b470 tx=0x7fafa4010e80 comp rx=0 tx=0).stop 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7fafbf21c740 1 -- 172.21.15.98:0/2305692769 shutdown_connections 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7fafbf21c740 1 --2- 172.21.15.98:0/2305692769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4057aec0 0x55ee405788e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.097 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7fafbf21c740 1 --2- 172.21.15.98:0/2305692769 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ee4058ae20 0x55ee4058d210 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.098 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7fafbf21c740 1 --2- 172.21.15.98:0/2305692769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee405783a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.098 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7fafbf21c740 1 --2- 172.21.15.98:0/2305692769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4056d970 0x55ee40577e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.098 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7fafbf21c740 1 -- 172.21.15.98:0/2305692769 >> 172.21.15.98:0/2305692769 conn(0x55ee4056a060 msgr2=0x55ee4056fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:09.098 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7faf9dffb640 0 client.16233 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:09.098 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7fafbf21c740 1 -- 172.21.15.98:0/2305692769 shutdown_connections 2024-09-19T07:25:09.098 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.090+0000 7fafbf21c740 1 -- 172.21.15.98:0/2305692769 wait complete. 2024-09-19T07:25:09.098 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.091+0000 7fafbf21c740 20 client.16233 trim_cache size 0 max 16384 2024-09-19T07:25:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafbf21c740 1 Processor -- start 2024-09-19T07:25:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafbf21c740 1 -- start start 2024-09-19T07:25:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafbf21c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4056d970 0x55ee40579dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafbf21c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee40592a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafbf21c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4057aec0 0x55ee40592f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafbf21c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fafb41ae070 con 0x55ee4056e290 2024-09-19T07:25:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafbf21c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fafb41ab880 con 0x55ee4057aec0 2024-09-19T07:25:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafbf21c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fafb41a96d0 con 0x55ee4056d970 2024-09-19T07:25:09.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafb9a16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee40592a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafb9a16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee40592a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51562/0 (socket says 172.21.15.98:51562) 2024-09-19T07:25:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafb9a16640 1 -- 172.21.15.98:0/1150491720 learned_addr learned my addr 172.21.15.98:0/1150491720 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafbaa18640 1 --2- 172.21.15.98:0/1150491720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4057aec0 0x55ee40592f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafb9a16640 1 -- 172.21.15.98:0/1150491720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4056d970 msgr2=0x55ee40579dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:09.108 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafba217640 1 --2- 172.21.15.98:0/1150491720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4056d970 0x55ee40579dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafb9a16640 1 --2- 172.21.15.98:0/1150491720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4056d970 0x55ee40579dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafb9a16640 1 -- 172.21.15.98:0/1150491720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4057aec0 msgr2=0x55ee40592f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafb9a16640 1 --2- 172.21.15.98:0/1150491720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4057aec0 0x55ee40592f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafb9a16640 1 -- 172.21.15.98:0/1150491720 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee40576390 con 0x55ee4056e290 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.105+0000 7fafbaa18640 1 --2- 172.21.15.98:0/1150491720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4057aec0 0x55ee40592f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7fafb9a16640 1 --2- 172.21.15.98:0/1150491720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee40592a20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fafa4005d00 tx=0x7fafa4005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c73d6fe6082bcae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7faf9ffff640 1 -- 172.21.15.98:0/1150491720 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa402f070 con 0x55ee4056e290 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7faf9ffff640 1 -- 172.21.15.98:0/1150491720 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafa4025040 con 0x55ee4056e290 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7faf9ffff640 1 -- 172.21.15.98:0/1150491720 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4005000 con 0x55ee4056e290 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7fafbf21c740 1 -- 172.21.15.98:0/1150491720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 msgr2=0x55ee40592a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7fafbf21c740 1 --2- 172.21.15.98:0/1150491720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee40592a20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fafa4005d00 tx=0x7fafa4005ed0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7fafbf21c740 1 -- 172.21.15.98:0/1150491720 shutdown_connections 2024-09-19T07:25:09.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7fafbf21c740 1 --2- 172.21.15.98:0/1150491720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4057aec0 0x55ee40592f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7fafbf21c740 1 --2- 172.21.15.98:0/1150491720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056e290 0x55ee40592a20 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7fafbf21c740 1 --2- 172.21.15.98:0/1150491720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4056d970 0x55ee40579dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7fafbf21c740 1 -- 172.21.15.98:0/1150491720 >> 172.21.15.98:0/1150491720 conn(0x55ee4056a060 msgr2=0x55ee405796c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7fafbf21c740 1 -- 172.21.15.98:0/1150491720 shutdown_connections 2024-09-19T07:25:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.106+0000 7fafbf21c740 1 -- 172.21.15.98:0/1150491720 wait complete. 2024-09-19T07:25:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafbf21c740 1 -- start start 2024-09-19T07:25:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafbf21c740 1 Processor -- start 2024-09-19T07:25:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafbf21c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056d970 0x55ee4057eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafbf21c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4056e290 0x55ee4057f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafbf21c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4057aec0 0x55ee4057f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafbf21c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fafb41a9d40 con 0x55ee4056d970 2024-09-19T07:25:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafbf21c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fafb41ab1b0 con 0x55ee4056e290 2024-09-19T07:25:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafbf21c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fafb41aa410 con 0x55ee4057aec0 2024-09-19T07:25:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafbf21c740 10 client.0 _ll_register_callbacks cb 0x7fafb0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafba217640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056d970 0x55ee4057eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafba217640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056d970 0x55ee4057eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51570/0 (socket says 172.21.15.98:51570) 2024-09-19T07:25:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafba217640 1 -- 172.21.15.98:0/4284855539 learned_addr learned my addr 172.21.15.98:0/4284855539 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafb9a16640 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4056e290 0x55ee4057f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafbaa18640 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4057aec0 0x55ee4057f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafba217640 1 -- 172.21.15.98:0/4284855539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4057aec0 msgr2=0x55ee4057f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafba217640 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4057aec0 0x55ee4057f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafba217640 1 -- 172.21.15.98:0/4284855539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4056e290 msgr2=0x55ee4057f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafba217640 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4056e290 0x55ee4057f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.107+0000 7fafba217640 1 -- 172.21.15.98:0/4284855539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee405f4c90 con 0x55ee4056d970 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7fafba217640 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056d970 0x55ee4057eec0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fafb002a460 tx=0x7fafb00092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d20a5dac05078d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7faf9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7faf9dffb640 1 -- 172.21.15.98:0/4284855539 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0035040 con 0x55ee4056d970 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7faf9dffb640 1 -- 172.21.15.98:0/4284855539 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fafb0005040 con 0x55ee4056d970 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7fafbf21c740 1 -- 172.21.15.98:0/4284855539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafa4025040 con 0x55ee4056d970 2024-09-19T07:25:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7faf9dffb640 1 -- 172.21.15.98:0/4284855539 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fafb0052050 con 0x55ee4056d970 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7fafbf21c740 10 client.16239 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7fafbf21c740 1 -- 172.21.15.98:0/4284855539 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ee405f5fa0 con 0x55ee4056d970 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7faf9dffb640 1 -- 172.21.15.98:0/4284855539 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafa4025040 con 0x55ee4056d970 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7faf9dffb640 1 -- 172.21.15.98:0/4284855539 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fafb004d030 con 0x55ee4056d970 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7fafbf21c740 10 client.16239 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7fafbf21c740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7fafbf21c740 20 client.16239 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7fafbf21c740 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ee405f6770 0x55ee405f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7fafbf21c740 4 client.16239 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.108+0000 7fafbf21c740 1 -- 172.21.15.98:0/4284855539 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee404d9d70 con 0x55ee405f6770 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.109+0000 7fafb9a16640 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ee405f6770 0x55ee405f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.109+0000 7faf9dffb640 10 client.16239 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:09.109+0000 7fafb9a16640 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ee405f6770 0x55ee405f8b90 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80648a130fb9f1bc server_cookie=d484735e35561f4c in_seq=0 out_seq=0 2024-09-19T07:25:10.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:09 smithi162 ceph-mon[35726]: pgmap v96: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 149 MiB/s rd, 167 MiB/s wr, 1.26k op/s 2024-09-19T07:25:10.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:09 smithi098 ceph-mon[30950]: pgmap v96: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 149 MiB/s rd, 167 MiB/s wr, 1.26k op/s 2024-09-19T07:25:10.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:09 smithi139 ceph-mon[35039]: pgmap v96: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 149 MiB/s rd, 167 MiB/s wr, 1.26k op/s 2024-09-19T07:25:12.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:11 smithi162 ceph-mon[35726]: pgmap v97: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 410 op/s 2024-09-19T07:25:12.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:11 smithi098 ceph-mon[30950]: pgmap v97: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 410 op/s 2024-09-19T07:25:12.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:11 smithi139 ceph-mon[35039]: pgmap v97: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 410 op/s 2024-09-19T07:25:14.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:13 smithi162 ceph-mon[35726]: pgmap v98: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 410 op/s 2024-09-19T07:25:14.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:13 smithi098 ceph-mon[30950]: pgmap v98: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 410 op/s 2024-09-19T07:25:14.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:13 smithi139 ceph-mon[35039]: pgmap v98: 97 pgs: 97 active+clean; 2.0 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 MiB/s rd, 60 MiB/s wr, 410 op/s 2024-09-19T07:25:14.531 INFO:tasks.workunit.client.0.smithi098.stdout:1/983: truncate dc/de/d22/d31/d5d/d6a/d6f/d4d/d53/de1/db1/fc1 1039458 0 2024-09-19T07:25:14.555 INFO:tasks.workunit.client.0.smithi098.stdout:1/984: dwrite dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/f4e [0,4194304] 0 2024-09-19T07:25:14.559 INFO:tasks.workunit.client.0.smithi098.stdout:8/910: sync 2024-09-19T07:25:14.559 INFO:tasks.workunit.client.0.smithi098.stdout:4/938: sync 2024-09-19T07:25:14.559 INFO:tasks.workunit.client.0.smithi098.stdout:6/886: sync 2024-09-19T07:25:14.560 INFO:tasks.workunit.client.0.smithi098.stdout:2/945: sync 2024-09-19T07:25:14.560 INFO:tasks.workunit.client.0.smithi098.stdout:2/946: stat d1/d5/d34/d76/l87 0 2024-09-19T07:25:14.560 INFO:tasks.workunit.client.0.smithi098.stdout:2/947: readlink d1/d9/dd7/l11f 0 2024-09-19T07:25:14.561 INFO:tasks.workunit.client.0.smithi098.stdout:2/948: creat d1/f145 x:0 0 0 2024-09-19T07:25:14.565 INFO:tasks.workunit.client.0.smithi098.stdout:0/923: mknod d5/d20/d14/d49/d62/da7/db7/c127 0 2024-09-19T07:25:14.565 INFO:tasks.workunit.client.0.smithi098.stdout:0/924: chown d5/f3d 455 1 2024-09-19T07:25:14.587 INFO:tasks.workunit.client.0.smithi098.stdout:1/985: creat dc/de/d22/d31/d35/d4f/f156 x:0 0 0 2024-09-19T07:25:14.589 INFO:tasks.workunit.client.0.smithi098.stdout:6/887: creat d2/db0/d8d/f13a x:0 0 0 2024-09-19T07:25:14.589 INFO:tasks.workunit.client.0.smithi098.stdout:4/939: symlink da/d31/d46/d5f/d118/l137 0 2024-09-19T07:25:14.590 INFO:tasks.workunit.client.0.smithi098.stdout:4/940: chown da/d31/d46/d56/d5b/db9/df0/d126 24389 1 2024-09-19T07:25:14.591 INFO:tasks.workunit.client.0.smithi098.stdout:1/986: write dc/de/d22/d31/f11d [891739,14870] 0 2024-09-19T07:25:14.592 INFO:tasks.workunit.client.0.smithi098.stdout:6/888: link d2/d5/d1f/d26/d7b/fd5 d2/db0/f13b 0 2024-09-19T07:25:14.592 INFO:tasks.workunit.client.0.smithi098.stdout:5/706: dwrite dc/de/d13/d46/d2e/d37/d81/f45 [0,4194304] 0 2024-09-19T07:25:14.594 INFO:tasks.workunit.client.0.smithi098.stdout:4/941: getdents da/d31/d46/d5f/d8a/db6/dc9 0 2024-09-19T07:25:14.595 INFO:tasks.workunit.client.0.smithi098.stdout:2/949: dwrite d1/d5/f54 [0,4194304] 0 2024-09-19T07:25:14.595 INFO:tasks.workunit.client.0.smithi098.stdout:8/911: dwrite d0/d16/d65/d9a/fcb [0,4194304] 0 2024-09-19T07:25:14.595 INFO:tasks.workunit.client.0.smithi098.stdout:3/799: dwrite de/df/d31/d61/d79/f91 [0,4194304] 0 2024-09-19T07:25:14.595 INFO:tasks.workunit.client.0.smithi098.stdout:3/800: truncate de/df/d31/fb0 878187 0 2024-09-19T07:25:14.595 INFO:tasks.workunit.client.0.smithi098.stdout:3/801: truncate de/df/f22 1229100 0 2024-09-19T07:25:14.596 INFO:tasks.workunit.client.0.smithi098.stdout:5/707: mkdir dc/de/d13/d46/df6 0 2024-09-19T07:25:14.599 INFO:tasks.workunit.client.0.smithi098.stdout:2/950: creat d1/dcb/dfd/f146 x:0 0 0 2024-09-19T07:25:14.599 INFO:tasks.workunit.client.0.smithi098.stdout:6/889: mkdir d2/d11/d13c 0 2024-09-19T07:25:14.600 INFO:tasks.workunit.client.0.smithi098.stdout:4/942: read da/d31/f57 [905620,34528] 0 2024-09-19T07:25:14.602 INFO:tasks.workunit.client.0.smithi098.stdout:6/890: dread d2/d5/d1f/d26/d42/d48/d53/d64/d6d/ffd [0,4194304] 0 2024-09-19T07:25:14.605 INFO:tasks.workunit.client.0.smithi098.stdout:3/802: mknod de/df/d31/d61/d69/dcd/cf0 0 2024-09-19T07:25:14.605 INFO:tasks.workunit.client.0.smithi098.stdout:3/803: fdatasync de/d4e/d6d/d8c/dab/fe9 0 2024-09-19T07:25:14.605 INFO:tasks.workunit.client.0.smithi098.stdout:8/912: write d0/d16/fcd [1745247,89440] 0 2024-09-19T07:25:14.605 INFO:tasks.workunit.client.0.smithi098.stdout:6/891: getdents d2/d5/d1f/d26/d42/d48 0 2024-09-19T07:25:14.606 INFO:tasks.workunit.client.0.smithi098.stdout:6/892: creat d2/db0/f13d x:0 0 0 2024-09-19T07:25:14.607 INFO:tasks.workunit.client.0.smithi098.stdout:2/951: mkdir d1/d5/d147 0 2024-09-19T07:25:14.609 INFO:tasks.workunit.client.0.smithi098.stdout:3/804: creat de/d4e/d6d/ff1 x:0 0 0 2024-09-19T07:25:14.613 INFO:tasks.workunit.client.0.smithi098.stdout:1/987: rmdir dc/de/d50 39 2024-09-19T07:25:14.613 INFO:tasks.workunit.client.0.smithi098.stdout:1/988: write dc/de/d22/d128/f100 [732071,6080] 0 2024-09-19T07:25:14.625 INFO:tasks.workunit.client.0.smithi098.stdout:2/952: dwrite d1/d9/d26/d35/f137 [0,4194304] 0 2024-09-19T07:25:14.630 INFO:tasks.workunit.client.0.smithi098.stdout:2/953: symlink d1/d5/d72/l148 0 2024-09-19T07:25:14.631 INFO:tasks.workunit.client.0.smithi098.stdout:8/913: link d0/d33/d44/fb1 d0/d2c/dfb/f130 0 2024-09-19T07:25:14.631 INFO:tasks.workunit.client.0.smithi098.stdout:2/954: mknod d1/d9/c149 0 2024-09-19T07:25:14.634 INFO:tasks.workunit.client.0.smithi098.stdout:1/989: write dc/de/d22/d31/d35/ff4 [280266,31499] 0 2024-09-19T07:25:14.635 INFO:tasks.workunit.client.0.smithi098.stdout:1/990: symlink dc/de/d50/d11b/l157 0 2024-09-19T07:25:14.638 INFO:tasks.workunit.client.0.smithi098.stdout:2/955: dread d1/d9/d26/d35/d91/fb0 [0,4194304] 0 2024-09-19T07:25:14.638 INFO:tasks.workunit.client.0.smithi098.stdout:2/956: fsync d1/d9/d26/d35/d48/d7f/fc6 0 2024-09-19T07:25:14.638 INFO:tasks.workunit.client.0.smithi098.stdout:2/957: write d1/d9/d26/d35/d88/dc2/f100 [259681,35381] 0 2024-09-19T07:25:14.639 INFO:tasks.workunit.client.0.smithi098.stdout:2/958: fdatasync d1/d9/d26/d35/d88/deb/ff0 0 2024-09-19T07:25:14.639 INFO:tasks.workunit.client.0.smithi098.stdout:2/959: chown d1/dcb/dfd/f11e 12375 1 2024-09-19T07:25:14.639 INFO:tasks.workunit.client.0.smithi098.stdout:2/960: chown d1/dcb/lf6 2893025 1 2024-09-19T07:25:14.639 INFO:tasks.workunit.client.0.smithi098.stdout:3/805: dwrite de/df/d1f/d2b/fd4 [0,4194304] 0 2024-09-19T07:25:14.640 INFO:tasks.workunit.client.0.smithi098.stdout:3/806: unlink de/d4e/d6d/dad/lb8 0 2024-09-19T07:25:14.640 INFO:tasks.workunit.client.0.smithi098.stdout:5/708: dwrite dc/de/d13/d46/d2e/d37/d81/db8/fe4 [0,4194304] 0 2024-09-19T07:25:14.640 INFO:tasks.workunit.client.0.smithi098.stdout:4/943: dwrite da/d31/d46/d5f/d8a/fa5 [4194304,4194304] 0 2024-09-19T07:25:14.641 INFO:tasks.workunit.client.0.smithi098.stdout:2/961: creat d1/d5/d72/db5/dad/d12f/f14a x:0 0 0 2024-09-19T07:25:14.642 INFO:tasks.workunit.client.0.smithi098.stdout:0/925: rename d5/d20/d1f/d47/lfe to d5/d20/d1f/d47/db2/dd3/l128 0 2024-09-19T07:25:14.642 INFO:tasks.workunit.client.0.smithi098.stdout:0/926: write d5/d20/d1f/d47/dae/dca/fcd [708764,106883] 0 2024-09-19T07:25:14.642 INFO:tasks.workunit.client.0.smithi098.stdout:3/807: creat de/df/d31/d61/d69/ff2 x:0 0 0 2024-09-19T07:25:14.649 INFO:tasks.workunit.client.0.smithi098.stdout:0/927: unlink d5/d20/d1f/d52/d64/d77/cd4 0 2024-09-19T07:25:14.649 INFO:tasks.workunit.client.0.smithi098.stdout:0/928: fdatasync d5/d20/d1f/d47/db2/dbf/d6d/f6f 0 2024-09-19T07:25:14.650 INFO:tasks.workunit.client.0.smithi098.stdout:3/808: mkdir de/d4e/d6d/d71/df3 0 2024-09-19T07:25:14.651 INFO:tasks.workunit.client.0.smithi098.stdout:0/929: creat d5/d20/d1f/d47/db2/dd3/d106/d94/d121/f129 x:0 0 0 2024-09-19T07:25:14.653 INFO:tasks.workunit.client.0.smithi098.stdout:0/930: creat d5/d20/d1f/d52/d101/d111/f12a x:0 0 0 2024-09-19T07:25:14.671 INFO:tasks.workunit.client.0.smithi098.stdout:3/809: dread de/df/d31/d61/d79/fb5 [0,4194304] 0 2024-09-19T07:25:14.671 INFO:tasks.workunit.client.0.smithi098.stdout:3/810: write de/df/d1f/d72/f8a [1134856,106074] 0 2024-09-19T07:25:14.672 INFO:tasks.workunit.client.0.smithi098.stdout:2/962: dwrite d1/d9/d26/d35/f137 [0,4194304] 0 2024-09-19T07:25:14.672 INFO:tasks.workunit.client.0.smithi098.stdout:5/709: dwrite dc/de/d13/d46/d2e/d62/f85 [0,4194304] 0 2024-09-19T07:25:14.672 INFO:tasks.workunit.client.0.smithi098.stdout:3/811: mkdir de/d4e/d6d/d8c/dab/de6/df4 0 2024-09-19T07:25:14.673 INFO:tasks.workunit.client.0.smithi098.stdout:4/944: write da/d31/d46/d5f/d8a/fa5 [5387293,12314] 0 2024-09-19T07:25:14.673 INFO:tasks.workunit.client.0.smithi098.stdout:4/945: fdatasync da/d31/d46/d56/d5b/d66/fca 0 2024-09-19T07:25:14.674 INFO:tasks.workunit.client.0.smithi098.stdout:6/893: dwrite d2/d5/d1f/d26/d7b/ff8 [0,4194304] 0 2024-09-19T07:25:14.674 INFO:tasks.workunit.client.0.smithi098.stdout:2/963: truncate d1/d9/d26/d35/d91/f94 1356928 0 2024-09-19T07:25:14.674 INFO:tasks.workunit.client.0.smithi098.stdout:2/964: truncate d1/d9/d26/d35/d88/dc2/dfb/d60/da5/dd9/fe9 4255666 0 2024-09-19T07:25:14.674 INFO:tasks.workunit.client.0.smithi098.stdout:1/991: dwrite dc/de/d22/d31/d5d/d6a/d6f/d5f/db0/ff9 [0,4194304] 0 2024-09-19T07:25:14.674 INFO:tasks.workunit.client.0.smithi098.stdout:0/931: dwrite d5/d20/d1f/f109 [0,4194304] 0 2024-09-19T07:25:14.676 INFO:tasks.workunit.client.0.smithi098.stdout:5/710: rename dc/de/d13/d46/d2e/f77 to dc/de/d36/d71/d84/ff7 0 2024-09-19T07:25:14.676 INFO:tasks.workunit.client.0.smithi098.stdout:1/992: dread dc/de/d50/f61 [0,4194304] 0 2024-09-19T07:25:14.676 INFO:tasks.workunit.client.0.smithi098.stdout:1/993: chown dc/d2a/l92 6 1 2024-09-19T07:25:14.677 INFO:tasks.workunit.client.0.smithi098.stdout:0/932: mkdir d5/d20/d1f/d52/d12b 0 2024-09-19T07:25:14.677 INFO:tasks.workunit.client.0.smithi098.stdout:0/933: fdatasync d5/d20/d1f/d47/dae/ffc 0 2024-09-19T07:25:14.677 INFO:tasks.workunit.client.0.smithi098.stdout:0/934: readlink d5/d20/d14/d49/d62/l97 0 2024-09-19T07:25:14.678 INFO:tasks.workunit.client.0.smithi098.stdout:0/935: mkdir d5/d20/d1f/d11b/d12c 0 2024-09-19T07:25:14.684 INFO:tasks.workunit.client.0.smithi098.stdout:6/894: write d2/d5/d1f/d26/d42/d48/d53/da2/f115 [3991183,52019] 0 2024-09-19T07:25:14.685 INFO:tasks.workunit.client.0.smithi098.stdout:6/895: mknod d2/d5/d1f/d105/d10b/c13e 0 2024-09-19T07:25:14.686 INFO:tasks.workunit.client.0.smithi098.stdout:2/965: write d1/d5/d72/db5/d4e/fde [3050173,46379] 0 2024-09-19T07:25:14.686 INFO:tasks.workunit.client.0.smithi098.stdout:2/966: read d1/d9/d3e/fd [2389011,55508] 0 2024-09-19T07:25:14.693 INFO:tasks.workunit.client.0.smithi098.stdout:2/967: unlink d1/d5/c6f 0 2024-09-19T07:25:14.693 INFO:tasks.workunit.client.0.smithi098.stdout:2/968: dread - d1/d9/d26/d35/f114 zero size 2024-09-19T07:25:14.694 INFO:tasks.workunit.client.0.smithi098.stdout:0/936: write d5/f4f [2938166,98297] 0 2024-09-19T07:25:14.694 INFO:tasks.workunit.client.0.smithi098.stdout:0/937: dread - d5/d20/d1f/d47/db2/dd3/d106/f126 zero size 2024-09-19T07:25:14.702 INFO:tasks.workunit.client.0.smithi098.stdout:1/994: rename dc/d2a/ccb to dc/de/d22/d31/d5d/d6a/d6f/d4d/c158 0 2024-09-19T07:25:14.704 INFO:tasks.workunit.client.0.smithi098.stdout:1/995: getdents dc/d17/d1b/d1d/d30 0 2024-09-19T07:25:14.704 INFO:tasks.workunit.client.0.smithi098.stdout:2/969: read d1/d5/d72/ff9 [3417152,27796] 0 2024-09-19T07:25:14.704 INFO:tasks.workunit.client.0.smithi098.stdout:2/970: chown d1/d9/d3e/f55 96799 1 2024-09-19T07:25:14.708 INFO:tasks.workunit.client.0.smithi098.stdout:1/996: rmdir dc/de/d22/d31/d5d/d6a/d6f/d4d/d53 39 2024-09-19T07:25:14.708 INFO:tasks.workunit.client.0.smithi098.stdout:1/997: write dc/de/d22/d31/d5d/d6a/d6f/d5f/dbc/fde [2633072,68425] 0 2024-09-19T07:25:14.708 INFO:tasks.workunit.client.0.smithi098.stdout:5/711: dwrite dc/de/d13/d46/d2e/d37/d81/db8/fc6 [0,4194304] 0 2024-09-19T07:25:14.709 INFO:tasks.workunit.client.0.smithi098.stdout:2/971: dread d1/dcb/dfd/d93/d61/d62/fc3 [0,4194304] 0 2024-09-19T07:25:14.709 INFO:tasks.workunit.client.0.smithi098.stdout:2/972: stat d1/d5/c84 0 2024-09-19T07:25:14.709 INFO:tasks.workunit.client.0.smithi098.stdout:1/998: creat dc/de/d22/d31/d5d/d6a/d6f/d5f/db0/f159 x:0 0 0 2024-09-19T07:25:14.710 INFO:tasks.workunit.client.0.smithi098.stdout:1/999: write dc/de/d22/d31/d5d/d6a/d6f/ffe [698867,28247] 0 2024-09-19T07:25:14.712 INFO:tasks.workunit.client.0.smithi098.stdout:2/973: symlink d1/d9/d26/d35/d88/dc2/dfb/l14b 0 2024-09-19T07:25:14.713 INFO:tasks.workunit.client.0.smithi098.stdout:5/712: mkdir dc/de/d13/d7d/df8 0 2024-09-19T07:25:14.714 INFO:tasks.workunit.client.0.smithi098.stdout:5/713: getdents dc/de/d13/d46/d2e/d37/d6d 0 2024-09-19T07:25:14.714 INFO:tasks.workunit.client.0.smithi098.stdout:2/974: mkdir d1/d9/d26/d35/d88/dc2/dfb/d60/d65/d14c 0 2024-09-19T07:25:14.715 INFO:tasks.workunit.client.0.smithi098.stdout:2/975: write d1/dcb/dfd/d93/d61/f119 [789894,89583] 0 2024-09-19T07:25:14.715 INFO:tasks.workunit.client.0.smithi098.stdout:2/976: truncate d1/dcb/dfd/d93/d61/d62/fa2 1353790 0 2024-09-19T07:25:14.715 INFO:tasks.workunit.client.0.smithi098.stdout:3/812: dwrite de/df/d31/d61/d79/f91 [0,4194304] 0 2024-09-19T07:25:14.715 INFO:tasks.workunit.client.0.smithi098.stdout:4/946: dwrite da/d31/d46/d5f/d8a/db6/dc2/de7/ff1 [0,4194304] 0 2024-09-19T07:25:14.716 INFO:tasks.workunit.client.0.smithi098.stdout:6/896: dwrite d2/d5/d1f/d26/d7b/fd5 [0,4194304] 0 2024-09-19T07:25:14.716 INFO:tasks.workunit.client.0.smithi098.stdout:6/897: truncate d2/d5/d1f/d26/d7b/de0/ffe 732732 0 2024-09-19T07:25:14.716 INFO:tasks.workunit.client.0.smithi098.stdout:6/898: stat d2/db0/d4e/d6e/l111 0 2024-09-19T07:25:14.716 INFO:tasks.workunit.client.0.smithi098.stdout:6/899: chown d2 7546047 1 2024-09-19T07:25:14.716 INFO:tasks.workunit.client.0.smithi098.stdout:2/977: truncate d1/d9/d26/d35/d91/fb0 1429055 0 2024-09-19T07:25:14.716 INFO:tasks.workunit.client.0.smithi098.stdout:2/978: write d1/f145 [18646,117098] 0 2024-09-19T07:25:14.716 INFO:tasks.workunit.client.0.smithi098.stdout:3/813: mknod de/df/d31/d61/d69/ddd/cf5 0 2024-09-19T07:25:14.718 INFO:tasks.workunit.client.0.smithi098.stdout:2/979: mknod d1/d9/d26/d35/d88/dc2/dfb/d60/da5/c14d 0 2024-09-19T07:25:14.719 INFO:tasks.workunit.client.0.smithi098.stdout:6/900: dread d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/d131/fca [0,4194304] 0 2024-09-19T07:25:14.721 INFO:tasks.workunit.client.0.smithi098.stdout:6/901: creat d2/d5/d128/f13f x:0 0 0 2024-09-19T07:25:14.722 INFO:tasks.workunit.client.0.smithi098.stdout:3/814: mknod de/df/d31/d61/cf6 0 2024-09-19T07:25:14.722 INFO:tasks.workunit.client.0.smithi098.stdout:3/815: dread - de/df/d1f/d72/f95 zero size 2024-09-19T07:25:14.723 INFO:tasks.workunit.client.0.smithi098.stdout:6/902: rename d2/d5/d1f/d26/d7b/da3/ce4 to d2/d5/d1f/d26/d7b/da3/c140 0 2024-09-19T07:25:14.724 INFO:tasks.workunit.client.0.smithi098.stdout:5/714: write dc/de/d13/d46/d2e/fc2 [254516,90218] 0 2024-09-19T07:25:14.724 INFO:tasks.workunit.client.0.smithi098.stdout:5/715: write dc/de/d13/d46/d2e/da5/ff2 [1046193,95976] 0 2024-09-19T07:25:14.725 INFO:tasks.workunit.client.0.smithi098.stdout:2/980: unlink d1/d5/d34/d5a/db2/ce1 0 2024-09-19T07:25:14.727 INFO:tasks.workunit.client.0.smithi098.stdout:5/716: truncate dc/de/d13/d46/d23/f5f 2551266 0 2024-09-19T07:25:14.728 INFO:tasks.workunit.client.0.smithi098.stdout:0/938: rename d5/d20/d14/d49/d62/da7/lbb to d5/d20/d1f/d52/d101/l12d 0 2024-09-19T07:25:14.731 INFO:tasks.workunit.client.0.smithi098.stdout:6/903: creat d2/f141 x:0 0 0 2024-09-19T07:25:14.732 INFO:tasks.workunit.client.0.smithi098.stdout:4/947: rmdir da/d31/d46/d56/d5b 39 2024-09-19T07:25:14.737 INFO:tasks.workunit.client.0.smithi098.stdout:6/904: mkdir d2/d5/d1f/d26/d42/d48/d53/da2/d139/d8f/d142 0 2024-09-19T07:25:14.737 INFO:tasks.workunit.client.0.smithi098.stdout:0/939: dread d5/d20/d1f/d52/d64/d77/fcb [0,4194304] 0 2024-09-19T07:25:14.737 INFO:tasks.workunit.client.0.smithi098.stdout:6/905: dread d2/d5/d1f/d26/d42/d48/fce [0,4194304] 0 2024-09-19T07:25:14.737 INFO:tasks.workunit.client.0.smithi098.stdout:6/906: stat d2/d5/d1f/d26/d42/d48/d53/da2/d139/f11e 0 2024-09-19T07:25:14.738 INFO:tasks.workunit.client.0.smithi098.stdout:3/816: read de/df/f63 [906780,71758] 0 2024-09-19T07:25:14.738 INFO:tasks.workunit.client.0.smithi098.stdout:4/948: mkdir da/d31/d46/d56/d5b/d138 0 2024-09-19T07:25:14.740 INFO:tasks.workunit.client.0.smithi098.stdout:4/949: symlink da/d31/d46/d5f/d118/l139 0 2024-09-19T07:25:14.740 INFO:tasks.workunit.client.0.smithi098.stdout:5/717: dread dc/de/d13/d5c/fea [0,4194304] 0 2024-09-19T07:25:14.740 INFO:tasks.workunit.client.0.smithi098.stdout:5/718: fdatasync dc/de/d13/fa1 0 2024-09-19T07:25:14.742 INFO:tasks.workunit.client.0.smithi098.stdout:3/817: dread de/d4e/fdf [0,4194304] 0 2024-09-19T07:25:14.742 INFO:tasks.workunit.client.0.smithi098.stdout:3/818: chown de/df/led 2049551 1 2024-09-19T07:25:14.742 INFO:tasks.workunit.client.0.smithi098.stdout:6/907: dread d2/db0/d8d/f12b [0,4194304] 0 2024-09-19T07:25:14.742 INFO:tasks.workunit.client.0.smithi098.stdout:5/719: creat dc/de/d36/dba/ff9 x:0 0 0 2024-09-19T07:25:14.745 INFO:tasks.workunit.client.0.smithi098.stdout:6/908: unlink d2/db0/d4e/f65 0 2024-09-19T07:25:14.745 INFO:tasks.workunit.client.0.smithi098.stdout:6/909: dread - d2/f141 zero size 2024-09-19T07:25:14.745 INFO:tasks.workunit.client.0.smithi098.stdout:3/819: truncate de/d4e/f50 1223122 0 2024-09-19T07:25:14.746 INFO:tasks.workunit.client.0.smithi098.stdout:3/820: fsync de/df/d1f/d2b/d93/fe1 0 2024-09-19T07:25:14.747 INFO:tasks.workunit.client.0.smithi098.stdout:5/720: symlink dc/de/d13/d46/d2e/da5/lfa 0 2024-09-19T07:25:14.747 INFO:tasks.workunit.client.0.smithi098.stdout:3/821: mkdir de/df/d1f/d2b/df7 0 2024-09-19T07:25:14.748 INFO:tasks.workunit.client.0.smithi098.stdout:6/910: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/f143 x:0 0 0 2024-09-19T07:25:14.749 INFO:tasks.workunit.client.0.smithi098.stdout:5/721: creat dc/de/d13/d7d/ffb x:0 0 0 2024-09-19T07:25:14.749 INFO:tasks.workunit.client.0.smithi098.stdout:2/981: dwrite d1/dcb/dfd/d93/d61/d62/fc3 [0,4194304] 0 2024-09-19T07:25:14.753 INFO:tasks.workunit.client.0.smithi098.stdout:5/722: rename dc/de/d13/f21 to dc/de/dc0/ffc 0 2024-09-19T07:25:14.760 INFO:tasks.workunit.client.0.smithi098.stdout:4/950: write da/d31/d46/d5f/d8a/db6/dc2/de7/d109/ff7 [3274919,19119] 0 2024-09-19T07:25:14.762 INFO:tasks.workunit.client.0.smithi098.stdout:4/951: creat da/d31/d46/d56/f13a x:0 0 0 2024-09-19T07:25:14.762 INFO:tasks.workunit.client.0.smithi098.stdout:4/952: readlink da/d31/d46/d56/d5b/db9/df0/d10a/d119/l134 0 2024-09-19T07:25:14.762 INFO:tasks.workunit.client.0.smithi098.stdout:4/953: fsync da/f1d 0 2024-09-19T07:25:14.772 INFO:tasks.workunit.client.0.smithi098.stdout:2/982: link d1/d9/d26/d35/d91/fb0 d1/d9/d26/d35/d48/d6e/d13b/f14e 0 2024-09-19T07:25:14.775 INFO:tasks.workunit.client.0.smithi098.stdout:2/983: rename d1/d5/c111 to d1/dcb/dfd/d93/c14f 0 2024-09-19T07:25:14.789 INFO:tasks.workunit.client.0.smithi098.stdout:3/822: dwrite de/d4e/d6d/d71/fbf [4194304,4194304] 0 2024-09-19T07:25:14.789 INFO:tasks.workunit.client.0.smithi098.stdout:3/823: write f5 [1421970,52831] 0 2024-09-19T07:25:14.789 INFO:tasks.workunit.client.0.smithi098.stdout:3/824: dread - de/df/d1f/d2b/d93/fe1 zero size 2024-09-19T07:25:14.789 INFO:tasks.workunit.client.0.smithi098.stdout:3/825: write de/d4e/d6d/ff1 [813556,77921] 0 2024-09-19T07:25:14.790 INFO:tasks.workunit.client.0.smithi098.stdout:5/723: dwrite dc/de/d13/d46/d2e/d62/f72 [0,4194304] 0 2024-09-19T07:25:14.790 INFO:tasks.workunit.client.0.smithi098.stdout:5/724: rmdir dc/de/d36/dba 39 2024-09-19T07:25:14.794 INFO:tasks.workunit.client.0.smithi098.stdout:6/911: dwrite d2/d11/f66 [0,4194304] 0 2024-09-19T07:25:14.794 INFO:tasks.workunit.client.0.smithi098.stdout:6/912: chown d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/l96 3 1 2024-09-19T07:25:14.805 INFO:tasks.workunit.client.0.smithi098.stdout:4/954: dwrite da/ffd [0,4194304] 0 2024-09-19T07:25:14.806 INFO:tasks.workunit.client.0.smithi098.stdout:2/984: dwrite d1/d9/d26/d35/f114 [0,4194304] 0 2024-09-19T07:25:14.811 INFO:tasks.workunit.client.0.smithi098.stdout:3/826: dwrite de/f28 [0,4194304] 0 2024-09-19T07:25:14.813 INFO:tasks.workunit.client.0.smithi098.stdout:2/985: fsync d1/d9/d26/d35/d88/dc2/dfb/d60/da5/dd9/f30 0 2024-09-19T07:25:14.813 INFO:tasks.workunit.client.0.smithi098.stdout:2/986: write d1/d5/d72/db5/dad/fc9 [1481935,58089] 0 2024-09-19T07:25:14.813 INFO:tasks.workunit.client.0.smithi098.stdout:2/987: readlink d1/d5/d34/d5a/lfe 0 2024-09-19T07:25:14.813 INFO:tasks.workunit.client.0.smithi098.stdout:5/725: dwrite dc/de/d13/fa1 [0,4194304] 0 2024-09-19T07:25:14.814 INFO:tasks.workunit.client.0.smithi098.stdout:5/726: fdatasync dc/de/d13/d46/d2e/f33 0 2024-09-19T07:25:14.814 INFO:tasks.workunit.client.0.smithi098.stdout:2/988: creat d1/d5/d147/f150 x:0 0 0 2024-09-19T07:25:14.814 INFO:tasks.workunit.client.0.smithi098.stdout:4/955: mkdir da/d31/d46/d5f/d8a/db6/dc2/de7/d109/d13b 0 2024-09-19T07:25:14.818 INFO:tasks.workunit.client.0.smithi098.stdout:5/727: mkdir dc/de/d13/d5c/daf/dfd 0 2024-09-19T07:25:14.818 INFO:tasks.workunit.client.0.smithi098.stdout:5/728: dread - dc/de/d13/d46/d2e/d37/d67/d99/fda zero size 2024-09-19T07:25:14.818 INFO:tasks.workunit.client.0.smithi098.stdout:5/729: readlink dc/ld9 0 2024-09-19T07:25:14.819 INFO:tasks.workunit.client.0.smithi098.stdout:2/989: mkdir d1/d5/d147/d151 0 2024-09-19T07:25:14.819 INFO:tasks.workunit.client.0.smithi098.stdout:5/730: creat dc/de/d13/d46/d2e/d37/d67/ffe x:0 0 0 2024-09-19T07:25:14.820 INFO:tasks.workunit.client.0.smithi098.stdout:5/731: symlink dc/de/d13/d5c/daf/db9/lff 0 2024-09-19T07:25:14.820 INFO:tasks.workunit.client.0.smithi098.stdout:5/732: chown dc/de/d36/f4b 1 1 2024-09-19T07:25:14.821 INFO:tasks.workunit.client.0.smithi098.stdout:2/990: link d1/d5/d34/fb8 d1/d9/f152 0 2024-09-19T07:25:14.822 INFO:tasks.workunit.client.0.smithi098.stdout:5/733: unlink dc/de/d13/c2d 0 2024-09-19T07:25:14.825 INFO:tasks.workunit.client.0.smithi098.stdout:2/991: mknod d1/d5/d72/db5/dad/d10a/c153 0 2024-09-19T07:25:14.825 INFO:tasks.workunit.client.0.smithi098.stdout:4/956: write da/d31/d46/fdc [1074540,61065] 0 2024-09-19T07:25:14.826 INFO:tasks.workunit.client.0.smithi098.stdout:4/957: creat da/d31/d46/d56/d5b/d63/f13c x:0 0 0 2024-09-19T07:25:14.827 INFO:tasks.workunit.client.0.smithi098.stdout:4/958: mknod da/d59/c13d 0 2024-09-19T07:25:14.827 INFO:tasks.workunit.client.0.smithi098.stdout:4/959: stat da/d31/d46/d5f/d8a/db6/dc9/fda 0 2024-09-19T07:25:14.827 INFO:tasks.workunit.client.0.smithi098.stdout:4/960: chown da/d31/d46/d5f/dc8 111931660 1 2024-09-19T07:25:14.827 INFO:tasks.workunit.client.0.smithi098.stdout:4/961: fsync da/d31/f11e 0 2024-09-19T07:25:14.831 INFO:tasks.workunit.client.0.smithi098.stdout:4/962: link da/d31/d46/d5f/d8a/db6/dc2/de7/d109/fad da/d31/d46/d5f/d8a/db6/dc2/de7/d109/f13e 0 2024-09-19T07:25:14.832 INFO:tasks.workunit.client.0.smithi098.stdout:4/963: creat da/d31/d46/d56/d5b/f13f x:0 0 0 2024-09-19T07:25:14.839 INFO:tasks.workunit.client.0.smithi098.stdout:5/734: rename dc/de/d13/d46/d2e/d62 to dc/d100 0 2024-09-19T07:25:14.840 INFO:tasks.workunit.client.0.smithi098.stdout:5/735: symlink dc/de/d13/d7d/l101 0 2024-09-19T07:25:14.840 INFO:tasks.workunit.client.0.smithi098.stdout:4/964: dread da/d31/d46/d5f/d8a/db6/dc2/de7/d109/f99 [0,4194304] 0 2024-09-19T07:25:14.841 INFO:tasks.workunit.client.0.smithi098.stdout:5/736: creat dc/de/d13/d46/d2e/f102 x:0 0 0 2024-09-19T07:25:14.841 INFO:tasks.workunit.client.0.smithi098.stdout:5/737: chown dc/de/d36/f4b 4510749 1 2024-09-19T07:25:14.841 INFO:tasks.workunit.client.0.smithi098.stdout:4/965: read da/d31/d46/d56/d5b/db9/df0/f11c [676204,2639] 0 2024-09-19T07:25:14.842 INFO:tasks.workunit.client.0.smithi098.stdout:4/966: stat da/d31/d46/d56/d5b/d61/fb4 0 2024-09-19T07:25:14.846 INFO:tasks.workunit.client.0.smithi098.stdout:4/967: truncate da/f3a 4562951 0 2024-09-19T07:25:14.856 INFO:tasks.workunit.client.0.smithi098.stdout:4/968: write da/d31/d46/d5f/d8a/db6/dc2/de7/d109/f13e [160287,114856] 0 2024-09-19T07:25:14.856 INFO:tasks.workunit.client.0.smithi098.stdout:4/969: write da/f1e [1211554,19680] 0 2024-09-19T07:25:14.857 INFO:tasks.workunit.client.0.smithi098.stdout:4/970: chown da/d31/d46 177689 1 2024-09-19T07:25:14.857 INFO:tasks.workunit.client.0.smithi098.stdout:4/971: readlink da/d7e/l9c 0 2024-09-19T07:25:14.857 INFO:tasks.workunit.client.0.smithi098.stdout:4/972: creat da/d31/d46/d56/d5b/d61/f140 x:0 0 0 2024-09-19T07:25:14.860 INFO:tasks.workunit.client.0.smithi098.stdout:4/973: read da/d31/d46/d56/d5b/fb2 [1377248,103402] 0 2024-09-19T07:25:14.864 INFO:tasks.workunit.client.0.smithi098.stdout:4/974: dread da/d31/dc5/fe1 [0,4194304] 0 2024-09-19T07:25:14.864 INFO:tasks.workunit.client.0.smithi098.stdout:4/975: fsync da/d31/d46/fd8 0 2024-09-19T07:25:14.865 INFO:tasks.workunit.client.0.smithi098.stdout:4/976: rename da/d31/l4c to da/d31/d46/l141 0 2024-09-19T07:25:14.874 INFO:tasks.workunit.client.0.smithi098.stdout:4/977: dread da/ffd [0,4194304] 0 2024-09-19T07:25:14.895 INFO:tasks.workunit.client.0.smithi098.stdout:4/978: dwrite da/fb [12582912,4194304] 0 2024-09-19T07:25:14.900 INFO:tasks.workunit.client.0.smithi098.stdout:4/979: read da/d31/d46/d56/fa0 [3412169,45582] 0 2024-09-19T07:25:14.902 INFO:tasks.workunit.client.0.smithi098.stdout:4/980: mknod da/d31/d46/d56/d5b/d138/c142 0 2024-09-19T07:25:14.902 INFO:tasks.workunit.client.0.smithi098.stdout:4/981: dread - da/d59/deb/f117 zero size 2024-09-19T07:25:14.902 INFO:tasks.workunit.client.0.smithi098.stdout:4/982: getdents da/d31/d46/d114/d12f 0 2024-09-19T07:25:14.902 INFO:tasks.workunit.client.0.smithi098.stdout:4/983: stat da/d31/d46/d5f/d8a/db6/dc2/de7/d109/d13b 0 2024-09-19T07:25:14.902 INFO:tasks.workunit.client.0.smithi098.stdout:4/984: fsync da/d31/f57 0 2024-09-19T07:25:14.902 INFO:tasks.workunit.client.0.smithi098.stdout:4/985: dread - da/d31/d46/d5f/d118/df2/f108 zero size 2024-09-19T07:25:14.902 INFO:tasks.workunit.client.0.smithi098.stdout:4/986: chown da/d31/d46/c5e 93613 1 2024-09-19T07:25:14.902 INFO:tasks.workunit.client.0.smithi098.stdout:4/987: truncate da/d31/d46/d5f/d118/f105 555537 0 2024-09-19T07:25:14.903 INFO:tasks.workunit.client.0.smithi098.stdout:4/988: creat da/d31/f143 x:0 0 0 2024-09-19T07:25:14.911 INFO:tasks.workunit.client.0.smithi098.stdout:4/989: link da/d31/d46/d5f/d8a/db6/dc2/de7/c136 da/d31/d46/d56/d5b/db9/df0/d126/c144 0 2024-09-19T07:25:14.912 INFO:tasks.workunit.client.0.smithi098.stdout:4/990: symlink da/d31/d46/d5f/d8a/db6/dc2/de7/l145 0 2024-09-19T07:25:14.912 INFO:tasks.workunit.client.0.smithi098.stdout:4/991: fsync da/d31/f57 0 2024-09-19T07:25:14.913 INFO:tasks.workunit.client.0.smithi098.stdout:4/992: symlink da/d31/d46/d5f/d8a/db6/dc2/de7/l146 0 2024-09-19T07:25:15.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:15 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:25:15.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:15 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:25:15.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:15 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:25:16.174 INFO:tasks.workunit.client.0.smithi098.stdout:4/993: rename da/d31/d46/d56/d5b/d66/f106 to da/d31/d46/d5f/d118/f147 0 2024-09-19T07:25:16.174 INFO:tasks.workunit.client.0.smithi098.stdout:4/994: creat da/d31/d46/d56/d5b/d138/f148 x:0 0 0 2024-09-19T07:25:16.175 INFO:tasks.workunit.client.0.smithi098.stdout:4/995: read da/d31/d46/d56/d5b/d66/fd0 [157321,102204] 0 2024-09-19T07:25:16.175 INFO:tasks.workunit.client.0.smithi098.stdout:4/996: chown da/d31/f40 3304 1 2024-09-19T07:25:16.175 INFO:tasks.workunit.client.0.smithi098.stdout:4/997: chown da/d31/cbf 169 1 2024-09-19T07:25:16.175 INFO:tasks.workunit.client.0.smithi098.stdout:4/998: chown da/d31/d46/d56/d5b/d61/c104 1820898 1 2024-09-19T07:25:16.177 INFO:tasks.workunit.client.0.smithi098.stdout:8/914: sync 2024-09-19T07:25:16.177 INFO:tasks.workunit.client.0.smithi098.stdout:5/738: sync 2024-09-19T07:25:16.177 INFO:tasks.workunit.client.0.smithi098.stdout:3/827: sync 2024-09-19T07:25:16.178 INFO:tasks.workunit.client.0.smithi098.stdout:0/940: sync 2024-09-19T07:25:16.178 INFO:tasks.workunit.client.0.smithi098.stdout:6/913: sync 2024-09-19T07:25:16.178 INFO:tasks.workunit.client.0.smithi098.stdout:2/992: sync 2024-09-19T07:25:16.179 INFO:tasks.workunit.client.0.smithi098.stdout:5/739: mkdir dc/de/d13/d46/d2e/d37/d67/d103 0 2024-09-19T07:25:16.181 INFO:tasks.workunit.client.0.smithi098.stdout:6/914: unlink d2/d5/d1f/d26/d42/d48/d53/da2/d139/f3a 0 2024-09-19T07:25:16.181 INFO:tasks.workunit.client.0.smithi098.stdout:6/915: write d2/d5/d1f/d26/d42/d48/d53/d64/d6d/f82 [36744,110178] 0 2024-09-19T07:25:16.182 INFO:tasks.workunit.client.0.smithi098.stdout:6/916: chown d2/d5/d1f/d26/d42/d48/fab 79460 1 2024-09-19T07:25:16.182 INFO:tasks.workunit.client.0.smithi098.stdout:6/917: truncate d2/d11/fb4 4393420 0 2024-09-19T07:25:16.183 INFO:tasks.workunit.client.0.smithi098.stdout:3/828: symlink de/df/d31/d61/d69/ddd/de2/lf8 0 2024-09-19T07:25:16.184 INFO:tasks.workunit.client.0.smithi098.stdout:3/829: dread - de/d4e/d6d/d71/f88 zero size 2024-09-19T07:25:16.184 INFO:tasks.workunit.client.0.smithi098.stdout:3/830: chown de/df/d1f/d72/cac 0 1 2024-09-19T07:25:16.185 INFO:tasks.workunit.client.0.smithi098.stdout:8/915: creat d0/d16/d7d/dcc/dd2/f131 x:0 0 0 2024-09-19T07:25:16.186 INFO:tasks.workunit.client.0.smithi098.stdout:3/831: dread de/df/d1f/d2b/d93/fe8 [0,4194304] 0 2024-09-19T07:25:16.188 INFO:tasks.workunit.client.0.smithi098.stdout:0/941: mknod d5/d20/d1f/d52/d64/dcc/c12e 0 2024-09-19T07:25:16.189 INFO:tasks.workunit.client.0.smithi098.stdout:5/740: write dc/de/d13/d46/d2e/d37/d81/db8/fc6 [785273,47707] 0 2024-09-19T07:25:16.189 INFO:tasks.workunit.client.0.smithi098.stdout:5/741: truncate dc/d100/f72 4274713 0 2024-09-19T07:25:16.189 INFO:tasks.workunit.client.0.smithi098.stdout:9/853: fsync d3/d16/d43/d51/dd3/dc1/fe1 0 2024-09-19T07:25:16.189 INFO:tasks.workunit.client.0.smithi098.stdout:9/854: stat d3/ldd 0 2024-09-19T07:25:16.191 INFO:tasks.workunit.client.0.smithi098.stdout:0/942: symlink d5/d20/d1f/d52/d9f/l12f 0 2024-09-19T07:25:16.192 INFO:tasks.workunit.client.0.smithi098.stdout:3/832: rmdir de/df/d31 39 2024-09-19T07:25:16.193 INFO:tasks.workunit.client.0.smithi098.stdout:8/916: truncate d0/d2c/dfb/f130 1978767 0 2024-09-19T07:25:16.194 INFO:tasks.workunit.client.0.smithi098.stdout:4/999: write da/f3a [489773,36387] 0 2024-09-19T07:25:16.195 INFO:tasks.workunit.client.0.smithi098.stdout:9/855: link d3/d16/d38/f2e d3/dc/df/d15/d1a/d2b/d49/d50/f11b 0 2024-09-19T07:25:16.197 INFO:tasks.workunit.client.0.smithi098.stdout:3/833: mknod de/df/d31/d61/d69/cf9 0 2024-09-19T07:25:16.198 INFO:tasks.workunit.client.0.smithi098.stdout:5/742: truncate dc/de/d13/d46/d23/f5f 363643 0 2024-09-19T07:25:16.198 INFO:tasks.workunit.client.0.smithi098.stdout:5/743: chown dc/de/d13/d46/df6 991316 1 2024-09-19T07:25:16.199 INFO:tasks.workunit.client.0.smithi098.stdout:3/834: fdatasync de/df/d1f/d2b/d93/de5/fdb 0 2024-09-19T07:25:16.199 INFO:tasks.workunit.client.0.smithi098.stdout:5/744: symlink dc/de/d13/d46/d2e/d37/d6d/l104 0 2024-09-19T07:25:16.201 INFO:tasks.workunit.client.0.smithi098.stdout:3/835: mknod de/d4e/d6d/dad/cfa 0 2024-09-19T07:25:16.202 INFO:tasks.workunit.client.0.smithi098.stdout:5/745: rmdir dc/de/d13/d46/d2e/d37/de6 0 2024-09-19T07:25:16.203 INFO:tasks.workunit.client.0.smithi098.stdout:9/856: dread d3/d6/d8/f77 [0,4194304] 0 2024-09-19T07:25:16.203 INFO:tasks.workunit.client.0.smithi098.stdout:3/836: mkdir de/d4e/d6d/dfb 0 2024-09-19T07:25:16.204 INFO:tasks.workunit.client.0.smithi098.stdout:5/746: mknod dc/de/d13/d46/d2e/d37/d6d/dee/c105 0 2024-09-19T07:25:16.212 INFO:tasks.workunit.client.0.smithi098.stdout:0/943: dwrite d5/d20/d1f/d52/d64/dba/dd2/f10f [0,4194304] 0 2024-09-19T07:25:16.212 INFO:tasks.workunit.client.0.smithi098.stdout:0/944: read - d5/d20/d1f/d52/d64/dba/f104 zero size 2024-09-19T07:25:16.213 INFO:tasks.workunit.client.0.smithi098.stdout:9/857: dread d3/dc/df/d15/d1a/d2b/d49/d50/f11b [0,4194304] 0 2024-09-19T07:25:16.215 INFO:tasks.workunit.client.0.smithi098.stdout:6/918: link d2/d5/d1f/d26/d7b/de0/cea d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/c144 0 2024-09-19T07:25:16.218 INFO:tasks.workunit.client.0.smithi098.stdout:6/919: mknod d2/d5/d1f/d127/c145 0 2024-09-19T07:25:16.218 INFO:tasks.workunit.client.0.smithi098.stdout:6/920: fdatasync d2/d5/d1f/d26/d42/d48/fec 0 2024-09-19T07:25:16.218 INFO:tasks.workunit.client.0.smithi098.stdout:9/858: mkdir d3/d16/d43/d61/da6/d11c 0 2024-09-19T07:25:16.218 INFO:tasks.workunit.client.0.smithi098.stdout:9/859: truncate d3/d16/d38/f36 2437231 0 2024-09-19T07:25:16.218 INFO:tasks.workunit.client.0.smithi098.stdout:8/917: write d0/d33/d44/fb1 [516782,21179] 0 2024-09-19T07:25:16.220 INFO:tasks.workunit.client.0.smithi098.stdout:9/860: unlink d3/d6/d46/d83/da9/dbc/f109 0 2024-09-19T07:25:16.221 INFO:tasks.workunit.client.0.smithi098.stdout:9/861: symlink d3/d16/d43/d51/d6e/l11d 0 2024-09-19T07:25:16.222 INFO:tasks.workunit.client.0.smithi098.stdout:9/862: write d3/dc/f6a [430757,6598] 0 2024-09-19T07:25:16.222 INFO:tasks.workunit.client.0.smithi098.stdout:9/863: chown d3/d16/d43/lcf 25976 1 2024-09-19T07:25:16.223 INFO:tasks.workunit.client.0.smithi098.stdout:0/945: dread d5/d20/f12 [8388608,4194304] 0 2024-09-19T07:25:16.223 INFO:tasks.workunit.client.0.smithi098.stdout:0/946: chown d5/d20/d14/d49/d62/l68 39714841 1 2024-09-19T07:25:16.225 INFO:tasks.workunit.client.0.smithi098.stdout:0/947: creat d5/d20/d14/d49/d62/da7/f130 x:0 0 0 2024-09-19T07:25:16.226 INFO:tasks.workunit.client.0.smithi098.stdout:0/948: symlink d5/d20/d14/l131 0 2024-09-19T07:25:16.228 INFO:tasks.workunit.client.0.smithi098.stdout:0/949: truncate d5/d20/d1f/d52/d64/ff9 1738453 0 2024-09-19T07:25:16.230 INFO:tasks.workunit.client.0.smithi098.stdout:0/950: rmdir d5/d20/d1f/d11b/d12c 0 2024-09-19T07:25:16.231 INFO:tasks.workunit.client.0.smithi098.stdout:0/951: getdents d5/d20/d1f/d52/d64 0 2024-09-19T07:25:16.232 INFO:tasks.workunit.client.0.smithi098.stdout:0/952: creat d5/d20/d1f/d52/d64/dba/dd2/f132 x:0 0 0 2024-09-19T07:25:16.234 INFO:tasks.workunit.client.0.smithi098.stdout:0/953: symlink d5/d20/d1f/d52/d101/d111/l133 0 2024-09-19T07:25:16.235 INFO:tasks.workunit.client.0.smithi098.stdout:3/837: dwrite de/df/d1f/f56 [0,4194304] 0 2024-09-19T07:25:16.236 INFO:tasks.workunit.client.0.smithi098.stdout:0/954: creat d5/d20/d14/d49/f134 x:0 0 0 2024-09-19T07:25:16.236 INFO:tasks.workunit.client.0.smithi098.stdout:0/955: write d5/d20/d1f/d52/d64/dba/dd2/f132 [470601,12047] 0 2024-09-19T07:25:16.236 INFO:tasks.workunit.client.0.smithi098.stdout:0/956: chown d5/d20/d14/d49/f56 3 1 2024-09-19T07:25:16.237 INFO:tasks.workunit.client.0.smithi098.stdout:0/957: creat d5/d20/d1f/d47/f135 x:0 0 0 2024-09-19T07:25:16.237 INFO:tasks.workunit.client.0.smithi098.stdout:0/958: mknod d5/d20/d1f/d52/d9f/c136 0 2024-09-19T07:25:16.239 INFO:tasks.workunit.client.0.smithi098.stdout:5/747: rename cb to dc/de/d13/d46/d2e/d37/d6d/dee/c106 0 2024-09-19T07:25:16.239 INFO:tasks.workunit.client.0.smithi098.stdout:0/959: symlink d5/d20/d1f/d52/d64/l137 0 2024-09-19T07:25:16.240 INFO:tasks.workunit.client.0.smithi098.stdout:3/838: symlink de/df/d31/d61/d3f/d64/d84/lfc 0 2024-09-19T07:25:16.241 INFO:tasks.workunit.client.0.smithi098.stdout:3/839: creat de/df/d1f/d2b/df7/ffd x:0 0 0 2024-09-19T07:25:16.241 INFO:tasks.workunit.client.0.smithi098.stdout:3/840: write de/df/d31/f7d [1367178,14475] 0 2024-09-19T07:25:16.245 INFO:tasks.workunit.client.0.smithi098.stdout:8/918: dwrite d0/d2c/fe7 [4194304,4194304] 0 2024-09-19T07:25:16.245 INFO:tasks.workunit.client.0.smithi098.stdout:8/919: truncate d0/d16/d7d/dcc/dd2/df5/d115/f119 4952812 0 2024-09-19T07:25:16.250 INFO:tasks.workunit.client.0.smithi098.stdout:9/864: dwrite d3/d16/d43/d51/dd3/dc1/fe1 [0,4194304] 0 2024-09-19T07:25:16.255 INFO:tasks.workunit.client.0.smithi098.stdout:9/865: symlink d3/dc/df/d15/d1b/l11e 0 2024-09-19T07:25:16.257 INFO:tasks.workunit.client.0.smithi098.stdout:3/841: dread de/df/d31/d61/f4c [0,4194304] 0 2024-09-19T07:25:16.257 INFO:tasks.workunit.client.0.smithi098.stdout:3/842: stat l6 0 2024-09-19T07:25:16.257 INFO:tasks.workunit.client.0.smithi098.stdout:3/843: chown de/df/d31/d61/d79/f91 98620 1 2024-09-19T07:25:16.261 INFO:tasks.workunit.client.0.smithi098.stdout:3/844: link de/f25 de/df/d31/d61/d69/def/ffe 0 2024-09-19T07:25:16.262 INFO:tasks.workunit.client.0.smithi098.stdout:3/845: rmdir de/df/d31/d61/d69/ddd/de2 39 2024-09-19T07:25:16.262 INFO:tasks.workunit.client.0.smithi098.stdout:3/846: stat de/d4e/fe0 0 2024-09-19T07:25:16.264 INFO:tasks.workunit.client.0.smithi098.stdout:3/847: link de/df/d31/d61/cc9 de/df/d31/d61/d69/cff 0 2024-09-19T07:25:16.266 INFO:tasks.workunit.client.0.smithi098.stdout:9/866: dread d3/dc/df/d15/d1b/f9a [0,4194304] 0 2024-09-19T07:25:16.267 INFO:tasks.workunit.client.0.smithi098.stdout:0/960: dwrite d5/d20/d1f/d47/db2/dd3/d106/d94/fe0 [0,4194304] 0 2024-09-19T07:25:16.268 INFO:tasks.workunit.client.0.smithi098.stdout:3/848: write de/df/d1f/d2b/f77 [1947621,49425] 0 2024-09-19T07:25:16.268 INFO:tasks.workunit.client.0.smithi098.stdout:3/849: fdatasync f0 0 2024-09-19T07:25:16.269 INFO:tasks.workunit.client.0.smithi098.stdout:0/961: creat d5/d20/d1f/d52/d64/dba/dd2/dea/df2/f138 x:0 0 0 2024-09-19T07:25:16.272 INFO:tasks.workunit.client.0.smithi098.stdout:3/850: rmdir de/d4e/d6d/d8c/dab/de6 39 2024-09-19T07:25:16.279 INFO:tasks.workunit.client.0.smithi098.stdout:9/867: dread d3/dc/df/d15/d2f/f5f [0,4194304] 0 2024-09-19T07:25:16.280 INFO:tasks.workunit.client.0.smithi098.stdout:9/868: mknod d3/d16/d43/d51/dd3/d8a/c11f 0 2024-09-19T07:25:16.281 INFO:tasks.workunit.client.0.smithi098.stdout:9/869: rmdir d3/dc 39 2024-09-19T07:25:16.283 INFO:tasks.workunit.client.0.smithi098.stdout:0/962: write d5/f18 [7383577,84643] 0 2024-09-19T07:25:16.283 INFO:tasks.workunit.client.0.smithi098.stdout:9/870: creat d3/d6/d46/d83/da9/dbc/f120 x:0 0 0 2024-09-19T07:25:16.285 INFO:tasks.workunit.client.0.smithi098.stdout:9/871: symlink d3/dc/df/d15/d1a/d2d/l121 0 2024-09-19T07:25:16.286 INFO:tasks.workunit.client.0.smithi098.stdout:0/963: mknod d5/d20/d1f/d52/d64/da0/c139 0 2024-09-19T07:25:16.286 INFO:tasks.workunit.client.0.smithi098.stdout:0/964: chown d5/d20/d1f/d52/d64/dba/dd2/dea/df2/l10a 88290 1 2024-09-19T07:25:16.288 INFO:tasks.workunit.client.0.smithi098.stdout:0/965: creat d5/d20/d1f/d47/db2/dd3/d106/d92/df7/f13a x:0 0 0 2024-09-19T07:25:16.289 INFO:tasks.workunit.client.0.smithi098.stdout:0/966: creat d5/d20/d1f/d52/d9f/f13b x:0 0 0 2024-09-19T07:25:16.289 INFO:tasks.workunit.client.0.smithi098.stdout:0/967: read - d5/d20/d1f/d52/d64/dba/f104 zero size 2024-09-19T07:25:16.300 INFO:tasks.workunit.client.0.smithi098.stdout:3/851: dwrite de/df/f29 [4194304,4194304] 0 2024-09-19T07:25:16.300 INFO:tasks.workunit.client.0.smithi098.stdout:3/852: stat de/l24 0 2024-09-19T07:25:16.303 INFO:tasks.workunit.client.0.smithi098.stdout:3/853: rename de/faa to de/df/f100 0 2024-09-19T07:25:16.303 INFO:tasks.workunit.client.0.smithi098.stdout:3/854: chown de/d4e/d6d/dad/lcc 1212344333 1 2024-09-19T07:25:16.306 INFO:tasks.workunit.client.0.smithi098.stdout:3/855: dread de/df/d1f/d72/f8a [0,4194304] 0 2024-09-19T07:25:16.312 INFO:tasks.workunit.client.0.smithi098.stdout:3/856: read de/df/d1f/d2b/fdc [795393,36488] 0 2024-09-19T07:25:16.313 INFO:tasks.workunit.client.0.smithi098.stdout:3/857: mkdir de/df/d1f/d2b/d93/d101 0 2024-09-19T07:25:16.318 INFO:tasks.workunit.client.0.smithi098.stdout:0/968: dwrite d5/d20/d1f/d47/f90 [4194304,4194304] 0 2024-09-19T07:25:16.320 INFO:tasks.workunit.client.0.smithi098.stdout:3/858: write de/d4e/d6d/d71/fbf [5141956,130686] 0 2024-09-19T07:25:16.320 INFO:tasks.workunit.client.0.smithi098.stdout:3/859: stat de/df/d31/d61/d69/fcb 0 2024-09-19T07:25:16.320 INFO:tasks.workunit.client.0.smithi098.stdout:0/969: symlink d5/d20/d14/d49/d62/l13c 0 2024-09-19T07:25:16.322 INFO:tasks.workunit.client.0.smithi098.stdout:3/860: rmdir de/df/d1f/d72 39 2024-09-19T07:25:16.326 INFO:tasks.workunit.client.0.smithi098.stdout:3/861: dread de/df/d1f/f99 [0,4194304] 0 2024-09-19T07:25:16.328 INFO:tasks.workunit.client.0.smithi098.stdout:0/970: link d5/d20/d1f/d52/d64/da0/fdc d5/d20/d1f/d47/db2/dd3/d106/f13d 0 2024-09-19T07:25:16.329 INFO:tasks.workunit.client.0.smithi098.stdout:0/971: read d5/d20/d1f/d47/dae/ffc [94454,3058] 0 2024-09-19T07:25:16.329 INFO:tasks.workunit.client.0.smithi098.stdout:0/972: write d5/fe [4940234,13728] 0 2024-09-19T07:25:16.343 INFO:tasks.workunit.client.0.smithi098.stdout:0/973: rename d5/d20/d14/d49/d62/da7/fac to d5/d20/d1f/d52/d64/dba/dd2/dea/f13e 0 2024-09-19T07:25:16.344 INFO:tasks.workunit.client.0.smithi098.stdout:0/974: rmdir d5/d20/d1f/d47/db2/dd3/d106/d94/d121 39 2024-09-19T07:25:16.344 INFO:tasks.workunit.client.0.smithi098.stdout:0/975: chown d5/d20/d1f/d8d/c96 7478117 1 2024-09-19T07:25:16.345 INFO:tasks.workunit.client.0.smithi098.stdout:0/976: creat d5/d20/d1f/d47/db2/dd3/d106/d92/f13f x:0 0 0 2024-09-19T07:25:16.345 INFO:tasks.workunit.client.0.smithi098.stdout:0/977: chown d5 252151339 1 2024-09-19T07:25:16.346 INFO:tasks.workunit.client.0.smithi098.stdout:0/978: mkdir d5/d20/d1f/d140 0 2024-09-19T07:25:16.346 INFO:tasks.workunit.client.0.smithi098.stdout:0/979: chown d5/d20/d1f/d52/d9f/f10e 3900557 1 2024-09-19T07:25:16.350 INFO:tasks.workunit.client.0.smithi098.stdout:3/862: dwrite de/f26 [4194304,4194304] 0 2024-09-19T07:25:16.350 INFO:tasks.workunit.client.0.smithi098.stdout:3/863: stat de/d4e/d6d/fa1 0 2024-09-19T07:25:16.368 INFO:tasks.workunit.client.0.smithi098.stdout:0/980: dwrite d5/d20/f42 [4194304,4194304] 0 2024-09-19T07:25:16.368 INFO:tasks.workunit.client.0.smithi098.stdout:0/981: fdatasync d5/d20/f12 0 2024-09-19T07:25:16.368 INFO:tasks.workunit.client.0.smithi098.stdout:0/982: chown d5/d20/d1f/d52/d64/dcc/feb 61327 1 2024-09-19T07:25:16.368 INFO:tasks.workunit.client.0.smithi098.stdout:0/983: chown d5/d20/d14/d49/d62/l68 110 1 2024-09-19T07:25:16.368 INFO:tasks.workunit.client.0.smithi098.stdout:0/984: chown d5/d20/d1f/d52/d64 303887 1 2024-09-19T07:25:16.370 INFO:tasks.workunit.client.0.smithi098.stdout:0/985: symlink d5/d20/d1f/d47/db2/dbf/d6d/l141 0 2024-09-19T07:25:16.371 INFO:tasks.workunit.client.0.smithi098.stdout:0/986: mkdir d5/d20/d1f/d47/db2/dd3/d106/d92/df7/d142 0 2024-09-19T07:25:16.371 INFO:tasks.workunit.client.0.smithi098.stdout:0/987: chown d5/d20/d1f/d47/dae/dca/fcd 44059563 1 2024-09-19T07:25:16.371 INFO:tasks.workunit.client.0.smithi098.stdout:0/988: fsync d5/f46 0 2024-09-19T07:25:16.372 INFO:tasks.workunit.client.0.smithi098.stdout:0/989: getdents d5/d20/d1f/d47 0 2024-09-19T07:25:16.372 INFO:tasks.workunit.client.0.smithi098.stdout:0/990: write d5/f1e [3308216,23449] 0 2024-09-19T07:25:16.378 INFO:tasks.workunit.client.0.smithi098.stdout:0/991: write d5/f3d [1329944,109501] 0 2024-09-19T07:25:16.379 INFO:tasks.workunit.client.0.smithi098.stdout:3/864: dwrite f9 [0,4194304] 0 2024-09-19T07:25:16.383 INFO:tasks.workunit.client.0.smithi098.stdout:3/865: creat de/df/d31/d61/f102 x:0 0 0 2024-09-19T07:25:16.384 INFO:tasks.workunit.client.0.smithi098.stdout:3/866: truncate de/df/d31/d61/d79/fb5 2450246 0 2024-09-19T07:25:16.385 INFO:tasks.workunit.client.0.smithi098.stdout:3/867: mknod de/d4e/d6d/d71/c103 0 2024-09-19T07:25:16.385 INFO:tasks.workunit.client.0.smithi098.stdout:3/868: chown de/df/d31/d61/d3f/f85 64288103 1 2024-09-19T07:25:16.388 INFO:tasks.workunit.client.0.smithi098.stdout:3/869: dread de/df/d1f/d2b/d93/de5/fd2 [0,4194304] 0 2024-09-19T07:25:16.399 INFO:tasks.workunit.client.0.smithi098.stdout:0/992: dwrite d5/d20/d1f/d52/d64/dba/dd2/dea/ff6 [0,4194304] 0 2024-09-19T07:25:16.399 INFO:tasks.workunit.client.0.smithi098.stdout:0/993: readlink d5/d20/d14/d49/d62/da7/db7/lc8 0 2024-09-19T07:25:16.401 INFO:tasks.workunit.client.0.smithi098.stdout:3/870: link de/df/d1f/d2b/l68 de/df/d31/d61/d69/ddd/de2/l104 0 2024-09-19T07:25:16.401 INFO:tasks.workunit.client.0.smithi098.stdout:3/871: chown de/df/d4f 7667122 1 2024-09-19T07:25:16.401 INFO:tasks.workunit.client.0.smithi098.stdout:3/872: fsync de/d4e/d6d/d71/f73 0 2024-09-19T07:25:16.403 INFO:tasks.workunit.client.0.smithi098.stdout:0/994: unlink d5/d20/d14/d49/f56 0 2024-09-19T07:25:16.404 INFO:tasks.workunit.client.0.smithi098.stdout:0/995: truncate d5/d20/d1f/d47/db2/dd3/d106/d92/fe6 3514762 0 2024-09-19T07:25:16.405 INFO:tasks.workunit.client.0.smithi098.stdout:0/996: chown d5/d20/d1f/d47/db2/dbf/c82 54 1 2024-09-19T07:25:16.405 INFO:tasks.workunit.client.0.smithi098.stdout:0/997: chown d5/d20/d1f/d52/d64/da0/c139 29589752 1 2024-09-19T07:25:16.405 INFO:tasks.workunit.client.0.smithi098.stdout:0/998: stat d5/d20/d14/f4a 0 2024-09-19T07:25:16.406 INFO:tasks.workunit.client.0.smithi098.stdout:0/999: rename d5/d20/d1f/d47/db2/dbf/d6d/f9b to d5/d20/d14/d49/d62/f143 0 2024-09-19T07:25:16.410 INFO:tasks.workunit.client.0.smithi098.stdout:3/873: write de/df/d31/d61/d3f/f5d [634777,78119] 0 2024-09-19T07:25:16.411 INFO:tasks.workunit.client.0.smithi098.stdout:3/874: symlink de/d4e/d6d/d8c/dab/l105 0 2024-09-19T07:25:16.415 INFO:tasks.workunit.client.0.smithi098.stdout:3/875: fdatasync de/df/d31/d61/d3f/f5d 0 2024-09-19T07:25:16.416 INFO:tasks.workunit.client.0.smithi098.stdout:3/876: rmdir de/d4e/d6d/dad 39 2024-09-19T07:25:16.417 INFO:tasks.workunit.client.0.smithi098.stdout:3/877: mkdir de/d4e/d6d/d8c/dab/de6/df4/d106 0 2024-09-19T07:25:16.419 INFO:tasks.workunit.client.0.smithi098.stdout:3/878: write de/df/d31/d61/d3f/fb9 [579649,38013] 0 2024-09-19T07:25:16.422 INFO:tasks.workunit.client.0.smithi098.stdout:3/879: rmdir de/d4e/de7 0 2024-09-19T07:25:16.422 INFO:tasks.workunit.client.0.smithi098.stdout:3/880: stat de/df/d31 0 2024-09-19T07:25:16.423 INFO:tasks.workunit.client.0.smithi098.stdout:3/881: symlink de/df/d31/d61/d69/ddd/l107 0 2024-09-19T07:25:16.424 INFO:tasks.workunit.client.0.smithi098.stdout:3/882: stat de/df/d31/d61/d69/cff 0 2024-09-19T07:25:16.429 INFO:tasks.workunit.client.0.smithi098.stdout:3/883: read de/f25 [1313572,107927] 0 2024-09-19T07:25:16.429 INFO:tasks.workunit.client.0.smithi098.stdout:3/884: mknod de/d4e/d6d/d71/df3/c108 0 2024-09-19T07:25:16.430 INFO:tasks.workunit.client.0.smithi098.stdout:3/885: fdatasync de/df/d1f/d2b/f3a 0 2024-09-19T07:25:16.435 INFO:tasks.workunit.client.0.smithi098.stdout:3/886: write de/df/d31/d61/d79/fb5 [579270,50093] 0 2024-09-19T07:25:16.437 INFO:tasks.workunit.client.0.smithi098.stdout:3/887: mkdir de/df/d31/d61/d3f/d64/d109 0 2024-09-19T07:25:16.439 INFO:tasks.workunit.client.0.smithi098.stdout:3/888: symlink de/df/d1f/l10a 0 2024-09-19T07:25:16.464 INFO:tasks.workunit.client.0.smithi098.stdout:3/889: dwrite de/df/d1f/f99 [0,4194304] 0 2024-09-19T07:25:16.465 INFO:tasks.workunit.client.0.smithi098.stdout:3/890: creat de/deb/f10b x:0 0 0 2024-09-19T07:25:16.466 INFO:tasks.workunit.client.0.smithi098.stdout:3/891: mknod de/df/d1f/c10c 0 2024-09-19T07:25:16.467 INFO:tasks.workunit.client.0.smithi098.stdout:3/892: mknod de/df/d1f/d2b/c10d 0 2024-09-19T07:25:16.472 INFO:tasks.workunit.client.0.smithi098.stdout:3/893: write de/df/d31/d61/d69/def/ffe [2276548,126619] 0 2024-09-19T07:25:16.472 INFO:tasks.workunit.client.0.smithi098.stdout:3/894: read - de/df/d1f/fc3 zero size 2024-09-19T07:25:16.473 INFO:tasks.workunit.client.0.smithi098.stdout:3/895: truncate de/df/d31/f3d 1832541 0 2024-09-19T07:25:16.489 INFO:tasks.workunit.client.0.smithi098.stdout:3/896: dwrite de/d4e/d6d/d71/f88 [0,4194304] 0 2024-09-19T07:25:16.489 INFO:tasks.workunit.client.0.smithi098.stdout:3/897: readlink de/d4e/d6d/dad/lcc 0 2024-09-19T07:25:16.492 INFO:tasks.workunit.client.0.smithi098.stdout:3/898: unlink de/df/d1f/d2b/d93/de5/f4a 0 2024-09-19T07:25:16.493 INFO:tasks.workunit.client.0.smithi098.stdout:3/899: fdatasync de/df/d31/d61/d79/fce 0 2024-09-19T07:25:16.494 INFO:tasks.workunit.client.0.smithi098.stdout:3/900: rmdir de/d4e/d6d/d8c/dab 39 2024-09-19T07:25:16.495 INFO:tasks.workunit.client.0.smithi098.stdout:3/901: stat de/df/d1f/d2b/d93/de5/cd3 0 2024-09-19T07:25:16.498 INFO:tasks.workunit.client.0.smithi098.stdout:3/902: rmdir de/df/d1f/d72 39 2024-09-19T07:25:16.500 INFO:tasks.workunit.client.0.smithi098.stdout:3/903: getdents de/df/d31/d61/d79 0 2024-09-19T07:25:16.500 INFO:tasks.workunit.client.0.smithi098.stdout:3/904: dread - de/df/d1f/d2b/df7/ffd zero size 2024-09-19T07:25:16.500 INFO:tasks.workunit.client.0.smithi098.stdout:3/905: truncate de/df/d1f/fa0 36987 0 2024-09-19T07:25:16.500 INFO:tasks.workunit.client.0.smithi098.stdout:3/906: getdents de/deb 0 2024-09-19T07:25:16.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:16 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:25:16.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:16 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:25:16.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:16 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:25:16.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:16 smithi098 ceph-mon[30950]: pgmap v99: 97 pgs: 97 active+clean; 2.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 MiB/s rd, 67 MiB/s wr, 426 op/s 2024-09-19T07:25:16.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:16 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:25:16.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:16 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:25:16.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:16 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:25:16.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:16 smithi139 ceph-mon[35039]: pgmap v99: 97 pgs: 97 active+clean; 2.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 MiB/s rd, 67 MiB/s wr, 426 op/s 2024-09-19T07:25:16.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:16 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:25:16.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:16 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:25:16.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:16 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:25:16.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:16 smithi162 ceph-mon[35726]: pgmap v99: 97 pgs: 97 active+clean; 2.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 MiB/s rd, 67 MiB/s wr, 426 op/s 2024-09-19T07:25:18.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:17 smithi162 ceph-mon[35726]: pgmap v100: 97 pgs: 97 active+clean; 2.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.1 MiB/s wr, 289 op/s 2024-09-19T07:25:18.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:17 smithi098 ceph-mon[30950]: pgmap v100: 97 pgs: 97 active+clean; 2.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.1 MiB/s wr, 289 op/s 2024-09-19T07:25:18.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:17 smithi139 ceph-mon[35039]: pgmap v100: 97 pgs: 97 active+clean; 2.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.1 MiB/s wr, 289 op/s 2024-09-19T07:25:18.480 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T07:25:18.737 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:19.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.193+0000 7ff0d15d7640 1 -- 172.21.15.98:0/1869473752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc101e10 msgr2=0x7ff0cc1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:19.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.193+0000 7ff0d15d7640 1 --2- 172.21.15.98:0/1869473752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc101e10 0x7ff0cc1021f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009900 tx=0x7ff0bc02a410 comp rx=0 tx=0).stop 2024-09-19T07:25:19.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.193+0000 7ff0d15d7640 1 -- 172.21.15.98:0/1869473752 shutdown_connections 2024-09-19T07:25:19.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.193+0000 7ff0d15d7640 1 --2- 172.21.15.98:0/1869473752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0cc106f40 0x7ff0cc10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.193+0000 7ff0d15d7640 1 --2- 172.21.15.98:0/1869473752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0cc1027c0 0x7ff0cc106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.193+0000 7ff0d15d7640 1 --2- 172.21.15.98:0/1869473752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc101e10 0x7ff0cc1021f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.193+0000 7ff0d15d7640 1 -- 172.21.15.98:0/1869473752 >> 172.21.15.98:0/1869473752 conn(0x7ff0cc0fd8d0 msgr2=0x7ff0cc0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.193+0000 7ff0d15d7640 1 -- 172.21.15.98:0/1869473752 shutdown_connections 2024-09-19T07:25:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.193+0000 7ff0d15d7640 1 -- 172.21.15.98:0/1869473752 wait complete. 2024-09-19T07:25:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0d15d7640 1 Processor -- start 2024-09-19T07:25:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0d15d7640 1 -- start start 2024-09-19T07:25:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0d15d7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc101e10 0x7ff0cc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0d15d7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0cc1027c0 0x7ff0cc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0d15d7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0cc106f40 0x7ff0cc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0d15d7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc111fc0 con 0x7ff0cc101e10 2024-09-19T07:25:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0d15d7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc111e40 con 0x7ff0cc1027c0 2024-09-19T07:25:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0d15d7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc112140 con 0x7ff0cc106f40 2024-09-19T07:25:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0caffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc101e10 0x7ff0cc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0caffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc101e10 0x7ff0cc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33850/0 (socket says 172.21.15.98:33850) 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0caffd640 1 -- 172.21.15.98:0/3062054826 learned_addr learned my addr 172.21.15.98:0/3062054826 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0c27fc640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0cc1027c0 0x7ff0cc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.194+0000 7ff0cb7fe640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0cc106f40 0x7ff0cc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.195+0000 7ff0caffd640 1 -- 172.21.15.98:0/3062054826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0cc106f40 msgr2=0x7ff0cc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.195+0000 7ff0caffd640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0cc106f40 0x7ff0cc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.195+0000 7ff0caffd640 1 -- 172.21.15.98:0/3062054826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0cc1027c0 msgr2=0x7ff0cc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.195+0000 7ff0caffd640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0cc1027c0 0x7ff0cc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.195+0000 7ff0caffd640 1 -- 172.21.15.98:0/3062054826 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc1a6940 con 0x7ff0cc101e10 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.195+0000 7ff0cb7fe640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0cc106f40 0x7ff0cc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.195+0000 7ff0caffd640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc101e10 0x7ff0cc0744f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc005ab0 tx=0x7ff0bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.195+0000 7ff0c8ff9640 1 -- 172.21.15.98:0/3062054826 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc03f030 con 0x7ff0cc101e10 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.195+0000 7ff0d15d7640 1 -- 172.21.15.98:0/3062054826 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0cc1a6bd0 con 0x7ff0cc101e10 2024-09-19T07:25:19.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.195+0000 7ff0c8ff9640 1 -- 172.21.15.98:0/3062054826 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0bc003ce0 con 0x7ff0cc101e10 2024-09-19T07:25:19.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.195+0000 7ff0c8ff9640 1 -- 172.21.15.98:0/3062054826 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc035070 con 0x7ff0cc101e10 2024-09-19T07:25:19.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.195+0000 7ff0d15d7640 1 -- 172.21.15.98:0/3062054826 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0cc1a70b0 con 0x7ff0cc101e10 2024-09-19T07:25:19.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.198+0000 7ff0c8ff9640 1 -- 172.21.15.98:0/3062054826 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff0bc042030 con 0x7ff0cc101e10 2024-09-19T07:25:19.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.198+0000 7ff0d39b0740 1 Processor -- start 2024-09-19T07:25:19.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.198+0000 7ff0d39b0740 1 -- start start 2024-09-19T07:25:19.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.198+0000 7ff0d39b0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 0x55a34b6e7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.198+0000 7ff0d39b0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b6f2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.198+0000 7ff0d39b0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6f2680 0x55a34b6f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.198+0000 7ff0d39b0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a34b64d2e0 con 0x55a34b6e74a0 2024-09-19T07:25:19.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.198+0000 7ff0d39b0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a34b5f4ce0 con 0x55a34b6e7dc0 2024-09-19T07:25:19.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.198+0000 7ff0d39b0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a34b6492a0 con 0x55a34b6f2680 2024-09-19T07:25:19.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.198+0000 7ff0cb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 0x55a34b6e7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0cb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 0x55a34b6e7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33858/0 (socket says 172.21.15.98:33858) 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0cb7fe640 1 -- 172.21.15.98:0/1517953600 learned_addr learned my addr 172.21.15.98:0/1517953600 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0caffd640 1 --2- 172.21.15.98:0/1517953600 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b6f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0c27fc640 1 --2- 172.21.15.98:0/1517953600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6f2680 0x55a34b6f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0c8ff9640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff0b80a33b0 0x7ff0b80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0cb7fe640 1 -- 172.21.15.98:0/1517953600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6f2680 msgr2=0x55a34b6f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0cb7fe640 1 --2- 172.21.15.98:0/1517953600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6f2680 0x55a34b6f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0cb7fe640 1 -- 172.21.15.98:0/1517953600 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 msgr2=0x55a34b6f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0cb7fe640 1 --2- 172.21.15.98:0/1517953600 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b6f2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0cb7fe640 1 -- 172.21.15.98:0/1517953600 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a34b5d9440 con 0x55a34b6e74a0 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0c27fc640 1 --2- 172.21.15.98:0/1517953600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6f2680 0x55a34b6f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0c8ff9640 1 -- 172.21.15.98:0/3062054826 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7ff0bc0f0660 con 0x7ff0cc101e10 2024-09-19T07:25:19.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0cb7fe640 1 --2- 172.21.15.98:0/1517953600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 0x55a34b6e7880 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400c450 tx=0x7ff0c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb6291499afb847 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0cb7fe640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff0b80a33b0 0x7ff0b80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0c17fa640 1 -- 172.21.15.98:0/1517953600 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400c270 con 0x55a34b6e74a0 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0c17fa640 1 -- 172.21.15.98:0/1517953600 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0c401d040 con 0x55a34b6e74a0 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.199+0000 7ff0c17fa640 1 -- 172.21.15.98:0/1517953600 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c400a600 con 0x55a34b6e74a0 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.200+0000 7ff0d39b0740 1 -- 172.21.15.98:0/1517953600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 msgr2=0x55a34b6e7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.200+0000 7ff0cb7fe640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff0b80a33b0 0x7ff0b80a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4017000 tx=0x7ff0c400ad20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.200+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/1517953600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 0x55a34b6e7880 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff0c400c450 tx=0x7ff0c400c910 comp rx=0 tx=0).stop 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.200+0000 7ff0d39b0740 1 -- 172.21.15.98:0/1517953600 shutdown_connections 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.200+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/1517953600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6f2680 0x55a34b6f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.200+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/1517953600 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b6f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.200+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/1517953600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 0x55a34b6e7880 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.200+0000 7ff0d39b0740 1 -- 172.21.15.98:0/1517953600 >> 172.21.15.98:0/1517953600 conn(0x55a34b6e3a30 msgr2=0x55a34b6e3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.200+0000 7ff0d39b0740 1 -- 172.21.15.98:0/1517953600 shutdown_connections 2024-09-19T07:25:19.211 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.200+0000 7ff0d39b0740 1 -- 172.21.15.98:0/1517953600 wait complete. 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.200+0000 7ff0d39b0740 1 -- start start 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0d39b0740 1 Processor -- start 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0d39b0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e74a0 0x55a34b6f1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0d39b0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b6ef1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0d39b0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6f2680 0x55a34b6ef710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0d39b0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a34b6f5250 con 0x55a34b6f2680 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0d39b0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a34b608050 con 0x55a34b6e7dc0 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0d39b0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a34b6f53d0 con 0x55a34b6e74a0 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0d39b0740 10 client.0 _ll_register_callbacks cb 0x55a34b648160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0cb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6f2680 0x55a34b6ef710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0cb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6f2680 0x55a34b6ef710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33872/0 (socket says 172.21.15.98:33872) 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0cb7fe640 1 -- 172.21.15.98:0/3732959292 learned_addr learned my addr 172.21.15.98:0/3732959292 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:19.212 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0caffd640 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e74a0 0x55a34b6f1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0c27fc640 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b6ef1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0cb7fe640 1 -- 172.21.15.98:0/3732959292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e74a0 msgr2=0x55a34b6f1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0cb7fe640 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e74a0 0x55a34b6f1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0cb7fe640 1 -- 172.21.15.98:0/3732959292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 msgr2=0x55a34b6ef1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0cb7fe640 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b6ef1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0cb7fe640 1 -- 172.21.15.98:0/3732959292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34b3be3c0 con 0x55a34b6f2680 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0caffd640 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e74a0 0x55a34b6f1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0cb7fe640 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6f2680 0x55a34b6ef710 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4017910 tx=0x7ff0c4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ec522aae5c2b02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.201+0000 7ff0b27fc640 1 -- 172.21.15.98:0/3732959292 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c401c050 con 0x55a34b6f2680 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0b27fc640 1 -- 172.21.15.98:0/3732959292 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7ff0c402a070 con 0x55a34b6f2680 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3732959292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0c401d040 con 0x55a34b6f2680 2024-09-19T07:25:19.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0b27fc640 1 -- 172.21.15.98:0/3732959292 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff0c403b050 con 0x55a34b6f2680 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0d39b0740 10 client.16251 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3732959292 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a34b700ae0 con 0x55a34b6f2680 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0b27fc640 1 -- 172.21.15.98:0/3732959292 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0c401d040 con 0x55a34b6f2680 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0b27fc640 1 -- 172.21.15.98:0/3732959292 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ff0c4007800 con 0x55a34b6f2680 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0d39b0740 10 client.16251 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0d39b0740 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0d39b0740 20 client.16251 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a34b701f40 0x55a34b704330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0d39b0740 4 client.16251 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3732959292 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a34b65a850 con 0x55a34b701f40 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.202+0000 7ff0caffd640 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a34b701f40 0x55a34b704330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.203+0000 7ff0caffd640 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a34b701f40 0x55a34b704330 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2ead36fe21739af server_cookie=910c22f72368e0b9 in_seq=0 out_seq=0 2024-09-19T07:25:19.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.203+0000 7ff0b27fc640 10 client.16251 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.203+0000 7ff0b27fc640 1 -- 172.21.15.98:0/3732959292 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a34b65a850 con 0x55a34b701f40 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.203+0000 7ff0b27fc640 10 client.16251 handle_command_reply: tid=0 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.203+0000 7ff0d39b0740 1 client.16251 shutdown 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.204+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3732959292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6f2680 msgr2=0x55a34b6ef710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.204+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6f2680 0x55a34b6ef710 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4017910 tx=0x7ff0c4018000 comp rx=0 tx=0).stop 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.204+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3732959292 shutdown_connections 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.204+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a34b701f40 0x55a34b704330 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.204+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6f2680 0x55a34b6ef710 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.204+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b6ef1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.204+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/3732959292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e74a0 0x55a34b6f1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.204+0000 7ff0b27fc640 0 client.16251 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.204+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3732959292 >> 172.21.15.98:0/3732959292 conn(0x55a34b6e3a30 msgr2=0x55a34b6e9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:19.215 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.204+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3732959292 shutdown_connections 2024-09-19T07:25:19.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.204+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3732959292 wait complete. 2024-09-19T07:25:19.216 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.204+0000 7ff0d39b0740 20 client.16251 trim_cache size 0 max 16384 2024-09-19T07:25:19.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0d39b0740 1 Processor -- start 2024-09-19T07:25:19.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0d39b0740 1 -- start start 2024-09-19T07:25:19.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0d39b0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e3a30 0x55a34b6f1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0d39b0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e74a0 0x55a34b709a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0d39b0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b709f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0d39b0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1b24e0 con 0x55a34b6e3a30 2024-09-19T07:25:19.226 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0d39b0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1afcf0 con 0x55a34b6e7dc0 2024-09-19T07:25:19.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0d39b0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1adb40 con 0x55a34b6e74a0 2024-09-19T07:25:19.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0caffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e3a30 0x55a34b6f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0caffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e3a30 0x55a34b6f1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33886/0 (socket says 172.21.15.98:33886) 2024-09-19T07:25:19.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0caffd640 1 -- 172.21.15.98:0/1037058445 learned_addr learned my addr 172.21.15.98:0/1037058445 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:19.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0c27fc640 1 --2- 172.21.15.98:0/1037058445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e74a0 0x55a34b709a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0cb7fe640 1 --2- 172.21.15.98:0/1037058445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b709f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0caffd640 1 -- 172.21.15.98:0/1037058445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e74a0 msgr2=0x55a34b709a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:19.227 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0caffd640 1 --2- 172.21.15.98:0/1037058445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e74a0 0x55a34b709a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0caffd640 1 -- 172.21.15.98:0/1037058445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 msgr2=0x55a34b709f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:19.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0caffd640 1 --2- 172.21.15.98:0/1037058445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b709f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0caffd640 1 -- 172.21.15.98:0/1037058445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a34b6e3860 con 0x55a34b6e3a30 2024-09-19T07:25:19.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0c27fc640 1 --2- 172.21.15.98:0/1037058445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e74a0 0x55a34b709a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:19.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.221+0000 7ff0cb7fe640 1 --2- 172.21.15.98:0/1037058445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b709f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:19.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.222+0000 7ff0caffd640 1 --2- 172.21.15.98:0/1037058445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e3a30 0x55a34b6f1140 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0ee380 tx=0x7ff0bc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c378a33d3c6abfa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:19.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.222+0000 7ff0c0ff9640 1 -- 172.21.15.98:0/1037058445 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc049040 con 0x55a34b6e3a30 2024-09-19T07:25:19.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.222+0000 7ff0c0ff9640 1 -- 172.21.15.98:0/1037058445 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0bc0a70c0 con 0x55a34b6e3a30 2024-09-19T07:25:19.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.222+0000 7ff0c0ff9640 1 -- 172.21.15.98:0/1037058445 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0b8f80 con 0x55a34b6e3a30 2024-09-19T07:25:19.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.222+0000 7ff0d39b0740 1 -- 172.21.15.98:0/1037058445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e3a30 msgr2=0x55a34b6f1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:19.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.222+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/1037058445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e3a30 0x55a34b6f1140 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0ee380 tx=0x7ff0bc02a410 comp rx=0 tx=0).stop 2024-09-19T07:25:19.228 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.222+0000 7ff0d39b0740 1 -- 172.21.15.98:0/1037058445 shutdown_connections 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.222+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/1037058445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b709f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.222+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/1037058445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e74a0 0x55a34b709a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.222+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/1037058445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e3a30 0x55a34b6f1140 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.222+0000 7ff0d39b0740 1 -- 172.21.15.98:0/1037058445 >> 172.21.15.98:0/1037058445 conn(0x55a34b6ef870 msgr2=0x55a34b6f0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0d39b0740 1 -- 172.21.15.98:0/1037058445 shutdown_connections 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0d39b0740 1 -- 172.21.15.98:0/1037058445 wait complete. 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0d39b0740 1 -- start start 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0d39b0740 1 Processor -- start 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0d39b0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e3a30 0x55a34b6f86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0d39b0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 0x55a34b6f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0d39b0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b6f9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0d39b0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1ae1b0 con 0x55a34b6e74a0 2024-09-19T07:25:19.229 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0d39b0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1af620 con 0x55a34b6e7dc0 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0d39b0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1ae880 con 0x55a34b6e3a30 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0d39b0740 10 client.0 _ll_register_callbacks cb 0x7ff0c4009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0c27fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 0x55a34b6f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0c27fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 0x55a34b6f8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33892/0 (socket says 172.21.15.98:33892) 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0c27fc640 1 -- 172.21.15.98:0/3583843655 learned_addr learned my addr 172.21.15.98:0/3583843655 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.223+0000 7ff0caffd640 1 --2- 172.21.15.98:0/3583843655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e3a30 0x55a34b6f86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0c27fc640 1 -- 172.21.15.98:0/3583843655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e3a30 msgr2=0x55a34b6f86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0c27fc640 1 --2- 172.21.15.98:0/3583843655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e3a30 0x55a34b6f86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0c27fc640 1 -- 172.21.15.98:0/3583843655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 msgr2=0x55a34b6f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0c27fc640 1 --2- 172.21.15.98:0/3583843655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b6f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0c27fc640 1 -- 172.21.15.98:0/3583843655 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34b6e46c0 con 0x55a34b6e74a0 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0c27fc640 1 --2- 172.21.15.98:0/3583843655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 0x55a34b6f8be0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55a34b6e4db0 tx=0x7ff0b400fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da134b43691abc31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:19.230 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0b27fc640 1 -- 172.21.15.98:0/3583843655 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b40128a0 con 0x55a34b6e74a0 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0b27fc640 1 -- 172.21.15.98:0/3583843655 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7ff0b4012a40 con 0x55a34b6e74a0 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3583843655 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0bc0a70c0 con 0x55a34b6e74a0 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0b27fc640 1 -- 172.21.15.98:0/3583843655 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff0b4012c40 con 0x55a34b6e74a0 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0d39b0740 10 client.16257 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3583843655 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55a34b6e8330 con 0x55a34b6e74a0 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0b27fc640 1 -- 172.21.15.98:0/3583843655 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0bc0a70c0 con 0x55a34b6e74a0 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0b27fc640 1 -- 172.21.15.98:0/3583843655 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7ff0b40104f0 con 0x55a34b6e74a0 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0d39b0740 10 client.16257 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0d39b0740 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.224+0000 7ff0d39b0740 20 client.16257 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/3583843655 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a34b6f2680 0x55a34b76f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:19.231 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0d39b0740 4 client.16257 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3583843655 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a34b654d60 con 0x55a34b6f2680 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0caffd640 1 --2- 172.21.15.98:0/3583843655 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a34b6f2680 0x55a34b76f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0caffd640 1 --2- 172.21.15.98:0/3583843655 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a34b6f2680 0x55a34b76f530 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e79e9b021d2e944c server_cookie=3974b1c9d2b680a0 in_seq=0 out_seq=0 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0b27fc640 10 client.16257 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0b27fc640 1 -- 172.21.15.98:0/3583843655 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a34b654d60 con 0x55a34b6f2680 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0b27fc640 10 client.16257 handle_command_reply: tid=0 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0d39b0740 1 client.16257 shutdown 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3583843655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 msgr2=0x55a34b6f8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/3583843655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 0x55a34b6f8be0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55a34b6e4db0 tx=0x7ff0b400fb30 comp rx=0 tx=0).stop 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3583843655 shutdown_connections 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/3583843655 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a34b6e7dc0 0x55a34b6f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/3583843655 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55a34b6f2680 0x55a34b76f530 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/3583843655 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a34b6e74a0 0x55a34b6f8be0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0d39b0740 1 --2- 172.21.15.98:0/3583843655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a34b6e3a30 0x55a34b6f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0b27fc640 0 client.16257 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:19.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.225+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3583843655 >> 172.21.15.98:0/3583843655 conn(0x55a34b6ef870 msgr2=0x55a34b6ed660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:19.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3583843655 shutdown_connections 2024-09-19T07:25:19.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d39b0740 1 -- 172.21.15.98:0/3583843655 wait complete. 2024-09-19T07:25:19.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d39b0740 20 client.16257 trim_cache size 0 max 16384 2024-09-19T07:25:19.233 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:25:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: "status": "no active scrubs running", 2024-09-19T07:25:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: "scrubs": {} 2024-09-19T07:25:19.234 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:25:19.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d15d7640 1 -- 172.21.15.98:0/3062054826 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff0b80a33b0 msgr2=0x7ff0b80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:19.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d15d7640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff0b80a33b0 0x7ff0b80a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4017000 tx=0x7ff0c400ad20 comp rx=0 tx=0).stop 2024-09-19T07:25:19.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d15d7640 1 -- 172.21.15.98:0/3062054826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc101e10 msgr2=0x7ff0cc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:19.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d15d7640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc101e10 0x7ff0cc0744f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc005ab0 tx=0x7ff0bc0042f0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d15d7640 1 -- 172.21.15.98:0/3062054826 shutdown_connections 2024-09-19T07:25:19.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d15d7640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7ff0b80a33b0 0x7ff0b80a5870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d15d7640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0cc106f40 0x7ff0cc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d15d7640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff0cc1027c0 0x7ff0cc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d15d7640 1 --2- 172.21.15.98:0/3062054826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc101e10 0x7ff0cc0744f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:19.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d15d7640 1 -- 172.21.15.98:0/3062054826 >> 172.21.15.98:0/3062054826 conn(0x7ff0cc0fd8d0 msgr2=0x7ff0cc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:19.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d15d7640 1 -- 172.21.15.98:0/3062054826 shutdown_connections 2024-09-19T07:25:19.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:19.226+0000 7ff0d15d7640 1 -- 172.21.15.98:0/3062054826 wait complete. 2024-09-19T07:25:20.046 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T07:25:20.046 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:25:20.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:19 smithi162 ceph-mon[35726]: pgmap v101: 97 pgs: 97 active+clean; 2.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 315 op/s 2024-09-19T07:25:20.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:19 smithi098 ceph-mon[30950]: pgmap v101: 97 pgs: 97 active+clean; 2.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 315 op/s 2024-09-19T07:25:20.290 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:20.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:19 smithi139 ceph-mon[35039]: pgmap v101: 97 pgs: 97 active+clean; 2.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 315 op/s 2024-09-19T07:25:20.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.774+0000 7f28951b6640 1 -- 172.21.15.98:0/4126720567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2890100a80 msgr2=0x7f2890100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:20.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.774+0000 7f28951b6640 1 --2- 172.21.15.98:0/4126720567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2890100a80 0x7f2890100ee0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2880009930 tx=0x7f288002a420 comp rx=0 tx=0).stop 2024-09-19T07:25:20.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.774+0000 7f28951b6640 1 -- 172.21.15.98:0/4126720567 shutdown_connections 2024-09-19T07:25:20.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.774+0000 7f28951b6640 1 --2- 172.21.15.98:0/4126720567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2890101420 0x7f289010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:20.797 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.774+0000 7f28951b6640 1 --2- 172.21.15.98:0/4126720567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2890100a80 0x7f2890100ee0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.774+0000 7f28951b6640 1 --2- 172.21.15.98:0/4126720567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2890106a80 0x7f2890106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.774+0000 7f28951b6640 1 -- 172.21.15.98:0/4126720567 >> 172.21.15.98:0/4126720567 conn(0x7f28900fc7a0 msgr2=0x7f28900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.774+0000 7f28951b6640 1 -- 172.21.15.98:0/4126720567 shutdown_connections 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.774+0000 7f28951b6640 1 -- 172.21.15.98:0/4126720567 wait complete. 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.775+0000 7f28951b6640 1 Processor -- start 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.775+0000 7f28951b6640 1 -- start start 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.775+0000 7f28951b6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2890100a80 0x7f28901972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.775+0000 7f28951b6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2890101420 0x7f2890197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.775+0000 7f28951b6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2890106a80 0x7f289019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.775+0000 7f28951b6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2890110e40 con 0x7f2890100a80 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.775+0000 7f28951b6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2890110cc0 con 0x7f2890106a80 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.775+0000 7f28951b6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2890110fc0 con 0x7f2890101420 2024-09-19T07:25:20.798 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.775+0000 7f288ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2890100a80 0x7f28901972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.775+0000 7f288ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2890100a80 0x7f28901972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33920/0 (socket says 172.21.15.98:33920) 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.775+0000 7f288ed9d640 1 -- 172.21.15.98:0/1319594161 learned_addr learned my addr 172.21.15.98:0/1319594161 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.776+0000 7f288ed9d640 1 -- 172.21.15.98:0/1319594161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2890101420 msgr2=0x7f2890197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.776+0000 7f288e59c640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2890101420 0x7f2890197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.776+0000 7f288ed9d640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2890101420 0x7f2890197820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.776+0000 7f288ed9d640 1 -- 172.21.15.98:0/1319594161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2890106a80 msgr2=0x7f289019bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.776+0000 7f288ed9d640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2890106a80 0x7f289019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.776+0000 7f288ed9d640 1 -- 172.21.15.98:0/1319594161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289019c290 con 0x7f2890100a80 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.776+0000 7f288ed9d640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2890100a80 0x7f28901972e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f287800c920 tx=0x7f287800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.776+0000 7f2887fff640 1 -- 172.21.15.98:0/1319594161 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878007c70 con 0x7f2890100a80 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.776+0000 7f28951b6640 1 -- 172.21.15.98:0/1319594161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289019c580 con 0x7f2890100a80 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.776+0000 7f2887fff640 1 -- 172.21.15.98:0/1319594161 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2878007e10 con 0x7f2890100a80 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.776+0000 7f28951b6640 1 -- 172.21.15.98:0/1319594161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28901a3e60 con 0x7f2890100a80 2024-09-19T07:25:20.799 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.776+0000 7f2887fff640 1 -- 172.21.15.98:0/1319594161 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2878005260 con 0x7f2890100a80 2024-09-19T07:25:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.777+0000 7f28951b6640 1 -- 172.21.15.98:0/1319594161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2890100ee0 con 0x7f2890100a80 2024-09-19T07:25:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.778+0000 7f2887fff640 1 -- 172.21.15.98:0/1319594161 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2878005400 con 0x7f2890100a80 2024-09-19T07:25:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.779+0000 7f2887fff640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f287c0a33b0 0x7f287c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.779+0000 7f288e59c640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f287c0a33b0 0x7f287c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.779+0000 7f2887fff640 1 -- 172.21.15.98:0/1319594161 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f28780d0020 con 0x7f2890100a80 2024-09-19T07:25:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.779+0000 7f288e59c640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f287c0a33b0 0x7f287c0a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28800096c0 tx=0x7f2880000bc0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:20.800 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.782+0000 7f2887fff640 1 -- 172.21.15.98:0/1319594161 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2878014030 con 0x7f2890100a80 2024-09-19T07:25:20.984 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.984+0000 7f28951b6640 1 -- 172.21.15.98:0/1319594161 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2890198640 con 0x7f2890100a80 2024-09-19T07:25:20.985 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.984+0000 7f2887fff640 1 -- 172.21.15.98:0/1319594161 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11928 (secure 0 0 0) 0x7f287801f300 con 0x7f2890100a80 2024-09-19T07:25:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:25:20.985 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"btime":"2024-09-19T07:24:57:508846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:24:56.977446+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":73,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":74,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:25:20.986 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2024-09-19T07:25:20.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.986+0000 7f28951b6640 1 -- 172.21.15.98:0/1319594161 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f287c0a33b0 msgr2=0x7f287c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:20.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.986+0000 7f28951b6640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f287c0a33b0 0x7f287c0a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f28800096c0 tx=0x7f2880000bc0 comp rx=0 tx=0).stop 2024-09-19T07:25:20.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.986+0000 7f28951b6640 1 -- 172.21.15.98:0/1319594161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2890100a80 msgr2=0x7f28901972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:20.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.986+0000 7f28951b6640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2890100a80 0x7f28901972e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f287800c920 tx=0x7f287800cde0 comp rx=0 tx=0).stop 2024-09-19T07:25:20.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.986+0000 7f28951b6640 1 -- 172.21.15.98:0/1319594161 shutdown_connections 2024-09-19T07:25:20.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.986+0000 7f28951b6640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f287c0a33b0 0x7f287c0a5870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:20.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.986+0000 7f28951b6640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2890106a80 0x7f289019bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:20.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.986+0000 7f28951b6640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2890101420 0x7f2890197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:20.987 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.986+0000 7f28951b6640 1 --2- 172.21.15.98:0/1319594161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2890100a80 0x7f28901972e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:20.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.987+0000 7f28951b6640 1 -- 172.21.15.98:0/1319594161 >> 172.21.15.98:0/1319594161 conn(0x7f28900fc7a0 msgr2=0x7f28900fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:20.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.987+0000 7f28951b6640 1 -- 172.21.15.98:0/1319594161 shutdown_connections 2024-09-19T07:25:20.988 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:20.987+0000 7f28951b6640 1 -- 172.21.15.98:0/1319594161 wait complete. 2024-09-19T07:25:21.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:21 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1319594161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:21.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:21 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1319594161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:21.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:21 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1319594161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:21.620 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T07:25:21.865 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:22.246 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:22 smithi098 ceph-mon[30950]: pgmap v102: 97 pgs: 97 active+clean; 2.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 40 op/s 2024-09-19T07:25:22.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:22 smithi139 ceph-mon[35039]: pgmap v102: 97 pgs: 97 active+clean; 2.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 40 op/s 2024-09-19T07:25:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.327+0000 7fb174261640 1 -- 172.21.15.98:0/406241005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb16c102ef0 msgr2=0x7fb16c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.327+0000 7fb174261640 1 --2- 172.21.15.98:0/406241005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb16c102ef0 0x7fb16c10da40 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb164009ca0 tx=0x7fb16402a950 comp rx=0 tx=0).stop 2024-09-19T07:25:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.327+0000 7fb174261640 1 -- 172.21.15.98:0/406241005 shutdown_connections 2024-09-19T07:25:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.327+0000 7fb174261640 1 --2- 172.21.15.98:0/406241005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb16c102ef0 0x7fb16c10da40 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.327+0000 7fb174261640 1 --2- 172.21.15.98:0/406241005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c102570 0x7fb16c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.327+0000 7fb174261640 1 --2- 172.21.15.98:0/406241005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb16c100e20 0x7fb16c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.327+0000 7fb174261640 1 -- 172.21.15.98:0/406241005 >> 172.21.15.98:0/406241005 conn(0x7fb16c0fc7d0 msgr2=0x7fb16c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.327+0000 7fb174261640 1 -- 172.21.15.98:0/406241005 shutdown_connections 2024-09-19T07:25:22.328 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.327+0000 7fb174261640 1 -- 172.21.15.98:0/406241005 wait complete. 2024-09-19T07:25:22.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.328+0000 7fb174261640 1 Processor -- start 2024-09-19T07:25:22.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.328+0000 7fb174261640 1 -- start start 2024-09-19T07:25:22.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.328+0000 7fb174261640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c100e20 0x7fb16c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.328+0000 7fb174261640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb16c102570 0x7fb16c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.328+0000 7fb174261640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb16c102ef0 0x7fb16c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.328+0000 7fb174261640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c110f80 con 0x7fb16c102ef0 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.328+0000 7fb174261640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c110e00 con 0x7fb16c102570 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.328+0000 7fb174261640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c111100 con 0x7fb16c100e20 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.328+0000 7fb1727fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb16c102ef0 0x7fb16c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.328+0000 7fb1727fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb16c102ef0 0x7fb16c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33932/0 (socket says 172.21.15.98:33932) 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.328+0000 7fb1727fe640 1 -- 172.21.15.98:0/1070846809 learned_addr learned my addr 172.21.15.98:0/1070846809 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb171ffd640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c100e20 0x7fb16c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb1717fc640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb16c102570 0x7fb16c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb1727fe640 1 -- 172.21.15.98:0/1070846809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c100e20 msgr2=0x7fb16c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb1727fe640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c100e20 0x7fb16c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb1727fe640 1 -- 172.21.15.98:0/1070846809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb16c102570 msgr2=0x7fb16c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb1727fe640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb16c102570 0x7fb16c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb1727fe640 1 -- 172.21.15.98:0/1070846809 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16c1a68b0 con 0x7fb16c102ef0 2024-09-19T07:25:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb171ffd640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c100e20 0x7fb16c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb1727fe640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb16c102ef0 0x7fb16c0fd700 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb164006010 tx=0x7fb16402f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb162ffd640 1 -- 172.21.15.98:0/1070846809 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164034040 con 0x7fb16c102ef0 2024-09-19T07:25:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb162ffd640 1 -- 172.21.15.98:0/1070846809 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb164003e00 con 0x7fb16c102ef0 2024-09-19T07:25:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb174261640 1 -- 172.21.15.98:0/1070846809 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c1a6b40 con 0x7fb16c102ef0 2024-09-19T07:25:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb162ffd640 1 -- 172.21.15.98:0/1070846809 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb164045480 con 0x7fb16c102ef0 2024-09-19T07:25:22.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.329+0000 7fb174261640 1 -- 172.21.15.98:0/1070846809 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16c1a7020 con 0x7fb16c102ef0 2024-09-19T07:25:22.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.332+0000 7fb162ffd640 1 -- 172.21.15.98:0/1070846809 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb164037020 con 0x7fb16c102ef0 2024-09-19T07:25:22.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.332+0000 7fb17663a740 1 Processor -- start 2024-09-19T07:25:22.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.332+0000 7fb17663a740 1 -- start start 2024-09-19T07:25:22.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb17663a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0fb40 0x558669d0e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb17663a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0e5d0 0x558669d0ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb17663a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d19370 0x558669d1b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb17663a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558669c742f0 con 0x558669d0fb40 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb17663a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558669c1bcf0 con 0x558669d0e5d0 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb17663a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558669c702b0 con 0x558669d19370 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb1717fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0fb40 0x558669d0e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb1717fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0fb40 0x558669d0e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33944/0 (socket says 172.21.15.98:33944) 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb1717fc640 1 -- 172.21.15.98:0/4053912092 learned_addr learned my addr 172.21.15.98:0/4053912092 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb171ffd640 1 --2- 172.21.15.98:0/4053912092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0e5d0 0x558669d0ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb1717fc640 1 --2- 172.21.15.98:0/4053912092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d19370 0x558669d1b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb162ffd640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb1580a33b0 0x7fb1580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb1717fc640 1 -- 172.21.15.98:0/4053912092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d19370 msgr2=0x558669d1b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb1717fc640 1 --2- 172.21.15.98:0/4053912092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d19370 0x558669d1b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb1717fc640 1 -- 172.21.15.98:0/4053912092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0e5d0 msgr2=0x558669d0ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:22.335 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb1717fc640 1 --2- 172.21.15.98:0/4053912092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0e5d0 0x558669d0ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb1717fc640 1 -- 172.21.15.98:0/4053912092 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558669c003a0 con 0x558669d0fb40 2024-09-19T07:25:22.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb171ffd640 1 --2- 172.21.15.98:0/4053912092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0e5d0 0x558669d0ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:22.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb1727fe640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb1580a33b0 0x7fb1580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb1717fc640 1 --2- 172.21.15.98:0/4053912092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0fb40 0x558669d0e090 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00cf90 tx=0x7fb15c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279583eff3bc9f47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:22.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.333+0000 7fb162ffd640 1 -- 172.21.15.98:0/1070846809 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb1640f0e40 con 0x7fb16c102ef0 2024-09-19T07:25:22.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.334+0000 7fb157fff640 1 -- 172.21.15.98:0/4053912092 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c018030 con 0x558669d0fb40 2024-09-19T07:25:22.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.334+0000 7fb157fff640 1 -- 172.21.15.98:0/4053912092 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c012b40 con 0x558669d0fb40 2024-09-19T07:25:22.336 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.334+0000 7fb157fff640 1 -- 172.21.15.98:0/4053912092 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00e9d0 con 0x558669d0fb40 2024-09-19T07:25:22.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.334+0000 7fb17663a740 1 -- 172.21.15.98:0/4053912092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0fb40 msgr2=0x558669d0e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:22.344 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.334+0000 7fb1727fe640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb1580a33b0 0x7fb1580a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1640ee720 tx=0x7fb1640e9040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:22.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.334+0000 7fb17663a740 1 --2- 172.21.15.98:0/4053912092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0fb40 0x558669d0e090 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00cf90 tx=0x7fb15c00c520 comp rx=0 tx=0).stop 2024-09-19T07:25:22.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.334+0000 7fb17663a740 1 -- 172.21.15.98:0/4053912092 shutdown_connections 2024-09-19T07:25:22.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.334+0000 7fb17663a740 1 --2- 172.21.15.98:0/4053912092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d19370 0x558669d1b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.334+0000 7fb17663a740 1 --2- 172.21.15.98:0/4053912092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0e5d0 0x558669d0ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.334+0000 7fb17663a740 1 --2- 172.21.15.98:0/4053912092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0fb40 0x558669d0e090 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.334+0000 7fb17663a740 1 -- 172.21.15.98:0/4053912092 >> 172.21.15.98:0/4053912092 conn(0x558669cd7310 msgr2=0x558669d0ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:22.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.335+0000 7fb17663a740 1 -- 172.21.15.98:0/4053912092 shutdown_connections 2024-09-19T07:25:22.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.335+0000 7fb17663a740 1 -- 172.21.15.98:0/4053912092 wait complete. 2024-09-19T07:25:22.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.335+0000 7fb17663a740 1 -- start start 2024-09-19T07:25:22.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.335+0000 7fb17663a740 1 Processor -- start 2024-09-19T07:25:22.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.335+0000 7fb17663a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0e5d0 0x558669d18d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.335+0000 7fb17663a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d0fb40 0x558669d16000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.335+0000 7fb17663a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 0x558669d165d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.335+0000 7fb17663a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558669d1c070 con 0x558669d19370 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.335+0000 7fb17663a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558669c2f060 con 0x558669d0e5d0 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.335+0000 7fb17663a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558669d1c1f0 con 0x558669d0fb40 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.335+0000 7fb17663a740 10 client.0 _ll_register_callbacks cb 0x5586699828c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1717fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 0x558669d165d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1717fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 0x558669d165d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33958/0 (socket says 172.21.15.98:33958) 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1717fc640 1 -- 172.21.15.98:0/722233171 learned_addr learned my addr 172.21.15.98:0/722233171 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1717fc640 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0e5d0 0x558669d18d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb171ffd640 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d0fb40 0x558669d16000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1717fc640 1 -- 172.21.15.98:0/722233171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d0fb40 msgr2=0x558669d16000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1717fc640 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d0fb40 0x558669d16000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1717fc640 1 -- 172.21.15.98:0/722233171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0e5d0 msgr2=0x558669d18d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1717fc640 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0e5d0 0x558669d18d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1717fc640 1 -- 172.21.15.98:0/722233171 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586699e53c0 con 0x558669d19370 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb171ffd640 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d0fb40 0x558669d16000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1717fc640 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 0x558669d165d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00c4f0 tx=0x7fb15c00e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7b21cbb3e4efe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1557fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1557fa640 1 -- 172.21.15.98:0/722233171 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c018040 con 0x558669d19370 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1557fa640 1 -- 172.21.15.98:0/722233171 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb15c00e750 con 0x558669d19370 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb17663a740 1 -- 172.21.15.98:0/722233171 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb15c012b40 con 0x558669d19370 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb1557fa640 1 -- 172.21.15.98:0/722233171 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb15c00e3e0 con 0x558669d19370 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb17663a740 10 client.16275 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.336+0000 7fb17663a740 1 -- 172.21.15.98:0/722233171 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558669d27b20 con 0x558669d19370 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.337+0000 7fb1557fa640 1 -- 172.21.15.98:0/722233171 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c012b40 con 0x558669d19370 2024-09-19T07:25:22.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.337+0000 7fb1557fa640 1 -- 172.21.15.98:0/722233171 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb15c01d8d0 con 0x558669d19370 2024-09-19T07:25:22.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.337+0000 7fb17663a740 10 client.16275 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:22.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.337+0000 7fb17663a740 10 client.16275 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T07:25:22.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.337+0000 7fb17663a740 20 client.16275 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:22.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.337+0000 7fb17663a740 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x558669d28e70 0x558669d2b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.337+0000 7fb17663a740 4 client.16275 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:22.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.337+0000 7fb17663a740 1 -- 172.21.15.98:0/722233171 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558669c81860 con 0x558669d28e70 2024-09-19T07:25:22.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.337+0000 7fb171ffd640 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x558669d28e70 0x558669d2b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.338+0000 7fb171ffd640 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x558669d28e70 0x558669d2b260 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ab3e0d36c0b57218 server_cookie=f7ecf018e95e02ac in_seq=0 out_seq=0 2024-09-19T07:25:22.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.338+0000 7fb1557fa640 10 client.16275 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:25:22.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.338+0000 7fb1557fa640 1 -- 172.21.15.98:0/722233171 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558669c81860 con 0x558669d28e70 2024-09-19T07:25:22.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.338+0000 7fb1557fa640 10 client.16275 handle_command_reply: tid=0 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.338+0000 7fb17663a740 1 client.16275 shutdown 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.339+0000 7fb17663a740 1 -- 172.21.15.98:0/722233171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 msgr2=0x558669d165d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.339+0000 7fb17663a740 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 0x558669d165d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00c4f0 tx=0x7fb15c00e670 comp rx=0 tx=0).stop 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.339+0000 7fb17663a740 1 -- 172.21.15.98:0/722233171 shutdown_connections 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.339+0000 7fb17663a740 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 0x558669d165d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.339+0000 7fb17663a740 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x558669d28e70 0x558669d2b260 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.339+0000 7fb17663a740 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d0fb40 0x558669d16000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.339+0000 7fb17663a740 1 --2- 172.21.15.98:0/722233171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0e5d0 0x558669d18d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.339+0000 7fb1557fa640 0 client.16275 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.339+0000 7fb17663a740 1 -- 172.21.15.98:0/722233171 >> 172.21.15.98:0/722233171 conn(0x558669cd7310 msgr2=0x558669d10930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.339+0000 7fb17663a740 1 -- 172.21.15.98:0/722233171 shutdown_connections 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.339+0000 7fb17663a740 1 -- 172.21.15.98:0/722233171 wait complete. 2024-09-19T07:25:22.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.339+0000 7fb17663a740 20 client.16275 trim_cache size 0 max 16384 2024-09-19T07:25:22.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.351+0000 7fb17663a740 1 Processor -- start 2024-09-19T07:25:22.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.351+0000 7fb17663a740 1 -- start start 2024-09-19T07:25:22.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb17663a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0e5d0 0x558669d25340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb17663a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0fb40 0x558669d148d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb17663a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d19370 0x558669d14e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb17663a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1b2330 con 0x558669d0e5d0 2024-09-19T07:25:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb17663a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1afb40 con 0x558669d0fb40 2024-09-19T07:25:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb17663a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1ad990 con 0x558669d19370 2024-09-19T07:25:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb1717fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0e5d0 0x558669d25340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb1717fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0e5d0 0x558669d25340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33972/0 (socket says 172.21.15.98:33972) 2024-09-19T07:25:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb1717fc640 1 -- 172.21.15.98:0/3450103339 learned_addr learned my addr 172.21.15.98:0/3450103339 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:22.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb1717fc640 1 -- 172.21.15.98:0/3450103339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d19370 msgr2=0x558669d14e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T07:25:22.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb171ffd640 1 --2- 172.21.15.98:0/3450103339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0fb40 0x558669d148d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb1717fc640 1 --2- 172.21.15.98:0/3450103339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d19370 0x558669d14e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb1717fc640 1 -- 172.21.15.98:0/3450103339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0fb40 msgr2=0x558669d148d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:22.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb1717fc640 1 --2- 172.21.15.98:0/3450103339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0fb40 0x558669d148d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb1717fc640 1 -- 172.21.15.98:0/3450103339 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558669d0a510 con 0x558669d0e5d0 2024-09-19T07:25:22.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb171ffd640 1 --2- 172.21.15.98:0/3450103339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0fb40 0x558669d148d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:22.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb1717fc640 1 --2- 172.21.15.98:0/3450103339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0e5d0 0x558669d25340 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00c800 tx=0x7fb15c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edcce8ac9862cac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:22.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb1577fe640 1 -- 172.21.15.98:0/3450103339 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c036070 con 0x558669d0e5d0 2024-09-19T07:25:22.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb1577fe640 1 -- 172.21.15.98:0/3450103339 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c010c90 con 0x558669d0e5d0 2024-09-19T07:25:22.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.352+0000 7fb1577fe640 1 -- 172.21.15.98:0/3450103339 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c018040 con 0x558669d0e5d0 2024-09-19T07:25:22.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.353+0000 7fb17663a740 1 -- 172.21.15.98:0/3450103339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0e5d0 msgr2=0x558669d25340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:22.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.353+0000 7fb17663a740 1 --2- 172.21.15.98:0/3450103339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0e5d0 0x558669d25340 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00c800 tx=0x7fb15c00cf20 comp rx=0 tx=0).stop 2024-09-19T07:25:22.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.353+0000 7fb17663a740 1 -- 172.21.15.98:0/3450103339 shutdown_connections 2024-09-19T07:25:22.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.353+0000 7fb17663a740 1 --2- 172.21.15.98:0/3450103339 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d19370 0x558669d14e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.353+0000 7fb17663a740 1 --2- 172.21.15.98:0/3450103339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0fb40 0x558669d148d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.353+0000 7fb17663a740 1 --2- 172.21.15.98:0/3450103339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d0e5d0 0x558669d25340 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.353+0000 7fb17663a740 1 -- 172.21.15.98:0/3450103339 >> 172.21.15.98:0/3450103339 conn(0x558669cd7310 msgr2=0x558669d15fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:22.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.353+0000 7fb17663a740 1 -- 172.21.15.98:0/3450103339 shutdown_connections 2024-09-19T07:25:22.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.353+0000 7fb17663a740 1 -- 172.21.15.98:0/3450103339 wait complete. 2024-09-19T07:25:22.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.353+0000 7fb17663a740 1 -- start start 2024-09-19T07:25:22.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.353+0000 7fb17663a740 1 Processor -- start 2024-09-19T07:25:22.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb17663a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0fb40 0x558669d21900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb17663a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 0x558669d1cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb17663a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d1d0d0 0x558669d1d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb17663a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1ae000 con 0x558669d19370 2024-09-19T07:25:22.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb17663a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1af470 con 0x558669d0fb40 2024-09-19T07:25:22.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb17663a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb16c1ae6d0 con 0x558669d1d0d0 2024-09-19T07:25:22.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb17663a740 10 client.0 _ll_register_callbacks cb 0x7fb15c00ce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:22.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb171ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 0x558669d1cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb171ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 0x558669d1cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33988/0 (socket says 172.21.15.98:33988) 2024-09-19T07:25:22.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb171ffd640 1 -- 172.21.15.98:0/1727519567 learned_addr learned my addr 172.21.15.98:0/1727519567 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:22.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb1717fc640 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0fb40 0x558669d21900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb1717fc640 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d1d0d0 0x558669d1d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb171ffd640 1 -- 172.21.15.98:0/1727519567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d1d0d0 msgr2=0x558669d1d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:22.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb171ffd640 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d1d0d0 0x558669d1d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb171ffd640 1 -- 172.21.15.98:0/1727519567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0fb40 msgr2=0x558669d21900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb171ffd640 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0fb40 0x558669d21900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb171ffd640 1 -- 172.21.15.98:0/1727519567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558669d22150 con 0x558669d19370 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb1717fc640 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d1d0d0 0x558669d1d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb171ffd640 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 0x558669d1cb90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb168008d90 tx=0x7fb168011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469cc9cea4985038 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb1557fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb1557fa640 1 -- 172.21.15.98:0/1727519567 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168004220 con 0x558669d19370 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb1557fa640 1 -- 172.21.15.98:0/1727519567 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb1680043c0 con 0x558669d19370 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.354+0000 7fb17663a740 1 -- 172.21.15.98:0/1727519567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb15c010c90 con 0x558669d19370 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.355+0000 7fb1557fa640 1 -- 172.21.15.98:0/1727519567 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb16802a050 con 0x558669d19370 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.355+0000 7fb17663a740 10 client.16281 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.355+0000 7fb17663a740 1 -- 172.21.15.98:0/1727519567 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558669d93960 con 0x558669d19370 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.355+0000 7fb1557fa640 1 -- 172.21.15.98:0/1727519567 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c010c90 con 0x558669d19370 2024-09-19T07:25:22.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.355+0000 7fb1557fa640 1 -- 172.21.15.98:0/1727519567 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb168003ba0 con 0x558669d19370 2024-09-19T07:25:22.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.355+0000 7fb17663a740 10 client.16281 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:22.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.355+0000 7fb17663a740 10 client.16281 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T07:25:22.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.355+0000 7fb17663a740 20 client.16281 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:22.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.355+0000 7fb17663a740 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x558669d94170 0x558669d96590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:22.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.355+0000 7fb17663a740 4 client.16281 mds_command: new command op to 24442 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:25:22.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.355+0000 7fb17663a740 1 -- 172.21.15.98:0/1727519567 --> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558669c7bd70 con 0x558669d94170 2024-09-19T07:25:22.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.355+0000 7fb1717fc640 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x558669d94170 0x558669d96590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:22.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.356+0000 7fb1557fa640 10 client.16281 ms_handle_connect on v2:172.21.15.162:6838/609705447 2024-09-19T07:25:22.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.356+0000 7fb1717fc640 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x558669d94170 0x558669d96590 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3653969b7a3bd679 server_cookie=6a4eff79a792bae9 in_seq=0 out_seq=0 2024-09-19T07:25:22.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.357+0000 7fb1557fa640 1 -- 172.21.15.98:0/1727519567 <== mds.2 v2:172.21.15.162:6838/609705447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+71929 (crc 0 0 0) 0x558669c7bd70 con 0x558669d94170 2024-09-19T07:25:22.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.357+0000 7fb1557fa640 10 client.16281 handle_command_reply: tid=0 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb17663a740 1 client.16281 shutdown 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb17663a740 1 -- 172.21.15.98:0/1727519567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 msgr2=0x558669d1cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb17663a740 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 0x558669d1cb90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb168008d90 tx=0x7fb168011b00 comp rx=0 tx=0).stop 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb17663a740 1 -- 172.21.15.98:0/1727519567 shutdown_connections 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb17663a740 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.162:6838/609705447,v1:172.21.15.162:6839/609705447] conn(0x558669d94170 0x558669d96590 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb17663a740 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558669d1d0d0 0x558669d1d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb17663a740 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558669d19370 0x558669d1cb90 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb17663a740 1 --2- 172.21.15.98:0/1727519567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558669d0fb40 0x558669d21900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb1557fa640 0 client.16281 ms_handle_reset on v2:172.21.15.162:6838/609705447 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb17663a740 1 -- 172.21.15.98:0/1727519567 >> 172.21.15.98:0/1727519567 conn(0x558669cd7310 msgr2=0x558669d094e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb17663a740 1 -- 172.21.15.98:0/1727519567 shutdown_connections 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb17663a740 1 -- 172.21.15.98:0/1727519567 wait complete. 2024-09-19T07:25:22.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.358+0000 7fb17663a740 20 client.16281 trim_cache size 0 max 16384 2024-09-19T07:25:22.366 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2024-09-19T07:25:22.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.366 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.366 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 21778930, 2024-09-19T07:25:22.366 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635719, 2024-09-19T07:25:22.367 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/testfrmw.h" 2024-09-19T07:25:22.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.367 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.367 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 22049288, 2024-09-19T07:25:22.367 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635622, 2024-09-19T07:25:22.368 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/NOTES" 2024-09-19T07:25:22.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.368 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.368 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 25729002, 2024-09-19T07:25:22.368 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630909, 2024-09-19T07:25:22.368 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpipower.pod.1" 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 27852826, 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637110, 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g-interleaved" 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 29090376, 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637115, 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g" 2024-09-19T07:25:22.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.370 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.370 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 43732750, 2024-09-19T07:25:22.370 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635742, 2024-09-19T07:25:22.370 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/stress.c" 2024-09-19T07:25:22.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.370 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.370 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 49942298, 2024-09-19T07:25:22.370 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635713, 2024-09-19T07:25:22.370 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/NOTES" 2024-09-19T07:25:22.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 50477425, 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636811, 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/user_tdrm.c" 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 58883831, 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635614, 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/plan.txt" 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.371 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.372 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 60327872, 2024-09-19T07:25:22.372 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635639, 2024-09-19T07:25:22.372 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue" 2024-09-19T07:25:22.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.372 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.372 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 130976976, 2024-09-19T07:25:22.372 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635701, 2024-09-19T07:25:22.372 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/Makefile" 2024-09-19T07:25:22.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.372 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 155561460, 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636814, 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/Makefile" 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 176636326, 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635714, 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/LICENCE" 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 179162558, 2024-09-19T07:25:22.373 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637102, 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-nomig" 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 210491183, 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637053, 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/Makefile" 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 235916313, 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635654, 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock" 2024-09-19T07:25:22.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 252361115, 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635711, 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/testfrmw.c" 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 254184077, 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637174, 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_mmap.c" 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 254829721, 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635694, 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/Makefile" 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 284265907, 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635668, 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/LICENCE" 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.376 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.377 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 319677821, 2024-09-19T07:25:22.377 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630796, 2024-09-19T07:25:22.377 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_hold" 2024-09-19T07:25:22.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.377 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.377 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 344376761, 2024-09-19T07:25:22.377 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635318, 2024-09-19T07:25:22.377 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/4-2.c" 2024-09-19T07:25:22.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.377 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 350590236, 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635699, 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel" 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 361637811, 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635627, 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/testfrmw.c" 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 380935768, 2024-09-19T07:25:22.378 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636815, 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/tdrm.c" 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 385895494, 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635617, 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/s-c1.c" 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 441391851, 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635663, 2024-09-19T07:25:22.379 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/s-c.c" 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 448317307, 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635601, 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/assertions.xml" 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 503027584, 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635612, 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers" 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 515934594, 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635607, 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/Makefile" 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 531344917, 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637019, 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_stress_test.sh" 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.381 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 561897782, 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630908, 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/openhpid.pod.8" 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 571912972, 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635656, 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/Makefile" 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 573339494, 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635597, 2024-09-19T07:25:22.382 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues" 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 613869375, 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635662, 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/stress.c" 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 622124340, 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636816, 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/str_drm.h" 2024-09-19T07:25:22.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 623082522, 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635736, 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/testfrmw.h" 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 633274589, 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635610, 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/run.sh" 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 646387204, 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635323, 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/5-1.c" 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 655331193, 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637533, 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/Makefile" 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.385 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.386 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 662860038, 2024-09-19T07:25:22.386 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635619, 2024-09-19T07:25:22.386 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/testfrmw.c" 2024-09-19T07:25:22.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.386 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.386 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 669226779, 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635705, 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/LICENCE" 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 671199102, 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635652, 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/LICENCE" 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 675740676, 2024-09-19T07:25:22.387 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635733, 2024-09-19T07:25:22.388 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/s-c1.c" 2024-09-19T07:25:22.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.388 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.388 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 682083957, 2024-09-19T07:25:22.388 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635624, 2024-09-19T07:25:22.388 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam" 2024-09-19T07:25:22.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.388 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.388 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 687882958, 2024-09-19T07:25:22.388 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635661, 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init" 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 689541464, 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637103, 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g" 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 690366632, 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635324, 2024-09-19T07:25:22.389 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/6-1.c" 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 692929186, 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635325, 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/1-1.c" 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 693876085, 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637104, 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p" 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 695226874, 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630913, 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpitree.pod.1" 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 703383163, 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635655, 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/stress.c" 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.391 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.392 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 721459675, 2024-09-19T07:25:22.392 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635745, 2024-09-19T07:25:22.392 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/testfrmw.h" 2024-09-19T07:25:22.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.392 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.392 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 723485369, 2024-09-19T07:25:22.392 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630911, 2024-09-19T07:25:22.392 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpialarms.pod.1" 2024-09-19T07:25:22.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.393 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.393 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 732217752, 2024-09-19T07:25:22.393 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635634, 2024-09-19T07:25:22.393 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/testfrmw.c" 2024-09-19T07:25:22.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.393 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.393 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 741163508, 2024-09-19T07:25:22.393 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635674, 2024-09-19T07:25:22.393 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/testfrmw.c" 2024-09-19T07:25:22.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.394 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.394 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 756292996, 2024-09-19T07:25:22.394 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637116, 2024-09-19T07:25:22.394 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1p" 2024-09-19T07:25:22.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.394 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.394 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 775644166, 2024-09-19T07:25:22.394 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635729, 2024-09-19T07:25:22.394 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/do-plot" 2024-09-19T07:25:22.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.395 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.395 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 780937248, 2024-09-19T07:25:22.395 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636027, 2024-09-19T07:25:22.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.359+0000 7fb174261640 1 -- 172.21.15.98:0/1070846809 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb1580a33b0 msgr2=0x7fb1580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:22.395 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.359+0000 7fb174261640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb1580a33b0 0x7fb1580a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb1640ee720 tx=0x7fb1640e9040 comp rx=0 tx=0).stop 2024-09-19T07:25:22.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.359+0000 7fb174261640 1 -- 172.21.15.98:0/1070846809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb16c102ef0 msgr2=0x7fb16c0fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:22.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.359+0000 7fb174261640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb16c102ef0 0x7fb16c0fd700 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb164006010 tx=0x7fb16402f6f0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.359+0000 7fb174261640 1 -- 172.21.15.98:0/1070846809 shutdown_connections 2024-09-19T07:25:22.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.359+0000 7fb174261640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb1580a33b0 0x7fb1580a5870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.359+0000 7fb174261640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb16c102ef0 0x7fb16c0fd700 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.359+0000 7fb174261640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb16c102570 0x7fb16c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.359+0000 7fb174261640 1 --2- 172.21.15.98:0/1070846809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb16c100e20 0x7fb16c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:22.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.359+0000 7fb174261640 1 -- 172.21.15.98:0/1070846809 >> 172.21.15.98:0/1070846809 conn(0x7fb16c0fc7d0 msgr2=0x7fb16c06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:22.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.359+0000 7fb174261640 1 -- 172.21.15.98:0/1070846809 shutdown_connections 2024-09-19T07:25:22.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:22.359+0000 7fb174261640 1 -- 172.21.15.98:0/1070846809 wait complete. 2024-09-19T07:25:22.398 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/backbeat" 2024-09-19T07:25:22.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.398 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 794411315, 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635644, 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/NOTES" 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 834947965, 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630903, 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpionIBMblade.pod.1" 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.399 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 848654439, 2024-09-19T07:25:22.400 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630905, 2024-09-19T07:25:22.400 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpifan.pod.1" 2024-09-19T07:25:22.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.400 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.400 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 885401531, 2024-09-19T07:25:22.400 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635649, 2024-09-19T07:25:22.400 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.c" 2024-09-19T07:25:22.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.401 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.401 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 915247941, 2024-09-19T07:25:22.401 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635637, 2024-09-19T07:25:22.401 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/NOTES" 2024-09-19T07:25:22.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.401 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.401 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 932671253, 2024-09-19T07:25:22.401 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636029, 2024-09-19T07:25:22.401 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/maimparts" 2024-09-19T07:25:22.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.402 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.402 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 980025507, 2024-09-19T07:25:22.402 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635626, 2024-09-19T07:25:22.403 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/Makefile" 2024-09-19T07:25:22.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.403 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.403 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1028220227, 2024-09-19T07:25:22.403 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635659, 2024-09-19T07:25:22.403 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/NOTES" 2024-09-19T07:25:22.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.403 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.403 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1028544346, 2024-09-19T07:25:22.403 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635329, 2024-09-19T07:25:22.404 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/4-1.c" 2024-09-19T07:25:22.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.404 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.404 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1047067556, 2024-09-19T07:25:22.404 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637052, 2024-09-19T07:25:22.404 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/io_throttle_testplan.txt" 2024-09-19T07:25:22.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.404 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.404 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1050041207, 2024-09-19T07:25:22.404 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635679, 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/s-c1.c" 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1094640106, 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637054, 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/run_io_throttle_test.sh" 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1106345113, 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635660, 2024-09-19T07:25:22.405 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/LICENCE" 2024-09-19T07:25:22.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.406 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.406 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1124315010, 2024-09-19T07:25:22.406 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635693, 2024-09-19T07:25:22.406 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/stress.c" 2024-09-19T07:25:22.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.406 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.406 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1128280983, 2024-09-19T07:25:22.406 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635640, 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/stress.c" 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1135522509, 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637111, 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-16m" 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1160816728, 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635330, 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/cln.sh" 2024-09-19T07:25:22.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.408 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.408 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1200979049, 2024-09-19T07:25:22.408 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635603, 2024-09-19T07:25:22.408 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/run.sh" 2024-09-19T07:25:22.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.408 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.408 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1205566358, 2024-09-19T07:25:22.408 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635328, 2024-09-19T07:25:22.408 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/2-2.c" 2024-09-19T07:25:22.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.409 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.409 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1206775240, 2024-09-19T07:25:22.409 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637534, 2024-09-19T07:25:22.409 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid02.c" 2024-09-19T07:25:22.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.409 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.409 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1206870413, 2024-09-19T07:25:22.410 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635670, 2024-09-19T07:25:22.410 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/stress.c" 2024-09-19T07:25:22.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.410 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.410 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1233209777, 2024-09-19T07:25:22.410 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635682, 2024-09-19T07:25:22.410 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/testfrmw.h" 2024-09-19T07:25:22.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.411 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.411 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1237598474, 2024-09-19T07:25:22.411 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635720, 2024-09-19T07:25:22.411 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/NOTES" 2024-09-19T07:25:22.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.411 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.411 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1247404380, 2024-09-19T07:25:22.411 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635690, 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/testfrmw.h" 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1248404107, 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635695, 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/testfrmw.c" 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1279058133, 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635675, 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/testfrmw.h" 2024-09-19T07:25:22.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1283813878, 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635319, 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/coverage.txt" 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1317085880, 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635698, 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/LICENCE" 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1321452760, 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635616, 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init" 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1365720017, 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635635, 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/testfrmw.h" 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.414 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1375464426, 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635724, 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/stress1.c" 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1387710102, 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635629, 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/NOTES" 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1426116683, 2024-09-19T07:25:22.415 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637021, 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_process_stress.c" 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1439647113, 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635710, 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/Makefile" 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1474138918, 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635727, 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/testfrmw.h" 2024-09-19T07:25:22.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1478553722, 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635715, 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once" 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1501215317, 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635628, 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/testfrmw.h" 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.417 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1538653060, 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636030, 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/README" 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1538904054, 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635604, 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/plan.txt" 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.418 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1545756146, 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635600, 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/Makefile" 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1552844615, 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635696, 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/testfrmw.h" 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1565364228, 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637098, 2024-09-19T07:25:22.419 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1p" 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1572700231, 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635706, 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/assertions.xml" 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1591817288, 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637101, 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-touch" 2024-09-19T07:25:22.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1607525067, 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635681, 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/testfrmw.c" 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1626172985, 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635608, 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/assertions.xml" 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.421 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1670591929, 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637619, 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups02.c" 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1670722971, 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637096, 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m" 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1701357018, 2024-09-19T07:25:22.422 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630794, 2024-09-19T07:25:22.423 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_over" 2024-09-19T07:25:22.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.423 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.423 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1713261509, 2024-09-19T07:25:22.423 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635691, 2024-09-19T07:25:22.423 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress2.c" 2024-09-19T07:25:22.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.423 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1763122946, 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635725, 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/Makefile" 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1778064987, 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635737, 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/do-plot" 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.424 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1779946033, 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635650, 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.h" 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1781150654, 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635653, 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/threads_scenarii.c" 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1810932280, 2024-09-19T07:25:22.425 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635599, 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/coverage.txt" 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1818660217, 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635317, 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/9-1.c" 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1825887523, 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637532, 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid01.c" 2024-09-19T07:25:22.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.427 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.427 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1830210885, 2024-09-19T07:25:22.427 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635704, 2024-09-19T07:25:22.427 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/NOTES" 2024-09-19T07:25:22.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.427 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.427 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1837967823, 2024-09-19T07:25:22.427 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635609, 2024-09-19T07:25:22.427 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/multi_con_pro.c" 2024-09-19T07:25:22.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.428 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.428 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1861250421, 2024-09-19T07:25:22.428 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635620, 2024-09-19T07:25:22.428 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/testfrmw.h" 2024-09-19T07:25:22.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.429 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.429 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1918271774, 2024-09-19T07:25:22.429 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635638, 2024-09-19T07:25:22.429 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/LICENCE" 2024-09-19T07:25:22.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.430 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.430 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1925081329, 2024-09-19T07:25:22.430 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637409, 2024-09-19T07:25:22.430 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/Makefile" 2024-09-19T07:25:22.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.431 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.431 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1931477248, 2024-09-19T07:25:22.431 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635700, 2024-09-19T07:25:22.431 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/stress.c" 2024-09-19T07:25:22.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.432 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.432 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1943141745, 2024-09-19T07:25:22.432 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630795, 2024-09-19T07:25:22.432 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected" 2024-09-19T07:25:22.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.433 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.433 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1948924296, 2024-09-19T07:25:22.433 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635689, 2024-09-19T07:25:22.433 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/testfrmw.c" 2024-09-19T07:25:22.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.433 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.433 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1948928003, 2024-09-19T07:25:22.434 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637408, 2024-09-19T07:25:22.434 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_capable_net.sh" 2024-09-19T07:25:22.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.434 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.434 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1959933163, 2024-09-19T07:25:22.434 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635316, 2024-09-19T07:25:22.434 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/3-1.c" 2024-09-19T07:25:22.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.434 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.434 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1973294365, 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636817, 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/load_tdrm.sh" 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1996477093, 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635712, 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/testfrmw.h" 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2016061210, 2024-09-19T07:25:22.435 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635732, 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create" 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2060507032, 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635683, 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/do-plot" 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2064447251, 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635658, 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/testfrmw.h" 2024-09-19T07:25:22.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2077046937, 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636812, 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/Makefile" 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2099813458, 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635722, 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait" 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2115237828, 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635686, 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait" 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2137523931, 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637171, 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_measure.c" 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.438 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2138958912, 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635677, 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/LICENCE" 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2170989420, 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635734, 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/Makefile" 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2179697490, 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637315, 2024-09-19T07:25:22.439 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space" 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2180824099, 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635743, 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/Makefile" 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2214395930, 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635321, 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/testfrmw.h" 2024-09-19T07:25:22.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2231998166, 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635643, 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.h" 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2294786267, 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637108, 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-interleaved" 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.441 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2308893732, 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635740, 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/threads_scenarii.c" 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2320769584, 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635667, 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/NOTES" 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2329482362, 2024-09-19T07:25:22.442 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637615, 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/compat_16.h" 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2334068760, 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635718, 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/testfrmw.c" 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2360730700, 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630914, 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpitop.pod.1" 2024-09-19T07:25:22.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2390855082, 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635728, 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/stress2.c" 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2396332739, 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637107, 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-8p" 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2407567243, 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630797, 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_no_en" 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2425887233, 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630902, 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiinv.pod.1" 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.445 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2427620061, 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635678, 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork" 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2443516040, 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635748, 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/threads_scenarii.c" 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2446195357, 2024-09-19T07:25:22.446 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637105, 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m-touch" 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2449682848, 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637099, 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-shm-8p" 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2456516635, 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637410, 2024-09-19T07:25:22.447 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_bind.c" 2024-09-19T07:25:22.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.448 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.448 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2460089156, 2024-09-19T07:25:22.448 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636007, 2024-09-19T07:25:22.448 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/Makefile" 2024-09-19T07:25:22.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.448 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.449 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2460477000, 2024-09-19T07:25:22.449 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630898, 2024-09-19T07:25:22.449 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpireset.pod.1" 2024-09-19T07:25:22.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.449 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.450 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2469038404, 2024-09-19T07:25:22.450 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635636, 2024-09-19T07:25:22.450 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/do-plot" 2024-09-19T07:25:22.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.450 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.450 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2487471483, 2024-09-19T07:25:22.450 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635641, 2024-09-19T07:25:22.451 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/Makefile" 2024-09-19T07:25:22.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.451 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.451 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2494883840, 2024-09-19T07:25:22.451 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635605, 2024-09-19T07:25:22.451 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores" 2024-09-19T07:25:22.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2538986131, 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635703, 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/testfrmw.h" 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2570184503, 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635688, 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress1.c" 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.452 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2583594716, 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637106, 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m-touch" 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2605405360, 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637172, 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_boot_aggregate.c" 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2616835748, 2024-09-19T07:25:22.453 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635657, 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/testfrmw.c" 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2618192991, 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635723, 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/s-c.c" 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2622902379, 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635615, 2024-09-19T07:25:22.454 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads" 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2660325687, 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635730, 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/NOTES" 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2678488187, 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635606, 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/coverage.txt" 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.456 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.456 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2687218527, 2024-09-19T07:25:22.456 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635735, 2024-09-19T07:25:22.456 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/testfrmw.c" 2024-09-19T07:25:22.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.456 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.456 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2694731282, 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637020, 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/Makefile" 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2744023603, 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636028, 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/partbeat" 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2762019363, 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635664, 2024-09-19T07:25:22.457 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/Makefile" 2024-09-19T07:25:22.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.458 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.458 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2763737477, 2024-09-19T07:25:22.458 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635676, 2024-09-19T07:25:22.458 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/NOTES" 2024-09-19T07:25:22.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.458 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.458 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2771200758, 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637870, 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/keyctl/keyctl01.c" 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2792681535, 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630912, 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiwdt.pod.1" 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2814750516, 2024-09-19T07:25:22.459 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635651, 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/NOTES" 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2848768003, 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635648, 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/Makefile" 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2856661981, 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636008, 2024-09-19T07:25:22.460 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/fs_inod_readme.txt" 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2865028239, 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635625, 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/stress.c" 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2883102959, 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635322, 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/2-1.c" 2024-09-19T07:25:22.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2931811506, 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630899, 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpithres.pod.1" 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2931826014, 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630906, 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpisensor.pod.1" 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.463 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.463 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2939878500, 2024-09-19T07:25:22.463 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635684, 2024-09-19T07:25:22.463 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/NOTES" 2024-09-19T07:25:22.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.463 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.463 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2948807772, 2024-09-19T07:25:22.464 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635738, 2024-09-19T07:25:22.464 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/NOTES" 2024-09-19T07:25:22.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.464 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.464 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2958966927, 2024-09-19T07:25:22.465 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637057, 2024-09-19T07:25:22.465 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/iobw.c" 2024-09-19T07:25:22.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.465 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.465 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2968738607, 2024-09-19T07:25:22.465 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637113, 2024-09-19T07:25:22.465 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-8p" 2024-09-19T07:25:22.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.465 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.465 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2968986100, 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635645, 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/LICENCE" 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2986215997, 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635633, 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/Makefile" 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3009333350, 2024-09-19T07:25:22.466 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637173, 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/Makefile" 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3019771878, 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637109, 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-touch" 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3022311195, 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635702, 2024-09-19T07:25:22.467 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/testfrmw.c" 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3031951920, 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635717, 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/Makefile" 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3056755931, 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635731, 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/helper.c" 2024-09-19T07:25:22.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3071647311, 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635595, 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals" 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3127108080, 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635613, 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/keytests.sh" 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3134657253, 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635320, 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/testfrmw.c" 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3156344402, 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637871, 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/keyctl/Makefile" 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3159080039, 2024-09-19T07:25:22.470 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635327, 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/7-1.c" 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3174634145, 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636006, 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/fs_inod" 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3175862270, 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636819, 2024-09-19T07:25:22.471 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/tdrm.h" 2024-09-19T07:25:22.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.472 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.472 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3221782564, 2024-09-19T07:25:22.472 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636810, 2024-09-19T07:25:22.472 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space" 2024-09-19T07:25:22.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.472 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.472 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3223892536, 2024-09-19T07:25:22.472 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635744, 2024-09-19T07:25:22.472 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/testfrmw.c" 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3252675525, 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635680, 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/Makefile" 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3254162004, 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637097, 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-2shm-1m" 2024-09-19T07:25:22.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3299009672, 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635687, 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress.c" 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3303621835, 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630901, 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpisettime.pod.1" 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.474 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3304964201, 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635646, 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit" 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3319360441, 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637114, 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-2shm-1m" 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.475 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3355926238, 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635685, 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/LICENCE" 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3403939680, 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635598, 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/multi_send_rev_1.c" 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3431415584, 2024-09-19T07:25:22.476 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637100, 2024-09-19T07:25:22.477 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m" 2024-09-19T07:25:22.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.477 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.477 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3479371949, 2024-09-19T07:25:22.477 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630910, 2024-09-19T07:25:22.477 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiel.pod.1" 2024-09-19T07:25:22.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.477 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.477 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3489247351, 2024-09-19T07:25:22.478 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637056, 2024-09-19T07:25:22.478 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/myfunctions-io.sh" 2024-09-19T07:25:22.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.478 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.478 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3490708236, 2024-09-19T07:25:22.478 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635746, 2024-09-19T07:25:22.478 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/NOTES" 2024-09-19T07:25:22.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.478 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.478 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3492426210, 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635621, 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/do-plot" 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3542621158, 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630915, 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/Makefile.am" 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3556493130, 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630904, 2024-09-19T07:25:22.479 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/openhpi.pod.7" 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3564347236, 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635708, 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/stress.c" 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3569709603, 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630900, 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpievents.pod.1" 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3583676101, 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635716, 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/stress.c" 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3605784102, 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637618, 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups01.c" 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.481 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3607019027, 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635747, 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/LICENCE" 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3625615706, 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637614, 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups04.c" 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3658371367, 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635669, 2024-09-19T07:25:22.482 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock" 2024-09-19T07:25:22.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.483 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.483 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3661866448, 2024-09-19T07:25:22.483 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635623, 2024-09-19T07:25:22.483 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/LICENCE" 2024-09-19T07:25:22.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.483 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.483 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3664059367, 2024-09-19T07:25:22.483 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636818, 2024-09-19T07:25:22.483 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/README" 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3668390470, 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635741, 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self" 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3698268442, 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637112, 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-1m" 2024-09-19T07:25:22.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3743134151, 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635602, 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/multi_send_rev_2.c" 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3778095971, 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635709, 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/s-c.c" 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.485 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3791959789, 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635632, 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/s-c1.c" 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3794595493, 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637055, 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/README" 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.486 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3892214032, 2024-09-19T07:25:22.487 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635630, 2024-09-19T07:25:22.487 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/LICENCE" 2024-09-19T07:25:22.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.487 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.487 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3899557980, 2024-09-19T07:25:22.487 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637616, 2024-09-19T07:25:22.487 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups03.c" 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3923473354, 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635721, 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/LICENCE" 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3936310323, 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635671, 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/s-c1.c" 2024-09-19T07:25:22.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3979041392, 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635673, 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/Makefile" 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4001666075, 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630907, 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/Makefile.in" 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4043366605, 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635707, 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init" 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4047751035, 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635642, 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.c" 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.490 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4053245847, 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637617, 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/Makefile" 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4061510281, 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635647, 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/stress.c" 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4069045312, 2024-09-19T07:25:22.491 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635326, 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/assertions.xml" 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4073477710, 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635672, 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/s-c2.c" 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4079277431, 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635726, 2024-09-19T07:25:22.492 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/testfrmw.c" 2024-09-19T07:25:22.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.493 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.493 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4093283160, 2024-09-19T07:25:22.493 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635739, 2024-09-19T07:25:22.493 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/LICENCE" 2024-09-19T07:25:22.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.493 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.494 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4115643364, 2024-09-19T07:25:22.494 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635665, 2024-09-19T07:25:22.494 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/testfrmw.c" 2024-09-19T07:25:22.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.494 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.494 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4140059976, 2024-09-19T07:25:22.494 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635666, 2024-09-19T07:25:22.494 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/testfrmw.h" 2024-09-19T07:25:22.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4140855942, 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635631, 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open" 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4143622090, 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635611, 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/plan.txt" 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.495 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4171701664, 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635692, 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill" 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4196043010, 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635618, 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/Makefile" 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.496 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4225966950, 2024-09-19T07:25:22.497 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637411, 2024-09-19T07:25:22.497 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_raw.c" 2024-09-19T07:25:22.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:22.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:22.497 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:22.497 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4262793584, 2024-09-19T07:25:22.497 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635697, 2024-09-19T07:25:22.497 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/NOTES" 2024-09-19T07:25:22.497 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:25:22.497 INFO:teuthology.orchestra.run.smithi098.stdout:] 2024-09-19T07:25:22.498 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:22 smithi162 ceph-mon[35726]: pgmap v102: 97 pgs: 97 active+clean; 2.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 40 op/s 2024-09-19T07:25:23.385 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T07:25:23.636 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:24.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:23 smithi098 ceph-mon[30950]: pgmap v103: 97 pgs: 97 active+clean; 2.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 40 op/s 2024-09-19T07:25:24.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.114+0000 7fb1a057a640 1 -- 172.21.15.98:0/1072993552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1981082e0 msgr2=0x7fb19810ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:24.125 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.114+0000 7fb1a057a640 1 --2- 172.21.15.98:0/1072993552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1981082e0 0x7fb19810ec50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb190009cd0 tx=0x7fb19002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.114+0000 7fb1a057a640 1 -- 172.21.15.98:0/1072993552 shutdown_connections 2024-09-19T07:25:24.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.114+0000 7fb1a057a640 1 --2- 172.21.15.98:0/1072993552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1981082e0 0x7fb19810ec50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.114+0000 7fb1a057a640 1 --2- 172.21.15.98:0/1072993552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb198103760 0x7fb198107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.114+0000 7fb1a057a640 1 --2- 172.21.15.98:0/1072993552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb198102db0 0x7fb198103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.114+0000 7fb1a057a640 1 -- 172.21.15.98:0/1072993552 >> 172.21.15.98:0/1072993552 conn(0x7fb1980fc7d0 msgr2=0x7fb1980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:24.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.114+0000 7fb1a057a640 1 -- 172.21.15.98:0/1072993552 shutdown_connections 2024-09-19T07:25:24.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.114+0000 7fb1a057a640 1 -- 172.21.15.98:0/1072993552 wait complete. 2024-09-19T07:25:24.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.114+0000 7fb1a057a640 1 Processor -- start 2024-09-19T07:25:24.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb1a057a640 1 -- start start 2024-09-19T07:25:24.126 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb1a057a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb198102db0 0x7fb1981985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb1a057a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb198103760 0x7fb198198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb1a057a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1981082e0 0x7fb19819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb1a057a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb198112130 con 0x7fb198102db0 2024-09-19T07:25:24.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb1a057a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb198111fb0 con 0x7fb198103760 2024-09-19T07:25:24.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb1a057a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1981122b0 con 0x7fb1981082e0 2024-09-19T07:25:24.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb19e316640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb198102db0 0x7fb1981985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb19e316640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb198102db0 0x7fb1981985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37178/0 (socket says 172.21.15.98:37178) 2024-09-19T07:25:24.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb19e316640 1 -- 172.21.15.98:0/1991455013 learned_addr learned my addr 172.21.15.98:0/1991455013 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:24.127 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb19eb17640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1981082e0 0x7fb19819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb19e316640 1 -- 172.21.15.98:0/1991455013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1981082e0 msgr2=0x7fb19819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb19e316640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1981082e0 0x7fb19819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb19db15640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb198103760 0x7fb198198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb19e316640 1 -- 172.21.15.98:0/1991455013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb198103760 msgr2=0x7fb198198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb19e316640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb198103760 0x7fb198198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb19e316640 1 -- 172.21.15.98:0/1991455013 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19819d5a0 con 0x7fb198102db0 2024-09-19T07:25:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb19eb17640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1981082e0 0x7fb19819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb19e316640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb198102db0 0x7fb1981985f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb19400b4a0 tx=0x7fb19400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb18f7fe640 1 -- 172.21.15.98:0/1991455013 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194014070 con 0x7fb198102db0 2024-09-19T07:25:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb18f7fe640 1 -- 172.21.15.98:0/1991455013 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb194010af0 con 0x7fb198102db0 2024-09-19T07:25:24.128 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb1a057a640 1 -- 172.21.15.98:0/1991455013 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19819d890 con 0x7fb198102db0 2024-09-19T07:25:24.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.115+0000 7fb18f7fe640 1 -- 172.21.15.98:0/1991455013 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194017d10 con 0x7fb198102db0 2024-09-19T07:25:24.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.116+0000 7fb1a057a640 1 -- 172.21.15.98:0/1991455013 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1981a5170 con 0x7fb198102db0 2024-09-19T07:25:24.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.118+0000 7fb18f7fe640 1 -- 172.21.15.98:0/1991455013 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb194017070 con 0x7fb198102db0 2024-09-19T07:25:24.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.118+0000 7fb1a2953740 1 Processor -- start 2024-09-19T07:25:24.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.118+0000 7fb1a2953740 1 -- start start 2024-09-19T07:25:24.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.118+0000 7fb1a2953740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1bb40 0x5605a3f1a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.118+0000 7fb1a2953740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1a5d0 0x5605a3f1aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.118+0000 7fb1a2953740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f29780 0x5605a3f2bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.118+0000 7fb1a2953740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5605a3e802f0 con 0x5605a3f1a5d0 2024-09-19T07:25:24.129 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.118+0000 7fb1a2953740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5605a3e27cf0 con 0x5605a3f1bb40 2024-09-19T07:25:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.118+0000 7fb1a2953740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5605a3e7c2b0 con 0x5605a3f29780 2024-09-19T07:25:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.118+0000 7fb18f7fe640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb1840a33b0 0x7fb1840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19e316640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1a5d0 0x5605a3f1aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19e316640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1a5d0 0x5605a3f1aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37194/0 (socket says 172.21.15.98:37194) 2024-09-19T07:25:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19e316640 1 -- 172.21.15.98:0/3513291590 learned_addr learned my addr 172.21.15.98:0/3513291590 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19eb17640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb1840a33b0 0x7fb1840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19db15640 1 --2- 172.21.15.98:0/3513291590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f29780 0x5605a3f2bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19eb17640 1 --2- 172.21.15.98:0/3513291590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1bb40 0x5605a3f1a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb18f7fe640 1 -- 172.21.15.98:0/1991455013 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb1940cf0c0 con 0x7fb198102db0 2024-09-19T07:25:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19e316640 1 -- 172.21.15.98:0/3513291590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f29780 msgr2=0x5605a3f2bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:24.130 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19e316640 1 --2- 172.21.15.98:0/3513291590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f29780 0x5605a3f2bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19e316640 1 -- 172.21.15.98:0/3513291590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1bb40 msgr2=0x5605a3f1a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19e316640 1 --2- 172.21.15.98:0/3513291590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1bb40 0x5605a3f1a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19e316640 1 -- 172.21.15.98:0/3513291590 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605a3e0c3a0 con 0x5605a3f1a5d0 2024-09-19T07:25:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19eb17640 1 --2- 172.21.15.98:0/3513291590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1bb40 0x5605a3f1a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19e316640 1 --2- 172.21.15.98:0/3513291590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1a5d0 0x5605a3f1aa10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb194009420 tx=0x7fb19406e2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee24f9e64294b4e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb19eb17640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb1840a33b0 0x7fb1840a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb190005e30 tx=0x7fb190005da0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb18cff9640 1 -- 172.21.15.98:0/3513291590 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19401e070 con 0x5605a3f1a5d0 2024-09-19T07:25:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb18cff9640 1 -- 172.21.15.98:0/3513291590 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1940662d0 con 0x5605a3f1a5d0 2024-09-19T07:25:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.119+0000 7fb18cff9640 1 -- 172.21.15.98:0/3513291590 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1940a40f0 con 0x5605a3f1a5d0 2024-09-19T07:25:24.131 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.120+0000 7fb1a2953740 1 -- 172.21.15.98:0/3513291590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1a5d0 msgr2=0x5605a3f1aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.120+0000 7fb1a2953740 1 --2- 172.21.15.98:0/3513291590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1a5d0 0x5605a3f1aa10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb194009420 tx=0x7fb19406e2b0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.120+0000 7fb1a2953740 1 -- 172.21.15.98:0/3513291590 shutdown_connections 2024-09-19T07:25:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.120+0000 7fb1a2953740 1 --2- 172.21.15.98:0/3513291590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f29780 0x5605a3f2bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.120+0000 7fb1a2953740 1 --2- 172.21.15.98:0/3513291590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1a5d0 0x5605a3f1aa10 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.120+0000 7fb1a2953740 1 --2- 172.21.15.98:0/3513291590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1bb40 0x5605a3f1a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.120+0000 7fb1a2953740 1 -- 172.21.15.98:0/3513291590 >> 172.21.15.98:0/3513291590 conn(0x5605a3ee3310 msgr2=0x5605a3f16c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.120+0000 7fb1a2953740 1 -- 172.21.15.98:0/3513291590 shutdown_connections 2024-09-19T07:25:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.120+0000 7fb1a2953740 1 -- 172.21.15.98:0/3513291590 wait complete. 2024-09-19T07:25:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.120+0000 7fb1a2953740 1 -- start start 2024-09-19T07:25:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb1a2953740 1 Processor -- start 2024-09-19T07:25:24.132 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb1a2953740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1a5d0 0x5605a3f29230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb1a2953740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 0x5605a3f264e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb1a2953740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f29780 0x5605a3f26c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb1a2953740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5605a3f2c480 con 0x5605a3f1bb40 2024-09-19T07:25:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb1a2953740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5605a3e3b060 con 0x5605a3f1a5d0 2024-09-19T07:25:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb1a2953740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5605a3f2c600 con 0x5605a3f29780 2024-09-19T07:25:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb1a2953740 10 client.0 _ll_register_callbacks cb 0x5605a3b8e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb19db15640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 0x5605a3f264e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb19db15640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 0x5605a3f264e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37210/0 (socket says 172.21.15.98:37210) 2024-09-19T07:25:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb19db15640 1 -- 172.21.15.98:0/1154945314 learned_addr learned my addr 172.21.15.98:0/1154945314 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb19e316640 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1a5d0 0x5605a3f29230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.133 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb19eb17640 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f29780 0x5605a3f26c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb19db15640 1 -- 172.21.15.98:0/1154945314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f29780 msgr2=0x5605a3f26c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:24.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb19db15640 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f29780 0x5605a3f26c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb19db15640 1 -- 172.21.15.98:0/1154945314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1a5d0 msgr2=0x5605a3f29230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:24.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb19db15640 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1a5d0 0x5605a3f29230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb19db15640 1 -- 172.21.15.98:0/1154945314 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605a3bf13c0 con 0x5605a3f1bb40 2024-09-19T07:25:24.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb19db15640 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 0x5605a3f264e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb188009d40 tx=0x7fb1880117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893ab228b4249183 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:24.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.121+0000 7fb181ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:24.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb181ffb640 1 -- 172.21.15.98:0/1154945314 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188005220 con 0x5605a3f1bb40 2024-09-19T07:25:24.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb1a2953740 1 -- 172.21.15.98:0/1154945314 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1940662d0 con 0x5605a3f1bb40 2024-09-19T07:25:24.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb181ffb640 1 -- 172.21.15.98:0/1154945314 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb1880053c0 con 0x5605a3f1bb40 2024-09-19T07:25:24.134 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb181ffb640 1 -- 172.21.15.98:0/1154945314 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb188009e30 con 0x5605a3f1bb40 2024-09-19T07:25:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb1a2953740 10 client.16293 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb1a2953740 1 -- 172.21.15.98:0/1154945314 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5605a3f380a0 con 0x5605a3f1bb40 2024-09-19T07:25:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb181ffb640 1 -- 172.21.15.98:0/1154945314 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1940662d0 con 0x5605a3f1bb40 2024-09-19T07:25:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb181ffb640 1 -- 172.21.15.98:0/1154945314 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb18800f040 con 0x5605a3f1bb40 2024-09-19T07:25:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb1a2953740 10 client.16293 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb1a2953740 10 client.16293 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T07:25:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb1a2953740 20 client.16293 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb1a2953740 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5605a3f39550 0x5605a3f3b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb1a2953740 4 client.16293 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.122+0000 7fb1a2953740 1 -- 172.21.15.98:0/1154945314 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605a3e8d860 con 0x5605a3f39550 2024-09-19T07:25:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.123+0000 7fb19e316640 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5605a3f39550 0x5605a3f3b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.135 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.123+0000 7fb181ffb640 10 client.16293 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:25:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.123+0000 7fb19e316640 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5605a3f39550 0x5605a3f3b9a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1b5fa26dd9c39b87 server_cookie=66ba655193bbafad in_seq=0 out_seq=0 2024-09-19T07:25:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb181ffb640 1 -- 172.21.15.98:0/1154945314 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605a3e8d860 con 0x5605a3f39550 2024-09-19T07:25:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb181ffb640 10 client.16293 handle_command_reply: tid=0 2024-09-19T07:25:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb1a2953740 1 client.16293 shutdown 2024-09-19T07:25:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb1a2953740 1 -- 172.21.15.98:0/1154945314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 msgr2=0x5605a3f264e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb1a2953740 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 0x5605a3f264e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb188009d40 tx=0x7fb1880117b0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb1a2953740 1 -- 172.21.15.98:0/1154945314 shutdown_connections 2024-09-19T07:25:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb1a2953740 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5605a3f39550 0x5605a3f3b9a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb181ffb640 0 client.16293 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:25:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb1a2953740 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f29780 0x5605a3f26c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.136 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb1a2953740 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 0x5605a3f264e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb1a2953740 1 --2- 172.21.15.98:0/1154945314 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1a5d0 0x5605a3f29230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb1a2953740 1 -- 172.21.15.98:0/1154945314 >> 172.21.15.98:0/1154945314 conn(0x5605a3ee3310 msgr2=0x5605a3f1c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb1a2953740 1 -- 172.21.15.98:0/1154945314 shutdown_connections 2024-09-19T07:25:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.124+0000 7fb1a2953740 1 -- 172.21.15.98:0/1154945314 wait complete. 2024-09-19T07:25:24.137 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.125+0000 7fb1a2953740 20 client.16293 trim_cache size 0 max 16384 2024-09-19T07:25:24.138 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:23 smithi162 ceph-mon[35726]: pgmap v103: 97 pgs: 97 active+clean; 2.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 40 op/s 2024-09-19T07:25:24.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.137+0000 7fb1a2953740 1 Processor -- start 2024-09-19T07:25:24.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.137+0000 7fb1a2953740 1 -- start start 2024-09-19T07:25:24.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.137+0000 7fb1a2953740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f1a5d0 0x5605a3f29230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.137+0000 7fb1a2953740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 0x5605a3f16e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.137+0000 7fb1a2953740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f29780 0x5605a3f412b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.137+0000 7fb1a2953740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb1981ae1d0 con 0x5605a3f1bb40 2024-09-19T07:25:24.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.137+0000 7fb1a2953740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb1981ab9e0 con 0x5605a3f29780 2024-09-19T07:25:24.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.137+0000 7fb1a2953740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1981a9830 con 0x5605a3f1a5d0 2024-09-19T07:25:24.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb19db15640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 0x5605a3f16e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb19db15640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 0x5605a3f16e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37226/0 (socket says 172.21.15.98:37226) 2024-09-19T07:25:24.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb19db15640 1 -- 172.21.15.98:0/3799205867 learned_addr learned my addr 172.21.15.98:0/3799205867 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:24.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb19e316640 1 --2- 172.21.15.98:0/3799205867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f1a5d0 0x5605a3f29230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb19eb17640 1 --2- 172.21.15.98:0/3799205867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f29780 0x5605a3f412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb19db15640 1 -- 172.21.15.98:0/3799205867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f1a5d0 msgr2=0x5605a3f29230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:24.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb19db15640 1 --2- 172.21.15.98:0/3799205867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f1a5d0 0x5605a3f29230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb19db15640 1 -- 172.21.15.98:0/3799205867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f29780 msgr2=0x5605a3f412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:24.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb19db15640 1 --2- 172.21.15.98:0/3799205867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f29780 0x5605a3f412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb19db15640 1 -- 172.21.15.98:0/3799205867 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605a3f24a30 con 0x5605a3f1bb40 2024-09-19T07:25:24.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb19eb17640 1 --2- 172.21.15.98:0/3799205867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f29780 0x5605a3f412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:24.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb19db15640 1 --2- 172.21.15.98:0/3799205867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 0x5605a3f16e10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb18800a010 tx=0x7fb188005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed6ee04a5ee2034 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:24.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb183fff640 1 -- 172.21.15.98:0/3799205867 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188012860 con 0x5605a3f1bb40 2024-09-19T07:25:24.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb183fff640 1 -- 172.21.15.98:0/3799205867 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb188022430 con 0x5605a3f1bb40 2024-09-19T07:25:24.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.138+0000 7fb183fff640 1 -- 172.21.15.98:0/3799205867 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188022a10 con 0x5605a3f1bb40 2024-09-19T07:25:24.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 -- 172.21.15.98:0/3799205867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 msgr2=0x5605a3f16e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:24.145 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 --2- 172.21.15.98:0/3799205867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 0x5605a3f16e10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb18800a010 tx=0x7fb188005bb0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 -- 172.21.15.98:0/3799205867 shutdown_connections 2024-09-19T07:25:24.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 --2- 172.21.15.98:0/3799205867 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f29780 0x5605a3f412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 --2- 172.21.15.98:0/3799205867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f1bb40 0x5605a3f16e10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 --2- 172.21.15.98:0/3799205867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f1a5d0 0x5605a3f29230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 -- 172.21.15.98:0/3799205867 >> 172.21.15.98:0/3799205867 conn(0x5605a3ee3310 msgr2=0x5605a3f16700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:24.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 -- 172.21.15.98:0/3799205867 shutdown_connections 2024-09-19T07:25:24.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 -- 172.21.15.98:0/3799205867 wait complete. 2024-09-19T07:25:24.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 -- start start 2024-09-19T07:25:24.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 Processor -- start 2024-09-19T07:25:24.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f1a5d0 0x5605a3f2d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.139+0000 7fb1a2953740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1bb40 0x5605a3f2dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb1a2953740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f29780 0x5605a3f2e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb1a2953740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb1981a9ea0 con 0x5605a3f29780 2024-09-19T07:25:24.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb1a2953740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb1981ab310 con 0x5605a3f1bb40 2024-09-19T07:25:24.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb1a2953740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1981aa570 con 0x5605a3f1a5d0 2024-09-19T07:25:24.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb1a2953740 10 client.0 _ll_register_callbacks cb 0x7fb188009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:24.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb19eb17640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f29780 0x5605a3f2e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb19eb17640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f29780 0x5605a3f2e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37234/0 (socket says 172.21.15.98:37234) 2024-09-19T07:25:24.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb19eb17640 1 -- 172.21.15.98:0/1950209394 learned_addr learned my addr 172.21.15.98:0/1950209394 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:24.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb19db15640 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1bb40 0x5605a3f2dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb19e316640 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f1a5d0 0x5605a3f2d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb19eb17640 1 -- 172.21.15.98:0/1950209394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f1a5d0 msgr2=0x5605a3f2d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:24.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb19eb17640 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f1a5d0 0x5605a3f2d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb19eb17640 1 -- 172.21.15.98:0/1950209394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1bb40 msgr2=0x5605a3f2dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:24.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb19eb17640 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1bb40 0x5605a3f2dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb19eb17640 1 -- 172.21.15.98:0/1950209394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605a3fa33e0 con 0x5605a3f29780 2024-09-19T07:25:24.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb19e316640 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f1a5d0 0x5605a3f2d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:24.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb19eb17640 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f29780 0x5605a3f2e220 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb190031ce0 tx=0x7fb19002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7817ddbaf1012b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:24.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb181ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb181ffb640 1 -- 172.21.15.98:0/1950209394 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190057060 con 0x5605a3f29780 2024-09-19T07:25:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb181ffb640 1 -- 172.21.15.98:0/1950209394 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb190004250 con 0x5605a3f29780 2024-09-19T07:25:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb1a2953740 1 -- 172.21.15.98:0/1950209394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605a3e87d70 con 0x5605a3f29780 2024-09-19T07:25:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.140+0000 7fb181ffb640 1 -- 172.21.15.98:0/1950209394 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb190004450 con 0x5605a3f29780 2024-09-19T07:25:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.141+0000 7fb1a2953740 10 client.16299 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.141+0000 7fb1a2953740 1 -- 172.21.15.98:0/1950209394 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5605a3fa45d0 con 0x5605a3f29780 2024-09-19T07:25:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.141+0000 7fb181ffb640 1 -- 172.21.15.98:0/1950209394 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5605a3e87d70 con 0x5605a3f29780 2024-09-19T07:25:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.141+0000 7fb181ffb640 1 -- 172.21.15.98:0/1950209394 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb190030070 con 0x5605a3f29780 2024-09-19T07:25:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.141+0000 7fb1a2953740 10 client.16299 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.141+0000 7fb1a2953740 10 client.16299 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T07:25:24.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.141+0000 7fb1a2953740 20 client.16299 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.141+0000 7fb1a2953740 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5605a3fa4db0 0x5605a3fa71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.141+0000 7fb1a2953740 4 client.16299 mds_command: new command op to 24458 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:25:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.141+0000 7fb1a2953740 1 -- 172.21.15.98:0/1950209394 --> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605a3e04170 con 0x5605a3fa4db0 2024-09-19T07:25:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.141+0000 7fb19e316640 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5605a3fa4db0 0x5605a3fa71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb19e316640 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5605a3fa4db0 0x5605a3fa71d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3d9e621fdbff7fc1 server_cookie=ccbf8962b2ae807b in_seq=0 out_seq=0 2024-09-19T07:25:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb181ffb640 10 client.16299 ms_handle_connect on v2:172.21.15.139:6836/3386684827 2024-09-19T07:25:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb181ffb640 1 -- 172.21.15.98:0/1950209394 <== mds.1 v2:172.21.15.139:6836/3386684827 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26002 (crc 0 0 0) 0x5605a3e04170 con 0x5605a3fa4db0 2024-09-19T07:25:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb181ffb640 10 client.16299 handle_command_reply: tid=0 2024-09-19T07:25:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb1a2953740 1 client.16299 shutdown 2024-09-19T07:25:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb1a2953740 1 -- 172.21.15.98:0/1950209394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f29780 msgr2=0x5605a3f2e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:24.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb1a2953740 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f29780 0x5605a3f2e220 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb190031ce0 tx=0x7fb19002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb1a2953740 1 -- 172.21.15.98:0/1950209394 shutdown_connections 2024-09-19T07:25:24.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb1a2953740 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.139:6836/3386684827,v1:172.21.15.139:6837/3386684827] conn(0x5605a3fa4db0 0x5605a3fa71d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb1a2953740 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5605a3f29780 0x5605a3f2e220 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb1a2953740 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605a3f1bb40 0x5605a3f2dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb181ffb640 0 client.16299 ms_handle_reset on v2:172.21.15.139:6836/3386684827 2024-09-19T07:25:24.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb1a2953740 1 --2- 172.21.15.98:0/1950209394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5605a3f1a5d0 0x5605a3f2d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb1a2953740 1 -- 172.21.15.98:0/1950209394 >> 172.21.15.98:0/1950209394 conn(0x5605a3ee3310 msgr2=0x5605a3f1c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:24.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.142+0000 7fb1a2953740 1 -- 172.21.15.98:0/1950209394 shutdown_connections 2024-09-19T07:25:24.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a2953740 1 -- 172.21.15.98:0/1950209394 wait complete. 2024-09-19T07:25:24.151 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a2953740 20 client.16299 trim_cache size 0 max 16384 2024-09-19T07:25:24.152 INFO:teuthology.orchestra.run.smithi098.stdout:[ 2024-09-19T07:25:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 15627118, 2024-09-19T07:25:24.152 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636855, 2024-09-19T07:25:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/userBlockInclude.c" 2024-09-19T07:25:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 19631306, 2024-09-19T07:25:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631794, 2024-09-19T07:25:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/scripts/test/coverage_report.pl" 2024-09-19T07:25:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 158539509, 2024-09-19T07:25:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636336, 2024-09-19T07:25:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/Makefile" 2024-09-19T07:25:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 192319748, 2024-09-19T07:25:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631689, 2024-09-19T07:25:24.154 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_event_encode_test.c" 2024-09-19T07:25:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 271645081, 2024-09-19T07:25:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631686, 2024-09-19T07:25:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_rptentry_test.c" 2024-09-19T07:25:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.155 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 289968905, 2024-09-19T07:25:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636581, 2024-09-19T07:25:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/load_tbase.sh" 2024-09-19T07:25:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 299408799, 2024-09-19T07:25:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631694, 2024-09-19T07:25:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_rdr_test.c" 2024-09-19T07:25:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.156 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 304530769, 2024-09-19T07:25:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637911, 2024-09-19T07:25:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getsockname/getsockname01.c" 2024-09-19T07:25:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 410026441, 2024-09-19T07:25:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636853, 2024-09-19T07:25:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/includeTest.c" 2024-09-19T07:25:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 436820419, 2024-09-19T07:25:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635978, 2024-09-19T07:25:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config5" 2024-09-19T07:25:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 469257784, 2024-09-19T07:25:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637419, 2024-09-19T07:25:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_hostname.c" 2024-09-19T07:25:24.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 482126074, 2024-09-19T07:25:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630821, 2024-09-19T07:25:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_ripv" 2024-09-19T07:25:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 488487970, 2024-09-19T07:25:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631693, 2024-09-19T07:25:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/Makefile.am" 2024-09-19T07:25:24.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 515145109, 2024-09-19T07:25:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631685, 2024-09-19T07:25:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_text_utils_test.c" 2024-09-19T07:25:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 528607757, 2024-09-19T07:25:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511638195, 2024-09-19T07:25:24.160 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/brk/Makefile" 2024-09-19T07:25:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 558037638, 2024-09-19T07:25:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635977, 2024-09-19T07:25:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/Makefile" 2024-09-19T07:25:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 560261820, 2024-09-19T07:25:24.161 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635990, 2024-09-19T07:25:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/openfile/Makefile" 2024-09-19T07:25:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 606960676, 2024-09-19T07:25:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511638194, 2024-09-19T07:25:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/brk/brk01.c" 2024-09-19T07:25:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.162 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 649827762, 2024-09-19T07:25:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631690, 2024-09-19T07:25:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/Makefile.in" 2024-09-19T07:25:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 669171641, 2024-09-19T07:25:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637777, 2024-09-19T07:25:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/sched_setscheduler02.c" 2024-09-19T07:25:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 807214658, 2024-09-19T07:25:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635975, 2024-09-19T07:25:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config2" 2024-09-19T07:25:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 858368342, 2024-09-19T07:25:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631683, 2024-09-19T07:25:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_utils_test.c" 2024-09-19T07:25:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.164 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 945323838, 2024-09-19T07:25:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511638098, 2024-09-19T07:25:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect02.c" 2024-09-19T07:25:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 974841801, 2024-09-19T07:25:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631682, 2024-09-19T07:25:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrinfo_test.c" 2024-09-19T07:25:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1013624650, 2024-09-19T07:25:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635822, 2024-09-19T07:25:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/Makefile" 2024-09-19T07:25:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1093712728, 2024-09-19T07:25:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635790, 2024-09-19T07:25:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget02.c" 2024-09-19T07:25:24.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1098752015, 2024-09-19T07:25:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631688, 2024-09-19T07:25:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrarea_test.c" 2024-09-19T07:25:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1171194058, 2024-09-19T07:25:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636854, 2024-09-19T07:25:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/Makefile" 2024-09-19T07:25:24.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1288337330, 2024-09-19T07:25:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511638018, 2024-09-19T07:25:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_destroy/io_destroy01.c" 2024-09-19T07:25:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.168 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1297051521, 2024-09-19T07:25:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511638099, 2024-09-19T07:25:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/Makefile" 2024-09-19T07:25:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1312256016, 2024-09-19T07:25:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635533, 2024-09-19T07:25:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_2.c" 2024-09-19T07:25:24.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1339473022, 2024-09-19T07:25:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630818, 2024-09-19T07:25:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_over" 2024-09-19T07:25:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1435184898, 2024-09-19T07:25:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636852, 2024-09-19T07:25:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/includeTest.h" 2024-09-19T07:25:24.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1453439878, 2024-09-19T07:25:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637776, 2024-09-19T07:25:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/Makefile" 2024-09-19T07:25:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1517951867, 2024-09-19T07:25:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630817, 2024-09-19T07:25:24.171 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_no_en" 2024-09-19T07:25:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1552330980, 2024-09-19T07:25:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630816, 2024-09-19T07:25:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_eipv" 2024-09-19T07:25:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1552501398, 2024-09-19T07:25:24.172 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636922, 2024-09-19T07:25:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_mem_hog.c" 2024-09-19T07:25:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1601164169, 2024-09-19T07:25:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635982, 2024-09-19T07:25:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config0" 2024-09-19T07:25:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.173 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1626396474, 2024-09-19T07:25:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635791, 2024-09-19T07:25:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget03.c" 2024-09-19T07:25:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1771791155, 2024-09-19T07:25:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511638100, 2024-09-19T07:25:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect03.c" 2024-09-19T07:25:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.174 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1895650768, 2024-09-19T07:25:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637778, 2024-09-19T07:25:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/sched_setscheduler01.c" 2024-09-19T07:25:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1937052244, 2024-09-19T07:25:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511638019, 2024-09-19T07:25:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_destroy/Makefile" 2024-09-19T07:25:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.175 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1938071360, 2024-09-19T07:25:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631692, 2024-09-19T07:25:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_event_utils_test.c" 2024-09-19T07:25:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1947914201, 2024-09-19T07:25:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630815, 2024-09-19T07:25:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_irq" 2024-09-19T07:25:24.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 1954490095, 2024-09-19T07:25:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630819, 2024-09-19T07:25:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout" 2024-09-19T07:25:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2023914764, 2024-09-19T07:25:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637559, 2024-09-19T07:25:24.177 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_getevents/Makefile" 2024-09-19T07:25:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2048143541, 2024-09-19T07:25:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635535, 2024-09-19T07:25:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_1.c" 2024-09-19T07:25:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2052074367, 2024-09-19T07:25:24.178 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635823, 2024-09-19T07:25:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/mallocstress.c" 2024-09-19T07:25:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2081055238, 2024-09-19T07:25:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637558, 2024-09-19T07:25:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_getevents/io_getevents01.c" 2024-09-19T07:25:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.179 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2109992935, 2024-09-19T07:25:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631684, 2024-09-19T07:25:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrfield_test.c" 2024-09-19T07:25:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2276440739, 2024-09-19T07:25:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630813, 2024-09-19T07:25:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data" 2024-09-19T07:25:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.180 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2292995158, 2024-09-19T07:25:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636339, 2024-09-19T07:25:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_utils.c" 2024-09-19T07:25:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2346377986, 2024-09-19T07:25:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630811, 2024-09-19T07:25:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/refer" 2024-09-19T07:25:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.181 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2358499552, 2024-09-19T07:25:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635979, 2024-09-19T07:25:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config3" 2024-09-19T07:25:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2379114353, 2024-09-19T07:25:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637414, 2024-09-19T07:25:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_chroot.c" 2024-09-19T07:25:24.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2391504796, 2024-09-19T07:25:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636921, 2024-09-19T07:25:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/Makefile" 2024-09-19T07:25:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2524505861, 2024-09-19T07:25:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630822, 2024-09-19T07:25:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal" 2024-09-19T07:25:24.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2526684176, 2024-09-19T07:25:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636338, 2024-09-19T07:25:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/smt_smp_affinity.sh" 2024-09-19T07:25:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2682946298, 2024-09-19T07:25:24.184 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637416, 2024-09-19T07:25:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/Makefile" 2024-09-19T07:25:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.185 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2719997747, 2024-09-19T07:25:24.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a057a640 1 -- 172.21.15.98:0/1991455013 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb1840a33b0 msgr2=0x7fb1840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:24.185 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a057a640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb1840a33b0 0x7fb1840a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb190005e30 tx=0x7fb190005da0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a057a640 1 -- 172.21.15.98:0/1991455013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb198102db0 msgr2=0x7fb1981985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:24.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a057a640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb198102db0 0x7fb1981985f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb19400b4a0 tx=0x7fb19400b960 comp rx=0 tx=0).stop 2024-09-19T07:25:24.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a057a640 1 -- 172.21.15.98:0/1991455013 shutdown_connections 2024-09-19T07:25:24.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a057a640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb1840a33b0 0x7fb1840a5870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a057a640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1981082e0 0x7fb19819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a057a640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb198103760 0x7fb198198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a057a640 1 --2- 172.21.15.98:0/1991455013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb198102db0 0x7fb1981985f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:24.186 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a057a640 1 -- 172.21.15.98:0/1991455013 >> 172.21.15.98:0/1991455013 conn(0x7fb1980fc7d0 msgr2=0x7fb198105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:24.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a057a640 1 -- 172.21.15.98:0/1991455013 shutdown_connections 2024-09-19T07:25:24.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:24.143+0000 7fb1a057a640 1 -- 172.21.15.98:0/1991455013 wait complete. 2024-09-19T07:25:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635811, 2024-09-19T07:25:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl02.c" 2024-09-19T07:25:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.187 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2822631266, 2024-09-19T07:25:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630823, 2024-09-19T07:25:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/cases.sh" 2024-09-19T07:25:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 2903998084, 2024-09-19T07:25:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637417, 2024-09-19T07:25:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_rawio.c" 2024-09-19T07:25:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3028671565, 2024-09-19T07:25:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635813, 2024-09-19T07:25:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl01.c" 2024-09-19T07:25:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3059258845, 2024-09-19T07:25:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636580, 2024-09-19T07:25:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.h" 2024-09-19T07:25:24.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3089219967, 2024-09-19T07:25:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637418, 2024-09-19T07:25:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_nice.c" 2024-09-19T07:25:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3128570573, 2024-09-19T07:25:24.190 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635989, 2024-09-19T07:25:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/openfile/openfile.c" 2024-09-19T07:25:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3182428227, 2024-09-19T07:25:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636337, 2024-09-19T07:25:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_affinity.c" 2024-09-19T07:25:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.191 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3189644129, 2024-09-19T07:25:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635824, 2024-09-19T07:25:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/shm_test.c" 2024-09-19T07:25:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3276058643, 2024-09-19T07:25:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636582, 2024-09-19T07:25:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/str_mod.h" 2024-09-19T07:25:24.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3368525712, 2024-09-19T07:25:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636923, 2024-09-19T07:25:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_memory_spread_testset.sh" 2024-09-19T07:25:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3400532420, 2024-09-19T07:25:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635980, 2024-09-19T07:25:24.193 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config4" 2024-09-19T07:25:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3508624721, 2024-09-19T07:25:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636340, 2024-09-19T07:25:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_utils.h" 2024-09-19T07:25:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.194 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3528258778, 2024-09-19T07:25:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630820, 2024-09-19T07:25:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout_ripv" 2024-09-19T07:25:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3585876933, 2024-09-19T07:25:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635974, 2024-09-19T07:25:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config1" 2024-09-19T07:25:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.195 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3609063774, 2024-09-19T07:25:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631695, 2024-09-19T07:25:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_enum_utils_test.c" 2024-09-19T07:25:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3653169162, 2024-09-19T07:25:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631793, 2024-09-19T07:25:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/scripts/test/generate_index.pl" 2024-09-19T07:25:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.196 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3725228464, 2024-09-19T07:25:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635981, 2024-09-19T07:25:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config6" 2024-09-19T07:25:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3770686148, 2024-09-19T07:25:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631691, 2024-09-19T07:25:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpiatca_enum_utils_test.c" 2024-09-19T07:25:24.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3863635168, 2024-09-19T07:25:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511631687, 2024-09-19T07:25:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_time_utils_test.c" 2024-09-19T07:25:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3868906926, 2024-09-19T07:25:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635810, 2024-09-19T07:25:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl03.c" 2024-09-19T07:25:24.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3886860759, 2024-09-19T07:25:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637415, 2024-09-19T07:25:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_capable_sys.sh" 2024-09-19T07:25:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3905377016, 2024-09-19T07:25:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635788, 2024-09-19T07:25:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/Makefile" 2024-09-19T07:25:24.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3941168486, 2024-09-19T07:25:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635534, 2024-09-19T07:25:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/Makefile" 2024-09-19T07:25:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.200 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3953285744, 2024-09-19T07:25:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635812, 2024-09-19T07:25:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/Makefile" 2024-09-19T07:25:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 3996610074, 2024-09-19T07:25:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511638097, 2024-09-19T07:25:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect01.c" 2024-09-19T07:25:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.201 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4093386960, 2024-09-19T07:25:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636577, 2024-09-19T07:25:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.mod.c" 2024-09-19T07:25:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4095971334, 2024-09-19T07:25:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511637910, 2024-09-19T07:25:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getsockname/Makefile" 2024-09-19T07:25:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.202 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4118237526, 2024-09-19T07:25:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635787, 2024-09-19T07:25:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget05.c" 2024-09-19T07:25:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4118672180, 2024-09-19T07:25:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511630814, 2024-09-19T07:25:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_userspace" 2024-09-19T07:25:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.203 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4122112044, 2024-09-19T07:25:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635596, 2024-09-19T07:25:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals/sigismember_stress_1.c" 2024-09-19T07:25:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4155976402, 2024-09-19T07:25:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635789, 2024-09-19T07:25:24.204 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget01.c" 2024-09-19T07:25:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4209640300, 2024-09-19T07:25:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511635976, 2024-09-19T07:25:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config7" 2024-09-19T07:25:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.205 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4274777221, 2024-09-19T07:25:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636578, 2024-09-19T07:25:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.c" 2024-09-19T07:25:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:25:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "damage_type": "backtrace", 2024-09-19T07:25:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "id": 4285421481, 2024-09-19T07:25:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 1099511636579, 2024-09-19T07:25:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: "path": "/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/Makefile" 2024-09-19T07:25:24.206 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:25:24.206 INFO:teuthology.orchestra.run.smithi098.stdout:] 2024-09-19T07:25:24.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:23 smithi139 ceph-mon[35039]: pgmap v103: 97 pgs: 97 active+clean; 2.2 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 40 op/s 2024-09-19T07:25:24.969 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T07:25:25.211 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:25.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.665+0000 7f538fe2e640 1 -- 172.21.15.98:0/3059733696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f538810e3c0 msgr2=0x7f5388110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.665+0000 7f538fe2e640 1 --2- 172.21.15.98:0/3059733696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f538810e3c0 0x7f5388110810 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f5380009ca0 tx=0x7f538002a950 comp rx=0 tx=0).stop 2024-09-19T07:25:25.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.665+0000 7f538fe2e640 1 -- 172.21.15.98:0/3059733696 shutdown_connections 2024-09-19T07:25:25.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.665+0000 7f538fe2e640 1 --2- 172.21.15.98:0/3059733696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f538810e3c0 0x7f5388110810 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.665+0000 7f538fe2e640 1 --2- 172.21.15.98:0/3059733696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5388074f40 0x7f538810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.665+0000 7f538fe2e640 1 --2- 172.21.15.98:0/3059733696 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5388074620 0x7f5388074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.665+0000 7f538fe2e640 1 -- 172.21.15.98:0/3059733696 >> 172.21.15.98:0/3059733696 conn(0x7f53880fd8c0 msgr2=0x7f53880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:25.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.665+0000 7f538fe2e640 1 -- 172.21.15.98:0/3059733696 shutdown_connections 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.665+0000 7f538fe2e640 1 -- 172.21.15.98:0/3059733696 wait complete. 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538fe2e640 1 Processor -- start 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538fe2e640 1 -- start start 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538fe2e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5388074620 0x7f538819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538fe2e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5388074f40 0x7f538819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538fe2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f538810e3c0 0x7f538819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538fe2e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f53881141c0 con 0x7f5388074620 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538fe2e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5388114040 con 0x7f5388074f40 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538fe2e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5388114340 con 0x7f538810e3c0 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538dbca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5388074620 0x7f538819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538dbca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5388074620 0x7f538819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37246/0 (socket says 172.21.15.98:37246) 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538dbca640 1 -- 172.21.15.98:0/4097060778 learned_addr learned my addr 172.21.15.98:0/4097060778 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:25.669 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538d3c9640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5388074f40 0x7f538819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538e3cb640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f538810e3c0 0x7f538819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538dbca640 1 -- 172.21.15.98:0/4097060778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f538810e3c0 msgr2=0x7f538819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538dbca640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f538810e3c0 0x7f538819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538dbca640 1 -- 172.21.15.98:0/4097060778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5388074f40 msgr2=0x7f538819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538dbca640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5388074f40 0x7f538819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538dbca640 1 -- 172.21.15.98:0/4097060778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538819f5f0 con 0x7f5388074620 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.666+0000 7f538e3cb640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f538810e3c0 0x7f538819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.667+0000 7f538dbca640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5388074620 0x7f538819a640 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f538400b4a0 tx=0x7f538400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.667+0000 7f537effd640 1 -- 172.21.15.98:0/4097060778 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384015020 con 0x7f5388074620 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.667+0000 7f537effd640 1 -- 172.21.15.98:0/4097060778 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5384011d10 con 0x7f5388074620 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.667+0000 7f537effd640 1 -- 172.21.15.98:0/4097060778 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538400f2e0 con 0x7f5388074620 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.667+0000 7f538fe2e640 1 -- 172.21.15.98:0/4097060778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538819f8e0 con 0x7f5388074620 2024-09-19T07:25:25.670 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.667+0000 7f538fe2e640 1 -- 172.21.15.98:0/4097060778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53881a71c0 con 0x7f5388074620 2024-09-19T07:25:25.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.669+0000 7f537effd640 1 -- 172.21.15.98:0/4097060778 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5384018020 con 0x7f5388074620 2024-09-19T07:25:25.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.669+0000 7f5392207740 1 Processor -- start 2024-09-19T07:25:25.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.669+0000 7f5392207740 1 -- start start 2024-09-19T07:25:25.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f5392207740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a49281b40 0x555a49280090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f5392207740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a492805d0 0x555a49280a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.676 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f5392207740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a4928b370 0x555a4928d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f5392207740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555a491e62f0 con 0x555a49281b40 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f5392207740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555a4918dcf0 con 0x555a4928b370 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f5392207740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555a491e22b0 con 0x555a492805d0 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538e3cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a49281b40 0x555a49280090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538e3cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a49281b40 0x555a49280090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37262/0 (socket says 172.21.15.98:37262) 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538e3cb640 1 -- 172.21.15.98:0/998357615 learned_addr learned my addr 172.21.15.98:0/998357615 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538d3c9640 1 --2- 172.21.15.98:0/998357615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a4928b370 0x555a4928d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f537effd640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f53740a33b0 0x7f53740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538dbca640 1 --2- 172.21.15.98:0/998357615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a492805d0 0x555a49280a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538e3cb640 1 -- 172.21.15.98:0/998357615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a492805d0 msgr2=0x555a49280a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538e3cb640 1 --2- 172.21.15.98:0/998357615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a492805d0 0x555a49280a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538e3cb640 1 -- 172.21.15.98:0/998357615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a4928b370 msgr2=0x555a4928d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:25.677 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f537effd640 1 -- 172.21.15.98:0/4097060778 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f53840cf550 con 0x7f5388074620 2024-09-19T07:25:25.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538e3cb640 1 --2- 172.21.15.98:0/998357615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a4928b370 0x555a4928d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538e3cb640 1 -- 172.21.15.98:0/998357615 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a491723a0 con 0x555a49281b40 2024-09-19T07:25:25.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538d3c9640 1 --2- 172.21.15.98:0/998357615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a4928b370 0x555a4928d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:25:25.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538e3cb640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f53740a33b0 0x7f53740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.670+0000 7f538e3cb640 1 --2- 172.21.15.98:0/998357615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a49281b40 0x555a49280090 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5380006010 tx=0x7f538002f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc95164f4d8faec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:25.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.671+0000 7f5373fff640 1 -- 172.21.15.98:0/998357615 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380040040 con 0x555a49281b40 2024-09-19T07:25:25.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.671+0000 7f5373fff640 1 -- 172.21.15.98:0/998357615 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5380004520 con 0x555a49281b40 2024-09-19T07:25:25.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.671+0000 7f5373fff640 1 -- 172.21.15.98:0/998357615 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380034070 con 0x555a49281b40 2024-09-19T07:25:25.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.671+0000 7f5392207740 1 -- 172.21.15.98:0/998357615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a49281b40 msgr2=0x555a49280090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.671+0000 7f5392207740 1 --2- 172.21.15.98:0/998357615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a49281b40 0x555a49280090 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5380006010 tx=0x7f538002f9c0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.671+0000 7f538e3cb640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f53740a33b0 0x7f53740a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f538004b000 tx=0x7f538004c000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:25.678 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.671+0000 7f5392207740 1 -- 172.21.15.98:0/998357615 shutdown_connections 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.671+0000 7f5392207740 1 --2- 172.21.15.98:0/998357615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a4928b370 0x555a4928d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.671+0000 7f5392207740 1 --2- 172.21.15.98:0/998357615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a492805d0 0x555a49280a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.671+0000 7f5392207740 1 --2- 172.21.15.98:0/998357615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a49281b40 0x555a49280090 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.671+0000 7f5392207740 1 -- 172.21.15.98:0/998357615 >> 172.21.15.98:0/998357615 conn(0x555a49249310 msgr2=0x555a4927cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.672+0000 7f5392207740 1 -- 172.21.15.98:0/998357615 shutdown_connections 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.672+0000 7f5392207740 1 -- 172.21.15.98:0/998357615 wait complete. 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.672+0000 7f5392207740 1 -- start start 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.672+0000 7f5392207740 1 Processor -- start 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.672+0000 7f5392207740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 0x555a4928ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.672+0000 7f5392207740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a49281b40 0x555a49288020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.672+0000 7f5392207740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a4928b370 0x555a49288610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.672+0000 7f5392207740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555a4928e070 con 0x555a492805d0 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.672+0000 7f5392207740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555a491a1060 con 0x555a49281b40 2024-09-19T07:25:25.679 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.672+0000 7f5392207740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555a4928e1f0 con 0x555a4928b370 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.672+0000 7f5392207740 10 client.0 _ll_register_callbacks cb 0x555a48ef48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f538dbca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 0x555a4928ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f538dbca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 0x555a4928ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37278/0 (socket says 172.21.15.98:37278) 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f538dbca640 1 -- 172.21.15.98:0/1223879552 learned_addr learned my addr 172.21.15.98:0/1223879552 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f538d3c9640 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a49281b40 0x555a49288020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f538e3cb640 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a4928b370 0x555a49288610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f538dbca640 1 -- 172.21.15.98:0/1223879552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a4928b370 msgr2=0x555a49288610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f538dbca640 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a4928b370 0x555a49288610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f538dbca640 1 -- 172.21.15.98:0/1223879552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a49281b40 msgr2=0x555a49288020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f538dbca640 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a49281b40 0x555a49288020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f538dbca640 1 -- 172.21.15.98:0/1223879552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a48f573c0 con 0x555a492805d0 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f538dbca640 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 0x555a4928ad70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f53840ccde0 tx=0x7f538409b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4198eb723a27f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:25.680 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f53717fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f53717fa640 1 -- 172.21.15.98:0/1223879552 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538409c010 con 0x555a492805d0 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f53717fa640 1 -- 172.21.15.98:0/1223879552 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f53840666a0 con 0x555a492805d0 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f5392207740 1 -- 172.21.15.98:0/1223879552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5380004520 con 0x555a492805d0 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f53717fa640 1 -- 172.21.15.98:0/1223879552 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f538409fcc0 con 0x555a492805d0 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f5392207740 10 client.16311 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.673+0000 7f5392207740 1 -- 172.21.15.98:0/1223879552 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555a49299b70 con 0x555a492805d0 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.674+0000 7f53717fa640 1 -- 172.21.15.98:0/1223879552 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5380004520 con 0x555a492805d0 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.674+0000 7f53717fa640 1 -- 172.21.15.98:0/1223879552 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f5384097f80 con 0x555a492805d0 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.674+0000 7f5392207740 10 client.16311 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.674+0000 7f5392207740 10 client.16311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.674+0000 7f5392207740 20 client.16311 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.674+0000 7f5392207740 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555a4929b030 0x555a4929d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.681 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.674+0000 7f5392207740 4 client.16311 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:25.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.674+0000 7f5392207740 1 -- 172.21.15.98:0/1223879552 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a491f3860 con 0x555a4929b030 2024-09-19T07:25:25.682 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.674+0000 7f538d3c9640 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555a4929b030 0x555a4929d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.674+0000 7f538d3c9640 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555a4929b030 0x555a4929d490 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36f49f2a90297d74 server_cookie=bee610d2691f655a in_seq=0 out_seq=0 2024-09-19T07:25:25.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.674+0000 7f53717fa640 10 client.16311 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:25.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f53717fa640 1 -- 172.21.15.98:0/1223879552 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a491f3860 con 0x555a4929b030 2024-09-19T07:25:25.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f53717fa640 10 client.16311 handle_command_reply: tid=0 2024-09-19T07:25:25.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f5392207740 1 client.16311 shutdown 2024-09-19T07:25:25.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f5392207740 1 -- 172.21.15.98:0/1223879552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 msgr2=0x555a4928ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f5392207740 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 0x555a4928ad70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f53840ccde0 tx=0x7f538409b7e0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.683 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f5392207740 1 -- 172.21.15.98:0/1223879552 shutdown_connections 2024-09-19T07:25:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f5392207740 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a4928b370 0x555a49288610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f5392207740 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a49281b40 0x555a49288020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f5392207740 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555a4929b030 0x555a4929d490 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f5392207740 1 --2- 172.21.15.98:0/1223879552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 0x555a4928ad70 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f5392207740 1 -- 172.21.15.98:0/1223879552 >> 172.21.15.98:0/1223879552 conn(0x555a49249310 msgr2=0x555a49282960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f53717fa640 0 client.16311 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f5392207740 1 -- 172.21.15.98:0/1223879552 shutdown_connections 2024-09-19T07:25:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.675+0000 7f5392207740 1 -- 172.21.15.98:0/1223879552 wait complete. 2024-09-19T07:25:25.684 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.676+0000 7f5392207740 20 client.16311 trim_cache size 0 max 16384 2024-09-19T07:25:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.688+0000 7f5392207740 1 Processor -- start 2024-09-19T07:25:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.688+0000 7f5392207740 1 -- start start 2024-09-19T07:25:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.688+0000 7f5392207740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 0x555a4927bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.688+0000 7f5392207740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a49281b40 0x555a49283120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.688+0000 7f5392207740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a4928b370 0x555a49283660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.688+0000 7f5392207740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f53881b24d0 con 0x555a492805d0 2024-09-19T07:25:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.688+0000 7f5392207740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f53881afce0 con 0x555a49281b40 2024-09-19T07:25:25.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.688+0000 7f5392207740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f53881adb30 con 0x555a4928b370 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f538dbca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 0x555a4927bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f538dbca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 0x555a4927bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37282/0 (socket says 172.21.15.98:37282) 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f538dbca640 1 -- 172.21.15.98:0/2040231779 learned_addr learned my addr 172.21.15.98:0/2040231779 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f538dbca640 1 -- 172.21.15.98:0/2040231779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a4928b370 msgr2=0x555a49283660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f538d3c9640 1 --2- 172.21.15.98:0/2040231779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a49281b40 0x555a49283120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f538e3cb640 1 --2- 172.21.15.98:0/2040231779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a4928b370 0x555a49283660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f538dbca640 1 --2- 172.21.15.98:0/2040231779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a4928b370 0x555a49283660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f538dbca640 1 -- 172.21.15.98:0/2040231779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a49281b40 msgr2=0x555a49283120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f538dbca640 1 --2- 172.21.15.98:0/2040231779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a49281b40 0x555a49283120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f538dbca640 1 -- 172.21.15.98:0/2040231779 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a49286590 con 0x555a492805d0 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f538d3c9640 1 --2- 172.21.15.98:0/2040231779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a49281b40 0x555a49283120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f538dbca640 1 --2- 172.21.15.98:0/2040231779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 0x555a4927bbf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f538409b8a0 tx=0x7f5384010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b21602aabdd93fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f53737fe640 1 -- 172.21.15.98:0/2040231779 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538409b270 con 0x555a492805d0 2024-09-19T07:25:25.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f53737fe640 1 -- 172.21.15.98:0/2040231779 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f538409c010 con 0x555a492805d0 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.689+0000 7f53737fe640 1 -- 172.21.15.98:0/2040231779 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384060bd0 con 0x555a492805d0 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.690+0000 7f5392207740 1 -- 172.21.15.98:0/2040231779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 msgr2=0x555a4927bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.690+0000 7f5392207740 1 --2- 172.21.15.98:0/2040231779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 0x555a4927bbf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f538409b8a0 tx=0x7f5384010910 comp rx=0 tx=0).stop 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.690+0000 7f5392207740 1 -- 172.21.15.98:0/2040231779 shutdown_connections 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.690+0000 7f5392207740 1 --2- 172.21.15.98:0/2040231779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a4928b370 0x555a49283660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.690+0000 7f5392207740 1 --2- 172.21.15.98:0/2040231779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a49281b40 0x555a49283120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.690+0000 7f5392207740 1 --2- 172.21.15.98:0/2040231779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a492805d0 0x555a4927bbf0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.690+0000 7f5392207740 1 -- 172.21.15.98:0/2040231779 >> 172.21.15.98:0/2040231779 conn(0x555a49249310 msgr2=0x555a4927b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.690+0000 7f5392207740 1 -- 172.21.15.98:0/2040231779 shutdown_connections 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.690+0000 7f5392207740 1 -- 172.21.15.98:0/2040231779 wait complete. 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.690+0000 7f5392207740 1 -- start start 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.690+0000 7f5392207740 1 Processor -- start 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f5392207740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a492805d0 0x555a492851c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f5392207740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a49281b40 0x555a49285700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f5392207740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a4928b370 0x555a49285c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f5392207740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f53881ae1a0 con 0x555a4928b370 2024-09-19T07:25:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f5392207740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f53881af610 con 0x555a492805d0 2024-09-19T07:25:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f5392207740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f53881ae870 con 0x555a49281b40 2024-09-19T07:25:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f5392207740 10 client.0 _ll_register_callbacks cb 0x7f5384097c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f538e3cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a4928b370 0x555a49285c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f538e3cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a4928b370 0x555a49285c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37294/0 (socket says 172.21.15.98:37294) 2024-09-19T07:25:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f538e3cb640 1 -- 172.21.15.98:0/2604103487 learned_addr learned my addr 172.21.15.98:0/2604103487 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f538dbca640 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a492805d0 0x555a492851c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f538d3c9640 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a49281b40 0x555a49285700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f538e3cb640 1 -- 172.21.15.98:0/2604103487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a49281b40 msgr2=0x555a49285700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:25.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f538e3cb640 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a49281b40 0x555a49285700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f538e3cb640 1 -- 172.21.15.98:0/2604103487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a492805d0 msgr2=0x555a492851c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f538e3cb640 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a492805d0 0x555a492851c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f538e3cb640 1 -- 172.21.15.98:0/2604103487 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a49304e90 con 0x555a4928b370 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f538d3c9640 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a49281b40 0x555a49285700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f538e3cb640 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a4928b370 0x555a49285c40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5380030820 tx=0x7f5380030850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f3e7efea334e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f53717fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f53717fa640 1 -- 172.21.15.98:0/2604103487 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380040040 con 0x555a4928b370 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f53717fa640 1 -- 172.21.15.98:0/2604103487 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f5380030a00 con 0x555a4928b370 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.691+0000 7f5392207740 1 -- 172.21.15.98:0/2604103487 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f538409c010 con 0x555a4928b370 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.692+0000 7f53717fa640 1 -- 172.21.15.98:0/2604103487 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5380034040 con 0x555a4928b370 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.692+0000 7f5392207740 10 client.16317 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.692+0000 7f5392207740 1 -- 172.21.15.98:0/2604103487 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555a493060e0 con 0x555a4928b370 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.692+0000 7f53717fa640 1 -- 172.21.15.98:0/2604103487 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f538409c010 con 0x555a4928b370 2024-09-19T07:25:25.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.692+0000 7f53717fa640 1 -- 172.21.15.98:0/2604103487 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f5380004640 con 0x555a4928b370 2024-09-19T07:25:25.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.692+0000 7f5392207740 10 client.16317 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:25.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.692+0000 7f5392207740 10 client.16317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T07:25:25.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.692+0000 7f5392207740 20 client.16317 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:25.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.692+0000 7f5392207740 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555a49306370 0x555a49308760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:25.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.692+0000 7f5392207740 4 client.16317 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T07:25:25.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.692+0000 7f5392207740 1 -- 172.21.15.98:0/2604103487 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a491edd70 con 0x555a49306370 2024-09-19T07:25:25.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.692+0000 7f538dbca640 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555a49306370 0x555a49308760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:25.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f53717fa640 10 client.16317 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:25.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f538dbca640 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555a49306370 0x555a49308760 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=397950afb15c2121 server_cookie=ede85f222dddabff in_seq=0 out_seq=0 2024-09-19T07:25:25.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f53717fa640 1 -- 172.21.15.98:0/2604103487 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a491edd70 con 0x555a49306370 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f53717fa640 10 client.16317 handle_command_reply: tid=0 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f5392207740 1 client.16317 shutdown 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f5392207740 1 -- 172.21.15.98:0/2604103487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a4928b370 msgr2=0x555a49285c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f5392207740 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a4928b370 0x555a49285c40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5380030820 tx=0x7f5380030850 comp rx=0 tx=0).stop 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f5392207740 1 -- 172.21.15.98:0/2604103487 shutdown_connections 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f5392207740 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555a49306370 0x555a49308760 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f5392207740 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a4928b370 0x555a49285c40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f5392207740 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555a49281b40 0x555a49285700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f53717fa640 0 client.16317 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f5392207740 1 --2- 172.21.15.98:0/2604103487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555a492805d0 0x555a492851c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f5392207740 1 -- 172.21.15.98:0/2604103487 >> 172.21.15.98:0/2604103487 conn(0x555a49249310 msgr2=0x555a4927bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f5392207740 1 -- 172.21.15.98:0/2604103487 shutdown_connections 2024-09-19T07:25:25.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f5392207740 1 -- 172.21.15.98:0/2604103487 wait complete. 2024-09-19T07:25:25.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.693+0000 7f5392207740 20 client.16317 trim_cache size 0 max 16384 2024-09-19T07:25:25.701 INFO:teuthology.orchestra.run.smithi098.stdout:[] 2024-09-19T07:25:25.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.694+0000 7f538fe2e640 1 -- 172.21.15.98:0/4097060778 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f53740a33b0 msgr2=0x7f53740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.694+0000 7f538fe2e640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f53740a33b0 0x7f53740a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f538004b000 tx=0x7f538004c000 comp rx=0 tx=0).stop 2024-09-19T07:25:25.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.694+0000 7f538fe2e640 1 -- 172.21.15.98:0/4097060778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5388074620 msgr2=0x7f538819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:25.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.694+0000 7f538fe2e640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5388074620 0x7f538819a640 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f538400b4a0 tx=0x7f538400b8a0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.694+0000 7f538fe2e640 1 -- 172.21.15.98:0/4097060778 shutdown_connections 2024-09-19T07:25:25.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.694+0000 7f538fe2e640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f53740a33b0 0x7f53740a5870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.694+0000 7f538fe2e640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f538810e3c0 0x7f538819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.694+0000 7f538fe2e640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5388074f40 0x7f538819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.694+0000 7f538fe2e640 1 --2- 172.21.15.98:0/4097060778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5388074620 0x7f538819a640 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:25.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.694+0000 7f538fe2e640 1 -- 172.21.15.98:0/4097060778 >> 172.21.15.98:0/4097060778 conn(0x7f53880fd8c0 msgr2=0x7f53880fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:25.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.694+0000 7f538fe2e640 1 -- 172.21.15.98:0/4097060778 shutdown_connections 2024-09-19T07:25:25.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:25.694+0000 7f538fe2e640 1 -- 172.21.15.98:0/4097060778 wait complete. 2024-09-19T07:25:26.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:25 smithi162 ceph-mon[35726]: pgmap v104: 97 pgs: 97 active+clean; 2.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 55 op/s 2024-09-19T07:25:26.158 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7faf9dffb640 1 -- 172.21.15.98:0/4284855539 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee404d9d70 con 0x55ee405f6770 2024-09-19T07:25:26.158 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7faf9dffb640 10 client.16239 handle_command_reply: tid=0 2024-09-19T07:25:26.158 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7fafbf21c740 1 client.16239 shutdown 2024-09-19T07:25:26.158 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7fafbf21c740 1 -- 172.21.15.98:0/4284855539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056d970 msgr2=0x55ee4057eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:26.158 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7fafbf21c740 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056d970 0x55ee4057eec0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fafb002a460 tx=0x7fafb00092d0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7fafbf21c740 1 -- 172.21.15.98:0/4284855539 shutdown_connections 2024-09-19T07:25:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7fafbf21c740 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee4057aec0 0x55ee4057f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7fafbf21c740 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4056e290 0x55ee4057f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7fafbf21c740 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55ee405f6770 0x55ee405f8b90 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7fafbf21c740 1 --2- 172.21.15.98:0/4284855539 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ee4056d970 0x55ee4057eec0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7faf9dffb640 0 client.16239 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7fafbf21c740 1 -- 172.21.15.98:0/4284855539 >> 172.21.15.98:0/4284855539 conn(0x55ee4056a060 msgr2=0x55ee405691c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7fafbf21c740 1 -- 172.21.15.98:0/4284855539 shutdown_connections 2024-09-19T07:25:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.156+0000 7fafbf21c740 1 -- 172.21.15.98:0/4284855539 wait complete. 2024-09-19T07:25:26.159 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbf21c740 20 client.16239 trim_cache size 0 max 16384 2024-09-19T07:25:26.160 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:25:26.160 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:25:26.160 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:25:26.160 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:25:26.161 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbc47b640 1 -- 172.21.15.98:0/991563535 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fafa00a3460 msgr2=0x7fafa00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:26.161 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbc47b640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fafa00a3460 0x7fafa00a5920 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fafa4012980 tx=0x7fafa400bb80 comp rx=0 tx=0).stop 2024-09-19T07:25:26.161 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbc47b640 1 -- 172.21.15.98:0/991563535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb41069e0 msgr2=0x7fafb419bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:26.161 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbc47b640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb41069e0 0x7fafb419bb90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fafac00cad0 tx=0x7fafac00cf90 comp rx=0 tx=0).stop 2024-09-19T07:25:26.161 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbc47b640 1 -- 172.21.15.98:0/991563535 shutdown_connections 2024-09-19T07:25:26.161 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbc47b640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fafa00a3460 0x7fafa00a5920 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.162 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbc47b640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafb41069e0 0x7fafb419bb90 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.162 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbc47b640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fafb4101370 0x7fafb4197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.162 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbc47b640 1 --2- 172.21.15.98:0/991563535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafb41009d0 0x7fafb41972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:26.162 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbc47b640 1 -- 172.21.15.98:0/991563535 >> 172.21.15.98:0/991563535 conn(0x7fafb40fc6b0 msgr2=0x7fafb40fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:26.162 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbc47b640 1 -- 172.21.15.98:0/991563535 shutdown_connections 2024-09-19T07:25:26.162 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:26.157+0000 7fafbc47b640 1 -- 172.21.15.98:0/991563535 wait complete. 2024-09-19T07:25:26.163 INFO:tasks.workunit.client.0.smithi098.stdout:5/748: link dc/de/d13/d46/d2e/d37/d81/fd1 dc/de/d13/d46/d23/f107 0 2024-09-19T07:25:26.163 INFO:tasks.workunit.client.0.smithi098.stdout:5/749: write dc/de/d36/d71/f73 [956769,4344] 0 2024-09-19T07:25:26.163 INFO:tasks.workunit.client.0.smithi098.stdout:5/750: creat dc/de/f108 x:0 0 0 2024-09-19T07:25:26.173 INFO:tasks.workunit.client.0.smithi098.stdout:5/751: dread dc/de/d36/f39 [0,4194304] 0 2024-09-19T07:25:26.177 INFO:tasks.workunit.client.0.smithi098.stdout:5/752: dread dc/de/d13/f19 [0,4194304] 0 2024-09-19T07:25:26.178 INFO:tasks.workunit.client.0.smithi098.stdout:5/753: creat dc/de/d13/f109 x:0 0 0 2024-09-19T07:25:26.179 INFO:tasks.workunit.client.0.smithi098.stdout:5/754: link dc/de/d13/d5c/l69 dc/de/d36/d71/l10a 0 2024-09-19T07:25:26.180 INFO:tasks.workunit.client.0.smithi098.stdout:8/920: sync 2024-09-19T07:25:26.180 INFO:tasks.workunit.client.0.smithi098.stdout:9/872: sync 2024-09-19T07:25:26.180 INFO:tasks.workunit.client.0.smithi098.stdout:3/907: sync 2024-09-19T07:25:26.180 INFO:tasks.workunit.client.0.smithi098.stdout:6/921: sync 2024-09-19T07:25:26.180 INFO:tasks.workunit.client.0.smithi098.stdout:2/993: sync 2024-09-19T07:25:26.185 INFO:tasks.workunit.client.0.smithi098.stdout:6/922: unlink d2/d5/d1f/d26/d42/d48/dc3/cc5 0 2024-09-19T07:25:26.185 INFO:tasks.workunit.client.0.smithi098.stdout:2/994: mknod d1/d5/d72/db5/dad/d10a/c154 0 2024-09-19T07:25:26.185 INFO:tasks.workunit.client.0.smithi098.stdout:5/755: rmdir dc/de/d13/d46/d2e/d37/d67 39 2024-09-19T07:25:26.185 INFO:tasks.workunit.client.0.smithi098.stdout:5/756: dread - dc/de/d13/d46/d23/dc1/fe0 zero size 2024-09-19T07:25:26.186 INFO:tasks.workunit.client.0.smithi098.stdout:5/757: rmdir dc/de/d13/d46/d2e/da5 39 2024-09-19T07:25:26.186 INFO:tasks.workunit.client.0.smithi098.stdout:5/758: mknod dc/de/d13/d46/d2e/d37/d6d/dee/c10b 0 2024-09-19T07:25:26.186 INFO:tasks.workunit.client.0.smithi098.stdout:5/759: truncate dc/de/d13/d46/d23/d5e/fae 28233 0 2024-09-19T07:25:26.186 INFO:tasks.workunit.client.0.smithi098.stdout:8/921: write d0/d16/fcd [4902200,61193] 0 2024-09-19T07:25:26.187 INFO:tasks.workunit.client.0.smithi098.stdout:5/760: getdents dc/de/d13/d46/d2e 0 2024-09-19T07:25:26.187 INFO:tasks.workunit.client.0.smithi098.stdout:5/761: readlink dc/de/d13/d46/d2e/d37/d6d/l7a 0 2024-09-19T07:25:26.188 INFO:tasks.workunit.client.0.smithi098.stdout:3/908: rmdir de/df/d31/d61/d3f/d64/d84 39 2024-09-19T07:25:26.189 INFO:tasks.workunit.client.0.smithi098.stdout:8/922: getdents d0/d2c/d81 0 2024-09-19T07:25:26.189 INFO:tasks.workunit.client.0.smithi098.stdout:5/762: chown dc/de/l92 783158409 1 2024-09-19T07:25:26.190 INFO:tasks.workunit.client.0.smithi098.stdout:8/923: mkdir d0/d132 0 2024-09-19T07:25:26.192 INFO:tasks.workunit.client.0.smithi098.stdout:3/909: creat de/df/d31/d61/d79/f10e x:0 0 0 2024-09-19T07:25:26.192 INFO:tasks.workunit.client.0.smithi098.stdout:3/910: fsync de/deb/f10b 0 2024-09-19T07:25:26.192 INFO:tasks.workunit.client.0.smithi098.stdout:8/924: mkdir d0/d33/d55/d8a/d21/d133 0 2024-09-19T07:25:26.192 INFO:tasks.workunit.client.0.smithi098.stdout:5/763: rmdir dc/de 39 2024-09-19T07:25:26.192 INFO:tasks.workunit.client.0.smithi098.stdout:2/995: write d1/f57 [6787025,26557] 0 2024-09-19T07:25:26.193 INFO:tasks.workunit.client.0.smithi098.stdout:3/911: symlink de/d4e/l10f 0 2024-09-19T07:25:26.195 INFO:tasks.workunit.client.0.smithi098.stdout:8/925: mknod d0/d16/d7d/dcc/c134 0 2024-09-19T07:25:26.195 INFO:tasks.workunit.client.0.smithi098.stdout:8/926: stat d0/d33/d55/d8a/d28/c2a 0 2024-09-19T07:25:26.196 INFO:tasks.workunit.client.0.smithi098.stdout:5/764: mknod dc/de/d13/d46/d2e/da5/c10c 0 2024-09-19T07:25:26.197 INFO:tasks.workunit.client.0.smithi098.stdout:5/765: stat dc/de/d13/d46/d2e/d37/d67/f89 0 2024-09-19T07:25:26.197 INFO:tasks.workunit.client.0.smithi098.stdout:5/766: write dc/de/d13/d46/d2e/da5/ff2 [1895634,13603] 0 2024-09-19T07:25:26.198 INFO:tasks.workunit.client.0.smithi098.stdout:8/927: creat d0/dc5/f135 x:0 0 0 2024-09-19T07:25:26.199 INFO:tasks.workunit.client.0.smithi098.stdout:5/767: mkdir dc/de/d13/d5c/d10d 0 2024-09-19T07:25:26.200 INFO:tasks.workunit.client.0.smithi098.stdout:8/928: unlink d0/d2c/l38 0 2024-09-19T07:25:26.207 INFO:tasks.workunit.client.0.smithi098.stdout:8/929: write d0/d33/d55/d8a/f75 [4537468,29455] 0 2024-09-19T07:25:26.210 INFO:tasks.workunit.client.0.smithi098.stdout:8/930: getdents d0/dc5 0 2024-09-19T07:25:26.210 INFO:tasks.workunit.client.0.smithi098.stdout:8/931: readlink d0/d33/d55/d8a/d12/dba/ld1 0 2024-09-19T07:25:26.211 INFO:tasks.workunit.client.0.smithi098.stdout:8/932: creat d0/dc5/d11a/f136 x:0 0 0 2024-09-19T07:25:26.212 INFO:tasks.workunit.client.0.smithi098.stdout:8/933: fdatasync d0/d16/d7d/f103 0 2024-09-19T07:25:26.214 INFO:tasks.workunit.client.0.smithi098.stdout:5/768: write dc/de/d13/d46/d23/f5f [1303660,64133] 0 2024-09-19T07:25:26.218 INFO:tasks.workunit.client.0.smithi098.stdout:3/912: rename de/df/d1f/d2b/f3a to de/d4e/d6d/f110 0 2024-09-19T07:25:26.220 INFO:tasks.workunit.client.0.smithi098.stdout:8/934: rename d0/d33/d55/l93 to d0/d16/d65/d111/l137 0 2024-09-19T07:25:26.222 INFO:tasks.workunit.client.0.smithi098.stdout:3/913: mknod de/df/d31/d61/d79/c111 0 2024-09-19T07:25:26.223 INFO:tasks.workunit.client.0.smithi098.stdout:9/873: dwrite d3/d6/d46/ff0 [0,4194304] 0 2024-09-19T07:25:26.224 INFO:tasks.workunit.client.0.smithi098.stdout:3/914: creat de/d4e/d6d/d8c/dab/de6/f112 x:0 0 0 2024-09-19T07:25:26.224 INFO:tasks.workunit.client.0.smithi098.stdout:6/923: dwrite d2/d5/d1f/d26/d42/d48/d53/d64/d79/f8c [0,4194304] 0 2024-09-19T07:25:26.224 INFO:tasks.workunit.client.0.smithi098.stdout:2/996: dwrite d1/d9/d26/d35/d88/dc2/dfb/f131 [0,4194304] 0 2024-09-19T07:25:26.224 INFO:tasks.workunit.client.0.smithi098.stdout:2/997: chown d1/d9/d26/d35/d48/d6e/f120 31056 1 2024-09-19T07:25:26.224 INFO:tasks.workunit.client.0.smithi098.stdout:2/998: fdatasync d1/f145 0 2024-09-19T07:25:26.224 INFO:tasks.workunit.client.0.smithi098.stdout:2/999: chown d1/d9/d26/d35/f6b 11962476 1 2024-09-19T07:25:26.226 INFO:tasks.workunit.client.0.smithi098.stdout:6/924: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/l146 0 2024-09-19T07:25:26.228 INFO:tasks.workunit.client.0.smithi098.stdout:6/925: rename d2/d5/d1f/d26/d42/l51 to d2/d5/d1f/d26/d42/d48/d53/d64/l147 0 2024-09-19T07:25:26.229 INFO:tasks.workunit.client.0.smithi098.stdout:5/769: dread dc/de/f4d [0,4194304] 0 2024-09-19T07:25:26.229 INFO:tasks.workunit.client.0.smithi098.stdout:5/770: stat dc/de/d13/d46/d2e/f102 0 2024-09-19T07:25:26.232 INFO:tasks.workunit.client.0.smithi098.stdout:5/771: mkdir dc/de/d13/d46/d2e/d37/d6d/d10e 0 2024-09-19T07:25:26.238 INFO:tasks.workunit.client.0.smithi098.stdout:5/772: write f3 [3937240,81414] 0 2024-09-19T07:25:26.238 INFO:tasks.workunit.client.0.smithi098.stdout:6/926: write d2/d5/f3b [43097,97547] 0 2024-09-19T07:25:26.238 INFO:tasks.workunit.client.0.smithi098.stdout:5/773: chown dc/de/d13/d5c/fea 68437 1 2024-09-19T07:25:26.238 INFO:tasks.workunit.client.0.smithi098.stdout:6/927: fdatasync d2/d5/d1f/d26/d42/d48/d53/f5f 0 2024-09-19T07:25:26.240 INFO:tasks.workunit.client.0.smithi098.stdout:6/928: mkdir d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/d131/d148 0 2024-09-19T07:25:26.242 INFO:tasks.workunit.client.0.smithi098.stdout:6/929: truncate d2/d5/ff1 34990 0 2024-09-19T07:25:26.243 INFO:tasks.workunit.client.0.smithi098.stdout:9/874: write d3/d16/d38/d48/f9d [1418228,39994] 0 2024-09-19T07:25:26.243 INFO:tasks.workunit.client.0.smithi098.stdout:9/875: read d3/d16/f3c [2082241,85600] 0 2024-09-19T07:25:26.243 INFO:tasks.workunit.client.0.smithi098.stdout:9/876: chown d3/dc/df/d15/d2f 5745 1 2024-09-19T07:25:26.243 INFO:tasks.workunit.client.0.smithi098.stdout:9/877: write d3/dc/df/d15/d1a/d2d/d7f/ff8 [914128,13902] 0 2024-09-19T07:25:26.245 INFO:tasks.workunit.client.0.smithi098.stdout:9/878: rename d3/d16/d43/lc2 to d3/dc/df/d15/l122 0 2024-09-19T07:25:26.245 INFO:tasks.workunit.client.0.smithi098.stdout:9/879: readlink d3/dc/df/d15/d2f/lbe 0 2024-09-19T07:25:26.246 INFO:tasks.workunit.client.0.smithi098.stdout:9/880: mknod d3/dc/df/d15/c123 0 2024-09-19T07:25:26.248 INFO:tasks.workunit.client.0.smithi098.stdout:9/881: symlink d3/d30/d73/l124 0 2024-09-19T07:25:26.248 INFO:tasks.workunit.client.0.smithi098.stdout:9/882: write d3/d16/d38/fc6 [215319,87818] 0 2024-09-19T07:25:26.248 INFO:tasks.workunit.client.0.smithi098.stdout:9/883: rmdir d3/d16/d38/d48 39 2024-09-19T07:25:26.250 INFO:tasks.workunit.client.0.smithi098.stdout:5/774: read dc/de/d13/d46/d2e/d37/d81/fd1 [358486,82044] 0 2024-09-19T07:25:26.250 INFO:tasks.workunit.client.0.smithi098.stdout:5/775: chown dc/de/d13/d46/l44 15804 1 2024-09-19T07:25:26.250 INFO:tasks.workunit.client.0.smithi098.stdout:9/884: rmdir d3/dc/df/d15 39 2024-09-19T07:25:26.251 INFO:tasks.workunit.client.0.smithi098.stdout:9/885: mkdir d3/d6/d8/d125 0 2024-09-19T07:25:26.251 INFO:tasks.workunit.client.0.smithi098.stdout:9/886: fsync d3/d16/d43/d51/d6e/f10e 0 2024-09-19T07:25:26.252 INFO:tasks.workunit.client.0.smithi098.stdout:5/776: mkdir dc/de/d13/d46/d2e/d37/d67/d75/d10f 0 2024-09-19T07:25:26.252 INFO:tasks.workunit.client.0.smithi098.stdout:9/887: truncate d3/d6/d46/d83/fdb 1308880 0 2024-09-19T07:25:26.253 INFO:tasks.workunit.client.0.smithi098.stdout:5/777: mkdir dc/de/d36/d71/d84/d110 0 2024-09-19T07:25:26.255 INFO:tasks.workunit.client.0.smithi098.stdout:5/778: creat dc/de/d13/d46/d2e/d37/d6d/d10e/f111 x:0 0 0 2024-09-19T07:25:26.255 INFO:tasks.workunit.client.0.smithi098.stdout:9/888: mknod d3/dc/df/d15/d1a/c126 0 2024-09-19T07:25:26.256 INFO:tasks.workunit.client.0.smithi098.stdout:8/935: dwrite d0/d16/d7d/dcc/dd2/df5/d115/f119 [0,4194304] 0 2024-09-19T07:25:26.256 INFO:tasks.workunit.client.0.smithi098.stdout:3/915: dwrite de/d4e/fde [0,4194304] 0 2024-09-19T07:25:26.256 INFO:tasks.workunit.client.0.smithi098.stdout:8/936: read d0/d16/f17 [4809794,127832] 0 2024-09-19T07:25:26.256 INFO:tasks.workunit.client.0.smithi098.stdout:9/889: truncate d3/d16/d38/f36 1782314 0 2024-09-19T07:25:26.257 INFO:tasks.workunit.client.0.smithi098.stdout:9/890: read d3/dc/df/f4e [147814,27996] 0 2024-09-19T07:25:26.257 INFO:tasks.workunit.client.0.smithi098.stdout:9/891: fsync d3/d16/d43/d51/dd3/de6/fec 0 2024-09-19T07:25:26.261 INFO:tasks.workunit.client.0.smithi098.stdout:6/930: dwrite d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/d131/fff [0,4194304] 0 2024-09-19T07:25:26.264 INFO:tasks.workunit.client.0.smithi098.stdout:3/916: dread de/f19 [0,4194304] 0 2024-09-19T07:25:26.264 INFO:tasks.workunit.client.0.smithi098.stdout:3/917: read - de/d4e/d6d/fd6 zero size 2024-09-19T07:25:26.264 INFO:tasks.workunit.client.0.smithi098.stdout:3/918: symlink de/df/d31/d61/d79/l113 0 2024-09-19T07:25:26.266 INFO:tasks.workunit.client.0.smithi098.stdout:3/919: getdents de/df/d31 0 2024-09-19T07:25:26.271 INFO:tasks.workunit.client.0.smithi098.stdout:6/931: dread d2/d5/f62 [0,4194304] 0 2024-09-19T07:25:26.271 INFO:tasks.workunit.client.0.smithi098.stdout:3/920: mknod de/df/d1f/d2b/d93/de5/c114 0 2024-09-19T07:25:26.272 INFO:tasks.workunit.client.0.smithi098.stdout:3/921: mkdir de/d4e/d6d/d71/d115 0 2024-09-19T07:25:26.272 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:25 smithi098 ceph-mon[30950]: pgmap v104: 97 pgs: 97 active+clean; 2.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 55 op/s 2024-09-19T07:25:26.274 INFO:tasks.workunit.client.0.smithi098.stdout:6/932: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/f149 x:0 0 0 2024-09-19T07:25:26.279 INFO:tasks.workunit.client.0.smithi098.stdout:9/892: dwrite d3/dc/df/d15/fb8 [0,4194304] 0 2024-09-19T07:25:26.279 INFO:tasks.workunit.client.0.smithi098.stdout:9/893: chown d3/dc/df 20189 1 2024-09-19T07:25:26.284 INFO:tasks.workunit.client.0.smithi098.stdout:3/922: dread de/df/d1f/f56 [0,4194304] 0 2024-09-19T07:25:26.286 INFO:tasks.workunit.client.0.smithi098.stdout:3/923: rmdir de/d4e/d6d 39 2024-09-19T07:25:26.288 INFO:tasks.workunit.client.0.smithi098.stdout:3/924: mkdir de/d4e/d6d/d116 0 2024-09-19T07:25:26.289 INFO:tasks.workunit.client.0.smithi098.stdout:3/925: creat de/df/d4f/f117 x:0 0 0 2024-09-19T07:25:26.291 INFO:tasks.workunit.client.0.smithi098.stdout:5/779: rename dc/de/d36 to dc/de/d13/d46/d2e/d37/d6d/dee/d112 0 2024-09-19T07:25:26.293 INFO:tasks.workunit.client.0.smithi098.stdout:8/937: rename d0/d2c/d81/cae to d0/d1a/c138 0 2024-09-19T07:25:26.295 INFO:tasks.workunit.client.0.smithi098.stdout:5/780: creat dc/de/d13/d5c/daf/db9/f113 x:0 0 0 2024-09-19T07:25:26.298 INFO:tasks.workunit.client.0.smithi098.stdout:8/938: mkdir d0/d33/d55/d8a/d12/dba/df2/d9e/da4/d11c/d139 0 2024-09-19T07:25:26.299 INFO:tasks.workunit.client.0.smithi098.stdout:6/933: dwrite d2/d5/d1f/d26/d42/d48/d53/f12a [0,4194304] 0 2024-09-19T07:25:26.306 INFO:tasks.workunit.client.0.smithi098.stdout:8/939: write d0/d33/d55/d8a/d12/dba/df2/d9e/da4/db9/ff6 [3448032,28784] 0 2024-09-19T07:25:26.308 INFO:tasks.workunit.client.0.smithi098.stdout:8/940: unlink d0/d33/d55/d8a/d12/dba/df2/f88 0 2024-09-19T07:25:26.310 INFO:tasks.workunit.client.0.smithi098.stdout:8/941: rmdir d0/d33/d55/d8a/d12/dba/df2 39 2024-09-19T07:25:26.313 INFO:tasks.workunit.client.0.smithi098.stdout:9/894: dwrite d3/d16/d38/d48/f9d [0,4194304] 0 2024-09-19T07:25:26.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:25 smithi139 ceph-mon[35039]: pgmap v104: 97 pgs: 97 active+clean; 2.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 14 MiB/s wr, 55 op/s 2024-09-19T07:25:26.328 INFO:tasks.workunit.client.0.smithi098.stdout:3/926: dwrite de/df/d31/d61/d3f/f5d [0,4194304] 0 2024-09-19T07:25:26.328 INFO:tasks.workunit.client.0.smithi098.stdout:5/781: dwrite dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/fbf [0,4194304] 0 2024-09-19T07:25:26.328 INFO:tasks.workunit.client.0.smithi098.stdout:5/782: write dc/f12 [2578074,82093] 0 2024-09-19T07:25:26.328 INFO:tasks.workunit.client.0.smithi098.stdout:5/783: write dc/d100/fe9 [358349,53313] 0 2024-09-19T07:25:26.329 INFO:tasks.workunit.client.0.smithi098.stdout:6/934: dwrite d2/d5/d1f/d26/d42/d48/f137 [0,4194304] 0 2024-09-19T07:25:26.334 INFO:tasks.workunit.client.0.smithi098.stdout:6/935: dread d2/d5/d1f/d26/fa7 [0,4194304] 0 2024-09-19T07:25:26.336 INFO:tasks.workunit.client.0.smithi098.stdout:8/942: dwrite d0/d16/f79 [0,4194304] 0 2024-09-19T07:25:26.344 INFO:tasks.workunit.client.0.smithi098.stdout:5/784: write dc/d100/f72 [3777792,71570] 0 2024-09-19T07:25:26.346 INFO:tasks.workunit.client.0.smithi098.stdout:5/785: mknod dc/de/d13/d46/d2e/d37/d67/d75/d10f/c114 0 2024-09-19T07:25:26.346 INFO:tasks.workunit.client.0.smithi098.stdout:5/786: fsync dc/de/d13/f7e 0 2024-09-19T07:25:26.347 INFO:tasks.workunit.client.0.smithi098.stdout:5/787: truncate dc/de/d13/f27 1126474 0 2024-09-19T07:25:26.347 INFO:tasks.workunit.client.0.smithi098.stdout:5/788: truncate dc/de/d13/d5c/daf/fb2 120291 0 2024-09-19T07:25:26.347 INFO:tasks.workunit.client.0.smithi098.stdout:5/789: readlink dc/de/d13/d46/d23/d5e/l61 0 2024-09-19T07:25:26.356 INFO:tasks.workunit.client.0.smithi098.stdout:9/895: dwrite d3/d6/d8/f108 [0,4194304] 0 2024-09-19T07:25:26.356 INFO:tasks.workunit.client.0.smithi098.stdout:3/927: dwrite de/df/d31/d61/d79/fce [0,4194304] 0 2024-09-19T07:25:26.356 INFO:tasks.workunit.client.0.smithi098.stdout:3/928: chown de/df/d31/d61/d79/fb5 7 1 2024-09-19T07:25:26.356 INFO:tasks.workunit.client.0.smithi098.stdout:9/896: creat d3/dc/df/da3/f127 x:0 0 0 2024-09-19T07:25:26.361 INFO:tasks.workunit.client.0.smithi098.stdout:5/790: dread dc/de/d13/d46/d23/f9b [0,4194304] 0 2024-09-19T07:25:26.363 INFO:tasks.workunit.client.0.smithi098.stdout:5/791: unlink dc/de/dc0/lef 0 2024-09-19T07:25:26.366 INFO:tasks.workunit.client.0.smithi098.stdout:5/792: dread dc/de/d13/d46/d2e/d37/d81/f58 [0,4194304] 0 2024-09-19T07:25:26.368 INFO:tasks.workunit.client.0.smithi098.stdout:5/793: creat dc/de/d13/d46/f115 x:0 0 0 2024-09-19T07:25:26.368 INFO:tasks.workunit.client.0.smithi098.stdout:5/794: chown dc/de/d13/f7e 4789 1 2024-09-19T07:25:26.368 INFO:tasks.workunit.client.0.smithi098.stdout:5/795: truncate dc/de/d13/d46/d2e/d37/d81/db8/fdd 908293 0 2024-09-19T07:25:26.368 INFO:tasks.workunit.client.0.smithi098.stdout:5/796: chown dc/de/d13/d46/f3e 31403163 1 2024-09-19T07:25:26.385 INFO:tasks.workunit.client.0.smithi098.stdout:9/897: dwrite d3/dc/df/d15/d1a/d2b/d92/f94 [0,4194304] 0 2024-09-19T07:25:26.386 INFO:tasks.workunit.client.0.smithi098.stdout:9/898: mknod d3/d30/d73/dc7/c128 0 2024-09-19T07:25:26.393 INFO:tasks.workunit.client.0.smithi098.stdout:5/797: dwrite dc/de/d13/f19 [0,4194304] 0 2024-09-19T07:25:26.393 INFO:tasks.workunit.client.0.smithi098.stdout:5/798: write dc/de/d13/fe3 [145790,20563] 0 2024-09-19T07:25:26.393 INFO:tasks.workunit.client.0.smithi098.stdout:5/799: truncate dc/de/d13/fc9 638417 0 2024-09-19T07:25:26.400 INFO:tasks.workunit.client.0.smithi098.stdout:3/929: dwrite de/f1d [0,4194304] 0 2024-09-19T07:25:26.415 INFO:tasks.workunit.client.0.smithi098.stdout:5/800: dwrite dc/de/d13/fc9 [0,4194304] 0 2024-09-19T07:25:26.415 INFO:tasks.workunit.client.0.smithi098.stdout:9/899: dwrite d3/d16/f57 [0,4194304] 0 2024-09-19T07:25:26.415 INFO:tasks.workunit.client.0.smithi098.stdout:9/900: fsync d3/dc/df/f87 0 2024-09-19T07:25:26.415 INFO:tasks.workunit.client.0.smithi098.stdout:5/801: fdatasync dc/de/d13/d46/d2e/d37/d81/db8/ff1 0 2024-09-19T07:25:26.415 INFO:tasks.workunit.client.0.smithi098.stdout:9/901: chown d3/d16/d43/d61/f66 0 1 2024-09-19T07:25:26.420 INFO:tasks.workunit.client.0.smithi098.stdout:9/902: unlink d3/d16/d43/l78 0 2024-09-19T07:25:26.420 INFO:tasks.workunit.client.0.smithi098.stdout:5/802: symlink dc/de/d13/d46/d2e/d37/d6d/dee/d112/dba/l116 0 2024-09-19T07:25:26.422 INFO:tasks.workunit.client.0.smithi098.stdout:9/903: creat d3/d6/d46/d83/da9/dbc/f129 x:0 0 0 2024-09-19T07:25:26.422 INFO:tasks.workunit.client.0.smithi098.stdout:9/904: chown d3/d16/d43/d61/da6/dd8/l110 6146 1 2024-09-19T07:25:26.422 INFO:tasks.workunit.client.0.smithi098.stdout:5/803: symlink dc/de/d13/d5c/daf/l117 0 2024-09-19T07:25:26.422 INFO:tasks.workunit.client.0.smithi098.stdout:5/804: truncate dc/de/d13/d46/d2e/d37/fce 1025183 0 2024-09-19T07:25:26.423 INFO:tasks.workunit.client.0.smithi098.stdout:5/805: mkdir dc/de/d13/d5c/daf/db9/d118 0 2024-09-19T07:25:26.424 INFO:tasks.workunit.client.0.smithi098.stdout:5/806: dread dc/de/d13/d46/d2e/d37/d81/db8/fdd [0,4194304] 0 2024-09-19T07:25:26.425 INFO:tasks.workunit.client.0.smithi098.stdout:5/807: creat dc/de/d13/d5c/daf/db9/d118/f119 x:0 0 0 2024-09-19T07:25:26.426 INFO:tasks.workunit.client.0.smithi098.stdout:5/808: rename dc/de/d13/d5c/daf/db9/lff to dc/de/d13/d5c/da2/l11a 0 2024-09-19T07:25:26.426 INFO:tasks.workunit.client.0.smithi098.stdout:5/809: fdatasync dc/de/d13/d46/d2e/d37/d6d/dee/d112/dba/ff9 0 2024-09-19T07:25:26.427 INFO:tasks.workunit.client.0.smithi098.stdout:5/810: mknod dc/de/d13/d5c/c11b 0 2024-09-19T07:25:26.427 INFO:tasks.workunit.client.0.smithi098.stdout:5/811: fsync dc/de/d13/d46/d2e/d37/d67/d99/fb4 0 2024-09-19T07:25:26.427 INFO:tasks.workunit.client.0.smithi098.stdout:5/812: readlink dc/de/d13/d46/d2e/d37/d6d/l8e 0 2024-09-19T07:25:26.432 INFO:tasks.workunit.client.0.smithi098.stdout:5/813: write dc/de/d13/f14 [2190216,118911] 0 2024-09-19T07:25:26.433 INFO:tasks.workunit.client.0.smithi098.stdout:5/814: mkdir dc/de/d11c 0 2024-09-19T07:25:26.433 INFO:tasks.workunit.client.0.smithi098.stdout:5/815: fsync dc/f12 0 2024-09-19T07:25:26.436 INFO:tasks.workunit.client.0.smithi098.stdout:5/816: creat dc/de/d13/d46/d23/f11d x:0 0 0 2024-09-19T07:25:26.436 INFO:tasks.workunit.client.0.smithi098.stdout:5/817: write dc/f17 [12870673,120944] 0 2024-09-19T07:25:26.436 INFO:tasks.workunit.client.0.smithi098.stdout:5/818: stat dc/de/d13/d46/d23/d5e/cd5 0 2024-09-19T07:25:26.443 INFO:tasks.workunit.client.0.smithi098.stdout:5/819: rename dc/de/d13/f14 to dc/de/d13/d5c/daf/db9/d118/f11e 0 2024-09-19T07:25:26.463 INFO:tasks.workunit.client.0.smithi098.stdout:5/820: dwrite dc/de/f96 [0,4194304] 0 2024-09-19T07:25:26.464 INFO:tasks.workunit.client.0.smithi098.stdout:5/821: mknod dc/de/c11f 0 2024-09-19T07:25:26.465 INFO:tasks.workunit.client.0.smithi098.stdout:5/822: readlink dc/de/d13/d46/lcd 0 2024-09-19T07:25:26.465 INFO:tasks.workunit.client.0.smithi098.stdout:5/823: chown dc/de/d13/d46/d23 0 1 2024-09-19T07:25:26.465 INFO:tasks.workunit.client.0.smithi098.stdout:5/824: creat dc/de/d13/d46/d2e/d37/f120 x:0 0 0 2024-09-19T07:25:26.467 INFO:tasks.workunit.client.0.smithi098.stdout:5/825: mkdir dc/de/d13/d5c/daf/db9/d121 0 2024-09-19T07:25:26.467 INFO:tasks.workunit.client.0.smithi098.stdout:5/826: chown dc/de/l30 144872 1 2024-09-19T07:25:26.467 INFO:tasks.workunit.client.0.smithi098.stdout:5/827: write dc/de/d13/d5c/fd6 [891180,43128] 0 2024-09-19T07:25:26.468 INFO:tasks.workunit.client.0.smithi098.stdout:5/828: unlink dc/de/d13/d46/d2e/da5/fcb 0 2024-09-19T07:25:26.468 INFO:tasks.workunit.client.0.smithi098.stdout:5/829: dread - dc/de/d13/d46/d23/d5e/fec zero size 2024-09-19T07:25:26.468 INFO:tasks.workunit.client.0.smithi098.stdout:5/830: write dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/fa9 [331739,128236] 0 2024-09-19T07:25:26.468 INFO:tasks.workunit.client.0.smithi098.stdout:5/831: dread - dc/de/d13/d46/d2e/d37/d67/ffe zero size 2024-09-19T07:25:26.486 INFO:tasks.workunit.client.0.smithi098.stdout:5/832: dwrite dc/d100/fe9 [0,4194304] 0 2024-09-19T07:25:26.488 INFO:tasks.workunit.client.0.smithi098.stdout:5/833: creat dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/d84/f122 x:0 0 0 2024-09-19T07:25:26.488 INFO:tasks.workunit.client.0.smithi098.stdout:5/834: chown dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/d84/d110 1 1 2024-09-19T07:25:26.489 INFO:tasks.workunit.client.0.smithi098.stdout:5/835: mkdir dc/de/d11c/d123 0 2024-09-19T07:25:26.510 INFO:tasks.workunit.client.0.smithi098.stdout:5/836: dwrite dc/de/d13/d46/d2e/d37/d81/fd1 [4194304,4194304] 0 2024-09-19T07:25:26.521 INFO:tasks.workunit.client.0.smithi098.stdout:5/837: dread dc/de/d13/d46/d2e/d37/f43 [0,4194304] 0 2024-09-19T07:25:26.521 INFO:tasks.workunit.client.0.smithi098.stdout:5/838: chown dc/de/d13/d46/d2e/c9c 3816008 1 2024-09-19T07:25:26.521 INFO:tasks.workunit.client.0.smithi098.stdout:5/839: write dc/de/d13/d5c/daf/db9/f113 [615537,72950] 0 2024-09-19T07:25:26.522 INFO:tasks.workunit.client.0.smithi098.stdout:5/840: mkdir dc/de/d13/d7d/d124 0 2024-09-19T07:25:26.523 INFO:tasks.workunit.client.0.smithi098.stdout:5/841: symlink dc/de/d13/d5c/daf/db9/d121/l125 0 2024-09-19T07:25:26.523 INFO:tasks.workunit.client.0.smithi098.stdout:5/842: truncate dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/d84/f8f 360391 0 2024-09-19T07:25:26.524 INFO:tasks.workunit.client.0.smithi098.stdout:5/843: rmdir dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/d84 39 2024-09-19T07:25:26.524 INFO:tasks.workunit.client.0.smithi098.stdout:5/844: read dc/f17 [11916644,130050] 0 2024-09-19T07:25:26.525 INFO:tasks.workunit.client.0.smithi098.stdout:5/845: truncate dc/de/d13/d5c/daf/db9/fe8 2206893 0 2024-09-19T07:25:26.525 INFO:tasks.workunit.client.0.smithi098.stdout:5/846: write dc/de/d13/d46/d2e/d37/d67/d75/fed [27346,105067] 0 2024-09-19T07:25:26.542 INFO:tasks.workunit.client.0.smithi098.stdout:5/847: dwrite dc/de/d13/d5c/daf/db9/f113 [0,4194304] 0 2024-09-19T07:25:26.545 INFO:tasks.workunit.client.0.smithi098.stdout:5/848: mkdir dc/de/d13/d7d/d126 0 2024-09-19T07:25:26.546 INFO:tasks.workunit.client.0.smithi098.stdout:5/849: mkdir dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/d127 0 2024-09-19T07:25:26.563 INFO:tasks.workunit.client.0.smithi098.stdout:5/850: dwrite dc/de/d13/d46/d23/f5f [0,4194304] 0 2024-09-19T07:25:26.565 INFO:tasks.workunit.client.0.smithi098.stdout:5/851: creat dc/de/d13/d5c/daf/db9/d118/f128 x:0 0 0 2024-09-19T07:25:26.566 INFO:tasks.workunit.client.0.smithi098.stdout:5/852: creat dc/de/d13/d46/d2e/d37/d67/d99/f129 x:0 0 0 2024-09-19T07:25:26.568 INFO:tasks.workunit.client.0.smithi098.stdout:5/853: truncate dc/de/d13/d46/d23/d5e/fae 838582 0 2024-09-19T07:25:26.568 INFO:tasks.workunit.client.0.smithi098.stdout:5/854: creat dc/de/dc0/dd8/f12a x:0 0 0 2024-09-19T07:25:26.569 INFO:tasks.workunit.client.0.smithi098.stdout:5/855: creat dc/de/d13/d7d/df8/f12b x:0 0 0 2024-09-19T07:25:26.571 INFO:tasks.workunit.client.0.smithi098.stdout:5/856: creat dc/de/d13/d46/d23/d5e/f12c x:0 0 0 2024-09-19T07:25:26.571 INFO:tasks.workunit.client.0.smithi098.stdout:5/857: dread - dc/de/d13/d46/d2e/fd0 zero size 2024-09-19T07:25:26.572 INFO:tasks.workunit.client.0.smithi098.stdout:5/858: creat dc/de/d13/d46/d2e/d37/d81/db8/f12d x:0 0 0 2024-09-19T07:25:26.577 INFO:tasks.workunit.client.0.smithi098.stdout:5/859: dread dc/de/d13/d5c/daf/db9/fe8 [0,4194304] 0 2024-09-19T07:25:26.584 INFO:tasks.workunit.client.0.smithi098.stdout:5/860: dread dc/de/d13/d46/d2e/d37/d81/f45 [0,4194304] 0 2024-09-19T07:25:26.585 INFO:tasks.workunit.client.0.smithi098.stdout:5/861: rename dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/d84/ff7 to dc/de/dc0/dd8/f12e 0 2024-09-19T07:25:26.586 INFO:tasks.workunit.client.0.smithi098.stdout:5/862: mknod dc/de/d13/d46/d2e/d37/d6d/dee/c12f 0 2024-09-19T07:25:26.587 INFO:tasks.workunit.client.0.smithi098.stdout:5/863: write dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/d84/f122 [819105,5638] 0 2024-09-19T07:25:26.587 INFO:tasks.workunit.client.0.smithi098.stdout:5/864: unlink dc/de/d13/f27 0 2024-09-19T07:25:26.593 INFO:tasks.workunit.client.0.smithi098.stdout:5/865: write dc/de/d13/d5c/daf/db9/fe8 [1220717,118717] 0 2024-09-19T07:25:26.594 INFO:tasks.workunit.client.0.smithi098.stdout:5/866: creat dc/de/d13/d7d/df8/f130 x:0 0 0 2024-09-19T07:25:26.597 INFO:tasks.workunit.client.0.smithi098.stdout:5/867: write dc/de/d13/d46/d2e/d37/d81/f45 [4801624,29406] 0 2024-09-19T07:25:26.598 INFO:tasks.workunit.client.0.smithi098.stdout:5/868: creat dc/de/d13/d46/d2e/d37/d6d/f131 x:0 0 0 2024-09-19T07:25:26.599 INFO:tasks.workunit.client.0.smithi098.stdout:5/869: mkdir dc/de/d13/d46/d2e/da5/d132 0 2024-09-19T07:25:26.599 INFO:tasks.workunit.client.0.smithi098.stdout:5/870: chown dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/fbf 19 1 2024-09-19T07:25:26.599 INFO:tasks.workunit.client.0.smithi098.stdout:5/871: write dc/de/d13/d46/d2e/d37/d67/d99/fb4 [784223,58718] 0 2024-09-19T07:25:26.600 INFO:tasks.workunit.client.0.smithi098.stdout:5/872: dread dc/f54 [0,4194304] 0 2024-09-19T07:25:26.601 INFO:tasks.workunit.client.0.smithi098.stdout:5/873: mknod dc/de/d13/d46/d2e/da5/c133 0 2024-09-19T07:25:26.602 INFO:tasks.workunit.client.0.smithi098.stdout:5/874: mkdir dc/de/d13/d46/d2e/d37/d6d/dee/d134 0 2024-09-19T07:25:26.603 INFO:tasks.workunit.client.0.smithi098.stdout:5/875: creat dc/de/d13/d46/d2e/d37/d6d/d10e/f135 x:0 0 0 2024-09-19T07:25:26.603 INFO:tasks.workunit.client.0.smithi098.stdout:5/876: mknod dc/de/d13/d5c/daf/c136 0 2024-09-19T07:25:26.612 INFO:tasks.workunit.client.0.smithi098.stdout:5/877: write dc/de/d13/d46/d2e/d37/d81/db8/ff1 [1564695,121198] 0 2024-09-19T07:25:26.624 INFO:tasks.workunit.client.0.smithi098.stdout:5/878: rename dc/de/d13/d46/d2e/d37/d6d/l104 to dc/de/d13/d5c/l137 0 2024-09-19T07:25:26.776 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 21778930, 'ino': 1099511635719, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 22049288, 'ino': 1099511635622, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/NOTES'}, {'damage_type': 'backtrace', 'id': 25729002, 'ino': 1099511630909, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpipower.pod.1'}, {'damage_type': 'backtrace', 'id': 27852826, 'ino': 1099511637110, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g-interleaved'}, {'damage_type': 'backtrace', 'id': 29090376, 'ino': 1099511637115, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g'}, {'damage_type': 'backtrace', 'id': 43732750, 'ino': 1099511635742, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/stress.c'}, {'damage_type': 'backtrace', 'id': 49942298, 'ino': 1099511635713, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/NOTES'}, {'damage_type': 'backtrace', 'id': 50477425, 'ino': 1099511636811, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/user_tdrm.c'}, {'damage_type': 'backtrace', 'id': 58883831, 'ino': 1099511635614, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/plan.txt'}, {'damage_type': 'backtrace', 'id': 60327872, 'ino': 1099511635639, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue'}, {'damage_type': 'backtrace', 'id': 130976976, 'ino': 1099511635701, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/Makefile'}, {'damage_type': 'backtrace', 'id': 155561460, 'ino': 1099511636814, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/Makefile'}, {'damage_type': 'backtrace', 'id': 176636326, 'ino': 1099511635714, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/LICENCE'}, {'damage_type': 'backtrace', 'id': 179162558, 'ino': 1099511637102, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-nomig'}, {'damage_type': 'backtrace', 'id': 210491183, 'ino': 1099511637053, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/Makefile'}, {'damage_type': 'backtrace', 'id': 235916313, 'ino': 1099511635654, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock'}, {'damage_type': 'backtrace', 'id': 252361115, 'ino': 1099511635711, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 254184077, 'ino': 1099511637174, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_mmap.c'}, {'damage_type': 'backtrace', 'id': 254829721, 'ino': 1099511635694, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/Makefile'}, {'damage_type': 'backtrace', 'id': 284265907, 'ino': 1099511635668, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/LICENCE'}, {'damage_type': 'backtrace', 'id': 319677821, 'ino': 1099511630796, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_hold'}, {'damage_type': 'backtrace', 'id': 344376761, 'ino': 1099511635318, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/4-2.c'}, {'damage_type': 'backtrace', 'id': 350590236, 'ino': 1099511635699, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel'}, {'damage_type': 'backtrace', 'id': 361637811, 'ino': 1099511635627, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 380935768, 'ino': 1099511636815, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/tdrm.c'}, {'damage_type': 'backtrace', 'id': 385895494, 'ino': 1099511635617, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/s-c1.c'}, {'damage_type': 'backtrace', 'id': 441391851, 'ino': 1099511635663, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/s-c.c'}, {'damage_type': 'backtrace', 'id': 448317307, 'ino': 1099511635601, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/assertions.xml'}, {'damage_type': 'backtrace', 'id': 503027584, 'ino': 1099511635612, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers'}, {'damage_type': 'backtrace', 'id': 515934594, 'ino': 1099511635607, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/Makefile'}, {'damage_type': 'backtrace', 'id': 531344917, 'ino': 1099511637019, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_stress_test.sh'}, {'damage_type': 'backtrace', 'id': 561897782, 'ino': 1099511630908, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/openhpid.pod.8'}, {'damage_type': 'backtrace', 'id': 571912972, 'ino': 1099511635656, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/Makefile'}, {'damage_type': 'backtrace', 'id': 573339494, 'ino': 1099511635597, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues'}, {'damage_type': 'backtrace', 'id': 613869375, 'ino': 1099511635662, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/stress.c'}, {'damage_type': 'backtrace', 'id': 622124340, 'ino': 1099511636816, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/str_drm.h'}, {'damage_type': 'backtrace', 'id': 623082522, 'ino': 1099511635736, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 633274589, 'ino': 1099511635610, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/run.sh'}, {'damage_type': 'backtrace', 'id': 646387204, 'ino': 1099511635323, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/5-1.c'}, {'damage_type': 'backtrace', 'id': 655331193, 'ino': 1099511637533, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/Makefile'}, {'damage_type': 'backtrace', 'id': 662860038, 'ino': 1099511635619, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 669226779, 'ino': 1099511635705, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/LICENCE'}, {'damage_type': 'backtrace', 'id': 671199102, 'ino': 1099511635652, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/LICENCE'}, {'damage_type': 'backtrace', 'id': 675740676, 'ino': 1099511635733, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/s-c1.c'}, {'damage_type': 'backtrace', 'id': 682083957, 'ino': 1099511635624, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam'}, {'damage_type': 'backtrace', 'id': 687882958, 'ino': 1099511635661, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init'}, {'damage_type': 'backtrace', 'id': 689541464, 'ino': 1099511637103, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1g'}, {'damage_type': 'backtrace', 'id': 690366632, 'ino': 1099511635324, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/6-1.c'}, {'damage_type': 'backtrace', 'id': 692929186, 'ino': 1099511635325, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/1-1.c'}, {'damage_type': 'backtrace', 'id': 693876085, 'ino': 1099511637104, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p'}, {'damage_type': 'backtrace', 'id': 695226874, 'ino': 1099511630913, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpitree.pod.1'}, {'damage_type': 'backtrace', 'id': 703383163, 'ino': 1099511635655, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/stress.c'}, {'damage_type': 'backtrace', 'id': 721459675, 'ino': 1099511635745, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 723485369, 'ino': 1099511630911, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpialarms.pod.1'}, {'damage_type': 'backtrace', 'id': 732217752, 'ino': 1099511635634, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 741163508, 'ino': 1099511635674, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 756292996, 'ino': 1099511637116, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1p'}, {'damage_type': 'backtrace', 'id': 775644166, 'ino': 1099511635729, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/do-plot'}, {'damage_type': 'backtrace', 'id': 780937248, 'ino': 1099511636027, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/backbeat'}, {'damage_type': 'backtrace', 'id': 794411315, 'ino': 1099511635644, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/NOTES'}, {'damage_type': 'backtrace', 'id': 834947965, 'ino': 1099511630903, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpionIBMblade.pod.1'}, {'damage_type': 'backtrace', 'id': 848654439, 'ino': 1099511630905, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpifan.pod.1'}, {'damage_type': 'backtrace', 'id': 885401531, 'ino': 1099511635649, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 915247941, 'ino': 1099511635637, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/NOTES'}, {'damage_type': 'backtrace', 'id': 932671253, 'ino': 1099511636029, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/maimparts'}, {'damage_type': 'backtrace', 'id': 980025507, 'ino': 1099511635626, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/Makefile'}, {'damage_type': 'backtrace', 'id': 1028220227, 'ino': 1099511635659, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/NOTES'}, {'damage_type': 'backtrace', 'id': 1028544346, 'ino': 1099511635329, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/4-1.c'}, {'damage_type': 'backtrace', 'id': 1047067556, 'ino': 1099511637052, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/io_throttle_testplan.txt'}, {'damage_type': 'backtrace', 'id': 1050041207, 'ino': 1099511635679, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/s-c1.c'}, {'damage_type': 'backtrace', 'id': 1094640106, 'ino': 1099511637054, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/run_io_throttle_test.sh'}, {'damage_type': 'backtrace', 'id': 1106345113, 'ino': 1099511635660, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/LICENCE'}, {'damage_type': 'backtrace', 'id': 1124315010, 'ino': 1099511635693, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/stress.c'}, {'damage_type': 'backtrace', 'id': 1128280983, 'ino': 1099511635640, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/stress.c'}, {'damage_type': 'backtrace', 'id': 1135522509, 'ino': 1099511637111, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-16m'}, {'damage_type': 'backtrace', 'id': 1160816728, 'ino': 1099511635330, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/cln.sh'}, {'damage_type': 'backtrace', 'id': 1200979049, 'ino': 1099511635603, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/run.sh'}, {'damage_type': 'backtrace', 'id': 1205566358, 'ino': 1099511635328, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/2-2.c'}, {'damage_type': 'backtrace', 'id': 1206775240, 'ino': 1099511637534, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid02.c'}, {'damage_type': 'backtrace', 'id': 1206870413, 'ino': 1099511635670, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/stress.c'}, {'damage_type': 'backtrace', 'id': 1233209777, 'ino': 1099511635682, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 1237598474, 'ino': 1099511635720, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/NOTES'}, {'damage_type': 'backtrace', 'id': 1247404380, 'ino': 1099511635690, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 1248404107, 'ino': 1099511635695, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 1279058133, 'ino': 1099511635675, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 1283813878, 'ino': 1099511635319, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/coverage.txt'}, {'damage_type': 'backtrace', 'id': 1317085880, 'ino': 1099511635698, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/LICENCE'}, {'damage_type': 'backtrace', 'id': 1321452760, 'ino': 1099511635616, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init'}, {'damage_type': 'backtrace', 'id': 1365720017, 'ino': 1099511635635, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 1375464426, 'ino': 1099511635724, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/stress1.c'}, {'damage_type': 'backtrace', 'id': 1387710102, 'ino': 1099511635629, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/NOTES'}, {'damage_type': 'backtrace', 'id': 1426116683, 'ino': 1099511637021, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/memcg_process_stress.c'}, {'damage_type': 'backtrace', 'id': 1439647113, 'ino': 1099511635710, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/Makefile'}, {'damage_type': 'backtrace', 'id': 1474138918, 'ino': 1099511635727, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 1478553722, 'ino': 1099511635715, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once'}, {'damage_type': 'backtrace', 'id': 1501215317, 'ino': 1099511635628, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 1538653060, 'ino': 1099511636030, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/README'}, {'damage_type': 'backtrace', 'id': 1538904054, 'ino': 1099511635604, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/plan.txt'}, {'damage_type': 'backtrace', 'id': 1545756146, 'ino': 1099511635600, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/Makefile'}, {'damage_type': 'backtrace', 'id': 1552844615, 'ino': 1099511635696, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 1565364228, 'ino': 1099511637098, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-1p'}, {'damage_type': 'backtrace', 'id': 1572700231, 'ino': 1099511635706, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/assertions.xml'}, {'damage_type': 'backtrace', 'id': 1591817288, 'ino': 1099511637101, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-touch'}, {'damage_type': 'backtrace', 'id': 1607525067, 'ino': 1099511635681, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 1626172985, 'ino': 1099511635608, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/assertions.xml'}, {'damage_type': 'backtrace', 'id': 1670591929, 'ino': 1099511637619, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups02.c'}, {'damage_type': 'backtrace', 'id': 1670722971, 'ino': 1099511637096, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m'}, {'damage_type': 'backtrace', 'id': 1701357018, 'ino': 1099511630794, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_over'}, {'damage_type': 'backtrace', 'id': 1713261509, 'ino': 1099511635691, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress2.c'}, {'damage_type': 'backtrace', 'id': 1763122946, 'ino': 1099511635725, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/Makefile'}, {'damage_type': 'backtrace', 'id': 1778064987, 'ino': 1099511635737, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/do-plot'}, {'damage_type': 'backtrace', 'id': 1779946033, 'ino': 1099511635650, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 1781150654, 'ino': 1099511635653, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/threads_scenarii.c'}, {'damage_type': 'backtrace', 'id': 1810932280, 'ino': 1099511635599, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/coverage.txt'}, {'damage_type': 'backtrace', 'id': 1818660217, 'ino': 1099511635317, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/9-1.c'}, {'damage_type': 'backtrace', 'id': 1825887523, 'ino': 1099511637532, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/waitid/waitid01.c'}, {'damage_type': 'backtrace', 'id': 1830210885, 'ino': 1099511635704, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/NOTES'}, {'damage_type': 'backtrace', 'id': 1837967823, 'ino': 1099511635609, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/multi_con_pro.c'}, {'damage_type': 'backtrace', 'id': 1861250421, 'ino': 1099511635620, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 1918271774, 'ino': 1099511635638, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/LICENCE'}, {'damage_type': 'backtrace', 'id': 1925081329, 'ino': 1099511637409, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/Makefile'}, {'damage_type': 'backtrace', 'id': 1931477248, 'ino': 1099511635700, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/stress.c'}, {'damage_type': 'backtrace', 'id': 1943141745, 'ino': 1099511630795, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected'}, {'damage_type': 'backtrace', 'id': 1948924296, 'ino': 1099511635689, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 1948928003, 'ino': 1099511637408, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_capable_net.sh'}, {'damage_type': 'backtrace', 'id': 1959933163, 'ino': 1099511635316, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/3-1.c'}, {'damage_type': 'backtrace', 'id': 1973294365, 'ino': 1099511636817, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/load_tdrm.sh'}, {'damage_type': 'backtrace', 'id': 1996477093, 'ino': 1099511635712, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 2016061210, 'ino': 1099511635732, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create'}, {'damage_type': 'backtrace', 'id': 2060507032, 'ino': 1099511635683, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/do-plot'}, {'damage_type': 'backtrace', 'id': 2064447251, 'ino': 1099511635658, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 2077046937, 'ino': 1099511636812, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space/Makefile'}, {'damage_type': 'backtrace', 'id': 2099813458, 'ino': 1099511635722, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait'}, {'damage_type': 'backtrace', 'id': 2115237828, 'ino': 1099511635686, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait'}, {'damage_type': 'backtrace', 'id': 2137523931, 'ino': 1099511637171, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_measure.c'}, {'damage_type': 'backtrace', 'id': 2138958912, 'ino': 1099511635677, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/LICENCE'}, {'damage_type': 'backtrace', 'id': 2170989420, 'ino': 1099511635734, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/Makefile'}, {'damage_type': 'backtrace', 'id': 2179697490, 'ino': 1099511637315, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space'}, {'damage_type': 'backtrace', 'id': 2180824099, 'ino': 1099511635743, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/Makefile'}, {'damage_type': 'backtrace', 'id': 2214395930, 'ino': 1099511635321, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 2231998166, 'ino': 1099511635643, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 2294786267, 'ino': 1099511637108, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-1g-interleaved'}, {'damage_type': 'backtrace', 'id': 2308893732, 'ino': 1099511635740, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/threads_scenarii.c'}, {'damage_type': 'backtrace', 'id': 2320769584, 'ino': 1099511635667, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/NOTES'}, {'damage_type': 'backtrace', 'id': 2329482362, 'ino': 1099511637615, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/compat_16.h'}, {'damage_type': 'backtrace', 'id': 2334068760, 'ino': 1099511635718, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 2360730700, 'ino': 1099511630914, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpitop.pod.1'}, {'damage_type': 'backtrace', 'id': 2390855082, 'ino': 1099511635728, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/stress2.c'}, {'damage_type': 'backtrace', 'id': 2396332739, 'ino': 1099511637107, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-8p'}, {'damage_type': 'backtrace', 'id': 2407567243, 'ino': 1099511630797, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/non-panic/data/corrected_no_en'}, {'damage_type': 'backtrace', 'id': 2425887233, 'ino': 1099511630902, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiinv.pod.1'}, {'damage_type': 'backtrace', 'id': 2427620061, 'ino': 1099511635678, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork'}, {'damage_type': 'backtrace', 'id': 2443516040, 'ino': 1099511635748, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/threads_scenarii.c'}, {'damage_type': 'backtrace', 'id': 2446195357, 'ino': 1099511637105, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m-touch'}, {'damage_type': 'backtrace', 'id': 2449682848, 'ino': 1099511637099, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-shm-8p'}, {'damage_type': 'backtrace', 'id': 2456516635, 'ino': 1099511637410, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_bind.c'}, {'damage_type': 'backtrace', 'id': 2460089156, 'ino': 1099511636007, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/Makefile'}, {'damage_type': 'backtrace', 'id': 2460477000, 'ino': 1099511630898, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpireset.pod.1'}, {'damage_type': 'backtrace', 'id': 2469038404, 'ino': 1099511635636, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/do-plot'}, {'damage_type': 'backtrace', 'id': 2487471483, 'ino': 1099511635641, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/Makefile'}, {'damage_type': 'backtrace', 'id': 2494883840, 'ino': 1099511635605, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores'}, {'damage_type': 'backtrace', 'id': 2538986131, 'ino': 1099511635703, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 2570184503, 'ino': 1099511635688, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress1.c'}, {'damage_type': 'backtrace', 'id': 2583594716, 'ino': 1099511637106, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-1m-touch'}, {'damage_type': 'backtrace', 'id': 2605405360, 'ino': 1099511637172, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/ima_boot_aggregate.c'}, {'damage_type': 'backtrace', 'id': 2616835748, 'ino': 1099511635657, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_trylock/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 2618192991, 'ino': 1099511635723, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/s-c.c'}, {'damage_type': 'backtrace', 'id': 2622902379, 'ino': 1099511635615, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads'}, {'damage_type': 'backtrace', 'id': 2660325687, 'ino': 1099511635730, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/NOTES'}, {'damage_type': 'backtrace', 'id': 2678488187, 'ino': 1099511635606, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/coverage.txt'}, {'damage_type': 'backtrace', 'id': 2687218527, 'ino': 1099511635735, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 2694731282, 'ino': 1099511637020, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/memcg/stress/Makefile'}, {'damage_type': 'backtrace', 'id': 2744023603, 'ino': 1099511636028, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_maim/partbeat'}, {'damage_type': 'backtrace', 'id': 2762019363, 'ino': 1099511635664, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/Makefile'}, {'damage_type': 'backtrace', 'id': 2763737477, 'ino': 1099511635676, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/NOTES'}, {'damage_type': 'backtrace', 'id': 2771200758, 'ino': 1099511637870, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/keyctl/keyctl01.c'}, {'damage_type': 'backtrace', 'id': 2792681535, 'ino': 1099511630912, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiwdt.pod.1'}, {'damage_type': 'backtrace', 'id': 2814750516, 'ino': 1099511635651, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/NOTES'}, {'damage_type': 'backtrace', 'id': 2848768003, 'ino': 1099511635648, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/Makefile'}, {'damage_type': 'backtrace', 'id': 2856661981, 'ino': 1099511636008, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/fs_inod_readme.txt'}, {'damage_type': 'backtrace', 'id': 2865028239, 'ino': 1099511635625, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/stress.c'}, {'damage_type': 'backtrace', 'id': 2883102959, 'ino': 1099511635322, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/2-1.c'}, {'damage_type': 'backtrace', 'id': 2931811506, 'ino': 1099511630899, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpithres.pod.1'}, {'damage_type': 'backtrace', 'id': 2931826014, 'ino': 1099511630906, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpisensor.pod.1'}, {'damage_type': 'backtrace', 'id': 2939878500, 'ino': 1099511635684, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/NOTES'}, {'damage_type': 'backtrace', 'id': 2948807772, 'ino': 1099511635738, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/NOTES'}, {'damage_type': 'backtrace', 'id': 2958966927, 'ino': 1099511637057, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/iobw.c'}, {'damage_type': 'backtrace', 'id': 2968738607, 'ino': 1099511637113, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-anon-8p'}, {'damage_type': 'backtrace', 'id': 2968986100, 'ino': 1099511635645, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/LICENCE'}, {'damage_type': 'backtrace', 'id': 2986215997, 'ino': 1099511635633, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/Makefile'}, {'damage_type': 'backtrace', 'id': 3009333350, 'ino': 1099511637173, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/integrity/ima/src/Makefile'}, {'damage_type': 'backtrace', 'id': 3019771878, 'ino': 1099511637109, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-anon-8p-touch'}, {'damage_type': 'backtrace', 'id': 3022311195, 'ino': 1099511635702, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cancel/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 3031951920, 'ino': 1099511635717, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/Makefile'}, {'damage_type': 'backtrace', 'id': 3056755931, 'ino': 1099511635731, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/helper.c'}, {'damage_type': 'backtrace', 'id': 3071647311, 'ino': 1099511635595, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals'}, {'damage_type': 'backtrace', 'id': 3127108080, 'ino': 1099511635613, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/timers/keytests.sh'}, {'damage_type': 'backtrace', 'id': 3134657253, 'ino': 1099511635320, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 3156344402, 'ino': 1099511637871, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/keyctl/Makefile'}, {'damage_type': 'backtrace', 'id': 3159080039, 'ino': 1099511635327, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/7-1.c'}, {'damage_type': 'backtrace', 'id': 3174634145, 'ino': 1099511636006, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fs_inod/fs_inod'}, {'damage_type': 'backtrace', 'id': 3175862270, 'ino': 1099511636819, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/tdrm.h'}, {'damage_type': 'backtrace', 'id': 3221782564, 'ino': 1099511636810, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/user_space'}, {'damage_type': 'backtrace', 'id': 3223892536, 'ino': 1099511635744, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 3252675525, 'ino': 1099511635680, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/Makefile'}, {'damage_type': 'backtrace', 'id': 3254162004, 'ino': 1099511637097, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-2shm-1m'}, {'damage_type': 'backtrace', 'id': 3299009672, 'ino': 1099511635687, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_wait/stress.c'}, {'damage_type': 'backtrace', 'id': 3303621835, 'ino': 1099511630901, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpisettime.pod.1'}, {'damage_type': 'backtrace', 'id': 3304964201, 'ino': 1099511635646, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit'}, {'damage_type': 'backtrace', 'id': 3319360441, 'ino': 1099511637114, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-2shm-1m'}, {'damage_type': 'backtrace', 'id': 3355926238, 'ino': 1099511635685, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/fork/LICENCE'}, {'damage_type': 'backtrace', 'id': 3403939680, 'ino': 1099511635598, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/multi_send_rev_1.c'}, {'damage_type': 'backtrace', 'id': 3431415584, 'ino': 1099511637100, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-lazy-file-16m'}, {'damage_type': 'backtrace', 'id': 3479371949, 'ino': 1099511630910, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpiel.pod.1'}, {'damage_type': 'backtrace', 'id': 3489247351, 'ino': 1099511637056, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/myfunctions-io.sh'}, {'damage_type': 'backtrace', 'id': 3490708236, 'ino': 1099511635746, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/NOTES'}, {'damage_type': 'backtrace', 'id': 3492426210, 'ino': 1099511635621, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/do-plot'}, {'damage_type': 'backtrace', 'id': 3542621158, 'ino': 1099511630915, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/Makefile.am'}, {'damage_type': 'backtrace', 'id': 3556493130, 'ino': 1099511630904, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/openhpi.pod.7'}, {'damage_type': 'backtrace', 'id': 3564347236, 'ino': 1099511635708, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/stress.c'}, {'damage_type': 'backtrace', 'id': 3569709603, 'ino': 1099511630900, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/hpievents.pod.1'}, {'damage_type': 'backtrace', 'id': 3583676101, 'ino': 1099511635716, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/stress.c'}, {'damage_type': 'backtrace', 'id': 3605784102, 'ino': 1099511637618, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups01.c'}, {'damage_type': 'backtrace', 'id': 3607019027, 'ino': 1099511635747, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self/LICENCE'}, {'damage_type': 'backtrace', 'id': 3625615706, 'ino': 1099511637614, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups04.c'}, {'damage_type': 'backtrace', 'id': 3658371367, 'ino': 1099511635669, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock'}, {'damage_type': 'backtrace', 'id': 3661866448, 'ino': 1099511635623, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/LICENCE'}, {'damage_type': 'backtrace', 'id': 3664059367, 'ino': 1099511636818, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/drm/kernel_space/README'}, {'damage_type': 'backtrace', 'id': 3668390470, 'ino': 1099511635741, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_self'}, {'damage_type': 'backtrace', 'id': 3698268442, 'ino': 1099511637112, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/hotplug/memory_hotplug/Xpm-tests/test-mpm-file-1m'}, {'damage_type': 'backtrace', 'id': 3743134151, 'ino': 1099511635602, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/mqueues/multi_send_rev_2.c'}, {'damage_type': 'backtrace', 'id': 3778095971, 'ino': 1099511635709, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init/s-c.c'}, {'damage_type': 'backtrace', 'id': 3791959789, 'ino': 1099511635632, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open/s-c1.c'}, {'damage_type': 'backtrace', 'id': 3794595493, 'ino': 1099511637055, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/io-throttle/README'}, {'damage_type': 'backtrace', 'id': 3892214032, 'ino': 1099511635630, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_getschedparam/LICENCE'}, {'damage_type': 'backtrace', 'id': 3899557980, 'ino': 1099511637616, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/setgroups03.c'}, {'damage_type': 'backtrace', 'id': 3923473354, 'ino': 1099511635721, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_once/LICENCE'}, {'damage_type': 'backtrace', 'id': 3936310323, 'ino': 1099511635671, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/s-c1.c'}, {'damage_type': 'backtrace', 'id': 3979041392, 'ino': 1099511635673, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/Makefile'}, {'damage_type': 'backtrace', 'id': 4001666075, 'ino': 1099511630907, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/docs/man/Makefile.in'}, {'damage_type': 'backtrace', 'id': 4043366605, 'ino': 1099511635707, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_init'}, {'damage_type': 'backtrace', 'id': 4047751035, 'ino': 1099511635642, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_getvalue/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 4053245847, 'ino': 1099511637617, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/setgroups/Makefile'}, {'damage_type': 'backtrace', 'id': 4061510281, 'ino': 1099511635647, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_exit/stress.c'}, {'damage_type': 'backtrace', 'id': 4069045312, 'ino': 1099511635326, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_unlink/assertions.xml'}, {'damage_type': 'backtrace', 'id': 4073477710, 'ino': 1099511635672, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_lock/s-c2.c'}, {'damage_type': 'backtrace', 'id': 4079277431, 'ino': 1099511635726, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_cond_timedwait/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 4093283160, 'ino': 1099511635739, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_create/LICENCE'}, {'damage_type': 'backtrace', 'id': 4115643364, 'ino': 1099511635665, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 4140059976, 'ino': 1099511635666, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_mutex_init/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 4140855942, 'ino': 1099511635631, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_open'}, {'damage_type': 'backtrace', 'id': 4143622090, 'ino': 1099511635611, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/semaphores/plan.txt'}, {'damage_type': 'backtrace', 'id': 4171701664, 'ino': 1099511635692, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill'}, {'damage_type': 'backtrace', 'id': 4196043010, 'ino': 1099511635618, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/sem_init/Makefile'}, {'damage_type': 'backtrace', 'id': 4225966950, 'ino': 1099511637411, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_net/selinux_raw.c'}, {'damage_type': 'backtrace', 'id': 4262793584, 'ino': 1099511635697, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/threads/pthread_kill/NOTES'}] 2024-09-19T07:25:26.777 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 15627118, 'ino': 1099511636855, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/userBlockInclude.c'}, {'damage_type': 'backtrace', 'id': 19631306, 'ino': 1099511631794, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/scripts/test/coverage_report.pl'}, {'damage_type': 'backtrace', 'id': 158539509, 'ino': 1099511636336, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/Makefile'}, {'damage_type': 'backtrace', 'id': 192319748, 'ino': 1099511631689, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_event_encode_test.c'}, {'damage_type': 'backtrace', 'id': 271645081, 'ino': 1099511631686, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_rptentry_test.c'}, {'damage_type': 'backtrace', 'id': 289968905, 'ino': 1099511636581, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/load_tbase.sh'}, {'damage_type': 'backtrace', 'id': 299408799, 'ino': 1099511631694, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_rdr_test.c'}, {'damage_type': 'backtrace', 'id': 304530769, 'ino': 1099511637911, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getsockname/getsockname01.c'}, {'damage_type': 'backtrace', 'id': 410026441, 'ino': 1099511636853, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/includeTest.c'}, {'damage_type': 'backtrace', 'id': 436820419, 'ino': 1099511635978, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config5'}, {'damage_type': 'backtrace', 'id': 469257784, 'ino': 1099511637419, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_hostname.c'}, {'damage_type': 'backtrace', 'id': 482126074, 'ino': 1099511630821, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_ripv'}, {'damage_type': 'backtrace', 'id': 488487970, 'ino': 1099511631693, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/Makefile.am'}, {'damage_type': 'backtrace', 'id': 515145109, 'ino': 1099511631685, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_text_utils_test.c'}, {'damage_type': 'backtrace', 'id': 528607757, 'ino': 1099511638195, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/brk/Makefile'}, {'damage_type': 'backtrace', 'id': 558037638, 'ino': 1099511635977, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/Makefile'}, {'damage_type': 'backtrace', 'id': 560261820, 'ino': 1099511635990, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/openfile/Makefile'}, {'damage_type': 'backtrace', 'id': 606960676, 'ino': 1099511638194, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/brk/brk01.c'}, {'damage_type': 'backtrace', 'id': 649827762, 'ino': 1099511631690, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/Makefile.in'}, {'damage_type': 'backtrace', 'id': 669171641, 'ino': 1099511637777, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/sched_setscheduler02.c'}, {'damage_type': 'backtrace', 'id': 807214658, 'ino': 1099511635975, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config2'}, {'damage_type': 'backtrace', 'id': 858368342, 'ino': 1099511631683, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_utils_test.c'}, {'damage_type': 'backtrace', 'id': 945323838, 'ino': 1099511638098, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect02.c'}, {'damage_type': 'backtrace', 'id': 974841801, 'ino': 1099511631682, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrinfo_test.c'}, {'damage_type': 'backtrace', 'id': 1013624650, 'ino': 1099511635822, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/Makefile'}, {'damage_type': 'backtrace', 'id': 1093712728, 'ino': 1099511635790, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget02.c'}, {'damage_type': 'backtrace', 'id': 1098752015, 'ino': 1099511631688, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrarea_test.c'}, {'damage_type': 'backtrace', 'id': 1171194058, 'ino': 1099511636854, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/Makefile'}, {'damage_type': 'backtrace', 'id': 1288337330, 'ino': 1099511638018, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_destroy/io_destroy01.c'}, {'damage_type': 'backtrace', 'id': 1297051521, 'ino': 1099511638099, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/Makefile'}, {'damage_type': 'backtrace', 'id': 1312256016, 'ino': 1099511635533, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_2.c'}, {'damage_type': 'backtrace', 'id': 1339473022, 'ino': 1099511630818, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_over'}, {'damage_type': 'backtrace', 'id': 1435184898, 'ino': 1099511636852, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/include/includeTest.h'}, {'damage_type': 'backtrace', 'id': 1453439878, 'ino': 1099511637776, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/Makefile'}, {'damage_type': 'backtrace', 'id': 1517951867, 'ino': 1099511630817, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_no_en'}, {'damage_type': 'backtrace', 'id': 1552330980, 'ino': 1099511630816, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_eipv'}, {'damage_type': 'backtrace', 'id': 1552501398, 'ino': 1099511636922, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_mem_hog.c'}, {'damage_type': 'backtrace', 'id': 1601164169, 'ino': 1099511635982, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config0'}, {'damage_type': 'backtrace', 'id': 1626396474, 'ino': 1099511635791, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget03.c'}, {'damage_type': 'backtrace', 'id': 1771791155, 'ino': 1099511638100, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect03.c'}, {'damage_type': 'backtrace', 'id': 1895650768, 'ino': 1099511637778, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/sched_setscheduler/sched_setscheduler01.c'}, {'damage_type': 'backtrace', 'id': 1937052244, 'ino': 1099511638019, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_destroy/Makefile'}, {'damage_type': 'backtrace', 'id': 1938071360, 'ino': 1099511631692, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_event_utils_test.c'}, {'damage_type': 'backtrace', 'id': 1947914201, 'ino': 1099511630815, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_irq'}, {'damage_type': 'backtrace', 'id': 1954490095, 'ino': 1099511630819, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout'}, {'damage_type': 'backtrace', 'id': 2023914764, 'ino': 1099511637559, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_getevents/Makefile'}, {'damage_type': 'backtrace', 'id': 2048143541, 'ino': 1099511635535, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_1.c'}, {'damage_type': 'backtrace', 'id': 2052074367, 'ino': 1099511635823, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/mallocstress.c'}, {'damage_type': 'backtrace', 'id': 2081055238, 'ino': 1099511637558, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/io_getevents/io_getevents01.c'}, {'damage_type': 'backtrace', 'id': 2109992935, 'ino': 1099511631684, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_struct_idrfield_test.c'}, {'damage_type': 'backtrace', 'id': 2276440739, 'ino': 1099511630813, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data'}, {'damage_type': 'backtrace', 'id': 2292995158, 'ino': 1099511636339, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_utils.c'}, {'damage_type': 'backtrace', 'id': 2346377986, 'ino': 1099511630811, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/refer'}, {'damage_type': 'backtrace', 'id': 2358499552, 'ino': 1099511635979, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config3'}, {'damage_type': 'backtrace', 'id': 2379114353, 'ino': 1099511637414, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_chroot.c'}, {'damage_type': 'backtrace', 'id': 2391504796, 'ino': 1099511636921, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/Makefile'}, {'damage_type': 'backtrace', 'id': 2524505861, 'ino': 1099511630822, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal'}, {'damage_type': 'backtrace', 'id': 2526684176, 'ino': 1099511636338, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/smt_smp_affinity.sh'}, {'damage_type': 'backtrace', 'id': 2682946298, 'ino': 1099511637416, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/Makefile'}, {'damage_type': 'backtrace', 'id': 2719997747, 'ino': 1099511635811, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl02.c'}, {'damage_type': 'backtrace', 'id': 2822631266, 'ino': 1099511630823, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/cases.sh'}, {'damage_type': 'backtrace', 'id': 2903998084, 'ino': 1099511637417, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_rawio.c'}, {'damage_type': 'backtrace', 'id': 3028671565, 'ino': 1099511635813, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl01.c'}, {'damage_type': 'backtrace', 'id': 3059258845, 'ino': 1099511636580, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.h'}, {'damage_type': 'backtrace', 'id': 3089219967, 'ino': 1099511637418, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_nice.c'}, {'damage_type': 'backtrace', 'id': 3128570573, 'ino': 1099511635989, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/openfile/openfile.c'}, {'damage_type': 'backtrace', 'id': 3182428227, 'ino': 1099511636337, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_affinity.c'}, {'damage_type': 'backtrace', 'id': 3189644129, 'ino': 1099511635824, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/mtest07/shm_test.c'}, {'damage_type': 'backtrace', 'id': 3276058643, 'ino': 1099511636582, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/str_mod.h'}, {'damage_type': 'backtrace', 'id': 3368525712, 'ino': 1099511636923, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/controllers/cpuset/cpuset_memory_spread_test/cpuset_memory_spread_testset.sh'}, {'damage_type': 'backtrace', 'id': 3400532420, 'ino': 1099511635980, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config4'}, {'damage_type': 'backtrace', 'id': 3508624721, 'ino': 1099511636340, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/sched/hyperthreading/ht_affinity/ht_utils.h'}, {'damage_type': 'backtrace', 'id': 3528258778, 'ino': 1099511630820, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout_ripv'}, {'damage_type': 'backtrace', 'id': 3585876933, 'ino': 1099511635974, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config1'}, {'damage_type': 'backtrace', 'id': 3609063774, 'ino': 1099511631695, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_enum_utils_test.c'}, {'damage_type': 'backtrace', 'id': 3653169162, 'ino': 1099511631793, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/scripts/test/generate_index.pl'}, {'damage_type': 'backtrace', 'id': 3725228464, 'ino': 1099511635981, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config6'}, {'damage_type': 'backtrace', 'id': 3770686148, 'ino': 1099511631691, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpiatca_enum_utils_test.c'}, {'damage_type': 'backtrace', 'id': 3863635168, 'ino': 1099511631687, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/sahpi/sahpi_time_utils_test.c'}, {'damage_type': 'backtrace', 'id': 3868906926, 'ino': 1099511635810, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/hugeshmctl03.c'}, {'damage_type': 'backtrace', 'id': 3886860759, 'ino': 1099511637415, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/security/selinux-testsuite/tests/capable_sys/selinux_capable_sys.sh'}, {'damage_type': 'backtrace', 'id': 3905377016, 'ino': 1099511635788, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/Makefile'}, {'damage_type': 'backtrace', 'id': 3941168486, 'ino': 1099511635534, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/Makefile'}, {'damage_type': 'backtrace', 'id': 3953285744, 'ino': 1099511635812, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmctl/Makefile'}, {'damage_type': 'backtrace', 'id': 3996610074, 'ino': 1099511638097, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/mprotect/mprotect01.c'}, {'damage_type': 'backtrace', 'id': 4093386960, 'ino': 1099511636577, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.mod.c'}, {'damage_type': 'backtrace', 'id': 4095971334, 'ino': 1099511637910, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/syscalls/getsockname/Makefile'}, {'damage_type': 'backtrace', 'id': 4118237526, 'ino': 1099511635787, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget05.c'}, {'damage_type': 'backtrace', 'id': 4118672180, 'ino': 1099511630814, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_userspace'}, {'damage_type': 'backtrace', 'id': 4122112044, 'ino': 1099511635596, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals/sigismember_stress_1.c'}, {'damage_type': 'backtrace', 'id': 4155976402, 'ino': 1099511635789, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/mem/hugetlb/hugeshmget/hugeshmget01.c'}, {'damage_type': 'backtrace', 'id': 4209640300, 'ino': 1099511635976, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/ext4-new-features/ext4-ffsb-config/ffsb-config7'}, {'damage_type': 'backtrace', 'id': 4274777221, 'ino': 1099511636578, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/tbase.c'}, {'damage_type': 'backtrace', 'id': 4285421481, 'ino': 1099511636579, 'path': '/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/device-drivers/base/tbase/Makefile'}] 2024-09-19T07:25:26.777 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-09-19T07:25:26.986 INFO:tasks.workunit.client.0.smithi098.stdout:3/930: sync 2024-09-19T07:25:26.986 INFO:tasks.workunit.client.0.smithi098.stdout:8/943: sync 2024-09-19T07:25:26.987 INFO:tasks.workunit.client.0.smithi098.stdout:9/905: sync 2024-09-19T07:25:26.987 INFO:tasks.workunit.client.0.smithi098.stdout:6/936: sync 2024-09-19T07:25:26.988 INFO:tasks.workunit.client.0.smithi098.stdout:6/937: symlink d2/d5/d1f/d127/l14a 0 2024-09-19T07:25:26.988 INFO:tasks.workunit.client.0.smithi098.stdout:8/944: mknod d0/d16/d7d/c13a 0 2024-09-19T07:25:26.988 INFO:tasks.workunit.client.0.smithi098.stdout:8/945: fsync d0/d2c/d81/f117 0 2024-09-19T07:25:26.989 INFO:tasks.workunit.client.0.smithi098.stdout:6/938: creat d2/db0/d8d/f14b x:0 0 0 2024-09-19T07:25:26.989 INFO:tasks.workunit.client.0.smithi098.stdout:6/939: fsync d2/d5/d1f/d26/d7b/da3/f11b 0 2024-09-19T07:25:26.989 INFO:tasks.workunit.client.0.smithi098.stdout:3/931: mkdir de/d4e/d6d/dfb/d118 0 2024-09-19T07:25:26.991 INFO:tasks.workunit.client.0.smithi098.stdout:8/946: creat d0/d33/d55/d8a/f13b x:0 0 0 2024-09-19T07:25:26.991 INFO:tasks.workunit.client.0.smithi098.stdout:6/940: link d2/d5/d1f/d26/d42/d48/d53/da2/d139/f2f d2/db0/f14c 0 2024-09-19T07:25:26.999 INFO:tasks.workunit.client.0.smithi098.stdout:6/941: write d2/db0/d8d/fcc [1034382,64291] 0 2024-09-19T07:25:27.000 INFO:tasks.workunit.client.0.smithi098.stdout:8/947: write d0/d16/d65/dd8/fea [921572,52878] 0 2024-09-19T07:25:27.000 INFO:tasks.workunit.client.0.smithi098.stdout:6/942: mkdir d2/d5/d1f/d26/d42/d14d 0 2024-09-19T07:25:27.001 INFO:tasks.workunit.client.0.smithi098.stdout:6/943: mkdir d2/d11/d14e 0 2024-09-19T07:25:27.001 INFO:tasks.workunit.client.0.smithi098.stdout:8/948: symlink d0/d33/d55/d8a/d12/dba/df2/d9e/l13c 0 2024-09-19T07:25:27.002 INFO:tasks.workunit.client.0.smithi098.stdout:8/949: mkdir d0/d33/d44/dbe/d13d 0 2024-09-19T07:25:27.002 INFO:tasks.workunit.client.0.smithi098.stdout:8/950: getdents d0/d33/d55/d8a/d12/dba/df2/d9e/d124 0 2024-09-19T07:25:27.010 INFO:tasks.workunit.client.0.smithi098.stdout:9/906: dwrite d3/d6/d46/d83/fdb [0,4194304] 0 2024-09-19T07:25:27.013 INFO:tasks.workunit.client.0.smithi098.stdout:9/907: mknod d3/dc/df/d15/d1a/d2b/d49/d74/c12a 0 2024-09-19T07:25:27.015 INFO:tasks.workunit.client.0.smithi098.stdout:9/908: creat d3/d6/d8/d125/f12b x:0 0 0 2024-09-19T07:25:27.016 INFO:tasks.workunit.client.0.smithi098.stdout:9/909: creat d3/d16/d43/d51/d6e/f12c x:0 0 0 2024-09-19T07:25:27.018 INFO:tasks.workunit.client.0.smithi098.stdout:9/910: link d3/dc/df/d15/d1b/c3b d3/dc/df/d15/d1a/dc9/c12d 0 2024-09-19T07:25:27.019 INFO:tasks.workunit.client.0.smithi098.stdout:6/944: dwrite d2/fe [0,4194304] 0 2024-09-19T07:25:27.019 INFO:tasks.workunit.client.0.smithi098.stdout:9/911: mkdir d3/dc/df/d15/d1a/d12e 0 2024-09-19T07:25:27.019 INFO:tasks.workunit.client.0.smithi098.stdout:6/945: write d2/db0/f13d [965700,106070] 0 2024-09-19T07:25:27.024 INFO:tasks.workunit.client.0.smithi098.stdout:9/912: dread d3/d6/d46/d83/da9/fc8 [0,4194304] 0 2024-09-19T07:25:27.025 INFO:tasks.workunit.client.0.smithi098.stdout:6/946: write d2/d5/d1f/d26/d7b/de0/ffe [969961,54649] 0 2024-09-19T07:25:27.026 INFO:tasks.workunit.client.0.smithi098.stdout:9/913: mkdir d3/dc/df/d15/d1b/d90/d12f 0 2024-09-19T07:25:27.026 INFO:tasks.workunit.client.0.smithi098.stdout:9/914: mkdir d3/d16/d43/d115/d130 0 2024-09-19T07:25:27.027 INFO:tasks.workunit.client.0.smithi098.stdout:9/915: unlink d3/d16/ff1 0 2024-09-19T07:25:27.030 INFO:tasks.workunit.client.0.smithi098.stdout:6/947: dread d2/db0/f14c [0,4194304] 0 2024-09-19T07:25:27.053 INFO:tasks.workunit.client.0.smithi098.stdout:9/916: dwrite d3/dc/df/d15/d1a/d2d/f3a [4194304,4194304] 0 2024-09-19T07:25:27.053 INFO:tasks.workunit.client.0.smithi098.stdout:6/948: dwrite d2/d5/d1f/d26/d42/d48/d123/fac [0,4194304] 0 2024-09-19T07:25:27.055 INFO:tasks.workunit.client.0.smithi098.stdout:6/949: creat d2/d11/d14e/f14f x:0 0 0 2024-09-19T07:25:27.063 INFO:tasks.workunit.client.0.smithi098.stdout:9/917: write d3/dc/df/d15/d1a/d2b/d49/d50/fd6 [1040295,129625] 0 2024-09-19T07:25:27.069 INFO:tasks.workunit.client.0.smithi098.stdout:9/918: read d3/d16/d43/d51/d6e/f10e [2179097,84434] 0 2024-09-19T07:25:27.070 INFO:tasks.workunit.client.0.smithi098.stdout:9/919: rmdir d3/dc/df/d15/d1a/d12e 0 2024-09-19T07:25:27.071 INFO:tasks.workunit.client.0.smithi098.stdout:9/920: mknod d3/d16/d43/db1/c131 0 2024-09-19T07:25:27.072 INFO:tasks.workunit.client.0.smithi098.stdout:9/921: creat d3/dc/df/d15/d2f/f132 x:0 0 0 2024-09-19T07:25:27.073 INFO:tasks.workunit.client.0.smithi098.stdout:9/922: creat d3/f133 x:0 0 0 2024-09-19T07:25:27.075 INFO:tasks.workunit.client.0.smithi098.stdout:9/923: rmdir d3/d16/d43/d61/da6/dd8 39 2024-09-19T07:25:27.075 INFO:tasks.workunit.client.0.smithi098.stdout:9/924: write d3/d16/d43/d51/dd3/d7e/f8e [843925,115262] 0 2024-09-19T07:25:27.098 INFO:tasks.workunit.client.0.smithi098.stdout:9/925: dwrite d3/d16/d43/dce/f10c [0,4194304] 0 2024-09-19T07:25:27.100 INFO:tasks.workunit.client.0.smithi098.stdout:9/926: truncate d3/d16/d38/f26 920754 0 2024-09-19T07:25:27.101 INFO:tasks.workunit.client.0.smithi098.stdout:9/927: mknod d3/dc/df/d15/d1a/d2b/d49/d65/c134 0 2024-09-19T07:25:27.102 INFO:tasks.workunit.client.0.smithi098.stdout:9/928: getdents d3/dc/df/d15/d2f 0 2024-09-19T07:25:27.104 INFO:tasks.workunit.client.0.smithi098.stdout:9/929: unlink d3/d6/caa 0 2024-09-19T07:25:27.104 INFO:tasks.workunit.client.0.smithi098.stdout:9/930: fsync d3/dc/df/d15/d1b/f9a 0 2024-09-19T07:25:27.105 INFO:tasks.workunit.client.0.smithi098.stdout:9/931: mknod d3/dc/df/d15/d1b/c135 0 2024-09-19T07:25:27.105 INFO:tasks.workunit.client.0.smithi098.stdout:9/932: write d3/d16/d43/db1/ff5 [773219,76245] 0 2024-09-19T07:25:27.106 INFO:tasks.workunit.client.0.smithi098.stdout:9/933: unlink d3/d16/d38/d22/l53 0 2024-09-19T07:25:27.107 INFO:tasks.workunit.client.0.smithi098.stdout:9/934: symlink d3/d16/d43/d61/da6/l136 0 2024-09-19T07:25:27.108 INFO:tasks.workunit.client.0.smithi098.stdout:9/935: write d3/dc/df/d31/fda [1016210,125272] 0 2024-09-19T07:25:28.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:27 smithi162 ceph-mon[35726]: pgmap v105: 97 pgs: 97 active+clean; 2.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 6.0 MiB/s wr, 39 op/s 2024-09-19T07:25:28.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:27 smithi098 ceph-mon[30950]: pgmap v105: 97 pgs: 97 active+clean; 2.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 6.0 MiB/s wr, 39 op/s 2024-09-19T07:25:28.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:27 smithi139 ceph-mon[35039]: pgmap v105: 97 pgs: 97 active+clean; 2.2 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 6.0 MiB/s wr, 39 op/s 2024-09-19T07:25:29.389 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T07:25:29.389 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:25:29.553 INFO:tasks.workunit.client.0.smithi098.stdout:5/879: rename dc/d100/f72 to dc/de/d13/d5c/daf/db9/d118/f138 0 2024-09-19T07:25:29.553 INFO:tasks.workunit.client.0.smithi098.stdout:5/880: readlink dc/de/d13/d46/d2e/d37/d81/l80 0 2024-09-19T07:25:29.554 INFO:tasks.workunit.client.0.smithi098.stdout:5/881: symlink dc/de/d13/d5c/daf/db9/d121/l139 0 2024-09-19T07:25:29.556 INFO:tasks.workunit.client.0.smithi098.stdout:5/882: creat dc/de/d13/d46/d2e/d37/d6d/dee/d112/f13a x:0 0 0 2024-09-19T07:25:29.557 INFO:tasks.workunit.client.0.smithi098.stdout:5/883: creat dc/de/d13/d46/d23/dc1/f13b x:0 0 0 2024-09-19T07:25:29.558 INFO:tasks.workunit.client.0.smithi098.stdout:9/936: sync 2024-09-19T07:25:29.558 INFO:tasks.workunit.client.0.smithi098.stdout:5/884: mkdir dc/de/d13/d7d/df8/d13c 0 2024-09-19T07:25:29.559 INFO:tasks.workunit.client.0.smithi098.stdout:5/885: mknod dc/de/d13/d46/d2e/d37/d67/d103/c13d 0 2024-09-19T07:25:29.559 INFO:tasks.workunit.client.0.smithi098.stdout:5/886: stat dc/de/d13/d5c/daf/db9/fe8 0 2024-09-19T07:25:29.559 INFO:tasks.workunit.client.0.smithi098.stdout:5/887: dread - dc/de/d13/d46/d2e/d37/d6d/dee/d112/dba/ff9 zero size 2024-09-19T07:25:29.570 INFO:tasks.workunit.client.0.smithi098.stdout:3/932: rename de/df/l7e to de/df/d31/d61/d79/l119 0 2024-09-19T07:25:29.571 INFO:tasks.workunit.client.0.smithi098.stdout:3/933: mknod de/df/d1f/d72/c11a 0 2024-09-19T07:25:29.573 INFO:tasks.workunit.client.0.smithi098.stdout:3/934: getdents de/df/d31/d61/d3f/d64 0 2024-09-19T07:25:29.573 INFO:tasks.workunit.client.0.smithi098.stdout:3/935: write de/df/d31/f5b [2523677,68713] 0 2024-09-19T07:25:29.576 INFO:tasks.workunit.client.0.smithi098.stdout:3/936: unlink de/df/d1f/d2b/d93/de5/fd2 0 2024-09-19T07:25:29.576 INFO:tasks.workunit.client.0.smithi098.stdout:3/937: truncate de/df/d31/d61/d3f/f7a 83159 0 2024-09-19T07:25:29.576 INFO:tasks.workunit.client.0.smithi098.stdout:3/938: chown de/df/d1f/d72/f98 4118 1 2024-09-19T07:25:29.583 INFO:tasks.workunit.client.0.smithi098.stdout:9/937: dwrite d3/dc/ffa [0,4194304] 0 2024-09-19T07:25:29.586 INFO:tasks.workunit.client.0.smithi098.stdout:9/938: write d3/d6/f91 [237925,77291] 0 2024-09-19T07:25:29.586 INFO:tasks.workunit.client.0.smithi098.stdout:9/939: write d3/dc/df/f4e [1473911,103950] 0 2024-09-19T07:25:29.586 INFO:tasks.workunit.client.0.smithi098.stdout:8/951: rename d0/d16/d7d/dcc to d0/d33/d44/dbe/d13e 0 2024-09-19T07:25:29.588 INFO:tasks.workunit.client.0.smithi098.stdout:9/940: creat d3/d6/d46/d83/f137 x:0 0 0 2024-09-19T07:25:29.588 INFO:tasks.workunit.client.0.smithi098.stdout:6/950: rename d2/d5/d1f/d26/d42/d48/d53/da2/ld6 to d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/d131/l150 0 2024-09-19T07:25:29.590 INFO:tasks.workunit.client.0.smithi098.stdout:9/941: mknod d3/dc/df/d15/d1a/db7/c138 0 2024-09-19T07:25:29.590 INFO:tasks.workunit.client.0.smithi098.stdout:9/942: fsync d3/dc/df/d15/d1a/d2d/f3a 0 2024-09-19T07:25:29.590 INFO:tasks.workunit.client.0.smithi098.stdout:9/943: fdatasync d3/d6/d46/d83/da9/dbc/ff6 0 2024-09-19T07:25:29.590 INFO:tasks.workunit.client.0.smithi098.stdout:9/944: chown d3/dc/df/d15/d1b/d90/lc3 11 1 2024-09-19T07:25:29.590 INFO:tasks.workunit.client.0.smithi098.stdout:8/952: creat d0/d33/d44/dbe/d13e/dd2/df5/d115/f13f x:0 0 0 2024-09-19T07:25:29.591 INFO:tasks.workunit.client.0.smithi098.stdout:8/953: chown d0/d33/d55/d8a/d12/dba/df2/d9e/da4/d11c 38665139 1 2024-09-19T07:25:29.592 INFO:tasks.workunit.client.0.smithi098.stdout:9/945: rename d3/dc/df/d15/d1a/d2d/c32 to d3/d6/d46/d83/da9/dbc/c139 0 2024-09-19T07:25:29.594 INFO:tasks.workunit.client.0.smithi098.stdout:8/954: link d0/d16/d61/l105 d0/d33/d55/d8a/d12/dba/df2/d9e/da4/db9/l140 0 2024-09-19T07:25:29.595 INFO:tasks.workunit.client.0.smithi098.stdout:8/955: mkdir d0/dc7/d141 0 2024-09-19T07:25:29.596 INFO:tasks.workunit.client.0.smithi098.stdout:8/956: mknod d0/dc7/d141/c142 0 2024-09-19T07:25:29.597 INFO:tasks.workunit.client.0.smithi098.stdout:8/957: chown d0/d16/f95 3139 1 2024-09-19T07:25:29.597 INFO:tasks.workunit.client.0.smithi098.stdout:8/958: write d0/d33/d55/d8a/d12/dba/df2/d9e/da4/faf [511493,45575] 0 2024-09-19T07:25:29.601 INFO:tasks.workunit.client.0.smithi098.stdout:3/939: dwrite de/f25 [0,4194304] 0 2024-09-19T07:25:29.601 INFO:tasks.workunit.client.0.smithi098.stdout:3/940: chown de/df/d1f/d72/cd7 106535662 1 2024-09-19T07:25:29.620 INFO:tasks.workunit.client.0.smithi098.stdout:6/951: dwrite d2/d11/fb4 [0,4194304] 0 2024-09-19T07:25:29.620 INFO:tasks.workunit.client.0.smithi098.stdout:6/952: readlink d2/d5/l45 0 2024-09-19T07:25:29.629 INFO:tasks.workunit.client.0.smithi098.stdout:3/941: dwrite de/df/d1f/d2b/d93/fe1 [0,4194304] 0 2024-09-19T07:25:29.629 INFO:tasks.workunit.client.0.smithi098.stdout:3/942: chown de/df/d1f/d2b/d93/fe1 866675206 1 2024-09-19T07:25:29.632 INFO:tasks.workunit.client.0.smithi098.stdout:8/959: dwrite d0/d16/d65/fd6 [0,4194304] 0 2024-09-19T07:25:29.633 INFO:tasks.workunit.client.0.smithi098.stdout:8/960: truncate d0/d16/f94 2904448 0 2024-09-19T07:25:29.640 INFO:tasks.workunit.client.0.smithi098.stdout:3/943: link de/df/d31/d61/d3f/d64/d84/l8b de/d4e/d6d/d71/df3/l11b 0 2024-09-19T07:25:29.640 INFO:tasks.workunit.client.0.smithi098.stdout:3/944: chown de/df/d31/d61/d69/def 6447 1 2024-09-19T07:25:29.640 INFO:tasks.workunit.client.0.smithi098.stdout:3/945: chown de/df/d31/d61/d79/fb5 197050 1 2024-09-19T07:25:29.644 INFO:tasks.workunit.client.0.smithi098.stdout:3/946: unlink de/d4e/d6d/d71/c103 0 2024-09-19T07:25:29.657 INFO:tasks.workunit.client.0.smithi098.stdout:8/961: dwrite d0/d33/d55/d8a/d12/dba/df2/d9e/da4/db9/ff6 [0,4194304] 0 2024-09-19T07:25:29.657 INFO:tasks.workunit.client.0.smithi098.stdout:8/962: chown d0/d33/d55/d8a/d12/dba/df2/d9e/da4/d11c/d139 1185997 1 2024-09-19T07:25:29.660 INFO:tasks.workunit.client.0.smithi098.stdout:8/963: write d0/d16/d65/dd8/fea [166023,6085] 0 2024-09-19T07:25:29.661 INFO:tasks.workunit.client.0.smithi098.stdout:8/964: creat d0/d16/d7d/f143 x:0 0 0 2024-09-19T07:25:29.662 INFO:tasks.workunit.client.0.smithi098.stdout:8/965: link d0/d16/f3a d0/d33/f144 0 2024-09-19T07:25:29.662 INFO:tasks.workunit.client.0.smithi098.stdout:8/966: write d0/d16/d65/dd8/fe6 [785248,76190] 0 2024-09-19T07:25:29.666 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:29.667 INFO:tasks.workunit.client.0.smithi098.stdout:3/947: dwrite de/df/d1f/f56 [0,4194304] 0 2024-09-19T07:25:29.667 INFO:tasks.workunit.client.0.smithi098.stdout:3/948: chown de/df/d31/d61/d69/cff 140230992 1 2024-09-19T07:25:29.668 INFO:tasks.workunit.client.0.smithi098.stdout:3/949: creat de/d4e/d6d/dfb/d118/f11c x:0 0 0 2024-09-19T07:25:29.668 INFO:tasks.workunit.client.0.smithi098.stdout:3/950: symlink de/deb/l11d 0 2024-09-19T07:25:29.670 INFO:tasks.workunit.client.0.smithi098.stdout:3/951: symlink de/d4e/d6d/d8c/dab/de6/df4/d106/l11e 0 2024-09-19T07:25:29.670 INFO:tasks.workunit.client.0.smithi098.stdout:3/952: chown de/d4e/d6d/c80 410651 1 2024-09-19T07:25:29.679 INFO:tasks.workunit.client.0.smithi098.stdout:3/953: write de/df/d31/f7d [1111180,127057] 0 2024-09-19T07:25:29.680 INFO:tasks.workunit.client.0.smithi098.stdout:3/954: write de/df/d1f/d2b/d93/fb2 [268903,128146] 0 2024-09-19T07:25:29.682 INFO:tasks.workunit.client.0.smithi098.stdout:3/955: unlink de/df/d31/d61/d69/ddd/de2/lf8 0 2024-09-19T07:25:29.695 INFO:tasks.workunit.client.0.smithi098.stdout:8/967: dwrite d0/d16/d65/dd8/f122 [0,4194304] 0 2024-09-19T07:25:29.696 INFO:tasks.workunit.client.0.smithi098.stdout:8/968: rmdir d0/dc7/d141 39 2024-09-19T07:25:29.701 INFO:tasks.workunit.client.0.smithi098.stdout:8/969: creat d0/d33/d55/d8a/f145 x:0 0 0 2024-09-19T07:25:29.705 INFO:tasks.workunit.client.0.smithi098.stdout:3/956: dwrite de/df/d31/d61/d3f/fb9 [0,4194304] 0 2024-09-19T07:25:29.706 INFO:tasks.workunit.client.0.smithi098.stdout:3/957: readlink de/df/d1f/d2b/lc0 0 2024-09-19T07:25:29.717 INFO:tasks.workunit.client.0.smithi098.stdout:3/958: dread de/d4e/fde [0,4194304] 0 2024-09-19T07:25:29.724 INFO:tasks.workunit.client.0.smithi098.stdout:8/970: dwrite d0/d33/d55/d8a/d12/dba/df2/fdc [0,4194304] 0 2024-09-19T07:25:29.725 INFO:tasks.workunit.client.0.smithi098.stdout:8/971: mkdir d0/d2c/d146 0 2024-09-19T07:25:29.725 INFO:tasks.workunit.client.0.smithi098.stdout:8/972: write d0/d2c/fe7 [7853563,49732] 0 2024-09-19T07:25:29.726 INFO:tasks.workunit.client.0.smithi098.stdout:8/973: write d0/d33/d55/d8a/d12/fab [4420024,45332] 0 2024-09-19T07:25:29.726 INFO:tasks.workunit.client.0.smithi098.stdout:8/974: read - d0/d33/d44/dbe/d13e/dd2/df5/d115/f127 zero size 2024-09-19T07:25:29.728 INFO:tasks.workunit.client.0.smithi098.stdout:8/975: rename d0/d16/d7d/fb2 to d0/d16/f147 0 2024-09-19T07:25:29.728 INFO:tasks.workunit.client.0.smithi098.stdout:8/976: stat d0/d33/f6e 0 2024-09-19T07:25:29.737 INFO:tasks.workunit.client.0.smithi098.stdout:3/959: dwrite de/df/d31/d61/d69/ff2 [0,4194304] 0 2024-09-19T07:25:29.739 INFO:tasks.workunit.client.0.smithi098.stdout:3/960: symlink de/df/d31/d61/d79/l11f 0 2024-09-19T07:25:29.740 INFO:tasks.workunit.client.0.smithi098.stdout:3/961: mknod de/deb/c120 0 2024-09-19T07:25:29.740 INFO:tasks.workunit.client.0.smithi098.stdout:5/888: sync 2024-09-19T07:25:29.740 INFO:tasks.workunit.client.0.smithi098.stdout:5/889: write dc/de/d13/d5c/daf/db9/d118/f128 [183476,100786] 0 2024-09-19T07:25:29.741 INFO:tasks.workunit.client.0.smithi098.stdout:3/962: truncate de/d4e/d6d/fa1 1233289 0 2024-09-19T07:25:29.741 INFO:tasks.workunit.client.0.smithi098.stdout:3/963: write de/df/d1f/f83 [1025386,94287] 0 2024-09-19T07:25:29.741 INFO:tasks.workunit.client.0.smithi098.stdout:3/964: read de/d4e/fdf [167565,23545] 0 2024-09-19T07:25:29.742 INFO:tasks.workunit.client.0.smithi098.stdout:3/965: readlink de/df/d1f/d2b/l68 0 2024-09-19T07:25:29.742 INFO:tasks.workunit.client.0.smithi098.stdout:3/966: read - de/df/d31/d61/d79/f10e zero size 2024-09-19T07:25:29.742 INFO:tasks.workunit.client.0.smithi098.stdout:5/890: truncate dc/de/d13/d46/d2e/d37/d6d/dee/d112/f39 527743 0 2024-09-19T07:25:29.744 INFO:tasks.workunit.client.0.smithi098.stdout:3/967: dread de/df/d31/f3d [0,4194304] 0 2024-09-19T07:25:29.744 INFO:tasks.workunit.client.0.smithi098.stdout:5/891: mkdir dc/de/d13e 0 2024-09-19T07:25:29.744 INFO:tasks.workunit.client.0.smithi098.stdout:5/892: dread - dc/de/d13/d5c/da2/fb7 zero size 2024-09-19T07:25:29.745 INFO:tasks.workunit.client.0.smithi098.stdout:5/893: truncate dc/de/d13/d46/d2e/f33 3529764 0 2024-09-19T07:25:29.747 INFO:tasks.workunit.client.0.smithi098.stdout:5/894: symlink dc/de/d13/d46/d23/dc1/l13f 0 2024-09-19T07:25:29.748 INFO:tasks.workunit.client.0.smithi098.stdout:5/895: mknod dc/d6c/c140 0 2024-09-19T07:25:29.751 INFO:tasks.workunit.client.0.smithi098.stdout:5/896: dread dc/de/d13/d46/d2e/d37/d6d/dee/d112/f39 [0,4194304] 0 2024-09-19T07:25:29.751 INFO:tasks.workunit.client.0.smithi098.stdout:5/897: getdents dc/de/d13/d5c/d10d 0 2024-09-19T07:25:29.753 INFO:tasks.workunit.client.0.smithi098.stdout:5/898: rename dc/de/f108 to dc/de/d13/d46/f141 0 2024-09-19T07:25:29.754 INFO:tasks.workunit.client.0.smithi098.stdout:5/899: creat dc/de/d13/d46/d23/d5e/f142 x:0 0 0 2024-09-19T07:25:29.754 INFO:tasks.workunit.client.0.smithi098.stdout:5/900: dread - dc/de/d13/d46/d23/dc1/ff4 zero size 2024-09-19T07:25:29.754 INFO:tasks.workunit.client.0.smithi098.stdout:5/901: getdents dc/de/d13/d5c/daf/db9/d118 0 2024-09-19T07:25:29.760 INFO:tasks.workunit.client.0.smithi098.stdout:5/902: mknod dc/de/d13/d46/d2e/d37/d6d/dee/d112/c143 0 2024-09-19T07:25:29.761 INFO:tasks.workunit.client.0.smithi098.stdout:5/903: rename dc/de/d13/d5c/da2/fb7 to dc/de/d13/d46/d2e/da5/f144 0 2024-09-19T07:25:29.768 INFO:tasks.workunit.client.0.smithi098.stdout:3/968: dwrite de/d4e/d6d/d8c/fc8 [0,4194304] 0 2024-09-19T07:25:29.768 INFO:tasks.workunit.client.0.smithi098.stdout:3/969: write de/df/d1f/d2b/f77 [2406584,8985] 0 2024-09-19T07:25:29.769 INFO:tasks.workunit.client.0.smithi098.stdout:3/970: creat de/d4e/d6d/d71/df3/f121 x:0 0 0 2024-09-19T07:25:29.798 INFO:tasks.workunit.client.0.smithi098.stdout:3/971: dwrite de/f2f [4194304,4194304] 0 2024-09-19T07:25:29.798 INFO:tasks.workunit.client.0.smithi098.stdout:3/972: symlink de/d4e/d6d/d8c/l122 0 2024-09-19T07:25:29.799 INFO:tasks.workunit.client.0.smithi098.stdout:3/973: creat de/d4e/d6d/dfb/d118/f123 x:0 0 0 2024-09-19T07:25:29.800 INFO:tasks.workunit.client.0.smithi098.stdout:3/974: symlink de/df/d31/d61/d69/ddd/l124 0 2024-09-19T07:25:29.804 INFO:tasks.workunit.client.0.smithi098.stdout:3/975: dread de/df/d1f/d2b/f5e [0,4194304] 0 2024-09-19T07:25:29.806 INFO:tasks.workunit.client.0.smithi098.stdout:3/976: mkdir de/df/d31/d61/d69/d125 0 2024-09-19T07:25:29.815 INFO:tasks.workunit.client.0.smithi098.stdout:3/977: dread de/d4e/d6d/f110 [0,4194304] 0 2024-09-19T07:25:29.817 INFO:tasks.workunit.client.0.smithi098.stdout:3/978: rename de/d4e/fde to de/d4e/d6d/d71/f126 0 2024-09-19T07:25:29.819 INFO:tasks.workunit.client.0.smithi098.stdout:3/979: creat de/df/d31/d61/d69/dcd/f127 x:0 0 0 2024-09-19T07:25:29.819 INFO:tasks.workunit.client.0.smithi098.stdout:3/980: readlink de/df/d31/d61/d69/ddd/l107 0 2024-09-19T07:25:29.829 INFO:tasks.workunit.client.0.smithi098.stdout:3/981: rename de/df/d31/d61/d79/f10e to de/f128 0 2024-09-19T07:25:29.831 INFO:tasks.workunit.client.0.smithi098.stdout:3/982: mkdir de/df/d1f/d129 0 2024-09-19T07:25:29.834 INFO:tasks.workunit.client.0.smithi098.stdout:3/983: getdents de/d4e/d6d/d8c/dab/de6 0 2024-09-19T07:25:29.835 INFO:tasks.workunit.client.0.smithi098.stdout:3/984: creat de/d4e/f12a x:0 0 0 2024-09-19T07:25:29.835 INFO:tasks.workunit.client.0.smithi098.stdout:3/985: fdatasync de/f26 0 2024-09-19T07:25:29.836 INFO:tasks.workunit.client.0.smithi098.stdout:3/986: mknod de/d4e/d6d/d8c/dab/de6/df4/d106/c12b 0 2024-09-19T07:25:29.844 INFO:tasks.workunit.client.0.smithi098.stdout:9/946: sync 2024-09-19T07:25:29.845 INFO:tasks.workunit.client.0.smithi098.stdout:9/947: unlink d3/dc/df/f4e 0 2024-09-19T07:25:29.845 INFO:tasks.workunit.client.0.smithi098.stdout:9/948: rename d3/d16/d43 to d3/d16/d43/d61/da6/d13a 22 2024-09-19T07:25:29.848 INFO:tasks.workunit.client.0.smithi098.stdout:9/949: write d3/d16/d38/d48/f96 [3991592,4758] 0 2024-09-19T07:25:29.850 INFO:tasks.workunit.client.0.smithi098.stdout:9/950: creat d3/d16/d43/f13b x:0 0 0 2024-09-19T07:25:29.850 INFO:tasks.workunit.client.0.smithi098.stdout:9/951: write d3/d16/d38/fc6 [1014941,16267] 0 2024-09-19T07:25:29.858 INFO:tasks.workunit.client.0.smithi098.stdout:3/987: dwrite de/f46 [0,4194304] 0 2024-09-19T07:25:29.862 INFO:tasks.workunit.client.0.smithi098.stdout:3/988: mknod de/df/d31/c12c 0 2024-09-19T07:25:29.862 INFO:tasks.workunit.client.0.smithi098.stdout:3/989: fdatasync de/df/d31/f7d 0 2024-09-19T07:25:29.862 INFO:tasks.workunit.client.0.smithi098.stdout:3/990: readlink de/d4e/l10f 0 2024-09-19T07:25:29.865 INFO:tasks.workunit.client.0.smithi098.stdout:9/952: dread d3/d16/d43/dce/f10c [0,4194304] 0 2024-09-19T07:25:29.866 INFO:tasks.workunit.client.0.smithi098.stdout:9/953: symlink d3/d6/d8/d125/l13c 0 2024-09-19T07:25:29.866 INFO:tasks.workunit.client.0.smithi098.stdout:9/954: write d3/dc/df/d15/d1a/d2d/d7f/ff8 [1507962,42829] 0 2024-09-19T07:25:29.870 INFO:tasks.workunit.client.0.smithi098.stdout:9/955: dread d3/d16/d38/f36 [0,4194304] 0 2024-09-19T07:25:29.870 INFO:tasks.workunit.client.0.smithi098.stdout:9/956: truncate d3/dc/fea 550778 0 2024-09-19T07:25:29.871 INFO:tasks.workunit.client.0.smithi098.stdout:9/957: mkdir d3/dc/d13d 0 2024-09-19T07:25:29.871 INFO:tasks.workunit.client.0.smithi098.stdout:9/958: write d3/dc/df/da3/f127 [560034,68907] 0 2024-09-19T07:25:29.871 INFO:tasks.workunit.client.0.smithi098.stdout:9/959: write d3/d6/d46/d83/da9/dbc/f129 [407244,38615] 0 2024-09-19T07:25:29.873 INFO:tasks.workunit.client.0.smithi098.stdout:3/991: link de/df/d31/d61/d79/cc7 de/df/c12d 0 2024-09-19T07:25:29.881 INFO:tasks.workunit.client.0.smithi098.stdout:9/960: read d3/d6/d46/ff0 [2282152,69260] 0 2024-09-19T07:25:29.883 INFO:tasks.workunit.client.0.smithi098.stdout:9/961: creat d3/dc/df/d15/d1a/d2b/f13e x:0 0 0 2024-09-19T07:25:29.883 INFO:tasks.workunit.client.0.smithi098.stdout:9/962: chown d3/dc/df/da3/l101 0 1 2024-09-19T07:25:29.883 INFO:tasks.workunit.client.0.smithi098.stdout:9/963: stat d3/dc/df/d15/d1a/d2b/d49/d50/l75 0 2024-09-19T07:25:29.884 INFO:tasks.workunit.client.0.smithi098.stdout:9/964: rename d3/dc/df/d15/d1a/dc9/c12d to d3/d6/d8/c13f 0 2024-09-19T07:25:29.895 INFO:tasks.workunit.client.0.smithi098.stdout:3/992: dwrite de/d4e/d6d/d71/fbf [4194304,4194304] 0 2024-09-19T07:25:29.899 INFO:tasks.workunit.client.0.smithi098.stdout:3/993: unlink de/d4e/d6d/lc1 0 2024-09-19T07:25:29.900 INFO:tasks.workunit.client.0.smithi098.stdout:3/994: symlink de/d4e/d6d/d71/d115/l12e 0 2024-09-19T07:25:29.902 INFO:tasks.workunit.client.0.smithi098.stdout:9/965: dwrite d3/dc/df/d15/d1a/d2b/d49/d55/fd9 [0,4194304] 0 2024-09-19T07:25:29.910 INFO:tasks.workunit.client.0.smithi098.stdout:9/966: mkdir d3/d6/d8/d125/d140 0 2024-09-19T07:25:29.915 INFO:tasks.workunit.client.0.smithi098.stdout:9/967: rename d3/d16/d38/d22/f95 to d3/dc/df/d15/d1a/d2d/f141 0 2024-09-19T07:25:29.934 INFO:tasks.workunit.client.0.smithi098.stdout:3/995: dwrite de/df/f22 [0,4194304] 0 2024-09-19T07:25:29.935 INFO:tasks.workunit.client.0.smithi098.stdout:3/996: readlink de/df/d1f/l30 0 2024-09-19T07:25:29.938 INFO:tasks.workunit.client.0.smithi098.stdout:3/997: unlink de/df/d31/d61/d69/ddd/l107 0 2024-09-19T07:25:29.938 INFO:tasks.workunit.client.0.smithi098.stdout:3/998: write f0 [5458232,102718] 0 2024-09-19T07:25:29.939 INFO:tasks.workunit.client.0.smithi098.stdout:9/968: dwrite d3/d16/d43/d51/dd3/dc1/f111 [0,4194304] 0 2024-09-19T07:25:29.939 INFO:tasks.workunit.client.0.smithi098.stdout:9/969: dread - d3/d16/d43/d51/d6e/f12c zero size 2024-09-19T07:25:29.939 INFO:tasks.workunit.client.0.smithi098.stdout:9/970: chown d3/d6/d46/ff0 833663049 1 2024-09-19T07:25:29.939 INFO:tasks.workunit.client.0.smithi098.stdout:9/971: chown d3/dc/df/d15/c123 30818806 1 2024-09-19T07:25:29.950 INFO:tasks.workunit.client.0.smithi098.stdout:9/972: write d3/dc/f6a [6132617,528] 0 2024-09-19T07:25:29.956 INFO:tasks.workunit.client.0.smithi098.stdout:3/999: dwrite de/df/d1f/f47 [0,4194304] 0 2024-09-19T07:25:29.958 INFO:tasks.workunit.client.0.smithi098.stdout:9/973: dread d3/d16/d38/d48/f9d [0,4194304] 0 2024-09-19T07:25:29.958 INFO:tasks.workunit.client.0.smithi098.stdout:9/974: chown d3/dc/df/d15/d1a/d2b/d49/la2 37990 1 2024-09-19T07:25:29.959 INFO:tasks.workunit.client.0.smithi098.stdout:9/975: symlink d3/dc/df/da3/l142 0 2024-09-19T07:25:29.965 INFO:tasks.workunit.client.0.smithi098.stdout:9/976: dread d3/dc/df/d15/d1a/d2b/d49/d50/fd6 [0,4194304] 0 2024-09-19T07:25:29.965 INFO:tasks.workunit.client.0.smithi098.stdout:9/977: stat d3/dc/df/d15/d2f/f5f 0 2024-09-19T07:25:29.967 INFO:tasks.workunit.client.0.smithi098.stdout:9/978: rename d3/d16/d43/d51/dd3/le2 to d3/d6/l143 0 2024-09-19T07:25:29.969 INFO:tasks.workunit.client.0.smithi098.stdout:9/979: rmdir d3/d16/d38/d48/d112 0 2024-09-19T07:25:29.969 INFO:tasks.workunit.client.0.smithi098.stdout:9/980: chown d3/d6/d8/fae 707074837 1 2024-09-19T07:25:29.969 INFO:tasks.workunit.client.0.smithi098.stdout:9/981: creat d3/dc/df/d15/d1a/d2d/f144 x:0 0 0 2024-09-19T07:25:29.971 INFO:tasks.workunit.client.0.smithi098.stdout:9/982: rename d3/d16/d43/d51/dd3/de6 to d3/d6/d8/d125/d140/d145 0 2024-09-19T07:25:29.972 INFO:tasks.workunit.client.0.smithi098.stdout:9/983: unlink d3/d16/d43/d51/d6e/f12c 0 2024-09-19T07:25:29.972 INFO:tasks.workunit.client.0.smithi098.stdout:9/984: stat d3/d30/l69 0 2024-09-19T07:25:29.974 INFO:tasks.workunit.client.0.smithi098.stdout:9/985: read d3/d16/d38/f36 [1711133,105015] 0 2024-09-19T07:25:29.975 INFO:tasks.workunit.client.0.smithi098.stdout:9/986: mknod d3/d6/d46/d83/da9/dbc/c146 0 2024-09-19T07:25:29.975 INFO:tasks.workunit.client.0.smithi098.stdout:9/987: write d3/d16/d43/dce/f10c [5154088,101486] 0 2024-09-19T07:25:29.990 INFO:tasks.workunit.client.0.smithi098.stdout:6/953: sync 2024-09-19T07:25:29.990 INFO:tasks.workunit.client.0.smithi098.stdout:5/904: sync 2024-09-19T07:25:29.991 INFO:tasks.workunit.client.0.smithi098.stdout:8/977: sync 2024-09-19T07:25:29.991 INFO:tasks.workunit.client.0.smithi098.stdout:5/905: chown dc/de/d13/d46/d2e/f102 198 1 2024-09-19T07:25:29.991 INFO:tasks.workunit.client.0.smithi098.stdout:8/978: symlink d0/dc7/d141/l148 0 2024-09-19T07:25:29.992 INFO:tasks.workunit.client.0.smithi098.stdout:6/954: link d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/d131/fff d2/d5/d1f/d26/f151 0 2024-09-19T07:25:29.992 INFO:tasks.workunit.client.0.smithi098.stdout:9/988: dwrite d3/d6/d46/d83/fdb [0,4194304] 0 2024-09-19T07:25:29.993 INFO:tasks.workunit.client.0.smithi098.stdout:8/979: rename d0/d16/d65/l11b to d0/d132/l149 0 2024-09-19T07:25:29.993 INFO:tasks.workunit.client.0.smithi098.stdout:8/980: chown d0/d33/d55/d8a/d12/f102 371830 1 2024-09-19T07:25:29.993 INFO:tasks.workunit.client.0.smithi098.stdout:6/955: creat d2/d11/d14e/f152 x:0 0 0 2024-09-19T07:25:29.993 INFO:tasks.workunit.client.0.smithi098.stdout:6/956: truncate d2/d5/d1f/d26/d42/d48/d53/da2/d139/d8f/f125 59202 0 2024-09-19T07:25:29.994 INFO:tasks.workunit.client.0.smithi098.stdout:9/989: dread d3/d16/d43/db1/ff5 [0,4194304] 0 2024-09-19T07:25:29.994 INFO:tasks.workunit.client.0.smithi098.stdout:8/981: creat d0/d33/d55/d8a/d21/d3c/f14a x:0 0 0 2024-09-19T07:25:29.994 INFO:tasks.workunit.client.0.smithi098.stdout:8/982: fsync d0/d33/f144 0 2024-09-19T07:25:29.995 INFO:tasks.workunit.client.0.smithi098.stdout:9/990: symlink d3/d16/d43/l147 0 2024-09-19T07:25:29.996 INFO:tasks.workunit.client.0.smithi098.stdout:6/957: link d2/d5/d1f/d26/d42/d48/fec d2/d11/f153 0 2024-09-19T07:25:29.997 INFO:tasks.workunit.client.0.smithi098.stdout:9/991: truncate d3/d6/d46/ff0 1418762 0 2024-09-19T07:25:29.997 INFO:tasks.workunit.client.0.smithi098.stdout:9/992: readlink d3/dc/df/d15/d1a/d2d/l97 0 2024-09-19T07:25:29.997 INFO:tasks.workunit.client.0.smithi098.stdout:9/993: chown d3/d16/f3c 62223146 1 2024-09-19T07:25:29.998 INFO:tasks.workunit.client.0.smithi098.stdout:9/994: dread d3/dc/fea [0,4194304] 0 2024-09-19T07:25:29.998 INFO:tasks.workunit.client.0.smithi098.stdout:9/995: write d3/d16/d43/d51/dd3/d7e/f8e [911585,95063] 0 2024-09-19T07:25:29.998 INFO:tasks.workunit.client.0.smithi098.stdout:6/958: truncate d2/d5/f3b 60938 0 2024-09-19T07:25:30.000 INFO:tasks.workunit.client.0.smithi098.stdout:9/996: mkdir d3/dc/df/d15/d1a/d2b/d49/d55/d148 0 2024-09-19T07:25:30.000 INFO:tasks.workunit.client.0.smithi098.stdout:6/959: mkdir d2/d5/d1f/d26/d42/d48/d154 0 2024-09-19T07:25:30.000 INFO:tasks.workunit.client.0.smithi098.stdout:6/960: readlink d2/d5/d1f/d26/d7b/l7f 0 2024-09-19T07:25:30.001 INFO:tasks.workunit.client.0.smithi098.stdout:9/997: creat d3/d6/d46/d83/da9/dbc/f149 x:0 0 0 2024-09-19T07:25:30.002 INFO:tasks.workunit.client.0.smithi098.stdout:9/998: chown d3/dc/df/d15/d1a/d2b/d49/d50/le4 6894454 1 2024-09-19T07:25:30.003 INFO:tasks.workunit.client.0.smithi098.stdout:9/999: mkdir d3/dc/df/d31/d14a 0 2024-09-19T07:25:30.008 INFO:tasks.workunit.client.0.smithi098.stdout:6/961: read d2/db0/f13b [463994,49608] 0 2024-09-19T07:25:30.020 INFO:tasks.workunit.client.0.smithi098.stdout:8/983: dwrite d0/d33/d44/dbe/d13e/dd2/df5/d115/f119 [4194304,4194304] 0 2024-09-19T07:25:30.021 INFO:tasks.workunit.client.0.smithi098.stdout:8/984: mknod d0/d33/d55/d8a/d21/d133/c14b 0 2024-09-19T07:25:30.021 INFO:tasks.workunit.client.0.smithi098.stdout:8/985: write d0/d33/d55/d8a/d21/d3c/f14a [701992,11363] 0 2024-09-19T07:25:30.022 INFO:tasks.workunit.client.0.smithi098.stdout:8/986: unlink d0/d16/f147 0 2024-09-19T07:25:30.028 INFO:tasks.workunit.client.0.smithi098.stdout:5/906: dwrite dc/de/d13/d46/d2e/d37/d81/db8/fc6 [0,4194304] 0 2024-09-19T07:25:30.030 INFO:tasks.workunit.client.0.smithi098.stdout:5/907: unlink dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/l10a 0 2024-09-19T07:25:30.030 INFO:tasks.workunit.client.0.smithi098.stdout:5/908: getdents dc/de/d13/d46/d2e/da5/d132 0 2024-09-19T07:25:30.031 INFO:tasks.workunit.client.0.smithi098.stdout:6/962: dwrite d2/d5/d1f/d26/d42/d48/d53/f12a [0,4194304] 0 2024-09-19T07:25:30.031 INFO:tasks.workunit.client.0.smithi098.stdout:5/909: creat dc/de/d13/d46/d23/dc1/f145 x:0 0 0 2024-09-19T07:25:30.032 INFO:tasks.workunit.client.0.smithi098.stdout:6/963: write d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d98/fc4 [782287,38225] 0 2024-09-19T07:25:30.032 INFO:tasks.workunit.client.0.smithi098.stdout:5/910: truncate dc/de/d13/d5c/da2/f94 4140116 0 2024-09-19T07:25:30.040 INFO:tasks.workunit.client.0.smithi098.stdout:5/911: getdents dc/de/d13/d46/d2e/d37 0 2024-09-19T07:25:30.040 INFO:tasks.workunit.client.0.smithi098.stdout:5/912: readlink dc/de/d13/d46/d2e/d37/d6d/l8c 0 2024-09-19T07:25:30.041 INFO:tasks.workunit.client.0.smithi098.stdout:5/913: truncate dc/de/d13/d46/d2e/d37/d81/f56 1047458 0 2024-09-19T07:25:30.044 INFO:tasks.workunit.client.0.smithi098.stdout:8/987: write d0/fb5 [3235012,117278] 0 2024-09-19T07:25:30.045 INFO:tasks.workunit.client.0.smithi098.stdout:8/988: unlink d0/d33/d55/d8a/d21/deb/ffc 0 2024-09-19T07:25:30.046 INFO:tasks.workunit.client.0.smithi098.stdout:8/989: creat d0/d33/d55/d8a/d12/dba/f14c x:0 0 0 2024-09-19T07:25:30.050 INFO:tasks.workunit.client.0.smithi098.stdout:6/964: dwrite d2/db0/d8d/ff4 [0,4194304] 0 2024-09-19T07:25:30.053 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:29 smithi098 ceph-mon[30950]: pgmap v106: 97 pgs: 97 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 21 MiB/s wr, 72 op/s 2024-09-19T07:25:30.058 INFO:tasks.workunit.client.0.smithi098.stdout:6/965: dread d2/d5/f62 [0,4194304] 0 2024-09-19T07:25:30.058 INFO:tasks.workunit.client.0.smithi098.stdout:6/966: read d2/d5/d1f/fd3 [1080113,80509] 0 2024-09-19T07:25:30.060 INFO:tasks.workunit.client.0.smithi098.stdout:6/967: creat d2/d5/d1f/d26/d42/d14d/f155 x:0 0 0 2024-09-19T07:25:30.060 INFO:tasks.workunit.client.0.smithi098.stdout:6/968: readlink d2/d5/d1f/d26/d42/d48/d53/ldf 0 2024-09-19T07:25:30.063 INFO:tasks.workunit.client.0.smithi098.stdout:6/969: truncate d2/d5/d1f/d26/d42/d48/d53/d64/d6d/f75 772966 0 2024-09-19T07:25:30.063 INFO:tasks.workunit.client.0.smithi098.stdout:6/970: chown d2/d5/d1f/d26/d42/d48/d53/d64/d6d/le1 3702232 1 2024-09-19T07:25:30.064 INFO:tasks.workunit.client.0.smithi098.stdout:6/971: creat d2/d5/d1f/d26/d42/d48/f156 x:0 0 0 2024-09-19T07:25:30.067 INFO:tasks.workunit.client.0.smithi098.stdout:5/914: dwrite dc/de/d13/d46/d2e/d37/d81/fd1 [4194304,4194304] 0 2024-09-19T07:25:30.068 INFO:tasks.workunit.client.0.smithi098.stdout:5/915: creat dc/de/d13/d46/df6/f146 x:0 0 0 2024-09-19T07:25:30.071 INFO:tasks.workunit.client.0.smithi098.stdout:6/972: write d2/d5/d1f/d26/d42/d48/d53/d64/d6d/ffd [761384,70064] 0 2024-09-19T07:25:30.072 INFO:tasks.workunit.client.0.smithi098.stdout:6/973: creat d2/d5/d1f/d127/f157 x:0 0 0 2024-09-19T07:25:30.072 INFO:tasks.workunit.client.0.smithi098.stdout:6/974: dread - d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/f12f zero size 2024-09-19T07:25:30.078 INFO:tasks.workunit.client.0.smithi098.stdout:6/975: read d2/d11/f56 [2886748,17011] 0 2024-09-19T07:25:30.078 INFO:tasks.workunit.client.0.smithi098.stdout:6/976: truncate d2/d5/d128/f13f 1024121 0 2024-09-19T07:25:30.079 INFO:tasks.workunit.client.0.smithi098.stdout:5/916: link dc/de/d13/d46/d2e/d37/d81/d6a/f7c dc/de/d13/d5c/da2/f147 0 2024-09-19T07:25:30.080 INFO:tasks.workunit.client.0.smithi098.stdout:6/977: rmdir d2/d5/d1f/d26/d7b/de0 39 2024-09-19T07:25:30.080 INFO:tasks.workunit.client.0.smithi098.stdout:6/978: chown d2/db0/d4e/d6e/fdb 1737 1 2024-09-19T07:25:30.080 INFO:tasks.workunit.client.0.smithi098.stdout:6/979: dread - d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/d101/f149 zero size 2024-09-19T07:25:30.080 INFO:tasks.workunit.client.0.smithi098.stdout:5/917: mknod dc/de/d13/d46/d2e/da5/c148 0 2024-09-19T07:25:30.081 INFO:tasks.workunit.client.0.smithi098.stdout:6/980: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/dc6/l158 0 2024-09-19T07:25:30.082 INFO:tasks.workunit.client.0.smithi098.stdout:5/918: rmdir dc/de/d13/d7d/df8 39 2024-09-19T07:25:30.084 INFO:tasks.workunit.client.0.smithi098.stdout:6/981: write d2/db0/d4e/d6e/d9d/ffb [105895,95657] 0 2024-09-19T07:25:30.085 INFO:tasks.workunit.client.0.smithi098.stdout:6/982: truncate d2/d5/d128/f13f 1792269 0 2024-09-19T07:25:30.085 INFO:tasks.workunit.client.0.smithi098.stdout:6/983: truncate d2/d11/f5c 4812783 0 2024-09-19T07:25:30.089 INFO:tasks.workunit.client.0.smithi098.stdout:6/984: rename d2/d11/l2c to d2/d11/l159 0 2024-09-19T07:25:30.090 INFO:tasks.workunit.client.0.smithi098.stdout:6/985: dread d2/d5/f62 [0,4194304] 0 2024-09-19T07:25:30.091 INFO:tasks.workunit.client.0.smithi098.stdout:6/986: symlink d2/d5/d1f/d26/d42/d48/d53/l15a 0 2024-09-19T07:25:30.094 INFO:tasks.workunit.client.0.smithi098.stdout:6/987: symlink d2/d5/d1f/d26/d42/d48/d53/d64/d6d/dc1/l15b 0 2024-09-19T07:25:30.095 INFO:tasks.workunit.client.0.smithi098.stdout:6/988: mkdir d2/d5/d1f/d26/d7b/da3/d15c 0 2024-09-19T07:25:30.101 INFO:tasks.workunit.client.0.smithi098.stdout:5/919: dwrite f4 [0,4194304] 0 2024-09-19T07:25:30.102 INFO:tasks.workunit.client.0.smithi098.stdout:5/920: stat dc/de/d13/d46/d2e/d37/d67/d75/d10f 0 2024-09-19T07:25:30.104 INFO:tasks.workunit.client.0.smithi098.stdout:6/989: write d2/d11/f66 [2048492,64166] 0 2024-09-19T07:25:30.110 INFO:tasks.workunit.client.0.smithi098.stdout:6/990: write d2/d5/d1f/d26/d42/d48/d53/da2/d139/f57 [1028398,34332] 0 2024-09-19T07:25:30.117 INFO:tasks.workunit.client.0.smithi098.stdout:6/991: dread d2/d5/d1f/d26/d42/d48/fab [0,4194304] 0 2024-09-19T07:25:30.118 INFO:tasks.workunit.client.0.smithi098.stdout:6/992: creat d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/f15d x:0 0 0 2024-09-19T07:25:30.119 INFO:tasks.workunit.client.0.smithi098.stdout:5/921: rename dc/de/d13/d46/d2e/d37/d81 to dc/de/d13/d46/d2e/da5/d149 0 2024-09-19T07:25:30.119 INFO:tasks.workunit.client.0.smithi098.stdout:5/922: chown dc/de/d13/f7e 142339444 1 2024-09-19T07:25:30.119 INFO:tasks.workunit.client.0.smithi098.stdout:5/923: rmdir dc/de/dc0/dd8 39 2024-09-19T07:25:30.120 INFO:tasks.workunit.client.0.smithi098.stdout:5/924: creat dc/de/d13/d46/d2e/da5/d149/db8/f14a x:0 0 0 2024-09-19T07:25:30.122 INFO:tasks.workunit.client.0.smithi098.stdout:5/925: mkdir dc/de/d13/d46/d2e/d37/d14b 0 2024-09-19T07:25:30.123 INFO:tasks.workunit.client.0.smithi098.stdout:5/926: rmdir dc/de/d13/d46/d2e/d37/d67 39 2024-09-19T07:25:30.125 INFO:tasks.workunit.client.0.smithi098.stdout:5/927: write dc/de/d13/d46/d2e/da5/ff2 [1022525,6946] 0 2024-09-19T07:25:30.127 INFO:tasks.workunit.client.0.smithi098.stdout:5/928: creat dc/de/d13/d46/d23/f14c x:0 0 0 2024-09-19T07:25:30.127 INFO:tasks.workunit.client.0.smithi098.stdout:5/929: write dc/de/d13/d46/df6/f146 [708708,57275] 0 2024-09-19T07:25:30.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:29 smithi162 ceph-mon[35726]: pgmap v106: 97 pgs: 97 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 21 MiB/s wr, 72 op/s 2024-09-19T07:25:30.134 INFO:tasks.workunit.client.0.smithi098.stdout:6/993: dwrite d2/ff7 [0,4194304] 0 2024-09-19T07:25:30.134 INFO:tasks.workunit.client.0.smithi098.stdout:6/994: chown d2/db0/d8d/fcc 379 1 2024-09-19T07:25:30.135 INFO:tasks.workunit.client.0.smithi098.stdout:6/995: dread d2/d5/d1f/d26/d7b/da3/f11b [0,4194304] 0 2024-09-19T07:25:30.138 INFO:tasks.workunit.client.0.smithi098.stdout:5/930: rename dc/de/dc0/dd8/f12a to dc/de/d13/d46/d2e/d37/d67/d99/f14d 0 2024-09-19T07:25:30.138 INFO:tasks.workunit.client.0.smithi098.stdout:5/931: fsync dc/de/d13/fc9 0 2024-09-19T07:25:30.158 INFO:tasks.workunit.client.0.smithi098.stdout:6/996: dwrite d2/d5/d1f/d26/d42/d48/f137 [0,4194304] 0 2024-09-19T07:25:30.160 INFO:tasks.workunit.client.0.smithi098.stdout:6/997: mkdir d2/d5/d1f/d26/d15e 0 2024-09-19T07:25:30.160 INFO:tasks.workunit.client.0.smithi098.stdout:6/998: chown d2/d5/d1f/d26/d42/d48/d53/d64/d6d/d80/f100 358100 1 2024-09-19T07:25:30.160 INFO:tasks.workunit.client.0.smithi098.stdout:6/999: readlink d2/d5/d1f/d26/l4b 0 2024-09-19T07:25:30.162 INFO:tasks.workunit.client.0.smithi098.stdout:5/932: dwrite dc/de/d13/d46/d23/f14c [0,4194304] 0 2024-09-19T07:25:30.162 INFO:tasks.workunit.client.0.smithi098.stdout:5/933: chown dc/de/d13/d46/d2e/d37/d6d/c8d 2 1 2024-09-19T07:25:30.162 INFO:tasks.workunit.client.0.smithi098.stdout:5/934: write dc/de/d13/d46/d23/dc1/f145 [360020,56248] 0 2024-09-19T07:25:30.167 INFO:tasks.workunit.client.0.smithi098.stdout:5/935: mknod dc/de/d13/d46/d2e/d37/c14e 0 2024-09-19T07:25:30.168 INFO:tasks.workunit.client.0.smithi098.stdout:5/936: rename dc/de/d13/d46/c50 to dc/c14f 0 2024-09-19T07:25:30.177 INFO:tasks.workunit.client.0.smithi098.stdout:8/990: sync 2024-09-19T07:25:30.178 INFO:tasks.workunit.client.0.smithi098.stdout:8/991: truncate d0/d33/d55/d8a/d12/dba/fec 750016 0 2024-09-19T07:25:30.178 INFO:tasks.workunit.client.0.smithi098.stdout:8/992: fsync d0/d33/d55/d8a/f145 0 2024-09-19T07:25:30.179 INFO:tasks.workunit.client.0.smithi098.stdout:8/993: mkdir d0/d33/d55/d8a/d28/d118/d14d 0 2024-09-19T07:25:30.193 INFO:tasks.workunit.client.0.smithi098.stdout:8/994: rename d0/d16/d61/ce5 to d0/d2c/dfb/c14e 0 2024-09-19T07:25:30.200 INFO:tasks.workunit.client.0.smithi098.stdout:8/995: dread d0/d1a/f3b [0,4194304] 0 2024-09-19T07:25:30.200 INFO:tasks.workunit.client.0.smithi098.stdout:8/996: chown d0/d33/d44/dbe/d13d 1656473 1 2024-09-19T07:25:30.200 INFO:tasks.workunit.client.0.smithi098.stdout:8/997: write d0/d33/d55/d8a/d21/d3c/f12d [422536,31910] 0 2024-09-19T07:25:30.201 INFO:tasks.workunit.client.0.smithi098.stdout:8/998: chown d0/d33/d55/fc3 854046 1 2024-09-19T07:25:30.201 INFO:tasks.workunit.client.0.smithi098.stdout:8/999: readlink d0/d16/d65/d111/l137 0 2024-09-19T07:25:30.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:29 smithi139 ceph-mon[35039]: pgmap v106: 97 pgs: 97 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 21 MiB/s wr, 72 op/s 2024-09-19T07:25:30.341 INFO:tasks.workunit.client.0.smithi098.stdout:5/937: sync 2024-09-19T07:25:30.343 INFO:tasks.workunit.client.0.smithi098.stdout:5/938: dread dc/de/d13/d46/d2e/fc2 [0,4194304] 0 2024-09-19T07:25:30.351 INFO:tasks.workunit.client.0.smithi098.stdout:5/939: write dc/de/d13/d46/f3e [4285980,81184] 0 2024-09-19T07:25:30.351 INFO:tasks.workunit.client.0.smithi098.stdout:5/940: getdents dc/de/d13/d46/d2e 0 2024-09-19T07:25:30.359 INFO:tasks.workunit.client.0.smithi098.stdout:5/941: rename dc/de/d13/d5c/daf/db9/d118/f11e to dc/de/d13/d46/d2e/da5/d149/db8/f150 0 2024-09-19T07:25:30.391 INFO:tasks.workunit.client.0.smithi098.stdout:5/942: rmdir dc/de/d13/d46/d2e/da5/d149 39 2024-09-19T07:25:30.456 INFO:tasks.workunit.client.0.smithi098.stdout:5/943: sync 2024-09-19T07:25:30.457 INFO:tasks.workunit.client.0.smithi098.stdout:5/944: chown dc/de/d13/d46/d2e/da5/d149/cbe 2 1 2024-09-19T07:25:30.477 INFO:tasks.workunit.client.0.smithi098.stdout:5/945: dwrite dc/de/d13/d5c/da2/f7b [0,4194304] 0 2024-09-19T07:25:30.481 INFO:tasks.workunit.client.0.smithi098.stdout:5/946: write dc/de/d13/d5c/daf/fb2 [1136801,102241] 0 2024-09-19T07:25:30.489 INFO:tasks.workunit.client.0.smithi098.stdout:5/947: dread dc/de/d13/d46/d2e/f33 [0,4194304] 0 2024-09-19T07:25:30.489 INFO:tasks.workunit.client.0.smithi098.stdout:5/948: write dc/de/d13/d5c/daf/db9/d118/f138 [3907284,52519] 0 2024-09-19T07:25:30.489 INFO:tasks.workunit.client.0.smithi098.stdout:5/949: write dc/de/d13/d5c/daf/db9/d118/f119 [829147,114221] 0 2024-09-19T07:25:30.490 INFO:tasks.workunit.client.0.smithi098.stdout:5/950: mkdir dc/de/d13/d46/d2e/d37/d14b/d151 0 2024-09-19T07:25:30.491 INFO:tasks.workunit.client.0.smithi098.stdout:5/951: creat dc/de/f152 x:0 0 0 2024-09-19T07:25:30.491 INFO:tasks.workunit.client.0.smithi098.stdout:5/952: stat dc/de/d13/d46/f3e 0 2024-09-19T07:25:30.500 INFO:tasks.workunit.client.0.smithi098.stdout:5/953: write dc/de/d13/d46/d2e/d37/d6d/dee/d112/f4b [3651559,120994] 0 2024-09-19T07:25:30.501 INFO:tasks.workunit.client.0.smithi098.stdout:5/954: symlink dc/de/d13/d5c/d10d/l153 0 2024-09-19T07:25:30.501 INFO:tasks.workunit.client.0.smithi098.stdout:5/955: read dc/de/f34 [445480,83396] 0 2024-09-19T07:25:30.510 INFO:tasks.workunit.client.0.smithi098.stdout:5/956: rmdir dc/de/d13/d46/d2e/d37 39 2024-09-19T07:25:30.533 INFO:tasks.workunit.client.0.smithi098.stdout:5/957: dwrite dc/de/d13/d46/d2e/da5/d149/d6a/f95 [0,4194304] 0 2024-09-19T07:25:30.533 INFO:tasks.workunit.client.0.smithi098.stdout:5/958: write dc/de/f2a [642826,3300] 0 2024-09-19T07:25:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.693+0000 7fe6f80fa640 1 -- 172.21.15.98:0/257090057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6f010e450 msgr2=0x7fe6f0110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.693+0000 7fe6f80fa640 1 --2- 172.21.15.98:0/257090057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6f010e450 0x7fe6f0110840 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8009900 tx=0x7fe6e802a480 comp rx=0 tx=0).stop 2024-09-19T07:25:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.693+0000 7fe6f80fa640 1 -- 172.21.15.98:0/257090057 shutdown_connections 2024-09-19T07:25:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.693+0000 7fe6f80fa640 1 --2- 172.21.15.98:0/257090057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6f010e450 0x7fe6f0110840 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.695 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.693+0000 7fe6f80fa640 1 --2- 172.21.15.98:0/257090057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f0074e30 0x7fe6f010df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.693+0000 7fe6f80fa640 1 --2- 172.21.15.98:0/257090057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6f0074510 0x7fe6f00748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.693+0000 7fe6f80fa640 1 -- 172.21.15.98:0/257090057 >> 172.21.15.98:0/257090057 conn(0x7fe6f00fd8f0 msgr2=0x7fe6f00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.693+0000 7fe6f80fa640 1 -- 172.21.15.98:0/257090057 shutdown_connections 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.693+0000 7fe6f80fa640 1 -- 172.21.15.98:0/257090057 wait complete. 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.693+0000 7fe6f80fa640 1 Processor -- start 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.693+0000 7fe6f80fa640 1 -- start start 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f80fa640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6f0074510 0x7fe6f019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f80fa640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6f0074e30 0x7fe6f019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f80fa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f010e450 0x7fe6f019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f80fa640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f0114180 con 0x7fe6f0074510 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f80fa640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f0114000 con 0x7fe6f0074e30 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f80fa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f0114300 con 0x7fe6f010e450 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f5e96640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6f0074510 0x7fe6f019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:30.696 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f5e96640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6f0074510 0x7fe6f019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37312/0 (socket says 172.21.15.98:37312) 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f5695640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6f0074e30 0x7fe6f019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f5e96640 1 -- 172.21.15.98:0/3238519234 learned_addr learned my addr 172.21.15.98:0/3238519234 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f6697640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f010e450 0x7fe6f019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f5e96640 1 -- 172.21.15.98:0/3238519234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f010e450 msgr2=0x7fe6f019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f5e96640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f010e450 0x7fe6f019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f5e96640 1 -- 172.21.15.98:0/3238519234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6f0074e30 msgr2=0x7fe6f019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f5e96640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6f0074e30 0x7fe6f019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f5e96640 1 -- 172.21.15.98:0/3238519234 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f019f630 con 0x7fe6f0074510 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f5695640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6f0074e30 0x7fe6f019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f5e96640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6f0074510 0x7fe6f019a680 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000cce0 tx=0x7fe6e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6eeffd640 1 -- 172.21.15.98:0/3238519234 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0004b20 con 0x7fe6f0074510 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6f80fa640 1 -- 172.21.15.98:0/3238519234 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f019f920 con 0x7fe6f0074510 2024-09-19T07:25:30.697 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.694+0000 7fe6eeffd640 1 -- 172.21.15.98:0/3238519234 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6e0004cc0 con 0x7fe6f0074510 2024-09-19T07:25:30.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.695+0000 7fe6eeffd640 1 -- 172.21.15.98:0/3238519234 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e000f7d0 con 0x7fe6f0074510 2024-09-19T07:25:30.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.695+0000 7fe6f80fa640 1 -- 172.21.15.98:0/3238519234 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f01a7200 con 0x7fe6f0074510 2024-09-19T07:25:30.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.695+0000 7fe6f80fa640 1 -- 172.21.15.98:0/3238519234 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6f00748f0 con 0x7fe6f0074510 2024-09-19T07:25:30.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.697+0000 7fe6eeffd640 1 -- 172.21.15.98:0/3238519234 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe6e000f970 con 0x7fe6f0074510 2024-09-19T07:25:30.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.697+0000 7fe6eeffd640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fe6d80a3430 0x7fe6d80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:30.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.697+0000 7fe6f5695640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fe6d80a3430 0x7fe6d80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:30.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.697+0000 7fe6eeffd640 1 -- 172.21.15.98:0/3238519234 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fe6e00d00b0 con 0x7fe6f0074510 2024-09-19T07:25:30.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.698+0000 7fe6f5695640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fe6d80a3430 0x7fe6d80a58f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe6f010f7e0 tx=0x7fe6e400b390 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:30.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.701+0000 7fe6eeffd640 1 -- 172.21.15.98:0/3238519234 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe6e0014030 con 0x7fe6f0074510 2024-09-19T07:25:30.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.905+0000 7fe6f80fa640 1 -- 172.21.15.98:0/3238519234 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6f0109630 con 0x7fe6f0074510 2024-09-19T07:25:30.906 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.906+0000 7fe6eeffd640 1 -- 172.21.15.98:0/3238519234 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11928 (secure 0 0 0) 0x7fe6e009c490 con 0x7fe6f0074510 2024-09-19T07:25:30.907 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:25:30.907 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"btime":"2024-09-19T07:24:57:508846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:24:56.977446+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":73,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":74,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:25:30.907 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2024-09-19T07:25:30.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.908+0000 7fe6f80fa640 1 -- 172.21.15.98:0/3238519234 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fe6d80a3430 msgr2=0x7fe6d80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:30.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.908+0000 7fe6f80fa640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fe6d80a3430 0x7fe6d80a58f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe6f010f7e0 tx=0x7fe6e400b390 comp rx=0 tx=0).stop 2024-09-19T07:25:30.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.908+0000 7fe6f80fa640 1 -- 172.21.15.98:0/3238519234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6f0074510 msgr2=0x7fe6f019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:30.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.908+0000 7fe6f80fa640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6f0074510 0x7fe6f019a680 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000cce0 tx=0x7fe6e000a620 comp rx=0 tx=0).stop 2024-09-19T07:25:30.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.908+0000 7fe6f80fa640 1 -- 172.21.15.98:0/3238519234 shutdown_connections 2024-09-19T07:25:30.909 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.908+0000 7fe6f80fa640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fe6d80a3430 0x7fe6d80a58f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.908+0000 7fe6f80fa640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6f010e450 0x7fe6f019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.908+0000 7fe6f80fa640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe6f0074e30 0x7fe6f019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.908+0000 7fe6f80fa640 1 --2- 172.21.15.98:0/3238519234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe6f0074510 0x7fe6f019a680 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:30.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.908+0000 7fe6f80fa640 1 -- 172.21.15.98:0/3238519234 >> 172.21.15.98:0/3238519234 conn(0x7fe6f00fd8f0 msgr2=0x7fe6f00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:30.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.908+0000 7fe6f80fa640 1 -- 172.21.15.98:0/3238519234 shutdown_connections 2024-09-19T07:25:30.910 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:30.909+0000 7fe6f80fa640 1 -- 172.21.15.98:0/3238519234 wait complete. 2024-09-19T07:25:31.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:30 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3238519234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:31.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:30 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3238519234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:31.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:30 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3238519234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:31.671 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T07:25:31.671 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T07:25:31.917 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:32.214 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:31 smithi098 ceph-mon[30950]: pgmap v107: 97 pgs: 97 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 15 MiB/s wr, 47 op/s 2024-09-19T07:25:32.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:31 smithi139 ceph-mon[35039]: pgmap v107: 97 pgs: 97 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 15 MiB/s wr, 47 op/s 2024-09-19T07:25:32.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:31 smithi162 ceph-mon[35726]: pgmap v107: 97 pgs: 97 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 15 MiB/s wr, 47 op/s 2024-09-19T07:25:32.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.461+0000 7f6d2211a640 1 -- 172.21.15.98:0/1733439960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d1c101de0 msgr2=0x7f6d1c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:32.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.461+0000 7f6d2211a640 1 --2- 172.21.15.98:0/1733439960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d1c101de0 0x7f6d1c1021c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009ca0 tx=0x7f6d0c02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.461+0000 7f6d2211a640 1 -- 172.21.15.98:0/1733439960 shutdown_connections 2024-09-19T07:25:32.464 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.461+0000 7f6d2211a640 1 --2- 172.21.15.98:0/1733439960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d1c106f10 0x7f6d1c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.461+0000 7f6d2211a640 1 --2- 172.21.15.98:0/1733439960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d1c102790 0x7f6d1c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.461+0000 7f6d2211a640 1 --2- 172.21.15.98:0/1733439960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d1c101de0 0x7f6d1c1021c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.461+0000 7f6d2211a640 1 -- 172.21.15.98:0/1733439960 >> 172.21.15.98:0/1733439960 conn(0x7f6d1c0fd8c0 msgr2=0x7f6d1c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:32.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.461+0000 7f6d2211a640 1 -- 172.21.15.98:0/1733439960 shutdown_connections 2024-09-19T07:25:32.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.461+0000 7f6d2211a640 1 -- 172.21.15.98:0/1733439960 wait complete. 2024-09-19T07:25:32.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.462+0000 7f6d2211a640 1 Processor -- start 2024-09-19T07:25:32.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.462+0000 7f6d2211a640 1 -- start start 2024-09-19T07:25:32.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.462+0000 7f6d2211a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d1c101de0 0x7f6d1c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.462+0000 7f6d2211a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d1c102790 0x7f6d1c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.462+0000 7f6d2211a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d1c106f10 0x7f6d1c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.462+0000 7f6d2211a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c111f30 con 0x7f6d1c101de0 2024-09-19T07:25:32.465 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.462+0000 7f6d2211a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c111db0 con 0x7f6d1c102790 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.462+0000 7f6d2211a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c1120b0 con 0x7f6d1c106f10 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.462+0000 7f6d1b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d1c101de0 0x7f6d1c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.462+0000 7f6d1b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d1c101de0 0x7f6d1c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37602/0 (socket says 172.21.15.98:37602) 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d1b7fe640 1 -- 172.21.15.98:0/2608611833 learned_addr learned my addr 172.21.15.98:0/2608611833 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d1affd640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d1c102790 0x7f6d1c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d1c106f10 0x7f6d1c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d1b7fe640 1 -- 172.21.15.98:0/2608611833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d1c106f10 msgr2=0x7f6d1c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d1b7fe640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d1c106f10 0x7f6d1c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d1b7fe640 1 -- 172.21.15.98:0/2608611833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d1c102790 msgr2=0x7f6d1c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d1b7fe640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d1c102790 0x7f6d1c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d1b7fe640 1 -- 172.21.15.98:0/2608611833 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c1a6980 con 0x7f6d1c101de0 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d1b7fe640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d1c101de0 0x7f6d1c0744f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c02ade0 tx=0x7f6d0c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d18ff9640 1 -- 172.21.15.98:0/2608611833 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c02fa20 con 0x7f6d1c101de0 2024-09-19T07:25:32.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d2211a640 1 -- 172.21.15.98:0/2608611833 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1c1a6c10 con 0x7f6d1c101de0 2024-09-19T07:25:32.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d18ff9640 1 -- 172.21.15.98:0/2608611833 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d0c02fbc0 con 0x7f6d1c101de0 2024-09-19T07:25:32.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d18ff9640 1 -- 172.21.15.98:0/2608611833 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c0467b0 con 0x7f6d1c101de0 2024-09-19T07:25:32.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.463+0000 7f6d2211a640 1 -- 172.21.15.98:0/2608611833 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1c1a71a0 con 0x7f6d1c101de0 2024-09-19T07:25:32.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.465+0000 7f6d18ff9640 1 -- 172.21.15.98:0/2608611833 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6d0c046950 con 0x7f6d1c101de0 2024-09-19T07:25:32.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d244f3740 1 Processor -- start 2024-09-19T07:25:32.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d244f3740 1 -- start start 2024-09-19T07:25:32.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d244f3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482410760 0x560482410b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d244f3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 0x56048241b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d244f3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x56048241dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d244f3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5604823762a0 con 0x560482411080 2024-09-19T07:25:32.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d244f3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56048231db10 con 0x56048241b940 2024-09-19T07:25:32.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d244f3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560482372260 con 0x560482410760 2024-09-19T07:25:32.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d18ff9640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6d040a33b0 0x7f6d040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d1b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 0x56048241b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d1bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482410760 0x560482410b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d1b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 0x56048241b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37608/0 (socket says 172.21.15.98:37608) 2024-09-19T07:25:32.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d1bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482410760 0x560482410b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:52620/0 (socket says 172.21.15.98:52620) 2024-09-19T07:25:32.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d1b7fe640 1 -- 172.21.15.98:0/4245689157 learned_addr learned my addr 172.21.15.98:0/4245689157 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:32.472 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6d040a33b0 0x7f6d040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.466+0000 7f6d1affd640 1 --2- 172.21.15.98:0/4245689157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x56048241dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d1bfff640 1 -- 172.21.15.98:0/4245689157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 msgr2=0x56048241dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/4245689157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x56048241dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d1bfff640 1 -- 172.21.15.98:0/4245689157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 msgr2=0x56048241b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d18ff9640 1 -- 172.21.15.98:0/2608611833 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f6d0c0f10b0 con 0x7f6d1c101de0 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/4245689157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 0x56048241b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d1bfff640 1 -- 172.21.15.98:0/4245689157 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604820e7b90 con 0x560482410760 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d1affd640 1 --2- 172.21.15.98:0/4245689157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x56048241dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d1b7fe640 1 --2- 172.21.15.98:0/4245689157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 0x56048241b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6d040a33b0 0x7f6d040a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6d14010740 tx=0x7f6d14017000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/4245689157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482410760 0x560482410b40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d140128f0 tx=0x7f6d14012db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f41fa279414cf02b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d01ffb640 1 -- 172.21.15.98:0/4245689157 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14023070 con 0x560482410760 2024-09-19T07:25:32.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d01ffb640 1 -- 172.21.15.98:0/4245689157 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d14012460 con 0x560482410760 2024-09-19T07:25:32.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.467+0000 7f6d01ffb640 1 -- 172.21.15.98:0/4245689157 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14004c40 con 0x560482410760 2024-09-19T07:25:32.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.468+0000 7f6d244f3740 1 -- 172.21.15.98:0/4245689157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482410760 msgr2=0x560482410b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:32.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.468+0000 7f6d244f3740 1 --2- 172.21.15.98:0/4245689157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482410760 0x560482410b40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d140128f0 tx=0x7f6d14012db0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.468+0000 7f6d244f3740 1 -- 172.21.15.98:0/4245689157 shutdown_connections 2024-09-19T07:25:32.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.468+0000 7f6d244f3740 1 --2- 172.21.15.98:0/4245689157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x56048241dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.468+0000 7f6d244f3740 1 --2- 172.21.15.98:0/4245689157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 0x56048241b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.468+0000 7f6d244f3740 1 --2- 172.21.15.98:0/4245689157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482410760 0x560482410b40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.468+0000 7f6d244f3740 1 -- 172.21.15.98:0/4245689157 >> 172.21.15.98:0/4245689157 conn(0x56048240ccf0 msgr2=0x56048240d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:32.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.468+0000 7f6d244f3740 1 -- 172.21.15.98:0/4245689157 shutdown_connections 2024-09-19T07:25:32.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.468+0000 7f6d244f3740 1 -- 172.21.15.98:0/4245689157 wait complete. 2024-09-19T07:25:32.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.468+0000 7f6d244f3740 1 -- start start 2024-09-19T07:25:32.474 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d244f3740 1 Processor -- start 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d244f3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482410760 0x5604824187f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d244f3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482411080 0x560482418d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d244f3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x560482419270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d244f3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56048241e510 con 0x560482410760 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d244f3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5604822fe6e0 con 0x56048241b940 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d244f3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56048241e690 con 0x560482411080 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d244f3740 10 client.0 _ll_register_callbacks cb 0x560482322a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d1b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482410760 0x5604824187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d1affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482411080 0x560482418d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d1b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482410760 0x5604824187f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37614/0 (socket says 172.21.15.98:37614) 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d1b7fe640 1 -- 172.21.15.98:0/2990419779 learned_addr learned my addr 172.21.15.98:0/2990419779 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x560482419270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.475 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d1b7fe640 1 -- 172.21.15.98:0/2990419779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482411080 msgr2=0x560482418d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d1b7fe640 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482411080 0x560482418d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d1b7fe640 1 -- 172.21.15.98:0/2990419779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 msgr2=0x560482419270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d1b7fe640 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x560482419270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d1b7fe640 1 -- 172.21.15.98:0/2990419779 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604824279d0 con 0x560482410760 2024-09-19T07:25:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.469+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x560482419270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6d1b7fe640 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482410760 0x5604824187f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c000f80 tx=0x7f6d0c0ee8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b684999a9cf2039 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6cfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6cfaffd640 1 -- 172.21.15.98:0/2990419779 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c0eebf0 con 0x560482410760 2024-09-19T07:25:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6cfaffd640 1 -- 172.21.15.98:0/2990419779 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f6d0c046c40 con 0x560482410760 2024-09-19T07:25:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6d244f3740 1 -- 172.21.15.98:0/2990419779 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d14012460 con 0x560482410760 2024-09-19T07:25:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6cfaffd640 1 -- 172.21.15.98:0/2990419779 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6d0c046e40 con 0x560482410760 2024-09-19T07:25:32.476 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6d244f3740 10 client.16335 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6d244f3740 1 -- 172.21.15.98:0/2990419779 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56048241e510 con 0x560482410760 2024-09-19T07:25:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6cfaffd640 1 -- 172.21.15.98:0/2990419779 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d14012460 con 0x560482410760 2024-09-19T07:25:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6cfaffd640 1 -- 172.21.15.98:0/2990419779 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f6d0c04e030 con 0x560482410760 2024-09-19T07:25:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6d244f3740 10 client.16335 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6d244f3740 10 client.16335 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:25:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.470+0000 7f6d244f3740 20 client.16335 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.471+0000 7f6d244f3740 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56048242b7b0 0x56048242dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.471+0000 7f6d244f3740 4 client.16335 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.471+0000 7f6d244f3740 1 -- 172.21.15.98:0/2990419779 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604823839d0 con 0x56048242b7b0 2024-09-19T07:25:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.471+0000 7f6d1affd640 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56048242b7b0 0x56048242dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.471+0000 7f6d1affd640 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56048242b7b0 0x56048242dbf0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c5391153366b1e5 server_cookie=8e817435efe59754 in_seq=0 out_seq=0 2024-09-19T07:25:32.477 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.471+0000 7f6cfaffd640 10 client.16335 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:32.478 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6cfaffd640 1 -- 172.21.15.98:0/2990419779 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604823839d0 con 0x56048242b7b0 2024-09-19T07:25:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6cfaffd640 10 client.16335 handle_command_reply: tid=0 2024-09-19T07:25:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6d244f3740 1 client.16335 shutdown 2024-09-19T07:25:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6d244f3740 1 -- 172.21.15.98:0/2990419779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482410760 msgr2=0x5604824187f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6d244f3740 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482410760 0x5604824187f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c000f80 tx=0x7f6d0c0ee8a0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6d244f3740 1 -- 172.21.15.98:0/2990419779 shutdown_connections 2024-09-19T07:25:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6d244f3740 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x560482419270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6d244f3740 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482411080 0x560482418d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6d244f3740 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56048242b7b0 0x56048242dbf0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6cfaffd640 0 client.16335 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6d244f3740 1 --2- 172.21.15.98:0/2990419779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482410760 0x5604824187f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6d244f3740 1 -- 172.21.15.98:0/2990419779 >> 172.21.15.98:0/2990419779 conn(0x56048240ccf0 msgr2=0x56048240be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:32.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6d244f3740 1 -- 172.21.15.98:0/2990419779 shutdown_connections 2024-09-19T07:25:32.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6d244f3740 1 -- 172.21.15.98:0/2990419779 wait complete. 2024-09-19T07:25:32.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.472+0000 7f6d244f3740 20 client.16335 trim_cache size 0 max 16384 2024-09-19T07:25:32.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d244f3740 1 Processor -- start 2024-09-19T07:25:32.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d244f3740 1 -- start start 2024-09-19T07:25:32.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d244f3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482410760 0x5604824131c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d244f3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 0x5604824334c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d244f3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x560482433a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.490 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d244f3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c1b23c0 con 0x560482411080 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d244f3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c1afbd0 con 0x56048241b940 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d244f3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c1ada20 con 0x560482410760 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d1affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 0x5604824334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d1affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 0x5604824334c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37618/0 (socket says 172.21.15.98:37618) 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d1affd640 1 -- 172.21.15.98:0/2883810899 learned_addr learned my addr 172.21.15.98:0/2883810899 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d1b7fe640 1 --2- 172.21.15.98:0/2883810899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482410760 0x5604824131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.489+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/2883810899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x560482433a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.490+0000 7f6d1affd640 1 -- 172.21.15.98:0/2883810899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482410760 msgr2=0x5604824131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.490+0000 7f6d1affd640 1 --2- 172.21.15.98:0/2883810899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482410760 0x5604824131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.490+0000 7f6d1affd640 1 -- 172.21.15.98:0/2883810899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 msgr2=0x560482433a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.490+0000 7f6d1affd640 1 --2- 172.21.15.98:0/2883810899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x560482433a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.490+0000 7f6d1affd640 1 -- 172.21.15.98:0/2883810899 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560482408260 con 0x560482411080 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.490+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/2883810899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x560482433a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:32.491 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.490+0000 7f6d1affd640 1 --2- 172.21.15.98:0/2883810899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 0x5604824334c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c1087b0 tx=0x7f6d10014900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c185680f34f5f89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:32.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.490+0000 7f6d017fa640 1 -- 172.21.15.98:0/2883810899 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10014190 con 0x560482411080 2024-09-19T07:25:32.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.490+0000 7f6d017fa640 1 -- 172.21.15.98:0/2883810899 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d10005500 con 0x560482411080 2024-09-19T07:25:32.492 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.490+0000 7f6d017fa640 1 -- 172.21.15.98:0/2883810899 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d100126b0 con 0x560482411080 2024-09-19T07:25:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.491+0000 7f6d244f3740 1 -- 172.21.15.98:0/2883810899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 msgr2=0x5604824334c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.491+0000 7f6d244f3740 1 --2- 172.21.15.98:0/2883810899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 0x5604824334c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c1087b0 tx=0x7f6d10014900 comp rx=0 tx=0).stop 2024-09-19T07:25:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.491+0000 7f6d244f3740 1 -- 172.21.15.98:0/2883810899 shutdown_connections 2024-09-19T07:25:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.491+0000 7f6d244f3740 1 --2- 172.21.15.98:0/2883810899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56048241b940 0x560482433a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.491+0000 7f6d244f3740 1 --2- 172.21.15.98:0/2883810899 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560482411080 0x5604824334c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.491+0000 7f6d244f3740 1 --2- 172.21.15.98:0/2883810899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482410760 0x5604824131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.491+0000 7f6d244f3740 1 -- 172.21.15.98:0/2883810899 >> 172.21.15.98:0/2883810899 conn(0x56048240ccf0 msgr2=0x56048241a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.491+0000 7f6d244f3740 1 -- 172.21.15.98:0/2883810899 shutdown_connections 2024-09-19T07:25:32.495 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.491+0000 7f6d244f3740 1 -- 172.21.15.98:0/2883810899 wait complete. 2024-09-19T07:25:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.491+0000 7f6d244f3740 1 -- start start 2024-09-19T07:25:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.491+0000 7f6d244f3740 1 Processor -- start 2024-09-19T07:25:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d244f3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560482410760 0x560482415900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d244f3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482411080 0x560482415e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d244f3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56048241b940 0x560482416380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d244f3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c1ae090 con 0x56048241b940 2024-09-19T07:25:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d244f3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c1af500 con 0x560482410760 2024-09-19T07:25:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d244f3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c1ae760 con 0x560482411080 2024-09-19T07:25:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d244f3740 10 client.0 _ll_register_callbacks cb 0x7f6d0c0bd0b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d1bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56048241b940 0x560482416380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d1b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560482410760 0x560482415900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.496 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d1bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56048241b940 0x560482416380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37622/0 (socket says 172.21.15.98:37622) 2024-09-19T07:25:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d1bfff640 1 -- 172.21.15.98:0/3238751206 learned_addr learned my addr 172.21.15.98:0/3238751206 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d1affd640 1 --2- 172.21.15.98:0/3238751206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482411080 0x560482415e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d1bfff640 1 -- 172.21.15.98:0/3238751206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482411080 msgr2=0x560482415e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/3238751206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482411080 0x560482415e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d1bfff640 1 -- 172.21.15.98:0/3238751206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560482410760 msgr2=0x560482415900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/3238751206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560482410760 0x560482415900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d1bfff640 1 -- 172.21.15.98:0/3238751206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604824955f0 con 0x56048241b940 2024-09-19T07:25:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d1bfff640 1 --2- 172.21.15.98:0/3238751206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56048241b940 0x560482416380 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6d14024000 tx=0x7f6d140048b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d185177cab80e6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6cfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6cfaffd640 1 -- 172.21.15.98:0/3238751206 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14035060 con 0x56048241b940 2024-09-19T07:25:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6cfaffd640 1 -- 172.21.15.98:0/3238751206 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f6d1401b040 con 0x56048241b940 2024-09-19T07:25:32.497 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.492+0000 7f6d244f3740 1 -- 172.21.15.98:0/3238751206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d10005500 con 0x56048241b940 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.493+0000 7f6cfaffd640 1 -- 172.21.15.98:0/3238751206 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6d14023040 con 0x56048241b940 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.493+0000 7f6d244f3740 10 client.16341 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.493+0000 7f6d244f3740 1 -- 172.21.15.98:0/3238751206 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5604824967c0 con 0x56048241b940 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.493+0000 7f6cfaffd640 1 -- 172.21.15.98:0/3238751206 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d10005500 con 0x56048241b940 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.493+0000 7f6cfaffd640 1 -- 172.21.15.98:0/3238751206 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f6d14004eb0 con 0x56048241b940 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.493+0000 7f6d244f3740 10 client.16341 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.493+0000 7f6d244f3740 10 client.16341 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.493+0000 7f6d244f3740 20 client.16341 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.493+0000 7f6d244f3740 1 --2- 172.21.15.98:0/3238751206 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56048242b7b0 0x560482498d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.493+0000 7f6d244f3740 4 client.16341 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.493+0000 7f6d244f3740 1 -- 172.21.15.98:0/3238751206 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x56048237dd20 con 0x56048242b7b0 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.493+0000 7f6d1b7fe640 1 --2- 172.21.15.98:0/3238751206 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56048242b7b0 0x560482498d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.494+0000 7f6d1b7fe640 1 --2- 172.21.15.98:0/3238751206 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56048242b7b0 0x560482498d50 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42bc46f122bb1fb7 server_cookie=569a3b6a74fe0bb7 in_seq=0 out_seq=0 2024-09-19T07:25:32.498 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:32.494+0000 7f6cfaffd640 10 client.16341 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:34.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:33 smithi162 ceph-mon[35726]: pgmap v108: 97 pgs: 97 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 15 MiB/s wr, 47 op/s 2024-09-19T07:25:34.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:33 smithi098 ceph-mon[30950]: pgmap v108: 97 pgs: 97 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 15 MiB/s wr, 47 op/s 2024-09-19T07:25:34.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:33 smithi139 ceph-mon[35039]: pgmap v108: 97 pgs: 97 active+clean; 2.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 MiB/s rd, 15 MiB/s wr, 47 op/s 2024-09-19T07:25:36.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:35 smithi098 ceph-mon[30950]: pgmap v109: 97 pgs: 97 active+clean; 2.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 21 MiB/s wr, 167 op/s 2024-09-19T07:25:36.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:35 smithi139 ceph-mon[35039]: pgmap v109: 97 pgs: 97 active+clean; 2.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 21 MiB/s wr, 167 op/s 2024-09-19T07:25:36.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:35 smithi162 ceph-mon[35726]: pgmap v109: 97 pgs: 97 active+clean; 2.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 21 MiB/s wr, 167 op/s 2024-09-19T07:25:38.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:37 smithi098 ceph-mon[30950]: pgmap v110: 97 pgs: 97 active+clean; 2.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 21 MiB/s wr, 152 op/s 2024-09-19T07:25:38.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:37 smithi139 ceph-mon[35039]: pgmap v110: 97 pgs: 97 active+clean; 2.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 21 MiB/s wr, 152 op/s 2024-09-19T07:25:38.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:37 smithi162 ceph-mon[35726]: pgmap v110: 97 pgs: 97 active+clean; 2.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 21 MiB/s wr, 152 op/s 2024-09-19T07:25:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.244+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1981924509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af4101370 msgr2=0x7f4af410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.244+0000 7f4afc3e4640 1 --2- 172.21.15.98:0/1981924509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af4101370 0x7f4af410d8a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009cd0 tx=0x7f4aec02a8e0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.244+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1981924509 shutdown_connections 2024-09-19T07:25:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.244+0000 7f4afc3e4640 1 --2- 172.21.15.98:0/1981924509 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af4101370 0x7f4af410d8a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.244+0000 7f4afc3e4640 1 --2- 172.21.15.98:0/1981924509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af41009d0 0x7f4af4100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.244+0000 7f4afc3e4640 1 --2- 172.21.15.98:0/1981924509 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4af41069e0 0x7f4af4106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.244+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1981924509 >> 172.21.15.98:0/1981924509 conn(0x7f4af40fc6f0 msgr2=0x7f4af40feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.244+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1981924509 shutdown_connections 2024-09-19T07:25:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.244+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1981924509 wait complete. 2024-09-19T07:25:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afc3e4640 1 Processor -- start 2024-09-19T07:25:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afc3e4640 1 -- start start 2024-09-19T07:25:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afc3e4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af41009d0 0x7f4af4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afc3e4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4af4101370 0x7f4af41988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afc3e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af41069e0 0x7f4af419cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afc3e4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4af4110e20 con 0x7f4af41009d0 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afc3e4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4af4110ca0 con 0x7f4af4101370 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afc3e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4af4110fa0 con 0x7f4af41069e0 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afa180640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af41009d0 0x7f4af4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afa180640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af41009d0 0x7f4af4198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37642/0 (socket says 172.21.15.98:37642) 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afa180640 1 -- 172.21.15.98:0/1359625180 learned_addr learned my addr 172.21.15.98:0/1359625180 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4af997f640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4af4101370 0x7f4af41988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afa981640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af41069e0 0x7f4af419cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afa180640 1 -- 172.21.15.98:0/1359625180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af41069e0 msgr2=0x7f4af419cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afa180640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af41069e0 0x7f4af419cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afa180640 1 -- 172.21.15.98:0/1359625180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4af4101370 msgr2=0x7f4af41988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afa180640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4af4101370 0x7f4af41988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afa180640 1 -- 172.21.15.98:0/1359625180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af419d350 con 0x7f4af41009d0 2024-09-19T07:25:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.245+0000 7f4afa981640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af41069e0 0x7f4af419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.246+0000 7f4afa180640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af41009d0 0x7f4af4198360 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4af000e9f0 tx=0x7f4af000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.246+0000 7f4aeb7fe640 1 -- 172.21.15.98:0/1359625180 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af000cd80 con 0x7f4af41009d0 2024-09-19T07:25:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.246+0000 7f4aeb7fe640 1 -- 172.21.15.98:0/1359625180 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4af0010910 con 0x7f4af41009d0 2024-09-19T07:25:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.246+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1359625180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af419d640 con 0x7f4af41009d0 2024-09-19T07:25:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.246+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1359625180 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af41a4ed0 con 0x7f4af41009d0 2024-09-19T07:25:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.246+0000 7f4aeb7fe640 1 -- 172.21.15.98:0/1359625180 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af0018930 con 0x7f4af41009d0 2024-09-19T07:25:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.248+0000 7f4aeb7fe640 1 -- 172.21.15.98:0/1359625180 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4af0010ac0 con 0x7f4af41009d0 2024-09-19T07:25:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.248+0000 7f4aff255740 1 Processor -- start 2024-09-19T07:25:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.248+0000 7f4aff255740 1 -- start start 2024-09-19T07:25:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4aff255740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e49dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4aff255740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e58b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4aff255740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 0x5636b3e5b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4aff255740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5636b3dae2f0 con 0x5636b3e499f0 2024-09-19T07:25:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4aff255740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5636b3d56270 con 0x5636b3e4a310 2024-09-19T07:25:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4aff255740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5636b3daa2b0 con 0x5636b3e590c0 2024-09-19T07:25:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4aeb7fe640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f4ae00a3460 0x7f4ae00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4afa180640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e58b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4afa981640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e49dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4afa981640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e49dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37658/0 (socket says 172.21.15.98:37658) 2024-09-19T07:25:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4afa981640 1 -- 172.21.15.98:0/2538834939 learned_addr learned my addr 172.21.15.98:0/2538834939 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4af997f640 1 --2- 172.21.15.98:0/2538834939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 0x5636b3e5b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4afa981640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f4ae00a3460 0x7f4ae00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4aeb7fe640 1 -- 172.21.15.98:0/1359625180 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f4af00d0050 con 0x7f4af41009d0 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4afa981640 1 -- 172.21.15.98:0/2538834939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 msgr2=0x5636b3e5b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4afa981640 1 --2- 172.21.15.98:0/2538834939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 0x5636b3e5b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4afa981640 1 -- 172.21.15.98:0/2538834939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 msgr2=0x5636b3e58b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4afa981640 1 --2- 172.21.15.98:0/2538834939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e58b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4afa981640 1 -- 172.21.15.98:0/2538834939 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b3d55340 con 0x5636b3e499f0 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4afa180640 1 --2- 172.21.15.98:0/2538834939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e58b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.249+0000 7f4afa981640 1 --2- 172.21.15.98:0/2538834939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e49dd0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009a60 tx=0x7f4aec031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69a4d7b1e430ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.250+0000 7f4afa981640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f4ae00a3460 0x7f4ae00a5920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4aec006010 tx=0x7f4aec047000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.250+0000 7f4ae8bfe640 1 -- 172.21.15.98:0/2538834939 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec04d070 con 0x5636b3e499f0 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.250+0000 7f4ae8bfe640 1 -- 172.21.15.98:0/2538834939 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4aec036040 con 0x5636b3e499f0 2024-09-19T07:25:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.250+0000 7f4ae8bfe640 1 -- 172.21.15.98:0/2538834939 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec030ce0 con 0x5636b3e499f0 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.250+0000 7f4aff255740 1 -- 172.21.15.98:0/2538834939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 msgr2=0x5636b3e49dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.250+0000 7f4aff255740 1 --2- 172.21.15.98:0/2538834939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e49dd0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009a60 tx=0x7f4aec031cc0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.250+0000 7f4aff255740 1 -- 172.21.15.98:0/2538834939 shutdown_connections 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.250+0000 7f4aff255740 1 --2- 172.21.15.98:0/2538834939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 0x5636b3e5b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.250+0000 7f4aff255740 1 --2- 172.21.15.98:0/2538834939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e58b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.250+0000 7f4aff255740 1 --2- 172.21.15.98:0/2538834939 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e49dd0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.250+0000 7f4aff255740 1 -- 172.21.15.98:0/2538834939 >> 172.21.15.98:0/2538834939 conn(0x5636b3e46060 msgr2=0x5636b3e46440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4aff255740 1 -- 172.21.15.98:0/2538834939 shutdown_connections 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4aff255740 1 -- 172.21.15.98:0/2538834939 wait complete. 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4aff255740 1 -- start start 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4aff255740 1 Processor -- start 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4aff255740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e56030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4aff255740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e56570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4aff255740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 0x5636b3e56ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4aff255740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5636b3e5bcc0 con 0x5636b3e499f0 2024-09-19T07:25:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4aff255740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5636b3d37290 con 0x5636b3e4a310 2024-09-19T07:25:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4aff255740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5636b3e5be40 con 0x5636b3e590c0 2024-09-19T07:25:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4aff255740 10 client.0 _ll_register_callbacks cb 0x5636b3d68140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4afa180640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e56030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4afa180640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e56030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37662/0 (socket says 172.21.15.98:37662) 2024-09-19T07:25:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4afa180640 1 -- 172.21.15.98:0/1131829778 learned_addr learned my addr 172.21.15.98:0/1131829778 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4af997f640 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e56570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.251+0000 7f4afa981640 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 0x5636b3e56ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4afa180640 1 -- 172.21.15.98:0/1131829778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 msgr2=0x5636b3e56ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4afa180640 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 0x5636b3e56ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4afa180640 1 -- 172.21.15.98:0/1131829778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 msgr2=0x5636b3e56570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4afa180640 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e56570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4afa180640 1 -- 172.21.15.98:0/1131829778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636b3ac1210 con 0x5636b3e499f0 2024-09-19T07:25:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4afa180640 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e56030 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4af00cdd70 tx=0x7f4af006b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d373e58d6eac60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4addffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4addffb640 1 -- 172.21.15.98:0/1131829778 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af00a4ce0 con 0x5636b3e499f0 2024-09-19T07:25:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4addffb640 1 -- 172.21.15.98:0/1131829778 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f4af00a01f0 con 0x5636b3e499f0 2024-09-19T07:25:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4aff255740 1 -- 172.21.15.98:0/1131829778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aec036040 con 0x5636b3e499f0 2024-09-19T07:25:39.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4addffb640 1 -- 172.21.15.98:0/1131829778 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4af00a4f70 con 0x5636b3e499f0 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4aff255740 10 client.16353 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4aff255740 1 -- 172.21.15.98:0/1131829778 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5636b3b8d620 con 0x5636b3e499f0 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4addffb640 1 -- 172.21.15.98:0/1131829778 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4aec036040 con 0x5636b3e499f0 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4addffb640 1 -- 172.21.15.98:0/1131829778 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f4af00bc210 con 0x5636b3e499f0 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4aff255740 10 client.16353 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4aff255740 10 client.16353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4aff255740 20 client.16353 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4aff255740 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5636b3e69060 0x5636b3e6b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4aff255740 4 client.16353 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.252+0000 7f4aff255740 1 -- 172.21.15.98:0/1131829778 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636b3dbba20 con 0x5636b3e69060 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.253+0000 7f4af997f640 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5636b3e69060 0x5636b3e6b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.253+0000 7f4af997f640 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5636b3e69060 0x5636b3e6b490 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f01a194ec28a796 server_cookie=5f54e92281d973db in_seq=0 out_seq=0 2024-09-19T07:25:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.253+0000 7f4addffb640 10 client.16353 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4addffb640 1 -- 172.21.15.98:0/1131829778 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636b3dbba20 con 0x5636b3e69060 2024-09-19T07:25:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4addffb640 10 client.16353 handle_command_reply: tid=0 2024-09-19T07:25:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4aff255740 1 client.16353 shutdown 2024-09-19T07:25:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4aff255740 1 -- 172.21.15.98:0/1131829778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 msgr2=0x5636b3e56030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4aff255740 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e56030 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f4af00cdd70 tx=0x7f4af006b0b0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4aff255740 1 -- 172.21.15.98:0/1131829778 shutdown_connections 2024-09-19T07:25:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4aff255740 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 0x5636b3e56ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4aff255740 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e56570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4aff255740 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5636b3e69060 0x5636b3e6b490 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4aff255740 1 --2- 172.21.15.98:0/1131829778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e56030 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4addffb640 0 client.16353 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4aff255740 1 -- 172.21.15.98:0/1131829778 >> 172.21.15.98:0/1131829778 conn(0x5636b3e46060 msgr2=0x5636b3e4bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4aff255740 1 -- 172.21.15.98:0/1131829778 shutdown_connections 2024-09-19T07:25:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4aff255740 1 -- 172.21.15.98:0/1131829778 wait complete. 2024-09-19T07:25:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.254+0000 7f4aff255740 20 client.16353 trim_cache size 0 max 16384 2024-09-19T07:25:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.268+0000 7f4aff255740 1 Processor -- start 2024-09-19T07:25:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4aff255740 1 -- start start 2024-09-19T07:25:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4aff255740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e58360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4aff255740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e70da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4aff255740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 0x5636b3e712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4aff255740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4af41ae110 con 0x5636b3e499f0 2024-09-19T07:25:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4aff255740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4af41ab920 con 0x5636b3e4a310 2024-09-19T07:25:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4aff255740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4af41a9770 con 0x5636b3e590c0 2024-09-19T07:25:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4afa180640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e58360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4afa180640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e58360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37670/0 (socket says 172.21.15.98:37670) 2024-09-19T07:25:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4afa180640 1 -- 172.21.15.98:0/2686466938 learned_addr learned my addr 172.21.15.98:0/2686466938 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4af997f640 1 --2- 172.21.15.98:0/2686466938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e70da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4afa180640 1 -- 172.21.15.98:0/2686466938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 msgr2=0x5636b3e712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4afa180640 1 --2- 172.21.15.98:0/2686466938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 0x5636b3e712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4afa180640 1 -- 172.21.15.98:0/2686466938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 msgr2=0x5636b3e70da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4afa180640 1 --2- 172.21.15.98:0/2686466938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e70da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4afa180640 1 -- 172.21.15.98:0/2686466938 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636b3e46fc0 con 0x5636b3e499f0 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4afa180640 1 --2- 172.21.15.98:0/2686466938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e58360 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4af009a5b0 tx=0x7f4af009a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4d060cf65cc884 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4adffff640 1 -- 172.21.15.98:0/2686466938 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af009be40 con 0x5636b3e499f0 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4adffff640 1 -- 172.21.15.98:0/2686466938 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4af006d070 con 0x5636b3e499f0 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.269+0000 7f4adffff640 1 -- 172.21.15.98:0/2686466938 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af00bc350 con 0x5636b3e499f0 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 -- 172.21.15.98:0/2686466938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 msgr2=0x5636b3e58360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 --2- 172.21.15.98:0/2686466938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e58360 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f4af009a5b0 tx=0x7f4af009a810 comp rx=0 tx=0).stop 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 -- 172.21.15.98:0/2686466938 shutdown_connections 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 --2- 172.21.15.98:0/2686466938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e590c0 0x5636b3e712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 --2- 172.21.15.98:0/2686466938 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e4a310 0x5636b3e70da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 --2- 172.21.15.98:0/2686466938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e58360 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 -- 172.21.15.98:0/2686466938 >> 172.21.15.98:0/2686466938 conn(0x5636b3e46060 msgr2=0x5636b3e4bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 -- 172.21.15.98:0/2686466938 shutdown_connections 2024-09-19T07:25:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 -- 172.21.15.98:0/2686466938 wait complete. 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 -- start start 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 Processor -- start 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e5d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e4a310 0x5636b3e5de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e590c0 0x5636b3e60f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4af41a9de0 con 0x5636b3e499f0 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4af41ab250 con 0x5636b3e590c0 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.270+0000 7f4aff255740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4af41aa4b0 con 0x5636b3e4a310 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4aff255740 10 client.0 _ll_register_callbacks cb 0x7f4af009c0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4afa180640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e5d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4afa180640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e5d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37682/0 (socket says 172.21.15.98:37682) 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4afa180640 1 -- 172.21.15.98:0/3597721971 learned_addr learned my addr 172.21.15.98:0/3597721971 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4afa981640 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e590c0 0x5636b3e60f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4af997f640 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e4a310 0x5636b3e5de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4afa180640 1 -- 172.21.15.98:0/3597721971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e4a310 msgr2=0x5636b3e5de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4afa180640 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e4a310 0x5636b3e5de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4afa180640 1 -- 172.21.15.98:0/3597721971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e590c0 msgr2=0x5636b3e60f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4afa180640 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e590c0 0x5636b3e60f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4afa180640 1 -- 172.21.15.98:0/3597721971 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636b3e615c0 con 0x5636b3e499f0 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4afa180640 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e5d910 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4af009c290 tx=0x7f4af00b5410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307fbff9e42b2150 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4addffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4addffb640 1 -- 172.21.15.98:0/3597721971 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af00b5040 con 0x5636b3e499f0 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4addffb640 1 -- 172.21.15.98:0/3597721971 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f4af0010640 con 0x5636b3e499f0 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4aff255740 1 -- 172.21.15.98:0/3597721971 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4af006d070 con 0x5636b3e499f0 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4addffb640 1 -- 172.21.15.98:0/3597721971 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f4af009be40 con 0x5636b3e499f0 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4aff255740 10 client.16359 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4aff255740 1 -- 172.21.15.98:0/3597721971 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5636b3ed4960 con 0x5636b3e499f0 2024-09-19T07:25:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.271+0000 7f4addffb640 1 -- 172.21.15.98:0/3597721971 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4af006d070 con 0x5636b3e499f0 2024-09-19T07:25:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.272+0000 7f4addffb640 1 -- 172.21.15.98:0/3597721971 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f4af0018ad0 con 0x5636b3e499f0 2024-09-19T07:25:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.272+0000 7f4aff255740 10 client.16359 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.272+0000 7f4aff255740 10 client.16359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:25:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.272+0000 7f4aff255740 20 client.16359 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.272+0000 7f4aff255740 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5636b3ed4cf0 0x5636b3ed70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.272+0000 7f4aff255740 4 client.16359 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:25:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.272+0000 7f4aff255740 1 -- 172.21.15.98:0/3597721971 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5636b3db5d70 con 0x5636b3ed4cf0 2024-09-19T07:25:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.272+0000 7f4af997f640 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5636b3ed4cf0 0x5636b3ed70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.272+0000 7f4addffb640 10 client.16359 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.272+0000 7f4af997f640 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5636b3ed4cf0 0x5636b3ed70e0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8aed8ee1b8fed8c server_cookie=a08e1f0d22fb52a3 in_seq=0 out_seq=0 2024-09-19T07:25:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.946+0000 7f4addffb640 1 -- 172.21.15.98:0/3597721971 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5636b3db5d70 con 0x5636b3ed4cf0 2024-09-19T07:25:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.946+0000 7f4addffb640 10 client.16359 handle_command_reply: tid=0 2024-09-19T07:25:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.946+0000 7f4aff255740 1 client.16359 shutdown 2024-09-19T07:25:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.947+0000 7f4aff255740 1 -- 172.21.15.98:0/3597721971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 msgr2=0x5636b3e5d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.947+0000 7f4aff255740 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e5d910 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4af009c290 tx=0x7f4af00b5410 comp rx=0 tx=0).stop 2024-09-19T07:25:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.947+0000 7f4aff255740 1 -- 172.21.15.98:0/3597721971 shutdown_connections 2024-09-19T07:25:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.947+0000 7f4aff255740 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5636b3e590c0 0x5636b3e60f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.947+0000 7f4aff255740 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636b3e4a310 0x5636b3e5de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.947+0000 7f4aff255740 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5636b3ed4cf0 0x5636b3ed70e0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.947+0000 7f4aff255740 1 --2- 172.21.15.98:0/3597721971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5636b3e499f0 0x5636b3e5d910 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.947+0000 7f4addffb640 0 client.16359 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.947+0000 7f4aff255740 1 -- 172.21.15.98:0/3597721971 >> 172.21.15.98:0/3597721971 conn(0x5636b3e46060 msgr2=0x5636b3e449a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.947+0000 7f4aff255740 1 -- 172.21.15.98:0/3597721971 shutdown_connections 2024-09-19T07:25:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.947+0000 7f4aff255740 1 -- 172.21.15.98:0/3597721971 wait complete. 2024-09-19T07:25:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.947+0000 7f4aff255740 20 client.16359 trim_cache size 0 max 16384 2024-09-19T07:25:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:25:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:25:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:25:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:25:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.948+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1359625180 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f4ae00a3460 msgr2=0x7f4ae00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.948+0000 7f4afc3e4640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f4ae00a3460 0x7f4ae00a5920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4aec006010 tx=0x7f4aec047000 comp rx=0 tx=0).stop 2024-09-19T07:25:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.948+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1359625180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af41009d0 msgr2=0x7f4af4198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.948+0000 7f4afc3e4640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af41009d0 0x7f4af4198360 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4af000e9f0 tx=0x7f4af000eeb0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.948+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1359625180 shutdown_connections 2024-09-19T07:25:39.950 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.948+0000 7f4afc3e4640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f4ae00a3460 0x7f4ae00a5920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.948+0000 7f4afc3e4640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4af41069e0 0x7f4af419cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.948+0000 7f4afc3e4640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4af4101370 0x7f4af41988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.948+0000 7f4afc3e4640 1 --2- 172.21.15.98:0/1359625180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4af41009d0 0x7f4af4198360 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.948+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1359625180 >> 172.21.15.98:0/1359625180 conn(0x7f4af40fc6f0 msgr2=0x7f4af406a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.948+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1359625180 shutdown_connections 2024-09-19T07:25:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:39.948+0000 7f4afc3e4640 1 -- 172.21.15.98:0/1359625180 wait complete. 2024-09-19T07:25:40.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:39 smithi162 ceph-mon[35726]: pgmap v111: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 22 MiB/s wr, 527 op/s 2024-09-19T07:25:40.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:39 smithi098 ceph-mon[30950]: pgmap v111: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 22 MiB/s wr, 527 op/s 2024-09-19T07:25:40.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:39 smithi139 ceph-mon[35039]: pgmap v111: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 MiB/s rd, 22 MiB/s wr, 527 op/s 2024-09-19T07:25:40.977 INFO:tasks.workunit.client.0.smithi098.stdout:5/959: rename dc/de/d13/d46/d2e/da5/d149/db8/fdd to dc/de/d13/d46/d2e/d37/d6d/dee/d112/dba/f154 0 2024-09-19T07:25:41.341 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.340+0000 7f6cfaffd640 1 -- 172.21.15.98:0/3238751206 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56048237dd20 con 0x56048242b7b0 2024-09-19T07:25:41.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.340+0000 7f6cfaffd640 10 client.16341 handle_command_reply: tid=0 2024-09-19T07:25:41.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.340+0000 7f6d244f3740 1 client.16341 shutdown 2024-09-19T07:25:41.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.340+0000 7f6d244f3740 1 -- 172.21.15.98:0/3238751206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56048241b940 msgr2=0x560482416380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:41.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.340+0000 7f6d244f3740 1 --2- 172.21.15.98:0/3238751206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56048241b940 0x560482416380 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6d14024000 tx=0x7f6d140048b0 comp rx=0 tx=0).stop 2024-09-19T07:25:41.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.340+0000 7f6d244f3740 1 -- 172.21.15.98:0/3238751206 shutdown_connections 2024-09-19T07:25:41.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.340+0000 7f6d244f3740 1 --2- 172.21.15.98:0/3238751206 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56048242b7b0 0x560482498d50 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:41.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.340+0000 7f6d244f3740 1 --2- 172.21.15.98:0/3238751206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56048241b940 0x560482416380 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:41.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.340+0000 7f6d244f3740 1 --2- 172.21.15.98:0/3238751206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560482411080 0x560482415e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:41.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.340+0000 7f6d244f3740 1 --2- 172.21.15.98:0/3238751206 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560482410760 0x560482415900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:41.342 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.340+0000 7f6cfaffd640 0 client.16341 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:41.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.340+0000 7f6d244f3740 1 -- 172.21.15.98:0/3238751206 >> 172.21.15.98:0/3238751206 conn(0x56048240ccf0 msgr2=0x56048240b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:41.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.341+0000 7f6d244f3740 1 -- 172.21.15.98:0/3238751206 shutdown_connections 2024-09-19T07:25:41.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.341+0000 7f6d244f3740 1 -- 172.21.15.98:0/3238751206 wait complete. 2024-09-19T07:25:41.343 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.341+0000 7f6d244f3740 20 client.16341 trim_cache size 0 max 16384 2024-09-19T07:25:41.343 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:25:41.343 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 30, 2024-09-19T07:25:41.343 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:25:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 14, 2024-09-19T07:25:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": { 2024-09-19T07:25:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "ebe6b401": { 2024-09-19T07:25:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "version": 14, 2024-09-19T07:25:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "age_ref": 0.0, 2024-09-19T07:25:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:25:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "QUIESCED", 2024-09-19T07:25:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:25:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "timeout": 90.0, 2024-09-19T07:25:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "expiration": 136.6, 2024-09-19T07:25:41.344 INFO:teuthology.orchestra.run.smithi098.stdout: "members": { 2024-09-19T07:25:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: "file:/": { 2024-09-19T07:25:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: "excluded": false, 2024-09-19T07:25:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:25:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "QUIESCED", 2024-09-19T07:25:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:25:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:25:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:25:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:25:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:25:41.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:25:41.345 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:25:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.342+0000 7f6d2211a640 1 -- 172.21.15.98:0/2608611833 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6d040a33b0 msgr2=0x7f6d040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.342+0000 7f6d2211a640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6d040a33b0 0x7f6d040a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6d14010740 tx=0x7f6d14017000 comp rx=0 tx=0).stop 2024-09-19T07:25:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.342+0000 7f6d2211a640 1 -- 172.21.15.98:0/2608611833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d1c101de0 msgr2=0x7f6d1c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.342+0000 7f6d2211a640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d1c101de0 0x7f6d1c0744f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c02ade0 tx=0x7f6d0c0319f0 comp rx=0 tx=0).stop 2024-09-19T07:25:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.342+0000 7f6d2211a640 1 -- 172.21.15.98:0/2608611833 shutdown_connections 2024-09-19T07:25:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.342+0000 7f6d2211a640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6d040a33b0 0x7f6d040a5870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.342+0000 7f6d2211a640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d1c106f10 0x7f6d1c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:41.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.342+0000 7f6d2211a640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6d1c102790 0x7f6d1c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.342+0000 7f6d2211a640 1 --2- 172.21.15.98:0/2608611833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6d1c101de0 0x7f6d1c0744f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.342+0000 7f6d2211a640 1 -- 172.21.15.98:0/2608611833 >> 172.21.15.98:0/2608611833 conn(0x7f6d1c0fd8c0 msgr2=0x7f6d1c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.342+0000 7f6d2211a640 1 -- 172.21.15.98:0/2608611833 shutdown_connections 2024-09-19T07:25:41.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:41.342+0000 7f6d2211a640 1 -- 172.21.15.98:0/2608611833 wait complete. 2024-09-19T07:25:42.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:41 smithi098 ceph-mon[30950]: pgmap v112: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 7.3 MiB/s wr, 495 op/s 2024-09-19T07:25:42.120 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ebe6b401', quiesce took 12.7 seconds. Will release after: 3.900000000000002 2024-09-19T07:25:42.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:41 smithi139 ceph-mon[35039]: pgmap v112: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 7.3 MiB/s wr, 495 op/s 2024-09-19T07:25:42.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:41 smithi162 ceph-mon[35726]: pgmap v112: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 7.3 MiB/s wr, 495 op/s 2024-09-19T07:25:45.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:44 smithi162 ceph-mon[35726]: pgmap v113: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 7.3 MiB/s wr, 495 op/s 2024-09-19T07:25:45.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:44 smithi098 ceph-mon[30950]: pgmap v113: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 7.3 MiB/s wr, 495 op/s 2024-09-19T07:25:45.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:44 smithi139 ceph-mon[35039]: pgmap v113: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 MiB/s rd, 7.3 MiB/s wr, 495 op/s 2024-09-19T07:25:46.022 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:25:46.282 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:47.206 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:46 smithi098 ceph-mon[30950]: pgmap v114: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 7.4 MiB/s wr, 535 op/s 2024-09-19T07:25:47.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.205+0000 7f494f738640 1 -- 172.21.15.98:0/4262490211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948101420 msgr2=0x7f494810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:47.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.205+0000 7f494f738640 1 --2- 172.21.15.98:0/4262490211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948101420 0x7f494810d950 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f4938009930 tx=0x7f493802a420 comp rx=0 tx=0).stop 2024-09-19T07:25:47.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.205+0000 7f494f738640 1 -- 172.21.15.98:0/4262490211 shutdown_connections 2024-09-19T07:25:47.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.205+0000 7f494f738640 1 --2- 172.21.15.98:0/4262490211 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948101420 0x7f494810d950 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:47.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.205+0000 7f494f738640 1 --2- 172.21.15.98:0/4262490211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4948100a80 0x7f4948100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:47.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.205+0000 7f494f738640 1 --2- 172.21.15.98:0/4262490211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4948106a80 0x7f4948106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:47.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.205+0000 7f494f738640 1 -- 172.21.15.98:0/4262490211 >> 172.21.15.98:0/4262490211 conn(0x7f49480fc7a0 msgr2=0x7f49480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:47.232 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.205+0000 7f494f738640 1 -- 172.21.15.98:0/4262490211 shutdown_connections 2024-09-19T07:25:47.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.206+0000 7f494f738640 1 -- 172.21.15.98:0/4262490211 wait complete. 2024-09-19T07:25:47.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.206+0000 7f494f738640 1 Processor -- start 2024-09-19T07:25:47.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.206+0000 7f494f738640 1 -- start start 2024-09-19T07:25:47.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494f738640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4948100a80 0x7f4948198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:47.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494f738640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4948101420 0x7f4948198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:47.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494f738640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948106a80 0x7f494819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:47.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494f738640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4948110e80 con 0x7f4948106a80 2024-09-19T07:25:47.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494f738640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4948110d00 con 0x7f4948101420 2024-09-19T07:25:47.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494f738640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4948111000 con 0x7f4948100a80 2024-09-19T07:25:47.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494dcd5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948106a80 0x7f494819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:47.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494dcd5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948106a80 0x7f494819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48022/0 (socket says 172.21.15.98:48022) 2024-09-19T07:25:47.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494dcd5640 1 -- 172.21.15.98:0/361993377 learned_addr learned my addr 172.21.15.98:0/361993377 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:47.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494d4d4640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4948100a80 0x7f4948198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:47.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494ccd3640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4948101420 0x7f4948198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:47.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494dcd5640 1 -- 172.21.15.98:0/361993377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4948100a80 msgr2=0x7f4948198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:47.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494dcd5640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4948100a80 0x7f4948198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:47.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494dcd5640 1 -- 172.21.15.98:0/361993377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4948101420 msgr2=0x7f4948198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:47.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494dcd5640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4948101420 0x7f4948198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:47.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494dcd5640 1 -- 172.21.15.98:0/361993377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494819d3c0 con 0x7f4948106a80 2024-09-19T07:25:47.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494ccd3640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4948101420 0x7f4948198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:47.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494dcd5640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948106a80 0x7f494819cce0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4938005ab0 tx=0x7f49380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:47.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f49467fc640 1 -- 172.21.15.98:0/361993377 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493803f030 con 0x7f4948106a80 2024-09-19T07:25:47.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f494f738640 1 -- 172.21.15.98:0/361993377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494819d650 con 0x7f4948106a80 2024-09-19T07:25:47.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f49467fc640 1 -- 172.21.15.98:0/361993377 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4938003ce0 con 0x7f4948106a80 2024-09-19T07:25:47.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.207+0000 7f49467fc640 1 -- 172.21.15.98:0/361993377 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938035070 con 0x7f4948106a80 2024-09-19T07:25:47.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.208+0000 7f494f738640 1 -- 172.21.15.98:0/361993377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49481a4f90 con 0x7f4948106a80 2024-09-19T07:25:47.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.209+0000 7f494f738640 1 -- 172.21.15.98:0/361993377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4948100ee0 con 0x7f4948106a80 2024-09-19T07:25:47.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.210+0000 7f49467fc640 1 -- 172.21.15.98:0/361993377 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4938042030 con 0x7f4948106a80 2024-09-19T07:25:47.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.210+0000 7f49467fc640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f49300a33b0 0x7f49300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:47.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.210+0000 7f494d4d4640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f49300a33b0 0x7f49300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:47.235 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.210+0000 7f49467fc640 1 -- 172.21.15.98:0/361993377 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f49380f0030 con 0x7f4948106a80 2024-09-19T07:25:47.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.211+0000 7f494d4d4640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f49300a33b0 0x7f49300a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f494000a300 tx=0x7f494000a290 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:47.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.214+0000 7f49467fc640 1 -- 172.21.15.98:0/361993377 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f49380bc9e0 con 0x7f4948106a80 2024-09-19T07:25:47.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:46 smithi139 ceph-mon[35039]: pgmap v114: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 7.4 MiB/s wr, 535 op/s 2024-09-19T07:25:47.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:46 smithi162 ceph-mon[35726]: pgmap v114: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 7.4 MiB/s wr, 535 op/s 2024-09-19T07:25:47.416 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.416+0000 7f494f738640 1 -- 172.21.15.98:0/361993377 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49481a5160 con 0x7f4948106a80 2024-09-19T07:25:47.417 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.417+0000 7f49467fc640 1 -- 172.21.15.98:0/361993377 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11928 (secure 0 0 0) 0x7f49380bc2e0 con 0x7f4948106a80 2024-09-19T07:25:47.418 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:25:47.418 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"btime":"2024-09-19T07:24:57:508846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:24:56.977446+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":73,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":74,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:25:47.418 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2024-09-19T07:25:47.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.419+0000 7f494f738640 1 -- 172.21.15.98:0/361993377 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f49300a33b0 msgr2=0x7f49300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:47.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.419+0000 7f494f738640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f49300a33b0 0x7f49300a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f494000a300 tx=0x7f494000a290 comp rx=0 tx=0).stop 2024-09-19T07:25:47.420 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.419+0000 7f494f738640 1 -- 172.21.15.98:0/361993377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948106a80 msgr2=0x7f494819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:47.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.419+0000 7f494f738640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948106a80 0x7f494819cce0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4938005ab0 tx=0x7f49380042f0 comp rx=0 tx=0).stop 2024-09-19T07:25:47.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.419+0000 7f494f738640 1 -- 172.21.15.98:0/361993377 shutdown_connections 2024-09-19T07:25:47.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.419+0000 7f494f738640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f49300a33b0 0x7f49300a5870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:47.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.419+0000 7f494f738640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948106a80 0x7f494819cce0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:47.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.419+0000 7f494f738640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4948101420 0x7f4948198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:47.421 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.419+0000 7f494f738640 1 --2- 172.21.15.98:0/361993377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4948100a80 0x7f4948198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:47.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.419+0000 7f494f738640 1 -- 172.21.15.98:0/361993377 >> 172.21.15.98:0/361993377 conn(0x7f49480fc7a0 msgr2=0x7f494806a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:47.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.419+0000 7f494f738640 1 -- 172.21.15.98:0/361993377 shutdown_connections 2024-09-19T07:25:47.422 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:47.419+0000 7f494f738640 1 -- 172.21.15.98:0/361993377 wait complete. 2024-09-19T07:25:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:47 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/361993377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:48.193 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db --set-id ebe6b401 --release --await' 2024-09-19T07:25:48.194 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db --set-id ebe6b401 --release --await 2024-09-19T07:25:48.285 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:47 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/361993377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:48.401 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:47 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/361993377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:25:48.442 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:25:48.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.927+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1344794725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b8100a80 msgr2=0x7f90b8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.927+0000 7f90bd7ca640 1 --2- 172.21.15.98:0/1344794725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b8100a80 0x7f90b8100ee0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009930 tx=0x7f90ac02a420 comp rx=0 tx=0).stop 2024-09-19T07:25:48.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.927+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1344794725 shutdown_connections 2024-09-19T07:25:48.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.927+0000 7f90bd7ca640 1 --2- 172.21.15.98:0/1344794725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b8101420 0x7f90b810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.927+0000 7f90bd7ca640 1 --2- 172.21.15.98:0/1344794725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b8100a80 0x7f90b8100ee0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.927+0000 7f90bd7ca640 1 --2- 172.21.15.98:0/1344794725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90b8106a80 0x7f90b8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.927+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1344794725 >> 172.21.15.98:0/1344794725 conn(0x7f90b80fc7a0 msgr2=0x7f90b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:48.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.927+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1344794725 shutdown_connections 2024-09-19T07:25:48.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.928+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1344794725 wait complete. 2024-09-19T07:25:48.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.928+0000 7f90bd7ca640 1 Processor -- start 2024-09-19T07:25:48.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.928+0000 7f90bd7ca640 1 -- start start 2024-09-19T07:25:48.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.928+0000 7f90bd7ca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b8100a80 0x7f90b8197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.928+0000 7f90bd7ca640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b8101420 0x7f90b8197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.960 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.928+0000 7f90bd7ca640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90b8106a80 0x7f90b819bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.928+0000 7f90bd7ca640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90b8110e80 con 0x7f90b8100a80 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.928+0000 7f90bd7ca640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f90b8110d00 con 0x7f90b8106a80 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.928+0000 7f90bd7ca640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90b8111000 con 0x7f90b8101420 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90b6ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b8100a80 0x7f90b8197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90b6ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b8100a80 0x7f90b8197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48044/0 (socket says 172.21.15.98:48044) 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90b6ffd640 1 -- 172.21.15.98:0/1914120037 learned_addr learned my addr 172.21.15.98:0/1914120037 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90b77fe640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90b8106a80 0x7f90b819bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90b67fc640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b8101420 0x7f90b8197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90b6ffd640 1 -- 172.21.15.98:0/1914120037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b8101420 msgr2=0x7f90b8197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90b6ffd640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b8101420 0x7f90b8197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90b6ffd640 1 -- 172.21.15.98:0/1914120037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90b8106a80 msgr2=0x7f90b819bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90b6ffd640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90b8106a80 0x7f90b819bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90b6ffd640 1 -- 172.21.15.98:0/1914120037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b819c2b0 con 0x7f90b8100a80 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90b6ffd640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b8100a80 0x7f90b8197300 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f90a800c920 tx=0x7f90a800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f909ffff640 1 -- 172.21.15.98:0/1914120037 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8007c70 con 0x7f90b8100a80 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1914120037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b819c5a0 con 0x7f90b8100a80 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f909ffff640 1 -- 172.21.15.98:0/1914120037 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90a8007e10 con 0x7f90b8100a80 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f909ffff640 1 -- 172.21.15.98:0/1914120037 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8018890 con 0x7f90b8100a80 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.929+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1914120037 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b81a3e80 con 0x7f90b8100a80 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.932+0000 7f909ffff640 1 -- 172.21.15.98:0/1914120037 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f90a8018a70 con 0x7f90b8100a80 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.932+0000 7f90bfba3740 1 Processor -- start 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.932+0000 7f90bfba3740 1 -- start start 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.932+0000 7f90bfba3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359035ee0 0x5623590362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.932+0000 7f90bfba3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359036800 0x562359042f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.932+0000 7f90bfba3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359043450 0x562359045840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.932+0000 7f90bfba3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562358f9b620 con 0x562359035ee0 2024-09-19T07:25:48.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.932+0000 7f90bfba3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562358f42e50 con 0x562359043450 2024-09-19T07:25:48.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.932+0000 7f90bfba3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562358f975e0 con 0x562359036800 2024-09-19T07:25:48.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.932+0000 7f90b77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359035ee0 0x5623590362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.932+0000 7f90b77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359035ee0 0x5623590362c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48052/0 (socket says 172.21.15.98:48052) 2024-09-19T07:25:48.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.932+0000 7f90b77fe640 1 -- 172.21.15.98:0/3636769119 learned_addr learned my addr 172.21.15.98:0/3636769119 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:48.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f90b6ffd640 1 --2- 172.21.15.98:0/3636769119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359036800 0x562359042f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f90b67fc640 1 --2- 172.21.15.98:0/3636769119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359043450 0x562359045840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f90b77fe640 1 -- 172.21.15.98:0/3636769119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359036800 msgr2=0x562359042f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f90b77fe640 1 --2- 172.21.15.98:0/3636769119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359036800 0x562359042f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f90b77fe640 1 -- 172.21.15.98:0/3636769119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359043450 msgr2=0x562359045840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f909ffff640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f90a00a33b0 0x7f90a00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.963 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f90b77fe640 1 --2- 172.21.15.98:0/3636769119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359043450 0x562359045840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f90b77fe640 1 -- 172.21.15.98:0/3636769119 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562358f33d40 con 0x562359035ee0 2024-09-19T07:25:48.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f90b67fc640 1 --2- 172.21.15.98:0/3636769119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359043450 0x562359045840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:48.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f909ffff640 1 -- 172.21.15.98:0/1914120037 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f90a80cfe80 con 0x7f90b8100a80 2024-09-19T07:25:48.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f90b77fe640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f90a00a33b0 0x7f90a00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f90b77fe640 1 --2- 172.21.15.98:0/3636769119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359035ee0 0x5623590362c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f90b0010370 tx=0x7f90b0010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcfcfe4f574a76d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:48.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f909d7fa640 1 -- 172.21.15.98:0/3636769119 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b0022070 con 0x562359035ee0 2024-09-19T07:25:48.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f909d7fa640 1 -- 172.21.15.98:0/3636769119 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90b00113e0 con 0x562359035ee0 2024-09-19T07:25:48.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.933+0000 7f909d7fa640 1 -- 172.21.15.98:0/3636769119 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b0016070 con 0x562359035ee0 2024-09-19T07:25:48.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.934+0000 7f90bfba3740 1 -- 172.21.15.98:0/3636769119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359035ee0 msgr2=0x5623590362c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.934+0000 7f90b77fe640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f90a00a33b0 0x7f90a00a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f90b001f000 tx=0x7f90b0022000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:48.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.934+0000 7f90bfba3740 1 --2- 172.21.15.98:0/3636769119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359035ee0 0x5623590362c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f90b0010370 tx=0x7f90b0010830 comp rx=0 tx=0).stop 2024-09-19T07:25:48.964 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.934+0000 7f90bfba3740 1 -- 172.21.15.98:0/3636769119 shutdown_connections 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.934+0000 7f90bfba3740 1 --2- 172.21.15.98:0/3636769119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359043450 0x562359045840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.934+0000 7f90bfba3740 1 --2- 172.21.15.98:0/3636769119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359036800 0x562359042f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.934+0000 7f90bfba3740 1 --2- 172.21.15.98:0/3636769119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359035ee0 0x5623590362c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.934+0000 7f90bfba3740 1 -- 172.21.15.98:0/3636769119 >> 172.21.15.98:0/3636769119 conn(0x5623590325f0 msgr2=0x5623590329d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.934+0000 7f90bfba3740 1 -- 172.21.15.98:0/3636769119 shutdown_connections 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.934+0000 7f90bfba3740 1 -- 172.21.15.98:0/3636769119 wait complete. 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.934+0000 7f90bfba3740 1 -- start start 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90bfba3740 1 Processor -- start 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90bfba3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359035ee0 0x5623590403c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90bfba3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 0x562359040900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90bfba3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359043450 0x562359040e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90bfba3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562359046080 con 0x562359036800 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90bfba3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562358f23f10 con 0x562359035ee0 2024-09-19T07:25:48.965 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90bfba3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x562359046200 con 0x562359043450 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90bfba3740 10 client.0 _ll_register_callbacks cb 0x562358f47db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90b67fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 0x562359040900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90b67fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 0x562359040900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48056/0 (socket says 172.21.15.98:48056) 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90b67fc640 1 -- 172.21.15.98:0/3386286017 learned_addr learned my addr 172.21.15.98:0/3386286017 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90b6ffd640 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359035ee0 0x5623590403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90b77fe640 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359043450 0x562359040e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90b67fc640 1 -- 172.21.15.98:0/3386286017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359043450 msgr2=0x562359040e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90b67fc640 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359043450 0x562359040e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90b67fc640 1 -- 172.21.15.98:0/3386286017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359035ee0 msgr2=0x5623590403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90b67fc640 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359035ee0 0x5623590403c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90b67fc640 1 -- 172.21.15.98:0/3386286017 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562358caa580 con 0x562359036800 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f90b67fc640 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 0x562359040900 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f90ac02a940 tx=0x7f90ac031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad496f94ab81d74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:48.966 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.935+0000 7f909aff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f909aff5640 1 -- 172.21.15.98:0/3386286017 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac03f070 con 0x562359036800 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f909aff5640 1 -- 172.21.15.98:0/3386286017 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f90ac004450 con 0x562359036800 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f90bfba3740 1 -- 172.21.15.98:0/3386286017 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90b00113e0 con 0x562359036800 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f909aff5640 1 -- 172.21.15.98:0/3386286017 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f90ac035070 con 0x562359036800 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f90bfba3740 10 client.16377 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f90bfba3740 1 -- 172.21.15.98:0/3386286017 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562358d74960 con 0x562359036800 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f909aff5640 1 -- 172.21.15.98:0/3386286017 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90b00113e0 con 0x562359036800 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f909aff5640 1 -- 172.21.15.98:0/3386286017 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f90ac004be0 con 0x562359036800 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f90bfba3740 10 client.16377 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f90bfba3740 10 client.16377 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f90bfba3740 20 client.16377 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f90bfba3740 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56235903a3c0 0x56235903a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.967 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f90bfba3740 4 client.16377 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.936+0000 7f90bfba3740 1 -- 172.21.15.98:0/3386286017 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562358fa8b90 con 0x56235903a3c0 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.937+0000 7f90b6ffd640 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56235903a3c0 0x56235903a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.937+0000 7f909aff5640 10 client.16377 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.937+0000 7f90b6ffd640 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56235903a3c0 0x56235903a830 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d92633535151ffde server_cookie=dab4cf573e61269f in_seq=0 out_seq=0 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f909aff5640 1 -- 172.21.15.98:0/3386286017 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562358fa8b90 con 0x56235903a3c0 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f909aff5640 10 client.16377 handle_command_reply: tid=0 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f90bfba3740 1 client.16377 shutdown 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f90bfba3740 1 -- 172.21.15.98:0/3386286017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 msgr2=0x562359040900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f90bfba3740 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 0x562359040900 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f90ac02a940 tx=0x7f90ac031860 comp rx=0 tx=0).stop 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f90bfba3740 1 -- 172.21.15.98:0/3386286017 shutdown_connections 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f90bfba3740 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359043450 0x562359040e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f90bfba3740 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56235903a3c0 0x56235903a830 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.968 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f90bfba3740 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 0x562359040900 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f909aff5640 0 client.16377 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:48.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f90bfba3740 1 --2- 172.21.15.98:0/3386286017 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359035ee0 0x5623590403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f90bfba3740 1 -- 172.21.15.98:0/3386286017 >> 172.21.15.98:0/3386286017 conn(0x5623590325f0 msgr2=0x5623590382b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:48.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f90bfba3740 1 -- 172.21.15.98:0/3386286017 shutdown_connections 2024-09-19T07:25:48.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f90bfba3740 1 -- 172.21.15.98:0/3386286017 wait complete. 2024-09-19T07:25:48.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.938+0000 7f90bfba3740 20 client.16377 trim_cache size 0 max 16384 2024-09-19T07:25:48.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90bfba3740 1 Processor -- start 2024-09-19T07:25:48.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90bfba3740 1 -- start start 2024-09-19T07:25:48.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90bfba3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359035ee0 0x562359031640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90bfba3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 0x56235905cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90bfba3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359043450 0x56235905d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.969 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90bfba3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90b81ae0b0 con 0x562359036800 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90bfba3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f90b81ab8c0 con 0x562359043450 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90bfba3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90b81a9710 con 0x562359035ee0 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90b67fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 0x56235905cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90b67fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 0x56235905cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48072/0 (socket says 172.21.15.98:48072) 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90b67fc640 1 -- 172.21.15.98:0/4026485001 learned_addr learned my addr 172.21.15.98:0/4026485001 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90b67fc640 1 -- 172.21.15.98:0/4026485001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359035ee0 msgr2=0x562359031640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90b67fc640 1 --2- 172.21.15.98:0/4026485001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359035ee0 0x562359031640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90b67fc640 1 -- 172.21.15.98:0/4026485001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359043450 msgr2=0x56235905d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90b67fc640 1 --2- 172.21.15.98:0/4026485001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359043450 0x56235905d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90b67fc640 1 -- 172.21.15.98:0/4026485001 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562359030bb0 con 0x562359036800 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.955+0000 7f90b67fc640 1 --2- 172.21.15.98:0/4026485001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 0x56235905cfe0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0035f0 tx=0x7f90ac02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d46b42ce4d6215 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.956+0000 7f909cff9640 1 -- 172.21.15.98:0/4026485001 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac04f040 con 0x562359036800 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.956+0000 7f909cff9640 1 -- 172.21.15.98:0/4026485001 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90ac003e40 con 0x562359036800 2024-09-19T07:25:48.970 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.956+0000 7f909cff9640 1 -- 172.21.15.98:0/4026485001 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac03f040 con 0x562359036800 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.956+0000 7f90bfba3740 1 -- 172.21.15.98:0/4026485001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 msgr2=0x56235905cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.956+0000 7f90bfba3740 1 --2- 172.21.15.98:0/4026485001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 0x56235905cfe0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0035f0 tx=0x7f90ac02a420 comp rx=0 tx=0).stop 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.956+0000 7f90bfba3740 1 -- 172.21.15.98:0/4026485001 shutdown_connections 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.956+0000 7f90bfba3740 1 --2- 172.21.15.98:0/4026485001 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359043450 0x56235905d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.956+0000 7f90bfba3740 1 --2- 172.21.15.98:0/4026485001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359036800 0x56235905cfe0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.956+0000 7f90bfba3740 1 --2- 172.21.15.98:0/4026485001 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359035ee0 0x562359031640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.956+0000 7f90bfba3740 1 -- 172.21.15.98:0/4026485001 >> 172.21.15.98:0/4026485001 conn(0x5623590325f0 msgr2=0x562359030f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.956+0000 7f90bfba3740 1 -- 172.21.15.98:0/4026485001 shutdown_connections 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.956+0000 7f90bfba3740 1 -- 172.21.15.98:0/4026485001 wait complete. 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.957+0000 7f90bfba3740 1 -- start start 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.957+0000 7f90bfba3740 1 Processor -- start 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.957+0000 7f90bfba3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359035ee0 0x562359047960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.971 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.957+0000 7f90bfba3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359036800 0x562359047ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.957+0000 7f90bfba3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359043450 0x5623590befb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.957+0000 7f90bfba3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90b81a9d80 con 0x562359043450 2024-09-19T07:25:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.957+0000 7f90bfba3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f90b81ab1f0 con 0x562359036800 2024-09-19T07:25:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.957+0000 7f90bfba3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f90b81aa450 con 0x562359035ee0 2024-09-19T07:25:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.957+0000 7f90bfba3740 10 client.0 _ll_register_callbacks cb 0x7f90ac005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.957+0000 7f90b77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359043450 0x5623590befb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.957+0000 7f90b77fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359043450 0x5623590befb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:48076/0 (socket says 172.21.15.98:48076) 2024-09-19T07:25:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.957+0000 7f90b77fe640 1 -- 172.21.15.98:0/2587366534 learned_addr learned my addr 172.21.15.98:0/2587366534 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:48.972 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f90b6ffd640 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359035ee0 0x562359047960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f90b67fc640 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359036800 0x562359047ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f90b77fe640 1 -- 172.21.15.98:0/2587366534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359035ee0 msgr2=0x562359047960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f90b77fe640 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359035ee0 0x562359047960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f90b77fe640 1 -- 172.21.15.98:0/2587366534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359036800 msgr2=0x562359047ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f90b77fe640 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359036800 0x562359047ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f90b77fe640 1 -- 172.21.15.98:0/2587366534 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623590bf5a0 con 0x562359043450 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f90b77fe640 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359043450 0x5623590befb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f90b0010370 tx=0x7f90b0012a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14be87837e6ddab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f909aff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f909aff5640 1 -- 172.21.15.98:0/2587366534 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b0036060 con 0x562359043450 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f909aff5640 1 -- 172.21.15.98:0/2587366534 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f90b001cc70 con 0x562359043450 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f90bfba3740 1 -- 172.21.15.98:0/2587366534 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90ac003e40 con 0x562359043450 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f909aff5640 1 -- 172.21.15.98:0/2587366534 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f90b0016040 con 0x562359043450 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f90bfba3740 10 client.16383 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:48.973 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f90bfba3740 1 -- 172.21.15.98:0/2587366534 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5623590c08a0 con 0x562359043450 2024-09-19T07:25:48.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f909aff5640 1 -- 172.21.15.98:0/2587366534 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90ac003e40 con 0x562359043450 2024-09-19T07:25:48.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.958+0000 7f909aff5640 1 -- 172.21.15.98:0/2587366534 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f90b000f040 con 0x562359043450 2024-09-19T07:25:48.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.959+0000 7f90bfba3740 10 client.16383 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:48.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.959+0000 7f90bfba3740 10 client.16383 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:25:48.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.959+0000 7f90bfba3740 20 client.16383 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:48.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.959+0000 7f90bfba3740 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5623590c0c80 0x5623590c3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:48.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.959+0000 7f90bfba3740 4 client.16383 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ebe6b401", "release": true, "await": true}] 2024-09-19T07:25:48.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.959+0000 7f90bfba3740 1 -- 172.21.15.98:0/2587366534 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ebe6b401", "release": true, "await": true}) -- 0x562358fa30a0 con 0x5623590c0c80 2024-09-19T07:25:48.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.959+0000 7f90b6ffd640 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5623590c0c80 0x5623590c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:48.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.959+0000 7f90b6ffd640 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5623590c0c80 0x5623590c3070 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8438bc5cc0cc1b68 server_cookie=6ef6dcc1e654d025 in_seq=0 out_seq=0 2024-09-19T07:25:48.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:48.959+0000 7f909aff5640 10 client.16383 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:49.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:48 smithi098 ceph-mon[30950]: pgmap v115: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 997 KiB/s wr, 415 op/s 2024-09-19T07:25:49.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:48 smithi139 ceph-mon[35039]: pgmap v115: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 997 KiB/s wr, 415 op/s 2024-09-19T07:25:49.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:48 smithi162 ceph-mon[35726]: pgmap v115: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 997 KiB/s wr, 415 op/s 2024-09-19T07:25:49.570 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f909aff5640 1 -- 172.21.15.98:0/2587366534 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562358fa30a0 con 0x5623590c0c80 2024-09-19T07:25:49.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f909aff5640 10 client.16383 handle_command_reply: tid=0 2024-09-19T07:25:49.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f90bfba3740 1 client.16383 shutdown 2024-09-19T07:25:49.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f90bfba3740 1 -- 172.21.15.98:0/2587366534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359043450 msgr2=0x5623590befb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:49.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f90bfba3740 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359043450 0x5623590befb0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f90b0010370 tx=0x7f90b0012a20 comp rx=0 tx=0).stop 2024-09-19T07:25:49.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f90bfba3740 1 -- 172.21.15.98:0/2587366534 shutdown_connections 2024-09-19T07:25:49.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f90bfba3740 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5623590c0c80 0x5623590c3070 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:49.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f90bfba3740 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562359043450 0x5623590befb0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:49.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f90bfba3740 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562359036800 0x562359047ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:49.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f909aff5640 0 client.16383 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:49.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f90bfba3740 1 --2- 172.21.15.98:0/2587366534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562359035ee0 0x562359047960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:49.571 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f90bfba3740 1 -- 172.21.15.98:0/2587366534 >> 172.21.15.98:0/2587366534 conn(0x5623590325f0 msgr2=0x562359030f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:49.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f90bfba3740 1 -- 172.21.15.98:0/2587366534 shutdown_connections 2024-09-19T07:25:49.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f90bfba3740 1 -- 172.21.15.98:0/2587366534 wait complete. 2024-09-19T07:25:49.572 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.569+0000 7f90bfba3740 20 client.16383 trim_cache size 0 max 16384 2024-09-19T07:25:49.572 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:25:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 30, 2024-09-19T07:25:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:25:49.572 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 16, 2024-09-19T07:25:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": { 2024-09-19T07:25:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "ebe6b401": { 2024-09-19T07:25:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "version": 16, 2024-09-19T07:25:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "age_ref": 0.0, 2024-09-19T07:25:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:25:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RELEASED", 2024-09-19T07:25:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:25:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:25:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "timeout": 90.0, 2024-09-19T07:25:49.573 INFO:teuthology.orchestra.run.smithi098.stdout: "expiration": 136.6, 2024-09-19T07:25:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "members": { 2024-09-19T07:25:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "file:/": { 2024-09-19T07:25:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "excluded": false, 2024-09-19T07:25:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:25:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RELEASED", 2024-09-19T07:25:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:25:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:25:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:25:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:25:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:25:49.574 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:25:49.574 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:25:49.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.570+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1914120037 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f90a00a33b0 msgr2=0x7f90a00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:49.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.570+0000 7f90bd7ca640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f90a00a33b0 0x7f90a00a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f90b001f000 tx=0x7f90b0022000 comp rx=0 tx=0).stop 2024-09-19T07:25:49.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.570+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1914120037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b8100a80 msgr2=0x7f90b8197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:49.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.570+0000 7f90bd7ca640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b8100a80 0x7f90b8197300 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f90a800c920 tx=0x7f90a800cde0 comp rx=0 tx=0).stop 2024-09-19T07:25:49.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.570+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1914120037 shutdown_connections 2024-09-19T07:25:49.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.570+0000 7f90bd7ca640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f90a00a33b0 0x7f90a00a5870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:49.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.570+0000 7f90bd7ca640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f90b8106a80 0x7f90b819bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:49.575 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.570+0000 7f90bd7ca640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b8101420 0x7f90b8197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:49.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.570+0000 7f90bd7ca640 1 --2- 172.21.15.98:0/1914120037 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90b8100a80 0x7f90b8197300 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:49.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.570+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1914120037 >> 172.21.15.98:0/1914120037 conn(0x7f90b80fc7a0 msgr2=0x7f90b80fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:49.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.570+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1914120037 shutdown_connections 2024-09-19T07:25:49.576 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:25:49.570+0000 7f90bd7ca640 1 -- 172.21.15.98:0/1914120037 wait complete. 2024-09-19T07:25:49.599 INFO:tasks.workunit.client.0.smithi098.stdout:5/960: creat dc/de/d13/d46/d2e/da5/f155 x:0 0 0 2024-09-19T07:25:49.601 INFO:tasks.workunit.client.0.smithi098.stdout:5/961: creat dc/de/d13/d7d/f156 x:0 0 0 2024-09-19T07:25:49.606 INFO:tasks.workunit.client.0.smithi098.stdout:5/962: getdents dc/de/dc0 0 2024-09-19T07:25:49.616 INFO:tasks.workunit.client.0.smithi098.stdout:5/963: symlink dc/de/d13/d5c/daf/db9/d121/l157 0 2024-09-19T07:25:49.619 INFO:tasks.workunit.client.0.smithi098.stdout:5/964: rename dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71 to dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/d158 22 2024-09-19T07:25:49.620 INFO:tasks.workunit.client.0.smithi098.stdout:5/965: mknod dc/de/d13/d46/d2e/d37/d6d/c159 0 2024-09-19T07:25:49.626 INFO:tasks.workunit.client.0.smithi098.stdout:5/966: write dc/de/d13/d46/d23/dc1/f145 [493173,104510] 0 2024-09-19T07:25:49.628 INFO:tasks.workunit.client.0.smithi098.stdout:5/967: mkdir dc/de/d13/d5c/daf/d15a 0 2024-09-19T07:25:49.629 INFO:tasks.workunit.client.0.smithi098.stdout:5/968: creat dc/de/d13/d7d/d124/f15b x:0 0 0 2024-09-19T07:25:49.656 INFO:tasks.workunit.client.0.smithi098.stdout:5/969: dwrite dc/de/d13/d5c/fea [0,4194304] 0 2024-09-19T07:25:50.323 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ebe6b401', total seconds elapsed: 20.9 2024-09-19T07:25:51.131 INFO:tasks.workunit.client.0.smithi098.stdout:5/970: write dc/de/d13/d46/d2e/da5/d149/db8/fe4 [3206544,60455] 0 2024-09-19T07:25:51.131 INFO:tasks.workunit.client.0.smithi098.stdout:5/971: chown dc/de/d13/d7d/d124/f15b 7806 1 2024-09-19T07:25:51.135 INFO:tasks.workunit.client.0.smithi098.stdout:5/972: mknod dc/de/d13/d46/d2e/d37/d6d/dee/d112/d71/d127/c15c 0 2024-09-19T07:25:51.136 INFO:tasks.workunit.client.0.smithi098.stdout:5/973: readlink dc/de/d13/d46/d2e/da5/lfa 0 2024-09-19T07:25:51.143 INFO:tasks.workunit.client.0.smithi098.stdout:5/974: dread dc/de/d13/d46/d2e/d37/d6d/dee/d112/f3d [0,4194304] 0 2024-09-19T07:25:51.146 INFO:tasks.workunit.client.0.smithi098.stdout:5/975: link dc/de/d13/d5c/da2/f147 dc/de/d13/d46/d23/dc1/f15d 0 2024-09-19T07:25:51.149 INFO:tasks.workunit.client.0.smithi098.stdout:5/976: creat dc/d100/f15e x:0 0 0 2024-09-19T07:25:51.150 INFO:tasks.workunit.client.0.smithi098.stdout:5/977: unlink dc/de/d13/d46/d23/dc1/f15d 0 2024-09-19T07:25:51.150 INFO:tasks.workunit.client.0.smithi098.stdout:5/978: truncate dc/de/d13/d46/d2e/da5/d149/db8/f14a 533197 0 2024-09-19T07:25:51.161 INFO:tasks.workunit.client.0.smithi098.stdout:5/979: dread dc/d100/f85 [0,4194304] 0 2024-09-19T07:25:51.165 INFO:tasks.workunit.client.0.smithi098.stdout:5/980: rename dc/de/d13/d5c/daf/db9/d118/f119 to dc/de/d13/d46/df6/f15f 0 2024-09-19T07:25:51.166 INFO:tasks.workunit.client.0.smithi098.stdout:5/981: getdents dc/de/d13/d46/d2e/d37/d6d/dee/d134 0 2024-09-19T07:25:51.172 INFO:tasks.workunit.client.0.smithi098.stdout:5/982: write dc/f12 [4511214,90773] 0 2024-09-19T07:25:51.173 INFO:tasks.workunit.client.0.smithi098.stdout:5/983: mknod dc/de/d13/d5c/daf/d15a/c160 0 2024-09-19T07:25:51.174 INFO:tasks.workunit.client.0.smithi098.stdout:5/984: mkdir dc/de/d13/d5c/da2/d161 0 2024-09-19T07:25:51.185 INFO:tasks.workunit.client.0.smithi098.stdout:5/985: link dc/d100/l91 dc/de/d13/d5c/daf/db9/d118/l162 0 2024-09-19T07:25:51.187 INFO:tasks.workunit.client.0.smithi098.stdout:5/986: symlink dc/de/d13/d5c/l163 0 2024-09-19T07:25:51.216 INFO:tasks.workunit.client.0.smithi098.stdout:5/987: dwrite fa [0,4194304] 0 2024-09-19T07:25:51.217 INFO:tasks.workunit.client.0.smithi098.stdout:5/988: chown dc/de/d13/d46/d2e/da5/d149/db8/f14a 20934526 1 2024-09-19T07:25:51.217 INFO:tasks.workunit.client.0.smithi098.stdout:5/989: chown dc/de/d13/fa1 146 1 2024-09-19T07:25:51.218 INFO:tasks.workunit.client.0.smithi098.stdout:5/990: readlink dc/de/d13/d46/lcd 0 2024-09-19T07:25:51.229 INFO:tasks.workunit.client.0.smithi098.stdout:5/991: write dc/de/d13/fa1 [2396019,127724] 0 2024-09-19T07:25:51.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:50 smithi098 ceph-mon[30950]: pgmap v116: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 1.4 MiB/s wr, 428 op/s 2024-09-19T07:25:51.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:50 smithi139 ceph-mon[35039]: pgmap v116: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 1.4 MiB/s wr, 428 op/s 2024-09-19T07:25:51.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:50 smithi162 ceph-mon[35726]: pgmap v116: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 1.4 MiB/s wr, 428 op/s 2024-09-19T07:25:51.437 INFO:tasks.workunit.client.0.smithi098.stdout:5/992: sync 2024-09-19T07:25:51.451 INFO:tasks.workunit.client.0.smithi098.stdout:5/993: read dc/de/d13/d46/d2e/da5/d149/db8/fc6 [119885,107014] 0 2024-09-19T07:25:51.453 INFO:tasks.workunit.client.0.smithi098.stdout:5/994: creat dc/de/d13/d46/d2e/d37/d14b/d151/f164 x:0 0 0 2024-09-19T07:25:51.455 INFO:tasks.workunit.client.0.smithi098.stdout:5/995: mknod dc/de/d13/d46/d23/dc1/c165 0 2024-09-19T07:25:51.455 INFO:tasks.workunit.client.0.smithi098.stdout:5/996: readlink dc/ld9 0 2024-09-19T07:25:51.456 INFO:tasks.workunit.client.0.smithi098.stdout:5/997: mknod dc/c166 0 2024-09-19T07:25:51.456 INFO:tasks.workunit.client.0.smithi098.stdout:5/998: readlink dc/d100/l8b 0 2024-09-19T07:25:51.457 INFO:tasks.workunit.client.0.smithi098.stdout:5/999: truncate dc/de/d13/d46/d2e/d37/d6d/f131 890447 0 2024-09-19T07:25:51.462 INFO:tasks.workunit.client.0.smithi098.stderr:+ rm -rf -- ./tmp.lagndhNYO2 2024-09-19T07:25:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.033+0000 7f780994b640 1 -- 172.21.15.98:0/3630437586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7804102c80 msgr2=0x7f7804103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.033+0000 7f780994b640 1 --2- 172.21.15.98:0/3630437586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7804102c80 0x7f7804103060 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009900 tx=0x7f77f402a480 comp rx=0 tx=0).stop 2024-09-19T07:25:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.033+0000 7f780994b640 1 -- 172.21.15.98:0/3630437586 shutdown_connections 2024-09-19T07:25:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.033+0000 7f780994b640 1 --2- 172.21.15.98:0/3630437586 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f780410c0d0 0x7f780410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.033+0000 7f780994b640 1 --2- 172.21.15.98:0/3630437586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78041035a0 0x7f780410ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.033+0000 7f780994b640 1 --2- 172.21.15.98:0/3630437586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7804102c80 0x7f7804103060 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.033+0000 7f780994b640 1 -- 172.21.15.98:0/3630437586 >> 172.21.15.98:0/3630437586 conn(0x7f7804077990 msgr2=0x7f78040fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.033+0000 7f780994b640 1 -- 172.21.15.98:0/3630437586 shutdown_connections 2024-09-19T07:25:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.033+0000 7f780994b640 1 -- 172.21.15.98:0/3630437586 wait complete. 2024-09-19T07:25:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.033+0000 7f780994b640 1 Processor -- start 2024-09-19T07:25:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f780994b640 1 -- start start 2024-09-19T07:25:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f780994b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7804102c80 0x7f78041983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f780994b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78041035a0 0x7f7804198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f780994b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f780410c0d0 0x7f780419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f780994b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7804111eb0 con 0x7f7804102c80 2024-09-19T07:25:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f780994b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7804111d30 con 0x7f780410c0d0 2024-09-19T07:25:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f780994b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7804112030 con 0x7f78041035a0 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f7802ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7804102c80 0x7f78041983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f7802ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7804102c80 0x7f78041983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57950/0 (socket says 172.21.15.98:57950) 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f7802ffd640 1 -- 172.21.15.98:0/1742091963 learned_addr learned my addr 172.21.15.98:0/1742091963 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f78037fe640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f780410c0d0 0x7f780419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f78027fc640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78041035a0 0x7f7804198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f7802ffd640 1 -- 172.21.15.98:0/1742091963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78041035a0 msgr2=0x7f7804198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f7802ffd640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78041035a0 0x7f7804198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f7802ffd640 1 -- 172.21.15.98:0/1742091963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f780410c0d0 msgr2=0x7f780419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f7802ffd640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f780410c0d0 0x7f780419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f7802ffd640 1 -- 172.21.15.98:0/1742091963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780419d3d0 con 0x7f7804102c80 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f78037fe640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f780410c0d0 0x7f780419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.034+0000 7f7802ffd640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7804102c80 0x7f78041983e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f77f4006010 tx=0x7f77f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.035+0000 7f7808949640 1 -- 172.21.15.98:0/1742091963 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f403f030 con 0x7f7804102c80 2024-09-19T07:25:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.035+0000 7f7808949640 1 -- 172.21.15.98:0/1742091963 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77f4003ce0 con 0x7f7804102c80 2024-09-19T07:25:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.035+0000 7f780994b640 1 -- 172.21.15.98:0/1742091963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780419d660 con 0x7f7804102c80 2024-09-19T07:25:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.035+0000 7f7808949640 1 -- 172.21.15.98:0/1742091963 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4035070 con 0x7f7804102c80 2024-09-19T07:25:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.035+0000 7f780994b640 1 -- 172.21.15.98:0/1742091963 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78041a4f50 con 0x7f7804102c80 2024-09-19T07:25:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.037+0000 7f7808949640 1 -- 172.21.15.98:0/1742091963 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f77f4042030 con 0x7f7804102c80 2024-09-19T07:25:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.037+0000 7f780c7c4740 1 Processor -- start 2024-09-19T07:25:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.037+0000 7f780c7c4740 1 -- start start 2024-09-19T07:25:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.037+0000 7f7808949640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f77ec0a3460 0x7f77ec0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f780c7c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd2af0 0x559893bd2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78037fe640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f77ec0a3460 0x7f77ec0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f780c7c4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bd3410 0x559893bdd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f780c7c4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bddcb0 0x559893be00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f780c7c4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559893b372f0 con 0x559893bddcb0 2024-09-19T07:25:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f780c7c4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559893adf270 con 0x559893bd3410 2024-09-19T07:25:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f780c7c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559893b332b0 con 0x559893bd2af0 2024-09-19T07:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f7808949640 1 -- 172.21.15.98:0/1742091963 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f77f40f03e0 con 0x7f7804102c80 2024-09-19T07:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78037fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bddcb0 0x559893be00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78037fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bddcb0 0x559893be00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57964/0 (socket says 172.21.15.98:57964) 2024-09-19T07:25:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78037fe640 1 -- 172.21.15.98:0/3043078831 learned_addr learned my addr 172.21.15.98:0/3043078831 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78037fe640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f77ec0a3460 0x7f77ec0a5920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0127e0 tx=0x7f77fc012be0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78027fc640 1 --2- 172.21.15.98:0/3043078831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bd3410 0x559893bdd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78037fe640 1 -- 172.21.15.98:0/3043078831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd2af0 msgr2=0x559893bd2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78037fe640 1 --2- 172.21.15.98:0/3043078831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd2af0 0x559893bd2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78037fe640 1 -- 172.21.15.98:0/3043078831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bd3410 msgr2=0x559893bdd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78037fe640 1 --2- 172.21.15.98:0/3043078831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bd3410 0x559893bdd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78037fe640 1 -- 172.21.15.98:0/3043078831 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559893ade340 con 0x559893bddcb0 2024-09-19T07:25:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78027fc640 1 --2- 172.21.15.98:0/3043078831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bd3410 0x559893bdd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:25:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f78037fe640 1 --2- 172.21.15.98:0/3043078831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bddcb0 0x559893be00a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00ea80 tx=0x7f77fc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e9209b2d1365f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f77e9ffb640 1 -- 172.21.15.98:0/3043078831 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc01fb70 con 0x559893bddcb0 2024-09-19T07:25:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f77e9ffb640 1 -- 172.21.15.98:0/3043078831 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77fc023070 con 0x559893bddcb0 2024-09-19T07:25:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.038+0000 7f77e9ffb640 1 -- 172.21.15.98:0/3043078831 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0265d0 con 0x559893bddcb0 2024-09-19T07:25:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.039+0000 7f780c7c4740 1 -- 172.21.15.98:0/3043078831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bddcb0 msgr2=0x559893be00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.039+0000 7f780c7c4740 1 --2- 172.21.15.98:0/3043078831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bddcb0 0x559893be00a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00ea80 tx=0x7f77fc01f000 comp rx=0 tx=0).stop 2024-09-19T07:25:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.039+0000 7f780c7c4740 1 -- 172.21.15.98:0/3043078831 shutdown_connections 2024-09-19T07:25:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.039+0000 7f780c7c4740 1 --2- 172.21.15.98:0/3043078831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bddcb0 0x559893be00a0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.039+0000 7f780c7c4740 1 --2- 172.21.15.98:0/3043078831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bd3410 0x559893bdd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.039+0000 7f780c7c4740 1 --2- 172.21.15.98:0/3043078831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd2af0 0x559893bd2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.039+0000 7f780c7c4740 1 -- 172.21.15.98:0/3043078831 >> 172.21.15.98:0/3043078831 conn(0x559893bcf060 msgr2=0x559893bcf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.039+0000 7f780c7c4740 1 -- 172.21.15.98:0/3043078831 shutdown_connections 2024-09-19T07:25:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.039+0000 7f780c7c4740 1 -- 172.21.15.98:0/3043078831 wait complete. 2024-09-19T07:25:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.039+0000 7f780c7c4740 1 -- start start 2024-09-19T07:25:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f780c7c4740 1 Processor -- start 2024-09-19T07:25:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f780c7c4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd2af0 0x559893bdabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f780c7c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd3410 0x559893bdb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f780c7c4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bddcb0 0x559893bdb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f780c7c4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559893be0880 con 0x559893bd2af0 2024-09-19T07:25:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f780c7c4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559893ac0290 con 0x559893bddcb0 2024-09-19T07:25:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f780c7c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559893be0a00 con 0x559893bd3410 2024-09-19T07:25:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f780c7c4740 10 client.0 _ll_register_callbacks cb 0x559893af1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f7802ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd2af0 0x559893bdabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f7802ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd2af0 0x559893bdabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57966/0 (socket says 172.21.15.98:57966) 2024-09-19T07:25:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f7802ffd640 1 -- 172.21.15.98:0/2686462370 learned_addr learned my addr 172.21.15.98:0/2686462370 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f78037fe640 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bddcb0 0x559893bdb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f78027fc640 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd3410 0x559893bdb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f7802ffd640 1 -- 172.21.15.98:0/2686462370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd3410 msgr2=0x559893bdb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f7802ffd640 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd3410 0x559893bdb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.059 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f7802ffd640 1 -- 172.21.15.98:0/2686462370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bddcb0 msgr2=0x559893bdb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:53.059 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f7802ffd640 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bddcb0 0x559893bdb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.059 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f7802ffd640 1 -- 172.21.15.98:0/2686462370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989384a210 con 0x559893bd2af0 2024-09-19T07:25:53.059 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.040+0000 7f77e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:53.059 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f7802ffd640 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd2af0 0x559893bdabe0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f77f40b8bb0 tx=0x7f77f40095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c620f6a623e603d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:53.059 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f77e2ffd640 1 -- 172.21.15.98:0/2686462370 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4049070 con 0x559893bd2af0 2024-09-19T07:25:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f77e2ffd640 1 -- 172.21.15.98:0/2686462370 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f77f40c4f30 con 0x559893bd2af0 2024-09-19T07:25:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f780c7c4740 1 -- 172.21.15.98:0/2686462370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77fc023070 con 0x559893bd2af0 2024-09-19T07:25:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f77e2ffd640 1 -- 172.21.15.98:0/2686462370 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f77f40bc290 con 0x559893bd2af0 2024-09-19T07:25:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f780c7c4740 10 client.16395 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f780c7c4740 1 -- 172.21.15.98:0/2686462370 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559893916620 con 0x559893bd2af0 2024-09-19T07:25:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f77e2ffd640 1 -- 172.21.15.98:0/2686462370 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77fc023070 con 0x559893bd2af0 2024-09-19T07:25:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f77e2ffd640 1 -- 172.21.15.98:0/2686462370 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f77f40f0030 con 0x559893bd2af0 2024-09-19T07:25:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f780c7c4740 10 client.16395 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f780c7c4740 10 client.16395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:25:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f780c7c4740 20 client.16395 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f780c7c4740 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559893bedbd0 0x559893befff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f780c7c4740 4 client.16395 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:25:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f780c7c4740 1 -- 172.21.15.98:0/2686462370 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559893b44a20 con 0x559893bedbd0 2024-09-19T07:25:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.041+0000 7f78027fc640 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559893bedbd0 0x559893befff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.042+0000 7f78027fc640 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559893bedbd0 0x559893befff0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4313001a1cb5a8b server_cookie=3fe508ea2bc55820 in_seq=0 out_seq=0 2024-09-19T07:25:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.042+0000 7f77e2ffd640 10 client.16395 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.043+0000 7f77e2ffd640 1 -- 172.21.15.98:0/2686462370 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559893b44a20 con 0x559893bedbd0 2024-09-19T07:25:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.043+0000 7f77e2ffd640 10 client.16395 handle_command_reply: tid=0 2024-09-19T07:25:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.043+0000 7f780c7c4740 1 client.16395 shutdown 2024-09-19T07:25:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.043+0000 7f780c7c4740 1 -- 172.21.15.98:0/2686462370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd2af0 msgr2=0x559893bdabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.043+0000 7f780c7c4740 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd2af0 0x559893bdabe0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f77f40b8bb0 tx=0x7f77f40095d0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.063 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.043+0000 7f780c7c4740 1 -- 172.21.15.98:0/2686462370 shutdown_connections 2024-09-19T07:25:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.043+0000 7f780c7c4740 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bddcb0 0x559893bdb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.043+0000 7f780c7c4740 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd3410 0x559893bdb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.043+0000 7f780c7c4740 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559893bedbd0 0x559893befff0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.044+0000 7f780c7c4740 1 --2- 172.21.15.98:0/2686462370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd2af0 0x559893bdabe0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.044+0000 7f77e2ffd640 0 client.16395 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.044+0000 7f780c7c4740 1 -- 172.21.15.98:0/2686462370 >> 172.21.15.98:0/2686462370 conn(0x559893bcf060 msgr2=0x559893bd4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.044+0000 7f780c7c4740 1 -- 172.21.15.98:0/2686462370 shutdown_connections 2024-09-19T07:25:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.044+0000 7f780c7c4740 1 -- 172.21.15.98:0/2686462370 wait complete. 2024-09-19T07:25:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.044+0000 7f780c7c4740 20 client.16395 trim_cache size 0 max 16384 2024-09-19T07:25:53.073 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f780c7c4740 1 Processor -- start 2024-09-19T07:25:53.073 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f780c7c4740 1 -- start start 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f780c7c4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bd2af0 0x559893bdb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f780c7c4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 0x559893bf58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f780c7c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bddcb0 0x559893bf5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f780c7c4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78041b0170 con 0x559893bd3410 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f780c7c4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78041ad980 con 0x559893bd2af0 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f780c7c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f78041ab7d0 con 0x559893bddcb0 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f78027fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 0x559893bf58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f78027fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 0x559893bf58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57980/0 (socket says 172.21.15.98:57980) 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f78027fc640 1 -- 172.21.15.98:0/3322754490 learned_addr learned my addr 172.21.15.98:0/3322754490 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f78037fe640 1 --2- 172.21.15.98:0/3322754490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bddcb0 0x559893bf5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f7802ffd640 1 --2- 172.21.15.98:0/3322754490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bd2af0 0x559893bdb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f78027fc640 1 -- 172.21.15.98:0/3322754490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bddcb0 msgr2=0x559893bf5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f78027fc640 1 --2- 172.21.15.98:0/3322754490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bddcb0 0x559893bf5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f78027fc640 1 -- 172.21.15.98:0/3322754490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bd2af0 msgr2=0x559893bdb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f78027fc640 1 --2- 172.21.15.98:0/3322754490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bd2af0 0x559893bdb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f78027fc640 1 -- 172.21.15.98:0/3322754490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559893be0760 con 0x559893bd3410 2024-09-19T07:25:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.059+0000 7f78027fc640 1 --2- 172.21.15.98:0/3322754490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 0x559893bf58e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f77f800bc70 tx=0x7f77f800b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766c0bfb855ff19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.060+0000 7f77e97fa640 1 -- 172.21.15.98:0/3322754490 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8005250 con 0x559893bd3410 2024-09-19T07:25:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.060+0000 7f77e97fa640 1 -- 172.21.15.98:0/3322754490 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77f80053f0 con 0x559893bd3410 2024-09-19T07:25:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.060+0000 7f77e97fa640 1 -- 172.21.15.98:0/3322754490 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f801a980 con 0x559893bd3410 2024-09-19T07:25:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.060+0000 7f780c7c4740 1 -- 172.21.15.98:0/3322754490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 msgr2=0x559893bf58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.060+0000 7f780c7c4740 1 --2- 172.21.15.98:0/3322754490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 0x559893bf58e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f77f800bc70 tx=0x7f77f800b3a0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.060+0000 7f780c7c4740 1 -- 172.21.15.98:0/3322754490 shutdown_connections 2024-09-19T07:25:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.060+0000 7f780c7c4740 1 --2- 172.21.15.98:0/3322754490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bddcb0 0x559893bf5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.060+0000 7f780c7c4740 1 --2- 172.21.15.98:0/3322754490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 0x559893bf58e0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.060+0000 7f780c7c4740 1 --2- 172.21.15.98:0/3322754490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bd2af0 0x559893bdb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.060+0000 7f780c7c4740 1 -- 172.21.15.98:0/3322754490 >> 172.21.15.98:0/3322754490 conn(0x559893bcf060 msgr2=0x559893bdcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.060+0000 7f780c7c4740 1 -- 172.21.15.98:0/3322754490 shutdown_connections 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.060+0000 7f780c7c4740 1 -- 172.21.15.98:0/3322754490 wait complete. 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f780c7c4740 1 -- start start 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f780c7c4740 1 Processor -- start 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f780c7c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd2af0 0x559893bd7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f780c7c4740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 0x559893bd80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f780c7c4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bddcb0 0x559893bd8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f780c7c4740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78041abe40 con 0x559893bd3410 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f780c7c4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78041ad2b0 con 0x559893bddcb0 2024-09-19T07:25:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f780c7c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f78041ac510 con 0x559893bd2af0 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f780c7c4740 10 client.0 _ll_register_callbacks cb 0x7f77f4005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f78027fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 0x559893bd80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f78027fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 0x559893bd80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:57992/0 (socket says 172.21.15.98:57992) 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f78027fc640 1 -- 172.21.15.98:0/1951007983 learned_addr learned my addr 172.21.15.98:0/1951007983 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f78037fe640 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bddcb0 0x559893bd8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f7802ffd640 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd2af0 0x559893bd7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f78027fc640 1 -- 172.21.15.98:0/1951007983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd2af0 msgr2=0x559893bd7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f78027fc640 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd2af0 0x559893bd7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f78027fc640 1 -- 172.21.15.98:0/1951007983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bddcb0 msgr2=0x559893bd8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f78027fc640 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bddcb0 0x559893bd8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.061+0000 7f78027fc640 1 -- 172.21.15.98:0/1951007983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559893c578b0 con 0x559893bd3410 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f78027fc640 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 0x559893bd80e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f77f800bee0 tx=0x7f77f800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e88f59cc948b422 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:25:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f77e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:25:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f77e2ffd640 1 -- 172.21.15.98:0/1951007983 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8032060 con 0x559893bd3410 2024-09-19T07:25:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f77e2ffd640 1 -- 172.21.15.98:0/1951007983 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f77f8005050 con 0x559893bd3410 2024-09-19T07:25:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f780c7c4740 1 -- 172.21.15.98:0/1951007983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77f80053f0 con 0x559893bd3410 2024-09-19T07:25:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f77e2ffd640 1 -- 172.21.15.98:0/1951007983 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f77f8005250 con 0x559893bd3410 2024-09-19T07:25:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f780c7c4740 10 client.16401 fetch_fsmap learned FSMap version 30 2024-09-19T07:25:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f780c7c4740 1 -- 172.21.15.98:0/1951007983 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559893c58ba0 con 0x559893bd3410 2024-09-19T07:25:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f77e2ffd640 1 -- 172.21.15.98:0/1951007983 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77f80053f0 con 0x559893bd3410 2024-09-19T07:25:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f77e2ffd640 1 -- 172.21.15.98:0/1951007983 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f77f802c030 con 0x559893bd3410 2024-09-19T07:25:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f780c7c4740 10 client.16401 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:25:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f780c7c4740 10 client.16401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:25:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f780c7c4740 20 client.16401 populate_metadata read hostname 'smithi098' 2024-09-19T07:25:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f780c7c4740 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559893c592a0 0x559893c5b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:25:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f780c7c4740 4 client.16401 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:25:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f780c7c4740 1 -- 172.21.15.98:0/1951007983 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559893b3ed70 con 0x559893c592a0 2024-09-19T07:25:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.062+0000 7f7802ffd640 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559893c592a0 0x559893c5b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:25:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.063+0000 7f77e2ffd640 10 client.16401 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.063+0000 7f7802ffd640 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559893c592a0 0x559893c5b6c0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32243a0e882eea6c server_cookie=418710d58ea96807 in_seq=0 out_seq=0 2024-09-19T07:25:53.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:52 smithi098 ceph-mon[30950]: pgmap v117: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 558 KiB/s wr, 52 op/s 2024-09-19T07:25:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f77e2ffd640 1 -- 172.21.15.98:0/1951007983 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559893b3ed70 con 0x559893c592a0 2024-09-19T07:25:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f77e2ffd640 10 client.16401 handle_command_reply: tid=0 2024-09-19T07:25:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f780c7c4740 1 client.16401 shutdown 2024-09-19T07:25:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f780c7c4740 1 -- 172.21.15.98:0/1951007983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 msgr2=0x559893bd80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:53.297 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f780c7c4740 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 0x559893bd80e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f77f800bee0 tx=0x7f77f800bf10 comp rx=0 tx=0).stop 2024-09-19T07:25:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f780c7c4740 1 -- 172.21.15.98:0/1951007983 shutdown_connections 2024-09-19T07:25:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f780c7c4740 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559893bddcb0 0x559893bd8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f780c7c4740 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559893c592a0 0x559893c5b6c0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f780c7c4740 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559893bd3410 0x559893bd80e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f780c7c4740 1 --2- 172.21.15.98:0/1951007983 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559893bd2af0 0x559893bd7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f77e2ffd640 0 client.16401 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:25:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f780c7c4740 1 -- 172.21.15.98:0/1951007983 >> 172.21.15.98:0/1951007983 conn(0x559893bcf060 msgr2=0x559893bd4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:53.298 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f780c7c4740 1 -- 172.21.15.98:0/1951007983 shutdown_connections 2024-09-19T07:25:53.299 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f780c7c4740 1 -- 172.21.15.98:0/1951007983 wait complete. 2024-09-19T07:25:53.299 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.295+0000 7f780c7c4740 20 client.16401 trim_cache size 0 max 16384 2024-09-19T07:25:53.299 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:25:53.299 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:25:53.299 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:25:53.299 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:25:53.300 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.296+0000 7f780994b640 1 -- 172.21.15.98:0/1742091963 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f77ec0a3460 msgr2=0x7f77ec0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:53.300 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.296+0000 7f780994b640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f77ec0a3460 0x7f77ec0a5920 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0127e0 tx=0x7f77fc012be0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.300 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.296+0000 7f780994b640 1 -- 172.21.15.98:0/1742091963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7804102c80 msgr2=0x7f78041983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:25:53.300 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.296+0000 7f780994b640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7804102c80 0x7f78041983e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f77f4006010 tx=0x7f77f40042f0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.296+0000 7f780994b640 1 -- 172.21.15.98:0/1742091963 shutdown_connections 2024-09-19T07:25:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.296+0000 7f780994b640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f77ec0a3460 0x7f77ec0a5920 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.296+0000 7f780994b640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f780410c0d0 0x7f780419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.296+0000 7f780994b640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78041035a0 0x7f7804198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.296+0000 7f780994b640 1 --2- 172.21.15.98:0/1742091963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7804102c80 0x7f78041983e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:25:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.296+0000 7f780994b640 1 -- 172.21.15.98:0/1742091963 >> 172.21.15.98:0/1742091963 conn(0x7f7804077990 msgr2=0x7f78040fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:25:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.296+0000 7f780994b640 1 -- 172.21.15.98:0/1742091963 shutdown_connections 2024-09-19T07:25:53.301 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:25:53.296+0000 7f780994b640 1 -- 172.21.15.98:0/1742091963 wait complete. 2024-09-19T07:25:53.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:52 smithi139 ceph-mon[35039]: pgmap v117: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 558 KiB/s wr, 52 op/s 2024-09-19T07:25:53.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:52 smithi162 ceph-mon[35726]: pgmap v117: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 558 KiB/s wr, 52 op/s 2024-09-19T07:25:55.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:54 smithi098 ceph-mon[30950]: pgmap v118: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 558 KiB/s wr, 52 op/s 2024-09-19T07:25:55.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:54 smithi139 ceph-mon[35039]: pgmap v118: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 558 KiB/s wr, 52 op/s 2024-09-19T07:25:55.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:54 smithi162 ceph-mon[35726]: pgmap v118: 97 pgs: 97 active+clean; 2.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 558 KiB/s wr, 52 op/s 2024-09-19T07:25:57.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:56 smithi098 ceph-mon[30950]: pgmap v119: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 270 op/s 2024-09-19T07:25:57.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:56 smithi139 ceph-mon[35039]: pgmap v119: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 270 op/s 2024-09-19T07:25:57.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:56 smithi162 ceph-mon[35726]: pgmap v119: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.5 MiB/s wr, 270 op/s 2024-09-19T07:25:59.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:25:58 smithi098 ceph-mon[30950]: pgmap v120: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 230 op/s 2024-09-19T07:25:59.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:25:58 smithi139 ceph-mon[35039]: pgmap v120: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 230 op/s 2024-09-19T07:25:59.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:25:58 smithi162 ceph-mon[35726]: pgmap v120: 97 pgs: 97 active+clean; 2.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 230 op/s 2024-09-19T07:26:01.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:00 smithi098 ceph-mon[30950]: pgmap v121: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 345 op/s 2024-09-19T07:26:01.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:00 smithi139 ceph-mon[35039]: pgmap v121: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 345 op/s 2024-09-19T07:26:01.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:00 smithi162 ceph-mon[35726]: pgmap v121: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 345 op/s 2024-09-19T07:26:02.201 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T07:26:02.201 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T07:26:03.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:02 smithi098 ceph-mon[30950]: pgmap v122: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.6 MiB/s wr, 340 op/s 2024-09-19T07:26:03.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:02 smithi139 ceph-mon[35039]: pgmap v122: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.6 MiB/s wr, 340 op/s 2024-09-19T07:26:03.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:02 smithi162 ceph-mon[35726]: pgmap v122: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.6 MiB/s wr, 340 op/s 2024-09-19T07:26:05.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:04 smithi098 ceph-mon[30950]: pgmap v123: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.6 MiB/s wr, 340 op/s 2024-09-19T07:26:05.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:04 smithi139 ceph-mon[35039]: pgmap v123: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.6 MiB/s wr, 340 op/s 2024-09-19T07:26:05.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:04 smithi162 ceph-mon[35726]: pgmap v123: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.6 MiB/s wr, 340 op/s 2024-09-19T07:26:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.386+0000 7fb920bf8640 1 -- 172.21.15.98:0/4247443498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb91c1009b0 msgr2=0x7fb91c100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.386+0000 7fb920bf8640 1 --2- 172.21.15.98:0/4247443498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb91c1009b0 0x7fb91c100e10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb910009930 tx=0x7fb91002a420 comp rx=0 tx=0).stop 2024-09-19T07:26:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.386+0000 7fb920bf8640 1 -- 172.21.15.98:0/4247443498 shutdown_connections 2024-09-19T07:26:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.386+0000 7fb920bf8640 1 --2- 172.21.15.98:0/4247443498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb91c101350 0x7fb91c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.386+0000 7fb920bf8640 1 --2- 172.21.15.98:0/4247443498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb91c1009b0 0x7fb91c100e10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.389 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.386+0000 7fb920bf8640 1 --2- 172.21.15.98:0/4247443498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb91c1069c0 0x7fb91c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.386+0000 7fb920bf8640 1 -- 172.21.15.98:0/4247443498 >> 172.21.15.98:0/4247443498 conn(0x7fb91c077990 msgr2=0x7fb91c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.386+0000 7fb920bf8640 1 -- 172.21.15.98:0/4247443498 shutdown_connections 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.386+0000 7fb920bf8640 1 -- 172.21.15.98:0/4247443498 wait complete. 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.387+0000 7fb920bf8640 1 Processor -- start 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.387+0000 7fb920bf8640 1 -- start start 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.387+0000 7fb920bf8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb91c1009b0 0x7fb91c0fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.387+0000 7fb920bf8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb91c101350 0x7fb91c0fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.387+0000 7fb920bf8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb91c1069c0 0x7fb91c0fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.387+0000 7fb920bf8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c110e00 con 0x7fb91c1069c0 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.387+0000 7fb920bf8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c110c80 con 0x7fb91c101350 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.387+0000 7fb920bf8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c110f80 con 0x7fb91c1009b0 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb91a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb91c1009b0 0x7fb91c0fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.390 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb91ad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb91c1069c0 0x7fb91c0fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb919d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb91c101350 0x7fb91c0fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb91a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb91c1009b0 0x7fb91c0fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:34986/0 (socket says 172.21.15.98:34986) 2024-09-19T07:26:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb919d9b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb91c101350 0x7fb91c0fd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:56178/0 (socket says 172.21.15.98:56178) 2024-09-19T07:26:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb91a59c640 1 -- 172.21.15.98:0/3220861324 learned_addr learned my addr 172.21.15.98:0/3220861324 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb91ad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb91c1069c0 0x7fb91c0fd860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51008/0 (socket says 172.21.15.98:51008) 2024-09-19T07:26:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb919d9b640 1 -- 172.21.15.98:0/3220861324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb91c1009b0 msgr2=0x7fb91c0fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb919d9b640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb91c1009b0 0x7fb91c0fcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb919d9b640 1 -- 172.21.15.98:0/3220861324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb91c1069c0 msgr2=0x7fb91c0fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb919d9b640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb91c1069c0 0x7fb91c0fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb919d9b640 1 -- 172.21.15.98:0/3220861324 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91c1a6880 con 0x7fb91c101350 2024-09-19T07:26:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb91a59c640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb91c1009b0 0x7fb91c0fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:26:06.391 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb91ad9d640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb91c1069c0 0x7fb91c0fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:26:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb919d9b640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb91c101350 0x7fb91c0fd320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb910005940 tx=0x7fb9100040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb90b7fe640 1 -- 172.21.15.98:0/3220861324 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91003f070 con 0x7fb91c101350 2024-09-19T07:26:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb920bf8640 1 -- 172.21.15.98:0/3220861324 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91c1a6b10 con 0x7fb91c101350 2024-09-19T07:26:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb90b7fe640 1 -- 172.21.15.98:0/3220861324 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9100044c0 con 0x7fb91c101350 2024-09-19T07:26:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb90b7fe640 1 -- 172.21.15.98:0/3220861324 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910035070 con 0x7fb91c101350 2024-09-19T07:26:06.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.388+0000 7fb920bf8640 1 -- 172.21.15.98:0/3220861324 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb91c1a7050 con 0x7fb91c101350 2024-09-19T07:26:06.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb923a66740 1 Processor -- start 2024-09-19T07:26:06.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb923a66740 1 -- start start 2024-09-19T07:26:06.398 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb90b7fe640 1 -- 172.21.15.98:0/3220861324 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb91003b460 con 0x7fb91c101350 2024-09-19T07:26:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb923a66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b27af0 0x55b726b27ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb923a66740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b28410 0x55b726b32770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb923a66740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b350a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb923a66740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b726a8c2f0 con 0x55b726b28410 2024-09-19T07:26:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb923a66740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b726a34270 con 0x55b726b32cb0 2024-09-19T07:26:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb923a66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b726a882b0 con 0x55b726b27af0 2024-09-19T07:26:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb91a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b28410 0x55b726b32770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb91ad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b27af0 0x55b726b27ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb91ad9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b27af0 0x55b726b27ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:34988/0 (socket says 172.21.15.98:34988) 2024-09-19T07:26:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb91a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b28410 0x55b726b32770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51018/0 (socket says 172.21.15.98:51018) 2024-09-19T07:26:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb91ad9d640 1 -- 172.21.15.98:0/2300838550 learned_addr learned my addr 172.21.15.98:0/2300838550 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:06.399 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb919d9b640 1 --2- 172.21.15.98:0/2300838550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b350a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb91a59c640 1 -- 172.21.15.98:0/2300838550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b27af0 msgr2=0x55b726b27ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.391+0000 7fb91a59c640 1 --2- 172.21.15.98:0/2300838550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b27af0 0x55b726b27ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.392+0000 7fb91a59c640 1 -- 172.21.15.98:0/2300838550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 msgr2=0x55b726b350a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.392+0000 7fb91a59c640 1 --2- 172.21.15.98:0/2300838550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b350a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.392+0000 7fb91a59c640 1 -- 172.21.15.98:0/2300838550 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b726a33340 con 0x55b726b28410 2024-09-19T07:26:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.392+0000 7fb90b7fe640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb9040a3460 0x7fb9040a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.392+0000 7fb91a59c640 1 --2- 172.21.15.98:0/2300838550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b28410 0x55b726b32770 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb90c010480 tx=0x7fb90c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff63c0a9de70873e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.392+0000 7fb91ad9d640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb9040a3460 0x7fb9040a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.392+0000 7fb90b7fe640 1 -- 172.21.15.98:0/3220861324 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb9100f0160 con 0x7fb91c101350 2024-09-19T07:26:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.392+0000 7fb908ff9640 1 -- 172.21.15.98:0/2300838550 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c011820 con 0x55b726b28410 2024-09-19T07:26:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.392+0000 7fb908ff9640 1 -- 172.21.15.98:0/2300838550 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb90c01a380 con 0x55b726b28410 2024-09-19T07:26:06.400 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.392+0000 7fb908ff9640 1 -- 172.21.15.98:0/2300838550 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c01b640 con 0x55b726b28410 2024-09-19T07:26:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 -- 172.21.15.98:0/2300838550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b28410 msgr2=0x55b726b32770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb91ad9d640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb9040a3460 0x7fb9040a5920 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb914009fd0 tx=0x7fb914009500 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 --2- 172.21.15.98:0/2300838550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b28410 0x55b726b32770 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb90c010480 tx=0x7fb90c00bf90 comp rx=0 tx=0).stop 2024-09-19T07:26:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 -- 172.21.15.98:0/2300838550 shutdown_connections 2024-09-19T07:26:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 --2- 172.21.15.98:0/2300838550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b350a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 --2- 172.21.15.98:0/2300838550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b28410 0x55b726b32770 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 --2- 172.21.15.98:0/2300838550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b27af0 0x55b726b27ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 -- 172.21.15.98:0/2300838550 >> 172.21.15.98:0/2300838550 conn(0x55b726b24060 msgr2=0x55b726b24440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 -- 172.21.15.98:0/2300838550 shutdown_connections 2024-09-19T07:26:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 -- 172.21.15.98:0/2300838550 wait complete. 2024-09-19T07:26:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 -- start start 2024-09-19T07:26:06.401 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 Processor -- start 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 0x55b726b2fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b28410 0x55b726b300d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b30610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b726b35880 con 0x55b726b27af0 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b726a15290 con 0x55b726b32cb0 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b726b35a00 con 0x55b726b28410 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb923a66740 10 client.0 _ll_register_callbacks cb 0x55b726a46140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb91a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 0x55b726b2fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb91a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 0x55b726b2fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51022/0 (socket says 172.21.15.98:51022) 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.393+0000 7fb91a59c640 1 -- 172.21.15.98:0/1341505336 learned_addr learned my addr 172.21.15.98:0/1341505336 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb919d9b640 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b28410 0x55b726b300d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb91ad9d640 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b30610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.402 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb919d9b640 1 -- 172.21.15.98:0/1341505336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 msgr2=0x55b726b30610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb919d9b640 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b30610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb919d9b640 1 -- 172.21.15.98:0/1341505336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 msgr2=0x55b726b2fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb919d9b640 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 0x55b726b2fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb919d9b640 1 -- 172.21.15.98:0/1341505336 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72679f210 con 0x55b726b28410 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb91a59c640 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 0x55b726b2fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb919d9b640 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b28410 0x55b726b300d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9100ed880 tx=0x7fb910009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=467aeade45b8cd10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb901ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb901ffb640 1 -- 172.21.15.98:0/1341505336 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910048070 con 0x55b726b28410 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb901ffb640 1 -- 172.21.15.98:0/1341505336 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb910031bd0 con 0x55b726b28410 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb923a66740 1 -- 172.21.15.98:0/1341505336 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb90c01a380 con 0x55b726b28410 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb901ffb640 1 -- 172.21.15.98:0/1341505336 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb9100bc290 con 0x55b726b28410 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb923a66740 10 client.25642 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:06.403 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb923a66740 1 -- 172.21.15.98:0/1341505336 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b72686b620 con 0x55b726b28410 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.394+0000 7fb901ffb640 1 -- 172.21.15.98:0/1341505336 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb90c01a380 con 0x55b726b28410 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.395+0000 7fb901ffb640 1 -- 172.21.15.98:0/1341505336 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb91004b060 con 0x55b726b28410 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.395+0000 7fb923a66740 10 client.25642 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.395+0000 7fb923a66740 10 client.25642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.395+0000 7fb923a66740 20 client.25642 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.395+0000 7fb923a66740 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b726b42c40 0x55b726b45100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.395+0000 7fb923a66740 4 client.25642 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.395+0000 7fb923a66740 1 -- 172.21.15.98:0/1341505336 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b726a99a20 con 0x55b726b42c40 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.395+0000 7fb91a59c640 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b726b42c40 0x55b726b45100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.395+0000 7fb91a59c640 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b726b42c40 0x55b726b45100 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=260c7b73e2c87436 server_cookie=965de4df8344ece3 in_seq=0 out_seq=0 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.395+0000 7fb901ffb640 10 client.25642 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb901ffb640 1 -- 172.21.15.98:0/1341505336 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b726a99a20 con 0x55b726b42c40 2024-09-19T07:26:06.404 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb901ffb640 10 client.25642 handle_command_reply: tid=0 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb923a66740 1 client.25642 shutdown 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb923a66740 1 -- 172.21.15.98:0/1341505336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b28410 msgr2=0x55b726b300d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb923a66740 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b28410 0x55b726b300d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9100ed880 tx=0x7fb910009620 comp rx=0 tx=0).stop 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb923a66740 1 -- 172.21.15.98:0/1341505336 shutdown_connections 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb923a66740 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b30610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb923a66740 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b28410 0x55b726b300d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb923a66740 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b726b42c40 0x55b726b45100 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb923a66740 1 --2- 172.21.15.98:0/1341505336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 0x55b726b2fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb923a66740 1 -- 172.21.15.98:0/1341505336 >> 172.21.15.98:0/1341505336 conn(0x55b726b24060 msgr2=0x55b726b29d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb901ffb640 0 client.25642 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb923a66740 1 -- 172.21.15.98:0/1341505336 shutdown_connections 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb923a66740 1 -- 172.21.15.98:0/1341505336 wait complete. 2024-09-19T07:26:06.405 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.398+0000 7fb923a66740 20 client.25642 trim_cache size 0 max 16384 2024-09-19T07:26:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.412+0000 7fb923a66740 1 Processor -- start 2024-09-19T07:26:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.412+0000 7fb923a66740 1 -- start start 2024-09-19T07:26:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb923a66740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 0x55b726b30440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb923a66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b28410 0x55b726b31b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb923a66740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b4a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb923a66740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c1b2390 con 0x55b726b27af0 2024-09-19T07:26:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb923a66740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c1afba0 con 0x55b726b32cb0 2024-09-19T07:26:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb923a66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c1ad9f0 con 0x55b726b28410 2024-09-19T07:26:06.417 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb91a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 0x55b726b30440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb91a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 0x55b726b30440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51038/0 (socket says 172.21.15.98:51038) 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb91a59c640 1 -- 172.21.15.98:0/2412538254 learned_addr learned my addr 172.21.15.98:0/2412538254 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb91ad9d640 1 --2- 172.21.15.98:0/2412538254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b4a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb91a59c640 1 -- 172.21.15.98:0/2412538254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b28410 msgr2=0x55b726b31b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb91a59c640 1 --2- 172.21.15.98:0/2412538254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b28410 0x55b726b31b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb91a59c640 1 -- 172.21.15.98:0/2412538254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 msgr2=0x55b726b4a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb91a59c640 1 --2- 172.21.15.98:0/2412538254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b4a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb91a59c640 1 -- 172.21.15.98:0/2412538254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b726b28240 con 0x55b726b27af0 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb91ad9d640 1 --2- 172.21.15.98:0/2412538254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b4a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb91a59c640 1 --2- 172.21.15.98:0/2412538254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 0x55b726b30440 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb90c010480 tx=0x7fb90c00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f16c9fc261598a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb903fff640 1 -- 172.21.15.98:0/2412538254 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c0053d0 con 0x55b726b27af0 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb903fff640 1 -- 172.21.15.98:0/2412538254 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb90c005570 con 0x55b726b27af0 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.413+0000 7fb903fff640 1 -- 172.21.15.98:0/2412538254 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c004990 con 0x55b726b27af0 2024-09-19T07:26:06.418 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 -- 172.21.15.98:0/2412538254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 msgr2=0x55b726b30440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 --2- 172.21.15.98:0/2412538254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 0x55b726b30440 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb90c010480 tx=0x7fb90c00b410 comp rx=0 tx=0).stop 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 -- 172.21.15.98:0/2412538254 shutdown_connections 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 --2- 172.21.15.98:0/2412538254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b32cb0 0x55b726b4a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 --2- 172.21.15.98:0/2412538254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b28410 0x55b726b31b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 --2- 172.21.15.98:0/2412538254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b27af0 0x55b726b30440 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 -- 172.21.15.98:0/2412538254 >> 172.21.15.98:0/2412538254 conn(0x55b726b24060 msgr2=0x55b726b313f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 -- 172.21.15.98:0/2412538254 shutdown_connections 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 -- 172.21.15.98:0/2412538254 wait complete. 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 -- start start 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 Processor -- start 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b27af0 0x55b726b3b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b28410 0x55b726b36440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b32cb0 0x55b726b36980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.419 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c1ae060 con 0x55b726b32cb0 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c1af4d0 con 0x55b726b28410 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb91c1ae730 con 0x55b726b27af0 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.414+0000 7fb923a66740 10 client.0 _ll_register_callbacks cb 0x7fb910005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb91ad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b32cb0 0x55b726b36980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb91a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b27af0 0x55b726b3b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb91ad9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b32cb0 0x55b726b36980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51040/0 (socket says 172.21.15.98:51040) 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb91a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b27af0 0x55b726b3b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:35004/0 (socket says 172.21.15.98:35004) 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb91ad9d640 1 -- 172.21.15.98:0/1195133081 learned_addr learned my addr 172.21.15.98:0/1195133081 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb919d9b640 1 --2- 172.21.15.98:0/1195133081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b28410 0x55b726b36440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb91ad9d640 1 -- 172.21.15.98:0/1195133081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b27af0 msgr2=0x55b726b3b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb91ad9d640 1 --2- 172.21.15.98:0/1195133081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b27af0 0x55b726b3b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb91ad9d640 1 -- 172.21.15.98:0/1195133081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b28410 msgr2=0x55b726b36440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:06.420 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb91ad9d640 1 --2- 172.21.15.98:0/1195133081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b28410 0x55b726b36440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb91ad9d640 1 -- 172.21.15.98:0/1195133081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b726b36ec0 con 0x55b726b32cb0 2024-09-19T07:26:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb91ad9d640 1 --2- 172.21.15.98:0/1195133081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b32cb0 0x55b726b36980 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb914011d20 tx=0x7fb914004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf920979be70c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb901ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:26:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb901ffb640 1 -- 172.21.15.98:0/1195133081 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91402e060 con 0x55b726b32cb0 2024-09-19T07:26:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb901ffb640 1 -- 172.21.15.98:0/1195133081 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb91401caa0 con 0x55b726b32cb0 2024-09-19T07:26:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb923a66740 1 -- 172.21.15.98:0/1195133081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb90c005570 con 0x55b726b32cb0 2024-09-19T07:26:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb901ffb640 1 -- 172.21.15.98:0/1195133081 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb91401cca0 con 0x55b726b32cb0 2024-09-19T07:26:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb923a66740 10 client.16419 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb923a66740 1 -- 172.21.15.98:0/1195133081 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b726bad670 con 0x55b726b32cb0 2024-09-19T07:26:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.415+0000 7fb901ffb640 1 -- 172.21.15.98:0/1195133081 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb90c005570 con 0x55b726b32cb0 2024-09-19T07:26:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.416+0000 7fb901ffb640 1 -- 172.21.15.98:0/1195133081 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb914028460 con 0x55b726b32cb0 2024-09-19T07:26:06.421 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.416+0000 7fb923a66740 10 client.16419 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.416+0000 7fb923a66740 10 client.16419 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:26:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.416+0000 7fb923a66740 20 client.16419 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.416+0000 7fb923a66740 1 --2- 172.21.15.98:0/1195133081 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b726bade70 0x55b726bb0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.416+0000 7fb923a66740 4 client.16419 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:26:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.416+0000 7fb923a66740 1 -- 172.21.15.98:0/1195133081 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b726a93d70 con 0x55b726bade70 2024-09-19T07:26:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.416+0000 7fb91a59c640 1 --2- 172.21.15.98:0/1195133081 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b726bade70 0x55b726bb0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.416+0000 7fb901ffb640 10 client.16419 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:06.422 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.416+0000 7fb91a59c640 1 --2- 172.21.15.98:0/1195133081 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b726bade70 0x55b726bb0290 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad186614054c7c86 server_cookie=fb42b958c625f298 in_seq=0 out_seq=0 2024-09-19T07:26:06.727 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.726+0000 7fb901ffb640 1 -- 172.21.15.98:0/1195133081 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b726a93d70 con 0x55b726bade70 2024-09-19T07:26:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.726+0000 7fb901ffb640 10 client.16419 handle_command_reply: tid=0 2024-09-19T07:26:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.726+0000 7fb923a66740 1 client.16419 shutdown 2024-09-19T07:26:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.726+0000 7fb923a66740 1 -- 172.21.15.98:0/1195133081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b32cb0 msgr2=0x55b726b36980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.726+0000 7fb923a66740 1 --2- 172.21.15.98:0/1195133081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b32cb0 0x55b726b36980 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb914011d20 tx=0x7fb914004a40 comp rx=0 tx=0).stop 2024-09-19T07:26:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.726+0000 7fb923a66740 1 -- 172.21.15.98:0/1195133081 shutdown_connections 2024-09-19T07:26:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.726+0000 7fb923a66740 1 --2- 172.21.15.98:0/1195133081 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55b726bade70 0x55b726bb0290 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.726+0000 7fb923a66740 1 --2- 172.21.15.98:0/1195133081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b726b32cb0 0x55b726b36980 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.726+0000 7fb901ffb640 0 client.16419 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.726+0000 7fb923a66740 1 --2- 172.21.15.98:0/1195133081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b726b28410 0x55b726b36440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.726+0000 7fb923a66740 1 --2- 172.21.15.98:0/1195133081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b726b27af0 0x55b726b3b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb923a66740 1 -- 172.21.15.98:0/1195133081 >> 172.21.15.98:0/1195133081 conn(0x55b726b24060 msgr2=0x55b726b231c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb923a66740 1 -- 172.21.15.98:0/1195133081 shutdown_connections 2024-09-19T07:26:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb923a66740 1 -- 172.21.15.98:0/1195133081 wait complete. 2024-09-19T07:26:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb923a66740 20 client.16419 trim_cache size 0 max 16384 2024-09-19T07:26:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:26:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:26:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:26:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:26:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb920bf8640 1 -- 172.21.15.98:0/3220861324 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb9040a3460 msgr2=0x7fb9040a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb920bf8640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb9040a3460 0x7fb9040a5920 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb914009fd0 tx=0x7fb914009500 comp rx=0 tx=0).stop 2024-09-19T07:26:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb920bf8640 1 -- 172.21.15.98:0/3220861324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb91c101350 msgr2=0x7fb91c0fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb920bf8640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb91c101350 0x7fb91c0fd320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb910005940 tx=0x7fb9100040c0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb920bf8640 1 -- 172.21.15.98:0/3220861324 shutdown_connections 2024-09-19T07:26:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb920bf8640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb9040a3460 0x7fb9040a5920 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb920bf8640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb91c1069c0 0x7fb91c0fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb920bf8640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb91c101350 0x7fb91c0fd320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.727+0000 7fb920bf8640 1 --2- 172.21.15.98:0/3220861324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb91c1009b0 0x7fb91c0fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.728+0000 7fb920bf8640 1 -- 172.21.15.98:0/3220861324 >> 172.21.15.98:0/3220861324 conn(0x7fb91c077990 msgr2=0x7fb91c0699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.728+0000 7fb920bf8640 1 -- 172.21.15.98:0/3220861324 shutdown_connections 2024-09-19T07:26:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:06.728+0000 7fb920bf8640 1 -- 172.21.15.98:0/3220861324 wait complete. 2024-09-19T07:26:07.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:06 smithi098 ceph-mon[30950]: pgmap v124: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.4 MiB/s wr, 473 op/s 2024-09-19T07:26:07.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:06 smithi139 ceph-mon[35039]: pgmap v124: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.4 MiB/s wr, 473 op/s 2024-09-19T07:26:07.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:06 smithi162 ceph-mon[35726]: pgmap v124: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.4 MiB/s wr, 473 op/s 2024-09-19T07:26:09.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:08 smithi098 ceph-mon[30950]: pgmap v125: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 255 op/s 2024-09-19T07:26:09.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:08 smithi139 ceph-mon[35039]: pgmap v125: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 255 op/s 2024-09-19T07:26:09.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:08 smithi162 ceph-mon[35726]: pgmap v125: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 255 op/s 2024-09-19T07:26:11.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:10 smithi098 ceph-mon[30950]: pgmap v126: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 619 op/s 2024-09-19T07:26:11.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:10 smithi139 ceph-mon[35039]: pgmap v126: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 619 op/s 2024-09-19T07:26:11.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:10 smithi162 ceph-mon[35726]: pgmap v126: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 619 op/s 2024-09-19T07:26:13.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:12 smithi098 ceph-mon[30950]: pgmap v127: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 543 op/s 2024-09-19T07:26:13.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:12 smithi139 ceph-mon[35039]: pgmap v127: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 543 op/s 2024-09-19T07:26:13.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:12 smithi162 ceph-mon[35726]: pgmap v127: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 543 op/s 2024-09-19T07:26:15.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:14 smithi098 ceph-mon[30950]: pgmap v128: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 535 op/s 2024-09-19T07:26:15.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:14 smithi139 ceph-mon[35039]: pgmap v128: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 535 op/s 2024-09-19T07:26:15.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:14 smithi162 ceph-mon[35726]: pgmap v128: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 535 op/s 2024-09-19T07:26:16.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:15 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:26:16.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:15 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:26:16.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:15 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:26:17.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:16 smithi098 ceph-mon[30950]: pgmap v129: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 691 op/s 2024-09-19T07:26:17.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:16 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:26:17.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:16 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:26:17.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:16 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:26:17.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:16 smithi139 ceph-mon[35039]: pgmap v129: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 691 op/s 2024-09-19T07:26:17.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:16 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:26:17.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:16 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:26:17.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:16 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:26:17.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:16 smithi162 ceph-mon[35726]: pgmap v129: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 691 op/s 2024-09-19T07:26:17.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:16 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:26:17.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:16 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:26:17.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:16 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:26:19.184 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:18 smithi162 ceph-mon[35726]: pgmap v130: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 558 op/s 2024-09-19T07:26:19.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:18 smithi098 ceph-mon[30950]: pgmap v130: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 558 op/s 2024-09-19T07:26:19.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:18 smithi139 ceph-mon[35039]: pgmap v130: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 558 op/s 2024-09-19T07:26:19.823 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.818+0000 7fb9636c9640 1 -- 172.21.15.98:0/3906807971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c107b80 msgr2=0x7fb95c107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:19.823 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.818+0000 7fb9636c9640 1 --2- 172.21.15.98:0/3906807971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c107b80 0x7fb95c107f60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb958009930 tx=0x7fb95802a420 comp rx=0 tx=0).stop 2024-09-19T07:26:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.818+0000 7fb9636c9640 1 -- 172.21.15.98:0/3906807971 shutdown_connections 2024-09-19T07:26:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.818+0000 7fb9636c9640 1 --2- 172.21.15.98:0/3906807971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c102480 0x7fb95c10e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.818+0000 7fb9636c9640 1 --2- 172.21.15.98:0/3906807971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c101ae0 0x7fb95c101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.818+0000 7fb9636c9640 1 --2- 172.21.15.98:0/3906807971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c107b80 0x7fb95c107f60 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.818+0000 7fb9636c9640 1 -- 172.21.15.98:0/3906807971 >> 172.21.15.98:0/3906807971 conn(0x7fb95c0fd7e0 msgr2=0x7fb95c0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.818+0000 7fb9636c9640 1 -- 172.21.15.98:0/3906807971 shutdown_connections 2024-09-19T07:26:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.818+0000 7fb9636c9640 1 -- 172.21.15.98:0/3906807971 wait complete. 2024-09-19T07:26:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb9636c9640 1 Processor -- start 2024-09-19T07:26:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb9636c9640 1 -- start start 2024-09-19T07:26:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb9636c9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c101ae0 0x7fb95c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb9636c9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c102480 0x7fb95c1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb9636c9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c107b80 0x7fb95c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb9636c9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c111ef0 con 0x7fb95c107b80 2024-09-19T07:26:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb9636c9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c111d70 con 0x7fb95c101ae0 2024-09-19T07:26:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb9636c9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c112070 con 0x7fb95c102480 2024-09-19T07:26:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb961c66640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c107b80 0x7fb95c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb961465640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c101ae0 0x7fb95c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb961c66640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c107b80 0x7fb95c19cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53620/0 (socket says 172.21.15.98:53620) 2024-09-19T07:26:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb961c66640 1 -- 172.21.15.98:0/2893732490 learned_addr learned my addr 172.21.15.98:0/2893732490 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.819+0000 7fb960c64640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c102480 0x7fb95c1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.820+0000 7fb961c66640 1 -- 172.21.15.98:0/2893732490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c102480 msgr2=0x7fb95c1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.820+0000 7fb961c66640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c102480 0x7fb95c1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.820+0000 7fb961c66640 1 -- 172.21.15.98:0/2893732490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c101ae0 msgr2=0x7fb95c198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.820+0000 7fb961c66640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c101ae0 0x7fb95c198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.820+0000 7fb961c66640 1 -- 172.21.15.98:0/2893732490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c19d350 con 0x7fb95c107b80 2024-09-19T07:26:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.820+0000 7fb961c66640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c107b80 0x7fb95c19cc20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb95400eb10 tx=0x7fb95400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.820+0000 7fb9527fc640 1 -- 172.21.15.98:0/2893732490 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954004b20 con 0x7fb95c107b80 2024-09-19T07:26:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.820+0000 7fb9527fc640 1 -- 172.21.15.98:0/2893732490 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb954004cc0 con 0x7fb95c107b80 2024-09-19T07:26:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.820+0000 7fb9636c9640 1 -- 172.21.15.98:0/2893732490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95c19d640 con 0x7fb95c107b80 2024-09-19T07:26:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.820+0000 7fb9527fc640 1 -- 172.21.15.98:0/2893732490 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954010760 con 0x7fb95c107b80 2024-09-19T07:26:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.820+0000 7fb9636c9640 1 -- 172.21.15.98:0/2893732490 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb95c1a4ed0 con 0x7fb95c107b80 2024-09-19T07:26:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.823+0000 7fb9527fc640 1 -- 172.21.15.98:0/2893732490 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb954005020 con 0x7fb95c107b80 2024-09-19T07:26:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.823+0000 7fb966462740 1 Processor -- start 2024-09-19T07:26:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.823+0000 7fb966462740 1 -- start start 2024-09-19T07:26:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb966462740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b713af0 0x555f3b713ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb966462740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b714410 0x555f3b71e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb966462740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 0x555f3b7210a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb966462740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555f3b6782f0 con 0x555f3b71ecb0 2024-09-19T07:26:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb966462740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555f3b620270 con 0x555f3b713af0 2024-09-19T07:26:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb966462740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555f3b6742b0 con 0x555f3b714410 2024-09-19T07:26:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb9527fc640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb9480a3460 0x7fb9480a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb960c64640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 0x555f3b7210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb960c64640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 0x555f3b7210a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53626/0 (socket says 172.21.15.98:53626) 2024-09-19T07:26:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb961c66640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb9480a3460 0x7fb9480a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb960c64640 1 -- 172.21.15.98:0/2347037270 learned_addr learned my addr 172.21.15.98:0/2347037270 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb961465640 1 --2- 172.21.15.98:0/2347037270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b714410 0x555f3b71e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb960c64640 1 --2- 172.21.15.98:0/2347037270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b713af0 0x555f3b713ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb9527fc640 1 -- 172.21.15.98:0/2893732490 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb9540d0240 con 0x7fb95c107b80 2024-09-19T07:26:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb961465640 1 -- 172.21.15.98:0/2347037270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b713af0 msgr2=0x555f3b713ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:19.846 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb961465640 1 --2- 172.21.15.98:0/2347037270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b713af0 0x555f3b713ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb961465640 1 -- 172.21.15.98:0/2347037270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 msgr2=0x555f3b7210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb961465640 1 --2- 172.21.15.98:0/2347037270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 0x555f3b7210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb961465640 1 -- 172.21.15.98:0/2347037270 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3b61f340 con 0x555f3b714410 2024-09-19T07:26:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb960c64640 1 --2- 172.21.15.98:0/2347037270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b713af0 0x555f3b713ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:26:19.847 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb961c66640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb9480a3460 0x7fb9480a5920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb95409c1f0 tx=0x7fb95406f320 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb961465640 1 --2- 172.21.15.98:0/2347037270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b714410 0x555f3b71e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb958005940 tx=0x7fb958005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2dd8de4d3aa9bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.824+0000 7fb9477fe640 1 -- 172.21.15.98:0/2347037270 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958040070 con 0x555f3b714410 2024-09-19T07:26:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.825+0000 7fb9477fe640 1 -- 172.21.15.98:0/2347037270 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9580318f0 con 0x555f3b714410 2024-09-19T07:26:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.825+0000 7fb9477fe640 1 -- 172.21.15.98:0/2347037270 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958035040 con 0x555f3b714410 2024-09-19T07:26:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.825+0000 7fb966462740 1 -- 172.21.15.98:0/2347037270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b714410 msgr2=0x555f3b71e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.825+0000 7fb966462740 1 --2- 172.21.15.98:0/2347037270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b714410 0x555f3b71e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb958005940 tx=0x7fb958005c00 comp rx=0 tx=0).stop 2024-09-19T07:26:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.825+0000 7fb966462740 1 -- 172.21.15.98:0/2347037270 shutdown_connections 2024-09-19T07:26:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.825+0000 7fb966462740 1 --2- 172.21.15.98:0/2347037270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 0x555f3b7210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.825+0000 7fb966462740 1 --2- 172.21.15.98:0/2347037270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b714410 0x555f3b71e770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.825+0000 7fb966462740 1 --2- 172.21.15.98:0/2347037270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b713af0 0x555f3b713ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.825+0000 7fb966462740 1 -- 172.21.15.98:0/2347037270 >> 172.21.15.98:0/2347037270 conn(0x555f3b710060 msgr2=0x555f3b710440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.825+0000 7fb966462740 1 -- 172.21.15.98:0/2347037270 shutdown_connections 2024-09-19T07:26:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.825+0000 7fb966462740 1 -- 172.21.15.98:0/2347037270 wait complete. 2024-09-19T07:26:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb966462740 1 -- start start 2024-09-19T07:26:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb966462740 1 Processor -- start 2024-09-19T07:26:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb966462740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b713af0 0x555f3b71bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb966462740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b714410 0x555f3b71c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb966462740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b71ecb0 0x555f3b71c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb966462740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555f3b721880 con 0x555f3b714410 2024-09-19T07:26:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb966462740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555f3b601290 con 0x555f3b713af0 2024-09-19T07:26:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb966462740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x555f3b721a00 con 0x555f3b71ecb0 2024-09-19T07:26:19.851 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb966462740 10 client.0 _ll_register_callbacks cb 0x555f3b632140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:19.852 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb961465640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b714410 0x555f3b71c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.852 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb961465640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b714410 0x555f3b71c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53642/0 (socket says 172.21.15.98:53642) 2024-09-19T07:26:19.852 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb961465640 1 -- 172.21.15.98:0/2723055150 learned_addr learned my addr 172.21.15.98:0/2723055150 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:19.852 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb960c64640 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b713af0 0x555f3b71bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.853 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb960c64640 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b71ecb0 0x555f3b71c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.853 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb961465640 1 -- 172.21.15.98:0/2723055150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b71ecb0 msgr2=0x555f3b71c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:19.853 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.826+0000 7fb961465640 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b71ecb0 0x555f3b71c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.853 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb961465640 1 -- 172.21.15.98:0/2723055150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b713af0 msgr2=0x555f3b71bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:19.853 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb961465640 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b713af0 0x555f3b71bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.853 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb961465640 1 -- 172.21.15.98:0/2723055150 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3b38b210 con 0x555f3b714410 2024-09-19T07:26:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb961465640 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b714410 0x555f3b71c110 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb9580052b0 tx=0x7fb9580052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4834577daa56b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb944ff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:26:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb944ff9640 1 -- 172.21.15.98:0/2723055150 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958040070 con 0x555f3b714410 2024-09-19T07:26:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb944ff9640 1 -- 172.21.15.98:0/2723055150 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb9580316f0 con 0x555f3b714410 2024-09-19T07:26:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb966462740 1 -- 172.21.15.98:0/2723055150 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9580318f0 con 0x555f3b714410 2024-09-19T07:26:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb944ff9640 1 -- 172.21.15.98:0/2723055150 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb958055050 con 0x555f3b714410 2024-09-19T07:26:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb966462740 10 client.16431 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb966462740 1 -- 172.21.15.98:0/2723055150 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555f3b457620 con 0x555f3b714410 2024-09-19T07:26:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb944ff9640 1 -- 172.21.15.98:0/2723055150 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9580318f0 con 0x555f3b714410 2024-09-19T07:26:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb944ff9640 1 -- 172.21.15.98:0/2723055150 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb9580042d0 con 0x555f3b714410 2024-09-19T07:26:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb966462740 10 client.16431 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb966462740 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:26:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb966462740 20 client.16431 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb966462740 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555f3b72ead0 0x555f3b730ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb966462740 4 client.16431 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.827+0000 7fb966462740 1 -- 172.21.15.98:0/2723055150 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f3b685a20 con 0x555f3b72ead0 2024-09-19T07:26:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.828+0000 7fb960c64640 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555f3b72ead0 0x555f3b730ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.828+0000 7fb960c64640 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555f3b72ead0 0x555f3b730ec0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd9c17236ef94e91 server_cookie=8082b6cf09571433 in_seq=0 out_seq=0 2024-09-19T07:26:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.828+0000 7fb944ff9640 10 client.16431 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb944ff9640 1 -- 172.21.15.98:0/2723055150 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f3b685a20 con 0x555f3b72ead0 2024-09-19T07:26:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb944ff9640 10 client.16431 handle_command_reply: tid=0 2024-09-19T07:26:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb966462740 1 client.16431 shutdown 2024-09-19T07:26:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb966462740 1 -- 172.21.15.98:0/2723055150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b714410 msgr2=0x555f3b71c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb966462740 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b714410 0x555f3b71c110 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb9580052b0 tx=0x7fb9580052e0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb966462740 1 -- 172.21.15.98:0/2723055150 shutdown_connections 2024-09-19T07:26:19.858 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb966462740 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b71ecb0 0x555f3b71c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb966462740 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555f3b72ead0 0x555f3b730ec0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb966462740 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b714410 0x555f3b71c110 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb966462740 1 --2- 172.21.15.98:0/2723055150 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b713af0 0x555f3b71bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb944ff9640 0 client.16431 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb966462740 1 -- 172.21.15.98:0/2723055150 >> 172.21.15.98:0/2723055150 conn(0x555f3b710060 msgr2=0x555f3b715d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb966462740 1 -- 172.21.15.98:0/2723055150 shutdown_connections 2024-09-19T07:26:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb966462740 1 -- 172.21.15.98:0/2723055150 wait complete. 2024-09-19T07:26:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.830+0000 7fb966462740 20 client.16431 trim_cache size 0 max 16384 2024-09-19T07:26:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.845+0000 7fb966462740 1 Processor -- start 2024-09-19T07:26:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.845+0000 7fb966462740 1 -- start start 2024-09-19T07:26:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.845+0000 7fb966462740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b713af0 0x555f3b71c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.845+0000 7fb966462740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 0x555f3b736520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.845+0000 7fb966462740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b736a60 0x555f3b718e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.845+0000 7fb966462740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1b01e0 con 0x555f3b71ecb0 2024-09-19T07:26:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.845+0000 7fb966462740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1ad9f0 con 0x555f3b736a60 2024-09-19T07:26:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.845+0000 7fb966462740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1ab840 con 0x555f3b713af0 2024-09-19T07:26:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.845+0000 7fb961465640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 0x555f3b736520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.845+0000 7fb961465640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 0x555f3b736520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53644/0 (socket says 172.21.15.98:53644) 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.845+0000 7fb961465640 1 -- 172.21.15.98:0/3514388566 learned_addr learned my addr 172.21.15.98:0/3514388566 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.845+0000 7fb960c64640 1 --2- 172.21.15.98:0/3514388566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b713af0 0x555f3b71c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.846+0000 7fb960c64640 1 --2- 172.21.15.98:0/3514388566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b736a60 0x555f3b718e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.846+0000 7fb961465640 1 -- 172.21.15.98:0/3514388566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b713af0 msgr2=0x555f3b71c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.846+0000 7fb961465640 1 --2- 172.21.15.98:0/3514388566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b713af0 0x555f3b71c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.846+0000 7fb961465640 1 -- 172.21.15.98:0/3514388566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b736a60 msgr2=0x555f3b718e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.846+0000 7fb961465640 1 --2- 172.21.15.98:0/3514388566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b736a60 0x555f3b718e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.846+0000 7fb961465640 1 -- 172.21.15.98:0/3514388566 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3b721440 con 0x555f3b71ecb0 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.846+0000 7fb961465640 1 --2- 172.21.15.98:0/3514388566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 0x555f3b736520 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb95802a940 tx=0x7fb958005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e00b82cca7506e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.846+0000 7fb946ffd640 1 -- 172.21.15.98:0/3514388566 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958040040 con 0x555f3b71ecb0 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.846+0000 7fb946ffd640 1 -- 172.21.15.98:0/3514388566 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb958005500 con 0x555f3b71ecb0 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.846+0000 7fb946ffd640 1 -- 172.21.15.98:0/3514388566 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958035070 con 0x555f3b71ecb0 2024-09-19T07:26:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 -- 172.21.15.98:0/3514388566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 msgr2=0x555f3b736520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 --2- 172.21.15.98:0/3514388566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 0x555f3b736520 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb95802a940 tx=0x7fb958005850 comp rx=0 tx=0).stop 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 -- 172.21.15.98:0/3514388566 shutdown_connections 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 --2- 172.21.15.98:0/3514388566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b736a60 0x555f3b718e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 --2- 172.21.15.98:0/3514388566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b71ecb0 0x555f3b736520 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 --2- 172.21.15.98:0/3514388566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b713af0 0x555f3b71c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 -- 172.21.15.98:0/3514388566 >> 172.21.15.98:0/3514388566 conn(0x555f3b710060 msgr2=0x555f3b71dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 -- 172.21.15.98:0/3514388566 shutdown_connections 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 -- 172.21.15.98:0/3514388566 wait complete. 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 -- start start 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 Processor -- start 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b713af0 0x555f3b722a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b71ecb0 0x555f3b722fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b736a60 0x555f3b7234f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1abeb0 con 0x555f3b736a60 2024-09-19T07:26:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1ad320 con 0x555f3b71ecb0 2024-09-19T07:26:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1ac580 con 0x555f3b713af0 2024-09-19T07:26:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.847+0000 7fb966462740 10 client.0 _ll_register_callbacks cb 0x7fb94c00bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb960c64640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b736a60 0x555f3b7234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb961465640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b71ecb0 0x555f3b722fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb960c64640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b736a60 0x555f3b7234f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53646/0 (socket says 172.21.15.98:53646) 2024-09-19T07:26:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb960c64640 1 -- 172.21.15.98:0/3620932791 learned_addr learned my addr 172.21.15.98:0/3620932791 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb960c64640 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b713af0 0x555f3b722a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb960c64640 1 -- 172.21.15.98:0/3620932791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b713af0 msgr2=0x555f3b722a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb960c64640 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b713af0 0x555f3b722a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb960c64640 1 -- 172.21.15.98:0/3620932791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b71ecb0 msgr2=0x555f3b722fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb960c64640 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b71ecb0 0x555f3b722fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb960c64640 1 -- 172.21.15.98:0/3620932791 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3b7985a0 con 0x555f3b736a60 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb961465640 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b71ecb0 0x555f3b722fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb960c64640 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b736a60 0x555f3b7234f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x555f3b731490 tx=0x7fb94c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5565abebb65ed46a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb944ff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb944ff9640 1 -- 172.21.15.98:0/3620932791 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0039c0 con 0x555f3b736a60 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb944ff9640 1 -- 172.21.15.98:0/3620932791 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb94c003b60 con 0x555f3b736a60 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb966462740 1 -- 172.21.15.98:0/3620932791 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb958005500 con 0x555f3b736a60 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb944ff9640 1 -- 172.21.15.98:0/3620932791 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb94c003d60 con 0x555f3b736a60 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb966462740 10 client.16437 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.848+0000 7fb966462740 1 -- 172.21.15.98:0/3620932791 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555f3b7998d0 con 0x555f3b736a60 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.849+0000 7fb944ff9640 1 -- 172.21.15.98:0/3620932791 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb958005500 con 0x555f3b736a60 2024-09-19T07:26:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.849+0000 7fb944ff9640 1 -- 172.21.15.98:0/3620932791 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb94c03a070 con 0x555f3b736a60 2024-09-19T07:26:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.849+0000 7fb966462740 10 client.16437 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.849+0000 7fb966462740 10 client.16437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:26:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.849+0000 7fb966462740 20 client.16437 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.849+0000 7fb966462740 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555f3b79a060 0x555f3b79c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.849+0000 7fb966462740 4 client.16437 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:26:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.849+0000 7fb966462740 1 -- 172.21.15.98:0/3620932791 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555f3b67fd70 con 0x555f3b79a060 2024-09-19T07:26:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.849+0000 7fb961465640 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555f3b79a060 0x555f3b79c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.849+0000 7fb944ff9640 10 client.16437 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:19.849+0000 7fb961465640 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555f3b79a060 0x555f3b79c480 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b40e8a377cf1206d server_cookie=833657f3bcb95905 in_seq=0 out_seq=0 2024-09-19T07:26:21.153 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T07:26:21.153 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T07:26:21.154 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:26:21.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:20 smithi098 ceph-mon[30950]: pgmap v131: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 705 op/s 2024-09-19T07:26:21.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:20 smithi139 ceph-mon[35039]: pgmap v131: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 705 op/s 2024-09-19T07:26:21.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:20 smithi162 ceph-mon[35726]: pgmap v131: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 705 op/s 2024-09-19T07:26:21.406 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:26:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb944ff9640 1 -- 172.21.15.98:0/3620932791 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555f3b67fd70 con 0x555f3b79a060 2024-09-19T07:26:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb944ff9640 10 client.16437 handle_command_reply: tid=0 2024-09-19T07:26:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb966462740 1 client.16437 shutdown 2024-09-19T07:26:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb966462740 1 -- 172.21.15.98:0/3620932791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b736a60 msgr2=0x555f3b7234f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb966462740 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b736a60 0x555f3b7234f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x555f3b731490 tx=0x7fb94c00b390 comp rx=0 tx=0).stop 2024-09-19T07:26:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb966462740 1 -- 172.21.15.98:0/3620932791 shutdown_connections 2024-09-19T07:26:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb966462740 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x555f3b79a060 0x555f3b79c480 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb966462740 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f3b736a60 0x555f3b7234f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb966462740 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555f3b71ecb0 0x555f3b722fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.465 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb966462740 1 --2- 172.21.15.98:0/3620932791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555f3b713af0 0x555f3b722a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb966462740 1 -- 172.21.15.98:0/3620932791 >> 172.21.15.98:0/3620932791 conn(0x555f3b710060 msgr2=0x555f3b70e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb944ff9640 0 client.16437 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb966462740 1 -- 172.21.15.98:0/3620932791 shutdown_connections 2024-09-19T07:26:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb966462740 1 -- 172.21.15.98:0/3620932791 wait complete. 2024-09-19T07:26:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.464+0000 7fb966462740 20 client.16437 trim_cache size 0 max 16384 2024-09-19T07:26:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:26:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:26:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:26:21.466 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:26:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.465+0000 7fb9636c9640 1 -- 172.21.15.98:0/2893732490 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb9480a3460 msgr2=0x7fb9480a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.465+0000 7fb9636c9640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb9480a3460 0x7fb9480a5920 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb95409c1f0 tx=0x7fb95406f320 comp rx=0 tx=0).stop 2024-09-19T07:26:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.465+0000 7fb9636c9640 1 -- 172.21.15.98:0/2893732490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c107b80 msgr2=0x7fb95c19cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.465+0000 7fb9636c9640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c107b80 0x7fb95c19cc20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb95400eb10 tx=0x7fb95400c2d0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.465+0000 7fb9636c9640 1 -- 172.21.15.98:0/2893732490 shutdown_connections 2024-09-19T07:26:21.467 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.465+0000 7fb9636c9640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb9480a3460 0x7fb9480a5920 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.465+0000 7fb9636c9640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb95c107b80 0x7fb95c19cc20 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.465+0000 7fb9636c9640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c102480 0x7fb95c1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.465+0000 7fb9636c9640 1 --2- 172.21.15.98:0/2893732490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb95c101ae0 0x7fb95c198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.465+0000 7fb9636c9640 1 -- 172.21.15.98:0/2893732490 >> 172.21.15.98:0/2893732490 conn(0x7fb95c0fd7e0 msgr2=0x7fb95c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.465+0000 7fb9636c9640 1 -- 172.21.15.98:0/2893732490 shutdown_connections 2024-09-19T07:26:21.468 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:21.465+0000 7fb9636c9640 1 -- 172.21.15.98:0/2893732490 wait complete. 2024-09-19T07:26:21.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.883+0000 7fbb38606640 1 -- 172.21.15.98:0/247613883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb30102d90 msgr2=0x7fbb30103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:21.883 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.883+0000 7fbb38606640 1 --2- 172.21.15.98:0/247613883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb30102d90 0x7fbb30103170 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009930 tx=0x7fbb2c02a420 comp rx=0 tx=0).stop 2024-09-19T07:26:21.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.883+0000 7fbb38606640 1 -- 172.21.15.98:0/247613883 shutdown_connections 2024-09-19T07:26:21.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.883+0000 7fbb38606640 1 --2- 172.21.15.98:0/247613883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb30108290 0x7fbb3010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.883+0000 7fbb38606640 1 --2- 172.21.15.98:0/247613883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb30103740 0x7fbb30107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.883+0000 7fbb38606640 1 --2- 172.21.15.98:0/247613883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb30102d90 0x7fbb30103170 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.883+0000 7fbb38606640 1 -- 172.21.15.98:0/247613883 >> 172.21.15.98:0/247613883 conn(0x7fbb300fc7d0 msgr2=0x7fbb300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:21.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.883+0000 7fbb38606640 1 -- 172.21.15.98:0/247613883 shutdown_connections 2024-09-19T07:26:21.884 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.883+0000 7fbb38606640 1 -- 172.21.15.98:0/247613883 wait complete. 2024-09-19T07:26:21.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.883+0000 7fbb38606640 1 Processor -- start 2024-09-19T07:26:21.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb38606640 1 -- start start 2024-09-19T07:26:21.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb38606640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb30102d90 0x7fbb301985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:21.886 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb38606640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb30103740 0x7fbb30198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:21.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb38606640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb30108290 0x7fbb3019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:21.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb38606640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbb30112090 con 0x7fbb30103740 2024-09-19T07:26:21.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb38606640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbb30111f10 con 0x7fbb30108290 2024-09-19T07:26:21.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb38606640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb30112210 con 0x7fbb30102d90 2024-09-19T07:26:21.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb35ba1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb30103740 0x7fbb30198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:21.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb363a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb30102d90 0x7fbb301985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:21.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb35ba1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb30103740 0x7fbb30198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:53660/0 (socket says 172.21.15.98:53660) 2024-09-19T07:26:21.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb35ba1640 1 -- 172.21.15.98:0/2337692599 learned_addr learned my addr 172.21.15.98:0/2337692599 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:21.887 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb36ba3640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb30108290 0x7fbb3019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:21.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb35ba1640 1 -- 172.21.15.98:0/2337692599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb30102d90 msgr2=0x7fbb301985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:21.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb35ba1640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb30102d90 0x7fbb301985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb35ba1640 1 -- 172.21.15.98:0/2337692599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb30108290 msgr2=0x7fbb3019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:21.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb35ba1640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb30108290 0x7fbb3019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:21.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.884+0000 7fbb35ba1640 1 -- 172.21.15.98:0/2337692599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3019d550 con 0x7fbb30103740 2024-09-19T07:26:21.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.885+0000 7fbb35ba1640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb30103740 0x7fbb30198ae0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000d740 tx=0x7fbb2000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:21.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.885+0000 7fbb277fe640 1 -- 172.21.15.98:0/2337692599 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20017070 con 0x7fbb30103740 2024-09-19T07:26:21.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.885+0000 7fbb277fe640 1 -- 172.21.15.98:0/2337692599 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb2000de50 con 0x7fbb30103740 2024-09-19T07:26:21.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.885+0000 7fbb38606640 1 -- 172.21.15.98:0/2337692599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3019d840 con 0x7fbb30103740 2024-09-19T07:26:21.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.885+0000 7fbb277fe640 1 -- 172.21.15.98:0/2337692599 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20004e00 con 0x7fbb30103740 2024-09-19T07:26:21.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.885+0000 7fbb38606640 1 -- 172.21.15.98:0/2337692599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb301a5120 con 0x7fbb30103740 2024-09-19T07:26:21.888 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.886+0000 7fbb38606640 1 -- 172.21.15.98:0/2337692599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb3006a7f0 con 0x7fbb30103740 2024-09-19T07:26:21.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.887+0000 7fbb277fe640 1 -- 172.21.15.98:0/2337692599 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fbb20004fa0 con 0x7fbb30103740 2024-09-19T07:26:21.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.888+0000 7fbb277fe640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fbb1c0a3430 0x7fbb1c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:21.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.888+0000 7fbb363a2640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fbb1c0a3430 0x7fbb1c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:21.889 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.888+0000 7fbb277fe640 1 -- 172.21.15.98:0/2337692599 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fbb200cf9e0 con 0x7fbb30103740 2024-09-19T07:26:21.890 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.888+0000 7fbb363a2640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fbb1c0a3430 0x7fbb1c0a58f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009900 tx=0x7fbb2c0058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:21.891 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:21.891+0000 7fbb277fe640 1 -- 172.21.15.98:0/2337692599 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb2009bdc0 con 0x7fbb30103740 2024-09-19T07:26:22.139 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.139+0000 7fbb38606640 1 -- 172.21.15.98:0/2337692599 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb3010a2a0 con 0x7fbb30103740 2024-09-19T07:26:22.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.140+0000 7fbb277fe640 1 -- 172.21.15.98:0/2337692599 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11928 (secure 0 0 0) 0x7fbb200a00c0 con 0x7fbb30103740 2024-09-19T07:26:22.142 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:26:22.143 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"btime":"2024-09-19T07:24:57:508846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:24:56.977446+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":73,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":74,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:26:22.143 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2024-09-19T07:26:22.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.145+0000 7fbb38606640 1 -- 172.21.15.98:0/2337692599 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fbb1c0a3430 msgr2=0x7fbb1c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:22.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.145+0000 7fbb38606640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fbb1c0a3430 0x7fbb1c0a58f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c009900 tx=0x7fbb2c0058d0 comp rx=0 tx=0).stop 2024-09-19T07:26:22.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.145+0000 7fbb38606640 1 -- 172.21.15.98:0/2337692599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb30103740 msgr2=0x7fbb30198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:22.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.145+0000 7fbb38606640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb30103740 0x7fbb30198ae0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000d740 tx=0x7fbb2000dc00 comp rx=0 tx=0).stop 2024-09-19T07:26:22.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.145+0000 7fbb38606640 1 -- 172.21.15.98:0/2337692599 shutdown_connections 2024-09-19T07:26:22.146 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.145+0000 7fbb38606640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fbb1c0a3430 0x7fbb1c0a58f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:22.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.145+0000 7fbb38606640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbb30108290 0x7fbb3019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:22.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.146+0000 7fbb38606640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb30103740 0x7fbb30198ae0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:22.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.146+0000 7fbb38606640 1 --2- 172.21.15.98:0/2337692599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb30102d90 0x7fbb301985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:22.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.146+0000 7fbb38606640 1 -- 172.21.15.98:0/2337692599 >> 172.21.15.98:0/2337692599 conn(0x7fbb300fc7d0 msgr2=0x7fbb30105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:22.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.146+0000 7fbb38606640 1 -- 172.21.15.98:0/2337692599 shutdown_connections 2024-09-19T07:26:22.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:22.146+0000 7fbb38606640 1 -- 172.21.15.98:0/2337692599 wait complete. 2024-09-19T07:26:23.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:22 smithi098 ceph-mon[30950]: pgmap v132: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 353 op/s 2024-09-19T07:26:23.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:22 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2337692599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:23.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:22 smithi139 ceph-mon[35039]: pgmap v132: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 353 op/s 2024-09-19T07:26:23.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:22 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2337692599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:23.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:22 smithi162 ceph-mon[35726]: pgmap v132: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 353 op/s 2024-09-19T07:26:23.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:22 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2337692599' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:23.510 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T07:26:23.510 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T07:26:23.766 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:26:24.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.330+0000 7f40f5603640 1 -- 172.21.15.98:0/136016932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40f0102bb0 msgr2=0x7f40f0102f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:24.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.330+0000 7f40f5603640 1 --2- 172.21.15.98:0/136016932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40f0102bb0 0x7f40f0102f90 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f40e0009900 tx=0x7f40e002a480 comp rx=0 tx=0).stop 2024-09-19T07:26:24.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.330+0000 7f40f5603640 1 -- 172.21.15.98:0/136016932 shutdown_connections 2024-09-19T07:26:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.330+0000 7f40f5603640 1 --2- 172.21.15.98:0/136016932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40f010bfe0 0x7f40f010e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.330+0000 7f40f5603640 1 --2- 172.21.15.98:0/136016932 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40f01034d0 0x7f40f010b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.330+0000 7f40f5603640 1 --2- 172.21.15.98:0/136016932 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40f0102bb0 0x7f40f0102f90 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.330+0000 7f40f5603640 1 -- 172.21.15.98:0/136016932 >> 172.21.15.98:0/136016932 conn(0x7f40f00fc630 msgr2=0x7f40f00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.330+0000 7f40f5603640 1 -- 172.21.15.98:0/136016932 shutdown_connections 2024-09-19T07:26:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.330+0000 7f40f5603640 1 -- 172.21.15.98:0/136016932 wait complete. 2024-09-19T07:26:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40f5603640 1 Processor -- start 2024-09-19T07:26:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40f5603640 1 -- start start 2024-09-19T07:26:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40f5603640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40f0102bb0 0x7f40f01982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40f5603640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40f01034d0 0x7f40f01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40f5603640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40f010bfe0 0x7f40f019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40f5603640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f40f0111de0 con 0x7f40f010bfe0 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40f5603640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f40f0111c60 con 0x7f40f0102bb0 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40f5603640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f40f0111f60 con 0x7f40f01034d0 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40eeffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40f0102bb0 0x7f40f01982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40eeffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40f0102bb0 0x7f40f01982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:57920/0 (socket says 172.21.15.98:57920) 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40ef7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40f010bfe0 0x7f40f019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40eeffd640 1 -- 172.21.15.98:0/465207847 learned_addr learned my addr 172.21.15.98:0/465207847 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40f01034d0 0x7f40f01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40ef7fe640 1 -- 172.21.15.98:0/465207847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40f01034d0 msgr2=0x7f40f01987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40ef7fe640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40f01034d0 0x7f40f01987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40ef7fe640 1 -- 172.21.15.98:0/465207847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40f0102bb0 msgr2=0x7f40f01982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.331+0000 7f40ef7fe640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40f0102bb0 0x7f40f01982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.332+0000 7f40ef7fe640 1 -- 172.21.15.98:0/465207847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f019d250 con 0x7f40f010bfe0 2024-09-19T07:26:24.355 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.332+0000 7f40ef7fe640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40f010bfe0 0x7f40f019cb70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f40e800e940 tx=0x7f40e800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.332+0000 7f40d7fff640 1 -- 172.21.15.98:0/465207847 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e8004d20 con 0x7f40f010bfe0 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.332+0000 7f40f5603640 1 -- 172.21.15.98:0/465207847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f019d540 con 0x7f40f010bfe0 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.332+0000 7f40d7fff640 1 -- 172.21.15.98:0/465207847 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e8005020 con 0x7f40f010bfe0 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.332+0000 7f40d7fff640 1 -- 172.21.15.98:0/465207847 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e80116b0 con 0x7f40f010bfe0 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.332+0000 7f40f5603640 1 -- 172.21.15.98:0/465207847 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f01a4e20 con 0x7f40f010bfe0 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.334+0000 7f40d7fff640 1 -- 172.21.15.98:0/465207847 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f40e80054d0 con 0x7f40f010bfe0 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.334+0000 7f40f79dc740 1 Processor -- start 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.334+0000 7f40f79dc740 1 -- start start 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40f79dc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0dd900 0x55769e0ddce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40f79dc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0de220 0x55769e0e85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40f79dc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0e8ae0 0x55769e0eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40f79dc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55769e0432a0 con 0x55769e0de220 2024-09-19T07:26:24.356 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40f79dc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55769dfeab10 con 0x55769e0dd900 2024-09-19T07:26:24.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40f79dc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55769e03f260 con 0x55769e0e8ae0 2024-09-19T07:26:24.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40eeffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0de220 0x55769e0e85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40eeffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0de220 0x55769e0e85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51908/0 (socket says 172.21.15.98:51908) 2024-09-19T07:26:24.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40eeffd640 1 -- 172.21.15.98:0/4086797335 learned_addr learned my addr 172.21.15.98:0/4086797335 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:24.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/4086797335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0dd900 0x55769e0ddce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40d7fff640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f40d80a33b0 0x7f40d80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/4086797335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0e8ae0 0x55769e0eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40ef7fe640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f40d80a33b0 0x7f40d80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40ee7fc640 1 -- 172.21.15.98:0/4086797335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0e8ae0 msgr2=0x55769e0eaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:24.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/4086797335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0e8ae0 0x55769e0eaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.357 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40ee7fc640 1 -- 172.21.15.98:0/4086797335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0de220 msgr2=0x55769e0e85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:24.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/4086797335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0de220 0x55769e0e85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40ee7fc640 1 -- 172.21.15.98:0/4086797335 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55769ddb4b90 con 0x55769e0dd900 2024-09-19T07:26:24.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40eeffd640 1 --2- 172.21.15.98:0/4086797335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0de220 0x55769e0e85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:26:24.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40d7fff640 1 -- 172.21.15.98:0/465207847 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f40e80cfd60 con 0x7f40f010bfe0 2024-09-19T07:26:24.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/4086797335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0dd900 0x55769e0ddce0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f40e4005d00 tx=0x7f40e4005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c18f4c81c795b8f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:24.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.335+0000 7f40ef7fe640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f40d80a33b0 0x7f40d80a5870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f40e8098a90 tx=0x7f40e8098450 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:24.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.336+0000 7f40d57fa640 1 -- 172.21.15.98:0/4086797335 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4012d00 con 0x55769e0dd900 2024-09-19T07:26:24.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.336+0000 7f40d57fa640 1 -- 172.21.15.98:0/4086797335 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e4005020 con 0x55769e0dd900 2024-09-19T07:26:24.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.336+0000 7f40d57fa640 1 -- 172.21.15.98:0/4086797335 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e40049a0 con 0x55769e0dd900 2024-09-19T07:26:24.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.336+0000 7f40f79dc740 1 -- 172.21.15.98:0/4086797335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0dd900 msgr2=0x55769e0ddce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:24.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.336+0000 7f40f79dc740 1 --2- 172.21.15.98:0/4086797335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0dd900 0x55769e0ddce0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f40e4005d00 tx=0x7f40e4005c90 comp rx=0 tx=0).stop 2024-09-19T07:26:24.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.336+0000 7f40f79dc740 1 -- 172.21.15.98:0/4086797335 shutdown_connections 2024-09-19T07:26:24.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.336+0000 7f40f79dc740 1 --2- 172.21.15.98:0/4086797335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0e8ae0 0x55769e0eaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.336+0000 7f40f79dc740 1 --2- 172.21.15.98:0/4086797335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0de220 0x55769e0e85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.336+0000 7f40f79dc740 1 --2- 172.21.15.98:0/4086797335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0dd900 0x55769e0ddce0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.336+0000 7f40f79dc740 1 -- 172.21.15.98:0/4086797335 >> 172.21.15.98:0/4086797335 conn(0x55769e0d9e90 msgr2=0x55769e0da270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:24.360 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.336+0000 7f40f79dc740 1 -- 172.21.15.98:0/4086797335 shutdown_connections 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.336+0000 7f40f79dc740 1 -- 172.21.15.98:0/4086797335 wait complete. 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40f79dc740 1 -- start start 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40f79dc740 1 Processor -- start 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40f79dc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0dd900 0x55769e0e5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40f79dc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0de220 0x55769e0e5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40f79dc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 0x55769e0e6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40f79dc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55769e0eb6b0 con 0x55769e0e8ae0 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40f79dc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55769dfcb6e0 con 0x55769e0de220 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40f79dc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55769e0eb830 con 0x55769e0dd900 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40f79dc740 10 client.0 _ll_register_callbacks cb 0x55769dfefa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40ee7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 0x55769e0e6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40ee7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 0x55769e0e6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51918/0 (socket says 172.21.15.98:51918) 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40eeffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0de220 0x55769e0e5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40ee7fc640 1 -- 172.21.15.98:0/2176765803 learned_addr learned my addr 172.21.15.98:0/2176765803 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.337+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/2176765803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0dd900 0x55769e0e5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40ee7fc640 1 -- 172.21.15.98:0/2176765803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0dd900 msgr2=0x55769e0e5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/2176765803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0dd900 0x55769e0e5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40ee7fc640 1 -- 172.21.15.98:0/2176765803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0de220 msgr2=0x55769e0e5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/2176765803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0de220 0x55769e0e5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40ee7fc640 1 -- 172.21.15.98:0/2176765803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55769e0f4c80 con 0x55769e0e8ae0 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/2176765803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 0x55769e0e6510 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f40e400bd70 tx=0x7f40e401b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e07bf2d053f812 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40d2ff5640 1 -- 172.21.15.98:0/2176765803 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4010740 con 0x55769e0e8ae0 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40d2ff5640 1 -- 172.21.15.98:0/2176765803 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f40e40108e0 con 0x55769e0e8ae0 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40f79dc740 1 -- 172.21.15.98:0/2176765803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40e4005020 con 0x55769e0e8ae0 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40d2ff5640 1 -- 172.21.15.98:0/2176765803 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f40e4010ae0 con 0x55769e0e8ae0 2024-09-19T07:26:24.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40f79dc740 10 client.16455 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40f79dc740 1 -- 172.21.15.98:0/2176765803 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55769e0f75f0 con 0x55769e0e8ae0 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40d2ff5640 1 -- 172.21.15.98:0/2176765803 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e4005020 con 0x55769e0e8ae0 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.338+0000 7f40d2ff5640 1 -- 172.21.15.98:0/2176765803 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f40e401e410 con 0x55769e0e8ae0 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.339+0000 7f40f79dc740 10 client.16455 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.339+0000 7f40f79dc740 10 client.16455 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.339+0000 7f40f79dc740 20 client.16455 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.339+0000 7f40f79dc740 1 --2- 172.21.15.98:0/2176765803 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55769e0f8940 0x55769e0fad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.339+0000 7f40f79dc740 4 client.16455 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.339+0000 7f40f79dc740 1 -- 172.21.15.98:0/2176765803 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55769e0509d0 con 0x55769e0f8940 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.339+0000 7f40eeffd640 1 --2- 172.21.15.98:0/2176765803 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55769e0f8940 0x55769e0fad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.339+0000 7f40eeffd640 1 --2- 172.21.15.98:0/2176765803 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55769e0f8940 0x55769e0fad30 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb83fa9b3d66d0fc server_cookie=a0e08f356a343687 in_seq=0 out_seq=0 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.339+0000 7f40d2ff5640 10 client.16455 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.340+0000 7f40d2ff5640 1 -- 172.21.15.98:0/2176765803 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55769e0509d0 con 0x55769e0f8940 2024-09-19T07:26:24.363 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.340+0000 7f40d2ff5640 10 client.16455 handle_command_reply: tid=0 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.340+0000 7f40f79dc740 1 client.16455 shutdown 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.340+0000 7f40f79dc740 1 -- 172.21.15.98:0/2176765803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 msgr2=0x55769e0e6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.340+0000 7f40f79dc740 1 --2- 172.21.15.98:0/2176765803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 0x55769e0e6510 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f40e400bd70 tx=0x7f40e401b040 comp rx=0 tx=0).stop 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.340+0000 7f40f79dc740 1 -- 172.21.15.98:0/2176765803 shutdown_connections 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.340+0000 7f40f79dc740 1 --2- 172.21.15.98:0/2176765803 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55769e0f8940 0x55769e0fad30 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.340+0000 7f40f79dc740 1 --2- 172.21.15.98:0/2176765803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 0x55769e0e6510 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.340+0000 7f40f79dc740 1 --2- 172.21.15.98:0/2176765803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0de220 0x55769e0e5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.340+0000 7f40d2ff5640 0 client.16455 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.340+0000 7f40f79dc740 1 --2- 172.21.15.98:0/2176765803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0dd900 0x55769e0e5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.340+0000 7f40f79dc740 1 -- 172.21.15.98:0/2176765803 >> 172.21.15.98:0/2176765803 conn(0x55769e0d9e90 msgr2=0x55769e0dfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.341+0000 7f40f79dc740 1 -- 172.21.15.98:0/2176765803 shutdown_connections 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.341+0000 7f40f79dc740 1 -- 172.21.15.98:0/2176765803 wait complete. 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.341+0000 7f40f79dc740 20 client.16455 trim_cache size 0 max 16384 2024-09-19T07:26:24.364 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40f79dc740 1 Processor -- start 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40f79dc740 1 -- start start 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40f79dc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0dd900 0x55769e0e60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40f79dc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0de220 0x55769e0e0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40f79dc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0e8ae0 0x55769e100390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40f79dc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f40f01b0150 con 0x55769e0dd900 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40f79dc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f40f01ad960 con 0x55769e0e8ae0 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40f79dc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f40f01ab7b0 con 0x55769e0de220 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40ee7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0dd900 0x55769e0e60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40ee7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0dd900 0x55769e0e60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51934/0 (socket says 172.21.15.98:51934) 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40ee7fc640 1 -- 172.21.15.98:0/3023086995 learned_addr learned my addr 172.21.15.98:0/3023086995 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40eeffd640 1 --2- 172.21.15.98:0/3023086995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0de220 0x55769e0e0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/3023086995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0e8ae0 0x55769e100390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.365 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40ee7fc640 1 -- 172.21.15.98:0/3023086995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0de220 msgr2=0x55769e0e0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:24.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/3023086995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0de220 0x55769e0e0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40ee7fc640 1 -- 172.21.15.98:0/3023086995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0e8ae0 msgr2=0x55769e100390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:24.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.358+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/3023086995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0e8ae0 0x55769e100390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.359+0000 7f40ee7fc640 1 -- 172.21.15.98:0/3023086995 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55769e0dab20 con 0x55769e0dd900 2024-09-19T07:26:24.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.359+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/3023086995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0dd900 0x55769e0e60c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f40e4001eb0 tx=0x7f40e400bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d363097cc898c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:24.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.359+0000 7f40d4ff9640 1 -- 172.21.15.98:0/3023086995 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e400ba10 con 0x55769e0dd900 2024-09-19T07:26:24.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.359+0000 7f40d4ff9640 1 -- 172.21.15.98:0/3023086995 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e4016070 con 0x55769e0dd900 2024-09-19T07:26:24.366 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.359+0000 7f40d4ff9640 1 -- 172.21.15.98:0/3023086995 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e401e640 con 0x55769e0dd900 2024-09-19T07:26:24.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 -- 172.21.15.98:0/3023086995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0dd900 msgr2=0x55769e0e60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:24.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 --2- 172.21.15.98:0/3023086995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0dd900 0x55769e0e60c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f40e4001eb0 tx=0x7f40e400bcd0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 -- 172.21.15.98:0/3023086995 shutdown_connections 2024-09-19T07:26:24.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 --2- 172.21.15.98:0/3023086995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0e8ae0 0x55769e100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 --2- 172.21.15.98:0/3023086995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0de220 0x55769e0e0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 --2- 172.21.15.98:0/3023086995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0dd900 0x55769e0e60c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 -- 172.21.15.98:0/3023086995 >> 172.21.15.98:0/3023086995 conn(0x55769e0d9e90 msgr2=0x55769e0e7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:24.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 -- 172.21.15.98:0/3023086995 shutdown_connections 2024-09-19T07:26:24.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 -- 172.21.15.98:0/3023086995 wait complete. 2024-09-19T07:26:24.369 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 -- start start 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 Processor -- start 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0dd900 0x55769e0f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0de220 0x55769e0ec610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 0x55769e0ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f40f01abe20 con 0x55769e0e8ae0 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f40f01ad290 con 0x55769e0de220 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f40f01ac4f0 con 0x55769e0dd900 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40f79dc740 10 client.0 _ll_register_callbacks cb 0x7f40e40052f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40ee7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 0x55769e0ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40ee7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 0x55769e0ecc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51944/0 (socket says 172.21.15.98:51944) 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.360+0000 7f40ee7fc640 1 -- 172.21.15.98:0/1318069291 learned_addr learned my addr 172.21.15.98:0/1318069291 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40eeffd640 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0de220 0x55769e0ec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0dd900 0x55769e0f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.370 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40ee7fc640 1 -- 172.21.15.98:0/1318069291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0dd900 msgr2=0x55769e0f12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0dd900 0x55769e0f12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40ee7fc640 1 -- 172.21.15.98:0/1318069291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0de220 msgr2=0x55769e0ec610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0de220 0x55769e0ec610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40ee7fc640 1 -- 172.21.15.98:0/1318069291 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55769e0ed430 con 0x55769e0e8ae0 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40ee7fc640 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 0x55769e0ecc00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f40e4010fe0 tx=0x7f40e4010a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf27bc42970c667 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40d2ff5640 1 -- 172.21.15.98:0/1318069291 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e4005070 con 0x55769e0e8ae0 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40d2ff5640 1 -- 172.21.15.98:0/1318069291 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f40e4012d00 con 0x55769e0e8ae0 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40f79dc740 1 -- 172.21.15.98:0/1318069291 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40e4016070 con 0x55769e0e8ae0 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40d2ff5640 1 -- 172.21.15.98:0/1318069291 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f40e401e3e0 con 0x55769e0e8ae0 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40f79dc740 10 client.16461 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.361+0000 7f40f79dc740 1 -- 172.21.15.98:0/1318069291 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55769e163450 con 0x55769e0e8ae0 2024-09-19T07:26:24.371 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.362+0000 7f40d2ff5640 1 -- 172.21.15.98:0/1318069291 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e4016070 con 0x55769e0e8ae0 2024-09-19T07:26:24.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.362+0000 7f40d2ff5640 1 -- 172.21.15.98:0/1318069291 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f40e4003850 con 0x55769e0e8ae0 2024-09-19T07:26:24.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.362+0000 7f40f79dc740 10 client.16461 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:24.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.362+0000 7f40f79dc740 10 client.16461 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:26:24.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.362+0000 7f40f79dc740 20 client.16461 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:24.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.362+0000 7f40f79dc740 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55769e163ac0 0x55769e165ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:24.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.362+0000 7f40f79dc740 4 client.16461 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T07:26:24.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.362+0000 7f40f79dc740 1 -- 172.21.15.98:0/1318069291 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x55769e04ad20 con 0x55769e163ac0 2024-09-19T07:26:24.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.362+0000 7f40eeffd640 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55769e163ac0 0x55769e165ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:24.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.362+0000 7f40d2ff5640 10 client.16461 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:24.372 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:24.362+0000 7f40eeffd640 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55769e163ac0 0x55769e165ee0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c4a22dd7d46c161 server_cookie=f9e1f9005dc10e19 in_seq=0 out_seq=0 2024-09-19T07:26:25.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:24 smithi098 ceph-mon[30950]: pgmap v133: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 314 op/s 2024-09-19T07:26:25.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:24 smithi139 ceph-mon[35039]: pgmap v133: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 314 op/s 2024-09-19T07:26:25.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:24 smithi162 ceph-mon[35726]: pgmap v133: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 314 op/s 2024-09-19T07:26:25.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.478+0000 7f40d2ff5640 1 -- 172.21.15.98:0/1318069291 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55769e04ad20 con 0x55769e163ac0 2024-09-19T07:26:25.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.478+0000 7f40d2ff5640 10 client.16461 handle_command_reply: tid=0 2024-09-19T07:26:25.479 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.478+0000 7f40f79dc740 1 client.16461 shutdown 2024-09-19T07:26:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.478+0000 7f40f79dc740 1 -- 172.21.15.98:0/1318069291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 msgr2=0x55769e0ecc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.478+0000 7f40f79dc740 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 0x55769e0ecc00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f40e4010fe0 tx=0x7f40e4010a30 comp rx=0 tx=0).stop 2024-09-19T07:26:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.478+0000 7f40f79dc740 1 -- 172.21.15.98:0/1318069291 shutdown_connections 2024-09-19T07:26:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.478+0000 7f40f79dc740 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55769e163ac0 0x55769e165ee0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.478+0000 7f40f79dc740 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55769e0e8ae0 0x55769e0ecc00 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.478+0000 7f40f79dc740 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769e0de220 0x55769e0ec610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.478+0000 7f40f79dc740 1 --2- 172.21.15.98:0/1318069291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55769e0dd900 0x55769e0f12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.478+0000 7f40d2ff5640 0 client.16461 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f79dc740 1 -- 172.21.15.98:0/1318069291 >> 172.21.15.98:0/1318069291 conn(0x55769e0d9e90 msgr2=0x55769e0e4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f79dc740 1 -- 172.21.15.98:0/1318069291 shutdown_connections 2024-09-19T07:26:25.480 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f79dc740 1 -- 172.21.15.98:0/1318069291 wait complete. 2024-09-19T07:26:25.481 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f79dc740 20 client.16461 trim_cache size 0 max 16384 2024-09-19T07:26:25.481 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:26:25.481 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 30, 2024-09-19T07:26:25.481 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:26:25.481 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 18, 2024-09-19T07:26:25.481 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": { 2024-09-19T07:26:25.481 INFO:teuthology.orchestra.run.smithi098.stdout: "7be3d2a5": { 2024-09-19T07:26:25.481 INFO:teuthology.orchestra.run.smithi098.stdout: "version": 18, 2024-09-19T07:26:25.481 INFO:teuthology.orchestra.run.smithi098.stdout: "age_ref": 0.0, 2024-09-19T07:26:25.481 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "QUIESCED", 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: "timeout": 90.0, 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: "expiration": 149.8, 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: "members": { 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: "file:/": { 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: "excluded": false, 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "QUIESCED", 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:25.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:25.483 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:25.483 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:25.483 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:26:25.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f5603640 1 -- 172.21.15.98:0/465207847 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f40d80a33b0 msgr2=0x7f40d80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:25.483 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f5603640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f40d80a33b0 0x7f40d80a5870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f40e8098a90 tx=0x7f40e8098450 comp rx=0 tx=0).stop 2024-09-19T07:26:25.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f5603640 1 -- 172.21.15.98:0/465207847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40f010bfe0 msgr2=0x7f40f019cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:25.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f5603640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40f010bfe0 0x7f40f019cb70 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f40e800e940 tx=0x7f40e800ee00 comp rx=0 tx=0).stop 2024-09-19T07:26:25.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f5603640 1 -- 172.21.15.98:0/465207847 shutdown_connections 2024-09-19T07:26:25.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f5603640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f40d80a33b0 0x7f40d80a5870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:25.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f5603640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f40f010bfe0 0x7f40f019cb70 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:25.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f5603640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f40f01034d0 0x7f40f01987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:25.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f5603640 1 --2- 172.21.15.98:0/465207847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f40f0102bb0 0x7f40f01982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:25.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.479+0000 7f40f5603640 1 -- 172.21.15.98:0/465207847 >> 172.21.15.98:0/465207847 conn(0x7f40f00fc630 msgr2=0x7f40f00fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:25.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.480+0000 7f40f5603640 1 -- 172.21.15.98:0/465207847 shutdown_connections 2024-09-19T07:26:25.484 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:25.480+0000 7f40f5603640 1 -- 172.21.15.98:0/465207847 wait complete. 2024-09-19T07:26:26.207 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7be3d2a5', quiesce took 5.1 seconds. Will release after: 24.700000000000003 2024-09-19T07:26:27.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:26 smithi098 ceph-mon[30950]: pgmap v134: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 666 op/s 2024-09-19T07:26:27.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:26 smithi139 ceph-mon[35039]: pgmap v134: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 666 op/s 2024-09-19T07:26:27.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:26 smithi162 ceph-mon[35726]: pgmap v134: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 666 op/s 2024-09-19T07:26:29.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:28 smithi098 ceph-mon[30950]: pgmap v135: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 510 op/s 2024-09-19T07:26:29.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:28 smithi139 ceph-mon[35039]: pgmap v135: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 510 op/s 2024-09-19T07:26:29.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:28 smithi162 ceph-mon[35726]: pgmap v135: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 510 op/s 2024-09-19T07:26:31.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:30 smithi098 ceph-mon[30950]: pgmap v136: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 523 op/s 2024-09-19T07:26:31.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:30 smithi139 ceph-mon[35039]: pgmap v136: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 523 op/s 2024-09-19T07:26:31.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:30 smithi162 ceph-mon[35726]: pgmap v136: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 523 op/s 2024-09-19T07:26:33.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:32 smithi098 ceph-mon[30950]: pgmap v137: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 1.2 MiB/s wr, 378 op/s 2024-09-19T07:26:33.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:32 smithi139 ceph-mon[35039]: pgmap v137: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 1.2 MiB/s wr, 378 op/s 2024-09-19T07:26:33.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:32 smithi162 ceph-mon[35726]: pgmap v137: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 979 KiB/s rd, 1.2 MiB/s wr, 378 op/s 2024-09-19T07:26:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.561+0000 7fc7c139d640 1 -- 172.21.15.98:0/1437476036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7bc10bee0 msgr2=0x7fc7bc10e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.561+0000 7fc7c139d640 1 --2- 172.21.15.98:0/1437476036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7bc10bee0 0x7fc7bc10e3a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4009ca0 tx=0x7fc7b402a950 comp rx=0 tx=0).stop 2024-09-19T07:26:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.561+0000 7fc7c139d640 1 -- 172.21.15.98:0/1437476036 shutdown_connections 2024-09-19T07:26:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.561+0000 7fc7c139d640 1 --2- 172.21.15.98:0/1437476036 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7bc10bee0 0x7fc7bc10e3a0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.561+0000 7fc7c139d640 1 --2- 172.21.15.98:0/1437476036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7bc1033e0 0x7fc7bc10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.561+0000 7fc7c139d640 1 --2- 172.21.15.98:0/1437476036 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7bc102ac0 0x7fc7bc102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.561+0000 7fc7c139d640 1 -- 172.21.15.98:0/1437476036 >> 172.21.15.98:0/1437476036 conn(0x7fc7bc0fc510 msgr2=0x7fc7bc0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.561+0000 7fc7c139d640 1 -- 172.21.15.98:0/1437476036 shutdown_connections 2024-09-19T07:26:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.561+0000 7fc7c139d640 1 -- 172.21.15.98:0/1437476036 wait complete. 2024-09-19T07:26:34.564 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.561+0000 7fc7c139d640 1 Processor -- start 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7c139d640 1 -- start start 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7c139d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7bc102ac0 0x7fc7bc1981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7c139d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7bc1033e0 0x7fc7bc1986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7c139d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7bc10bee0 0x7fc7bc19ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7c139d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc111ce0 con 0x7fc7bc1033e0 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7c139d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc111b60 con 0x7fc7bc10bee0 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7c139d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc111e60 con 0x7fc7bc102ac0 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7bb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7bc1033e0 0x7fc7bc1986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7bb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7bc1033e0 0x7fc7bc1986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42764/0 (socket says 172.21.15.98:42764) 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7bb7fe640 1 -- 172.21.15.98:0/3904573114 learned_addr learned my addr 172.21.15.98:0/3904573114 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7bbfff640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7bc102ac0 0x7fc7bc1981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7c0b9c640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7bc10bee0 0x7fc7bc19ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7bb7fe640 1 -- 172.21.15.98:0/3904573114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7bc102ac0 msgr2=0x7fc7bc1981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.565 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7bc102ac0 0x7fc7bc1981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7bb7fe640 1 -- 172.21.15.98:0/3904573114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7bc10bee0 msgr2=0x7fc7bc19ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7bc10bee0 0x7fc7bc19ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.562+0000 7fc7bb7fe640 1 -- 172.21.15.98:0/3904573114 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7bc19d1a0 con 0x7fc7bc1033e0 2024-09-19T07:26:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.563+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7bc1033e0 0x7fc7bc1986f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc7b000d770 tx=0x7fc7b000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.563+0000 7fc7b97fa640 1 -- 172.21.15.98:0/3904573114 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0017070 con 0x7fc7bc1033e0 2024-09-19T07:26:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.563+0000 7fc7b97fa640 1 -- 172.21.15.98:0/3904573114 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b0005500 con 0x7fc7bc1033e0 2024-09-19T07:26:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.563+0000 7fc7c139d640 1 -- 172.21.15.98:0/3904573114 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7bc19d490 con 0x7fc7bc1033e0 2024-09-19T07:26:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.563+0000 7fc7b97fa640 1 -- 172.21.15.98:0/3904573114 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0004e00 con 0x7fc7bc1033e0 2024-09-19T07:26:34.566 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.563+0000 7fc7c139d640 1 -- 172.21.15.98:0/3904573114 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7bc1a4d20 con 0x7fc7bc1033e0 2024-09-19T07:26:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.565+0000 7fc7b97fa640 1 -- 172.21.15.98:0/3904573114 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc7b0004fa0 con 0x7fc7bc1033e0 2024-09-19T07:26:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.565+0000 7fc7c546f740 1 Processor -- start 2024-09-19T07:26:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.565+0000 7fc7c546f740 1 -- start start 2024-09-19T07:26:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7c546f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9a2cc0 0x55823a9a30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7c546f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9ad940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7c546f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9ade80 0x55823a9b0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7c546f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55823a9072f0 con 0x55823a9a35e0 2024-09-19T07:26:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7c546f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55823a8af270 con 0x55823a9ade80 2024-09-19T07:26:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7c546f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55823a9032b0 con 0x55823a9a2cc0 2024-09-19T07:26:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7bbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9ad940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7bbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9ad940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42774/0 (socket says 172.21.15.98:42774) 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7bbfff640 1 -- 172.21.15.98:0/3249714273 learned_addr learned my addr 172.21.15.98:0/3249714273 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7b97fa640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc7a40a3430 0x7fc7a40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/3249714273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9ade80 0x55823a9b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7bbfff640 1 -- 172.21.15.98:0/3249714273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9a2cc0 msgr2=0x55823a9a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7c0b9c640 1 --2- 172.21.15.98:0/3249714273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9a2cc0 0x55823a9a30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7bbfff640 1 --2- 172.21.15.98:0/3249714273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9a2cc0 0x55823a9a30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7bbfff640 1 -- 172.21.15.98:0/3249714273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9ade80 msgr2=0x55823a9b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7bbfff640 1 --2- 172.21.15.98:0/3249714273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9ade80 0x55823a9b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7bbfff640 1 -- 172.21.15.98:0/3249714273 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55823a8ae340 con 0x55823a9a35e0 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/3249714273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9ade80 0x55823a9b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7c0b9c640 1 --2- 172.21.15.98:0/3249714273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9a2cc0 0x55823a9a30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7c0b9c640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc7a40a3430 0x7fc7a40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7b97fa640 1 -- 172.21.15.98:0/3904573114 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc7b00cf6b0 con 0x7fc7bc1033e0 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.566+0000 7fc7bbfff640 1 --2- 172.21.15.98:0/3249714273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9ad940 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00ac20 tx=0x7fc7ac00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5cff44b58275a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7a27fc640 1 -- 172.21.15.98:0/3249714273 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac01d070 con 0x55823a9a35e0 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7a27fc640 1 -- 172.21.15.98:0/3249714273 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7ac018b20 con 0x55823a9a35e0 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7a27fc640 1 -- 172.21.15.98:0/3249714273 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac010c00 con 0x55823a9a35e0 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7c546f740 1 -- 172.21.15.98:0/3249714273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 msgr2=0x55823a9ad940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7c0b9c640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc7a40a3430 0x7fc7a40a58f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4005cc0 tx=0x7fc7b4005fd0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7c546f740 1 --2- 172.21.15.98:0/3249714273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9ad940 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00ac20 tx=0x7fc7ac00f790 comp rx=0 tx=0).stop 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7c546f740 1 -- 172.21.15.98:0/3249714273 shutdown_connections 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7c546f740 1 --2- 172.21.15.98:0/3249714273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9ade80 0x55823a9b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7c546f740 1 --2- 172.21.15.98:0/3249714273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9ad940 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7c546f740 1 --2- 172.21.15.98:0/3249714273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9a2cc0 0x55823a9a30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7c546f740 1 -- 172.21.15.98:0/3249714273 >> 172.21.15.98:0/3249714273 conn(0x55823a99f230 msgr2=0x55823a99f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7c546f740 1 -- 172.21.15.98:0/3249714273 shutdown_connections 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.567+0000 7fc7c546f740 1 -- 172.21.15.98:0/3249714273 wait complete. 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.568+0000 7fc7c546f740 1 -- start start 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.568+0000 7fc7c546f740 1 Processor -- start 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.568+0000 7fc7c546f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a2cc0 0x55823a9aad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.568+0000 7fc7c546f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9ab260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.568+0000 7fc7c546f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.568+0000 7fc7c546f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55823a9b0a50 con 0x55823a9a35e0 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.568+0000 7fc7c546f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55823a890290 con 0x55823a9a2cc0 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.568+0000 7fc7c546f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55823a9b0bd0 con 0x55823a9ade80 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.568+0000 7fc7c546f740 10 client.0 _ll_register_callbacks cb 0x55823a8c1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.568+0000 7fc7bb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.568+0000 7fc7bb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9ab260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42776/0 (socket says 172.21.15.98:42776) 2024-09-19T07:26:34.577 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.568+0000 7fc7bb7fe640 1 -- 172.21.15.98:0/2602533409 learned_addr learned my addr 172.21.15.98:0/2602533409 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc7c0b9c640 1 --2- 172.21.15.98:0/2602533409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc7bb7fe640 1 -- 172.21.15.98:0/2602533409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 msgr2=0x55823a9ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/2602533409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9ab7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc7bb7fe640 1 -- 172.21.15.98:0/2602533409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a2cc0 msgr2=0x55823a9aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/2602533409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a2cc0 0x55823a9aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc7bb7fe640 1 -- 172.21.15.98:0/2602533409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55823a61a210 con 0x55823a9a35e0 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/2602533409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9ab260 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00cd3d0 tx=0x7fc7b009b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5a185eb6872c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc79b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc79b7fe640 1 -- 172.21.15.98:0/2602533409 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0020070 con 0x55823a9a35e0 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc79b7fe640 1 -- 172.21.15.98:0/2602533409 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc7b0009cc0 con 0x55823a9a35e0 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc7c546f740 1 -- 172.21.15.98:0/2602533409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7ac018b20 con 0x55823a9a35e0 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc79b7fe640 1 -- 172.21.15.98:0/2602533409 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc7b009c060 con 0x55823a9a35e0 2024-09-19T07:26:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc7c546f740 10 client.16473 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc7c546f740 1 -- 172.21.15.98:0/2602533409 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55823a6e6620 con 0x55823a9a35e0 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc79b7fe640 1 -- 172.21.15.98:0/2602533409 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7ac018b20 con 0x55823a9a35e0 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc79b7fe640 1 -- 172.21.15.98:0/2602533409 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fc7b0097fd0 con 0x55823a9a35e0 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc7c546f740 10 client.16473 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.569+0000 7fc7c546f740 10 client.16473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.570+0000 7fc7c546f740 20 client.16473 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.570+0000 7fc7c546f740 1 --2- 172.21.15.98:0/2602533409 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55823a9bdde0 0x55823a9c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.570+0000 7fc7c546f740 4 client.16473 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.570+0000 7fc7c546f740 1 -- 172.21.15.98:0/2602533409 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55823a914a20 con 0x55823a9bdde0 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.570+0000 7fc7bbfff640 1 --2- 172.21.15.98:0/2602533409 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55823a9bdde0 0x55823a9c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.570+0000 7fc7bbfff640 1 --2- 172.21.15.98:0/2602533409 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55823a9bdde0 0x55823a9c02a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2f127e721238283 server_cookie=a3f62b585d5944cf in_seq=0 out_seq=0 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.570+0000 7fc79b7fe640 10 client.16473 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc79b7fe640 1 -- 172.21.15.98:0/2602533409 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55823a914a20 con 0x55823a9bdde0 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc79b7fe640 10 client.16473 handle_command_reply: tid=0 2024-09-19T07:26:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc7c546f740 1 client.16473 shutdown 2024-09-19T07:26:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc7c546f740 1 -- 172.21.15.98:0/2602533409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 msgr2=0x55823a9ab260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc7c546f740 1 --2- 172.21.15.98:0/2602533409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9ab260 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00cd3d0 tx=0x7fc7b009b4a0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc7c546f740 1 -- 172.21.15.98:0/2602533409 shutdown_connections 2024-09-19T07:26:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc7c546f740 1 --2- 172.21.15.98:0/2602533409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc7c546f740 1 --2- 172.21.15.98:0/2602533409 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55823a9bdde0 0x55823a9c02a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc7c546f740 1 --2- 172.21.15.98:0/2602533409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9ab260 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc7c546f740 1 --2- 172.21.15.98:0/2602533409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a2cc0 0x55823a9aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc79b7fe640 0 client.16473 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc7c546f740 1 -- 172.21.15.98:0/2602533409 >> 172.21.15.98:0/2602533409 conn(0x55823a99f230 msgr2=0x55823a9a4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc7c546f740 1 -- 172.21.15.98:0/2602533409 shutdown_connections 2024-09-19T07:26:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc7c546f740 1 -- 172.21.15.98:0/2602533409 wait complete. 2024-09-19T07:26:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.571+0000 7fc7c546f740 20 client.16473 trim_cache size 0 max 16384 2024-09-19T07:26:34.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.585+0000 7fc7c546f740 1 Processor -- start 2024-09-19T07:26:34.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.585+0000 7fc7c546f740 1 -- start start 2024-09-19T07:26:34.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7c546f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a2cc0 0x55823a9a5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7c546f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.590 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7c546f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7c546f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc1b0080 con 0x55823a9a35e0 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7c546f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc1ad890 con 0x55823a9a2cc0 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7c546f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc1ab6e0 con 0x55823a9ade80 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7bb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7bb7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9a95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42780/0 (socket says 172.21.15.98:42780) 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7bb7fe640 1 -- 172.21.15.98:0/1496159076 learned_addr learned my addr 172.21.15.98:0/1496159076 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7bbfff640 1 --2- 172.21.15.98:0/1496159076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a2cc0 0x55823a9a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7c0b9c640 1 --2- 172.21.15.98:0/1496159076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7bb7fe640 1 -- 172.21.15.98:0/1496159076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 msgr2=0x55823a9ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/1496159076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9ab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7bb7fe640 1 -- 172.21.15.98:0/1496159076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a2cc0 msgr2=0x55823a9a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/1496159076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a2cc0 0x55823a9a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.591 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7bb7fe640 1 -- 172.21.15.98:0/1496159076 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55823a9a3410 con 0x55823a9a35e0 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7c0b9c640 1 --2- 172.21.15.98:0/1496159076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/1496159076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9a95f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00cfc00 tx=0x7fc7b009b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd78a158bf72a264 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7a1ffb640 1 -- 172.21.15.98:0/1496159076 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0020050 con 0x55823a9a35e0 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7a1ffb640 1 -- 172.21.15.98:0/1496159076 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b009fd10 con 0x55823a9a35e0 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.586+0000 7fc7a1ffb640 1 -- 172.21.15.98:0/1496159076 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0097fd0 con 0x55823a9a35e0 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.587+0000 7fc7c546f740 1 -- 172.21.15.98:0/1496159076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 msgr2=0x55823a9a95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.587+0000 7fc7c546f740 1 --2- 172.21.15.98:0/1496159076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9a95f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00cfc00 tx=0x7fc7b009b5d0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.587+0000 7fc7c546f740 1 -- 172.21.15.98:0/1496159076 shutdown_connections 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.587+0000 7fc7c546f740 1 --2- 172.21.15.98:0/1496159076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.587+0000 7fc7c546f740 1 --2- 172.21.15.98:0/1496159076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a35e0 0x55823a9a95f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.587+0000 7fc7c546f740 1 --2- 172.21.15.98:0/1496159076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a2cc0 0x55823a9a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.587+0000 7fc7c546f740 1 -- 172.21.15.98:0/1496159076 >> 172.21.15.98:0/1496159076 conn(0x55823a99f230 msgr2=0x55823a9acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:34.592 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.587+0000 7fc7c546f740 1 -- 172.21.15.98:0/1496159076 shutdown_connections 2024-09-19T07:26:34.593 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.587+0000 7fc7c546f740 1 -- 172.21.15.98:0/1496159076 wait complete. 2024-09-19T07:26:34.593 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.587+0000 7fc7c546f740 1 -- start start 2024-09-19T07:26:34.593 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7c546f740 1 Processor -- start 2024-09-19T07:26:34.593 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7c546f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a2cc0 0x55823a9a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.593 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7c546f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a35e0 0x55823a9a8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.593 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7c546f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9a87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.593 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7c546f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc1abd50 con 0x55823a9a2cc0 2024-09-19T07:26:34.593 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7c546f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc1ad1c0 con 0x55823a9a35e0 2024-09-19T07:26:34.593 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7c546f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc7bc1ac420 con 0x55823a9ade80 2024-09-19T07:26:34.593 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7c546f740 10 client.0 _ll_register_callbacks cb 0x7fc7b000d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:34.593 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7bbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a2cc0 0x55823a9a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.593 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7bbfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a2cc0 0x55823a9a7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:42782/0 (socket says 172.21.15.98:42782) 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7bbfff640 1 -- 172.21.15.98:0/2881758511 learned_addr learned my addr 172.21.15.98:0/2881758511 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a35e0 0x55823a9a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7c0b9c640 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9a87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7bbfff640 1 -- 172.21.15.98:0/2881758511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 msgr2=0x55823a9a87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7bbfff640 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9a87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7bbfff640 1 -- 172.21.15.98:0/2881758511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a35e0 msgr2=0x55823a9a8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7bbfff640 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a35e0 0x55823a9a8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7bbfff640 1 -- 172.21.15.98:0/2881758511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55823aa27b70 con 0x55823a9a2cc0 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc7bbfff640 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a2cc0 0x55823a9a7d30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac01b040 tx=0x7fc7ac00a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665e16633ca8d2dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.588+0000 7fc79b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc79b7fe640 1 -- 172.21.15.98:0/2881758511 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac030020 con 0x55823a9a2cc0 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc79b7fe640 1 -- 172.21.15.98:0/2881758511 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fc7ac010ca0 con 0x55823a9a2cc0 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc7c546f740 1 -- 172.21.15.98:0/2881758511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7b009fd10 con 0x55823a9a2cc0 2024-09-19T07:26:34.594 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc79b7fe640 1 -- 172.21.15.98:0/2881758511 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc7ac01d040 con 0x55823a9a2cc0 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc7c546f740 10 client.16479 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc7c546f740 1 -- 172.21.15.98:0/2881758511 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55823aa28e30 con 0x55823a9a2cc0 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc79b7fe640 1 -- 172.21.15.98:0/2881758511 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b009fd10 con 0x55823a9a2cc0 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc79b7fe640 1 -- 172.21.15.98:0/2881758511 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fc7ac018440 con 0x55823a9a2cc0 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc7c546f740 10 client.16479 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc7c546f740 10 client.16479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc7c546f740 20 client.16479 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc7c546f740 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55823aa292d0 0x55823aa2b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc7c546f740 4 client.16479 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc7c546f740 1 -- 172.21.15.98:0/2881758511 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55823a90ed70 con 0x55823aa292d0 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.589+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55823aa292d0 0x55823aa2b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.590+0000 7fc7bb7fe640 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55823aa292d0 0x55823aa2b6c0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fecbc0c36a8d9a81 server_cookie=ec444638bbaefa51 in_seq=0 out_seq=0 2024-09-19T07:26:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.590+0000 7fc79b7fe640 10 client.16479 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:34.695 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.694+0000 7fc79b7fe640 1 -- 172.21.15.98:0/2881758511 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55823a90ed70 con 0x55823aa292d0 2024-09-19T07:26:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.694+0000 7fc79b7fe640 10 client.16479 handle_command_reply: tid=0 2024-09-19T07:26:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.694+0000 7fc7c546f740 1 client.16479 shutdown 2024-09-19T07:26:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c546f740 1 -- 172.21.15.98:0/2881758511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a2cc0 msgr2=0x55823a9a7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c546f740 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a2cc0 0x55823a9a7d30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac01b040 tx=0x7fc7ac00a490 comp rx=0 tx=0).stop 2024-09-19T07:26:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c546f740 1 -- 172.21.15.98:0/2881758511 shutdown_connections 2024-09-19T07:26:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c546f740 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55823a9ade80 0x55823a9a87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c546f740 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55823a9a35e0 0x55823a9a8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c546f740 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55823aa292d0 0x55823aa2b6c0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c546f740 1 --2- 172.21.15.98:0/2881758511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55823a9a2cc0 0x55823a9a7d30 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc79b7fe640 0 client.16479 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:34.696 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c546f740 1 -- 172.21.15.98:0/2881758511 >> 172.21.15.98:0/2881758511 conn(0x55823a99f230 msgr2=0x55823a9b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c546f740 1 -- 172.21.15.98:0/2881758511 shutdown_connections 2024-09-19T07:26:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c546f740 1 -- 172.21.15.98:0/2881758511 wait complete. 2024-09-19T07:26:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c546f740 20 client.16479 trim_cache size 0 max 16384 2024-09-19T07:26:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:26:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:26:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:26:34.697 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:26:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c139d640 1 -- 172.21.15.98:0/3904573114 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc7a40a3430 msgr2=0x7fc7a40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c139d640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc7a40a3430 0x7fc7a40a58f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4005cc0 tx=0x7fc7b4005fd0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c139d640 1 -- 172.21.15.98:0/3904573114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7bc1033e0 msgr2=0x7fc7bc1986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.695+0000 7fc7c139d640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7bc1033e0 0x7fc7bc1986f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc7b000d770 tx=0x7fc7b000dc30 comp rx=0 tx=0).stop 2024-09-19T07:26:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.696+0000 7fc7c139d640 1 -- 172.21.15.98:0/3904573114 shutdown_connections 2024-09-19T07:26:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.696+0000 7fc7c139d640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fc7a40a3430 0x7fc7a40a58f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.696+0000 7fc7c139d640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc7bc10bee0 0x7fc7bc19ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.698 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.696+0000 7fc7c139d640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc7bc1033e0 0x7fc7bc1986f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.696+0000 7fc7c139d640 1 --2- 172.21.15.98:0/3904573114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7bc102ac0 0x7fc7bc1981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.696+0000 7fc7c139d640 1 -- 172.21.15.98:0/3904573114 >> 172.21.15.98:0/3904573114 conn(0x7fc7bc0fc510 msgr2=0x7fc7bc0fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.696+0000 7fc7c139d640 1 -- 172.21.15.98:0/3904573114 shutdown_connections 2024-09-19T07:26:34.699 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:34.696+0000 7fc7c139d640 1 -- 172.21.15.98:0/3904573114 wait complete. 2024-09-19T07:26:35.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:34 smithi098 ceph-mon[30950]: pgmap v138: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 983 KiB/s wr, 366 op/s 2024-09-19T07:26:35.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:34 smithi139 ceph-mon[35039]: pgmap v138: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 983 KiB/s wr, 366 op/s 2024-09-19T07:26:35.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:34 smithi162 ceph-mon[35726]: pgmap v138: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 983 KiB/s wr, 366 op/s 2024-09-19T07:26:37.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:36 smithi098 ceph-mon[30950]: pgmap v139: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 1.1 MiB/s wr, 427 op/s 2024-09-19T07:26:37.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:36 smithi139 ceph-mon[35039]: pgmap v139: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 1.1 MiB/s wr, 427 op/s 2024-09-19T07:26:37.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:36 smithi162 ceph-mon[35726]: pgmap v139: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 1.1 MiB/s wr, 427 op/s 2024-09-19T07:26:39.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:38 smithi098 ceph-mon[30950]: pgmap v140: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 114 KiB/s wr, 75 op/s 2024-09-19T07:26:39.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:38 smithi139 ceph-mon[35039]: pgmap v140: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 114 KiB/s wr, 75 op/s 2024-09-19T07:26:39.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:38 smithi162 ceph-mon[35726]: pgmap v140: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 114 KiB/s wr, 75 op/s 2024-09-19T07:26:41.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:40 smithi098 ceph-mon[30950]: pgmap v141: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 114 KiB/s wr, 77 op/s 2024-09-19T07:26:41.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:40 smithi139 ceph-mon[35039]: pgmap v141: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 114 KiB/s wr, 77 op/s 2024-09-19T07:26:41.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:40 smithi162 ceph-mon[35726]: pgmap v141: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 114 KiB/s wr, 77 op/s 2024-09-19T07:26:43.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:42 smithi098 ceph-mon[30950]: pgmap v142: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 102 KiB/s wr, 65 op/s 2024-09-19T07:26:43.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:42 smithi139 ceph-mon[35039]: pgmap v142: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 102 KiB/s wr, 65 op/s 2024-09-19T07:26:43.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:42 smithi162 ceph-mon[35726]: pgmap v142: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 102 KiB/s wr, 65 op/s 2024-09-19T07:26:45.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:44 smithi098 ceph-mon[30950]: pgmap v143: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 102 KiB/s wr, 63 op/s 2024-09-19T07:26:45.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:44 smithi139 ceph-mon[35039]: pgmap v143: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 102 KiB/s wr, 63 op/s 2024-09-19T07:26:45.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:44 smithi162 ceph-mon[35726]: pgmap v143: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 102 KiB/s wr, 63 op/s 2024-09-19T07:26:47.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:46 smithi098 ceph-mon[30950]: pgmap v144: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 106 KiB/s wr, 66 op/s 2024-09-19T07:26:47.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:46 smithi139 ceph-mon[35039]: pgmap v144: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 106 KiB/s wr, 66 op/s 2024-09-19T07:26:47.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:46 smithi162 ceph-mon[35726]: pgmap v144: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 106 KiB/s wr, 66 op/s 2024-09-19T07:26:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.793+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/3096172335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cd41069c0 msgr2=0x7f0cd4106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.793+0000 7f0cdc4e4640 1 --2- 172.21.15.98:0/3096172335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cd41069c0 0x7f0cd4106da0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009930 tx=0x7f0cd002a420 comp rx=0 tx=0).stop 2024-09-19T07:26:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.793+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/3096172335 shutdown_connections 2024-09-19T07:26:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.793+0000 7f0cdc4e4640 1 --2- 172.21.15.98:0/3096172335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cd4101350 0x7f0cd410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.793+0000 7f0cdc4e4640 1 --2- 172.21.15.98:0/3096172335 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd41009b0 0x7f0cd4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.793+0000 7f0cdc4e4640 1 --2- 172.21.15.98:0/3096172335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cd41069c0 0x7f0cd4106da0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.796 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.793+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/3096172335 >> 172.21.15.98:0/3096172335 conn(0x7f0cd4077990 msgr2=0x7f0cd40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:47.797 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.793+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/3096172335 shutdown_connections 2024-09-19T07:26:47.797 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.793+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/3096172335 wait complete. 2024-09-19T07:26:47.797 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cdc4e4640 1 Processor -- start 2024-09-19T07:26:47.797 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cdc4e4640 1 -- start start 2024-09-19T07:26:47.797 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cdc4e4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cd41009b0 0x7f0cd41971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.797 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cdc4e4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cd4101350 0x7f0cd4197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.797 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cdc4e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd41069c0 0x7f0cd419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.797 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cdc4e4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd4110e00 con 0x7f0cd41009b0 2024-09-19T07:26:47.797 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cdc4e4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd4110c80 con 0x7f0cd4101350 2024-09-19T07:26:47.797 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cdc4e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd4110f80 con 0x7f0cd41069c0 2024-09-19T07:26:47.797 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cda280640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cd41009b0 0x7f0cd41971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.797 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cda280640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cd41009b0 0x7f0cd41971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41048/0 (socket says 172.21.15.98:41048) 2024-09-19T07:26:47.798 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cda280640 1 -- 172.21.15.98:0/387725695 learned_addr learned my addr 172.21.15.98:0/387725695 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:47.798 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cdaa81640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd41069c0 0x7f0cd419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.798 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cda280640 1 -- 172.21.15.98:0/387725695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd41069c0 msgr2=0x7f0cd419ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.798 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cda280640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd41069c0 0x7f0cd419ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.798 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cda280640 1 -- 172.21.15.98:0/387725695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cd4101350 msgr2=0x7f0cd4197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.798 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cd4101350 0x7f0cd4197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.798 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cda280640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cd4101350 0x7f0cd4197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.798 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cda280640 1 -- 172.21.15.98:0/387725695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd419c1c0 con 0x7f0cd41009b0 2024-09-19T07:26:47.798 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cdaa81640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd41069c0 0x7f0cd419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:26:47.798 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.794+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cd4101350 0x7f0cd4197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:26:47.798 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.795+0000 7f0cda280640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cd41009b0 0x7f0cd41971d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009a50 tx=0x7f0cd0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:47.798 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.795+0000 7f0ccb7fe640 1 -- 172.21.15.98:0/387725695 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd003f030 con 0x7f0cd41009b0 2024-09-19T07:26:47.799 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.795+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/387725695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd419c450 con 0x7f0cd41009b0 2024-09-19T07:26:47.799 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.795+0000 7f0ccb7fe640 1 -- 172.21.15.98:0/387725695 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd0003ce0 con 0x7f0cd41009b0 2024-09-19T07:26:47.799 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.795+0000 7f0ccb7fe640 1 -- 172.21.15.98:0/387725695 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0035070 con 0x7f0cd41009b0 2024-09-19T07:26:47.799 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.795+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/387725695 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd41a3d40 con 0x7f0cd41009b0 2024-09-19T07:26:47.807 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.797+0000 7f0ccb7fe640 1 -- 172.21.15.98:0/387725695 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0cd0042030 con 0x7f0cd41009b0 2024-09-19T07:26:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cdf286740 1 Processor -- start 2024-09-19T07:26:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cdf286740 1 -- start start 2024-09-19T07:26:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cdf286740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 0x558de8d7dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cdf286740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d7e290 0x558de8d8a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0ccb7fe640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0cc00a3460 0x7f0cc00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cdf286740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d8aec0 0x558de8d8d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cdf286740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558de8ce22f0 con 0x558de8d7d970 2024-09-19T07:26:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cdf286740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558de8c8a270 con 0x558de8d8aec0 2024-09-19T07:26:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cdf286740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558de8cde2b0 con 0x558de8d7e290 2024-09-19T07:26:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cdaa81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 0x558de8d7dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.808 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0cc00a3460 0x7f0cc00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cdaa81640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 0x558de8d7dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41050/0 (socket says 172.21.15.98:41050) 2024-09-19T07:26:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cdaa81640 1 -- 172.21.15.98:0/2771170437 learned_addr learned my addr 172.21.15.98:0/2771170437 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0ccb7fe640 1 -- 172.21.15.98:0/387725695 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0cd00f0390 con 0x7f0cd41009b0 2024-09-19T07:26:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.798+0000 7f0cda280640 1 --2- 172.21.15.98:0/2771170437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d7e290 0x558de8d8a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.799+0000 7f0cdaa81640 1 --2- 172.21.15.98:0/2771170437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d8aec0 0x558de8d8d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.799+0000 7f0cda280640 1 -- 172.21.15.98:0/2771170437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d8aec0 msgr2=0x558de8d8d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.799+0000 7f0cda280640 1 --2- 172.21.15.98:0/2771170437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d8aec0 0x558de8d8d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.799+0000 7f0cda280640 1 -- 172.21.15.98:0/2771170437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 msgr2=0x558de8d7dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.799+0000 7f0cda280640 1 --2- 172.21.15.98:0/2771170437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 0x558de8d7dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.799+0000 7f0cda280640 1 -- 172.21.15.98:0/2771170437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558de8c89340 con 0x558de8d7e290 2024-09-19T07:26:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.799+0000 7f0cdaa81640 1 --2- 172.21.15.98:0/2771170437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 0x558de8d7dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:26:47.809 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.799+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0cc00a3460 0x7f0cc00a5920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4105f00 tx=0x7f0cc4005d30 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.799+0000 7f0cda280640 1 --2- 172.21.15.98:0/2771170437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d7e290 0x558de8d8a980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00edab0 tx=0x7f0cd002a420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f3d2dfd56396c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.799+0000 7f0cc8bfe640 1 -- 172.21.15.98:0/2771170437 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0049070 con 0x558de8d7e290 2024-09-19T07:26:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.799+0000 7f0cc8bfe640 1 -- 172.21.15.98:0/2771170437 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd00bcd40 con 0x558de8d7e290 2024-09-19T07:26:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.799+0000 7f0cc8bfe640 1 -- 172.21.15.98:0/2771170437 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd003b460 con 0x558de8d7e290 2024-09-19T07:26:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.800+0000 7f0cdf286740 1 -- 172.21.15.98:0/2771170437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d7e290 msgr2=0x558de8d8a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.800+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2771170437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d7e290 0x558de8d8a980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00edab0 tx=0x7f0cd002a420 comp rx=0 tx=0).stop 2024-09-19T07:26:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.800+0000 7f0cdf286740 1 -- 172.21.15.98:0/2771170437 shutdown_connections 2024-09-19T07:26:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.800+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2771170437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d8aec0 0x558de8d8d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.800+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2771170437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d7e290 0x558de8d8a980 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.810 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.800+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2771170437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 0x558de8d7dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.800+0000 7f0cdf286740 1 -- 172.21.15.98:0/2771170437 >> 172.21.15.98:0/2771170437 conn(0x558de8d7a060 msgr2=0x558de8d7a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.800+0000 7f0cdf286740 1 -- 172.21.15.98:0/2771170437 shutdown_connections 2024-09-19T07:26:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.800+0000 7f0cdf286740 1 -- 172.21.15.98:0/2771170437 wait complete. 2024-09-19T07:26:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.800+0000 7f0cdf286740 1 -- start start 2024-09-19T07:26:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cdf286740 1 Processor -- start 2024-09-19T07:26:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cdf286740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7d970 0x558de8d87ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cdf286740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 0x558de8d88420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cdf286740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 0x558de8d88960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cdf286740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558de8cde2b0 con 0x558de8d7e290 2024-09-19T07:26:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cdf286740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558de8c6b290 con 0x558de8d7d970 2024-09-19T07:26:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cdf286740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558de8d8d8b0 con 0x558de8d8aec0 2024-09-19T07:26:47.811 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cdf286740 10 client.0 _ll_register_callbacks cb 0x558de8c9c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cd9a7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 0x558de8d88420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cd9a7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 0x558de8d88420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41054/0 (socket says 172.21.15.98:41054) 2024-09-19T07:26:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cd9a7f640 1 -- 172.21.15.98:0/2983698895 learned_addr learned my addr 172.21.15.98:0/2983698895 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cdaa81640 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 0x558de8d88960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cda280640 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7d970 0x558de8d87ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cd9a7f640 1 -- 172.21.15.98:0/2983698895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 msgr2=0x558de8d88960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 0x558de8d88960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cd9a7f640 1 -- 172.21.15.98:0/2983698895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7d970 msgr2=0x558de8d87ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7d970 0x558de8d87ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cd9a7f640 1 -- 172.21.15.98:0/2983698895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558de89f5210 con 0x558de8d7e290 2024-09-19T07:26:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cda280640 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7d970 0x558de8d87ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:26:47.812 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 0x558de8d88420 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400f9d0 tx=0x7f0cc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511bc437a7707856 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.801+0000 7f0cbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cbdffb640 1 -- 172.21.15.98:0/2983698895 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4020070 con 0x558de8d7e290 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cbdffb640 1 -- 172.21.15.98:0/2983698895 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0cc400ecc0 con 0x558de8d7e290 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cdf286740 1 -- 172.21.15.98:0/2983698895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cd00bcd40 con 0x558de8d7e290 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cbdffb640 1 -- 172.21.15.98:0/2983698895 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0cc402c050 con 0x558de8d7e290 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cdf286740 10 client.16491 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cdf286740 1 -- 172.21.15.98:0/2983698895 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558de8ac1620 con 0x558de8d7e290 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cbdffb640 1 -- 172.21.15.98:0/2983698895 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cd00bcd40 con 0x558de8d7e290 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cbdffb640 1 -- 172.21.15.98:0/2983698895 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f0cc4024440 con 0x558de8d7e290 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cdf286740 10 client.16491 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cdf286740 10 client.16491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cdf286740 20 client.16491 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:47.813 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558de8d9ac50 0x558de8d9d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cdf286740 4 client.16491 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cdf286740 1 -- 172.21.15.98:0/2983698895 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558de8cefa20 con 0x558de8d9ac50 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.802+0000 7f0cda280640 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558de8d9ac50 0x558de8d9d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.803+0000 7f0cbdffb640 10 client.16491 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.803+0000 7f0cda280640 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558de8d9ac50 0x558de8d9d0a0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8f5eb3cce79018c server_cookie=8de96fe1f9bd5a70 in_seq=0 out_seq=0 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cbdffb640 1 -- 172.21.15.98:0/2983698895 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558de8cefa20 con 0x558de8d9ac50 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cbdffb640 10 client.16491 handle_command_reply: tid=0 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cdf286740 1 client.16491 shutdown 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cdf286740 1 -- 172.21.15.98:0/2983698895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 msgr2=0x558de8d88420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 0x558de8d88420 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400f9d0 tx=0x7f0cc40046c0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cdf286740 1 -- 172.21.15.98:0/2983698895 shutdown_connections 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 0x558de8d88960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.814 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558de8d9ac50 0x558de8d9d0a0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 0x558de8d88420 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2983698895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7d970 0x558de8d87ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cbdffb640 0 client.16491 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cdf286740 1 -- 172.21.15.98:0/2983698895 >> 172.21.15.98:0/2983698895 conn(0x558de8d7a060 msgr2=0x558de8d7fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cdf286740 1 -- 172.21.15.98:0/2983698895 shutdown_connections 2024-09-19T07:26:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cdf286740 1 -- 172.21.15.98:0/2983698895 wait complete. 2024-09-19T07:26:47.815 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.804+0000 7f0cdf286740 20 client.16491 trim_cache size 0 max 16384 2024-09-19T07:26:47.823 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.818+0000 7f0cdf286740 1 Processor -- start 2024-09-19T07:26:47.823 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.818+0000 7f0cdf286740 1 -- start start 2024-09-19T07:26:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.818+0000 7f0cdf286740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7d970 0x558de8da2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.818+0000 7f0cdf286740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 0x558de8da2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.818+0000 7f0cdf286740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 0x558de8d85120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.818+0000 7f0cdf286740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41adfb0 con 0x558de8d7e290 2024-09-19T07:26:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.818+0000 7f0cdf286740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41ab7c0 con 0x558de8d7d970 2024-09-19T07:26:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.818+0000 7f0cdf286740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41a9610 con 0x558de8d8aec0 2024-09-19T07:26:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cd9a7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 0x558de8da2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cd9a7f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 0x558de8da2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41058/0 (socket says 172.21.15.98:41058) 2024-09-19T07:26:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cd9a7f640 1 -- 172.21.15.98:0/2911574830 learned_addr learned my addr 172.21.15.98:0/2911574830 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cdaa81640 1 --2- 172.21.15.98:0/2911574830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 0x558de8d85120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cda280640 1 --2- 172.21.15.98:0/2911574830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7d970 0x558de8da2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.824 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cd9a7f640 1 -- 172.21.15.98:0/2911574830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 msgr2=0x558de8d85120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/2911574830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 0x558de8d85120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cd9a7f640 1 -- 172.21.15.98:0/2911574830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7d970 msgr2=0x558de8da2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/2911574830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7d970 0x558de8da2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cd9a7f640 1 -- 172.21.15.98:0/2911574830 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558de8d79b00 con 0x558de8d7e290 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cdaa81640 1 --2- 172.21.15.98:0/2911574830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 0x558de8d85120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/2911574830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 0x558de8da2eb0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4024890 tx=0x7f0cc400ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e5aec630d4d584 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cbffff640 1 -- 172.21.15.98:0/2911574830 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4034030 con 0x558de8d7e290 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cbffff640 1 -- 172.21.15.98:0/2911574830 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cc400d760 con 0x558de8d7e290 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.819+0000 7f0cbffff640 1 -- 172.21.15.98:0/2911574830 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4020050 con 0x558de8d7e290 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 -- 172.21.15.98:0/2911574830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 msgr2=0x558de8da2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2911574830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 0x558de8da2eb0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4024890 tx=0x7f0cc400ff50 comp rx=0 tx=0).stop 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 -- 172.21.15.98:0/2911574830 shutdown_connections 2024-09-19T07:26:47.825 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2911574830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 0x558de8d85120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2911574830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7e290 0x558de8da2eb0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 --2- 172.21.15.98:0/2911574830 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7d970 0x558de8da2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 -- 172.21.15.98:0/2911574830 >> 172.21.15.98:0/2911574830 conn(0x558de8d7a060 msgr2=0x558de8d89f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 -- 172.21.15.98:0/2911574830 shutdown_connections 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 -- 172.21.15.98:0/2911574830 wait complete. 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 -- start start 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 Processor -- start 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 0x558de8d93270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.820+0000 7f0cdf286740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7e290 0x558de8d8e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cdf286740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 0x558de8d8ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cdf286740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41a9c80 con 0x558de8d7d970 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cdf286740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41ab0f0 con 0x558de8d7e290 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cdf286740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd41aa350 con 0x558de8d8aec0 2024-09-19T07:26:47.826 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cdf286740 10 client.0 _ll_register_callbacks cb 0x7f0cc4013070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cda280640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 0x558de8d93270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cda280640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 0x558de8d93270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41072/0 (socket says 172.21.15.98:41072) 2024-09-19T07:26:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cda280640 1 -- 172.21.15.98:0/4259463299 learned_addr learned my addr 172.21.15.98:0/4259463299 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7e290 0x558de8d8e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cda280640 1 -- 172.21.15.98:0/4259463299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 msgr2=0x558de8d8ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cda280640 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 0x558de8d8ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cda280640 1 -- 172.21.15.98:0/4259463299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7e290 msgr2=0x558de8d8e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cda280640 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7e290 0x558de8d8e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cda280640 1 -- 172.21.15.98:0/4259463299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558de8d8f320 con 0x558de8d7d970 2024-09-19T07:26:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7e290 0x558de8d8e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:26:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cda280640 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 0x558de8d93270 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00bc2f0 tx=0x7f0cd004bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27ad7e3f3fed82c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:47.827 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:26:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cbdffb640 1 -- 172.21.15.98:0/4259463299 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00a4070 con 0x558de8d7d970 2024-09-19T07:26:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cbdffb640 1 -- 172.21.15.98:0/4259463299 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f0cd003bd00 con 0x558de8d7d970 2024-09-19T07:26:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cdf286740 1 -- 172.21.15.98:0/4259463299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cc400d760 con 0x558de8d7d970 2024-09-19T07:26:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cbdffb640 1 -- 172.21.15.98:0/4259463299 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0cd0049040 con 0x558de8d7d970 2024-09-19T07:26:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cdf286740 10 client.16497 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cdf286740 1 -- 172.21.15.98:0/4259463299 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558de8e059e0 con 0x558de8d7d970 2024-09-19T07:26:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.821+0000 7f0cbdffb640 1 -- 172.21.15.98:0/4259463299 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0cc400d760 con 0x558de8d7d970 2024-09-19T07:26:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.822+0000 7f0cbdffb640 1 -- 172.21.15.98:0/4259463299 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f0cd0031bd0 con 0x558de8d7d970 2024-09-19T07:26:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.822+0000 7f0cdf286740 10 client.16497 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.822+0000 7f0cdf286740 10 client.16497 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:26:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.822+0000 7f0cdf286740 20 client.16497 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:47.828 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.822+0000 7f0cdf286740 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558de8e05fa0 0x558de8e08400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.822+0000 7f0cdf286740 4 client.16497 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:26:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.822+0000 7f0cdf286740 1 -- 172.21.15.98:0/4259463299 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558de8ce9d70 con 0x558de8e05fa0 2024-09-19T07:26:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.822+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558de8e05fa0 0x558de8e08400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.822+0000 7f0cbdffb640 10 client.16497 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:47.829 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.822+0000 7f0cd9a7f640 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558de8e05fa0 0x558de8e08400 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1df82a0ba740abdd server_cookie=da5742cfc46d3094 in_seq=0 out_seq=0 2024-09-19T07:26:47.842 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cbdffb640 1 -- 172.21.15.98:0/4259463299 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558de8ce9d70 con 0x558de8e05fa0 2024-09-19T07:26:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cbdffb640 10 client.16497 handle_command_reply: tid=0 2024-09-19T07:26:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cdf286740 1 client.16497 shutdown 2024-09-19T07:26:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cdf286740 1 -- 172.21.15.98:0/4259463299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 msgr2=0x558de8d93270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cdf286740 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 0x558de8d93270 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00bc2f0 tx=0x7f0cd004bfb0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cdf286740 1 -- 172.21.15.98:0/4259463299 shutdown_connections 2024-09-19T07:26:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cdf286740 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558de8d8aec0 0x558de8d8ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cdf286740 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558de8d7e290 0x558de8d8e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cdf286740 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558de8e05fa0 0x558de8e08400 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cdf286740 1 --2- 172.21.15.98:0/4259463299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558de8d7d970 0x558de8d93270 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cbdffb640 0 client.16497 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cdf286740 1 -- 172.21.15.98:0/4259463299 >> 172.21.15.98:0/4259463299 conn(0x558de8d7a060 msgr2=0x558de8d789a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cdf286740 1 -- 172.21.15.98:0/4259463299 shutdown_connections 2024-09-19T07:26:47.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cdf286740 1 -- 172.21.15.98:0/4259463299 wait complete. 2024-09-19T07:26:47.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.842+0000 7f0cdf286740 20 client.16497 trim_cache size 0 max 16384 2024-09-19T07:26:47.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:26:47.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:26:47.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:26:47.844 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:26:47.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.843+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/387725695 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0cc00a3460 msgr2=0x7f0cc00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.843+0000 7f0cdc4e4640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0cc00a3460 0x7f0cc00a5920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4105f00 tx=0x7f0cc4005d30 comp rx=0 tx=0).stop 2024-09-19T07:26:47.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.843+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/387725695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cd41009b0 msgr2=0x7f0cd41971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:47.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.843+0000 7f0cdc4e4640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cd41009b0 0x7f0cd41971d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0cd0009a50 tx=0x7f0cd0004270 comp rx=0 tx=0).stop 2024-09-19T07:26:47.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.843+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/387725695 shutdown_connections 2024-09-19T07:26:47.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.843+0000 7f0cdc4e4640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f0cc00a3460 0x7f0cc00a5920 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.845 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.843+0000 7f0cdc4e4640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0cd41069c0 0x7f0cd419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.846 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.843+0000 7f0cdc4e4640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0cd4101350 0x7f0cd4197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.846 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.843+0000 7f0cdc4e4640 1 --2- 172.21.15.98:0/387725695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0cd41009b0 0x7f0cd41971d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:47.846 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.843+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/387725695 >> 172.21.15.98:0/387725695 conn(0x7f0cd4077990 msgr2=0x7f0cd40fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:47.846 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.843+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/387725695 shutdown_connections 2024-09-19T07:26:47.846 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:26:47.843+0000 7f0cdc4e4640 1 -- 172.21.15.98:0/387725695 wait complete. 2024-09-19T07:26:49.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:48 smithi098 ceph-mon[30950]: pgmap v145: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-09-19T07:26:49.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:48 smithi139 ceph-mon[35039]: pgmap v145: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-09-19T07:26:49.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:48 smithi162 ceph-mon[35726]: pgmap v145: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-09-19T07:26:50.909 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:26:51.174 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:26:51.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:50 smithi098 ceph-mon[30950]: pgmap v146: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-09-19T07:26:51.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:50 smithi139 ceph-mon[35039]: pgmap v146: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-09-19T07:26:51.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:50 smithi162 ceph-mon[35726]: pgmap v146: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-09-19T07:26:51.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.612+0000 7fdf9e22e640 1 -- 172.21.15.98:0/2030867436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf981002f0 msgr2=0x7fdf981006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:51.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.612+0000 7fdf9e22e640 1 --2- 172.21.15.98:0/2030867436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf981002f0 0x7fdf981006d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009930 tx=0x7fdf8802a420 comp rx=0 tx=0).stop 2024-09-19T07:26:51.633 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.612+0000 7fdf9e22e640 1 -- 172.21.15.98:0/2030867436 shutdown_connections 2024-09-19T07:26:51.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.612+0000 7fdf9e22e640 1 --2- 172.21.15.98:0/2030867436 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf98106f50 0x7fdf9810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:51.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.612+0000 7fdf9e22e640 1 --2- 172.21.15.98:0/2030867436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf98100ca0 0x7fdf98106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:51.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.612+0000 7fdf9e22e640 1 --2- 172.21.15.98:0/2030867436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf981002f0 0x7fdf981006d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:51.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.612+0000 7fdf9e22e640 1 -- 172.21.15.98:0/2030867436 >> 172.21.15.98:0/2030867436 conn(0x7fdf98077210 msgr2=0x7fdf980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:51.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.612+0000 7fdf9e22e640 1 -- 172.21.15.98:0/2030867436 shutdown_connections 2024-09-19T07:26:51.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.612+0000 7fdf9e22e640 1 -- 172.21.15.98:0/2030867436 wait complete. 2024-09-19T07:26:51.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.613+0000 7fdf9e22e640 1 Processor -- start 2024-09-19T07:26:51.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.613+0000 7fdf9e22e640 1 -- start start 2024-09-19T07:26:51.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.613+0000 7fdf9e22e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf981002f0 0x7fdf98198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:51.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.613+0000 7fdf9e22e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf98100ca0 0x7fdf98198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:51.634 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.613+0000 7fdf9e22e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf98106f50 0x7fdf9819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.613+0000 7fdf9e22e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98112000 con 0x7fdf98100ca0 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.613+0000 7fdf9e22e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98111e80 con 0x7fdf981002f0 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.613+0000 7fdf9e22e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdf98112180 con 0x7fdf98106f50 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf98100ca0 0x7fdf98198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf96ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf98100ca0 0x7fdf98198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:41096/0 (socket says 172.21.15.98:41096) 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf96ffd640 1 -- 172.21.15.98:0/5416986 learned_addr learned my addr 172.21.15.98:0/5416986 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf97fff640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf98106f50 0x7fdf9819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf977fe640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf981002f0 0x7fdf98198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf96ffd640 1 -- 172.21.15.98:0/5416986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf98106f50 msgr2=0x7fdf9819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf96ffd640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf98106f50 0x7fdf9819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf96ffd640 1 -- 172.21.15.98:0/5416986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf981002f0 msgr2=0x7fdf98198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf96ffd640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf981002f0 0x7fdf98198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:51.635 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf96ffd640 1 -- 172.21.15.98:0/5416986 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9819d500 con 0x7fdf98100ca0 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf977fe640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf981002f0 0x7fdf98198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf96ffd640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf98100ca0 0x7fdf98198a90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00b450 tx=0x7fdf8c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf94ff9640 1 -- 172.21.15.98:0/5416986 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c015020 con 0x7fdf98100ca0 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf94ff9640 1 -- 172.21.15.98:0/5416986 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf8c011d70 con 0x7fdf98100ca0 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf9e22e640 1 -- 172.21.15.98:0/5416986 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9819d7f0 con 0x7fdf98100ca0 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.614+0000 7fdf94ff9640 1 -- 172.21.15.98:0/5416986 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c00f340 con 0x7fdf98100ca0 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.615+0000 7fdf9e22e640 1 -- 172.21.15.98:0/5416986 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf981a50d0 con 0x7fdf98100ca0 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.615+0000 7fdf9e22e640 1 -- 172.21.15.98:0/5416986 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf981006d0 con 0x7fdf98100ca0 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.617+0000 7fdf94ff9640 1 -- 172.21.15.98:0/5416986 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fdf8c018020 con 0x7fdf98100ca0 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.617+0000 7fdf94ff9640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdf800a33b0 0x7fdf800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.617+0000 7fdf977fe640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdf800a33b0 0x7fdf800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.618+0000 7fdf94ff9640 1 -- 172.21.15.98:0/5416986 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fdf8c0cfc20 con 0x7fdf98100ca0 2024-09-19T07:26:51.636 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.618+0000 7fdf977fe640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdf800a33b0 0x7fdf800a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdf88000c00 tx=0x7fdf88005a20 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:51.637 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.621+0000 7fdf94ff9640 1 -- 172.21.15.98:0/5416986 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdf8c01f020 con 0x7fdf98100ca0 2024-09-19T07:26:51.823 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.822+0000 7fdf9e22e640 1 -- 172.21.15.98:0/5416986 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf981998b0 con 0x7fdf98100ca0 2024-09-19T07:26:51.824 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.823+0000 7fdf94ff9640 1 -- 172.21.15.98:0/5416986 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11928 (secure 0 0 0) 0x7fdf8c00d040 con 0x7fdf98100ca0 2024-09-19T07:26:51.824 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:26:51.825 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"btime":"2024-09-19T07:24:57:508846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:24:56.977446+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":73,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":74,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:26:51.826 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2024-09-19T07:26:51.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.825+0000 7fdf9e22e640 1 -- 172.21.15.98:0/5416986 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdf800a33b0 msgr2=0x7fdf800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:51.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.825+0000 7fdf9e22e640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdf800a33b0 0x7fdf800a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdf88000c00 tx=0x7fdf88005a20 comp rx=0 tx=0).stop 2024-09-19T07:26:51.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.825+0000 7fdf9e22e640 1 -- 172.21.15.98:0/5416986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf98100ca0 msgr2=0x7fdf98198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:51.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.825+0000 7fdf9e22e640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf98100ca0 0x7fdf98198a90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c00b450 tx=0x7fdf8c00b910 comp rx=0 tx=0).stop 2024-09-19T07:26:51.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.825+0000 7fdf9e22e640 1 -- 172.21.15.98:0/5416986 shutdown_connections 2024-09-19T07:26:51.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.825+0000 7fdf9e22e640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fdf800a33b0 0x7fdf800a5870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:51.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.825+0000 7fdf9e22e640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdf98106f50 0x7fdf9819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:51.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.825+0000 7fdf9e22e640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf98100ca0 0x7fdf98198a90 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:51.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.825+0000 7fdf9e22e640 1 --2- 172.21.15.98:0/5416986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdf981002f0 0x7fdf98198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:51.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.825+0000 7fdf9e22e640 1 -- 172.21.15.98:0/5416986 >> 172.21.15.98:0/5416986 conn(0x7fdf98077210 msgr2=0x7fdf98105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:51.826 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.825+0000 7fdf9e22e640 1 -- 172.21.15.98:0/5416986 shutdown_connections 2024-09-19T07:26:51.827 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:51.825+0000 7fdf9e22e640 1 -- 172.21.15.98:0/5416986 wait complete. 2024-09-19T07:26:52.272 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:51 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/5416986' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:52.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:51 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/5416986' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:52.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:51 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/5416986' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:52.553 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db --set-id 7be3d2a5 --release --await' 2024-09-19T07:26:52.554 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db --set-id 7be3d2a5 --release --await 2024-09-19T07:26:52.808 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:26:53.212 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:52 smithi098 ceph-mon[30950]: pgmap v147: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 10 op/s 2024-09-19T07:26:53.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.297+0000 7f1692a31640 1 -- 172.21.15.98:0/660471918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f168c103740 msgr2=0x7f168c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:53.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.297+0000 7f1692a31640 1 --2- 172.21.15.98:0/660471918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f168c103740 0x7f168c107b80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1674009930 tx=0x7f167402a420 comp rx=0 tx=0).stop 2024-09-19T07:26:53.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.297+0000 7f1692a31640 1 -- 172.21.15.98:0/660471918 shutdown_connections 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.297+0000 7f1692a31640 1 --2- 172.21.15.98:0/660471918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f168c108290 0x7f168c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.297+0000 7f1692a31640 1 --2- 172.21.15.98:0/660471918 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f168c103740 0x7f168c107b80 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.297+0000 7f1692a31640 1 --2- 172.21.15.98:0/660471918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f168c102d90 0x7f168c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.297+0000 7f1692a31640 1 -- 172.21.15.98:0/660471918 >> 172.21.15.98:0/660471918 conn(0x7f168c0fc7d0 msgr2=0x7f168c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.297+0000 7f1692a31640 1 -- 172.21.15.98:0/660471918 shutdown_connections 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.297+0000 7f1692a31640 1 -- 172.21.15.98:0/660471918 wait complete. 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f1692a31640 1 Processor -- start 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f1692a31640 1 -- start start 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f1692a31640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f168c102d90 0x7f168c198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f1692a31640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f168c103740 0x7f168c198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f1692a31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f168c108290 0x7f168c19cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f1692a31640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1120d0 con 0x7f168c102d90 2024-09-19T07:26:53.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f1692a31640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f168c111f50 con 0x7f168c103740 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f1692a31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f168c112250 con 0x7f168c108290 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f168bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f168c102d90 0x7f168c198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f168bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f168c102d90 0x7f168c198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58314/0 (socket says 172.21.15.98:58314) 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f168bfff640 1 -- 172.21.15.98:0/1766707000 learned_addr learned my addr 172.21.15.98:0/1766707000 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f1683fff640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f168c103740 0x7f168c198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f1690fce640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f168c108290 0x7f168c19cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f168bfff640 1 -- 172.21.15.98:0/1766707000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f168c108290 msgr2=0x7f168c19cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f168bfff640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f168c108290 0x7f168c19cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f168bfff640 1 -- 172.21.15.98:0/1766707000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f168c103740 msgr2=0x7f168c198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f168bfff640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f168c103740 0x7f168c198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.298+0000 7f168bfff640 1 -- 172.21.15.98:0/1766707000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168c19d640 con 0x7f168c102d90 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.299+0000 7f168bfff640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f168c102d90 0x7f168c198690 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f167c00c970 tx=0x7f167c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:53.301 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.299+0000 7f1689ffb640 1 -- 172.21.15.98:0/1766707000 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c007bb0 con 0x7f168c102d90 2024-09-19T07:26:53.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.299+0000 7f1689ffb640 1 -- 172.21.15.98:0/1766707000 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f167c007d50 con 0x7f168c102d90 2024-09-19T07:26:53.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.299+0000 7f1692a31640 1 -- 172.21.15.98:0/1766707000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168c19d930 con 0x7f168c102d90 2024-09-19T07:26:53.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.299+0000 7f1689ffb640 1 -- 172.21.15.98:0/1766707000 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c00f450 con 0x7f168c102d90 2024-09-19T07:26:53.302 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.299+0000 7f1692a31640 1 -- 172.21.15.98:0/1766707000 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f168c100920 con 0x7f168c102d90 2024-09-19T07:26:53.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.301+0000 7f1689ffb640 1 -- 172.21.15.98:0/1766707000 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f167c005020 con 0x7f168c102d90 2024-09-19T07:26:53.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.301+0000 7f1694e0a740 1 Processor -- start 2024-09-19T07:26:53.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.301+0000 7f1694e0a740 1 -- start start 2024-09-19T07:26:53.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f1694e0a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562060 0x5612a8562440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f1694e0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 0x5612a856cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f1694e0a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a856d240 0x5612a856f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.306 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f1694e0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5612a84c7620 con 0x5612a8562980 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f1694e0a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5612a846ee50 con 0x5612a856d240 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f1694e0a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5612a84c35e0 con 0x5612a8562060 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f168bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 0x5612a856cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f168bfff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 0x5612a856cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58326/0 (socket says 172.21.15.98:58326) 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f168bfff640 1 -- 172.21.15.98:0/4189793987 learned_addr learned my addr 172.21.15.98:0/4189793987 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f1689ffb640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16780a33b0 0x7f16780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f1690fce640 1 --2- 172.21.15.98:0/4189793987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562060 0x5612a8562440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f1683fff640 1 --2- 172.21.15.98:0/4189793987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a856d240 0x5612a856f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f1690fce640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16780a33b0 0x7f16780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f1689ffb640 1 -- 172.21.15.98:0/1766707000 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f167c0cfb30 con 0x7f168c102d90 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f168bfff640 1 -- 172.21.15.98:0/4189793987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562060 msgr2=0x5612a8562440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f168bfff640 1 --2- 172.21.15.98:0/4189793987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562060 0x5612a8562440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.307 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f168bfff640 1 -- 172.21.15.98:0/4189793987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a856d240 msgr2=0x5612a856f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:53.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f168bfff640 1 --2- 172.21.15.98:0/4189793987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a856d240 0x5612a856f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f168bfff640 1 -- 172.21.15.98:0/4189793987 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a845fd40 con 0x5612a8562980 2024-09-19T07:26:53.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.302+0000 7f168bfff640 1 --2- 172.21.15.98:0/4189793987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 0x5612a856cd00 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f167c09bae0 tx=0x7f167c004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2016ea3300786ff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:53.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f1690fce640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16780a33b0 0x7f16780a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f16840070b0 tx=0x7f16840093d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:53.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f16827fc640 1 -- 172.21.15.98:0/4189793987 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c01d070 con 0x5612a8562980 2024-09-19T07:26:53.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f16827fc640 1 -- 172.21.15.98:0/4189793987 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f167c09c4e0 con 0x5612a8562980 2024-09-19T07:26:53.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f16827fc640 1 -- 172.21.15.98:0/4189793987 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c0cd4d0 con 0x5612a8562980 2024-09-19T07:26:53.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f1694e0a740 1 -- 172.21.15.98:0/4189793987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 msgr2=0x5612a856cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:53.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f1694e0a740 1 --2- 172.21.15.98:0/4189793987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 0x5612a856cd00 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f167c09bae0 tx=0x7f167c004a20 comp rx=0 tx=0).stop 2024-09-19T07:26:53.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f1694e0a740 1 -- 172.21.15.98:0/4189793987 shutdown_connections 2024-09-19T07:26:53.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f1694e0a740 1 --2- 172.21.15.98:0/4189793987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a856d240 0x5612a856f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.308 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f1694e0a740 1 --2- 172.21.15.98:0/4189793987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 0x5612a856cd00 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f1694e0a740 1 --2- 172.21.15.98:0/4189793987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562060 0x5612a8562440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f1694e0a740 1 -- 172.21.15.98:0/4189793987 >> 172.21.15.98:0/4189793987 conn(0x5612a855e5f0 msgr2=0x5612a855e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f1694e0a740 1 -- 172.21.15.98:0/4189793987 shutdown_connections 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.303+0000 7f1694e0a740 1 -- 172.21.15.98:0/4189793987 wait complete. 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1694e0a740 1 -- start start 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1694e0a740 1 Processor -- start 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1694e0a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562060 0x5612a856a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1694e0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 0x5612a856a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1694e0a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a856d240 0x5612a856abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1694e0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5612a856fe10 con 0x5612a8562980 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1694e0a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5612a844ff10 con 0x5612a8562060 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1694e0a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5612a856ff90 con 0x5612a856d240 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1694e0a740 10 client.0 _ll_register_callbacks cb 0x5612a8473db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:53.309 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1683fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 0x5612a856a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1683fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 0x5612a856a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58334/0 (socket says 172.21.15.98:58334) 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1683fff640 1 -- 172.21.15.98:0/930086510 learned_addr learned my addr 172.21.15.98:0/930086510 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.304+0000 7f1690fce640 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a856d240 0x5612a856abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f168bfff640 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562060 0x5612a856a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f1683fff640 1 -- 172.21.15.98:0/930086510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a856d240 msgr2=0x5612a856abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f1683fff640 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a856d240 0x5612a856abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f1683fff640 1 -- 172.21.15.98:0/930086510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562060 msgr2=0x5612a856a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f1683fff640 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562060 0x5612a856a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f1683fff640 1 -- 172.21.15.98:0/930086510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612a81d6580 con 0x5612a8562980 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f1683fff640 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 0x5612a856a680 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1674006010 tx=0x7f1674031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773dcbe597352365 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f166b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f166b7fe640 1 -- 172.21.15.98:0/930086510 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1674035040 con 0x5612a8562980 2024-09-19T07:26:53.310 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f166b7fe640 1 -- 172.21.15.98:0/930086510 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f1674004380 con 0x5612a8562980 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f1694e0a740 1 -- 172.21.15.98:0/930086510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f167c09c4e0 con 0x5612a8562980 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f166b7fe640 1 -- 172.21.15.98:0/930086510 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f16740035f0 con 0x5612a8562980 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f1694e0a740 10 client.16515 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f1694e0a740 1 -- 172.21.15.98:0/930086510 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5612a82a0960 con 0x5612a8562980 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.305+0000 7f166b7fe640 1 -- 172.21.15.98:0/930086510 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f167c09c4e0 con 0x5612a8562980 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.306+0000 7f166b7fe640 1 -- 172.21.15.98:0/930086510 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f167403c920 con 0x5612a8562980 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.306+0000 7f1694e0a740 10 client.16515 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.306+0000 7f1694e0a740 10 client.16515 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.306+0000 7f1694e0a740 20 client.16515 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.306+0000 7f1694e0a740 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5612a857ce10 0x5612a857f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.306+0000 7f1694e0a740 4 client.16515 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.306+0000 7f1694e0a740 1 -- 172.21.15.98:0/930086510 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612a84d4b90 con 0x5612a857ce10 2024-09-19T07:26:53.311 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.306+0000 7f168bfff640 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5612a857ce10 0x5612a857f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.306+0000 7f166b7fe640 10 client.16515 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:53.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.306+0000 7f168bfff640 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5612a857ce10 0x5612a857f2b0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8995fbc30531e80a server_cookie=801c84429fee91ad in_seq=0 out_seq=0 2024-09-19T07:26:53.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.307+0000 7f166b7fe640 1 -- 172.21.15.98:0/930086510 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612a84d4b90 con 0x5612a857ce10 2024-09-19T07:26:53.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.307+0000 7f166b7fe640 10 client.16515 handle_command_reply: tid=0 2024-09-19T07:26:53.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.307+0000 7f1694e0a740 1 client.16515 shutdown 2024-09-19T07:26:53.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.307+0000 7f1694e0a740 1 -- 172.21.15.98:0/930086510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 msgr2=0x5612a856a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:53.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.307+0000 7f1694e0a740 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 0x5612a856a680 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1674006010 tx=0x7f1674031a60 comp rx=0 tx=0).stop 2024-09-19T07:26:53.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.307+0000 7f1694e0a740 1 -- 172.21.15.98:0/930086510 shutdown_connections 2024-09-19T07:26:53.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.307+0000 7f1694e0a740 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a856d240 0x5612a856abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.307+0000 7f1694e0a740 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5612a857ce10 0x5612a857f2b0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.307+0000 7f1694e0a740 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a8562980 0x5612a856a680 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.313 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.307+0000 7f166b7fe640 0 client.16515 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:53.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.307+0000 7f1694e0a740 1 --2- 172.21.15.98:0/930086510 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562060 0x5612a856a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.307+0000 7f1694e0a740 1 -- 172.21.15.98:0/930086510 >> 172.21.15.98:0/930086510 conn(0x5612a855e5f0 msgr2=0x5612a85642d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:53.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.308+0000 7f1694e0a740 1 -- 172.21.15.98:0/930086510 shutdown_connections 2024-09-19T07:26:53.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.308+0000 7f1694e0a740 1 -- 172.21.15.98:0/930086510 wait complete. 2024-09-19T07:26:53.314 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.308+0000 7f1694e0a740 20 client.16515 trim_cache size 0 max 16384 2024-09-19T07:26:53.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:52 smithi139 ceph-mon[35039]: pgmap v147: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 10 op/s 2024-09-19T07:26:53.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.324+0000 7f1694e0a740 1 Processor -- start 2024-09-19T07:26:53.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.324+0000 7f1694e0a740 1 -- start start 2024-09-19T07:26:53.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.324+0000 7f1694e0a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562060 0x5612a8565480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1694e0a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562980 0x5612a855d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1694e0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 0x5612a8584bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1694e0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1b2610 con 0x5612a856d240 2024-09-19T07:26:53.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1694e0a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1afe20 con 0x5612a8562060 2024-09-19T07:26:53.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1694e0a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1adc70 con 0x5612a8562980 2024-09-19T07:26:53.326 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1690fce640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 0x5612a8584bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1690fce640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 0x5612a8584bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58350/0 (socket says 172.21.15.98:58350) 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1690fce640 1 -- 172.21.15.98:0/1125650931 learned_addr learned my addr 172.21.15.98:0/1125650931 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f168bfff640 1 --2- 172.21.15.98:0/1125650931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562060 0x5612a8565480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1683fff640 1 --2- 172.21.15.98:0/1125650931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562980 0x5612a855d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1690fce640 1 -- 172.21.15.98:0/1125650931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562980 msgr2=0x5612a855d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1690fce640 1 --2- 172.21.15.98:0/1125650931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562980 0x5612a855d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1690fce640 1 -- 172.21.15.98:0/1125650931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562060 msgr2=0x5612a8565480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1690fce640 1 --2- 172.21.15.98:0/1125650931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562060 0x5612a8565480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1690fce640 1 -- 172.21.15.98:0/1125650931 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a856c080 con 0x5612a856d240 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1690fce640 1 --2- 172.21.15.98:0/1125650931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 0x5612a8584bc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f168400aa40 tx=0x7f168400c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24309dcb56f62de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1681ffb640 1 -- 172.21.15.98:0/1125650931 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1684013040 con 0x5612a856d240 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1681ffb640 1 -- 172.21.15.98:0/1125650931 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f168402a070 con 0x5612a856d240 2024-09-19T07:26:53.327 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.325+0000 7f1681ffb640 1 -- 172.21.15.98:0/1125650931 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1684025b70 con 0x5612a856d240 2024-09-19T07:26:53.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.326+0000 7f1694e0a740 1 -- 172.21.15.98:0/1125650931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 msgr2=0x5612a8584bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:53.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.326+0000 7f1694e0a740 1 --2- 172.21.15.98:0/1125650931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 0x5612a8584bc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f168400aa40 tx=0x7f168400c070 comp rx=0 tx=0).stop 2024-09-19T07:26:53.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.326+0000 7f1694e0a740 1 -- 172.21.15.98:0/1125650931 shutdown_connections 2024-09-19T07:26:53.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.326+0000 7f1694e0a740 1 --2- 172.21.15.98:0/1125650931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 0x5612a8584bc0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.326+0000 7f1694e0a740 1 --2- 172.21.15.98:0/1125650931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562980 0x5612a855d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.326+0000 7f1694e0a740 1 --2- 172.21.15.98:0/1125650931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562060 0x5612a8565480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.326+0000 7f1694e0a740 1 -- 172.21.15.98:0/1125650931 >> 172.21.15.98:0/1125650931 conn(0x5612a855e5f0 msgr2=0x5612a855cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.326+0000 7f1694e0a740 1 -- 172.21.15.98:0/1125650931 shutdown_connections 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.326+0000 7f1694e0a740 1 -- 172.21.15.98:0/1125650931 wait complete. 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.326+0000 7f1694e0a740 1 -- start start 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1694e0a740 1 Processor -- start 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1694e0a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562060 0x5612a8571880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1694e0a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562980 0x5612a8571dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1694e0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 0x5612a85e0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1694e0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1ae2e0 con 0x5612a856d240 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1694e0a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1af750 con 0x5612a8562980 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1694e0a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1ae9b0 con 0x5612a8562060 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1694e0a740 10 client.0 _ll_register_callbacks cb 0x7f1674031660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1690fce640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 0x5612a85e0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.331 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1690fce640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 0x5612a85e0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58360/0 (socket says 172.21.15.98:58360) 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1690fce640 1 -- 172.21.15.98:0/2427898090 learned_addr learned my addr 172.21.15.98:0/2427898090 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f168bfff640 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562060 0x5612a8571880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1683fff640 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562980 0x5612a8571dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1690fce640 1 -- 172.21.15.98:0/2427898090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562060 msgr2=0x5612a8571880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1690fce640 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562060 0x5612a8571880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1690fce640 1 -- 172.21.15.98:0/2427898090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562980 msgr2=0x5612a8571dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1690fce640 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562980 0x5612a8571dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1690fce640 1 -- 172.21.15.98:0/2427898090 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612a85e1280 con 0x5612a856d240 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.327+0000 7f1690fce640 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 0x5612a85e0c40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f168400aab0 tx=0x7f1684025ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7933f0309d21d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f166b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f166b7fe640 1 -- 172.21.15.98:0/2427898090 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1684033060 con 0x5612a856d240 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f166b7fe640 1 -- 172.21.15.98:0/2427898090 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f168401b910 con 0x5612a856d240 2024-09-19T07:26:53.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f1694e0a740 1 -- 172.21.15.98:0/2427898090 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f168402a070 con 0x5612a856d240 2024-09-19T07:26:53.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f166b7fe640 1 -- 172.21.15.98:0/2427898090 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f168401bb30 con 0x5612a856d240 2024-09-19T07:26:53.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f1694e0a740 10 client.16521 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:53.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f1694e0a740 1 -- 172.21.15.98:0/2427898090 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5612a85e8650 con 0x5612a856d240 2024-09-19T07:26:53.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f166b7fe640 1 -- 172.21.15.98:0/2427898090 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f168402a070 con 0x5612a856d240 2024-09-19T07:26:53.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f166b7fe640 1 -- 172.21.15.98:0/2427898090 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f168402e8f0 con 0x5612a856d240 2024-09-19T07:26:53.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f1694e0a740 10 client.16521 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:53.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f1694e0a740 10 client.16521 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:26:53.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f1694e0a740 20 client.16521 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:53.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f1694e0a740 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5612a85e8cc0 0x5612a85eb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:53.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f1694e0a740 4 client.16521 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7be3d2a5", "release": true, "await": true}] 2024-09-19T07:26:53.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.328+0000 7f1694e0a740 1 -- 172.21.15.98:0/2427898090 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7be3d2a5", "release": true, "await": true}) -- 0x5612a84cf0a0 con 0x5612a85e8cc0 2024-09-19T07:26:53.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.329+0000 7f168bfff640 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5612a85e8cc0 0x5612a85eb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:53.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.329+0000 7f168bfff640 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5612a85e8cc0 0x5612a85eb0b0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8da13faa7433039b server_cookie=6fe2604caeb8b69f in_seq=0 out_seq=0 2024-09-19T07:26:53.334 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.329+0000 7f166b7fe640 10 client.16521 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:53.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:52 smithi162 ceph-mon[35726]: pgmap v147: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 10 op/s 2024-09-19T07:26:53.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f166b7fe640 1 -- 172.21.15.98:0/2427898090 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5612a84cf0a0 con 0x5612a85e8cc0 2024-09-19T07:26:53.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f166b7fe640 10 client.16521 handle_command_reply: tid=0 2024-09-19T07:26:53.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f1694e0a740 1 client.16521 shutdown 2024-09-19T07:26:53.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f1694e0a740 1 -- 172.21.15.98:0/2427898090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 msgr2=0x5612a85e0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:53.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f1694e0a740 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 0x5612a85e0c40 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f168400aab0 tx=0x7f1684025ba0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f1694e0a740 1 -- 172.21.15.98:0/2427898090 shutdown_connections 2024-09-19T07:26:53.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f1694e0a740 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x5612a85e8cc0 0x5612a85eb0b0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.534 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f1694e0a740 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5612a856d240 0x5612a85e0c40 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f1694e0a740 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5612a8562980 0x5612a8571dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f166b7fe640 0 client.16521 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:53.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f1694e0a740 1 --2- 172.21.15.98:0/2427898090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5612a8562060 0x5612a8571880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f1694e0a740 1 -- 172.21.15.98:0/2427898090 >> 172.21.15.98:0/2427898090 conn(0x5612a855e5f0 msgr2=0x5612a855d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:53.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f1694e0a740 1 -- 172.21.15.98:0/2427898090 shutdown_connections 2024-09-19T07:26:53.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.533+0000 7f1694e0a740 1 -- 172.21.15.98:0/2427898090 wait complete. 2024-09-19T07:26:53.535 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1694e0a740 20 client.16521 trim_cache size 0 max 16384 2024-09-19T07:26:53.535 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:26:53.535 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 30, 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 20, 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": { 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "7be3d2a5": { 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "version": 20, 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "age_ref": 0.0, 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RELEASED", 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "timeout": 90.0, 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "expiration": 149.8, 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "members": { 2024-09-19T07:26:53.536 INFO:teuthology.orchestra.run.smithi098.stdout: "file:/": { 2024-09-19T07:26:53.537 INFO:teuthology.orchestra.run.smithi098.stdout: "excluded": false, 2024-09-19T07:26:53.537 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:26:53.537 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RELEASED", 2024-09-19T07:26:53.537 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:26:53.537 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:53.537 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:53.537 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:53.537 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:53.537 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:53.537 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:26:53.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1692a31640 1 -- 172.21.15.98:0/1766707000 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16780a33b0 msgr2=0x7f16780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:53.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1692a31640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16780a33b0 0x7f16780a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f16840070b0 tx=0x7f16840093d0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1692a31640 1 -- 172.21.15.98:0/1766707000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f168c102d90 msgr2=0x7f168c198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:53.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1692a31640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f168c102d90 0x7f168c198690 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f167c00c970 tx=0x7f167c00ce30 comp rx=0 tx=0).stop 2024-09-19T07:26:53.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1692a31640 1 -- 172.21.15.98:0/1766707000 shutdown_connections 2024-09-19T07:26:53.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1692a31640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16780a33b0 0x7f16780a5870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1692a31640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f168c108290 0x7f168c19cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1692a31640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f168c103740 0x7f168c198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1692a31640 1 --2- 172.21.15.98:0/1766707000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f168c102d90 0x7f168c198690 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:53.538 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1692a31640 1 -- 172.21.15.98:0/1766707000 >> 172.21.15.98:0/1766707000 conn(0x7f168c0fc7d0 msgr2=0x7f168c105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:53.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1692a31640 1 -- 172.21.15.98:0/1766707000 shutdown_connections 2024-09-19T07:26:53.539 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:53.534+0000 7f1692a31640 1 -- 172.21.15.98:0/1766707000 wait complete. 2024-09-19T07:26:54.302 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7be3d2a5', total seconds elapsed: 33.1 2024-09-19T07:26:54.303 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T07:26:54.303 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:26:54.561 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:26:55.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.050+0000 7f9a19c70640 1 -- 172.21.15.98:0/2052912340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a14100e20 msgr2=0x7f9a14101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.050+0000 7f9a19c70640 1 --2- 172.21.15.98:0/2052912340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a14100e20 0x7f9a14101200 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009900 tx=0x7f9a0402a480 comp rx=0 tx=0).stop 2024-09-19T07:26:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.050+0000 7f9a19c70640 1 -- 172.21.15.98:0/2052912340 shutdown_connections 2024-09-19T07:26:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.050+0000 7f9a19c70640 1 --2- 172.21.15.98:0/2052912340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a14102ef0 0x7f9a1410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.050+0000 7f9a19c70640 1 --2- 172.21.15.98:0/2052912340 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a14102570 0x7f9a141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.050+0000 7f9a19c70640 1 --2- 172.21.15.98:0/2052912340 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a14100e20 0x7f9a14101200 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.050+0000 7f9a19c70640 1 -- 172.21.15.98:0/2052912340 >> 172.21.15.98:0/2052912340 conn(0x7f9a140fc7d0 msgr2=0x7f9a140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:55.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.050+0000 7f9a19c70640 1 -- 172.21.15.98:0/2052912340 shutdown_connections 2024-09-19T07:26:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.050+0000 7f9a19c70640 1 -- 172.21.15.98:0/2052912340 wait complete. 2024-09-19T07:26:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a19c70640 1 Processor -- start 2024-09-19T07:26:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a19c70640 1 -- start start 2024-09-19T07:26:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a19c70640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a14100e20 0x7f9a1419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a19c70640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a14102570 0x7f9a1419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a19c70640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a14102ef0 0x7f9a1419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a19c70640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9a14110f80 con 0x7f9a14102ef0 2024-09-19T07:26:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a19c70640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9a14110e00 con 0x7f9a14100e20 2024-09-19T07:26:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a19c70640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a14111100 con 0x7f9a14102570 2024-09-19T07:26:55.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a13fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a14102ef0 0x7f9a1419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a0bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a14102570 0x7f9a1419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a13fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a14102ef0 0x7f9a1419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58392/0 (socket says 172.21.15.98:58392) 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a13fff640 1 -- 172.21.15.98:0/648070191 learned_addr learned my addr 172.21.15.98:0/648070191 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a137fe640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a14100e20 0x7f9a1419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a13fff640 1 -- 172.21.15.98:0/648070191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a14102570 msgr2=0x7f9a1419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a13fff640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a14102570 0x7f9a1419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a13fff640 1 -- 172.21.15.98:0/648070191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a14100e20 msgr2=0x7f9a1419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a13fff640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a14100e20 0x7f9a1419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a13fff640 1 -- 172.21.15.98:0/648070191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1419f660 con 0x7f9a14102ef0 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a13fff640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a14102ef0 0x7f9a1419ef80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00eb10 tx=0x7f9a0c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.051+0000 7f9a117fa640 1 -- 172.21.15.98:0/648070191 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c004b20 con 0x7f9a14102ef0 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.052+0000 7f9a19c70640 1 -- 172.21.15.98:0/648070191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1419f950 con 0x7f9a14102ef0 2024-09-19T07:26:55.083 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.052+0000 7f9a117fa640 1 -- 172.21.15.98:0/648070191 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a0c004cc0 con 0x7f9a14102ef0 2024-09-19T07:26:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.052+0000 7f9a117fa640 1 -- 172.21.15.98:0/648070191 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c010760 con 0x7f9a14102ef0 2024-09-19T07:26:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.052+0000 7f9a19c70640 1 -- 172.21.15.98:0/648070191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a141a7230 con 0x7f9a14102ef0 2024-09-19T07:26:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.053+0000 7f9a19c70640 1 -- 172.21.15.98:0/648070191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a14101200 con 0x7f9a14102ef0 2024-09-19T07:26:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.054+0000 7f9a117fa640 1 -- 172.21.15.98:0/648070191 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9a0c005000 con 0x7f9a14102ef0 2024-09-19T07:26:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.054+0000 7f9a117fa640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9a000a33b0 0x7f9a000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.055+0000 7f9a137fe640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9a000a33b0 0x7f9a000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.055+0000 7f9a117fa640 1 -- 172.21.15.98:0/648070191 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f9a0c0d07d0 con 0x7f9a14102ef0 2024-09-19T07:26:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.055+0000 7f9a137fe640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9a000a33b0 0x7f9a000a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009230 tx=0x7f9a040058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:55.084 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.058+0000 7f9a117fa640 1 -- 172.21.15.98:0/648070191 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a0c09d120 con 0x7f9a14102ef0 2024-09-19T07:26:55.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:54 smithi098 ceph-mon[30950]: pgmap v148: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-09-19T07:26:55.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:54 smithi139 ceph-mon[35039]: pgmap v148: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-09-19T07:26:55.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.329+0000 7f9a19c70640 1 -- 172.21.15.98:0/648070191 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a1419ba10 con 0x7f9a14102ef0 2024-09-19T07:26:55.330 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.330+0000 7f9a117fa640 1 -- 172.21.15.98:0/648070191 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11928 (secure 0 0 0) 0x7f9a1419ba10 con 0x7f9a14102ef0 2024-09-19T07:26:55.330 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:26:55.331 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"btime":"2024-09-19T07:24:57:508846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:24:56.977446+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":73,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":74,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:26:55.331 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2024-09-19T07:26:55.332 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.332+0000 7f9a19c70640 1 -- 172.21.15.98:0/648070191 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9a000a33b0 msgr2=0x7f9a000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.332+0000 7f9a19c70640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9a000a33b0 0x7f9a000a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009230 tx=0x7f9a040058d0 comp rx=0 tx=0).stop 2024-09-19T07:26:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.332+0000 7f9a19c70640 1 -- 172.21.15.98:0/648070191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a14102ef0 msgr2=0x7f9a1419ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.332+0000 7f9a19c70640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a14102ef0 0x7f9a1419ef80 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00eb10 tx=0x7f9a0c00c2d0 comp rx=0 tx=0).stop 2024-09-19T07:26:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.332+0000 7f9a19c70640 1 -- 172.21.15.98:0/648070191 shutdown_connections 2024-09-19T07:26:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.332+0000 7f9a19c70640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f9a000a33b0 0x7f9a000a5870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.332+0000 7f9a19c70640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a14102ef0 0x7f9a1419ef80 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.332+0000 7f9a19c70640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a14102570 0x7f9a1419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.332+0000 7f9a19c70640 1 --2- 172.21.15.98:0/648070191 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9a14100e20 0x7f9a1419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.332+0000 7f9a19c70640 1 -- 172.21.15.98:0/648070191 >> 172.21.15.98:0/648070191 conn(0x7f9a140fc7d0 msgr2=0x7f9a1406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.332+0000 7f9a19c70640 1 -- 172.21.15.98:0/648070191 shutdown_connections 2024-09-19T07:26:55.333 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:55.332+0000 7f9a19c70640 1 -- 172.21.15.98:0/648070191 wait complete. 2024-09-19T07:26:55.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:54 smithi162 ceph-mon[35726]: pgmap v148: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-09-19T07:26:56.178 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T07:26:56.179 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T07:26:56.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:55 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/648070191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:56.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:55 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/648070191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:56.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:55 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/648070191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:26:56.437 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:26:57.103 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:56 smithi098 ceph-mon[30950]: pgmap v149: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 192 KiB/s wr, 17 op/s 2024-09-19T07:26:57.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.095+0000 7f5161723640 1 -- 172.21.15.98:0/2076914322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515c102ef0 msgr2=0x7f515c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:57.109 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.095+0000 7f5161723640 1 --2- 172.21.15.98:0/2076914322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515c102ef0 0x7f515c10da40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5154009cd0 tx=0x7f515402a970 comp rx=0 tx=0).stop 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.095+0000 7f5161723640 1 -- 172.21.15.98:0/2076914322 shutdown_connections 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.095+0000 7f5161723640 1 --2- 172.21.15.98:0/2076914322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515c102ef0 0x7f515c10da40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.095+0000 7f5161723640 1 --2- 172.21.15.98:0/2076914322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f515c102570 0x7f515c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.095+0000 7f5161723640 1 --2- 172.21.15.98:0/2076914322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f515c100e20 0x7f515c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.095+0000 7f5161723640 1 -- 172.21.15.98:0/2076914322 >> 172.21.15.98:0/2076914322 conn(0x7f515c0fc7d0 msgr2=0x7f515c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.095+0000 7f5161723640 1 -- 172.21.15.98:0/2076914322 shutdown_connections 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.095+0000 7f5161723640 1 -- 172.21.15.98:0/2076914322 wait complete. 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.095+0000 7f5161723640 1 Processor -- start 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.095+0000 7f5161723640 1 -- start start 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f5161723640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f515c100e20 0x7f515c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f5161723640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515c102570 0x7f515c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f5161723640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f515c102ef0 0x7f515c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f5161723640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f515c110fd0 con 0x7f515c100e20 2024-09-19T07:26:57.110 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f5161723640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f515c110e50 con 0x7f515c102ef0 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f5161723640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f515c111150 con 0x7f515c102570 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f515affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f515c100e20 0x7f515c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f515affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f515c100e20 0x7f515c198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58404/0 (socket says 172.21.15.98:58404) 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f515affd640 1 -- 172.21.15.98:0/2008065451 learned_addr learned my addr 172.21.15.98:0/2008065451 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f5153fff640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515c102570 0x7f515c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f515b7fe640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f515c102ef0 0x7f515c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f515affd640 1 -- 172.21.15.98:0/2008065451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515c102570 msgr2=0x7f515c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f515affd640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515c102570 0x7f515c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f515affd640 1 -- 172.21.15.98:0/2008065451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f515c102ef0 msgr2=0x7f515c19ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f515affd640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f515c102ef0 0x7f515c19ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f515affd640 1 -- 172.21.15.98:0/2008065451 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515c19d4f0 con 0x7f515c100e20 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f515affd640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f515c100e20 0x7f515c198540 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f514c00e9f0 tx=0x7f514c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f5158ff9640 1 -- 172.21.15.98:0/2008065451 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c00cd80 con 0x7f515c100e20 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f5161723640 1 -- 172.21.15.98:0/2008065451 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515c19d7e0 con 0x7f515c100e20 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f5158ff9640 1 -- 172.21.15.98:0/2008065451 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f514c005500 con 0x7f515c100e20 2024-09-19T07:26:57.111 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f5158ff9640 1 -- 172.21.15.98:0/2008065451 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c010690 con 0x7f515c100e20 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.096+0000 7f5161723640 1 -- 172.21.15.98:0/2008065451 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f515c1a50c0 con 0x7f515c100e20 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.099+0000 7f5158ff9640 1 -- 172.21.15.98:0/2008065451 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f514c0046c0 con 0x7f515c100e20 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f5163afc740 1 Processor -- start 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f5163afc740 1 -- start start 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f5163afc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690eff5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f5163afc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690eff5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f5163afc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690f008fe0 0x55690f00b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f5163afc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55690ef5b2a0 con 0x55690eff6ce0 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f5163afc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55690ef02b10 con 0x55690f008fe0 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f5163afc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55690ef57260 con 0x55690eff5b40 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f5158ff9640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f51480a3430 0x7f51480a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f515b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690eff5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f515b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690eff5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58410/0 (socket says 172.21.15.98:58410) 2024-09-19T07:26:57.112 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f515b7fe640 1 -- 172.21.15.98:0/3942827551 learned_addr learned my addr 172.21.15.98:0/3942827551 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.100+0000 7f5153fff640 1 --2- 172.21.15.98:0/3942827551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690f008fe0 0x55690f00b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.101+0000 7f515affd640 1 --2- 172.21.15.98:0/3942827551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690eff5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.101+0000 7f515b7fe640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f51480a3430 0x7f51480a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.101+0000 7f515b7fe640 1 -- 172.21.15.98:0/3942827551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 msgr2=0x55690eff5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.101+0000 7f515b7fe640 1 --2- 172.21.15.98:0/3942827551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690eff5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.101+0000 7f515b7fe640 1 -- 172.21.15.98:0/3942827551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690f008fe0 msgr2=0x55690f00b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.101+0000 7f515b7fe640 1 --2- 172.21.15.98:0/3942827551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690f008fe0 0x55690f00b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.101+0000 7f515b7fe640 1 -- 172.21.15.98:0/3942827551 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55690ecccb90 con 0x55690eff6ce0 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.101+0000 7f515affd640 1 --2- 172.21.15.98:0/3942827551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690eff5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.101+0000 7f5158ff9640 1 -- 172.21.15.98:0/2008065451 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f514c0d0190 con 0x7f515c100e20 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.101+0000 7f515b7fe640 1 --2- 172.21.15.98:0/3942827551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690eff5600 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5154009ca0 tx=0x7f515402fe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a42cd1466417413 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.101+0000 7f51517fa640 1 -- 172.21.15.98:0/3942827551 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5154034070 con 0x55690eff6ce0 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.102+0000 7f51517fa640 1 -- 172.21.15.98:0/3942827551 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f515404d030 con 0x55690eff6ce0 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.102+0000 7f51517fa640 1 -- 172.21.15.98:0/3942827551 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5154030990 con 0x55690eff6ce0 2024-09-19T07:26:57.113 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.102+0000 7f5163afc740 1 -- 172.21.15.98:0/3942827551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 msgr2=0x55690eff5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.102+0000 7f515b7fe640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f51480a3430 0x7f51480a58f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5154048000 tx=0x7f515404a000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.102+0000 7f5163afc740 1 --2- 172.21.15.98:0/3942827551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690eff5600 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5154009ca0 tx=0x7f515402fe50 comp rx=0 tx=0).stop 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.103+0000 7f5163afc740 1 -- 172.21.15.98:0/3942827551 shutdown_connections 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.103+0000 7f5163afc740 1 --2- 172.21.15.98:0/3942827551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690f008fe0 0x55690f00b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.103+0000 7f5163afc740 1 --2- 172.21.15.98:0/3942827551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690eff5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.103+0000 7f5163afc740 1 --2- 172.21.15.98:0/3942827551 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690eff5600 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.103+0000 7f5163afc740 1 -- 172.21.15.98:0/3942827551 >> 172.21.15.98:0/3942827551 conn(0x55690eff1cf0 msgr2=0x55690eff20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.103+0000 7f5163afc740 1 -- 172.21.15.98:0/3942827551 shutdown_connections 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.103+0000 7f5163afc740 1 -- 172.21.15.98:0/3942827551 wait complete. 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.103+0000 7f5163afc740 1 -- start start 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.103+0000 7f5163afc740 1 Processor -- start 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f5163afc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff5b40 0x55690eff9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f5163afc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff6ce0 0x55690eff9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.114 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f5163afc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690f008fe0 0x55690eff9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f5163afc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55690f00bb30 con 0x55690eff5b40 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f5163afc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55690eee36e0 con 0x55690f008fe0 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f5163afc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55690f00bcb0 con 0x55690eff6ce0 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f5163afc740 10 client.0 _ll_register_callbacks cb 0x55690ef07a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f515b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690f008fe0 0x55690eff9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f515b7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690f008fe0 0x55690eff9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:33240/0 (socket says 172.21.15.98:33240) 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f515b7fe640 1 -- 172.21.15.98:0/1023824829 learned_addr learned my addr 172.21.15.98:0/1023824829 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f515affd640 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff5b40 0x55690eff9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f5153fff640 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff6ce0 0x55690eff9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f515b7fe640 1 -- 172.21.15.98:0/1023824829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff6ce0 msgr2=0x55690eff9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f515b7fe640 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff6ce0 0x55690eff9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f515b7fe640 1 -- 172.21.15.98:0/1023824829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff5b40 msgr2=0x55690eff9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f515b7fe640 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff5b40 0x55690eff9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.104+0000 7f515b7fe640 1 -- 172.21.15.98:0/1023824829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55690f015150 con 0x55690f008fe0 2024-09-19T07:26:57.115 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.105+0000 7f515affd640 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff5b40 0x55690eff9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:26:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.105+0000 7f5153fff640 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff6ce0 0x55690eff9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:26:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.105+0000 7f515b7fe640 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690f008fe0 0x55690eff9ec0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5154005e00 tx=0x7f51540048d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4912472179b005bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.105+0000 7f51427fc640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-09-19T07:26:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.105+0000 7f51427fc640 1 -- 172.21.15.98:0/1023824829 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5154059030 con 0x55690f008fe0 2024-09-19T07:26:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.105+0000 7f5163afc740 1 -- 172.21.15.98:0/1023824829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f515404d030 con 0x55690f008fe0 2024-09-19T07:26:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.105+0000 7f51427fc640 1 -- 172.21.15.98:0/1023824829 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f5154030710 con 0x55690f008fe0 2024-09-19T07:26:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.105+0000 7f51427fc640 1 -- 172.21.15.98:0/1023824829 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5154034040 con 0x55690f008fe0 2024-09-19T07:26:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.105+0000 7f5163afc740 10 client.25781 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.105+0000 7f5163afc740 1 -- 172.21.15.98:0/1023824829 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55690f00bb30 con 0x55690f008fe0 2024-09-19T07:26:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.105+0000 7f51427fc640 1 -- 172.21.15.98:0/1023824829 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f515404d030 con 0x55690f008fe0 2024-09-19T07:26:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.106+0000 7f51427fc640 1 -- 172.21.15.98:0/1023824829 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f5154049500 con 0x55690f008fe0 2024-09-19T07:26:57.116 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.106+0000 7f5163afc740 10 client.25781 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.106+0000 7f5163afc740 10 client.25781 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.106+0000 7f5163afc740 20 client.25781 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.106+0000 7f5163afc740 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55690f018d50 0x55690f01b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.106+0000 7f5163afc740 4 client.25781 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.106+0000 7f5163afc740 1 -- 172.21.15.98:0/1023824829 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55690ef689d0 con 0x55690f018d50 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.106+0000 7f515affd640 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55690f018d50 0x55690f01b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.106+0000 7f51427fc640 10 client.25781 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.106+0000 7f515affd640 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55690f018d50 0x55690f01b180 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7105cf3424b73d35 server_cookie=bc9c0be8df367b02 in_seq=0 out_seq=0 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f51427fc640 1 -- 172.21.15.98:0/1023824829 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55690ef689d0 con 0x55690f018d50 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f51427fc640 10 client.25781 handle_command_reply: tid=0 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f5163afc740 1 client.25781 shutdown 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f5163afc740 1 -- 172.21.15.98:0/1023824829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690f008fe0 msgr2=0x55690eff9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f5163afc740 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690f008fe0 0x55690eff9ec0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5154005e00 tx=0x7f51540048d0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.117 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f5163afc740 1 -- 172.21.15.98:0/1023824829 shutdown_connections 2024-09-19T07:26:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f5163afc740 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690f008fe0 0x55690eff9ec0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f5163afc740 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff6ce0 0x55690eff9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f5163afc740 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55690f018d50 0x55690f01b180 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f5163afc740 1 --2- 172.21.15.98:0/1023824829 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff5b40 0x55690eff9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f51427fc640 0 client.25781 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f5163afc740 1 -- 172.21.15.98:0/1023824829 >> 172.21.15.98:0/1023824829 conn(0x55690eff1cf0 msgr2=0x55690eff7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f5163afc740 1 -- 172.21.15.98:0/1023824829 shutdown_connections 2024-09-19T07:26:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f5163afc740 1 -- 172.21.15.98:0/1023824829 wait complete. 2024-09-19T07:26:57.118 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.108+0000 7f5163afc740 20 client.25781 trim_cache size 0 max 16384 2024-09-19T07:26:57.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.139+0000 7f5163afc740 1 Processor -- start 2024-09-19T07:26:57.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f5163afc740 1 -- start start 2024-09-19T07:26:57.140 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f5163afc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690eff1cf0 0x55690eff20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f5163afc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690eff7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f5163afc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690f020a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f5163afc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f515c1ae030 con 0x55690eff6ce0 2024-09-19T07:26:57.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f5163afc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f515c1ab840 con 0x55690eff1cf0 2024-09-19T07:26:57.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f5163afc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f515c1a9690 con 0x55690eff5b40 2024-09-19T07:26:57.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f515affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690eff1cf0 0x55690eff20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f515b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690f020a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f5153fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690eff7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f515affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690eff1cf0 0x55690eff20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:33254/0 (socket says 172.21.15.98:33254) 2024-09-19T07:26:57.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f5153fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690eff7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:52118/0 (socket says 172.21.15.98:52118) 2024-09-19T07:26:57.141 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.140+0000 7f515affd640 1 -- 172.21.15.98:0/604678213 learned_addr learned my addr 172.21.15.98:0/604678213 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:57.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.141+0000 7f515affd640 1 -- 172.21.15.98:0/604678213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 msgr2=0x55690eff7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.141+0000 7f515affd640 1 --2- 172.21.15.98:0/604678213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690eff7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.141+0000 7f515affd640 1 -- 172.21.15.98:0/604678213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 msgr2=0x55690f020a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.141+0000 7f515affd640 1 --2- 172.21.15.98:0/604678213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690f020a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.141+0000 7f515affd640 1 -- 172.21.15.98:0/604678213 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55690efed260 con 0x55690eff1cf0 2024-09-19T07:26:57.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.141+0000 7f515b7fe640 1 --2- 172.21.15.98:0/604678213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690f020a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:26:57.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.141+0000 7f515affd640 1 --2- 172.21.15.98:0/604678213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690eff1cf0 0x55690eff20d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f514c098db0 tx=0x7f514c0cd040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9049e55385f04b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:57.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.141+0000 7f5150ff9640 1 -- 172.21.15.98:0/604678213 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c09cae0 con 0x55690eff1cf0 2024-09-19T07:26:57.143 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.141+0000 7f5150ff9640 1 -- 172.21.15.98:0/604678213 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f514c09c3e0 con 0x55690eff1cf0 2024-09-19T07:26:57.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.141+0000 7f5150ff9640 1 -- 172.21.15.98:0/604678213 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c0a4bc0 con 0x55690eff1cf0 2024-09-19T07:26:57.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.142+0000 7f5163afc740 1 -- 172.21.15.98:0/604678213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690eff1cf0 msgr2=0x55690eff20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:57.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.142+0000 7f5163afc740 1 --2- 172.21.15.98:0/604678213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690eff1cf0 0x55690eff20d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f514c098db0 tx=0x7f514c0cd040 comp rx=0 tx=0).stop 2024-09-19T07:26:57.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.143+0000 7f5163afc740 1 -- 172.21.15.98:0/604678213 shutdown_connections 2024-09-19T07:26:57.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.143+0000 7f5163afc740 1 --2- 172.21.15.98:0/604678213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690f020a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.143+0000 7f5163afc740 1 --2- 172.21.15.98:0/604678213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690eff7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.143+0000 7f5163afc740 1 --2- 172.21.15.98:0/604678213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690eff1cf0 0x55690eff20d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.143+0000 7f5163afc740 1 -- 172.21.15.98:0/604678213 >> 172.21.15.98:0/604678213 conn(0x55690effa020 msgr2=0x55690eff71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:57.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.143+0000 7f5163afc740 1 -- 172.21.15.98:0/604678213 shutdown_connections 2024-09-19T07:26:57.144 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.143+0000 7f5163afc740 1 -- 172.21.15.98:0/604678213 wait complete. 2024-09-19T07:26:57.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.143+0000 7f5163afc740 1 -- start start 2024-09-19T07:26:57.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.143+0000 7f5163afc740 1 Processor -- start 2024-09-19T07:26:57.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f5163afc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690eff1cf0 0x55690f0113b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f5163afc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690f00df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f5163afc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690f00e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f5163afc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f515c1a9d00 con 0x55690eff6ce0 2024-09-19T07:26:57.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f5163afc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f515c1ab170 con 0x55690eff1cf0 2024-09-19T07:26:57.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f5163afc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f515c1aa3d0 con 0x55690eff5b40 2024-09-19T07:26:57.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f5163afc740 10 client.0 _ll_register_callbacks cb 0x7f5154009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:26:57.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f515b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690f00e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f515b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690f00e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58430/0 (socket says 172.21.15.98:58430) 2024-09-19T07:26:57.147 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f515b7fe640 1 -- 172.21.15.98:0/338731256 learned_addr learned my addr 172.21.15.98:0/338731256 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:26:57.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f515affd640 1 --2- 172.21.15.98:0/338731256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690eff1cf0 0x55690f0113b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f515b7fe640 1 -- 172.21.15.98:0/338731256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 msgr2=0x55690f00df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f515b7fe640 1 --2- 172.21.15.98:0/338731256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690f00df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f515b7fe640 1 -- 172.21.15.98:0/338731256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690eff1cf0 msgr2=0x55690f0113b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:26:57.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f515b7fe640 1 --2- 172.21.15.98:0/338731256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690eff1cf0 0x55690f0113b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:57.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f515b7fe640 1 -- 172.21.15.98:0/338731256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55690eff6550 con 0x55690eff6ce0 2024-09-19T07:26:57.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.144+0000 7f515b7fe640 1 --2- 172.21.15.98:0/338731256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690f00e450 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5154001220 tx=0x7f515402fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02dbe3fb5962e59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:26:57.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.145+0000 7f51427fc640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:26:57.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.145+0000 7f51427fc640 1 -- 172.21.15.98:0/338731256 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5154059040 con 0x55690eff6ce0 2024-09-19T07:26:57.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.145+0000 7f51427fc640 1 -- 172.21.15.98:0/338731256 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f5154049af0 con 0x55690eff6ce0 2024-09-19T07:26:57.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.145+0000 7f5163afc740 1 -- 172.21.15.98:0/338731256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f514c09c3e0 con 0x55690eff6ce0 2024-09-19T07:26:57.148 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.146+0000 7f51427fc640 1 -- 172.21.15.98:0/338731256 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f515406a070 con 0x55690eff6ce0 2024-09-19T07:26:57.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.146+0000 7f5163afc740 10 client.16545 fetch_fsmap learned FSMap version 30 2024-09-19T07:26:57.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.146+0000 7f5163afc740 1 -- 172.21.15.98:0/338731256 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55690f084590 con 0x55690eff6ce0 2024-09-19T07:26:57.149 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.147+0000 7f51427fc640 1 -- 172.21.15.98:0/338731256 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f514c09c3e0 con 0x55690eff6ce0 2024-09-19T07:26:57.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.147+0000 7f51427fc640 1 -- 172.21.15.98:0/338731256 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f5154049470 con 0x55690eff6ce0 2024-09-19T07:26:57.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.147+0000 7f5163afc740 10 client.16545 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:26:57.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.147+0000 7f5163afc740 10 client.16545 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:26:57.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.147+0000 7f5163afc740 20 client.16545 populate_metadata read hostname 'smithi098' 2024-09-19T07:26:57.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.147+0000 7f5163afc740 1 --2- 172.21.15.98:0/338731256 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55690f008fe0 0x55690f086d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:26:57.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.147+0000 7f5163afc740 4 client.16545 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T07:26:57.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.147+0000 7f5163afc740 1 -- 172.21.15.98:0/338731256 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x55690ef62d20 con 0x55690f008fe0 2024-09-19T07:26:57.150 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.148+0000 7f515affd640 1 --2- 172.21.15.98:0/338731256 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55690f008fe0 0x55690f086d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:26:57.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.153+0000 7f51427fc640 10 client.16545 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:57.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:57.153+0000 7f515affd640 1 --2- 172.21.15.98:0/338731256 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55690f008fe0 0x55690f086d40 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c84adb1eb3c75041 server_cookie=2d3806a13d96ff38 in_seq=0 out_seq=0 2024-09-19T07:26:57.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:56 smithi139 ceph-mon[35039]: pgmap v149: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 192 KiB/s wr, 17 op/s 2024-09-19T07:26:57.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:56 smithi162 ceph-mon[35726]: pgmap v149: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 192 KiB/s wr, 17 op/s 2024-09-19T07:26:58.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.036+0000 7f51427fc640 1 -- 172.21.15.98:0/338731256 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55690ef62d20 con 0x55690f008fe0 2024-09-19T07:26:58.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.036+0000 7f51427fc640 10 client.16545 handle_command_reply: tid=0 2024-09-19T07:26:58.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.036+0000 7f5163afc740 1 client.16545 shutdown 2024-09-19T07:26:58.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.036+0000 7f5163afc740 1 -- 172.21.15.98:0/338731256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 msgr2=0x55690f00e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:58.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.036+0000 7f5163afc740 1 --2- 172.21.15.98:0/338731256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690f00e450 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5154001220 tx=0x7f515402fbd0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.036+0000 7f5163afc740 1 -- 172.21.15.98:0/338731256 shutdown_connections 2024-09-19T07:26:58.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.037+0000 7f5163afc740 1 --2- 172.21.15.98:0/338731256 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55690f008fe0 0x55690f086d40 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.037+0000 7f5163afc740 1 --2- 172.21.15.98:0/338731256 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55690eff6ce0 0x55690f00e450 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.038 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.037+0000 7f5163afc740 1 --2- 172.21.15.98:0/338731256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55690eff5b40 0x55690f00df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.037+0000 7f5163afc740 1 --2- 172.21.15.98:0/338731256 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55690eff1cf0 0x55690f0113b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.037+0000 7f5163afc740 1 -- 172.21.15.98:0/338731256 >> 172.21.15.98:0/338731256 conn(0x55690effa020 msgr2=0x55690effb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:58.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.037+0000 7f51427fc640 0 client.16545 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:26:58.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.037+0000 7f5163afc740 1 -- 172.21.15.98:0/338731256 shutdown_connections 2024-09-19T07:26:58.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.037+0000 7f5163afc740 1 -- 172.21.15.98:0/338731256 wait complete. 2024-09-19T07:26:58.039 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.037+0000 7f5163afc740 20 client.16545 trim_cache size 0 max 16384 2024-09-19T07:26:58.039 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:26:58.039 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 30, 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 22, 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": { 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "7a1992f6": { 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "version": 22, 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "age_ref": 0.0, 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "QUIESCED", 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "timeout": 90.0, 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "expiration": 149.8, 2024-09-19T07:26:58.040 INFO:teuthology.orchestra.run.smithi098.stdout: "members": { 2024-09-19T07:26:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "file:/": { 2024-09-19T07:26:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "excluded": false, 2024-09-19T07:26:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:26:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "QUIESCED", 2024-09-19T07:26:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:26:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:58.041 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:26:58.041 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:26:58.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.038+0000 7f5161723640 1 -- 172.21.15.98:0/2008065451 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f51480a3430 msgr2=0x7f51480a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:58.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.038+0000 7f5161723640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f51480a3430 0x7f51480a58f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5154048000 tx=0x7f515404a000 comp rx=0 tx=0).stop 2024-09-19T07:26:58.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.038+0000 7f5161723640 1 -- 172.21.15.98:0/2008065451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f515c100e20 msgr2=0x7f515c198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:26:58.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.038+0000 7f5161723640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f515c100e20 0x7f515c198540 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f514c00e9f0 tx=0x7f514c00edf0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.042 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.038+0000 7f5161723640 1 -- 172.21.15.98:0/2008065451 shutdown_connections 2024-09-19T07:26:58.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.038+0000 7f5161723640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f51480a3430 0x7f51480a58f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.038+0000 7f5161723640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f515c102ef0 0x7f515c19ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.038+0000 7f5161723640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f515c102570 0x7f515c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.038+0000 7f5161723640 1 --2- 172.21.15.98:0/2008065451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f515c100e20 0x7f515c198540 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:26:58.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.038+0000 7f5161723640 1 -- 172.21.15.98:0/2008065451 >> 172.21.15.98:0/2008065451 conn(0x7f515c0fc7d0 msgr2=0x7f515c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:26:58.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.038+0000 7f5161723640 1 -- 172.21.15.98:0/2008065451 shutdown_connections 2024-09-19T07:26:58.043 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:26:58.038+0000 7f5161723640 1 -- 172.21.15.98:0/2008065451 wait complete. 2024-09-19T07:26:58.813 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7a1992f6', quiesce took 4.5 seconds. Will release after: 25.3 2024-09-19T07:26:59.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:26:58 smithi098 ceph-mon[30950]: pgmap v150: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 188 KiB/s wr, 14 op/s 2024-09-19T07:26:59.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:26:58 smithi139 ceph-mon[35039]: pgmap v150: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 188 KiB/s wr, 14 op/s 2024-09-19T07:26:59.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:26:58 smithi162 ceph-mon[35726]: pgmap v150: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 188 KiB/s wr, 14 op/s 2024-09-19T07:27:00.950 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.949+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3016277888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34a4107b70 msgr2=0x7f34a4107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.950 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.949+0000 7f34aaaf1640 1 --2- 172.21.15.98:0/3016277888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34a4107b70 0x7f34a4107f50 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3498009930 tx=0x7f349802a420 comp rx=0 tx=0).stop 2024-09-19T07:27:00.950 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.949+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3016277888 shutdown_connections 2024-09-19T07:27:00.950 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.949+0000 7f34aaaf1640 1 --2- 172.21.15.98:0/3016277888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a4102470 0x7f34a410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.950 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.949+0000 7f34aaaf1640 1 --2- 172.21.15.98:0/3016277888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f34a4101ad0 0x7f34a4101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.950 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.949+0000 7f34aaaf1640 1 --2- 172.21.15.98:0/3016277888 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34a4107b70 0x7f34a4107f50 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.949+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3016277888 >> 172.21.15.98:0/3016277888 conn(0x7f34a40fd7b0 msgr2=0x7f34a40ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.949+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3016277888 shutdown_connections 2024-09-19T07:27:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.949+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3016277888 wait complete. 2024-09-19T07:27:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.950+0000 7f34aaaf1640 1 Processor -- start 2024-09-19T07:27:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.950+0000 7f34aaaf1640 1 -- start start 2024-09-19T07:27:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34aaaf1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a4101ad0 0x7f34a4198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34aaaf1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f34a4102470 0x7f34a41988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34aaaf1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34a4107b70 0x7f34a419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34aaaf1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f34a4111f20 con 0x7f34a4107b70 2024-09-19T07:27:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34aaaf1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f34a4111da0 con 0x7f34a4102470 2024-09-19T07:27:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34aaaf1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41120a0 con 0x7f34a4101ad0 2024-09-19T07:27:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34a908e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34a4107b70 0x7f34a419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34a908e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34a4107b70 0x7f34a419cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58444/0 (socket says 172.21.15.98:58444) 2024-09-19T07:27:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34a908e640 1 -- 172.21.15.98:0/3990802896 learned_addr learned my addr 172.21.15.98:0/3990802896 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34a888d640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a4101ad0 0x7f34a4198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34a3fff640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f34a4102470 0x7f34a41988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34a908e640 1 -- 172.21.15.98:0/3990802896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a4101ad0 msgr2=0x7f34a4198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34a908e640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a4101ad0 0x7f34a4198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34a908e640 1 -- 172.21.15.98:0/3990802896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f34a4102470 msgr2=0x7f34a41988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34a908e640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f34a4102470 0x7f34a41988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34a908e640 1 -- 172.21.15.98:0/3990802896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a419d360 con 0x7f34a4107b70 2024-09-19T07:27:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.951+0000 7f34a908e640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34a4107b70 0x7f34a419cc30 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f349c00eb10 tx=0x7f349c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.952+0000 7f34a1ffb640 1 -- 172.21.15.98:0/3990802896 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c004b20 con 0x7f34a4107b70 2024-09-19T07:27:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.952+0000 7f34a1ffb640 1 -- 172.21.15.98:0/3990802896 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f349c004cc0 con 0x7f34a4107b70 2024-09-19T07:27:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.952+0000 7f34a1ffb640 1 -- 172.21.15.98:0/3990802896 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349c010760 con 0x7f34a4107b70 2024-09-19T07:27:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.952+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3990802896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a419d650 con 0x7f34a4107b70 2024-09-19T07:27:00.955 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.952+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3990802896 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a41a4ee0 con 0x7f34a4107b70 2024-09-19T07:27:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.954+0000 7f34a1ffb640 1 -- 172.21.15.98:0/3990802896 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f349c005020 con 0x7f34a4107b70 2024-09-19T07:27:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34ad88d740 1 Processor -- start 2024-09-19T07:27:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34ad88d740 1 -- start start 2024-09-19T07:27:00.962 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34ad88d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 0x56294f54edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34ad88d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54f330 0x56294f55db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34ad88d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f55e0c0 0x56294f5604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34ad88d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56294f4b32f0 con 0x56294f54ea10 2024-09-19T07:27:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34ad88d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56294f45b270 con 0x56294f54f330 2024-09-19T07:27:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34ad88d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56294f4af2b0 con 0x56294f55e0c0 2024-09-19T07:27:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34a1ffb640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f34940a3460 0x7f34940a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34a888d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54f330 0x56294f55db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34a3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 0x56294f54edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34a888d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54f330 0x56294f55db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:33294/0 (socket says 172.21.15.98:33294) 2024-09-19T07:27:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34a888d640 1 -- 172.21.15.98:0/401329684 learned_addr learned my addr 172.21.15.98:0/401329684 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34a3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 0x56294f54edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58448/0 (socket says 172.21.15.98:58448) 2024-09-19T07:27:00.963 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34a908e640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f34940a3460 0x7f34940a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34a3fff640 1 --2- 172.21.15.98:0/401329684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f55e0c0 0x56294f5604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34a888d640 1 -- 172.21.15.98:0/401329684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f55e0c0 msgr2=0x56294f5604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.955+0000 7f34a888d640 1 --2- 172.21.15.98:0/401329684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f55e0c0 0x56294f5604b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.956+0000 7f34a888d640 1 -- 172.21.15.98:0/401329684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 msgr2=0x56294f54edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.956+0000 7f34a888d640 1 --2- 172.21.15.98:0/401329684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 0x56294f54edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.956+0000 7f34a888d640 1 -- 172.21.15.98:0/401329684 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56294f45a340 con 0x56294f54f330 2024-09-19T07:27:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.956+0000 7f34a3fff640 1 --2- 172.21.15.98:0/401329684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 0x56294f54edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.956+0000 7f34a1ffb640 1 -- 172.21.15.98:0/3990802896 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f349c0d0380 con 0x7f34a4107b70 2024-09-19T07:27:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.956+0000 7f34a888d640 1 --2- 172.21.15.98:0/401329684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54f330 0x56294f55db80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f349802a940 tx=0x7f3498005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19438fc7e01b4361 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.956+0000 7f34a908e640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f34940a3460 0x7f34940a5920 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f349c0cdb50 tx=0x7f349c098290 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.956+0000 7f348effd640 1 -- 172.21.15.98:0/401329684 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498040070 con 0x56294f54f330 2024-09-19T07:27:00.964 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.956+0000 7f348effd640 1 -- 172.21.15.98:0/401329684 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3498031870 con 0x56294f54f330 2024-09-19T07:27:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.956+0000 7f348effd640 1 -- 172.21.15.98:0/401329684 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498035040 con 0x56294f54f330 2024-09-19T07:27:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.957+0000 7f34ad88d740 1 -- 172.21.15.98:0/401329684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54f330 msgr2=0x56294f55db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.957+0000 7f34ad88d740 1 --2- 172.21.15.98:0/401329684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54f330 0x56294f55db80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f349802a940 tx=0x7f3498005bd0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.957+0000 7f34ad88d740 1 -- 172.21.15.98:0/401329684 shutdown_connections 2024-09-19T07:27:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.957+0000 7f34ad88d740 1 --2- 172.21.15.98:0/401329684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f55e0c0 0x56294f5604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.957+0000 7f34ad88d740 1 --2- 172.21.15.98:0/401329684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54f330 0x56294f55db80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.957+0000 7f34ad88d740 1 --2- 172.21.15.98:0/401329684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 0x56294f54edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.957+0000 7f34ad88d740 1 -- 172.21.15.98:0/401329684 >> 172.21.15.98:0/401329684 conn(0x56294f54b060 msgr2=0x56294f54b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.957+0000 7f34ad88d740 1 -- 172.21.15.98:0/401329684 shutdown_connections 2024-09-19T07:27:00.965 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.957+0000 7f34ad88d740 1 -- 172.21.15.98:0/401329684 wait complete. 2024-09-19T07:27:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.957+0000 7f34ad88d740 1 -- start start 2024-09-19T07:27:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.957+0000 7f34ad88d740 1 Processor -- start 2024-09-19T07:27:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34ad88d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54ea10 0x56294f55af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34ad88d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 0x56294f55b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34ad88d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 0x56294f55b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34ad88d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56294f560c90 con 0x56294f55e0c0 2024-09-19T07:27:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34ad88d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56294f43c290 con 0x56294f54ea10 2024-09-19T07:27:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34ad88d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56294f560e10 con 0x56294f54f330 2024-09-19T07:27:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34ad88d740 10 client.0 _ll_register_callbacks cb 0x56294f46d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34a3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 0x56294f55b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34a3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 0x56294f55b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58456/0 (socket says 172.21.15.98:58456) 2024-09-19T07:27:00.966 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34a3fff640 1 -- 172.21.15.98:0/1303042323 learned_addr learned my addr 172.21.15.98:0/1303042323 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34a3fff640 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54ea10 0x56294f55af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34a888d640 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 0x56294f55b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34a3fff640 1 -- 172.21.15.98:0/1303042323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 msgr2=0x56294f55b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34a3fff640 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 0x56294f55b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34a3fff640 1 -- 172.21.15.98:0/1303042323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54ea10 msgr2=0x56294f55af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34a3fff640 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54ea10 0x56294f55af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34a3fff640 1 -- 172.21.15.98:0/1303042323 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56294f1c6210 con 0x56294f55e0c0 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f34a3fff640 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 0x56294f55b9c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3490011ec0 tx=0x7f3490005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44dc0f2e839ebf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.958+0000 7f3483fff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f3483fff640 1 -- 172.21.15.98:0/1303042323 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490011070 con 0x56294f55e0c0 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f34ad88d740 1 -- 172.21.15.98:0/1303042323 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3498031870 con 0x56294f55e0c0 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f3483fff640 1 -- 172.21.15.98:0/1303042323 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f3490011210 con 0x56294f55e0c0 2024-09-19T07:27:00.967 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f3483fff640 1 -- 172.21.15.98:0/1303042323 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3490004020 con 0x56294f55e0c0 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f34ad88d740 10 client.16557 fetch_fsmap learned FSMap version 30 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f34ad88d740 1 -- 172.21.15.98:0/1303042323 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56294f292620 con 0x56294f55e0c0 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f3483fff640 1 -- 172.21.15.98:0/1303042323 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3498031870 con 0x56294f55e0c0 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f3483fff640 1 -- 172.21.15.98:0/1303042323 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f3490003c70 con 0x56294f55e0c0 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f34ad88d740 10 client.16557 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f34ad88d740 10 client.16557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f34ad88d740 20 client.16557 populate_metadata read hostname 'smithi098' 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f34ad88d740 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56294f56e070 0x56294f570480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f34ad88d740 4 client.16557 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f34ad88d740 1 -- 172.21.15.98:0/1303042323 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56294f4c0a20 con 0x56294f56e070 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.959+0000 7f34a888d640 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56294f56e070 0x56294f570480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.960+0000 7f34a888d640 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56294f56e070 0x56294f570480 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a4a037d792f9dfd server_cookie=284a800fc5119f9b in_seq=0 out_seq=0 2024-09-19T07:27:00.968 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.960+0000 7f3483fff640 10 client.16557 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f3483fff640 1 -- 172.21.15.98:0/1303042323 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56294f4c0a20 con 0x56294f56e070 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f3483fff640 10 client.16557 handle_command_reply: tid=0 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f34ad88d740 1 client.16557 shutdown 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f34ad88d740 1 -- 172.21.15.98:0/1303042323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 msgr2=0x56294f55b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f34ad88d740 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 0x56294f55b9c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3490011ec0 tx=0x7f3490005f90 comp rx=0 tx=0).stop 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f34ad88d740 1 -- 172.21.15.98:0/1303042323 shutdown_connections 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f34ad88d740 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56294f56e070 0x56294f570480 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f34ad88d740 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 0x56294f55b9c0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f34ad88d740 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 0x56294f55b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f34ad88d740 1 --2- 172.21.15.98:0/1303042323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54ea10 0x56294f55af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f34ad88d740 1 -- 172.21.15.98:0/1303042323 >> 172.21.15.98:0/1303042323 conn(0x56294f54b060 msgr2=0x56294f550d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f3483fff640 0 client.16557 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:00.969 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f34ad88d740 1 -- 172.21.15.98:0/1303042323 shutdown_connections 2024-09-19T07:27:00.970 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f34ad88d740 1 -- 172.21.15.98:0/1303042323 wait complete. 2024-09-19T07:27:00.970 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.961+0000 7f34ad88d740 20 client.16557 trim_cache size 0 max 16384 2024-09-19T07:27:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.975+0000 7f34ad88d740 1 Processor -- start 2024-09-19T07:27:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.975+0000 7f34ad88d740 1 -- start start 2024-09-19T07:27:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34ad88d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 0x56294f5597f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34ad88d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 0x56294f575d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34ad88d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f55e0c0 0x56294f576290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34ad88d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41ae0e0 con 0x56294f54ea10 2024-09-19T07:27:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34ad88d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41ab8f0 con 0x56294f55e0c0 2024-09-19T07:27:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34ad88d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41a9740 con 0x56294f54f330 2024-09-19T07:27:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34a3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 0x56294f5597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34a3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 0x56294f5597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58470/0 (socket says 172.21.15.98:58470) 2024-09-19T07:27:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34a3fff640 1 -- 172.21.15.98:0/2131422644 learned_addr learned my addr 172.21.15.98:0/2131422644 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34a3fff640 1 --2- 172.21.15.98:0/2131422644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f55e0c0 0x56294f576290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34a3fff640 1 -- 172.21.15.98:0/2131422644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 msgr2=0x56294f575d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34a3fff640 1 --2- 172.21.15.98:0/2131422644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 0x56294f575d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34a3fff640 1 -- 172.21.15.98:0/2131422644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f55e0c0 msgr2=0x56294f576290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34a3fff640 1 --2- 172.21.15.98:0/2131422644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f55e0c0 0x56294f576290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34a3fff640 1 -- 172.21.15.98:0/2131422644 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56294f559ed0 con 0x56294f54ea10 2024-09-19T07:27:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f34a3fff640 1 --2- 172.21.15.98:0/2131422644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 0x56294f5597f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3490011cf0 tx=0x7f3490011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c63768e5a6cf887 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f348e7fc640 1 -- 172.21.15.98:0/2131422644 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490032070 con 0x56294f54ea10 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f348e7fc640 1 -- 172.21.15.98:0/2131422644 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34900035f0 con 0x56294f54ea10 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.976+0000 7f348e7fc640 1 -- 172.21.15.98:0/2131422644 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490010cc0 con 0x56294f54ea10 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.977+0000 7f34ad88d740 1 -- 172.21.15.98:0/2131422644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 msgr2=0x56294f5597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.977+0000 7f34ad88d740 1 --2- 172.21.15.98:0/2131422644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 0x56294f5597f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3490011cf0 tx=0x7f3490011ba0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.977+0000 7f34ad88d740 1 -- 172.21.15.98:0/2131422644 shutdown_connections 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.977+0000 7f34ad88d740 1 --2- 172.21.15.98:0/2131422644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f55e0c0 0x56294f576290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.977+0000 7f34ad88d740 1 --2- 172.21.15.98:0/2131422644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 0x56294f575d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.977+0000 7f34ad88d740 1 --2- 172.21.15.98:0/2131422644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f54ea10 0x56294f5597f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.977+0000 7f34ad88d740 1 -- 172.21.15.98:0/2131422644 >> 172.21.15.98:0/2131422644 conn(0x56294f54b060 msgr2=0x56294f55cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.977+0000 7f34ad88d740 1 -- 172.21.15.98:0/2131422644 shutdown_connections 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.977+0000 7f34ad88d740 1 -- 172.21.15.98:0/2131422644 wait complete. 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.977+0000 7f34ad88d740 1 -- start start 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.977+0000 7f34ad88d740 1 Processor -- start 2024-09-19T07:27:00.982 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34ad88d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54ea10 0x56294f561fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34ad88d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 0x56294f5624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34ad88d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 0x56294f562a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34ad88d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41a9db0 con 0x56294f55e0c0 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34ad88d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41ab220 con 0x56294f54ea10 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34ad88d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34a41aa480 con 0x56294f54f330 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34ad88d740 10 client.0 _ll_register_callbacks cb 0x7f3490009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34a3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 0x56294f562a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34a3fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 0x56294f562a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:58474/0 (socket says 172.21.15.98:58474) 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34a3fff640 1 -- 172.21.15.98:0/2977687177 learned_addr learned my addr 172.21.15.98:0/2977687177 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34a3fff640 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54ea10 0x56294f561fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34a888d640 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 0x56294f5624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34a3fff640 1 -- 172.21.15.98:0/2977687177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 msgr2=0x56294f5624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34a3fff640 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 0x56294f5624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34a3fff640 1 -- 172.21.15.98:0/2977687177 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54ea10 msgr2=0x56294f561fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34a3fff640 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54ea10 0x56294f561fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34a3fff640 1 -- 172.21.15.98:0/2977687177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56294f54f160 con 0x56294f55e0c0 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34a888d640 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 0x56294f5624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34a3fff640 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 0x56294f562a20 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3490010450 tx=0x7f3490000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8401242bbdd90a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f3483fff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f3483fff640 1 -- 172.21.15.98:0/2977687177 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490032040 con 0x56294f55e0c0 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f3483fff640 1 -- 172.21.15.98:0/2977687177 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f3490010e40 con 0x56294f55e0c0 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.978+0000 7f34ad88d740 1 -- 172.21.15.98:0/2977687177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34900035f0 con 0x56294f55e0c0 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.979+0000 7f3483fff640 1 -- 172.21.15.98:0/2977687177 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3490011040 con 0x56294f55e0c0 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.979+0000 7f34ad88d740 10 client.16563 fetch_fsmap learned FSMap version 30 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.979+0000 7f34ad88d740 1 -- 172.21.15.98:0/2977687177 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56294f5d8fc0 con 0x56294f55e0c0 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.979+0000 7f3483fff640 1 -- 172.21.15.98:0/2977687177 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34900035f0 con 0x56294f55e0c0 2024-09-19T07:27:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.979+0000 7f3483fff640 1 -- 172.21.15.98:0/2977687177 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f3490022720 con 0x56294f55e0c0 2024-09-19T07:27:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.979+0000 7f34ad88d740 10 client.16563 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:27:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.979+0000 7f34ad88d740 10 client.16563 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:27:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.979+0000 7f34ad88d740 20 client.16563 populate_metadata read hostname 'smithi098' 2024-09-19T07:27:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.979+0000 7f34ad88d740 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56294f5d9620 0x56294f5dba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.979+0000 7f34ad88d740 4 client.16563 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:27:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.979+0000 7f34ad88d740 1 -- 172.21.15.98:0/2977687177 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56294f4bad70 con 0x56294f5d9620 2024-09-19T07:27:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.979+0000 7f34a888d640 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56294f5d9620 0x56294f5dba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.980+0000 7f34a888d640 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56294f5d9620 0x56294f5dba40 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b97cede68bf6ed6 server_cookie=cf6ed4ee2d02bc0f in_seq=0 out_seq=0 2024-09-19T07:27:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:00.980+0000 7f3483fff640 10 client.16563 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f3483fff640 1 -- 172.21.15.98:0/2977687177 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56294f4bad70 con 0x56294f5d9620 2024-09-19T07:27:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f3483fff640 10 client.16563 handle_command_reply: tid=0 2024-09-19T07:27:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f34ad88d740 1 client.16563 shutdown 2024-09-19T07:27:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f34ad88d740 1 -- 172.21.15.98:0/2977687177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 msgr2=0x56294f562a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f34ad88d740 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 0x56294f562a20 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3490010450 tx=0x7f3490000bc0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f34ad88d740 1 -- 172.21.15.98:0/2977687177 shutdown_connections 2024-09-19T07:27:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f34ad88d740 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x56294f5d9620 0x56294f5dba40 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f34ad88d740 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56294f55e0c0 0x56294f562a20 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f34ad88d740 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56294f54f330 0x56294f5624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f3483fff640 0 client.16563 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f34ad88d740 1 --2- 172.21.15.98:0/2977687177 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56294f54ea10 0x56294f561fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f34ad88d740 1 -- 172.21.15.98:0/2977687177 >> 172.21.15.98:0/2977687177 conn(0x56294f54b060 msgr2=0x56294f55cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f34ad88d740 1 -- 172.21.15.98:0/2977687177 shutdown_connections 2024-09-19T07:27:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f34ad88d740 1 -- 172.21.15.98:0/2977687177 wait complete. 2024-09-19T07:27:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.105+0000 7f34ad88d740 20 client.16563 trim_cache size 0 max 16384 2024-09-19T07:27:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:27:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:27:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:27:01.107 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:27:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.106+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3990802896 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f34940a3460 msgr2=0x7f34940a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.106+0000 7f34aaaf1640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f34940a3460 0x7f34940a5920 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f349c0cdb50 tx=0x7f349c098290 comp rx=0 tx=0).stop 2024-09-19T07:27:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.106+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3990802896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34a4107b70 msgr2=0x7f34a419cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.106+0000 7f34aaaf1640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34a4107b70 0x7f34a419cc30 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f349c00eb10 tx=0x7f349c00c2d0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.106+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3990802896 shutdown_connections 2024-09-19T07:27:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.106+0000 7f34aaaf1640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f34940a3460 0x7f34940a5920 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.106+0000 7f34aaaf1640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f34a4107b70 0x7f34a419cc30 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.106+0000 7f34aaaf1640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f34a4102470 0x7f34a41988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.106+0000 7f34aaaf1640 1 --2- 172.21.15.98:0/3990802896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34a4101ad0 0x7f34a4198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.106+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3990802896 >> 172.21.15.98:0/3990802896 conn(0x7f34a40fd7b0 msgr2=0x7f34a40fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.106+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3990802896 shutdown_connections 2024-09-19T07:27:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:01.106+0000 7f34aaaf1640 1 -- 172.21.15.98:0/3990802896 wait complete. 2024-09-19T07:27:01.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:00 smithi098 ceph-mon[30950]: pgmap v151: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 495 KiB/s wr, 102 op/s 2024-09-19T07:27:01.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:00 smithi139 ceph-mon[35039]: pgmap v151: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 495 KiB/s wr, 102 op/s 2024-09-19T07:27:01.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:00 smithi162 ceph-mon[35726]: pgmap v151: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 495 KiB/s wr, 102 op/s 2024-09-19T07:27:03.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:02 smithi098 ceph-mon[30950]: pgmap v152: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 479 KiB/s wr, 102 op/s 2024-09-19T07:27:03.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:02 smithi139 ceph-mon[35039]: pgmap v152: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 479 KiB/s wr, 102 op/s 2024-09-19T07:27:03.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:02 smithi162 ceph-mon[35726]: pgmap v152: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 479 KiB/s wr, 102 op/s 2024-09-19T07:27:05.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:05 smithi098 ceph-mon[30950]: pgmap v153: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 478 KiB/s wr, 101 op/s 2024-09-19T07:27:05.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:05 smithi139 ceph-mon[35039]: pgmap v153: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 478 KiB/s wr, 101 op/s 2024-09-19T07:27:05.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:05 smithi162 ceph-mon[35726]: pgmap v153: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 478 KiB/s wr, 101 op/s 2024-09-19T07:27:07.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:07 smithi098 ceph-mon[30950]: pgmap v154: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 599 KiB/s wr, 206 op/s 2024-09-19T07:27:07.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:07 smithi139 ceph-mon[35039]: pgmap v154: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 599 KiB/s wr, 206 op/s 2024-09-19T07:27:07.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:07 smithi162 ceph-mon[35726]: pgmap v154: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 599 KiB/s wr, 206 op/s 2024-09-19T07:27:09.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:09 smithi098 ceph-mon[30950]: pgmap v155: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 428 KiB/s wr, 198 op/s 2024-09-19T07:27:09.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:09 smithi139 ceph-mon[35039]: pgmap v155: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 428 KiB/s wr, 198 op/s 2024-09-19T07:27:09.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:09 smithi162 ceph-mon[35726]: pgmap v155: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 428 KiB/s wr, 198 op/s 2024-09-19T07:27:11.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:11 smithi098 ceph-mon[30950]: pgmap v156: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 430 KiB/s wr, 200 op/s 2024-09-19T07:27:11.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:11 smithi139 ceph-mon[35039]: pgmap v156: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 430 KiB/s wr, 200 op/s 2024-09-19T07:27:11.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:11 smithi162 ceph-mon[35726]: pgmap v156: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 430 KiB/s wr, 200 op/s 2024-09-19T07:27:13.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:13 smithi098 ceph-mon[30950]: pgmap v157: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 123 KiB/s wr, 113 op/s 2024-09-19T07:27:13.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:13 smithi139 ceph-mon[35039]: pgmap v157: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 123 KiB/s wr, 113 op/s 2024-09-19T07:27:13.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:13 smithi162 ceph-mon[35726]: pgmap v157: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 123 KiB/s wr, 113 op/s 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.202+0000 7f17070a5640 1 -- 172.21.15.98:0/3366659161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1700101390 msgr2=0x7f170010d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.202+0000 7f17070a5640 1 --2- 172.21.15.98:0/3366659161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1700101390 0x7f170010d8c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009cd0 tx=0x7f16f802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.202+0000 7f17070a5640 1 -- 172.21.15.98:0/3366659161 shutdown_connections 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.202+0000 7f17070a5640 1 --2- 172.21.15.98:0/3366659161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1700101390 0x7f170010d8c0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.202+0000 7f17070a5640 1 --2- 172.21.15.98:0/3366659161 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17001009f0 0x7f1700100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.202+0000 7f17070a5640 1 --2- 172.21.15.98:0/3366659161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1700106a00 0x7f1700106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.205 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.202+0000 7f17070a5640 1 -- 172.21.15.98:0/3366659161 >> 172.21.15.98:0/3366659161 conn(0x7f17000fc6b0 msgr2=0x7f17000fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.202+0000 7f17070a5640 1 -- 172.21.15.98:0/3366659161 shutdown_connections 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.202+0000 7f17070a5640 1 -- 172.21.15.98:0/3366659161 wait complete. 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.202+0000 7f17070a5640 1 Processor -- start 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.202+0000 7f17070a5640 1 -- start start 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f17070a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17001009f0 0x7f1700198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f17070a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1700101390 0x7f1700198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f17070a5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1700106a00 0x7f170019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f17070a5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1700110e90 con 0x7f1700106a00 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f17070a5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1700110d10 con 0x7f17001009f0 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f17070a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1700111010 con 0x7f1700101390 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f1705642640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1700106a00 0x7f170019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f1705642640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1700106a00 0x7f170019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47938/0 (socket says 172.21.15.98:47938) 2024-09-19T07:27:14.206 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f1705642640 1 -- 172.21.15.98:0/2150445 learned_addr learned my addr 172.21.15.98:0/2150445 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f1704e41640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17001009f0 0x7f1700198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f16fffff640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1700101390 0x7f1700198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f1705642640 1 -- 172.21.15.98:0/2150445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1700101390 msgr2=0x7f1700198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f1705642640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1700101390 0x7f1700198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f1705642640 1 -- 172.21.15.98:0/2150445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17001009f0 msgr2=0x7f1700198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f1705642640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17001009f0 0x7f1700198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f1705642640 1 -- 172.21.15.98:0/2150445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f170019d320 con 0x7f1700106a00 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f16fffff640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1700101390 0x7f1700198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f1705642640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1700106a00 0x7f170019cbf0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f16f8033040 tx=0x7f16f8031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.203+0000 7f16fdffb640 1 -- 172.21.15.98:0/2150445 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8004040 con 0x7f1700106a00 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.204+0000 7f16fdffb640 1 -- 172.21.15.98:0/2150445 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16f80046c0 con 0x7f1700106a00 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.204+0000 7f17070a5640 1 -- 172.21.15.98:0/2150445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f170019d5b0 con 0x7f1700106a00 2024-09-19T07:27:14.207 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.204+0000 7f16fdffb640 1 -- 172.21.15.98:0/2150445 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f8046480 con 0x7f1700106a00 2024-09-19T07:27:14.208 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.204+0000 7f17070a5640 1 -- 172.21.15.98:0/2150445 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17001a4ea0 con 0x7f1700106a00 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.206+0000 7f16fdffb640 1 -- 172.21.15.98:0/2150445 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f16f80305a0 con 0x7f1700106a00 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f1709e44740 1 Processor -- start 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f1709e44740 1 -- start start 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f1709e44740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 0x558e5b6c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f1709e44740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c5410 0x558e5b6cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f1709e44740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 0x558e5b6d20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f1709e44740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558e5b6292f0 con 0x558e5b6c4af0 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f1709e44740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558e5b5d1270 con 0x558e5b6cfcb0 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f1709e44740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558e5b6252b0 con 0x558e5b6c5410 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f16fdffb640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16e80a3460 0x7f16e80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f16fffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 0x558e5b6c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.213 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f1705642640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16e80a3460 0x7f16e80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f16fffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 0x558e5b6c4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47940/0 (socket says 172.21.15.98:47940) 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f16fffff640 1 -- 172.21.15.98:0/3249681865 learned_addr learned my addr 172.21.15.98:0/3249681865 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f1704e41640 1 --2- 172.21.15.98:0/3249681865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c5410 0x558e5b6cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f16fdffb640 1 -- 172.21.15.98:0/2150445 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f16f802e030 con 0x7f1700106a00 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f16fffff640 1 -- 172.21.15.98:0/3249681865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c5410 msgr2=0x558e5b6cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f16fffff640 1 --2- 172.21.15.98:0/3249681865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c5410 0x558e5b6cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f16fffff640 1 -- 172.21.15.98:0/3249681865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 msgr2=0x558e5b6d20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f16fffff640 1 --2- 172.21.15.98:0/3249681865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 0x558e5b6d20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.207+0000 7f16fffff640 1 -- 172.21.15.98:0/3249681865 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e5b5d0340 con 0x558e5b6c4af0 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.208+0000 7f1705642640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16e80a3460 0x7f16e80a5920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f16f80eea10 tx=0x7f16f8090320 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.208+0000 7f16fffff640 1 --2- 172.21.15.98:0/3249681865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 0x558e5b6c4ed0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009ca0 tx=0x7f16f4012760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00bee34de5b70a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.208+0000 7f16e6ffd640 1 -- 172.21.15.98:0/3249681865 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f4004030 con 0x558e5b6c4af0 2024-09-19T07:27:14.214 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.208+0000 7f16e6ffd640 1 -- 172.21.15.98:0/3249681865 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16f40041d0 con 0x558e5b6c4af0 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.208+0000 7f16e6ffd640 1 -- 172.21.15.98:0/3249681865 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f40136d0 con 0x558e5b6c4af0 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.208+0000 7f1709e44740 1 -- 172.21.15.98:0/3249681865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 msgr2=0x558e5b6c4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.208+0000 7f1709e44740 1 --2- 172.21.15.98:0/3249681865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 0x558e5b6c4ed0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009ca0 tx=0x7f16f4012760 comp rx=0 tx=0).stop 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.208+0000 7f1709e44740 1 -- 172.21.15.98:0/3249681865 shutdown_connections 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 --2- 172.21.15.98:0/3249681865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 0x558e5b6d20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 --2- 172.21.15.98:0/3249681865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c5410 0x558e5b6cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 --2- 172.21.15.98:0/3249681865 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 0x558e5b6c4ed0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 -- 172.21.15.98:0/3249681865 >> 172.21.15.98:0/3249681865 conn(0x558e5b6c1060 msgr2=0x558e5b6c1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 -- 172.21.15.98:0/3249681865 shutdown_connections 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 -- 172.21.15.98:0/3249681865 wait complete. 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 -- start start 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 Processor -- start 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c4af0 0x558e5b6ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.215 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 0x558e5b6cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 0x558e5b6cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558e5b6d2880 con 0x558e5b6c5410 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558e5b5b2290 con 0x558e5b6cfcb0 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.209+0000 7f1709e44740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x558e5b6d2a00 con 0x558e5b6c4af0 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f1709e44740 10 client.0 _ll_register_callbacks cb 0x558e5b5e3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f1704e41640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 0x558e5b6cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f1704e41640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 0x558e5b6cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47952/0 (socket says 172.21.15.98:47952) 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f1704e41640 1 -- 172.21.15.98:0/1170370690 learned_addr learned my addr 172.21.15.98:0/1170370690 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f16fffff640 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 0x558e5b6cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f16fffff640 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c4af0 0x558e5b6ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f1704e41640 1 -- 172.21.15.98:0/1170370690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c4af0 msgr2=0x558e5b6ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f1704e41640 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c4af0 0x558e5b6ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.216 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f1704e41640 1 -- 172.21.15.98:0/1170370690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 msgr2=0x558e5b6cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f1704e41640 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 0x558e5b6cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f1704e41640 1 -- 172.21.15.98:0/1170370690 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e5b33c210 con 0x558e5b6c5410 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f1704e41640 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 0x558e5b6cd000 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f16f000b9f0 tx=0x7f16f000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e678517c33d38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f16dffff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f16dffff640 1 -- 172.21.15.98:0/1170370690 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0003e20 con 0x558e5b6c5410 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f16dffff640 1 -- 172.21.15.98:0/1170370690 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f16f0011440 con 0x558e5b6c5410 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.210+0000 7f1709e44740 1 -- 172.21.15.98:0/1170370690 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16f40041d0 con 0x558e5b6c5410 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.211+0000 7f16dffff640 1 -- 172.21.15.98:0/1170370690 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f16f0011640 con 0x558e5b6c5410 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.211+0000 7f1709e44740 10 client.16575 fetch_fsmap learned FSMap version 30 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.211+0000 7f1709e44740 1 -- 172.21.15.98:0/1170370690 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558e5b408620 con 0x558e5b6c5410 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.211+0000 7f16dffff640 1 -- 172.21.15.98:0/1170370690 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16f40041d0 con 0x558e5b6c5410 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.211+0000 7f16dffff640 1 -- 172.21.15.98:0/1170370690 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f16f0023ab0 con 0x558e5b6c5410 2024-09-19T07:27:14.217 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.211+0000 7f1709e44740 10 client.16575 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:27:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.211+0000 7f1709e44740 10 client.16575 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:27:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.211+0000 7f1709e44740 20 client.16575 populate_metadata read hostname 'smithi098' 2024-09-19T07:27:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.211+0000 7f1709e44740 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558e5b6dfc70 0x558e5b6e2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.211+0000 7f1709e44740 4 client.16575 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.211+0000 7f1709e44740 1 -- 172.21.15.98:0/1170370690 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e5b636a20 con 0x558e5b6dfc70 2024-09-19T07:27:14.218 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.211+0000 7f16fffff640 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558e5b6dfc70 0x558e5b6e2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.212+0000 7f16fffff640 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558e5b6dfc70 0x558e5b6e2090 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=891bac99cb54c90d server_cookie=c2778e3d645bac98 in_seq=0 out_seq=0 2024-09-19T07:27:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.212+0000 7f16dffff640 10 client.16575 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f16dffff640 1 -- 172.21.15.98:0/1170370690 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e5b636a20 con 0x558e5b6dfc70 2024-09-19T07:27:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f16dffff640 10 client.16575 handle_command_reply: tid=0 2024-09-19T07:27:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f1709e44740 1 client.16575 shutdown 2024-09-19T07:27:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f1709e44740 1 -- 172.21.15.98:0/1170370690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 msgr2=0x558e5b6cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.219 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f1709e44740 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 0x558e5b6cd000 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f16f000b9f0 tx=0x7f16f000beb0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f1709e44740 1 -- 172.21.15.98:0/1170370690 shutdown_connections 2024-09-19T07:27:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f1709e44740 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 0x558e5b6cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f1709e44740 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558e5b6dfc70 0x558e5b6e2090 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f1709e44740 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 0x558e5b6cd000 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f16dffff640 0 client.16575 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f1709e44740 1 --2- 172.21.15.98:0/1170370690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c4af0 0x558e5b6ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f1709e44740 1 -- 172.21.15.98:0/1170370690 >> 172.21.15.98:0/1170370690 conn(0x558e5b6c1060 msgr2=0x558e5b6c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f1709e44740 1 -- 172.21.15.98:0/1170370690 shutdown_connections 2024-09-19T07:27:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f1709e44740 1 -- 172.21.15.98:0/1170370690 wait complete. 2024-09-19T07:27:14.220 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.213+0000 7f1709e44740 20 client.16575 trim_cache size 0 max 16384 2024-09-19T07:27:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.227+0000 7f1709e44740 1 Processor -- start 2024-09-19T07:27:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.227+0000 7f1709e44740 1 -- start start 2024-09-19T07:27:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1709e44740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c4af0 0x558e5b6cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1709e44740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 0x558e5b6cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1709e44740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 0x558e5b6e7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1709e44740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f17001b01e0 con 0x558e5b6c5410 2024-09-19T07:27:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1709e44740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f17001ad9f0 con 0x558e5b6cfcb0 2024-09-19T07:27:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1709e44740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f17001ab840 con 0x558e5b6c4af0 2024-09-19T07:27:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1704e41640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 0x558e5b6cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.233 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1704e41640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 0x558e5b6cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47968/0 (socket says 172.21.15.98:47968) 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1704e41640 1 -- 172.21.15.98:0/3183009207 learned_addr learned my addr 172.21.15.98:0/3183009207 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f16fffff640 1 --2- 172.21.15.98:0/3183009207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c4af0 0x558e5b6cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f16fffff640 1 --2- 172.21.15.98:0/3183009207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 0x558e5b6e7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1704e41640 1 -- 172.21.15.98:0/3183009207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c4af0 msgr2=0x558e5b6cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1704e41640 1 --2- 172.21.15.98:0/3183009207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c4af0 0x558e5b6cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1704e41640 1 -- 172.21.15.98:0/3183009207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 msgr2=0x558e5b6e7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1704e41640 1 --2- 172.21.15.98:0/3183009207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 0x558e5b6e7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1704e41640 1 -- 172.21.15.98:0/3183009207 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e5b6c0e90 con 0x558e5b6c5410 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f16fffff640 1 --2- 172.21.15.98:0/3183009207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 0x558e5b6e7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f1704e41640 1 --2- 172.21.15.98:0/3183009207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 0x558e5b6cd370 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f16f0023f20 tx=0x7f16f0004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4310378faf1fc95e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f16e67fc640 1 -- 172.21.15.98:0/3183009207 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0011440 con 0x558e5b6c5410 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f16e67fc640 1 -- 172.21.15.98:0/3183009207 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16f0005520 con 0x558e5b6c5410 2024-09-19T07:27:14.234 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.228+0000 7f16e67fc640 1 -- 172.21.15.98:0/3183009207 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0004680 con 0x558e5b6c5410 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.229+0000 7f1709e44740 1 -- 172.21.15.98:0/3183009207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 msgr2=0x558e5b6cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.229+0000 7f1709e44740 1 --2- 172.21.15.98:0/3183009207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 0x558e5b6cd370 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f16f0023f20 tx=0x7f16f0004580 comp rx=0 tx=0).stop 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.229+0000 7f1709e44740 1 -- 172.21.15.98:0/3183009207 shutdown_connections 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.229+0000 7f1709e44740 1 --2- 172.21.15.98:0/3183009207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6cfcb0 0x558e5b6e7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.229+0000 7f1709e44740 1 --2- 172.21.15.98:0/3183009207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c5410 0x558e5b6cd370 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.229+0000 7f1709e44740 1 --2- 172.21.15.98:0/3183009207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6c4af0 0x558e5b6cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.229+0000 7f1709e44740 1 -- 172.21.15.98:0/3183009207 >> 172.21.15.98:0/3183009207 conn(0x558e5b6c1060 msgr2=0x558e5b6cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.229+0000 7f1709e44740 1 -- 172.21.15.98:0/3183009207 shutdown_connections 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.229+0000 7f1709e44740 1 -- 172.21.15.98:0/3183009207 wait complete. 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.229+0000 7f1709e44740 1 -- start start 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.229+0000 7f1709e44740 1 Processor -- start 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f1709e44740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 0x558e5b6d8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.235 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f1709e44740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6c5410 0x558e5b6d8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f1709e44740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6cfcb0 0x558e5b6d3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f1709e44740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f17001abeb0 con 0x558e5b6c4af0 2024-09-19T07:27:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f1709e44740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f17001ad320 con 0x558e5b6c5410 2024-09-19T07:27:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f1709e44740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f17001ac580 con 0x558e5b6cfcb0 2024-09-19T07:27:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f1709e44740 10 client.0 _ll_register_callbacks cb 0x7f16f0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f16fffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 0x558e5b6d8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f16fffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 0x558e5b6d8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47972/0 (socket says 172.21.15.98:47972) 2024-09-19T07:27:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f16fffff640 1 -- 172.21.15.98:0/2444214889 learned_addr learned my addr 172.21.15.98:0/2444214889 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f1704e41640 1 --2- 172.21.15.98:0/2444214889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6c5410 0x558e5b6d8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f16fffff640 1 -- 172.21.15.98:0/2444214889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6cfcb0 msgr2=0x558e5b6d3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f16fffff640 1 --2- 172.21.15.98:0/2444214889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6cfcb0 0x558e5b6d3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f16fffff640 1 -- 172.21.15.98:0/2444214889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6c5410 msgr2=0x558e5b6d8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f16fffff640 1 --2- 172.21.15.98:0/2444214889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6c5410 0x558e5b6d8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f16fffff640 1 -- 172.21.15.98:0/2444214889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e5b6d3dc0 con 0x558e5b6c4af0 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f16fffff640 1 --2- 172.21.15.98:0/2444214889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 0x558e5b6d8020 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f16f4012c60 tx=0x7f16f4003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44ff209a7fa2d1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f16dffff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.230+0000 7f16dffff640 1 -- 172.21.15.98:0/2444214889 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f4026040 con 0x558e5b6c4af0 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f16dffff640 1 -- 172.21.15.98:0/2444214889 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f16f4005250 con 0x558e5b6c4af0 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f1709e44740 1 -- 172.21.15.98:0/2444214889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16f0005520 con 0x558e5b6c4af0 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f16dffff640 1 -- 172.21.15.98:0/2444214889 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f16f4005450 con 0x558e5b6c4af0 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f1709e44740 10 client.16581 fetch_fsmap learned FSMap version 30 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f1709e44740 1 -- 172.21.15.98:0/2444214889 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558e5b74a4d0 con 0x558e5b6c4af0 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f16dffff640 1 -- 172.21.15.98:0/2444214889 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16f0005520 con 0x558e5b6c4af0 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f16dffff640 1 -- 172.21.15.98:0/2444214889 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f16f400f040 con 0x558e5b6c4af0 2024-09-19T07:27:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f1709e44740 10 client.16581 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:27:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f1709e44740 10 client.16581 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:27:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f1709e44740 20 client.16581 populate_metadata read hostname 'smithi098' 2024-09-19T07:27:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f1709e44740 1 --2- 172.21.15.98:0/2444214889 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558e5b74aa30 0x558e5b74ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f1709e44740 4 client.16581 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:27:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f1709e44740 1 -- 172.21.15.98:0/2444214889 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558e5b630d70 con 0x558e5b74aa30 2024-09-19T07:27:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.231+0000 7f1704e41640 1 --2- 172.21.15.98:0/2444214889 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558e5b74aa30 0x558e5b74ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.232+0000 7f16dffff640 10 client.16581 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.232+0000 7f1704e41640 1 --2- 172.21.15.98:0/2444214889 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558e5b74aa30 0x558e5b74ce50 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9c3c1bc5ebc41ba server_cookie=6f0aa6290c1cbcff in_seq=0 out_seq=0 2024-09-19T07:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.256+0000 7f16dffff640 1 -- 172.21.15.98:0/2444214889 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558e5b630d70 con 0x558e5b74aa30 2024-09-19T07:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.256+0000 7f16dffff640 10 client.16581 handle_command_reply: tid=0 2024-09-19T07:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.256+0000 7f1709e44740 1 client.16581 shutdown 2024-09-19T07:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.256+0000 7f1709e44740 1 -- 172.21.15.98:0/2444214889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 msgr2=0x558e5b6d8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.256+0000 7f1709e44740 1 --2- 172.21.15.98:0/2444214889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 0x558e5b6d8020 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f16f4012c60 tx=0x7f16f4003e10 comp rx=0 tx=0).stop 2024-09-19T07:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.256+0000 7f1709e44740 1 -- 172.21.15.98:0/2444214889 shutdown_connections 2024-09-19T07:27:14.258 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.256+0000 7f1709e44740 1 --2- 172.21.15.98:0/2444214889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e5b6cfcb0 0x558e5b6d3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.256+0000 7f1709e44740 1 --2- 172.21.15.98:0/2444214889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e5b6c5410 0x558e5b6d8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.256+0000 7f1709e44740 1 --2- 172.21.15.98:0/2444214889 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x558e5b74aa30 0x558e5b74ce50 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.256+0000 7f1709e44740 1 --2- 172.21.15.98:0/2444214889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e5b6c4af0 0x558e5b6d8020 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.256+0000 7f16dffff640 0 client.16581 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.256+0000 7f1709e44740 1 -- 172.21.15.98:0/2444214889 >> 172.21.15.98:0/2444214889 conn(0x558e5b6c1060 msgr2=0x558e5b6c01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f1709e44740 1 -- 172.21.15.98:0/2444214889 shutdown_connections 2024-09-19T07:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f1709e44740 1 -- 172.21.15.98:0/2444214889 wait complete. 2024-09-19T07:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f1709e44740 20 client.16581 trim_cache size 0 max 16384 2024-09-19T07:27:14.259 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:27:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:27:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:27:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:27:14.260 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f17070a5640 1 -- 172.21.15.98:0/2150445 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16e80a3460 msgr2=0x7f16e80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f17070a5640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16e80a3460 0x7f16e80a5920 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f16f80eea10 tx=0x7f16f8090320 comp rx=0 tx=0).stop 2024-09-19T07:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f17070a5640 1 -- 172.21.15.98:0/2150445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1700106a00 msgr2=0x7f170019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f17070a5640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1700106a00 0x7f170019cbf0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f16f8033040 tx=0x7f16f8031e60 comp rx=0 tx=0).stop 2024-09-19T07:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f17070a5640 1 -- 172.21.15.98:0/2150445 shutdown_connections 2024-09-19T07:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f17070a5640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f16e80a3460 0x7f16e80a5920 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f17070a5640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1700106a00 0x7f170019cbf0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f17070a5640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1700101390 0x7f1700198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f17070a5640 1 --2- 172.21.15.98:0/2150445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f17001009f0 0x7f1700198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f17070a5640 1 -- 172.21.15.98:0/2150445 >> 172.21.15.98:0/2150445 conn(0x7f17000fc6b0 msgr2=0x7f1700104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f17070a5640 1 -- 172.21.15.98:0/2150445 shutdown_connections 2024-09-19T07:27:14.261 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:14.257+0000 7f17070a5640 1 -- 172.21.15.98:0/2150445 wait complete. 2024-09-19T07:27:15.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:15 smithi098 ceph-mon[30950]: pgmap v158: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 123 KiB/s wr, 107 op/s 2024-09-19T07:27:15.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:15 smithi139 ceph-mon[35039]: pgmap v158: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 123 KiB/s wr, 107 op/s 2024-09-19T07:27:15.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:15 smithi162 ceph-mon[35726]: pgmap v158: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 123 KiB/s wr, 107 op/s 2024-09-19T07:27:17.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:17 smithi098 ceph-mon[30950]: pgmap v159: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 144 KiB/s wr, 119 op/s 2024-09-19T07:27:17.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:17 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:27:17.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:17 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:27:17.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:17 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:27:17.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:17 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:27:17.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:17 smithi139 ceph-mon[35039]: pgmap v159: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 144 KiB/s wr, 119 op/s 2024-09-19T07:27:17.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:17 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:27:17.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:17 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:27:17.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:17 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:27:17.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:17 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:27:17.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:17 smithi162 ceph-mon[35726]: pgmap v159: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 144 KiB/s wr, 119 op/s 2024-09-19T07:27:17.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:17 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:27:17.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:17 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:27:17.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:17 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:27:17.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:17 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:27:19.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:19 smithi098 ceph-mon[30950]: pgmap v160: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-19T07:27:19.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:19 smithi139 ceph-mon[35039]: pgmap v160: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-19T07:27:19.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:19 smithi162 ceph-mon[35726]: pgmap v160: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-19T07:27:21.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:21 smithi139 ceph-mon[35039]: pgmap v161: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-19T07:27:21.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:21 smithi162 ceph-mon[35726]: pgmap v161: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-19T07:27:21.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:21 smithi098 ceph-mon[30950]: pgmap v161: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-19T07:27:23.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:23 smithi139 ceph-mon[35039]: pgmap v162: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T07:27:23.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:23 smithi162 ceph-mon[35726]: pgmap v162: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T07:27:23.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:23 smithi098 ceph-mon[30950]: pgmap v162: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T07:27:24.114 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:27:24.374 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:27:24.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.858+0000 7f707b725640 1 -- 172.21.15.98:0/2481686651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7074102ef0 msgr2=0x7f707410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:24.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.858+0000 7f707b725640 1 --2- 172.21.15.98:0/2481686651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7074102ef0 0x7f707410da40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f706c009ca0 tx=0x7f706c02a950 comp rx=0 tx=0).stop 2024-09-19T07:27:24.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.858+0000 7f707b725640 1 -- 172.21.15.98:0/2481686651 shutdown_connections 2024-09-19T07:27:24.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.858+0000 7f707b725640 1 --2- 172.21.15.98:0/2481686651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7074102ef0 0x7f707410da40 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:24.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.858+0000 7f707b725640 1 --2- 172.21.15.98:0/2481686651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7074102570 0x7f70741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:24.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.858+0000 7f707b725640 1 --2- 172.21.15.98:0/2481686651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7074100e20 0x7f7074101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:24.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.858+0000 7f707b725640 1 -- 172.21.15.98:0/2481686651 >> 172.21.15.98:0/2481686651 conn(0x7f70740fc7d0 msgr2=0x7f70740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:24.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.858+0000 7f707b725640 1 -- 172.21.15.98:0/2481686651 shutdown_connections 2024-09-19T07:27:24.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.858+0000 7f707b725640 1 -- 172.21.15.98:0/2481686651 wait complete. 2024-09-19T07:27:24.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f707b725640 1 Processor -- start 2024-09-19T07:27:24.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f707b725640 1 -- start start 2024-09-19T07:27:24.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f707b725640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7074100e20 0x7f7074197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:24.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f707b725640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7074102570 0x7f70741975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:24.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f707b725640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7074102ef0 0x7f7074197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:24.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f707b725640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7074110f80 con 0x7f7074102ef0 2024-09-19T07:27:24.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f707b725640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7074110e00 con 0x7f7074100e20 2024-09-19T07:27:24.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f707b725640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7074111100 con 0x7f7074102570 2024-09-19T07:27:24.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f7079cc2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7074102ef0 0x7f7074197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:24.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f7079cc2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7074102ef0 0x7f7074197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45044/0 (socket says 172.21.15.98:45044) 2024-09-19T07:27:24.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f7079cc2640 1 -- 172.21.15.98:0/535049876 learned_addr learned my addr 172.21.15.98:0/535049876 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:24.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f7078cc0640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7074102570 0x7f70741975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:24.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.859+0000 7f70794c1640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7074100e20 0x7f7074197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.860+0000 7f7079cc2640 1 -- 172.21.15.98:0/535049876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7074102570 msgr2=0x7f70741975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.860+0000 7f7079cc2640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7074102570 0x7f70741975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.860+0000 7f7079cc2640 1 -- 172.21.15.98:0/535049876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7074100e20 msgr2=0x7f7074197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.860+0000 7f7079cc2640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7074100e20 0x7f7074197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.860+0000 7f7079cc2640 1 -- 172.21.15.98:0/535049876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70741a68f0 con 0x7f7074102ef0 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.860+0000 7f7079cc2640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7074102ef0 0x7f7074197b00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f706c006010 tx=0x7f706c02f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.860+0000 7f706a7fc640 1 -- 172.21.15.98:0/535049876 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c034040 con 0x7f7074102ef0 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.860+0000 7f707b725640 1 -- 172.21.15.98:0/535049876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70741a6b80 con 0x7f7074102ef0 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.860+0000 7f706a7fc640 1 -- 172.21.15.98:0/535049876 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f706c003e00 con 0x7f7074102ef0 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.860+0000 7f706a7fc640 1 -- 172.21.15.98:0/535049876 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c045480 con 0x7f7074102ef0 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.860+0000 7f707b725640 1 -- 172.21.15.98:0/535049876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70741a70b0 con 0x7f7074102ef0 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.861+0000 7f707b725640 1 -- 172.21.15.98:0/535049876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7074101200 con 0x7f7074102ef0 2024-09-19T07:27:24.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.862+0000 7f706a7fc640 1 -- 172.21.15.98:0/535049876 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f706c037020 con 0x7f7074102ef0 2024-09-19T07:27:24.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.863+0000 7f706a7fc640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f70600a33b0 0x7f70600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:24.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.863+0000 7f706a7fc640 1 -- 172.21.15.98:0/535049876 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f706c0f0d70 con 0x7f7074102ef0 2024-09-19T07:27:24.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.863+0000 7f70794c1640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f70600a33b0 0x7f70600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:24.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.864+0000 7f70794c1640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f70600a33b0 0x7f70600a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7070005e10 tx=0x7f7070005da0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:24.870 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:24.866+0000 7f706a7fc640 1 -- 172.21.15.98:0/535049876 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f706c0bd8c0 con 0x7f7074102ef0 2024-09-19T07:27:25.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.076+0000 7f707b725640 1 -- 172.21.15.98:0/535049876 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f707406a560 con 0x7f7074102ef0 2024-09-19T07:27:25.077 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.077+0000 7f706a7fc640 1 -- 172.21.15.98:0/535049876 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11928 (secure 0 0 0) 0x7f706c0bd1c0 con 0x7f7074102ef0 2024-09-19T07:27:25.078 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:27:25.078 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"btime":"2024-09-19T07:24:57:508846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:24:56.977446+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":73,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":74,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:27:25.078 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2024-09-19T07:27:25.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.079+0000 7f707b725640 1 -- 172.21.15.98:0/535049876 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f70600a33b0 msgr2=0x7f70600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:25.079 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.079+0000 7f707b725640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f70600a33b0 0x7f70600a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7070005e10 tx=0x7f7070005da0 comp rx=0 tx=0).stop 2024-09-19T07:27:25.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.079+0000 7f707b725640 1 -- 172.21.15.98:0/535049876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7074102ef0 msgr2=0x7f7074197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:25.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.079+0000 7f707b725640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7074102ef0 0x7f7074197b00 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f706c006010 tx=0x7f706c02f6f0 comp rx=0 tx=0).stop 2024-09-19T07:27:25.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.079+0000 7f707b725640 1 -- 172.21.15.98:0/535049876 shutdown_connections 2024-09-19T07:27:25.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.079+0000 7f707b725640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f70600a33b0 0x7f70600a5870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:25.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.079+0000 7f707b725640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7074102ef0 0x7f7074197b00 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:25.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.079+0000 7f707b725640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7074102570 0x7f70741975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:25.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.079+0000 7f707b725640 1 --2- 172.21.15.98:0/535049876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7074100e20 0x7f7074197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:25.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.079+0000 7f707b725640 1 -- 172.21.15.98:0/535049876 >> 172.21.15.98:0/535049876 conn(0x7f70740fc7d0 msgr2=0x7f70741067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:25.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.079+0000 7f707b725640 1 -- 172.21.15.98:0/535049876 shutdown_connections 2024-09-19T07:27:25.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:25.079+0000 7f707b725640 1 -- 172.21.15.98:0/535049876 wait complete. 2024-09-19T07:27:25.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:25 smithi139 ceph-mon[35039]: pgmap v163: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-09-19T07:27:25.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:25 smithi162 ceph-mon[35726]: pgmap v163: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-09-19T07:27:25.522 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:25 smithi098 ceph-mon[30950]: pgmap v163: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-09-19T07:27:25.866 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db --set-id 7a1992f6 --release --await' 2024-09-19T07:27:25.866 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db --set-id 7a1992f6 --release --await 2024-09-19T07:27:26.120 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:27:26.241 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:26 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/535049876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:27:26.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:26 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/535049876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:27:26.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:26 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/535049876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:27:26.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.745+0000 7f6cee2e2640 1 -- 172.21.15.98:0/2784982981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ce8106f10 msgr2=0x7f6ce810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:26.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.745+0000 7f6cee2e2640 1 --2- 172.21.15.98:0/2784982981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ce8106f10 0x7f6ce810ea90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009ca0 tx=0x7f6ce002a8c0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.745+0000 7f6cee2e2640 1 -- 172.21.15.98:0/2784982981 shutdown_connections 2024-09-19T07:27:26.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.745+0000 7f6cee2e2640 1 --2- 172.21.15.98:0/2784982981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ce8106f10 0x7f6ce810ea90 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.745+0000 7f6cee2e2640 1 --2- 172.21.15.98:0/2784982981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ce8102790 0x7f6ce81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.745+0000 7f6cee2e2640 1 --2- 172.21.15.98:0/2784982981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ce8101de0 0x7f6ce81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.745+0000 7f6cee2e2640 1 -- 172.21.15.98:0/2784982981 >> 172.21.15.98:0/2784982981 conn(0x7f6ce80fd8c0 msgr2=0x7f6ce80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:26.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.745+0000 7f6cee2e2640 1 -- 172.21.15.98:0/2784982981 shutdown_connections 2024-09-19T07:27:26.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.745+0000 7f6cee2e2640 1 -- 172.21.15.98:0/2784982981 wait complete. 2024-09-19T07:27:26.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6cee2e2640 1 Processor -- start 2024-09-19T07:27:26.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6cee2e2640 1 -- start start 2024-09-19T07:27:26.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6cee2e2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ce8101de0 0x7f6ce8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6cee2e2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ce8102790 0x7f6ce8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6cee2e2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ce8106f10 0x7f6ce819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6cee2e2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce8111f90 con 0x7f6ce8101de0 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6cee2e2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce8111e10 con 0x7f6ce8106f10 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6cee2e2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce8112110 con 0x7f6ce8102790 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6ce7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ce8101de0 0x7f6ce8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6ce7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ce8101de0 0x7f6ce8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45056/0 (socket says 172.21.15.98:45056) 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6ce7fff640 1 -- 172.21.15.98:0/1286182157 learned_addr learned my addr 172.21.15.98:0/1286182157 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6cec87f640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ce8106f10 0x7f6ce819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6ce7fff640 1 -- 172.21.15.98:0/1286182157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ce8102790 msgr2=0x7f6ce8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6cdffff640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ce8102790 0x7f6ce8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ce8102790 0x7f6ce8198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6ce7fff640 1 -- 172.21.15.98:0/1286182157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ce8106f10 msgr2=0x7f6ce819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:26.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ce8106f10 0x7f6ce819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6ce7fff640 1 -- 172.21.15.98:0/1286182157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce819d400 con 0x7f6ce8101de0 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.746+0000 7f6cec87f640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ce8106f10 0x7f6ce819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.747+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ce8101de0 0x7f6ce8198450 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800b4a0 tx=0x7f6cd800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.747+0000 7f6ce5ffb640 1 -- 172.21.15.98:0/1286182157 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8014070 con 0x7f6ce8101de0 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.747+0000 7f6cee2e2640 1 -- 172.21.15.98:0/1286182157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce819d6f0 con 0x7f6ce8101de0 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.747+0000 7f6ce5ffb640 1 -- 172.21.15.98:0/1286182157 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cd8010af0 con 0x7f6ce8101de0 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.747+0000 7f6ce5ffb640 1 -- 172.21.15.98:0/1286182157 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8017d10 con 0x7f6ce8101de0 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.747+0000 7f6cee2e2640 1 -- 172.21.15.98:0/1286182157 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce81a4fd0 con 0x7f6ce8101de0 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.749+0000 7f6ce5ffb640 1 -- 172.21.15.98:0/1286182157 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6cd8017070 con 0x7f6ce8101de0 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.749+0000 7f6cf06bb740 1 Processor -- start 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.749+0000 7f6cf06bb740 1 -- start start 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.749+0000 7f6cf06bb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb3463060 0x559eb3463440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.762 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cf06bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb346dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cf06bb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb346e240 0x559eb3470630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cf06bb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559eb33c8620 con 0x559eb3463060 2024-09-19T07:27:26.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cf06bb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559eb336fe50 con 0x559eb346e240 2024-09-19T07:27:26.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cf06bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559eb33c45e0 con 0x559eb3463980 2024-09-19T07:27:26.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cec87f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb3463060 0x559eb3463440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cec87f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb3463060 0x559eb3463440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45068/0 (socket says 172.21.15.98:45068) 2024-09-19T07:27:26.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cec87f640 1 -- 172.21.15.98:0/459152949 learned_addr learned my addr 172.21.15.98:0/459152949 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:26.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/459152949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb346dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6ce5ffb640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6cd40a33b0 0x7f6cd40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cdffff640 1 --2- 172.21.15.98:0/459152949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb346e240 0x559eb3470630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.763 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cec87f640 1 -- 172.21.15.98:0/459152949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 msgr2=0x559eb346dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:26.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cec87f640 1 --2- 172.21.15.98:0/459152949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb346dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cec87f640 1 -- 172.21.15.98:0/459152949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb346e240 msgr2=0x559eb3470630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:26.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cec87f640 1 --2- 172.21.15.98:0/459152949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb346e240 0x559eb3470630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cec87f640 1 -- 172.21.15.98:0/459152949 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eb3360d40 con 0x559eb3463060 2024-09-19T07:27:26.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cdffff640 1 --2- 172.21.15.98:0/459152949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb346e240 0x559eb3470630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:27:26.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6ce5ffb640 1 -- 172.21.15.98:0/1286182157 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f6cd80cf0c0 con 0x7f6ce8101de0 2024-09-19T07:27:26.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cec87f640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6cd40a33b0 0x7f6cd40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.750+0000 7f6cec87f640 1 --2- 172.21.15.98:0/459152949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb3463060 0x559eb3463440 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009dc0 tx=0x7f6ce0031c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4738941a8a5ede7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:26.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cde7fc640 1 -- 172.21.15.98:0/459152949 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00319a0 con 0x559eb3463060 2024-09-19T07:27:26.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cde7fc640 1 -- 172.21.15.98:0/459152949 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ce0036070 con 0x559eb3463060 2024-09-19T07:27:26.764 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cde7fc640 1 -- 172.21.15.98:0/459152949 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce002fc90 con 0x559eb3463060 2024-09-19T07:27:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cf06bb740 1 -- 172.21.15.98:0/459152949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb3463060 msgr2=0x559eb3463440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cec87f640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6cd40a33b0 0x7f6cd40a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ce004b000 tx=0x7f6ce0048000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/459152949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb3463060 0x559eb3463440 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009dc0 tx=0x7f6ce0031c30 comp rx=0 tx=0).stop 2024-09-19T07:27:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cf06bb740 1 -- 172.21.15.98:0/459152949 shutdown_connections 2024-09-19T07:27:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/459152949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb346e240 0x559eb3470630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/459152949 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb346dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/459152949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb3463060 0x559eb3463440 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cf06bb740 1 -- 172.21.15.98:0/459152949 >> 172.21.15.98:0/459152949 conn(0x559eb345f5f0 msgr2=0x559eb345f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cf06bb740 1 -- 172.21.15.98:0/459152949 shutdown_connections 2024-09-19T07:27:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.751+0000 7f6cf06bb740 1 -- 172.21.15.98:0/459152949 wait complete. 2024-09-19T07:27:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.752+0000 7f6cf06bb740 1 -- start start 2024-09-19T07:27:26.765 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.752+0000 7f6cf06bb740 1 Processor -- start 2024-09-19T07:27:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.752+0000 7f6cf06bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463060 0x559eb346b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.752+0000 7f6cf06bb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463980 0x559eb346b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.752+0000 7f6cf06bb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb346bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.752+0000 7f6cf06bb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559eb3470c90 con 0x559eb346e240 2024-09-19T07:27:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.752+0000 7f6cf06bb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559eb3350f10 con 0x559eb3463980 2024-09-19T07:27:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.752+0000 7f6cf06bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x559eb3470e10 con 0x559eb3463060 2024-09-19T07:27:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.752+0000 7f6cf06bb740 10 client.0 _ll_register_callbacks cb 0x559eb3374db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.752+0000 7f6cec87f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb346bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.752+0000 7f6cec87f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb346bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45076/0 (socket says 172.21.15.98:45076) 2024-09-19T07:27:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cec87f640 1 -- 172.21.15.98:0/2454735884 learned_addr learned my addr 172.21.15.98:0/2454735884 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463060 0x559eb346b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.766 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cdffff640 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463980 0x559eb346b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cec87f640 1 -- 172.21.15.98:0/2454735884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463060 msgr2=0x559eb346b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cec87f640 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463060 0x559eb346b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cec87f640 1 -- 172.21.15.98:0/2454735884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463980 msgr2=0x559eb346b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cec87f640 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463980 0x559eb346b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cec87f640 1 -- 172.21.15.98:0/2454735884 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eb30d7580 con 0x559eb346e240 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cdffff640 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463980 0x559eb346b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463060 0x559eb346b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cec87f640 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb346bbc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6ce002f650 tx=0x7f6ce002fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce98bb13dfe430f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cc77fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cc77fe640 1 -- 172.21.15.98:0/2454735884 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce002fd50 con 0x559eb346e240 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cc77fe640 1 -- 172.21.15.98:0/2454735884 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f6ce004d050 con 0x559eb346e240 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2454735884 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ce0036070 con 0x559eb346e240 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cc77fe640 1 -- 172.21.15.98:0/2454735884 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6ce002f3b0 con 0x559eb346e240 2024-09-19T07:27:26.767 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cf06bb740 10 client.16599 fetch_fsmap learned FSMap version 30 2024-09-19T07:27:26.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.753+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2454735884 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559eb31a1960 con 0x559eb346e240 2024-09-19T07:27:26.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.754+0000 7f6cc77fe640 1 -- 172.21.15.98:0/2454735884 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ce0036070 con 0x559eb346e240 2024-09-19T07:27:26.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.754+0000 7f6cc77fe640 1 -- 172.21.15.98:0/2454735884 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f6ce0030aa0 con 0x559eb346e240 2024-09-19T07:27:26.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.754+0000 7f6cf06bb740 10 client.16599 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:27:26.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.754+0000 7f6cf06bb740 10 client.16599 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:27:26.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.754+0000 7f6cf06bb740 20 client.16599 populate_metadata read hostname 'smithi098' 2024-09-19T07:27:26.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.754+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559eb347dad0 0x559eb347fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.754+0000 7f6cf06bb740 4 client.16599 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:26.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.754+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2454735884 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559eb33d5b90 con 0x559eb347dad0 2024-09-19T07:27:26.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.754+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559eb347dad0 0x559eb347fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.754+0000 7f6cc77fe640 10 client.16599 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:26.768 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.754+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559eb347dad0 0x559eb347fec0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=967026e360540e1e server_cookie=b4abe8a731c1bd6f in_seq=0 out_seq=0 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.755+0000 7f6cc77fe640 1 -- 172.21.15.98:0/2454735884 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559eb33d5b90 con 0x559eb347dad0 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.755+0000 7f6cc77fe640 10 client.16599 handle_command_reply: tid=0 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.755+0000 7f6cf06bb740 1 client.16599 shutdown 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.755+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2454735884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 msgr2=0x559eb346bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.755+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb346bbc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6ce002f650 tx=0x7f6ce002fc60 comp rx=0 tx=0).stop 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.755+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2454735884 shutdown_connections 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.755+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559eb347dad0 0x559eb347fec0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.755+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb346bbc0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.755+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463980 0x559eb346b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.755+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/2454735884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463060 0x559eb346b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.755+0000 7f6cc77fe640 0 client.16599 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.755+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2454735884 >> 172.21.15.98:0/2454735884 conn(0x559eb345f5f0 msgr2=0x559eb34652d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:26.769 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.756+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2454735884 shutdown_connections 2024-09-19T07:27:26.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.756+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2454735884 wait complete. 2024-09-19T07:27:26.770 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.756+0000 7f6cf06bb740 20 client.16599 trim_cache size 0 max 16384 2024-09-19T07:27:26.774 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.772+0000 7f6cf06bb740 1 Processor -- start 2024-09-19T07:27:26.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cf06bb740 1 -- start start 2024-09-19T07:27:26.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cf06bb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463060 0x559eb3466610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cf06bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb3465ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cf06bb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb345e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cf06bb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce81b0390 con 0x559eb346e240 2024-09-19T07:27:26.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cf06bb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce81adba0 con 0x559eb3463060 2024-09-19T07:27:26.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cf06bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce81ab9f0 con 0x559eb3463980 2024-09-19T07:27:26.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cec87f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb345e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cec87f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb345e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45090/0 (socket says 172.21.15.98:45090) 2024-09-19T07:27:26.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cec87f640 1 -- 172.21.15.98:0/2720247055 learned_addr learned my addr 172.21.15.98:0/2720247055 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:26.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cdffff640 1 --2- 172.21.15.98:0/2720247055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb3465ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/2720247055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463060 0x559eb3466610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cec87f640 1 -- 172.21.15.98:0/2720247055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 msgr2=0x559eb3465ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cec87f640 1 --2- 172.21.15.98:0/2720247055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb3465ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cec87f640 1 -- 172.21.15.98:0/2720247055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463060 msgr2=0x559eb3466610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cec87f640 1 --2- 172.21.15.98:0/2720247055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463060 0x559eb3466610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cec87f640 1 -- 172.21.15.98:0/2720247055 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eb345dbb0 con 0x559eb346e240 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cdffff640 1 --2- 172.21.15.98:0/2720247055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb3465ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cec87f640 1 --2- 172.21.15.98:0/2720247055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb345e640 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0001220 tx=0x7f6ce0003ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea671137ff9e64c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.773+0000 7f6cddffb640 1 -- 172.21.15.98:0/2720247055 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce002fcd0 con 0x559eb346e240 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.774+0000 7f6cddffb640 1 -- 172.21.15.98:0/2720247055 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ce0036040 con 0x559eb346e240 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.774+0000 7f6cddffb640 1 -- 172.21.15.98:0/2720247055 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce002f880 con 0x559eb346e240 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.774+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2720247055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 msgr2=0x559eb345e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.774+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/2720247055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb345e640 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0001220 tx=0x7f6ce0003ad0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.774+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2720247055 shutdown_connections 2024-09-19T07:27:26.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.774+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/2720247055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb345e640 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.774+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/2720247055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb3465ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.774+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/2720247055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463060 0x559eb3466610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.774+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2720247055 >> 172.21.15.98:0/2720247055 conn(0x559eb345f5f0 msgr2=0x559eb345df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:26.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.774+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2720247055 shutdown_connections 2024-09-19T07:27:26.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.774+0000 7f6cf06bb740 1 -- 172.21.15.98:0/2720247055 wait complete. 2024-09-19T07:27:26.777 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.774+0000 7f6cf06bb740 1 -- start start 2024-09-19T07:27:26.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cf06bb740 1 Processor -- start 2024-09-19T07:27:26.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cf06bb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463060 0x559eb3472450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cf06bb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb3472990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.779 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cf06bb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb34e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cf06bb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce81ac060 con 0x559eb346e240 2024-09-19T07:27:26.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cf06bb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce81ad4d0 con 0x559eb3463060 2024-09-19T07:27:26.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cf06bb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce81ac730 con 0x559eb3463980 2024-09-19T07:27:26.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cf06bb740 10 client.0 _ll_register_callbacks cb 0x7f6ce0009960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:26.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cec87f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb34e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cec87f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb34e75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45100/0 (socket says 172.21.15.98:45100) 2024-09-19T07:27:26.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cec87f640 1 -- 172.21.15.98:0/330987401 learned_addr learned my addr 172.21.15.98:0/330987401 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:26.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463060 0x559eb3472450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cdffff640 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb3472990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cec87f640 1 -- 172.21.15.98:0/330987401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 msgr2=0x559eb3472990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:26.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cec87f640 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb3472990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.780 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cec87f640 1 -- 172.21.15.98:0/330987401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463060 msgr2=0x559eb3472450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cec87f640 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463060 0x559eb3472450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6cec87f640 1 -- 172.21.15.98:0/330987401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eb34e7b10 con 0x559eb346e240 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.775+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463060 0x559eb3472450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cec87f640 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb34e75d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6ce002a900 tx=0x7f6ce002f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f7f048a1a29575 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cc77fe640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cc77fe640 1 -- 172.21.15.98:0/330987401 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce00305c0 con 0x559eb346e240 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cc77fe640 1 -- 172.21.15.98:0/330987401 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f6ce004d040 con 0x559eb346e240 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cf06bb740 1 -- 172.21.15.98:0/330987401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ce0036040 con 0x559eb346e240 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cc77fe640 1 -- 172.21.15.98:0/330987401 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6ce0030760 con 0x559eb346e240 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cf06bb740 10 client.16605 fetch_fsmap learned FSMap version 30 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cf06bb740 1 -- 172.21.15.98:0/330987401 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559eb34e8d20 con 0x559eb346e240 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cc77fe640 1 -- 172.21.15.98:0/330987401 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ce0036040 con 0x559eb346e240 2024-09-19T07:27:26.781 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cc77fe640 1 -- 172.21.15.98:0/330987401 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f6ce0051c40 con 0x559eb346e240 2024-09-19T07:27:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cf06bb740 10 client.16605 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:27:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cf06bb740 10 client.16605 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:27:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cf06bb740 20 client.16605 populate_metadata read hostname 'smithi098' 2024-09-19T07:27:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559eb34e9200 0x559eb34eb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cf06bb740 4 client.16605 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7a1992f6", "release": true, "await": true}] 2024-09-19T07:27:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.776+0000 7f6cf06bb740 1 -- 172.21.15.98:0/330987401 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7a1992f6", "release": true, "await": true}) -- 0x559eb33d00a0 con 0x559eb34e9200 2024-09-19T07:27:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.777+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559eb34e9200 0x559eb34eb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.777+0000 7f6ce7fff640 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559eb34e9200 0x559eb34eb620 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40012a781912f6f0 server_cookie=5128239e7fd5c129 in_seq=0 out_seq=0 2024-09-19T07:27:26.782 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.777+0000 7f6cc77fe640 10 client.16605 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:26.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.953+0000 7f6cc77fe640 1 -- 172.21.15.98:0/330987401 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559eb33d00a0 con 0x559eb34e9200 2024-09-19T07:27:26.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.953+0000 7f6cc77fe640 10 client.16605 handle_command_reply: tid=0 2024-09-19T07:27:26.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.953+0000 7f6cf06bb740 1 client.16605 shutdown 2024-09-19T07:27:26.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.953+0000 7f6cf06bb740 1 -- 172.21.15.98:0/330987401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 msgr2=0x559eb34e75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:26.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.953+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb34e75d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6ce002a900 tx=0x7f6ce002f680 comp rx=0 tx=0).stop 2024-09-19T07:27:26.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.953+0000 7f6cf06bb740 1 -- 172.21.15.98:0/330987401 shutdown_connections 2024-09-19T07:27:26.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.953+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x559eb34e9200 0x559eb34eb620 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.954 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.953+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559eb346e240 0x559eb34e75d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.953+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559eb3463980 0x559eb3472990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.953+0000 7f6cf06bb740 1 --2- 172.21.15.98:0/330987401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559eb3463060 0x559eb3472450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.953+0000 7f6cf06bb740 1 -- 172.21.15.98:0/330987401 >> 172.21.15.98:0/330987401 conn(0x559eb345f5f0 msgr2=0x559eb346b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:26.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.953+0000 7f6cc77fe640 0 client.16605 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:26.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cf06bb740 1 -- 172.21.15.98:0/330987401 shutdown_connections 2024-09-19T07:27:26.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cf06bb740 1 -- 172.21.15.98:0/330987401 wait complete. 2024-09-19T07:27:26.955 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cf06bb740 20 client.16605 trim_cache size 0 max 16384 2024-09-19T07:27:26.955 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:27:26.955 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 30, 2024-09-19T07:27:26.955 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:27:26.956 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 24, 2024-09-19T07:27:26.956 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": { 2024-09-19T07:27:26.956 INFO:teuthology.orchestra.run.smithi098.stdout: "7a1992f6": { 2024-09-19T07:27:26.956 INFO:teuthology.orchestra.run.smithi098.stdout: "version": 24, 2024-09-19T07:27:26.956 INFO:teuthology.orchestra.run.smithi098.stdout: "age_ref": 0.0, 2024-09-19T07:27:26.956 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:27:26.956 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RELEASED", 2024-09-19T07:27:26.956 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:27:26.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:27:26.956 INFO:teuthology.orchestra.run.smithi098.stdout: "timeout": 90.0, 2024-09-19T07:27:26.956 INFO:teuthology.orchestra.run.smithi098.stdout: "expiration": 149.8, 2024-09-19T07:27:26.956 INFO:teuthology.orchestra.run.smithi098.stdout: "members": { 2024-09-19T07:27:26.957 INFO:teuthology.orchestra.run.smithi098.stdout: "file:/": { 2024-09-19T07:27:26.957 INFO:teuthology.orchestra.run.smithi098.stdout: "excluded": false, 2024-09-19T07:27:26.957 INFO:teuthology.orchestra.run.smithi098.stdout: "state": { 2024-09-19T07:27:26.957 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RELEASED", 2024-09-19T07:27:26.957 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.0 2024-09-19T07:27:26.957 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:27:26.957 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:27:26.957 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:27:26.957 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:27:26.957 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:27:26.957 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:27:26.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cee2e2640 1 -- 172.21.15.98:0/1286182157 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6cd40a33b0 msgr2=0x7f6cd40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:26.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cee2e2640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6cd40a33b0 0x7f6cd40a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6ce004b000 tx=0x7f6ce0048000 comp rx=0 tx=0).stop 2024-09-19T07:27:26.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cee2e2640 1 -- 172.21.15.98:0/1286182157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ce8101de0 msgr2=0x7f6ce8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:26.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cee2e2640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ce8101de0 0x7f6ce8198450 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800b4a0 tx=0x7f6cd800b960 comp rx=0 tx=0).stop 2024-09-19T07:27:26.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cee2e2640 1 -- 172.21.15.98:0/1286182157 shutdown_connections 2024-09-19T07:27:26.958 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cee2e2640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f6cd40a33b0 0x7f6cd40a5870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cee2e2640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6ce8106f10 0x7f6ce819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cee2e2640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ce8102790 0x7f6ce8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cee2e2640 1 --2- 172.21.15.98:0/1286182157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ce8101de0 0x7f6ce8198450 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:26.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cee2e2640 1 -- 172.21.15.98:0/1286182157 >> 172.21.15.98:0/1286182157 conn(0x7f6ce80fd8c0 msgr2=0x7f6ce80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:26.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cee2e2640 1 -- 172.21.15.98:0/1286182157 shutdown_connections 2024-09-19T07:27:26.959 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:26.954+0000 7f6cee2e2640 1 -- 172.21.15.98:0/1286182157 wait complete. 2024-09-19T07:27:27.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:27 smithi139 ceph-mon[35039]: pgmap v164: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-09-19T07:27:27.351 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.348+0000 7f7c1eca6640 1 -- 172.21.15.98:0/1320449489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c18101350 msgr2=0x7f7c1810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.351 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.348+0000 7f7c1eca6640 1 --2- 172.21.15.98:0/1320449489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c18101350 0x7f7c1810d880 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7c10009cd0 tx=0x7f7c1002a8e0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.351 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.348+0000 7f7c1eca6640 1 -- 172.21.15.98:0/1320449489 shutdown_connections 2024-09-19T07:27:27.351 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.348+0000 7f7c1eca6640 1 --2- 172.21.15.98:0/1320449489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c18101350 0x7f7c1810d880 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.351 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.348+0000 7f7c1eca6640 1 --2- 172.21.15.98:0/1320449489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c181009b0 0x7f7c18100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.351 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.348+0000 7f7c1eca6640 1 --2- 172.21.15.98:0/1320449489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c181069c0 0x7f7c18106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.351 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.348+0000 7f7c1eca6640 1 -- 172.21.15.98:0/1320449489 >> 172.21.15.98:0/1320449489 conn(0x7f7c18077990 msgr2=0x7f7c180fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:27.351 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.348+0000 7f7c1eca6640 1 -- 172.21.15.98:0/1320449489 shutdown_connections 2024-09-19T07:27:27.351 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.348+0000 7f7c1eca6640 1 -- 172.21.15.98:0/1320449489 wait complete. 2024-09-19T07:27:27.351 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c1eca6640 1 Processor -- start 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c1eca6640 1 -- start start 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c1eca6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c181009b0 0x7f7c181982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c1eca6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c18101350 0x7f7c18198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c1eca6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c181069c0 0x7f7c1819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c1eca6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7c18110e00 con 0x7f7c181009b0 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c1eca6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7c18110c80 con 0x7f7c18101350 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c1eca6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c18110f80 con 0x7f7c181069c0 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c1ca42640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c181009b0 0x7f7c181982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c1ca42640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c181009b0 0x7f7c181982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45130/0 (socket says 172.21.15.98:45130) 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c1ca42640 1 -- 172.21.15.98:0/2815986756 learned_addr learned my addr 172.21.15.98:0/2815986756 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c17fff640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c18101350 0x7f7c18198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.349+0000 7f7c1d243640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c181069c0 0x7f7c1819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.352 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.350+0000 7f7c1ca42640 1 -- 172.21.15.98:0/2815986756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c181069c0 msgr2=0x7f7c1819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.350+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c181069c0 0x7f7c1819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.350+0000 7f7c1ca42640 1 -- 172.21.15.98:0/2815986756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c18101350 msgr2=0x7f7c18198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.350+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c18101350 0x7f7c18198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.350+0000 7f7c1ca42640 1 -- 172.21.15.98:0/2815986756 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1819d2c0 con 0x7f7c181009b0 2024-09-19T07:27:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.350+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c181009b0 0x7f7c181982d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00e9f0 tx=0x7f7c0c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.350+0000 7f7c15ffb640 1 -- 172.21.15.98:0/2815986756 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00cd80 con 0x7f7c181009b0 2024-09-19T07:27:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.350+0000 7f7c15ffb640 1 -- 172.21.15.98:0/2815986756 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c0c010910 con 0x7f7c181009b0 2024-09-19T07:27:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.350+0000 7f7c1eca6640 1 -- 172.21.15.98:0/2815986756 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1819d5b0 con 0x7f7c181009b0 2024-09-19T07:27:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.350+0000 7f7c15ffb640 1 -- 172.21.15.98:0/2815986756 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c018990 con 0x7f7c181009b0 2024-09-19T07:27:27.353 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.350+0000 7f7c1eca6640 1 -- 172.21.15.98:0/2815986756 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c181a4e40 con 0x7f7c181009b0 2024-09-19T07:27:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.352+0000 7f7c15ffb640 1 -- 172.21.15.98:0/2815986756 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7c0c010ac0 con 0x7f7c181009b0 2024-09-19T07:27:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c21a39740 1 Processor -- start 2024-09-19T07:27:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c21a39740 1 -- start start 2024-09-19T07:27:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c21a39740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1920af0 0x563aa1920ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c21a39740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa1921410 0x563aa192b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c21a39740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa192bcb0 0x563aa192e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.361 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c21a39740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563aa18852f0 con 0x563aa192bcb0 2024-09-19T07:27:27.362 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c21a39740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563aa182d270 con 0x563aa1921410 2024-09-19T07:27:27.362 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c21a39740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563aa18812b0 con 0x563aa1920af0 2024-09-19T07:27:27.362 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c1ca42640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa1921410 0x563aa192b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.362 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c1d243640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1920af0 0x563aa1920ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.362 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c17fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa192bcb0 0x563aa192e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.362 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c1d243640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1920af0 0x563aa1920ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.98:43814/0 (socket says 172.21.15.98:43814) 2024-09-19T07:27:27.362 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c1d243640 1 -- 172.21.15.98:0/3123655930 learned_addr learned my addr 172.21.15.98:0/3123655930 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:27.362 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c15ffb640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7c080a3460 0x7f7c080a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.362 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c17fff640 1 -- 172.21.15.98:0/3123655930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1920af0 msgr2=0x563aa1920ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c17fff640 1 --2- 172.21.15.98:0/3123655930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1920af0 0x563aa1920ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c17fff640 1 -- 172.21.15.98:0/3123655930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa1921410 msgr2=0x563aa192b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c17fff640 1 --2- 172.21.15.98:0/3123655930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa1921410 0x563aa192b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c17fff640 1 -- 172.21.15.98:0/3123655930 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aa182c340 con 0x563aa192bcb0 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/3123655930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa1921410 0x563aa192b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c1d243640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7c080a3460 0x7f7c080a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.353+0000 7f7c15ffb640 1 -- 172.21.15.98:0/2815986756 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f7c0c0cffe0 con 0x7f7c181009b0 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.354+0000 7f7c17fff640 1 --2- 172.21.15.98:0/3123655930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa192bcb0 0x563aa192e0a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7c04005d00 tx=0x7f7c040107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc776dbed7bb243 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.354+0000 7f7c02ffd640 1 -- 172.21.15.98:0/3123655930 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0401c480 con 0x563aa192bcb0 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.354+0000 7f7c02ffd640 1 -- 172.21.15.98:0/3123655930 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c0401cb00 con 0x563aa192bcb0 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.354+0000 7f7c02ffd640 1 -- 172.21.15.98:0/3123655930 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c04011c10 con 0x563aa192bcb0 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.354+0000 7f7c21a39740 1 -- 172.21.15.98:0/3123655930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa192bcb0 msgr2=0x563aa192e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.363 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.354+0000 7f7c21a39740 1 --2- 172.21.15.98:0/3123655930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa192bcb0 0x563aa192e0a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7c04005d00 tx=0x7f7c040107a0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.364 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.354+0000 7f7c1d243640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7c080a3460 0x7f7c080a5920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7c10004ab0 tx=0x7f7c100095c0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:27.364 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.354+0000 7f7c21a39740 1 -- 172.21.15.98:0/3123655930 shutdown_connections 2024-09-19T07:27:27.364 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.354+0000 7f7c21a39740 1 --2- 172.21.15.98:0/3123655930 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa192bcb0 0x563aa192e0a0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.364 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.354+0000 7f7c21a39740 1 --2- 172.21.15.98:0/3123655930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa1921410 0x563aa192b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.364 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.354+0000 7f7c21a39740 1 --2- 172.21.15.98:0/3123655930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1920af0 0x563aa1920ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.364 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.354+0000 7f7c21a39740 1 -- 172.21.15.98:0/3123655930 >> 172.21.15.98:0/3123655930 conn(0x563aa191d060 msgr2=0x563aa191d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:27.364 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.355+0000 7f7c21a39740 1 -- 172.21.15.98:0/3123655930 shutdown_connections 2024-09-19T07:27:27.364 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.355+0000 7f7c21a39740 1 -- 172.21.15.98:0/3123655930 wait complete. 2024-09-19T07:27:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.355+0000 7f7c21a39740 1 -- start start 2024-09-19T07:27:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.355+0000 7f7c21a39740 1 Processor -- start 2024-09-19T07:27:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.355+0000 7f7c21a39740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1920af0 0x563aa1928b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.355+0000 7f7c21a39740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1921410 0x563aa1929070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.355+0000 7f7c21a39740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa192bcb0 0x563aa19295b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.355+0000 7f7c21a39740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563aa192e880 con 0x563aa1921410 2024-09-19T07:27:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.355+0000 7f7c21a39740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563aa180e290 con 0x563aa192bcb0 2024-09-19T07:27:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.355+0000 7f7c21a39740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x563aa192ea00 con 0x563aa1920af0 2024-09-19T07:27:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.355+0000 7f7c21a39740 10 client.0 _ll_register_callbacks cb 0x563aa183f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:27.365 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c17fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1921410 0x563aa1929070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c17fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1921410 0x563aa1929070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45146/0 (socket says 172.21.15.98:45146) 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c17fff640 1 -- 172.21.15.98:0/2463722512 learned_addr learned my addr 172.21.15.98:0/2463722512 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1920af0 0x563aa1928b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c1d243640 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa192bcb0 0x563aa19295b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c17fff640 1 -- 172.21.15.98:0/2463722512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1920af0 msgr2=0x563aa1928b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c17fff640 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1920af0 0x563aa1928b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c17fff640 1 -- 172.21.15.98:0/2463722512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa192bcb0 msgr2=0x563aa19295b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c17fff640 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa192bcb0 0x563aa19295b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c17fff640 1 -- 172.21.15.98:0/2463722512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aa1598210 con 0x563aa1921410 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c17fff640 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1921410 0x563aa1929070 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7c0401cee0 tx=0x7f7c0401cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c1ff9907dfd327 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7bf7fff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7bf7fff640 1 -- 172.21.15.98:0/2463722512 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0402b060 con 0x563aa1921410 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7bf7fff640 1 -- 172.21.15.98:0/2463722512 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f7c0401c480 con 0x563aa1921410 2024-09-19T07:27:27.366 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c21a39740 1 -- 172.21.15.98:0/2463722512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c0401cb00 con 0x563aa1921410 2024-09-19T07:27:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7bf7fff640 1 -- 172.21.15.98:0/2463722512 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7c0401c680 con 0x563aa1921410 2024-09-19T07:27:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c21a39740 10 client.16617 fetch_fsmap learned FSMap version 30 2024-09-19T07:27:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7c21a39740 1 -- 172.21.15.98:0/2463722512 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563aa1664620 con 0x563aa1921410 2024-09-19T07:27:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.356+0000 7f7bf7fff640 1 -- 172.21.15.98:0/2463722512 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c0401cb00 con 0x563aa1921410 2024-09-19T07:27:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.357+0000 7f7bf7fff640 1 -- 172.21.15.98:0/2463722512 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f7c0402e640 con 0x563aa1921410 2024-09-19T07:27:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.357+0000 7f7c21a39740 10 client.16617 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:27:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.357+0000 7f7c21a39740 10 client.16617 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:27:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.357+0000 7f7c21a39740 20 client.16617 populate_metadata read hostname 'smithi098' 2024-09-19T07:27:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.357+0000 7f7c21a39740 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563aa193bb60 0x563aa193df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.357+0000 7f7c21a39740 4 client.16617 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:27.367 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.357+0000 7f7c21a39740 1 -- 172.21.15.98:0/2463722512 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563aa1892a20 con 0x563aa193bb60 2024-09-19T07:27:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.357+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563aa193bb60 0x563aa193df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.357+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563aa193bb60 0x563aa193df50 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96153b573f835349 server_cookie=a80418baa9d94ef1 in_seq=0 out_seq=0 2024-09-19T07:27:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.357+0000 7f7bf7fff640 10 client.16617 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7bf7fff640 1 -- 172.21.15.98:0/2463722512 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563aa1892a20 con 0x563aa193bb60 2024-09-19T07:27:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7bf7fff640 10 client.16617 handle_command_reply: tid=0 2024-09-19T07:27:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7c21a39740 1 client.16617 shutdown 2024-09-19T07:27:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7c21a39740 1 -- 172.21.15.98:0/2463722512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1921410 msgr2=0x563aa1929070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7c21a39740 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1921410 0x563aa1929070 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7c0401cee0 tx=0x7f7c0401cf10 comp rx=0 tx=0).stop 2024-09-19T07:27:27.368 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7c21a39740 1 -- 172.21.15.98:0/2463722512 shutdown_connections 2024-09-19T07:27:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7c21a39740 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa192bcb0 0x563aa19295b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7c21a39740 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563aa193bb60 0x563aa193df50 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7c21a39740 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1921410 0x563aa1929070 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7c21a39740 1 --2- 172.21.15.98:0/2463722512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1920af0 0x563aa1928b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7bf7fff640 0 client.16617 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7c21a39740 1 -- 172.21.15.98:0/2463722512 >> 172.21.15.98:0/2463722512 conn(0x563aa191d060 msgr2=0x563aa1922d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7c21a39740 1 -- 172.21.15.98:0/2463722512 shutdown_connections 2024-09-19T07:27:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7c21a39740 1 -- 172.21.15.98:0/2463722512 wait complete. 2024-09-19T07:27:27.369 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.358+0000 7f7c21a39740 20 client.16617 trim_cache size 0 max 16384 2024-09-19T07:27:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.372+0000 7f7c21a39740 1 Processor -- start 2024-09-19T07:27:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c21a39740 1 -- start start 2024-09-19T07:27:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c21a39740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 0x563aa19293e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c21a39740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1921410 0x563aa19340a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c21a39740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa192bcb0 0x563aa19345e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.377 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c21a39740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7c181b0290 con 0x563aa1920af0 2024-09-19T07:27:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c21a39740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7c181adaa0 con 0x563aa192bcb0 2024-09-19T07:27:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c21a39740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c181ab8f0 con 0x563aa1921410 2024-09-19T07:27:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c1ca42640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 0x563aa19293e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c1ca42640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 0x563aa19293e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45160/0 (socket says 172.21.15.98:45160) 2024-09-19T07:27:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c1ca42640 1 -- 172.21.15.98:0/311034638 learned_addr learned my addr 172.21.15.98:0/311034638 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c17fff640 1 --2- 172.21.15.98:0/311034638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1921410 0x563aa19340a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c1d243640 1 --2- 172.21.15.98:0/311034638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa192bcb0 0x563aa19345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.378 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c1ca42640 1 -- 172.21.15.98:0/311034638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1921410 msgr2=0x563aa19340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/311034638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1921410 0x563aa19340a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c1ca42640 1 -- 172.21.15.98:0/311034638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa192bcb0 msgr2=0x563aa19345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/311034638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa192bcb0 0x563aa19345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c1ca42640 1 -- 172.21.15.98:0/311034638 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aa191ce90 con 0x563aa1920af0 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c17fff640 1 --2- 172.21.15.98:0/311034638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1921410 0x563aa19340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/311034638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 0x563aa19293e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0cdd00 tx=0x7f7c0c0bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24198ceb027fa542 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c027fc640 1 -- 172.21.15.98:0/311034638 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c09c340 con 0x563aa1920af0 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c027fc640 1 -- 172.21.15.98:0/311034638 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c0c0cde50 con 0x563aa1920af0 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.373+0000 7f7c027fc640 1 -- 172.21.15.98:0/311034638 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0cd980 con 0x563aa1920af0 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.374+0000 7f7c21a39740 1 -- 172.21.15.98:0/311034638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 msgr2=0x563aa19293e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.374+0000 7f7c21a39740 1 --2- 172.21.15.98:0/311034638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 0x563aa19293e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0cdd00 tx=0x7f7c0c0bc040 comp rx=0 tx=0).stop 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.374+0000 7f7c21a39740 1 -- 172.21.15.98:0/311034638 shutdown_connections 2024-09-19T07:27:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.374+0000 7f7c21a39740 1 --2- 172.21.15.98:0/311034638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa192bcb0 0x563aa19345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.374+0000 7f7c21a39740 1 --2- 172.21.15.98:0/311034638 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa1921410 0x563aa19340a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.374+0000 7f7c21a39740 1 --2- 172.21.15.98:0/311034638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 0x563aa19293e0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.374+0000 7f7c21a39740 1 -- 172.21.15.98:0/311034638 >> 172.21.15.98:0/311034638 conn(0x563aa191d060 msgr2=0x563aa192abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.374+0000 7f7c21a39740 1 -- 172.21.15.98:0/311034638 shutdown_connections 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.374+0000 7f7c21a39740 1 -- 172.21.15.98:0/311034638 wait complete. 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.374+0000 7f7c21a39740 1 -- start start 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.374+0000 7f7c21a39740 1 Processor -- start 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c21a39740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 0x563aa199e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c21a39740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa1921410 0x563aa199ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c21a39740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa192bcb0 0x563aa19a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c21a39740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7c181abf60 con 0x563aa1920af0 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c21a39740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7c181ad3d0 con 0x563aa1921410 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c21a39740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c181ac630 con 0x563aa192bcb0 2024-09-19T07:27:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c21a39740 10 client.0 _ll_register_callbacks cb 0x7f7c0c0d3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c1ca42640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 0x563aa199e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c1ca42640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 0x563aa199e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:45162/0 (socket says 172.21.15.98:45162) 2024-09-19T07:27:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c1ca42640 1 -- 172.21.15.98:0/604153758 learned_addr learned my addr 172.21.15.98:0/604153758 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c17fff640 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa1921410 0x563aa199ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c1d243640 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa192bcb0 0x563aa19a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c1ca42640 1 -- 172.21.15.98:0/604153758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa192bcb0 msgr2=0x563aa19a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa192bcb0 0x563aa19a9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c1ca42640 1 -- 172.21.15.98:0/604153758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa1921410 msgr2=0x563aa199ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa1921410 0x563aa199ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c1ca42640 1 -- 172.21.15.98:0/604153758 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aa19a9b50 con 0x563aa1920af0 2024-09-19T07:27:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c1d243640 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa192bcb0 0x563aa19a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c1ca42640 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 0x563aa199e590 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00c6a0 tx=0x7f7c0c09c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6696176a76cda5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7bf7fff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7bf7fff640 1 -- 172.21.15.98:0/604153758 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0cd980 con 0x563aa1920af0 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7bf7fff640 1 -- 172.21.15.98:0/604153758 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f7c0c0989b0 con 0x563aa1920af0 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c21a39740 1 -- 172.21.15.98:0/604153758 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c0c0cde50 con 0x563aa1920af0 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7bf7fff640 1 -- 172.21.15.98:0/604153758 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7c0c0a4a70 con 0x563aa1920af0 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.375+0000 7f7c21a39740 10 client.16623 fetch_fsmap learned FSMap version 30 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.376+0000 7f7c21a39740 1 -- 172.21.15.98:0/604153758 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563aa19aad80 con 0x563aa1920af0 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.376+0000 7f7bf7fff640 1 -- 172.21.15.98:0/604153758 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c0c0cde50 con 0x563aa1920af0 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.376+0000 7f7bf7fff640 1 -- 172.21.15.98:0/604153758 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f7c0c0bc0b0 con 0x563aa1920af0 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.376+0000 7f7c21a39740 10 client.16623 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.376+0000 7f7c21a39740 10 client.16623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.376+0000 7f7c21a39740 20 client.16623 populate_metadata read hostname 'smithi098' 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.376+0000 7f7c21a39740 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563aa19ab410 0x563aa19ad830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.376+0000 7f7c21a39740 4 client.16623 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:27:27.383 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.376+0000 7f7c21a39740 1 -- 172.21.15.98:0/604153758 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563aa188cd70 con 0x563aa19ab410 2024-09-19T07:27:27.383 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.376+0000 7f7c17fff640 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563aa19ab410 0x563aa19ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:27.383 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.376+0000 7f7bf7fff640 10 client.16623 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:27.383 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.376+0000 7f7c17fff640 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563aa19ab410 0x563aa19ad830 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c824c4372b0c3aaf server_cookie=b3aa2c7c03f7156 in_seq=0 out_seq=0 2024-09-19T07:27:27.383 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:27 smithi162 ceph-mon[35726]: pgmap v164: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-09-19T07:27:27.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7bf7fff640 1 -- 172.21.15.98:0/604153758 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563aa188cd70 con 0x563aa19ab410 2024-09-19T07:27:27.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7bf7fff640 10 client.16623 handle_command_reply: tid=0 2024-09-19T07:27:27.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7c21a39740 1 client.16623 shutdown 2024-09-19T07:27:27.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7c21a39740 1 -- 172.21.15.98:0/604153758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 msgr2=0x563aa199e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7c21a39740 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 0x563aa199e590 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00c6a0 tx=0x7f7c0c09c3b0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7c21a39740 1 -- 172.21.15.98:0/604153758 shutdown_connections 2024-09-19T07:27:27.392 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7c21a39740 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa192bcb0 0x563aa19a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.393 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7c21a39740 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563aa1921410 0x563aa199ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.393 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7c21a39740 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x563aa19ab410 0x563aa19ad830 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.393 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7c21a39740 1 --2- 172.21.15.98:0/604153758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563aa1920af0 0x563aa199e590 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.393 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7bf7fff640 0 client.16623 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:27.393 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7c21a39740 1 -- 172.21.15.98:0/604153758 >> 172.21.15.98:0/604153758 conn(0x563aa191d060 msgr2=0x563aa1922550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:27.393 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7c21a39740 1 -- 172.21.15.98:0/604153758 shutdown_connections 2024-09-19T07:27:27.393 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.391+0000 7f7c21a39740 1 -- 172.21.15.98:0/604153758 wait complete. 2024-09-19T07:27:27.393 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c21a39740 20 client.16623 trim_cache size 0 max 16384 2024-09-19T07:27:27.393 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:27:27.393 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:27:27.394 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:27:27.394 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:27:27.394 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c1eca6640 1 -- 172.21.15.98:0/2815986756 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7c080a3460 msgr2=0x7f7c080a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.394 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c1eca6640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7c080a3460 0x7f7c080a5920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7c10004ab0 tx=0x7f7c100095c0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.394 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c1eca6640 1 -- 172.21.15.98:0/2815986756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c181009b0 msgr2=0x7f7c181982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c1eca6640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c181009b0 0x7f7c181982d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00e9f0 tx=0x7f7c0c00eeb0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c1eca6640 1 -- 172.21.15.98:0/2815986756 shutdown_connections 2024-09-19T07:27:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c1eca6640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f7c080a3460 0x7f7c080a5920 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c1eca6640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c181069c0 0x7f7c1819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c1eca6640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7c18101350 0x7f7c18198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c1eca6640 1 --2- 172.21.15.98:0/2815986756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7c181009b0 0x7f7c181982d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c1eca6640 1 -- 172.21.15.98:0/2815986756 >> 172.21.15.98:0/2815986756 conn(0x7f7c18077990 msgr2=0x7f7c18069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c1eca6640 1 -- 172.21.15.98:0/2815986756 shutdown_connections 2024-09-19T07:27:27.395 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:27.392+0000 7f7c1eca6640 1 -- 172.21.15.98:0/2815986756 wait complete. 2024-09-19T07:27:27.421 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:27 smithi098 ceph-mon[30950]: pgmap v164: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-09-19T07:27:27.859 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7a1992f6', total seconds elapsed: 33.6 2024-09-19T07:27:29.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:29 smithi139 ceph-mon[35039]: pgmap v165: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2024-09-19T07:27:29.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:29 smithi162 ceph-mon[35726]: pgmap v165: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2024-09-19T07:27:29.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:29 smithi098 ceph-mon[30950]: pgmap v165: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.9 KiB/s wr, 5 op/s 2024-09-19T07:27:31.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:31 smithi139 ceph-mon[35039]: pgmap v166: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 458 KiB/s wr, 61 op/s 2024-09-19T07:27:31.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:31 smithi162 ceph-mon[35726]: pgmap v166: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 458 KiB/s wr, 61 op/s 2024-09-19T07:27:31.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:31 smithi098 ceph-mon[30950]: pgmap v166: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 458 KiB/s wr, 61 op/s 2024-09-19T07:27:33.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:33 smithi139 ceph-mon[35039]: pgmap v167: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 459 KiB/s wr, 63 op/s 2024-09-19T07:27:33.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:33 smithi162 ceph-mon[35726]: pgmap v167: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 459 KiB/s wr, 63 op/s 2024-09-19T07:27:33.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:33 smithi098 ceph-mon[30950]: pgmap v167: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 459 KiB/s wr, 63 op/s 2024-09-19T07:27:35.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:35 smithi139 ceph-mon[35039]: pgmap v168: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 459 KiB/s wr, 62 op/s 2024-09-19T07:27:35.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:35 smithi162 ceph-mon[35726]: pgmap v168: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 459 KiB/s wr, 62 op/s 2024-09-19T07:27:35.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:35 smithi098 ceph-mon[30950]: pgmap v168: 97 pgs: 97 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 459 KiB/s wr, 62 op/s 2024-09-19T07:27:37.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:37 smithi139 ceph-mon[35039]: pgmap v169: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 217 op/s 2024-09-19T07:27:37.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:37 smithi162 ceph-mon[35726]: pgmap v169: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 217 op/s 2024-09-19T07:27:37.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:37 smithi098 ceph-mon[30950]: pgmap v169: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 217 op/s 2024-09-19T07:27:39.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:39 smithi139 ceph-mon[35039]: pgmap v170: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 214 op/s 2024-09-19T07:27:39.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:39 smithi162 ceph-mon[35726]: pgmap v170: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 214 op/s 2024-09-19T07:27:39.522 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:39 smithi098 ceph-mon[30950]: pgmap v170: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 214 op/s 2024-09-19T07:27:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.482+0000 7f791798d640 1 -- 172.21.15.98:0/771074313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7910102050 msgr2=0x7f791010d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.482+0000 7f791798d640 1 --2- 172.21.15.98:0/771074313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7910102050 0x7f791010d7d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7908009ca0 tx=0x7f790802a950 comp rx=0 tx=0).stop 2024-09-19T07:27:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.482+0000 7f791798d640 1 -- 172.21.15.98:0/771074313 shutdown_connections 2024-09-19T07:27:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.482+0000 7f791798d640 1 --2- 172.21.15.98:0/771074313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7910102050 0x7f791010d7d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.482+0000 7f791798d640 1 --2- 172.21.15.98:0/771074313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79101016d0 0x7f7910101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.482+0000 7f791798d640 1 --2- 172.21.15.98:0/771074313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7910105af0 0x7f7910105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.482+0000 7f791798d640 1 -- 172.21.15.98:0/771074313 >> 172.21.15.98:0/771074313 conn(0x7f7910075ec0 msgr2=0x7f79100762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.482+0000 7f791798d640 1 -- 172.21.15.98:0/771074313 shutdown_connections 2024-09-19T07:27:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.482+0000 7f791798d640 1 -- 172.21.15.98:0/771074313 wait complete. 2024-09-19T07:27:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f791798d640 1 Processor -- start 2024-09-19T07:27:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f791798d640 1 -- start start 2024-09-19T07:27:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f791798d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79101016d0 0x7f7910197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f791798d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7910102050 0x7f7910197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f791798d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7910105af0 0x7f791019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f791798d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7910110de0 con 0x7f79101016d0 2024-09-19T07:27:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f791798d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7910110c60 con 0x7f7910105af0 2024-09-19T07:27:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f791798d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7910110f60 con 0x7f7910102050 2024-09-19T07:27:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f7915729640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79101016d0 0x7f7910197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f7915729640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79101016d0 0x7f7910197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34276/0 (socket says 172.21.15.98:34276) 2024-09-19T07:27:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f7915729640 1 -- 172.21.15.98:0/4150339188 learned_addr learned my addr 172.21.15.98:0/4150339188 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f7914f28640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7910102050 0x7f7910197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f7915f2a640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7910105af0 0x7f791019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f7915729640 1 -- 172.21.15.98:0/4150339188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7910102050 msgr2=0x7f7910197670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f7915729640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7910102050 0x7f7910197670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f7915729640 1 -- 172.21.15.98:0/4150339188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7910105af0 msgr2=0x7f791019b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f7915729640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7910105af0 0x7f791019b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f7915729640 1 -- 172.21.15.98:0/4150339188 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791019c120 con 0x7f79101016d0 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f7914f28640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7910102050 0x7f7910197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.483+0000 7f7915729640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79101016d0 0x7f7910197130 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f790c00eb00 tx=0x7f790c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.484+0000 7f79067fc640 1 -- 172.21.15.98:0/4150339188 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c00bc30 con 0x7f79101016d0 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.484+0000 7f791798d640 1 -- 172.21.15.98:0/4150339188 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791019c410 con 0x7f79101016d0 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.484+0000 7f79067fc640 1 -- 172.21.15.98:0/4150339188 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f790c00bdd0 con 0x7f79101016d0 2024-09-19T07:27:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.484+0000 7f79067fc640 1 -- 172.21.15.98:0/4150339188 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c017410 con 0x7f79101016d0 2024-09-19T07:27:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.484+0000 7f791798d640 1 -- 172.21.15.98:0/4150339188 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79101005c0 con 0x7f79101016d0 2024-09-19T07:27:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.486+0000 7f79067fc640 1 -- 172.21.15.98:0/4150339188 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f790c005020 con 0x7f79101016d0 2024-09-19T07:27:40.494 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.486+0000 7f791a803740 1 Processor -- start 2024-09-19T07:27:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.486+0000 7f791a803740 1 -- start start 2024-09-19T07:27:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.486+0000 7f791a803740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4cfeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.486+0000 7f791a803740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cff410 0x55c3f4d09770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.486+0000 7f791a803740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d0c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.486+0000 7f791a803740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c3f4c632f0 con 0x55c3f4cfeaf0 2024-09-19T07:27:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.486+0000 7f791a803740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c3f4c0b270 con 0x55c3f4cff410 2024-09-19T07:27:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.486+0000 7f791a803740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c3f4c5f2b0 con 0x55c3f4d09cb0 2024-09-19T07:27:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.486+0000 7f79067fc640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f78fc0a3460 0x7f78fc0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915f2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4cfeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915729640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cff410 0x55c3f4d09770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.495 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915f2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4cfeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34288/0 (socket says 172.21.15.98:34288) 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915f2a640 1 -- 172.21.15.98:0/237818555 learned_addr learned my addr 172.21.15.98:0/237818555 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7914f28640 1 --2- 172.21.15.98:0/237818555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d0c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915f2a640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f78fc0a3460 0x7f78fc0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f79067fc640 1 -- 172.21.15.98:0/4150339188 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f790c0d1600 con 0x7f79101016d0 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915729640 1 -- 172.21.15.98:0/237818555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4d09cb0 msgr2=0x55c3f4d0c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915729640 1 --2- 172.21.15.98:0/237818555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d0c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915729640 1 -- 172.21.15.98:0/237818555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cfeaf0 msgr2=0x55c3f4cfeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915729640 1 --2- 172.21.15.98:0/237818555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4cfeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915729640 1 -- 172.21.15.98:0/237818555 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f4c0a340 con 0x55c3f4cff410 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915f2a640 1 --2- 172.21.15.98:0/237818555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4cfeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915f2a640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f78fc0a3460 0x7f78fc0a5920 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7908005fe0 tx=0x7f7908005c50 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f7915729640 1 --2- 172.21.15.98:0/237818555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cff410 0x55c3f4d09770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f790c0ced20 tx=0x7f790c070790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3210f2d6a52aac28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:40.496 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f78fb7fe640 1 -- 172.21.15.98:0/237818555 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c09d960 con 0x55c3f4cff410 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f78fb7fe640 1 -- 172.21.15.98:0/237818555 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f790c0a1c60 con 0x55c3f4cff410 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.487+0000 7f78fb7fe640 1 -- 172.21.15.98:0/237818555 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c099fd0 con 0x55c3f4cff410 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.488+0000 7f791a803740 1 -- 172.21.15.98:0/237818555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cff410 msgr2=0x55c3f4d09770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.488+0000 7f791a803740 1 --2- 172.21.15.98:0/237818555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cff410 0x55c3f4d09770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f790c0ced20 tx=0x7f790c070790 comp rx=0 tx=0).stop 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.488+0000 7f791a803740 1 -- 172.21.15.98:0/237818555 shutdown_connections 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.488+0000 7f791a803740 1 --2- 172.21.15.98:0/237818555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d0c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.488+0000 7f791a803740 1 --2- 172.21.15.98:0/237818555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cff410 0x55c3f4d09770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.488+0000 7f791a803740 1 --2- 172.21.15.98:0/237818555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4cfeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.488+0000 7f791a803740 1 -- 172.21.15.98:0/237818555 >> 172.21.15.98:0/237818555 conn(0x55c3f4cfb060 msgr2=0x55c3f4cfb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.488+0000 7f791a803740 1 -- 172.21.15.98:0/237818555 shutdown_connections 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.488+0000 7f791a803740 1 -- 172.21.15.98:0/237818555 wait complete. 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.488+0000 7f791a803740 1 -- start start 2024-09-19T07:27:40.497 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f791a803740 1 Processor -- start 2024-09-19T07:27:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f791a803740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d06b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f791a803740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cff410 0x55c3f4d070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f791a803740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d07610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f791a803740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c3f4d0c880 con 0x55c3f4d09cb0 2024-09-19T07:27:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f791a803740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c3f4bec290 con 0x55c3f4cff410 2024-09-19T07:27:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f791a803740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55c3f4d0ca00 con 0x55c3f4cfeaf0 2024-09-19T07:27:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f791a803740 10 client.0 _ll_register_callbacks cb 0x55c3f4c1d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f7915f2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d07610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f7915729640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d06b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f7915f2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d07610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34290/0 (socket says 172.21.15.98:34290) 2024-09-19T07:27:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f7915f2a640 1 -- 172.21.15.98:0/2403306749 learned_addr learned my addr 172.21.15.98:0/2403306749 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f7914f28640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cff410 0x55c3f4d070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f7915f2a640 1 -- 172.21.15.98:0/2403306749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4cfeaf0 msgr2=0x55c3f4d06b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f7915f2a640 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d06b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f7915f2a640 1 -- 172.21.15.98:0/2403306749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cff410 msgr2=0x55c3f4d070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f7915f2a640 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cff410 0x55c3f4d070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f7915f2a640 1 -- 172.21.15.98:0/2403306749 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3f4976210 con 0x55c3f4d09cb0 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f7914f28640 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cff410 0x55c3f4d070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.489+0000 7f7915729640 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d06b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f7915f2a640 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d07610 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f790802ae70 tx=0x7f79080095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5450888c1528798d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f78f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f78f8ff9640 1 -- 172.21.15.98:0/2403306749 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790804f030 con 0x55c3f4d09cb0 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f791a803740 1 -- 172.21.15.98:0/2403306749 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f790c0a1c60 con 0x55c3f4d09cb0 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f78f8ff9640 1 -- 172.21.15.98:0/2403306749 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f790802fae0 con 0x55c3f4d09cb0 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f78f8ff9640 1 -- 172.21.15.98:0/2403306749 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7908034040 con 0x55c3f4d09cb0 2024-09-19T07:27:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f791a803740 10 client.16635 fetch_fsmap learned FSMap version 30 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f791a803740 1 -- 172.21.15.98:0/2403306749 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c3f4a42620 con 0x55c3f4d09cb0 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f78f8ff9640 1 -- 172.21.15.98:0/2403306749 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f790c0a1c60 con 0x55c3f4d09cb0 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f78f8ff9640 1 -- 172.21.15.98:0/2403306749 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f790805a020 con 0x55c3f4d09cb0 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f791a803740 10 client.16635 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f791a803740 10 client.16635 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f791a803740 20 client.16635 populate_metadata read hostname 'smithi098' 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f791a803740 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55c3f4d19cb0 0x55c3f4d1c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f791a803740 4 client.16635 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f791a803740 1 -- 172.21.15.98:0/2403306749 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3f4c70a20 con 0x55c3f4d19cb0 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.490+0000 7f7915729640 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55c3f4d19cb0 0x55c3f4d1c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.491+0000 7f78f8ff9640 10 client.16635 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.491+0000 7f7915729640 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55c3f4d19cb0 0x55c3f4d1c110 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c71cfeae64b846ac server_cookie=cf867295c98346b8 in_seq=0 out_seq=0 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f78f8ff9640 1 -- 172.21.15.98:0/2403306749 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3f4c70a20 con 0x55c3f4d19cb0 2024-09-19T07:27:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f78f8ff9640 10 client.16635 handle_command_reply: tid=0 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f791a803740 1 client.16635 shutdown 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f791a803740 1 -- 172.21.15.98:0/2403306749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 msgr2=0x55c3f4d07610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f791a803740 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d07610 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f790802ae70 tx=0x7f79080095c0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f791a803740 1 -- 172.21.15.98:0/2403306749 shutdown_connections 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f791a803740 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55c3f4d19cb0 0x55c3f4d1c110 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f791a803740 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d07610 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f791a803740 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cff410 0x55c3f4d070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f78f8ff9640 0 client.16635 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f791a803740 1 --2- 172.21.15.98:0/2403306749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d06b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f791a803740 1 -- 172.21.15.98:0/2403306749 >> 172.21.15.98:0/2403306749 conn(0x55c3f4cfb060 msgr2=0x55c3f4d00dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f791a803740 1 -- 172.21.15.98:0/2403306749 shutdown_connections 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f791a803740 1 -- 172.21.15.98:0/2403306749 wait complete. 2024-09-19T07:27:40.501 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.493+0000 7f791a803740 20 client.16635 trim_cache size 0 max 16384 2024-09-19T07:27:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.508+0000 7f791a803740 1 Processor -- start 2024-09-19T07:27:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.508+0000 7f791a803740 1 -- start start 2024-09-19T07:27:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f791a803740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d07440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f791a803740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cff410 0x55c3f4d21a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f791a803740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d21f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.513 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f791a803740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f79101adeb0 con 0x55c3f4cff410 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f791a803740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f79101ab6c0 con 0x55c3f4cfeaf0 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f791a803740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79101a9510 con 0x55c3f4d09cb0 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f7914f28640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cff410 0x55c3f4d21a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f7914f28640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cff410 0x55c3f4d21a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34294/0 (socket says 172.21.15.98:34294) 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f7914f28640 1 -- 172.21.15.98:0/702749052 learned_addr learned my addr 172.21.15.98:0/702749052 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f7915729640 1 --2- 172.21.15.98:0/702749052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d07440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f7915f2a640 1 --2- 172.21.15.98:0/702749052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d21f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f7914f28640 1 -- 172.21.15.98:0/702749052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4d09cb0 msgr2=0x55c3f4d21f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f7914f28640 1 --2- 172.21.15.98:0/702749052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d21f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f7914f28640 1 -- 172.21.15.98:0/702749052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cfeaf0 msgr2=0x55c3f4d07440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f7914f28640 1 --2- 172.21.15.98:0/702749052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d07440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f7914f28640 1 -- 172.21.15.98:0/702749052 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3f4cfae90 con 0x55c3f4cff410 2024-09-19T07:27:40.514 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f7914f28640 1 --2- 172.21.15.98:0/702749052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cff410 0x55c3f4d21a20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7910076350 tx=0x7f7900005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a02847bce8722c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.509+0000 7f78faffd640 1 -- 172.21.15.98:0/702749052 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900022070 con 0x55c3f4cff410 2024-09-19T07:27:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.510+0000 7f78faffd640 1 -- 172.21.15.98:0/702749052 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f790000f950 con 0x55c3f4cff410 2024-09-19T07:27:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.510+0000 7f78faffd640 1 -- 172.21.15.98:0/702749052 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79000039d0 con 0x55c3f4cff410 2024-09-19T07:27:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.510+0000 7f791a803740 1 -- 172.21.15.98:0/702749052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cff410 msgr2=0x55c3f4d21a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.510+0000 7f791a803740 1 --2- 172.21.15.98:0/702749052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cff410 0x55c3f4d21a20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7910076350 tx=0x7f7900005f90 comp rx=0 tx=0).stop 2024-09-19T07:27:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.510+0000 7f791a803740 1 -- 172.21.15.98:0/702749052 shutdown_connections 2024-09-19T07:27:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.510+0000 7f791a803740 1 --2- 172.21.15.98:0/702749052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d21f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.515 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.510+0000 7f791a803740 1 --2- 172.21.15.98:0/702749052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4cff410 0x55c3f4d21a20 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.510+0000 7f791a803740 1 --2- 172.21.15.98:0/702749052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d07440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.510+0000 7f791a803740 1 -- 172.21.15.98:0/702749052 >> 172.21.15.98:0/702749052 conn(0x55c3f4cfb060 msgr2=0x55c3f4d08c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.510+0000 7f791a803740 1 -- 172.21.15.98:0/702749052 shutdown_connections 2024-09-19T07:27:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.510+0000 7f791a803740 1 -- 172.21.15.98:0/702749052 wait complete. 2024-09-19T07:27:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.510+0000 7f791a803740 1 -- start start 2024-09-19T07:27:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f791a803740 1 Processor -- start 2024-09-19T07:27:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f791a803740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d7d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f791a803740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4cff410 0x55c3f4d7d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f791a803740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d10c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f791a803740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f79101a9b80 con 0x55c3f4d09cb0 2024-09-19T07:27:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f791a803740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f79101aaff0 con 0x55c3f4cfeaf0 2024-09-19T07:27:40.516 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f791a803740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f79101aa250 con 0x55c3f4cff410 2024-09-19T07:27:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f791a803740 10 client.0 _ll_register_callbacks cb 0x7f7908009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f7915f2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d10c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f7915729640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d7d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f7915f2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d10c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:34300/0 (socket says 172.21.15.98:34300) 2024-09-19T07:27:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f7915f2a640 1 -- 172.21.15.98:0/1126643648 learned_addr learned my addr 172.21.15.98:0/1126643648 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f7914f28640 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4cff410 0x55c3f4d7d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f7915f2a640 1 -- 172.21.15.98:0/1126643648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4cff410 msgr2=0x55c3f4d7d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f7915f2a640 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4cff410 0x55c3f4d7d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f7915f2a640 1 -- 172.21.15.98:0/1126643648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cfeaf0 msgr2=0x55c3f4d7d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f7915f2a640 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d7d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f7915f2a640 1 -- 172.21.15.98:0/1126643648 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3f4cfbcf0 con 0x55c3f4d09cb0 2024-09-19T07:27:40.517 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.511+0000 7f7915729640 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d7d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f7915f2a640 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d10c80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f790805c620 tx=0x7f790802fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fdbcac20e7e42b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f78f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:27:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f78f8ff9640 1 -- 172.21.15.98:0/1126643648 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7908061060 con 0x55c3f4d09cb0 2024-09-19T07:27:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f78f8ff9640 1 -- 172.21.15.98:0/1126643648 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f7908004450 con 0x55c3f4d09cb0 2024-09-19T07:27:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f791a803740 1 -- 172.21.15.98:0/1126643648 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f790000f950 con 0x55c3f4d09cb0 2024-09-19T07:27:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f78f8ff9640 1 -- 172.21.15.98:0/1126643648 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f790804f070 con 0x55c3f4d09cb0 2024-09-19T07:27:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f791a803740 10 client.16641 fetch_fsmap learned FSMap version 30 2024-09-19T07:27:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f791a803740 1 -- 172.21.15.98:0/1126643648 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c3f4d12270 con 0x55c3f4d09cb0 2024-09-19T07:27:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f78f8ff9640 1 -- 172.21.15.98:0/1126643648 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f790000f950 con 0x55c3f4d09cb0 2024-09-19T07:27:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f78f8ff9640 1 -- 172.21.15.98:0/1126643648 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7f790805a040 con 0x55c3f4d09cb0 2024-09-19T07:27:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f791a803740 10 client.16641 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:27:40.518 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f791a803740 10 client.16641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T07:27:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f791a803740 20 client.16641 populate_metadata read hostname 'smithi098' 2024-09-19T07:27:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f791a803740 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55c3f4d8d5f0 0x55c3f4d8f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f791a803740 4 client.16641 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T07:27:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f791a803740 1 -- 172.21.15.98:0/1126643648 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c3f4c6ad70 con 0x55c3f4d8d5f0 2024-09-19T07:27:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.512+0000 7f7915729640 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55c3f4d8d5f0 0x55c3f4d8f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.513+0000 7f78f8ff9640 10 client.16641 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:40.519 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.513+0000 7f7915729640 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55c3f4d8d5f0 0x55c3f4d8f9e0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbbb0e687c75780e server_cookie=e792e9c59e1b6343 in_seq=0 out_seq=0 2024-09-19T07:27:40.903 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.902+0000 7f78f8ff9640 1 -- 172.21.15.98:0/1126643648 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c3f4c6ad70 con 0x55c3f4d8d5f0 2024-09-19T07:27:40.903 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.902+0000 7f78f8ff9640 10 client.16641 handle_command_reply: tid=0 2024-09-19T07:27:40.903 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.902+0000 7f791a803740 1 client.16641 shutdown 2024-09-19T07:27:40.903 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.902+0000 7f791a803740 1 -- 172.21.15.98:0/1126643648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 msgr2=0x55c3f4d10c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.903 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.902+0000 7f791a803740 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d10c80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f790805c620 tx=0x7f790802fd10 comp rx=0 tx=0).stop 2024-09-19T07:27:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.902+0000 7f791a803740 1 -- 172.21.15.98:0/1126643648 shutdown_connections 2024-09-19T07:27:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.902+0000 7f791a803740 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55c3f4d8d5f0 0x55c3f4d8f9e0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.902+0000 7f78f8ff9640 0 client.16641 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.902+0000 7f791a803740 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3f4d09cb0 0x55c3f4d10c80 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.902+0000 7f791a803740 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c3f4cff410 0x55c3f4d7d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.903+0000 7f791a803740 1 --2- 172.21.15.98:0/1126643648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c3f4cfeaf0 0x55c3f4d7d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.903+0000 7f791a803740 1 -- 172.21.15.98:0/1126643648 >> 172.21.15.98:0/1126643648 conn(0x55c3f4cfb060 msgr2=0x55c3f4d00d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.903+0000 7f791a803740 1 -- 172.21.15.98:0/1126643648 shutdown_connections 2024-09-19T07:27:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.903+0000 7f791a803740 1 -- 172.21.15.98:0/1126643648 wait complete. 2024-09-19T07:27:40.904 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.903+0000 7f791a803740 20 client.16641 trim_cache size 0 max 16384 2024-09-19T07:27:40.905 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:{ 2024-09-19T07:27:40.905 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "message": "", 2024-09-19T07:27:40.905 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout: "return_code": 0 2024-09-19T07:27:40.905 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stdout:} 2024-09-19T07:27:40.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.904+0000 7f791798d640 1 -- 172.21.15.98:0/4150339188 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f78fc0a3460 msgr2=0x7f78fc0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.904+0000 7f791798d640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f78fc0a3460 0x7f78fc0a5920 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7908005fe0 tx=0x7f7908005c50 comp rx=0 tx=0).stop 2024-09-19T07:27:40.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.904+0000 7f791798d640 1 -- 172.21.15.98:0/4150339188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79101016d0 msgr2=0x7f7910197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:40.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.904+0000 7f791798d640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79101016d0 0x7f7910197130 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f790c00eb00 tx=0x7f790c00ef00 comp rx=0 tx=0).stop 2024-09-19T07:27:40.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.904+0000 7f791798d640 1 -- 172.21.15.98:0/4150339188 shutdown_connections 2024-09-19T07:27:40.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.904+0000 7f791798d640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f78fc0a3460 0x7f78fc0a5920 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.904+0000 7f791798d640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7910105af0 0x7f791019b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.904+0000 7f791798d640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7910102050 0x7f7910197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.904+0000 7f791798d640 1 --2- 172.21.15.98:0/4150339188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f79101016d0 0x7f7910197130 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:40.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.904+0000 7f791798d640 1 -- 172.21.15.98:0/4150339188 >> 172.21.15.98:0/4150339188 conn(0x7f7910075ec0 msgr2=0x7f79100ff090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:40.906 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.904+0000 7f791798d640 1 -- 172.21.15.98:0/4150339188 shutdown_connections 2024-09-19T07:27:40.907 INFO:teuthology.task.background_exec.ubuntu@smithi098.front.sepia.ceph.com.smithi098.stderr:2024-09-19T07:27:40.904+0000 7f791798d640 1 -- 172.21.15.98:0/4150339188 wait complete. 2024-09-19T07:27:41.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:41 smithi139 ceph-mon[35039]: pgmap v171: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 334 op/s 2024-09-19T07:27:41.325 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:41 smithi098 ceph-mon[30950]: pgmap v171: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 334 op/s 2024-09-19T07:27:41.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:41 smithi162 ceph-mon[35726]: pgmap v171: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 334 op/s 2024-09-19T07:27:42.840 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-19T07:27:42.841 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T07:27:43.137 DEBUG:teuthology.parallel:result is None 2024-09-19T07:27:43.138 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T07:27:43.170 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T07:27:43.170 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T07:27:43.180 INFO:tasks.quiescer:joining Quiescers 2024-09-19T07:27:43.181 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T07:27:43.181 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:27:43.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:43 smithi139 ceph-mon[35039]: pgmap v172: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 284 op/s 2024-09-19T07:27:43.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:43 smithi162 ceph-mon[35726]: pgmap v172: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 284 op/s 2024-09-19T07:27:43.502 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:27:43.522 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:43 smithi098 ceph-mon[30950]: pgmap v172: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 284 op/s 2024-09-19T07:27:44.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.023+0000 7f39eb434640 1 -- 172.21.15.98:0/1910893483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39e4102d30 msgr2=0x7f39e4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:44.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.023+0000 7f39eb434640 1 --2- 172.21.15.98:0/1910893483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39e4102d30 0x7f39e4103110 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009cd0 tx=0x7f39d402a8e0 comp rx=0 tx=0).stop 2024-09-19T07:27:44.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.023+0000 7f39eb434640 1 -- 172.21.15.98:0/1910893483 shutdown_connections 2024-09-19T07:27:44.033 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.023+0000 7f39eb434640 1 --2- 172.21.15.98:0/1910893483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e41082a0 0x7f39e410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.023+0000 7f39eb434640 1 --2- 172.21.15.98:0/1910893483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39e41036e0 0x7f39e4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.023+0000 7f39eb434640 1 --2- 172.21.15.98:0/1910893483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39e4102d30 0x7f39e4103110 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.023+0000 7f39eb434640 1 -- 172.21.15.98:0/1910893483 >> 172.21.15.98:0/1910893483 conn(0x7f39e40fc7d0 msgr2=0x7f39e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.023+0000 7f39eb434640 1 -- 172.21.15.98:0/1910893483 shutdown_connections 2024-09-19T07:27:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.023+0000 7f39eb434640 1 -- 172.21.15.98:0/1910893483 wait complete. 2024-09-19T07:27:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.023+0000 7f39eb434640 1 Processor -- start 2024-09-19T07:27:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.023+0000 7f39eb434640 1 -- start start 2024-09-19T07:27:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39eb434640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39e4102d30 0x7f39e41985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39eb434640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39e41036e0 0x7f39e4198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39eb434640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e41082a0 0x7f39e419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39eb434640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f39e41120a0 con 0x7f39e4102d30 2024-09-19T07:27:44.034 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39eb434640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f39e4111f20 con 0x7f39e41036e0 2024-09-19T07:27:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39eb434640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39e4112220 con 0x7f39e41082a0 2024-09-19T07:27:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e91d0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39e4102d30 0x7f39e41985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e91d0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39e4102d30 0x7f39e41985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37476/0 (socket says 172.21.15.98:37476) 2024-09-19T07:27:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e91d0640 1 -- 172.21.15.98:0/3512828598 learned_addr learned my addr 172.21.15.98:0/3512828598 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e89cf640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39e41036e0 0x7f39e4198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e99d1640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e41082a0 0x7f39e419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e91d0640 1 -- 172.21.15.98:0/3512828598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e41082a0 msgr2=0x7f39e419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e91d0640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e41082a0 0x7f39e419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e91d0640 1 -- 172.21.15.98:0/3512828598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39e41036e0 msgr2=0x7f39e4198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e91d0640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39e41036e0 0x7f39e4198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e91d0640 1 -- 172.21.15.98:0/3512828598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e419d570 con 0x7f39e4102d30 2024-09-19T07:27:44.035 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e89cf640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39e41036e0 0x7f39e4198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e91d0640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39e4102d30 0x7f39e41985c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f39d402ae00 tx=0x7f39d4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e27fc640 1 -- 172.21.15.98:0/3512828598 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4004040 con 0x7f39e4102d30 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39e27fc640 1 -- 172.21.15.98:0/3512828598 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39d40046c0 con 0x7f39e4102d30 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.024+0000 7f39eb434640 1 -- 172.21.15.98:0/3512828598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e419d800 con 0x7f39e4102d30 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.025+0000 7f39e27fc640 1 -- 172.21.15.98:0/3512828598 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4046480 con 0x7f39e4102d30 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.025+0000 7f39eb434640 1 -- 172.21.15.98:0/3512828598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e41a5140 con 0x7f39e4102d30 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.026+0000 7f39eb434640 1 -- 172.21.15.98:0/3512828598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e4103110 con 0x7f39e4102d30 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.027+0000 7f39e27fc640 1 -- 172.21.15.98:0/3512828598 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f39d40305a0 con 0x7f39e4102d30 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.027+0000 7f39e27fc640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f39cc0a33b0 0x7f39cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.027+0000 7f39e89cf640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f39cc0a33b0 0x7f39cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.027+0000 7f39e27fc640 1 -- 172.21.15.98:0/3512828598 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7f39d402e030 con 0x7f39e4102d30 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.028+0000 7f39e89cf640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f39cc0a33b0 0x7f39cc0a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f39d80058c0 tx=0x7f39d8005850 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:44.036 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.031+0000 7f39e27fc640 1 -- 172.21.15.98:0/3512828598 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f39d404b060 con 0x7f39e4102d30 2024-09-19T07:27:44.233 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.233+0000 7f39eb434640 1 -- 172.21.15.98:0/3512828598 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39e410a2b0 con 0x7f39e4102d30 2024-09-19T07:27:44.234 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.233+0000 7f39e27fc640 1 -- 172.21.15.98:0/3512828598 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11928 (secure 0 0 0) 0x7f39d4030890 con 0x7f39e4102d30 2024-09-19T07:27:44.234 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:27:44.234 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":30,"btime":"2024-09-19T07:24:57:508846+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:24:56.977446+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":73,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":74,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:27:44.234 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 30 2024-09-19T07:27:44.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.235+0000 7f39eb434640 1 -- 172.21.15.98:0/3512828598 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f39cc0a33b0 msgr2=0x7f39cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:44.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.235+0000 7f39eb434640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f39cc0a33b0 0x7f39cc0a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f39d80058c0 tx=0x7f39d8005850 comp rx=0 tx=0).stop 2024-09-19T07:27:44.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.235+0000 7f39eb434640 1 -- 172.21.15.98:0/3512828598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39e4102d30 msgr2=0x7f39e41985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:44.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.235+0000 7f39eb434640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39e4102d30 0x7f39e41985c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f39d402ae00 tx=0x7f39d4003970 comp rx=0 tx=0).stop 2024-09-19T07:27:44.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.236+0000 7f39eb434640 1 -- 172.21.15.98:0/3512828598 shutdown_connections 2024-09-19T07:27:44.236 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.236+0000 7f39eb434640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f39cc0a33b0 0x7f39cc0a5870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.236+0000 7f39eb434640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39e41082a0 0x7f39e419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.236+0000 7f39eb434640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f39e41036e0 0x7f39e4198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.236+0000 7f39eb434640 1 --2- 172.21.15.98:0/3512828598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f39e4102d30 0x7f39e41985c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.236+0000 7f39eb434640 1 -- 172.21.15.98:0/3512828598 >> 172.21.15.98:0/3512828598 conn(0x7f39e40fc7d0 msgr2=0x7f39e4105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.236+0000 7f39eb434640 1 -- 172.21.15.98:0/3512828598 shutdown_connections 2024-09-19T07:27:44.237 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:44.236+0000 7f39eb434640 1 -- 172.21.15.98:0/3512828598 wait complete. 2024-09-19T07:27:44.990 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24479 quiesce db --cancel --all' 2024-09-19T07:27:44.990 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24479 quiesce db --cancel --all 2024-09-19T07:27:45.238 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:27:45.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:45 smithi098 ceph-mon[30950]: pgmap v173: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 280 op/s 2024-09-19T07:27:45.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:45 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3512828598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:27:45.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:45 smithi139 ceph-mon[35039]: pgmap v173: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 280 op/s 2024-09-19T07:27:45.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:45 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3512828598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:27:45.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:45 smithi162 ceph-mon[35726]: pgmap v173: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 280 op/s 2024-09-19T07:27:45.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:45 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3512828598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:27:45.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.684+0000 7fb6349cc640 1 -- 172.21.15.98:0/2109605316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb630100e20 msgr2=0x7fb630101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:45.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.685+0000 7fb6349cc640 1 --2- 172.21.15.98:0/2109605316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb630100e20 0x7fb630101200 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb620009900 tx=0x7fb62002a480 comp rx=0 tx=0).stop 2024-09-19T07:27:45.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.685+0000 7fb6349cc640 1 -- 172.21.15.98:0/2109605316 shutdown_connections 2024-09-19T07:27:45.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.685+0000 7fb6349cc640 1 --2- 172.21.15.98:0/2109605316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb630102ef0 0x7fb63010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.685 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.685+0000 7fb6349cc640 1 --2- 172.21.15.98:0/2109605316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb630102570 0x7fb6301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.685+0000 7fb6349cc640 1 --2- 172.21.15.98:0/2109605316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb630100e20 0x7fb630101200 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.685+0000 7fb6349cc640 1 -- 172.21.15.98:0/2109605316 >> 172.21.15.98:0/2109605316 conn(0x7fb6300fc7d0 msgr2=0x7fb6300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:45.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.685+0000 7fb6349cc640 1 -- 172.21.15.98:0/2109605316 shutdown_connections 2024-09-19T07:27:45.686 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.685+0000 7fb6349cc640 1 -- 172.21.15.98:0/2109605316 wait complete. 2024-09-19T07:27:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.685+0000 7fb6349cc640 1 Processor -- start 2024-09-19T07:27:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb6349cc640 1 -- start start 2024-09-19T07:27:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb6349cc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb630100e20 0x7fb6300fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb6349cc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb630102570 0x7fb6300fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb6349cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb630102ef0 0x7fb6300fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb6349cc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb630110ff0 con 0x7fb630102570 2024-09-19T07:27:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb6349cc640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb630110e70 con 0x7fb630100e20 2024-09-19T07:27:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb6349cc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb630111170 con 0x7fb630102ef0 2024-09-19T07:27:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb62dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb630102570 0x7fb6300fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.688 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb62dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb630102570 0x7fb6300fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37488/0 (socket says 172.21.15.98:37488) 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb62dd9b640 1 -- 172.21.15.98:0/2504943164 learned_addr learned my addr 172.21.15.98:0/2504943164 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb62e59c640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb630100e20 0x7fb6300fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb62dd9b640 1 -- 172.21.15.98:0/2504943164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb630102ef0 msgr2=0x7fb6300fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb62ed9d640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb630102ef0 0x7fb6300fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb630102ef0 0x7fb6300fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb62dd9b640 1 -- 172.21.15.98:0/2504943164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb630100e20 msgr2=0x7fb6300fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb630100e20 0x7fb6300fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb62dd9b640 1 -- 172.21.15.98:0/2504943164 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6301a6aa0 con 0x7fb630102570 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.686+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb630102570 0x7fb6300fd1c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb61800b4a0 tx=0x7fb61800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.687+0000 7fb6277fe640 1 -- 172.21.15.98:0/2504943164 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618014070 con 0x7fb630102570 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.687+0000 7fb6277fe640 1 -- 172.21.15.98:0/2504943164 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb618010af0 con 0x7fb630102570 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.687+0000 7fb6277fe640 1 -- 172.21.15.98:0/2504943164 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618017d10 con 0x7fb630102570 2024-09-19T07:27:45.689 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.687+0000 7fb6349cc640 1 -- 172.21.15.98:0/2504943164 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6301a6d90 con 0x7fb630102570 2024-09-19T07:27:45.690 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.687+0000 7fb6349cc640 1 -- 172.21.15.98:0/2504943164 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6301a7250 con 0x7fb630102570 2024-09-19T07:27:45.691 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.689+0000 7fb6277fe640 1 -- 172.21.15.98:0/2504943164 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb618017070 con 0x7fb630102570 2024-09-19T07:27:45.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.689+0000 7fb636da5740 1 Processor -- start 2024-09-19T07:27:45.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb636da5740 1 -- start start 2024-09-19T07:27:45.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb636da5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5ba00 0x55f257b5bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb636da5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b5c320 0x55f257b666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb636da5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b66be0 0x55f257b68fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb636da5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f257ac0200 con 0x55f257b5ba00 2024-09-19T07:27:45.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb6277fe640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb61c0a3430 0x7fb61c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb636da5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f257a66dc0 con 0x55f257b5c320 2024-09-19T07:27:45.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb636da5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f257abc1c0 con 0x55f257b66be0 2024-09-19T07:27:45.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb62ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5ba00 0x55f257b5bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.692 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb62ed9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5ba00 0x55f257b5bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37494/0 (socket says 172.21.15.98:37494) 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb62ed9d640 1 -- 172.21.15.98:0/2450766229 learned_addr learned my addr 172.21.15.98:0/2450766229 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb62ed9d640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb61c0a3430 0x7fb61c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/2450766229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b66be0 0x55f257b68fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb62e59c640 1 --2- 172.21.15.98:0/2450766229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b5c320 0x55f257b666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb62ed9d640 1 -- 172.21.15.98:0/2450766229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b66be0 msgr2=0x55f257b68fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb62ed9d640 1 --2- 172.21.15.98:0/2450766229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b66be0 0x55f257b68fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb6277fe640 1 -- 172.21.15.98:0/2504943164 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb6180cef90 con 0x7fb630102570 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb62ed9d640 1 -- 172.21.15.98:0/2450766229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b5c320 msgr2=0x55f257b666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb62ed9d640 1 --2- 172.21.15.98:0/2450766229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b5c320 0x55f257b666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.690+0000 7fb62ed9d640 1 -- 172.21.15.98:0/2450766229 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f257831620 con 0x55f257b5ba00 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.691+0000 7fb62e59c640 1 --2- 172.21.15.98:0/2450766229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b5c320 0x55f257b666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.691+0000 7fb62ed9d640 1 --2- 172.21.15.98:0/2450766229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5ba00 0x55f257b5bde0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb628014d60 tx=0x7fb628011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d1554879286f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:45.693 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.691+0000 7fb62ed9d640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb61c0a3430 0x7fb61c0a58f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb628011c50 tx=0x7fb628016000 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:45.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.691+0000 7fb624ff9640 1 -- 172.21.15.98:0/2450766229 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb628022070 con 0x55f257b5ba00 2024-09-19T07:27:45.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.691+0000 7fb624ff9640 1 -- 172.21.15.98:0/2450766229 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb628014e50 con 0x55f257b5ba00 2024-09-19T07:27:45.694 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.691+0000 7fb624ff9640 1 -- 172.21.15.98:0/2450766229 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6280052a0 con 0x55f257b5ba00 2024-09-19T07:27:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.692+0000 7fb636da5740 1 -- 172.21.15.98:0/2450766229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5ba00 msgr2=0x55f257b5bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.692+0000 7fb636da5740 1 --2- 172.21.15.98:0/2450766229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5ba00 0x55f257b5bde0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb628014d60 tx=0x7fb628011750 comp rx=0 tx=0).stop 2024-09-19T07:27:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.692+0000 7fb636da5740 1 -- 172.21.15.98:0/2450766229 shutdown_connections 2024-09-19T07:27:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.692+0000 7fb636da5740 1 --2- 172.21.15.98:0/2450766229 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b66be0 0x55f257b68fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.692+0000 7fb636da5740 1 --2- 172.21.15.98:0/2450766229 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b5c320 0x55f257b666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.692+0000 7fb636da5740 1 --2- 172.21.15.98:0/2450766229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5ba00 0x55f257b5bde0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.692+0000 7fb636da5740 1 -- 172.21.15.98:0/2450766229 >> 172.21.15.98:0/2450766229 conn(0x55f257b57f90 msgr2=0x55f257b58370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.692+0000 7fb636da5740 1 -- 172.21.15.98:0/2450766229 shutdown_connections 2024-09-19T07:27:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.692+0000 7fb636da5740 1 -- 172.21.15.98:0/2450766229 wait complete. 2024-09-19T07:27:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.692+0000 7fb636da5740 1 -- start start 2024-09-19T07:27:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.692+0000 7fb636da5740 1 Processor -- start 2024-09-19T07:27:45.698 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.692+0000 7fb636da5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b5ba00 0x55f257b664f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb636da5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b637a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb636da5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b66be0 0x55f257b63ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb636da5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f257b697b0 con 0x55f257b5c320 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb636da5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f257a5ac50 con 0x55f257b66be0 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb636da5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55f257b69930 con 0x55f257b5ba00 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb636da5740 10 client.0 _ll_register_callbacks cb 0x55f257a6cba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb62dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb62dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b637a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37506/0 (socket says 172.21.15.98:37506) 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb62ed9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b66be0 0x55f257b63ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb62dd9b640 1 -- 172.21.15.98:0/3958013976 learned_addr learned my addr 172.21.15.98:0/3958013976 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb62e59c640 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b5ba00 0x55f257b664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb62dd9b640 1 -- 172.21.15.98:0/3958013976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b5ba00 msgr2=0x55f257b664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:45.699 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b5ba00 0x55f257b664f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb62dd9b640 1 -- 172.21.15.98:0/3958013976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b66be0 msgr2=0x55f257b63ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b66be0 0x55f257b63ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb62dd9b640 1 -- 172.21.15.98:0/3958013976 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f257b644e0 con 0x55f257b5c320 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb62ed9d640 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b66be0 0x55f257b63ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b637a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb618097750 tx=0x7fb61806af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416e5dbe63e09ca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb615ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb615ffb640 1 -- 172.21.15.98:0/3958013976 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61801e040 con 0x55f257b5c320 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb615ffb640 1 -- 172.21.15.98:0/3958013976 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb618097960 con 0x55f257b5c320 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb636da5740 1 -- 172.21.15.98:0/3958013976 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb628014e50 con 0x55f257b5c320 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb615ffb640 1 -- 172.21.15.98:0/3958013976 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb618095e60 con 0x55f257b5c320 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb636da5740 10 client.16659 fetch_fsmap learned FSMap version 30 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.693+0000 7fb636da5740 1 -- 172.21.15.98:0/3958013976 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f257b75300 con 0x55f257b5c320 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.694+0000 7fb615ffb640 1 -- 172.21.15.98:0/3958013976 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb628014e50 con 0x55f257b5c320 2024-09-19T07:27:45.700 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.694+0000 7fb615ffb640 1 -- 172.21.15.98:0/3958013976 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb6180cc8d0 con 0x55f257b5c320 2024-09-19T07:27:45.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.694+0000 7fb636da5740 10 client.16659 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:27:45.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.694+0000 7fb636da5740 10 client.16659 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:27:45.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.694+0000 7fb636da5740 20 client.16659 populate_metadata read hostname 'smithi098' 2024-09-19T07:27:45.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.694+0000 7fb636da5740 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55f257b76760 0x55f257b78b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.694+0000 7fb636da5740 4 client.16659 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T07:27:45.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.694+0000 7fb636da5740 1 -- 172.21.15.98:0/3958013976 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f257acd770 con 0x55f257b76760 2024-09-19T07:27:45.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.694+0000 7fb62e59c640 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55f257b76760 0x55f257b78b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.695+0000 7fb615ffb640 10 client.16659 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:45.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.695+0000 7fb62e59c640 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55f257b76760 0x55f257b78b50 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=594d8af7fe8875e3 server_cookie=2fb40d2b6cc9c54e in_seq=0 out_seq=0 2024-09-19T07:27:45.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.695+0000 7fb615ffb640 1 -- 172.21.15.98:0/3958013976 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f257acd770 con 0x55f257b76760 2024-09-19T07:27:45.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.695+0000 7fb615ffb640 10 client.16659 handle_command_reply: tid=0 2024-09-19T07:27:45.701 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.695+0000 7fb636da5740 1 client.16659 shutdown 2024-09-19T07:27:45.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.695+0000 7fb636da5740 1 -- 172.21.15.98:0/3958013976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 msgr2=0x55f257b637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:45.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.695+0000 7fb636da5740 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b637a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb618097750 tx=0x7fb61806af10 comp rx=0 tx=0).stop 2024-09-19T07:27:45.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.696+0000 7fb636da5740 1 -- 172.21.15.98:0/3958013976 shutdown_connections 2024-09-19T07:27:45.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.696+0000 7fb636da5740 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b66be0 0x55f257b63ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.696+0000 7fb636da5740 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55f257b76760 0x55f257b78b50 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.696+0000 7fb636da5740 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b637a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.696+0000 7fb636da5740 1 --2- 172.21.15.98:0/3958013976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b5ba00 0x55f257b664f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.696+0000 7fb615ffb640 0 client.16659 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:45.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.696+0000 7fb636da5740 1 -- 172.21.15.98:0/3958013976 >> 172.21.15.98:0/3958013976 conn(0x55f257b57f90 msgr2=0x55f257b571d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:45.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.696+0000 7fb636da5740 1 -- 172.21.15.98:0/3958013976 shutdown_connections 2024-09-19T07:27:45.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.696+0000 7fb636da5740 1 -- 172.21.15.98:0/3958013976 wait complete. 2024-09-19T07:27:45.702 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.696+0000 7fb636da5740 20 client.16659 trim_cache size 0 max 16384 2024-09-19T07:27:45.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.712+0000 7fb636da5740 1 Processor -- start 2024-09-19T07:27:45.714 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.712+0000 7fb636da5740 1 -- start start 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.712+0000 7fb636da5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b5ba00 0x55f257b72a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.712+0000 7fb636da5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b7e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.712+0000 7fb636da5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b66be0 0x55f257b7e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.712+0000 7fb636da5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301b2440 con 0x55f257b5c320 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.712+0000 7fb636da5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301afc50 con 0x55f257b66be0 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.712+0000 7fb636da5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301adaa0 con 0x55f257b5ba00 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb62dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b7e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb62dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b7e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37520/0 (socket says 172.21.15.98:37520) 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb62dd9b640 1 -- 172.21.15.98:0/2788909646 learned_addr learned my addr 172.21.15.98:0/2788909646 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb62dd9b640 1 -- 172.21.15.98:0/2788909646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b5ba00 msgr2=0x55f257b72a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb62e59c640 1 --2- 172.21.15.98:0/2788909646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b5ba00 0x55f257b72a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb62ed9d640 1 --2- 172.21.15.98:0/2788909646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b66be0 0x55f257b7e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/2788909646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b5ba00 0x55f257b72a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.715 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb62dd9b640 1 -- 172.21.15.98:0/2788909646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b66be0 msgr2=0x55f257b7e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/2788909646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b66be0 0x55f257b7e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb62dd9b640 1 -- 172.21.15.98:0/2788909646 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f257b53730 con 0x55f257b5c320 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb62ed9d640 1 --2- 172.21.15.98:0/2788909646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b66be0 0x55f257b7e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/2788909646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b7e420 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb6180995a0 tx=0x7fb618017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f8000bc1b67fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb617fff640 1 -- 172.21.15.98:0/2788909646 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61801e070 con 0x55f257b5c320 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb617fff640 1 -- 172.21.15.98:0/2788909646 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb618009230 con 0x55f257b5c320 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.713+0000 7fb617fff640 1 -- 172.21.15.98:0/2788909646 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618097960 con 0x55f257b5c320 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.714+0000 7fb636da5740 1 -- 172.21.15.98:0/2788909646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 msgr2=0x55f257b7e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.714+0000 7fb636da5740 1 --2- 172.21.15.98:0/2788909646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b7e420 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb6180995a0 tx=0x7fb618017730 comp rx=0 tx=0).stop 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.714+0000 7fb636da5740 1 -- 172.21.15.98:0/2788909646 shutdown_connections 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.714+0000 7fb636da5740 1 --2- 172.21.15.98:0/2788909646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b66be0 0x55f257b7e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.714+0000 7fb636da5740 1 --2- 172.21.15.98:0/2788909646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b7e420 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.716 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.714+0000 7fb636da5740 1 --2- 172.21.15.98:0/2788909646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b5ba00 0x55f257b72a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.714+0000 7fb636da5740 1 -- 172.21.15.98:0/2788909646 >> 172.21.15.98:0/2788909646 conn(0x55f257b57f90 msgr2=0x55f257b5ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:45.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.714+0000 7fb636da5740 1 -- 172.21.15.98:0/2788909646 shutdown_connections 2024-09-19T07:27:45.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.714+0000 7fb636da5740 1 -- 172.21.15.98:0/2788909646 wait complete. 2024-09-19T07:27:45.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.714+0000 7fb636da5740 1 -- start start 2024-09-19T07:27:45.717 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.714+0000 7fb636da5740 1 Processor -- start 2024-09-19T07:27:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb636da5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b5ba00 0x55f257b6eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb636da5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b6f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb636da5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b66be0 0x55f257b6bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb636da5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301ae110 con 0x55f257b5c320 2024-09-19T07:27:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb636da5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301af580 con 0x55f257b5ba00 2024-09-19T07:27:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb636da5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6301ae7e0 con 0x55f257b66be0 2024-09-19T07:27:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb636da5740 10 client.0 _ll_register_callbacks cb 0x7fb61809b190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T07:27:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb62dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b6f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb62dd9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b6f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:37532/0 (socket says 172.21.15.98:37532) 2024-09-19T07:27:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb62dd9b640 1 -- 172.21.15.98:0/273708432 learned_addr learned my addr 172.21.15.98:0/273708432 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:27:45.720 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb62e59c640 1 --2- 172.21.15.98:0/273708432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b5ba00 0x55f257b6eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb62dd9b640 1 -- 172.21.15.98:0/273708432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b66be0 msgr2=0x55f257b6bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/273708432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b66be0 0x55f257b6bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb62dd9b640 1 -- 172.21.15.98:0/273708432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b5ba00 msgr2=0x55f257b6eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/273708432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b5ba00 0x55f257b6eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb62dd9b640 1 -- 172.21.15.98:0/273708432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f257b61710 con 0x55f257b5c320 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb62dd9b640 1 --2- 172.21.15.98:0/273708432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b6f0c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb61809b280 tx=0x7fb618000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9128ec51e6c4a625 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb615ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb615ffb640 1 -- 172.21.15.98:0/273708432 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61801e050 con 0x55f257b5c320 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb615ffb640 1 -- 172.21.15.98:0/273708432 <== mon.0 v2:172.21.15.98:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8570+0+0 (secure 0 0 0) 0x7fb61809a3b0 con 0x55f257b5c320 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb636da5740 1 -- 172.21.15.98:0/273708432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb618009230 con 0x55f257b5c320 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.715+0000 7fb615ffb640 1 -- 172.21.15.98:0/273708432 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb61809f6a0 con 0x55f257b5c320 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.716+0000 7fb636da5740 10 client.16665 fetch_fsmap learned FSMap version 30 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.716+0000 7fb636da5740 1 -- 172.21.15.98:0/273708432 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f257be1880 con 0x55f257b5c320 2024-09-19T07:27:45.721 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.716+0000 7fb615ffb640 1 -- 172.21.15.98:0/273708432 <== mon.0 v2:172.21.15.98:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb618009230 con 0x55f257b5c320 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.716+0000 7fb615ffb640 1 -- 172.21.15.98:0/273708432 <== mon.0 v2:172.21.15.98:3300/0 5 ==== fsmap(e 30) ==== 8370+0+0 (secure 0 0 0) 0x7fb6180cc8d0 con 0x55f257b5c320 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.716+0000 7fb636da5740 10 client.16665 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.716+0000 7fb636da5740 10 client.16665 resolve_mds: validated gid 24479 aka daemon mds.b 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.716+0000 7fb636da5740 20 client.16665 populate_metadata read hostname 'smithi098' 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.716+0000 7fb636da5740 1 --2- 172.21.15.98:0/273708432 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55f257be1d60 0x55f257be4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.716+0000 7fb636da5740 4 client.16665 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.716+0000 7fb636da5740 1 -- 172.21.15.98:0/273708432 --> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55f257ac7c80 con 0x55f257be1d60 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.716+0000 7fb62e59c640 1 --2- 172.21.15.98:0/273708432 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55f257be1d60 0x55f257be4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb62e59c640 1 --2- 172.21.15.98:0/273708432 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55f257be1d60 0x55f257be4150 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79272a7c9011c201 server_cookie=27540e6ee1af6314 in_seq=0 out_seq=0 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb615ffb640 10 client.16665 ms_handle_connect on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb615ffb640 1 -- 172.21.15.98:0/273708432 <== mds.0 v2:172.21.15.139:6838/2420704228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55f257ac7c80 con 0x55f257be1d60 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb615ffb640 10 client.16665 handle_command_reply: tid=0 2024-09-19T07:27:45.722 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb636da5740 1 client.16665 shutdown 2024-09-19T07:27:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb636da5740 1 -- 172.21.15.98:0/273708432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 msgr2=0x55f257b6f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb636da5740 1 --2- 172.21.15.98:0/273708432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b6f0c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb61809b280 tx=0x7fb618000bc0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb636da5740 1 -- 172.21.15.98:0/273708432 shutdown_connections 2024-09-19T07:27:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb636da5740 1 --2- 172.21.15.98:0/273708432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f257b66be0 0x55f257b6bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb636da5740 1 --2- 172.21.15.98:0/273708432 >> [v2:172.21.15.139:6838/2420704228,v1:172.21.15.139:6839/2420704228] conn(0x55f257be1d60 0x55f257be4150 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb615ffb640 0 client.16665 ms_handle_reset on v2:172.21.15.139:6838/2420704228 2024-09-19T07:27:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb636da5740 1 --2- 172.21.15.98:0/273708432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f257b5c320 0x55f257b6f0c0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb636da5740 1 --2- 172.21.15.98:0/273708432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f257b5ba00 0x55f257b6eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb636da5740 1 -- 172.21.15.98:0/273708432 >> 172.21.15.98:0/273708432 conn(0x55f257b57f90 msgr2=0x55f257b5e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb636da5740 1 -- 172.21.15.98:0/273708432 shutdown_connections 2024-09-19T07:27:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb636da5740 1 -- 172.21.15.98:0/273708432 wait complete. 2024-09-19T07:27:45.723 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.717+0000 7fb636da5740 20 client.16665 trim_cache size 0 max 16384 2024-09-19T07:27:45.724 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:27:45.724 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 30, 2024-09-19T07:27:45.724 INFO:teuthology.orchestra.run.smithi098.stdout: "leader": 24479, 2024-09-19T07:27:45.724 INFO:teuthology.orchestra.run.smithi098.stdout: "set_version": 24, 2024-09-19T07:27:45.724 INFO:teuthology.orchestra.run.smithi098.stdout: "sets": {} 2024-09-19T07:27:45.724 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:27:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.718+0000 7fb6349cc640 1 -- 172.21.15.98:0/2504943164 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb61c0a3430 msgr2=0x7fb61c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.718+0000 7fb6349cc640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb61c0a3430 0x7fb61c0a58f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb628011c50 tx=0x7fb628016000 comp rx=0 tx=0).stop 2024-09-19T07:27:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.718+0000 7fb6349cc640 1 -- 172.21.15.98:0/2504943164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb630102570 msgr2=0x7fb6300fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:27:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.718+0000 7fb6349cc640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb630102570 0x7fb6300fd1c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb61800b4a0 tx=0x7fb61800b960 comp rx=0 tx=0).stop 2024-09-19T07:27:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.718+0000 7fb6349cc640 1 -- 172.21.15.98:0/2504943164 shutdown_connections 2024-09-19T07:27:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.718+0000 7fb6349cc640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb61c0a3430 0x7fb61c0a58f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.718+0000 7fb6349cc640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb630102ef0 0x7fb6300fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.718+0000 7fb6349cc640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb630102570 0x7fb6300fd1c0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.718+0000 7fb6349cc640 1 --2- 172.21.15.98:0/2504943164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb630100e20 0x7fb6300fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:27:45.725 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.718+0000 7fb6349cc640 1 -- 172.21.15.98:0/2504943164 >> 172.21.15.98:0/2504943164 conn(0x7fb6300fc7d0 msgr2=0x7fb63006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:27:45.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.718+0000 7fb6349cc640 1 -- 172.21.15.98:0/2504943164 shutdown_connections 2024-09-19T07:27:45.726 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:27:45.718+0000 7fb6349cc640 1 -- 172.21.15.98:0/2504943164 wait complete. 2024-09-19T07:27:46.585 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T07:27:46.585 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T07:27:46.598 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi098.front.sepia.ceph.com 2024-09-19T07:27:46.607 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T07:27:46.656 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T07:27:46.656 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T07:27:46.657 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi098.front.sepia.ceph.com 2024-09-19T07:27:46.657 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T07:27:46.685 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T07:27:47.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:47 smithi139 ceph-mon[35039]: pgmap v174: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 688 op/s 2024-09-19T07:27:47.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:47 smithi162 ceph-mon[35726]: pgmap v174: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 688 op/s 2024-09-19T07:27:47.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:47 smithi098 ceph-mon[30950]: pgmap v174: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 688 op/s 2024-09-19T07:27:49.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:49 smithi139 ceph-mon[35039]: pgmap v175: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 534 op/s 2024-09-19T07:27:49.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:49 smithi162 ceph-mon[35726]: pgmap v175: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 534 op/s 2024-09-19T07:27:49.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:49 smithi098 ceph-mon[30950]: pgmap v175: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 534 op/s 2024-09-19T07:27:51.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:51 smithi139 ceph-mon[35039]: pgmap v176: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 537 op/s 2024-09-19T07:27:51.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:51 smithi162 ceph-mon[35726]: pgmap v176: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 537 op/s 2024-09-19T07:27:51.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:51 smithi098 ceph-mon[30950]: pgmap v176: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 537 op/s 2024-09-19T07:27:53.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:53 smithi162 ceph-mon[35726]: pgmap v177: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 722 KiB/s wr, 417 op/s 2024-09-19T07:27:53.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:53 smithi098 ceph-mon[30950]: pgmap v177: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 722 KiB/s wr, 417 op/s 2024-09-19T07:27:53.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:53 smithi139 ceph-mon[35039]: pgmap v177: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 722 KiB/s wr, 417 op/s 2024-09-19T07:27:55.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:55 smithi162 ceph-mon[35726]: pgmap v178: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 721 KiB/s wr, 411 op/s 2024-09-19T07:27:55.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:55 smithi098 ceph-mon[30950]: pgmap v178: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 721 KiB/s wr, 411 op/s 2024-09-19T07:27:55.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:55 smithi139 ceph-mon[35039]: pgmap v178: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 721 KiB/s wr, 411 op/s 2024-09-19T07:27:57.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:57 smithi162 ceph-mon[35726]: pgmap v179: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 727 KiB/s wr, 415 op/s 2024-09-19T07:27:57.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:57 smithi098 ceph-mon[30950]: pgmap v179: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 727 KiB/s wr, 415 op/s 2024-09-19T07:27:57.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:57 smithi139 ceph-mon[35039]: pgmap v179: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 727 KiB/s wr, 415 op/s 2024-09-19T07:27:59.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:27:59 smithi162 ceph-mon[35726]: pgmap v180: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T07:27:59.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:27:59 smithi098 ceph-mon[30950]: pgmap v180: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T07:27:59.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:27:59 smithi139 ceph-mon[35039]: pgmap v180: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-09-19T07:28:01.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:01 smithi162 ceph-mon[35726]: pgmap v181: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-09-19T07:28:01.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:01 smithi098 ceph-mon[30950]: pgmap v181: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-09-19T07:28:01.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:01 smithi139 ceph-mon[35039]: pgmap v181: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-09-19T07:28:03.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:03 smithi162 ceph-mon[35726]: pgmap v182: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.4 KiB/s wr, 7 op/s 2024-09-19T07:28:03.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:03 smithi098 ceph-mon[30950]: pgmap v182: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.4 KiB/s wr, 7 op/s 2024-09-19T07:28:03.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:03 smithi139 ceph-mon[35039]: pgmap v182: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.4 KiB/s wr, 7 op/s 2024-09-19T07:28:05.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:05 smithi162 ceph-mon[35726]: pgmap v183: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.4 KiB/s wr, 6 op/s 2024-09-19T07:28:05.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:05 smithi098 ceph-mon[30950]: pgmap v183: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.4 KiB/s wr, 6 op/s 2024-09-19T07:28:05.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:05 smithi139 ceph-mon[35039]: pgmap v183: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.4 KiB/s wr, 6 op/s 2024-09-19T07:28:07.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:07 smithi162 ceph-mon[35726]: pgmap v184: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 KiB/s wr, 23 op/s 2024-09-19T07:28:07.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:07 smithi098 ceph-mon[30950]: pgmap v184: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 KiB/s wr, 23 op/s 2024-09-19T07:28:07.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:07 smithi139 ceph-mon[35039]: pgmap v184: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 28 KiB/s wr, 23 op/s 2024-09-19T07:28:09.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:09 smithi162 ceph-mon[35726]: pgmap v185: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-19T07:28:09.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:09 smithi098 ceph-mon[30950]: pgmap v185: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-19T07:28:09.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:09 smithi139 ceph-mon[35039]: pgmap v185: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-19T07:28:11.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:11 smithi162 ceph-mon[35726]: pgmap v186: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T07:28:11.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:11 smithi098 ceph-mon[30950]: pgmap v186: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T07:28:11.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:11 smithi139 ceph-mon[35039]: pgmap v186: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-19T07:28:13.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:13 smithi162 ceph-mon[35726]: pgmap v187: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T07:28:13.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:13 smithi098 ceph-mon[30950]: pgmap v187: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T07:28:13.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:13 smithi139 ceph-mon[35039]: pgmap v187: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T07:28:15.385 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:15 smithi162 ceph-mon[35726]: pgmap v188: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T07:28:15.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:15 smithi098 ceph-mon[30950]: pgmap v188: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T07:28:15.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:15 smithi139 ceph-mon[35039]: pgmap v188: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-19T07:28:17.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:17 smithi162 ceph-mon[35726]: pgmap v189: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:28:17.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:17 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:28:17.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:17 smithi098 ceph-mon[30950]: pgmap v189: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:28:17.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:17 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:28:17.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:17 smithi139 ceph-mon[35039]: pgmap v189: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T07:28:17.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:17 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:28:18.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:18 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:28:18.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:18 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:28:18.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:18 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:28:18.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:18 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:28:18.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:18 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:28:18.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:18 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:28:18.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:18 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:28:18.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:18 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:28:18.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:18 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:28:19.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:19 smithi139 ceph-mon[35039]: pgmap v190: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:28:19.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:19 smithi162 ceph-mon[35726]: pgmap v190: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:28:19.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:19 smithi098 ceph-mon[30950]: pgmap v190: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T07:28:21.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:21 smithi139 ceph-mon[35039]: pgmap v191: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:21 smithi162 ceph-mon[35726]: pgmap v191: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T07:28:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:21 smithi098 ceph-mon[30950]: pgmap v191: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-19T07:28:23.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:23 smithi098 ceph-mon[30950]: pgmap v192: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:28:23.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:23 smithi139 ceph-mon[35039]: pgmap v192: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:28:23.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:23 smithi162 ceph-mon[35726]: pgmap v192: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:28:25.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:25 smithi139 ceph-mon[35039]: pgmap v193: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:25.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:25 smithi162 ceph-mon[35726]: pgmap v193: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:25.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:25 smithi098 ceph-mon[30950]: pgmap v193: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:27.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:27 smithi139 ceph-mon[35039]: pgmap v194: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:28:27.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:27 smithi162 ceph-mon[35726]: pgmap v194: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:28:27.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:27 smithi098 ceph-mon[30950]: pgmap v194: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:28:29.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:29 smithi162 ceph-mon[35726]: pgmap v195: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:29.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:29 smithi098 ceph-mon[30950]: pgmap v195: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:29.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:29 smithi139 ceph-mon[35039]: pgmap v195: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:31.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:31 smithi162 ceph-mon[35726]: pgmap v196: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:28:31.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:31 smithi098 ceph-mon[30950]: pgmap v196: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:28:31.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:31 smithi139 ceph-mon[35039]: pgmap v196: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:28:33.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:33 smithi162 ceph-mon[35726]: pgmap v197: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:28:33.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:33 smithi098 ceph-mon[30950]: pgmap v197: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:28:33.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:33 smithi139 ceph-mon[35039]: pgmap v197: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:28:35.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:35 smithi162 ceph-mon[35726]: pgmap v198: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:35.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:35 smithi098 ceph-mon[30950]: pgmap v198: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:35.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:35 smithi139 ceph-mon[35039]: pgmap v198: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:37.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:37 smithi162 ceph-mon[35726]: pgmap v199: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:28:37.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:37 smithi098 ceph-mon[30950]: pgmap v199: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:28:37.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:37 smithi139 ceph-mon[35039]: pgmap v199: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:28:39.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:39 smithi162 ceph-mon[35726]: pgmap v200: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:39.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:39 smithi098 ceph-mon[30950]: pgmap v200: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:39.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:39 smithi139 ceph-mon[35039]: pgmap v200: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:41.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:41 smithi162 ceph-mon[35726]: pgmap v201: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:28:41.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:41 smithi098 ceph-mon[30950]: pgmap v201: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:28:41.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:41 smithi139 ceph-mon[35039]: pgmap v201: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:28:43.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:43 smithi162 ceph-mon[35726]: pgmap v202: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:28:43.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:43 smithi098 ceph-mon[30950]: pgmap v202: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:28:43.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:43 smithi139 ceph-mon[35039]: pgmap v202: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:28:45.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:45 smithi162 ceph-mon[35726]: pgmap v203: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:45.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:45 smithi098 ceph-mon[30950]: pgmap v203: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:45.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:45 smithi139 ceph-mon[35039]: pgmap v203: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:47.632 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:47 smithi162 ceph-mon[35726]: pgmap v204: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:28:47.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:47 smithi098 ceph-mon[30950]: pgmap v204: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:28:47.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:47 smithi139 ceph-mon[35039]: pgmap v204: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:28:49.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:49 smithi162 ceph-mon[35726]: pgmap v205: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:49.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:49 smithi098 ceph-mon[30950]: pgmap v205: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:49.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:49 smithi139 ceph-mon[35039]: pgmap v205: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:28:51.619 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:51 smithi139 ceph-mon[35039]: pgmap v206: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T07:28:51.631 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:51 smithi162 ceph-mon[35726]: pgmap v206: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T07:28:51.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:51 smithi098 ceph-mon[30950]: pgmap v206: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T07:28:53.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:53 smithi098 ceph-mon[30950]: pgmap v207: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T07:28:53.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:53 smithi139 ceph-mon[35039]: pgmap v207: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T07:28:53.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:53 smithi162 ceph-mon[35726]: pgmap v207: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T07:28:55.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:55 smithi098 ceph-mon[30950]: pgmap v208: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T07:28:55.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:55 smithi139 ceph-mon[35039]: pgmap v208: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T07:28:55.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:55 smithi162 ceph-mon[35726]: pgmap v208: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T07:28:57.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:57 smithi098 ceph-mon[30950]: pgmap v209: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T07:28:57.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:57 smithi139 ceph-mon[35039]: pgmap v209: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T07:28:57.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:57 smithi162 ceph-mon[35726]: pgmap v209: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T07:28:59.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:28:59 smithi098 ceph-mon[30950]: pgmap v210: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T07:28:59.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:28:59 smithi139 ceph-mon[35039]: pgmap v210: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T07:28:59.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:28:59 smithi162 ceph-mon[35726]: pgmap v210: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-19T07:29:01.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:01 smithi139 ceph-mon[35039]: pgmap v211: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T07:29:01.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:01 smithi162 ceph-mon[35726]: pgmap v211: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T07:29:02.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:01 smithi098 ceph-mon[30950]: pgmap v211: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-19T07:29:03.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:03 smithi139 ceph-mon[35039]: pgmap v212: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:29:03.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:03 smithi162 ceph-mon[35726]: pgmap v212: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:29:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:03 smithi098 ceph-mon[30950]: pgmap v212: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:29:05.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:05 smithi139 ceph-mon[35039]: pgmap v213: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:05.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:05 smithi162 ceph-mon[35726]: pgmap v213: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:06.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:05 smithi098 ceph-mon[30950]: pgmap v213: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:07.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:07 smithi139 ceph-mon[35039]: pgmap v214: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T07:29:07.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:07 smithi139 ceph-mon[35039]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T07:29:07.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:07 smithi162 ceph-mon[35726]: pgmap v214: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T07:29:07.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:07 smithi162 ceph-mon[35726]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T07:29:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:07 smithi098 ceph-mon[30950]: pgmap v214: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T07:29:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:07 smithi098 ceph-mon[30950]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T07:29:09.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:09 smithi139 ceph-mon[35039]: pgmap v216: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:29:09.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:09 smithi162 ceph-mon[35726]: pgmap v216: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:29:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:09 smithi098 ceph-mon[30950]: pgmap v216: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:29:11.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:11 smithi139 ceph-mon[35039]: pgmap v217: 97 pgs: 97 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-09-19T07:29:11.825 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:11 smithi098 ceph-mon[30950]: pgmap v217: 97 pgs: 97 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-09-19T07:29:11.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:11 smithi162 ceph-mon[35726]: pgmap v217: 97 pgs: 97 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-09-19T07:29:13.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:13 smithi139 ceph-mon[35039]: pgmap v218: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:29:13.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:13 smithi162 ceph-mon[35726]: pgmap v218: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:29:14.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:13 smithi098 ceph-mon[30950]: pgmap v218: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:29:15.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:15 smithi139 ceph-mon[35039]: pgmap v219: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:29:15.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:15 smithi162 ceph-mon[35726]: pgmap v219: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:29:16.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:15 smithi098 ceph-mon[30950]: pgmap v219: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:29:17.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:17 smithi098 ceph-mon[30950]: pgmap v220: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:29:17.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:17 smithi098 ceph-mon[30950]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T07:29:17.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:17 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:29:17.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:17 smithi139 ceph-mon[35039]: pgmap v220: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:29:17.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:17 smithi139 ceph-mon[35039]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T07:29:17.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:17 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:29:17.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:17 smithi162 ceph-mon[35726]: pgmap v220: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:29:17.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:17 smithi162 ceph-mon[35726]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T07:29:17.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:17 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:29:18.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:18 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:29:18.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:18 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:29:18.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:18 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:29:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:18 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:29:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:18 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:29:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:18 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:29:18.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:18 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:29:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:18 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:29:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:18 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:29:20.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:19 smithi162 ceph-mon[35726]: pgmap v222: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:29:20.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:19 smithi098 ceph-mon[30950]: pgmap v222: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:29:20.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:19 smithi139 ceph-mon[35039]: pgmap v222: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:29:22.119 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:21 smithi139 ceph-mon[35039]: pgmap v223: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:29:22.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:21 smithi162 ceph-mon[35726]: pgmap v223: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:29:22.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:21 smithi098 ceph-mon[30950]: pgmap v223: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:29:23.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:22 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:29:23.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:22 smithi162 ceph-mon[35726]: pgmap v224: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:29:23.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:22 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:29:23.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:22 smithi098 ceph-mon[30950]: pgmap v224: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:29:23.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:22 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:29:23.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:22 smithi139 ceph-mon[35039]: pgmap v224: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:29:25.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:24 smithi098 ceph-mon[30950]: pgmap v225: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:29:25.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:24 smithi139 ceph-mon[35039]: pgmap v225: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:29:25.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:24 smithi162 ceph-mon[35726]: pgmap v225: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:29:27.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:26 smithi098 ceph-mon[30950]: pgmap v226: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T07:29:27.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:26 smithi139 ceph-mon[35039]: pgmap v226: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T07:29:27.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:26 smithi162 ceph-mon[35726]: pgmap v226: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T07:29:29.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:28 smithi098 ceph-mon[30950]: pgmap v227: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T07:29:29.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:28 smithi139 ceph-mon[35039]: pgmap v227: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T07:29:29.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:28 smithi162 ceph-mon[35726]: pgmap v227: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T07:29:31.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:30 smithi098 ceph-mon[30950]: pgmap v228: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:29:31.276 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:30 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:29:31.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:30 smithi139 ceph-mon[35039]: pgmap v228: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:29:31.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:30 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:29:31.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:30 smithi162 ceph-mon[35726]: pgmap v228: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:29:31.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:30 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:29:33.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:32 smithi098 ceph-mon[30950]: pgmap v229: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:29:33.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:32 smithi139 ceph-mon[35039]: pgmap v229: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:29:33.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:32 smithi162 ceph-mon[35726]: pgmap v229: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:29:35.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:34 smithi098 ceph-mon[30950]: pgmap v230: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:35.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:34 smithi139 ceph-mon[35039]: pgmap v230: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:35.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:34 smithi162 ceph-mon[35726]: pgmap v230: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:37.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:36 smithi098 ceph-mon[30950]: pgmap v231: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:29:37.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:36 smithi139 ceph-mon[35039]: pgmap v231: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:29:37.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:36 smithi162 ceph-mon[35726]: pgmap v231: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:29:38.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:37 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:29:38.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:37 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:29:38.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:37 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:29:39.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:38 smithi098 ceph-mon[30950]: pgmap v232: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:39.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:38 smithi139 ceph-mon[35039]: pgmap v232: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:39.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:38 smithi162 ceph-mon[35726]: pgmap v232: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:41.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:40 smithi098 ceph-mon[30950]: pgmap v233: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:29:41.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:40 smithi139 ceph-mon[35039]: pgmap v233: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:29:41.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:40 smithi162 ceph-mon[35726]: pgmap v233: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:29:43.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:42 smithi098 ceph-mon[30950]: pgmap v234: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:29:43.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:42 smithi139 ceph-mon[35039]: pgmap v234: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:29:43.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:42 smithi162 ceph-mon[35726]: pgmap v234: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:29:45.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:44 smithi098 ceph-mon[30950]: pgmap v235: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:45.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:44 smithi139 ceph-mon[35039]: pgmap v235: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:45.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:44 smithi162 ceph-mon[35726]: pgmap v235: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:47.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:46 smithi098 ceph-mon[30950]: pgmap v236: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:29:47.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:46 smithi139 ceph-mon[35039]: pgmap v236: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:29:47.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:46 smithi162 ceph-mon[35726]: pgmap v236: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:29:49.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:48 smithi098 ceph-mon[30950]: pgmap v237: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:49.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:48 smithi139 ceph-mon[35039]: pgmap v237: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:49.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:48 smithi162 ceph-mon[35726]: pgmap v237: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:51.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:50 smithi098 ceph-mon[30950]: pgmap v238: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:29:51.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:50 smithi139 ceph-mon[35039]: pgmap v238: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:29:51.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:50 smithi162 ceph-mon[35726]: pgmap v238: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:29:53.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:52 smithi098 ceph-mon[30950]: pgmap v239: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:29:53.322 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:52 smithi139 ceph-mon[35039]: pgmap v239: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:29:53.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:52 smithi162 ceph-mon[35726]: pgmap v239: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:29:55.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:54 smithi098 ceph-mon[30950]: pgmap v240: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:55.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:54 smithi139 ceph-mon[35039]: pgmap v240: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:55.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:54 smithi162 ceph-mon[35726]: pgmap v240: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:57.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:56 smithi098 ceph-mon[30950]: pgmap v241: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:29:57.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:56 smithi139 ceph-mon[35039]: pgmap v241: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:29:57.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:56 smithi162 ceph-mon[35726]: pgmap v241: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:29:59.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:29:59 smithi098 ceph-mon[30950]: pgmap v242: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:59.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:29:59 smithi139 ceph-mon[35039]: pgmap v242: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:29:59.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:29:59 smithi162 ceph-mon[35726]: pgmap v242: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:00.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a[30946]: 2024-09-19T07:29:59.999+0000 7efcdf868640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T07:30:00.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a[30946]: 2024-09-19T07:29:59.999+0000 7efcdf868640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T07:30:00.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a[30946]: 2024-09-19T07:29:59.999+0000 7efcdf868640 -1 log_channel(cluster) log [ERR] : mds.i(mds.2): Metadata damage detected 2024-09-19T07:30:00.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a[30946]: 2024-09-19T07:29:59.999+0000 7efcdf868640 -1 log_channel(cluster) log [ERR] : mds.h(mds.1): Metadata damage detected 2024-09-19T07:30:00.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:00 smithi098 ceph-mon[30950]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T07:30:00.273 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:00 smithi098 ceph-mon[30950]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T07:30:00.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:00 smithi098 ceph-mon[30950]: mds.i(mds.2): Metadata damage detected 2024-09-19T07:30:00.274 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:00 smithi098 ceph-mon[30950]: mds.h(mds.1): Metadata damage detected 2024-09-19T07:30:00.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:00 smithi139 ceph-mon[35039]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T07:30:00.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:00 smithi139 ceph-mon[35039]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T07:30:00.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:00 smithi139 ceph-mon[35039]: mds.i(mds.2): Metadata damage detected 2024-09-19T07:30:00.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:00 smithi139 ceph-mon[35039]: mds.h(mds.1): Metadata damage detected 2024-09-19T07:30:00.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:00 smithi162 ceph-mon[35726]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T07:30:00.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:00 smithi162 ceph-mon[35726]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T07:30:00.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:00 smithi162 ceph-mon[35726]: mds.i(mds.2): Metadata damage detected 2024-09-19T07:30:00.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:00 smithi162 ceph-mon[35726]: mds.h(mds.1): Metadata damage detected 2024-09-19T07:30:01.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:01 smithi139 ceph-mon[35039]: pgmap v243: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:30:01.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:01 smithi162 ceph-mon[35726]: pgmap v243: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:30:01.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:01 smithi098 ceph-mon[30950]: pgmap v243: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:30:03.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:03 smithi139 ceph-mon[35039]: pgmap v244: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:30:03.317 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:03 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:30:03.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:03 smithi162 ceph-mon[35726]: pgmap v244: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:30:03.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:03 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:30:03.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:03 smithi098 ceph-mon[30950]: pgmap v244: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:30:03.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:03 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:30:05.316 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:05 smithi139 ceph-mon[35039]: pgmap v245: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:05.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:05 smithi162 ceph-mon[35726]: pgmap v245: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:05.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:05 smithi098 ceph-mon[30950]: pgmap v245: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:07.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:07 smithi162 ceph-mon[35726]: pgmap v246: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T07:30:07.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:07 smithi098 ceph-mon[30950]: pgmap v246: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T07:30:07.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:07 smithi139 ceph-mon[35039]: pgmap v246: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T07:30:08.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:08 smithi162 ceph-mon[35726]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T07:30:08.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:08 smithi098 ceph-mon[30950]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T07:30:08.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:08 smithi139 ceph-mon[35039]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T07:30:09.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:09 smithi162 ceph-mon[35726]: pgmap v248: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:30:09.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:09 smithi098 ceph-mon[30950]: pgmap v248: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:30:09.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:09 smithi139 ceph-mon[35039]: pgmap v248: 97 pgs: 97 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:30:11.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:11 smithi162 ceph-mon[35726]: pgmap v249: 97 pgs: 97 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:30:11.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:11 smithi098 ceph-mon[30950]: pgmap v249: 97 pgs: 97 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:30:11.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:11 smithi139 ceph-mon[35039]: pgmap v249: 97 pgs: 97 active+clean; 1.8 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:30:13.382 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:13 smithi162 ceph-mon[35726]: pgmap v250: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:30:13.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:13 smithi098 ceph-mon[30950]: pgmap v250: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:30:13.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:13 smithi139 ceph-mon[35039]: pgmap v250: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:30:15.381 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:15 smithi162 ceph-mon[35726]: pgmap v251: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:30:15.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:15 smithi098 ceph-mon[30950]: pgmap v251: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:30:15.566 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:15 smithi139 ceph-mon[35039]: pgmap v251: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T07:30:17.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:17 smithi139 ceph-mon[35039]: pgmap v252: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:30:17.884 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:17 smithi139 ceph-mon[35039]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T07:30:17.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:17 smithi162 ceph-mon[35726]: pgmap v252: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:30:17.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:17 smithi162 ceph-mon[35726]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T07:30:18.022 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:17 smithi098 ceph-mon[30950]: pgmap v252: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:30:18.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:17 smithi098 ceph-mon[30950]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T07:30:18.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:18 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:30:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:18 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:30:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:18 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:30:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:18 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:30:18.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:18 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:30:18.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:18 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:30:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:18 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:30:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:18 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:30:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:18 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:30:18.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:18 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:30:19.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:18 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:30:19.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:18 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:30:19.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:18 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:30:19.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:18 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:30:19.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:18 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:30:19.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:19 smithi139 ceph-mon[35039]: pgmap v254: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:30:19.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:19 smithi162 ceph-mon[35726]: pgmap v254: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:30:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:19 smithi098 ceph-mon[30950]: pgmap v254: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:30:21.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:21 smithi139 ceph-mon[35039]: pgmap v255: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:30:21.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:21 smithi162 ceph-mon[35726]: pgmap v255: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:30:22.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:21 smithi098 ceph-mon[30950]: pgmap v255: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:30:23.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:23 smithi139 ceph-mon[35039]: pgmap v256: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:30:23.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:23 smithi162 ceph-mon[35726]: pgmap v256: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:30:24.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:23 smithi098 ceph-mon[30950]: pgmap v256: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:30:25.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:25 smithi139 ceph-mon[35039]: pgmap v257: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:30:25.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:25 smithi162 ceph-mon[35726]: pgmap v257: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:30:26.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:25 smithi098 ceph-mon[30950]: pgmap v257: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:30:27.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:27 smithi139 ceph-mon[35039]: pgmap v258: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T07:30:27.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:27 smithi162 ceph-mon[35726]: pgmap v258: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T07:30:28.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:27 smithi098 ceph-mon[30950]: pgmap v258: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T07:30:29.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:29 smithi139 ceph-mon[35039]: pgmap v259: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T07:30:29.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:29 smithi162 ceph-mon[35726]: pgmap v259: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T07:30:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:29 smithi098 ceph-mon[30950]: pgmap v259: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T07:30:30.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:30 smithi162 ceph-mon[35726]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:30:31.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:30 smithi098 ceph-mon[30950]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:30:31.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:30 smithi139 ceph-mon[35039]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T07:30:31.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:31 smithi162 ceph-mon[35726]: pgmap v260: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:30:32.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:31 smithi098 ceph-mon[30950]: pgmap v260: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:30:32.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:31 smithi139 ceph-mon[35039]: pgmap v260: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:30:33.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:33 smithi162 ceph-mon[35726]: pgmap v261: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:30:34.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:33 smithi098 ceph-mon[30950]: pgmap v261: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:30:34.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:33 smithi139 ceph-mon[35039]: pgmap v261: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:30:35.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:35 smithi162 ceph-mon[35726]: pgmap v262: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:36.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:35 smithi098 ceph-mon[30950]: pgmap v262: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:36.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:35 smithi139 ceph-mon[35039]: pgmap v262: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:37.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:37 smithi162 ceph-mon[35726]: pgmap v263: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:30:38.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:37 smithi098 ceph-mon[30950]: pgmap v263: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:30:38.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:37 smithi139 ceph-mon[35039]: pgmap v263: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:30:39.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:39 smithi162 ceph-mon[35726]: pgmap v264: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:40.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:39 smithi098 ceph-mon[30950]: pgmap v264: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:40.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:39 smithi139 ceph-mon[35039]: pgmap v264: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:41.885 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:41 smithi162 ceph-mon[35726]: pgmap v265: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:30:42.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:41 smithi098 ceph-mon[30950]: pgmap v265: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:30:42.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:41 smithi139 ceph-mon[35039]: pgmap v265: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:30:43.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:43 smithi162 ceph-mon[35726]: pgmap v266: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:30:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:43 smithi098 ceph-mon[30950]: pgmap v266: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:30:44.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:43 smithi139 ceph-mon[35039]: pgmap v266: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:30:45.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:45 smithi162 ceph-mon[35726]: pgmap v267: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:45 smithi098 ceph-mon[30950]: pgmap v267: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:46.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:45 smithi139 ceph-mon[35039]: pgmap v267: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:47.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:47 smithi162 ceph-mon[35726]: pgmap v268: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:30:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:47 smithi098 ceph-mon[30950]: pgmap v268: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:30:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:47 smithi139 ceph-mon[35039]: pgmap v268: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:30:49.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:49 smithi162 ceph-mon[35726]: pgmap v269: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:49 smithi098 ceph-mon[30950]: pgmap v269: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:50.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:49 smithi139 ceph-mon[35039]: pgmap v269: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:51.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:51 smithi162 ceph-mon[35726]: pgmap v270: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:30:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:51 smithi098 ceph-mon[30950]: pgmap v270: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:30:52.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:51 smithi139 ceph-mon[35039]: pgmap v270: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:30:53.868 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:53 smithi139 ceph-mon[35039]: pgmap v271: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:30:53.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:53 smithi162 ceph-mon[35726]: pgmap v271: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:30:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:53 smithi098 ceph-mon[30950]: pgmap v271: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:30:55.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:55 smithi162 ceph-mon[35726]: pgmap v272: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:56.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:55 smithi098 ceph-mon[30950]: pgmap v272: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:56.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:55 smithi139 ceph-mon[35039]: pgmap v272: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:30:57.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:57 smithi162 ceph-mon[35726]: pgmap v273: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:30:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:57 smithi098 ceph-mon[30950]: pgmap v273: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:30:58.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:57 smithi139 ceph-mon[35039]: pgmap v273: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:30:59.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:30:59 smithi162 ceph-mon[35726]: pgmap v274: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:00.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:30:59 smithi098 ceph-mon[30950]: pgmap v274: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:00.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:30:59 smithi139 ceph-mon[35039]: pgmap v274: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:01.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:01 smithi162 ceph-mon[35726]: pgmap v275: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:31:02.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:01 smithi098 ceph-mon[30950]: pgmap v275: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:31:02.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:01 smithi139 ceph-mon[35039]: pgmap v275: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:31:03.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:03 smithi162 ceph-mon[35726]: pgmap v276: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:31:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:03 smithi098 ceph-mon[30950]: pgmap v276: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:31:04.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:03 smithi139 ceph-mon[35039]: pgmap v276: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:31:05.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:05 smithi162 ceph-mon[35726]: pgmap v277: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:06.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:05 smithi098 ceph-mon[30950]: pgmap v277: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:06.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:05 smithi139 ceph-mon[35039]: pgmap v277: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:07 smithi098 ceph-mon[30950]: pgmap v278: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T07:31:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:07 smithi098 ceph-mon[30950]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T07:31:08.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:07 smithi139 ceph-mon[35039]: pgmap v278: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T07:31:08.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:07 smithi139 ceph-mon[35039]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T07:31:08.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:07 smithi162 ceph-mon[35726]: pgmap v278: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T07:31:08.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:07 smithi162 ceph-mon[35726]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T07:31:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:09 smithi098 ceph-mon[30950]: pgmap v280: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:31:10.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:09 smithi139 ceph-mon[35039]: pgmap v280: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:31:10.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:09 smithi162 ceph-mon[35726]: pgmap v280: 97 pgs: 97 active+clean; 1.8 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:31:12.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:11 smithi098 ceph-mon[30950]: pgmap v281: 97 pgs: 97 active+clean; 449 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:31:12.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:11 smithi139 ceph-mon[35039]: pgmap v281: 97 pgs: 97 active+clean; 449 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:31:12.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:11 smithi162 ceph-mon[35726]: pgmap v281: 97 pgs: 97 active+clean; 449 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:31:14.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:13 smithi098 ceph-mon[30950]: pgmap v282: 97 pgs: 97 active+clean; 395 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:31:14.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:13 smithi139 ceph-mon[35039]: pgmap v282: 97 pgs: 97 active+clean; 395 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:31:14.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:13 smithi162 ceph-mon[35726]: pgmap v282: 97 pgs: 97 active+clean; 395 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:31:16.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:15 smithi098 ceph-mon[30950]: pgmap v283: 97 pgs: 97 active+clean; 395 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:31:16.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:15 smithi139 ceph-mon[35039]: pgmap v283: 97 pgs: 97 active+clean; 395 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:31:16.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:15 smithi162 ceph-mon[35726]: pgmap v283: 97 pgs: 97 active+clean; 395 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:31:17.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:17 smithi139 ceph-mon[35039]: pgmap v284: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:31:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:17 smithi139 ceph-mon[35039]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T07:31:17.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:17 smithi162 ceph-mon[35726]: pgmap v284: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:31:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:17 smithi162 ceph-mon[35726]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T07:31:18.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:17 smithi098 ceph-mon[30950]: pgmap v284: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:31:18.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:17 smithi098 ceph-mon[30950]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T07:31:18.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:18 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:31:18.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:18 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:31:19.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:18 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:31:19.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:19 smithi139 ceph-mon[35039]: pgmap v286: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:31:19.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:19 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:31:19.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:19 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:31:19.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:19 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:31:19.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:19 smithi162 ceph-mon[35726]: pgmap v286: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:31:19.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:19 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:31:19.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:19 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:31:19.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:19 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:31:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:19 smithi098 ceph-mon[30950]: pgmap v286: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:31:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:19 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:31:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:19 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:31:20.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:19 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:31:21.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:21 smithi139 ceph-mon[35039]: pgmap v287: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:31:21.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:21 smithi162 ceph-mon[35726]: pgmap v287: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:31:22.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:21 smithi098 ceph-mon[30950]: pgmap v287: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:31:23.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:23 smithi139 ceph-mon[35039]: pgmap v288: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:31:23.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:23 smithi162 ceph-mon[35726]: pgmap v288: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:31:24.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:23 smithi098 ceph-mon[30950]: pgmap v288: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:31:25.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:25 smithi139 ceph-mon[35039]: pgmap v289: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:31:25.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:25 smithi162 ceph-mon[35726]: pgmap v289: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:31:26.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:25 smithi098 ceph-mon[30950]: pgmap v289: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T07:31:27.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:27 smithi139 ceph-mon[35039]: pgmap v290: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T07:31:27.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:27 smithi162 ceph-mon[35726]: pgmap v290: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T07:31:28.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:27 smithi098 ceph-mon[30950]: pgmap v290: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T07:31:29.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:29 smithi162 ceph-mon[35726]: pgmap v291: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T07:31:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:29 smithi098 ceph-mon[30950]: pgmap v291: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T07:31:30.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:29 smithi139 ceph-mon[35039]: pgmap v291: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T07:31:31.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:31 smithi162 ceph-mon[35726]: pgmap v292: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:31:32.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:31 smithi098 ceph-mon[30950]: pgmap v292: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:31:32.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:31 smithi139 ceph-mon[35039]: pgmap v292: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:31:33.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:33 smithi162 ceph-mon[35726]: pgmap v293: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:31:34.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:33 smithi098 ceph-mon[30950]: pgmap v293: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:31:34.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:33 smithi139 ceph-mon[35039]: pgmap v293: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:31:35.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:35 smithi139 ceph-mon[35039]: pgmap v294: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:35.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:35 smithi162 ceph-mon[35726]: pgmap v294: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:36.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:35 smithi098 ceph-mon[30950]: pgmap v294: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:37.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:37 smithi162 ceph-mon[35726]: pgmap v295: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:31:38.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:37 smithi098 ceph-mon[30950]: pgmap v295: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:31:38.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:37 smithi139 ceph-mon[35039]: pgmap v295: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:31:39.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:39 smithi162 ceph-mon[35726]: pgmap v296: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:40.025 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:39 smithi098 ceph-mon[30950]: pgmap v296: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:40.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:39 smithi139 ceph-mon[35039]: pgmap v296: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:41.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:41 smithi162 ceph-mon[35726]: pgmap v297: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:31:42.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:41 smithi098 ceph-mon[30950]: pgmap v297: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:31:42.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:41 smithi139 ceph-mon[35039]: pgmap v297: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:31:43.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:43 smithi162 ceph-mon[35726]: pgmap v298: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:31:44.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:43 smithi098 ceph-mon[30950]: pgmap v298: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:31:44.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:43 smithi139 ceph-mon[35039]: pgmap v298: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:31:45.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:45 smithi162 ceph-mon[35726]: pgmap v299: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:46.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:45 smithi098 ceph-mon[30950]: pgmap v299: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:46.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:45 smithi139 ceph-mon[35039]: pgmap v299: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:47.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:47 smithi162 ceph-mon[35726]: pgmap v300: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:31:48.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:47 smithi098 ceph-mon[30950]: pgmap v300: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:31:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:47 smithi139 ceph-mon[35039]: pgmap v300: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:31:49.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:49 smithi162 ceph-mon[35726]: pgmap v301: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:49 smithi098 ceph-mon[30950]: pgmap v301: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:50.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:49 smithi139 ceph-mon[35039]: pgmap v301: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:51.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:51 smithi162 ceph-mon[35726]: pgmap v302: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:31:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:51 smithi098 ceph-mon[30950]: pgmap v302: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:31:52.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:51 smithi139 ceph-mon[35039]: pgmap v302: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:31:53.869 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:53 smithi139 ceph-mon[35039]: pgmap v303: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:31:53.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:53 smithi162 ceph-mon[35726]: pgmap v303: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:31:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:53 smithi098 ceph-mon[30950]: pgmap v303: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:31:55.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:55 smithi162 ceph-mon[35726]: pgmap v304: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:56.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:55 smithi098 ceph-mon[30950]: pgmap v304: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:56.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:55 smithi139 ceph-mon[35039]: pgmap v304: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:31:57.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:57 smithi162 ceph-mon[35726]: pgmap v305: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:31:58.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:57 smithi098 ceph-mon[30950]: pgmap v305: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:31:58.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:57 smithi139 ceph-mon[35039]: pgmap v305: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:31:59.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:31:59 smithi162 ceph-mon[35726]: pgmap v306: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:32:00.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:31:59 smithi098 ceph-mon[30950]: pgmap v306: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:32:00.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:31:59 smithi139 ceph-mon[35039]: pgmap v306: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:32:01.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:01 smithi162 ceph-mon[35726]: pgmap v307: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:32:02.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:01 smithi098 ceph-mon[30950]: pgmap v307: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:32:02.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:01 smithi139 ceph-mon[35039]: pgmap v307: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:32:03.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:03 smithi162 ceph-mon[35726]: pgmap v308: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:32:04.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:03 smithi098 ceph-mon[30950]: pgmap v308: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:32:04.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:03 smithi139 ceph-mon[35039]: pgmap v308: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:32:05.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:05 smithi162 ceph-mon[35726]: pgmap v309: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:32:06.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:05 smithi098 ceph-mon[30950]: pgmap v309: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:32:06.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:05 smithi139 ceph-mon[35039]: pgmap v309: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:32:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:07 smithi098 ceph-mon[30950]: pgmap v310: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T07:32:08.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:07 smithi098 ceph-mon[30950]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T07:32:08.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:07 smithi139 ceph-mon[35039]: pgmap v310: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T07:32:08.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:07 smithi139 ceph-mon[35039]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T07:32:08.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:07 smithi162 ceph-mon[35726]: pgmap v310: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T07:32:08.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:07 smithi162 ceph-mon[35726]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T07:32:10.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:09 smithi098 ceph-mon[30950]: pgmap v312: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:32:10.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:09 smithi139 ceph-mon[35039]: pgmap v312: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:32:10.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:09 smithi162 ceph-mon[35726]: pgmap v312: 97 pgs: 97 active+clean; 395 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:32:12.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:11 smithi098 ceph-mon[30950]: pgmap v313: 97 pgs: 97 active+clean; 84 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:32:12.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:11 smithi139 ceph-mon[35039]: pgmap v313: 97 pgs: 97 active+clean; 84 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:32:12.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:11 smithi162 ceph-mon[35726]: pgmap v313: 97 pgs: 97 active+clean; 84 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:32:14.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:13 smithi098 ceph-mon[30950]: pgmap v314: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:32:14.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:13 smithi139 ceph-mon[35039]: pgmap v314: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:32:14.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:13 smithi162 ceph-mon[35726]: pgmap v314: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:32:15.755 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T07:32:15.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.868+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/1714265793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0bc102c80 msgr2=0x7fe0bc103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:15.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.868+0000 7fe0c3ce4640 1 --2- 172.21.15.98:0/1714265793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0bc102c80 0x7fe0bc103060 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009ca0 tx=0x7fe0ac02a950 comp rx=0 tx=0).stop 2024-09-19T07:32:15.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.868+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/1714265793 shutdown_connections 2024-09-19T07:32:15.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.868+0000 7fe0c3ce4640 1 --2- 172.21.15.98:0/1714265793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0bc10c0d0 0x7fe0bc10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:15.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.868+0000 7fe0c3ce4640 1 --2- 172.21.15.98:0/1714265793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0bc1035a0 0x7fe0bc10ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:15.872 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.868+0000 7fe0c3ce4640 1 --2- 172.21.15.98:0/1714265793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0bc102c80 0x7fe0bc103060 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:15.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.868+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/1714265793 >> 172.21.15.98:0/1714265793 conn(0x7fe0bc077990 msgr2=0x7fe0bc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:15.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.868+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/1714265793 shutdown_connections 2024-09-19T07:32:15.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.868+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/1714265793 wait complete. 2024-09-19T07:32:15.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c3ce4640 1 Processor -- start 2024-09-19T07:32:15.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c3ce4640 1 -- start start 2024-09-19T07:32:15.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c3ce4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0bc102c80 0x7fe0bc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:15.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c3ce4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0bc1035a0 0x7fe0bc1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:15.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c3ce4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0bc10c0d0 0x7fe0bc19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:15.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c3ce4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc111ef0 con 0x7fe0bc102c80 2024-09-19T07:32:15.873 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c3ce4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc111d70 con 0x7fe0bc10c0d0 2024-09-19T07:32:15.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c3ce4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc112070 con 0x7fe0bc1035a0 2024-09-19T07:32:15.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c1a80640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0bc102c80 0x7fe0bc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:15.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c1a80640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0bc102c80 0x7fe0bc198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46940/0 (socket says 172.21.15.98:46940) 2024-09-19T07:32:15.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c1a80640 1 -- 172.21.15.98:0/3250451237 learned_addr learned my addr 172.21.15.98:0/3250451237 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:15.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c2281640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0bc10c0d0 0x7fe0bc19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:15.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c127f640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0bc1035a0 0x7fe0bc1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:15.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c1a80640 1 -- 172.21.15.98:0/3250451237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0bc1035a0 msgr2=0x7fe0bc1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:15.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c1a80640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0bc1035a0 0x7fe0bc1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:15.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c1a80640 1 -- 172.21.15.98:0/3250451237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0bc10c0d0 msgr2=0x7fe0bc19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:15.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c1a80640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0bc10c0d0 0x7fe0bc19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:15.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c1a80640 1 -- 172.21.15.98:0/3250451237 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0bc19d350 con 0x7fe0bc102c80 2024-09-19T07:32:15.874 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c2281640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0bc10c0d0 0x7fe0bc19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:32:15.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.869+0000 7fe0c1a80640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0bc102c80 0x7fe0bc198360 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac005cc0 tx=0x7fe0ac02f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:15.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.870+0000 7fe0baffd640 1 -- 172.21.15.98:0/3250451237 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac034040 con 0x7fe0bc102c80 2024-09-19T07:32:15.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.870+0000 7fe0baffd640 1 -- 172.21.15.98:0/3250451237 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0ac003e40 con 0x7fe0bc102c80 2024-09-19T07:32:15.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.870+0000 7fe0baffd640 1 -- 172.21.15.98:0/3250451237 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac045480 con 0x7fe0bc102c80 2024-09-19T07:32:15.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.870+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/3250451237 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0bc19d5e0 con 0x7fe0bc102c80 2024-09-19T07:32:15.875 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.870+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/3250451237 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0bc1a4ed0 con 0x7fe0bc102c80 2024-09-19T07:32:15.876 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.871+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/3250451237 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0bc103060 con 0x7fe0bc102c80 2024-09-19T07:32:15.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.872+0000 7fe0baffd640 1 -- 172.21.15.98:0/3250451237 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe0ac037020 con 0x7fe0bc102c80 2024-09-19T07:32:15.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.873+0000 7fe0baffd640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fe0a40a3460 0x7fe0a40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:15.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.873+0000 7fe0c127f640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fe0a40a3460 0x7fe0a40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:15.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.873+0000 7fe0baffd640 1 -- 172.21.15.98:0/3250451237 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8658+0+0 (secure 0 0 0) 0x7fe0ac0f0f60 con 0x7fe0bc102c80 2024-09-19T07:32:15.877 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.873+0000 7fe0c127f640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fe0a40a3460 0x7fe0a40a5920 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0fe130 tx=0x7fe0b0008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:15.878 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:15.877+0000 7fe0baffd640 1 -- 172.21.15.98:0/3250451237 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe0ac0bd9c0 con 0x7fe0bc102c80 2024-09-19T07:32:16.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:15 smithi098 ceph-mon[30950]: pgmap v315: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:32:16.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:15 smithi139 ceph-mon[35039]: pgmap v315: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:32:16.068 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.067+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/3250451237 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fe0bc0fee70 con 0x7fe0a40a3460 2024-09-19T07:32:16.076 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.075+0000 7fe0baffd640 1 -- 172.21.15.98:0/3250451237 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fe0bc0fee70 con 0x7fe0a40a3460 2024-09-19T07:32:16.077 INFO:teuthology.orchestra.run.smithi098.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T07:22:13", "first": "2024-09-19T07:23:00", "last": "2024-09-19T07:32:00", "last_pruned": "2024-09-19T07:32:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-19T07:32:16.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.077+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/3250451237 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fe0a40a3460 msgr2=0x7fe0a40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.077+0000 7fe0c3ce4640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fe0a40a3460 0x7fe0a40a5920 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0fe130 tx=0x7fe0b0008040 comp rx=0 tx=0).stop 2024-09-19T07:32:16.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.077+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/3250451237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0bc102c80 msgr2=0x7fe0bc198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.077+0000 7fe0c3ce4640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0bc102c80 0x7fe0bc198360 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac005cc0 tx=0x7fe0ac02f770 comp rx=0 tx=0).stop 2024-09-19T07:32:16.080 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.078+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/3250451237 shutdown_connections 2024-09-19T07:32:16.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.078+0000 7fe0c3ce4640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fe0a40a3460 0x7fe0a40a5920 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.078+0000 7fe0c3ce4640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe0bc10c0d0 0x7fe0bc19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.078+0000 7fe0c3ce4640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0bc1035a0 0x7fe0bc1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.078+0000 7fe0c3ce4640 1 --2- 172.21.15.98:0/3250451237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe0bc102c80 0x7fe0bc198360 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.081 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.078+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/3250451237 >> 172.21.15.98:0/3250451237 conn(0x7fe0bc077990 msgr2=0x7fe0bc0fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:16.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.078+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/3250451237 shutdown_connections 2024-09-19T07:32:16.082 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.078+0000 7fe0c3ce4640 1 -- 172.21.15.98:0/3250451237 wait complete. 2024-09-19T07:32:16.089 DEBUG:teuthology.orchestra.run.smithi098:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T07:32:16.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:15 smithi162 ceph-mon[35726]: pgmap v315: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T07:32:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.189+0000 7f68f596d640 1 -- 172.21.15.98:0/1494294361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68f01009d0 msgr2=0x7f68f0100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.189+0000 7f68f596d640 1 --2- 172.21.15.98:0/1494294361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68f01009d0 0x7f68f0100e30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009930 tx=0x7f68e402a420 comp rx=0 tx=0).stop 2024-09-19T07:32:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.189+0000 7f68f596d640 1 -- 172.21.15.98:0/1494294361 shutdown_connections 2024-09-19T07:32:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.189+0000 7f68f596d640 1 --2- 172.21.15.98:0/1494294361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68f0101370 0x7f68f010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.189+0000 7f68f596d640 1 --2- 172.21.15.98:0/1494294361 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68f01009d0 0x7f68f0100e30 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.193 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.189+0000 7f68f596d640 1 --2- 172.21.15.98:0/1494294361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68f01069e0 0x7f68f0106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.189+0000 7f68f596d640 1 -- 172.21.15.98:0/1494294361 >> 172.21.15.98:0/1494294361 conn(0x7f68f00fc6f0 msgr2=0x7f68f00feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.189+0000 7f68f596d640 1 -- 172.21.15.98:0/1494294361 shutdown_connections 2024-09-19T07:32:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.189+0000 7f68f596d640 1 -- 172.21.15.98:0/1494294361 wait complete. 2024-09-19T07:32:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.189+0000 7f68f596d640 1 Processor -- start 2024-09-19T07:32:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68f596d640 1 -- start start 2024-09-19T07:32:16.194 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68f596d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68f01009d0 0x7f68f0199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68f596d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68f0101370 0x7f68f0199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68f596d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68f01069e0 0x7f68f01a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68f596d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f68f0110e20 con 0x7f68f01069e0 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68f596d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f68f0110ca0 con 0x7f68f0101370 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68f596d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68f0110fa0 con 0x7f68f01009d0 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68ef7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68f01069e0 0x7f68f01a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68ef7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68f01069e0 0x7f68f01a4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46956/0 (socket says 172.21.15.98:46956) 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68ef7fe640 1 -- 172.21.15.98:0/1114869973 learned_addr learned my addr 172.21.15.98:0/1114869973 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68ee7fc640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68f0101370 0x7f68f0199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68eeffd640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68f01009d0 0x7f68f0199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68ef7fe640 1 -- 172.21.15.98:0/1114869973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68f01009d0 msgr2=0x7f68f0199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68ef7fe640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68f01009d0 0x7f68f0199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.195 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68ef7fe640 1 -- 172.21.15.98:0/1114869973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68f0101370 msgr2=0x7f68f0199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68ef7fe640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68f0101370 0x7f68f0199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68ef7fe640 1 -- 172.21.15.98:0/1114869973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f01a47d0 con 0x7f68f01069e0 2024-09-19T07:32:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68ef7fe640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68f01069e0 0x7f68f01a4290 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f68e800eaa0 tx=0x7f68e800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.190+0000 7f68f496b640 1 -- 172.21.15.98:0/1114869973 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e800cdb0 con 0x7f68f01069e0 2024-09-19T07:32:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.191+0000 7f68f496b640 1 -- 172.21.15.98:0/1114869973 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68e8005020 con 0x7f68f01069e0 2024-09-19T07:32:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.191+0000 7f68f496b640 1 -- 172.21.15.98:0/1114869973 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e80116b0 con 0x7f68f01069e0 2024-09-19T07:32:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.191+0000 7f68f596d640 1 -- 172.21.15.98:0/1114869973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f01a49a0 con 0x7f68f01069e0 2024-09-19T07:32:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.191+0000 7f68f596d640 1 -- 172.21.15.98:0/1114869973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f01a4e70 con 0x7f68f01069e0 2024-09-19T07:32:16.196 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.192+0000 7f68f596d640 1 -- 172.21.15.98:0/1114869973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f0102110 con 0x7f68f01069e0 2024-09-19T07:32:16.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.193+0000 7f68f496b640 1 -- 172.21.15.98:0/1114869973 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f68e8005560 con 0x7f68f01069e0 2024-09-19T07:32:16.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.193+0000 7f68f496b640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f68d80a3460 0x7f68d80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:16.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.193+0000 7f68eeffd640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f68d80a3460 0x7f68d80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:16.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.193+0000 7f68f496b640 1 -- 172.21.15.98:0/1114869973 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8658+0+0 (secure 0 0 0) 0x7f68e80d0000 con 0x7f68f01069e0 2024-09-19T07:32:16.197 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.194+0000 7f68eeffd640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f68d80a3460 0x7f68d80a5920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009890 tx=0x7f68e0008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:16.198 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.197+0000 7f68f496b640 1 -- 172.21.15.98:0/1114869973 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68e8016030 con 0x7f68f01069e0 2024-09-19T07:32:16.387 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.386+0000 7f68f596d640 1 -- 172.21.15.98:0/1114869973 --> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f68f00fd4a0 con 0x7f68d80a3460 2024-09-19T07:32:16.394 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.393+0000 7f68f496b640 1 -- 172.21.15.98:0/1114869973 <== mgr.15129 v2:172.21.15.98:6800/39328331 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f68f00fd4a0 con 0x7f68d80a3460 2024-09-19T07:32:16.394 INFO:teuthology.orchestra.run.smithi098.stdout:/ 1m 6m3h 2024-09-19T07:32:16.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.395+0000 7f68f596d640 1 -- 172.21.15.98:0/1114869973 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f68d80a3460 msgr2=0x7f68d80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.396 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.395+0000 7f68f596d640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f68d80a3460 0x7f68d80a5920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009890 tx=0x7f68e0008040 comp rx=0 tx=0).stop 2024-09-19T07:32:16.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.395+0000 7f68f596d640 1 -- 172.21.15.98:0/1114869973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68f01069e0 msgr2=0x7f68f01a4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.395+0000 7f68f596d640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68f01069e0 0x7f68f01a4290 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f68e800eaa0 tx=0x7f68e800ef60 comp rx=0 tx=0).stop 2024-09-19T07:32:16.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.395+0000 7f68f596d640 1 -- 172.21.15.98:0/1114869973 shutdown_connections 2024-09-19T07:32:16.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.395+0000 7f68f596d640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f68d80a3460 0x7f68d80a5920 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.395+0000 7f68f596d640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68f01069e0 0x7f68f01a4290 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.395+0000 7f68f596d640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f68f0101370 0x7f68f0199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.395+0000 7f68f596d640 1 --2- 172.21.15.98:0/1114869973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68f01009d0 0x7f68f0199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.395+0000 7f68f596d640 1 -- 172.21.15.98:0/1114869973 >> 172.21.15.98:0/1114869973 conn(0x7f68f00fc6f0 msgr2=0x7f68f00fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:16.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.395+0000 7f68f596d640 1 -- 172.21.15.98:0/1114869973 shutdown_connections 2024-09-19T07:32:16.397 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.395+0000 7f68f596d640 1 -- 172.21.15.98:0/1114869973 wait complete. 2024-09-19T07:32:16.407 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T07:32:16.418 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T07:32:16.419 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-19T07:32:16.420 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T07:32:16.489 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T07:32:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.588+0000 7fd18d07b640 1 -- 172.21.15.98:0/94940710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd188101aa0 msgr2=0x7fd188101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.588+0000 7fd18d07b640 1 --2- 172.21.15.98:0/94940710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd188101aa0 0x7fd188101f00 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009930 tx=0x7fd17c02a480 comp rx=0 tx=0).stop 2024-09-19T07:32:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.588+0000 7fd18d07b640 1 -- 172.21.15.98:0/94940710 shutdown_connections 2024-09-19T07:32:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.588+0000 7fd18d07b640 1 --2- 172.21.15.98:0/94940710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd188102440 0x7fd18810e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.588+0000 7fd18d07b640 1 --2- 172.21.15.98:0/94940710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd188101aa0 0x7fd188101f00 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.588+0000 7fd18d07b640 1 --2- 172.21.15.98:0/94940710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd188107ab0 0x7fd188107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.588+0000 7fd18d07b640 1 -- 172.21.15.98:0/94940710 >> 172.21.15.98:0/94940710 conn(0x7fd1880fd7c0 msgr2=0x7fd1880ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:16.590 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.588+0000 7fd18d07b640 1 -- 172.21.15.98:0/94940710 shutdown_connections 2024-09-19T07:32:16.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.588+0000 7fd18d07b640 1 -- 172.21.15.98:0/94940710 wait complete. 2024-09-19T07:32:16.591 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.589+0000 7fd18d07b640 1 Processor -- start 2024-09-19T07:32:16.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.589+0000 7fd18d07b640 1 -- start start 2024-09-19T07:32:16.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.589+0000 7fd18d07b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd188101aa0 0x7fd1881985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:16.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.589+0000 7fd18d07b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd188102440 0x7fd188198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:16.593 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.589+0000 7fd18d07b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd188107ab0 0x7fd18819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:16.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.589+0000 7fd18d07b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd188111f90 con 0x7fd188101aa0 2024-09-19T07:32:16.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.589+0000 7fd18d07b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd188111e10 con 0x7fd188107ab0 2024-09-19T07:32:16.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.589+0000 7fd18d07b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd188112110 con 0x7fd188102440 2024-09-19T07:32:16.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.589+0000 7fd186d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd188101aa0 0x7fd1881985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:16.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.589+0000 7fd186d9d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd188101aa0 0x7fd1881985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46970/0 (socket says 172.21.15.98:46970) 2024-09-19T07:32:16.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.589+0000 7fd186d9d640 1 -- 172.21.15.98:0/3410303870 learned_addr learned my addr 172.21.15.98:0/3410303870 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:16.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.590+0000 7fd18659c640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd188102440 0x7fd188198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:16.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.590+0000 7fd186d9d640 1 -- 172.21.15.98:0/3410303870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd188102440 msgr2=0x7fd188198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.594 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.590+0000 7fd186d9d640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd188102440 0x7fd188198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.590+0000 7fd186d9d640 1 -- 172.21.15.98:0/3410303870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd188107ab0 msgr2=0x7fd18819ce80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T07:32:16.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.590+0000 7fd186d9d640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd188107ab0 0x7fd18819ce80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.590+0000 7fd186d9d640 1 -- 172.21.15.98:0/3410303870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18819d5b0 con 0x7fd188101aa0 2024-09-19T07:32:16.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.590+0000 7fd186d9d640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd188101aa0 0x7fd1881985c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd17800b450 tx=0x7fd17800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:16.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.590+0000 7fd16ffff640 1 -- 172.21.15.98:0/3410303870 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd178015020 con 0x7fd188101aa0 2024-09-19T07:32:16.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.590+0000 7fd16ffff640 1 -- 172.21.15.98:0/3410303870 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd178011d70 con 0x7fd188101aa0 2024-09-19T07:32:16.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.590+0000 7fd18d07b640 1 -- 172.21.15.98:0/3410303870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18819d8a0 con 0x7fd188101aa0 2024-09-19T07:32:16.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.590+0000 7fd16ffff640 1 -- 172.21.15.98:0/3410303870 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd17800f340 con 0x7fd188101aa0 2024-09-19T07:32:16.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.590+0000 7fd18d07b640 1 -- 172.21.15.98:0/3410303870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1881a5130 con 0x7fd188101aa0 2024-09-19T07:32:16.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.591+0000 7fd18d07b640 1 -- 172.21.15.98:0/3410303870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd188101f80 con 0x7fd188101aa0 2024-09-19T07:32:16.595 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.592+0000 7fd16ffff640 1 -- 172.21.15.98:0/3410303870 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd178018020 con 0x7fd188101aa0 2024-09-19T07:32:16.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.593+0000 7fd16ffff640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd1700a33c0 0x7fd1700a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:16.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.593+0000 7fd18659c640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd1700a33c0 0x7fd1700a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:16.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.593+0000 7fd16ffff640 1 -- 172.21.15.98:0/3410303870 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fd1780cfd20 con 0x7fd188101aa0 2024-09-19T07:32:16.596 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.593+0000 7fd18659c640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd1700a33c0 0x7fd1700a5880 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd17c000c00 tx=0x7fd17c009560 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:16.598 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.597+0000 7fd16ffff640 1 -- 172.21.15.98:0/3410303870 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd17801f020 con 0x7fd188101aa0 2024-09-19T07:32:16.771 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.770+0000 7fd18d07b640 1 -- 172.21.15.98:0/3410303870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd188199910 con 0x7fd188101aa0 2024-09-19T07:32:16.773 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.771+0000 7fd16ffff640 1 -- 172.21.15.98:0/3410303870 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+23291 (secure 0 0 0) 0x7fd188199910 con 0x7fd188101aa0 2024-09-19T07:32:16.773 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:32:16.773 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":89,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:32:16.554373+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:20:16.391879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:20:18.243837+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":88,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/3732813400":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6801/2172632890":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/2271200719":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/617371908":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1543222160":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1123383068":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6800/2172632890":"2024-09-20T07:22:03.757428+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:32:16.775 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.774+0000 7fd18d07b640 1 -- 172.21.15.98:0/3410303870 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd1700a33c0 msgr2=0x7fd1700a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.774+0000 7fd18d07b640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd1700a33c0 0x7fd1700a5880 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd17c000c00 tx=0x7fd17c009560 comp rx=0 tx=0).stop 2024-09-19T07:32:16.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.774+0000 7fd18d07b640 1 -- 172.21.15.98:0/3410303870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd188101aa0 msgr2=0x7fd1881985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.774+0000 7fd18d07b640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd188101aa0 0x7fd1881985c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd17800b450 tx=0x7fd17800b910 comp rx=0 tx=0).stop 2024-09-19T07:32:16.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.774+0000 7fd18d07b640 1 -- 172.21.15.98:0/3410303870 shutdown_connections 2024-09-19T07:32:16.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.774+0000 7fd18d07b640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd1700a33c0 0x7fd1700a5880 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.774+0000 7fd18d07b640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd188107ab0 0x7fd18819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.774+0000 7fd18d07b640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd188102440 0x7fd188198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.774+0000 7fd18d07b640 1 --2- 172.21.15.98:0/3410303870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd188101aa0 0x7fd1881985c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.774+0000 7fd18d07b640 1 -- 172.21.15.98:0/3410303870 >> 172.21.15.98:0/3410303870 conn(0x7fd1880fd7c0 msgr2=0x7fd1880fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:16.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.774+0000 7fd18d07b640 1 -- 172.21.15.98:0/3410303870 shutdown_connections 2024-09-19T07:32:16.776 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.774+0000 7fd18d07b640 1 -- 172.21.15.98:0/3410303870 wait complete. 2024-09-19T07:32:16.786 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T07:15:50.874894+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T07:20:16.391879+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T07:20:18.243837+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 88, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T07:32:16.787 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T07:32:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.888+0000 7fd092a27640 1 -- 172.21.15.98:0/481873609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08c107a90 msgr2=0x7fd08c107e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.888+0000 7fd092a27640 1 --2- 172.21.15.98:0/481873609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08c107a90 0x7fd08c107e70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009930 tx=0x7fd07c02a420 comp rx=0 tx=0).stop 2024-09-19T07:32:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.888+0000 7fd092a27640 1 -- 172.21.15.98:0/481873609 shutdown_connections 2024-09-19T07:32:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.888+0000 7fd092a27640 1 --2- 172.21.15.98:0/481873609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd08c102420 0x7fd08c10e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.888+0000 7fd092a27640 1 --2- 172.21.15.98:0/481873609 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd08c101a80 0x7fd08c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.888+0000 7fd092a27640 1 --2- 172.21.15.98:0/481873609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08c107a90 0x7fd08c107e70 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.893 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.888+0000 7fd092a27640 1 -- 172.21.15.98:0/481873609 >> 172.21.15.98:0/481873609 conn(0x7fd08c0fd7c0 msgr2=0x7fd08c0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:16.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.888+0000 7fd092a27640 1 -- 172.21.15.98:0/481873609 shutdown_connections 2024-09-19T07:32:16.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.888+0000 7fd092a27640 1 -- 172.21.15.98:0/481873609 wait complete. 2024-09-19T07:32:16.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.888+0000 7fd092a27640 1 Processor -- start 2024-09-19T07:32:16.894 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.888+0000 7fd092a27640 1 -- start start 2024-09-19T07:32:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd092a27640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd08c101a80 0x7fd08c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd092a27640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08c102420 0x7fd08c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd092a27640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd08c107a90 0x7fd08c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd092a27640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c111f30 con 0x7fd08c102420 2024-09-19T07:32:16.895 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd092a27640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c111db0 con 0x7fd08c107a90 2024-09-19T07:32:16.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd092a27640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd08c1120b0 con 0x7fd08c101a80 2024-09-19T07:32:16.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd08b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08c102420 0x7fd08c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:16.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd08b7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08c102420 0x7fd08c198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:46996/0 (socket says 172.21.15.98:46996) 2024-09-19T07:32:16.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd08b7fe640 1 -- 172.21.15.98:0/2126052791 learned_addr learned my addr 172.21.15.98:0/2126052791 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:16.896 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd08bfff640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd08c101a80 0x7fd08c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:16.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd090fc4640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd08c107a90 0x7fd08c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:16.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd08b7fe640 1 -- 172.21.15.98:0/2126052791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd08c101a80 msgr2=0x7fd08c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd08b7fe640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd08c101a80 0x7fd08c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd08b7fe640 1 -- 172.21.15.98:0/2126052791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd08c107a90 msgr2=0x7fd08c19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:16.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd08b7fe640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd08c107a90 0x7fd08c19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:16.897 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd08b7fe640 1 -- 172.21.15.98:0/2126052791 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08c19d5b0 con 0x7fd08c102420 2024-09-19T07:32:16.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.889+0000 7fd08b7fe640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08c102420 0x7fd08c198b00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd08000b4a0 tx=0x7fd08000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:16.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.890+0000 7fd0897fa640 1 -- 172.21.15.98:0/2126052791 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080014070 con 0x7fd08c102420 2024-09-19T07:32:16.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.890+0000 7fd0897fa640 1 -- 172.21.15.98:0/2126052791 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd080010af0 con 0x7fd08c102420 2024-09-19T07:32:16.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.890+0000 7fd092a27640 1 -- 172.21.15.98:0/2126052791 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08c19d8a0 con 0x7fd08c102420 2024-09-19T07:32:16.898 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.890+0000 7fd0897fa640 1 -- 172.21.15.98:0/2126052791 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd080017d10 con 0x7fd08c102420 2024-09-19T07:32:16.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.890+0000 7fd092a27640 1 -- 172.21.15.98:0/2126052791 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd08c1a5130 con 0x7fd08c102420 2024-09-19T07:32:16.899 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.891+0000 7fd092a27640 1 -- 172.21.15.98:0/2126052791 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd08c101f60 con 0x7fd08c102420 2024-09-19T07:32:16.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.892+0000 7fd0897fa640 1 -- 172.21.15.98:0/2126052791 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd080017070 con 0x7fd08c102420 2024-09-19T07:32:16.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.892+0000 7fd0897fa640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd0740a33c0 0x7fd0740a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:16.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.893+0000 7fd08bfff640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd0740a33c0 0x7fd0740a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:16.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.893+0000 7fd0897fa640 1 -- 172.21.15.98:0/2126052791 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fd0800cf3d0 con 0x7fd08c102420 2024-09-19T07:32:16.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.893+0000 7fd08bfff640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd0740a33c0 0x7fd0740a5880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009900 tx=0x7fd07c0058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:16.901 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:16.895+0000 7fd0897fa640 1 -- 172.21.15.98:0/2126052791 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd08009be60 con 0x7fd08c102420 2024-09-19T07:32:17.064 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.063+0000 7fd092a27640 1 -- 172.21.15.98:0/2126052791 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd08c02d7c0 con 0x7fd08c102420 2024-09-19T07:32:17.065 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.063+0000 7fd0897fa640 1 -- 172.21.15.98:0/2126052791 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7fd08009b760 con 0x7fd08c102420 2024-09-19T07:32:17.065 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 1 2024-09-19T07:32:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.065+0000 7fd092a27640 1 -- 172.21.15.98:0/2126052791 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd0740a33c0 msgr2=0x7fd0740a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.065+0000 7fd092a27640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd0740a33c0 0x7fd0740a5880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd07c009900 tx=0x7fd07c0058d0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.065+0000 7fd092a27640 1 -- 172.21.15.98:0/2126052791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08c102420 msgr2=0x7fd08c198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.065+0000 7fd092a27640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08c102420 0x7fd08c198b00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd08000b4a0 tx=0x7fd08000b960 comp rx=0 tx=0).stop 2024-09-19T07:32:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.065+0000 7fd092a27640 1 -- 172.21.15.98:0/2126052791 shutdown_connections 2024-09-19T07:32:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.065+0000 7fd092a27640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd0740a33c0 0x7fd0740a5880 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.065+0000 7fd092a27640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd08c107a90 0x7fd08c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.065+0000 7fd092a27640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd08c102420 0x7fd08c198b00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.065+0000 7fd092a27640 1 --2- 172.21.15.98:0/2126052791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd08c101a80 0x7fd08c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.065+0000 7fd092a27640 1 -- 172.21.15.98:0/2126052791 >> 172.21.15.98:0/2126052791 conn(0x7fd08c0fd7c0 msgr2=0x7fd08c0fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.065+0000 7fd092a27640 1 -- 172.21.15.98:0/2126052791 shutdown_connections 2024-09-19T07:32:17.067 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.065+0000 7fd092a27640 1 -- 172.21.15.98:0/2126052791 wait complete. 2024-09-19T07:32:17.077 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T07:32:17.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.177+0000 7efdc6b1a640 1 -- 172.21.15.98:0/659961999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdc0102430 msgr2=0x7efdc010e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.177+0000 7efdc6b1a640 1 --2- 172.21.15.98:0/659961999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdc0102430 0x7efdc010e960 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009cd0 tx=0x7efdb802a8e0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.177+0000 7efdc6b1a640 1 -- 172.21.15.98:0/659961999 shutdown_connections 2024-09-19T07:32:17.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.177+0000 7efdc6b1a640 1 --2- 172.21.15.98:0/659961999 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdc0102430 0x7efdc010e960 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.177+0000 7efdc6b1a640 1 --2- 172.21.15.98:0/659961999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdc0101a90 0x7efdc0101ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.177+0000 7efdc6b1a640 1 --2- 172.21.15.98:0/659961999 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdc0107aa0 0x7efdc0107e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.177+0000 7efdc6b1a640 1 -- 172.21.15.98:0/659961999 >> 172.21.15.98:0/659961999 conn(0x7efdc00fd7d0 msgr2=0x7efdc00ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:17.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.177+0000 7efdc6b1a640 1 -- 172.21.15.98:0/659961999 shutdown_connections 2024-09-19T07:32:17.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.177+0000 7efdc6b1a640 1 -- 172.21.15.98:0/659961999 wait complete. 2024-09-19T07:32:17.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc6b1a640 1 Processor -- start 2024-09-19T07:32:17.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc6b1a640 1 -- start start 2024-09-19T07:32:17.181 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc6b1a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdc0101a90 0x7efdc00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc6b1a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdc0102430 0x7efdc0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc6b1a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdc0107aa0 0x7efdc0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc6b1a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efdc0111ee0 con 0x7efdc0101a90 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc6b1a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efdc0111d60 con 0x7efdc0102430 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc6b1a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efdc0112060 con 0x7efdc0107aa0 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc48b6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdc0101a90 0x7efdc00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc48b6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdc0101a90 0x7efdc00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47026/0 (socket says 172.21.15.98:47026) 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc48b6640 1 -- 172.21.15.98:0/767169777 learned_addr learned my addr 172.21.15.98:0/767169777 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdb7fff640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdc0102430 0x7efdc0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc48b6640 1 -- 172.21.15.98:0/767169777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdc0107aa0 msgr2=0x7efdc0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc48b6640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdc0107aa0 0x7efdc0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc48b6640 1 -- 172.21.15.98:0/767169777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdc0102430 msgr2=0x7efdc0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc48b6640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdc0102430 0x7efdc0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc48b6640 1 -- 172.21.15.98:0/767169777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc01a68f0 con 0x7efdc0101a90 2024-09-19T07:32:17.182 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdb7fff640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdc0102430 0x7efdc0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:32:17.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.178+0000 7efdc48b6640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdc0101a90 0x7efdc00744f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00d950 tx=0x7efdbc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:17.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.179+0000 7efdb5ffb640 1 -- 172.21.15.98:0/767169777 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc017070 con 0x7efdc0101a90 2024-09-19T07:32:17.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.179+0000 7efdb5ffb640 1 -- 172.21.15.98:0/767169777 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdbc009c30 con 0x7efdc0101a90 2024-09-19T07:32:17.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.179+0000 7efdc6b1a640 1 -- 172.21.15.98:0/767169777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc01a6be0 con 0x7efdc0101a90 2024-09-19T07:32:17.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.179+0000 7efdb5ffb640 1 -- 172.21.15.98:0/767169777 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc00f6b0 con 0x7efdc0101a90 2024-09-19T07:32:17.183 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.179+0000 7efdc6b1a640 1 -- 172.21.15.98:0/767169777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc01a7130 con 0x7efdc0101a90 2024-09-19T07:32:17.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.180+0000 7efdc6b1a640 1 -- 172.21.15.98:0/767169777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc0101ef0 con 0x7efdc0101a90 2024-09-19T07:32:17.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.181+0000 7efdb5ffb640 1 -- 172.21.15.98:0/767169777 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7efdbc0109d0 con 0x7efdc0101a90 2024-09-19T07:32:17.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.181+0000 7efdb5ffb640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7efda80a33c0 0x7efda80a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:17.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.181+0000 7efdb7fff640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7efda80a33c0 0x7efda80a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:17.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.181+0000 7efdb5ffb640 1 -- 172.21.15.98:0/767169777 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7efdbc0cf9d0 con 0x7efdc0101a90 2024-09-19T07:32:17.184 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.182+0000 7efdb7fff640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7efda80a33c0 0x7efda80a5880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efdb0005fd0 tx=0x7efdb0005ea0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:17.187 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.185+0000 7efdb5ffb640 1 -- 172.21.15.98:0/767169777 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efdbc009de0 con 0x7efdc0101a90 2024-09-19T07:32:17.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.349+0000 7efdc6b1a640 1 -- 172.21.15.98:0/767169777 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efdc010a050 con 0x7efdc0101a90 2024-09-19T07:32:17.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.350+0000 7efdb5ffb640 1 -- 172.21.15.98:0/767169777 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7efdbc09c350 con 0x7efdc0101a90 2024-09-19T07:32:17.351 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 32 2024-09-19T07:32:17.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.352+0000 7efdc6b1a640 1 -- 172.21.15.98:0/767169777 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7efda80a33c0 msgr2=0x7efda80a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.353 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.352+0000 7efdc6b1a640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7efda80a33c0 0x7efda80a5880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efdb0005fd0 tx=0x7efdb0005ea0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.352+0000 7efdc6b1a640 1 -- 172.21.15.98:0/767169777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdc0101a90 msgr2=0x7efdc00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.352+0000 7efdc6b1a640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdc0101a90 0x7efdc00744f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00d950 tx=0x7efdbc00de10 comp rx=0 tx=0).stop 2024-09-19T07:32:17.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.352+0000 7efdc6b1a640 1 -- 172.21.15.98:0/767169777 shutdown_connections 2024-09-19T07:32:17.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.352+0000 7efdc6b1a640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7efda80a33c0 0x7efda80a5880 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.352+0000 7efdc6b1a640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efdc0107aa0 0x7efdc0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.352+0000 7efdc6b1a640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdc0102430 0x7efdc0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.352+0000 7efdc6b1a640 1 --2- 172.21.15.98:0/767169777 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efdc0101a90 0x7efdc00744f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.352+0000 7efdc6b1a640 1 -- 172.21.15.98:0/767169777 >> 172.21.15.98:0/767169777 conn(0x7efdc00fd7d0 msgr2=0x7efdc00fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:17.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.352+0000 7efdc6b1a640 1 -- 172.21.15.98:0/767169777 shutdown_connections 2024-09-19T07:32:17.354 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.352+0000 7efdc6b1a640 1 -- 172.21.15.98:0/767169777 wait complete. 2024-09-19T07:32:17.364 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T07:32:17.466 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.463+0000 7fd9e94ba640 1 -- 172.21.15.98:0/1874003868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9e4100970 msgr2=0x7fd9e410e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.463+0000 7fd9e94ba640 1 --2- 172.21.15.98:0/1874003868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9e4100970 0x7fd9e410e960 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc009ca0 tx=0x7fd9dc02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.463+0000 7fd9e94ba640 1 -- 172.21.15.98:0/1874003868 shutdown_connections 2024-09-19T07:32:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.463+0000 7fd9e94ba640 1 --2- 172.21.15.98:0/1874003868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9e4100970 0x7fd9e410e960 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.463+0000 7fd9e94ba640 1 --2- 172.21.15.98:0/1874003868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9e40fffd0 0x7fd9e4100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.463+0000 7fd9e94ba640 1 --2- 172.21.15.98:0/1874003868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e4106ab0 0x7fd9e4106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.463+0000 7fd9e94ba640 1 -- 172.21.15.98:0/1874003868 >> 172.21.15.98:0/1874003868 conn(0x7fd9e4077170 msgr2=0x7fd9e40fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.463+0000 7fd9e94ba640 1 -- 172.21.15.98:0/1874003868 shutdown_connections 2024-09-19T07:32:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.463+0000 7fd9e94ba640 1 -- 172.21.15.98:0/1874003868 wait complete. 2024-09-19T07:32:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e94ba640 1 Processor -- start 2024-09-19T07:32:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e94ba640 1 -- start start 2024-09-19T07:32:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e94ba640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9e40fffd0 0x7fd9e41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:17.467 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e94ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e4100970 0x7fd9e4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e94ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9e4106ab0 0x7fd9e419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e94ba640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4111fe0 con 0x7fd9e40fffd0 2024-09-19T07:32:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e94ba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4111e60 con 0x7fd9e4106ab0 2024-09-19T07:32:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e94ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4112160 con 0x7fd9e4100970 2024-09-19T07:32:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e2ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9e40fffd0 0x7fd9e41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e2ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9e40fffd0 0x7fd9e41984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47042/0 (socket says 172.21.15.98:47042) 2024-09-19T07:32:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e2ffd640 1 -- 172.21.15.98:0/3060615618 learned_addr learned my addr 172.21.15.98:0/3060615618 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9dbfff640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e4100970 0x7fd9e4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e37fe640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9e4106ab0 0x7fd9e419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e2ffd640 1 -- 172.21.15.98:0/3060615618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e4100970 msgr2=0x7fd9e4198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.468 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e2ffd640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e4100970 0x7fd9e4198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.464+0000 7fd9e2ffd640 1 -- 172.21.15.98:0/3060615618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9e4106ab0 msgr2=0x7fd9e419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.465+0000 7fd9e2ffd640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9e4106ab0 0x7fd9e419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.465+0000 7fd9e2ffd640 1 -- 172.21.15.98:0/3060615618 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e419d4c0 con 0x7fd9e40fffd0 2024-09-19T07:32:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.465+0000 7fd9e37fe640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9e4106ab0 0x7fd9e419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:32:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.465+0000 7fd9dbfff640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e4100970 0x7fd9e4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:32:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.465+0000 7fd9e2ffd640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9e40fffd0 0x7fd9e41984d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400c970 tx=0x7fd9d400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.465+0000 7fd9e0ff9640 1 -- 172.21.15.98:0/3060615618 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4007bb0 con 0x7fd9e40fffd0 2024-09-19T07:32:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.465+0000 7fd9e0ff9640 1 -- 172.21.15.98:0/3060615618 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9d4007d50 con 0x7fd9e40fffd0 2024-09-19T07:32:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.465+0000 7fd9e94ba640 1 -- 172.21.15.98:0/3060615618 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e419d7b0 con 0x7fd9e40fffd0 2024-09-19T07:32:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.465+0000 7fd9e0ff9640 1 -- 172.21.15.98:0/3060615618 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400f450 con 0x7fd9e40fffd0 2024-09-19T07:32:17.469 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.465+0000 7fd9e94ba640 1 -- 172.21.15.98:0/3060615618 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e41a5040 con 0x7fd9e40fffd0 2024-09-19T07:32:17.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.466+0000 7fd9e94ba640 1 -- 172.21.15.98:0/3060615618 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e4100430 con 0x7fd9e40fffd0 2024-09-19T07:32:17.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.467+0000 7fd9e0ff9640 1 -- 172.21.15.98:0/3060615618 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd9d4005020 con 0x7fd9e40fffd0 2024-09-19T07:32:17.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.467+0000 7fd9e0ff9640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd9d00a33c0 0x7fd9d00a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:17.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.468+0000 7fd9dbfff640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd9d00a33c0 0x7fd9d00a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:17.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.468+0000 7fd9e0ff9640 1 -- 172.21.15.98:0/3060615618 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fd9d40cfc20 con 0x7fd9e40fffd0 2024-09-19T07:32:17.471 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.468+0000 7fd9dbfff640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd9d00a33c0 0x7fd9d00a5880 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc006fd0 tx=0x7fd9cc008040 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:17.473 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.471+0000 7fd9e0ff9640 1 -- 172.21.15.98:0/3060615618 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd9d4014030 con 0x7fd9e40fffd0 2024-09-19T07:32:17.641 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.640+0000 7fd9e94ba640 1 -- 172.21.15.98:0/3060615618 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd9e41a5210 con 0x7fd9e40fffd0 2024-09-19T07:32:17.642 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.641+0000 7fd9e0ff9640 1 -- 172.21.15.98:0/3060615618 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7fd9d409c5a0 con 0x7fd9e40fffd0 2024-09-19T07:32:17.642 INFO:teuthology.orchestra.run.smithi098.stdout:pg_num: 64 2024-09-19T07:32:17.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.643+0000 7fd9e94ba640 1 -- 172.21.15.98:0/3060615618 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd9d00a33c0 msgr2=0x7fd9d00a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.643+0000 7fd9e94ba640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd9d00a33c0 0x7fd9d00a5880 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc006fd0 tx=0x7fd9cc008040 comp rx=0 tx=0).stop 2024-09-19T07:32:17.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.643+0000 7fd9e94ba640 1 -- 172.21.15.98:0/3060615618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9e40fffd0 msgr2=0x7fd9e41984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.643+0000 7fd9e94ba640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9e40fffd0 0x7fd9e41984d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400c970 tx=0x7fd9d400ce30 comp rx=0 tx=0).stop 2024-09-19T07:32:17.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.643+0000 7fd9e94ba640 1 -- 172.21.15.98:0/3060615618 shutdown_connections 2024-09-19T07:32:17.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.643+0000 7fd9e94ba640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fd9d00a33c0 0x7fd9d00a5880 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.644 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.643+0000 7fd9e94ba640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd9e4106ab0 0x7fd9e419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.643+0000 7fd9e94ba640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd9e4100970 0x7fd9e4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.643+0000 7fd9e94ba640 1 --2- 172.21.15.98:0/3060615618 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd9e40fffd0 0x7fd9e41984d0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.643+0000 7fd9e94ba640 1 -- 172.21.15.98:0/3060615618 >> 172.21.15.98:0/3060615618 conn(0x7fd9e4077170 msgr2=0x7fd9e4104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:17.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.643+0000 7fd9e94ba640 1 -- 172.21.15.98:0/3060615618 shutdown_connections 2024-09-19T07:32:17.645 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.643+0000 7fd9e94ba640 1 -- 172.21.15.98:0/3060615618 wait complete. 2024-09-19T07:32:17.654 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:17 smithi098 ceph-mon[30950]: pgmap v316: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:32:17.654 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:17 smithi098 ceph-mon[30950]: from='client.16671 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:32:17.654 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:17 smithi098 ceph-mon[30950]: from='client.16677 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:32:17.654 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:17 smithi098 ceph-mon[30950]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T07:32:17.654 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:17 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3410303870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:32:17.654 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:17 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2126052791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:32:17.654 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:17 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/767169777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:32:17.655 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T07:32:17.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.752+0000 7f802bad0640 1 -- 172.21.15.98:0/783625590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80241009c0 msgr2=0x7f8024100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.752+0000 7f802bad0640 1 --2- 172.21.15.98:0/783625590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80241009c0 0x7f8024100e20 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8018009930 tx=0x7f801802a420 comp rx=0 tx=0).stop 2024-09-19T07:32:17.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.752+0000 7f802bad0640 1 -- 172.21.15.98:0/783625590 shutdown_connections 2024-09-19T07:32:17.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.752+0000 7f802bad0640 1 --2- 172.21.15.98:0/783625590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8024101360 0x7f802410d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.752+0000 7f802bad0640 1 --2- 172.21.15.98:0/783625590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80241009c0 0x7f8024100e20 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.752+0000 7f802bad0640 1 --2- 172.21.15.98:0/783625590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80241069d0 0x7f8024106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.752+0000 7f802bad0640 1 -- 172.21.15.98:0/783625590 >> 172.21.15.98:0/783625590 conn(0x7f80240fc6a0 msgr2=0x7f80240feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:17.756 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.752+0000 7f802bad0640 1 -- 172.21.15.98:0/783625590 shutdown_connections 2024-09-19T07:32:17.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.752+0000 7f802bad0640 1 -- 172.21.15.98:0/783625590 wait complete. 2024-09-19T07:32:17.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.753+0000 7f802bad0640 1 Processor -- start 2024-09-19T07:32:17.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.753+0000 7f802bad0640 1 -- start start 2024-09-19T07:32:17.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.753+0000 7f802bad0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80241009c0 0x7f802419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:17.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.753+0000 7f802bad0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8024101360 0x7f802419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:17.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.753+0000 7f802bad0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80241069d0 0x7f802419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:17.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.753+0000 7f802bad0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8024110e10 con 0x7f8024101360 2024-09-19T07:32:17.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.753+0000 7f802bad0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8024110c90 con 0x7f80241009c0 2024-09-19T07:32:17.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.753+0000 7f802bad0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8024110f90 con 0x7f80241069d0 2024-09-19T07:32:17.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.753+0000 7f802906b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8024101360 0x7f802419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:17.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.753+0000 7f802906b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8024101360 0x7f802419abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:47064/0 (socket says 172.21.15.98:47064) 2024-09-19T07:32:17.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.753+0000 7f802906b640 1 -- 172.21.15.98:0/1790461274 learned_addr learned my addr 172.21.15.98:0/1790461274 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:17.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.753+0000 7f802906b640 1 -- 172.21.15.98:0/1790461274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80241069d0 msgr2=0x7f802419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.754+0000 7f802906b640 1 --2- 172.21.15.98:0/1790461274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80241069d0 0x7f802419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.754+0000 7f802906b640 1 -- 172.21.15.98:0/1790461274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80241009c0 msgr2=0x7f802419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:17.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.754+0000 7f802906b640 1 --2- 172.21.15.98:0/1790461274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80241009c0 0x7f802419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:17.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.754+0000 7f802906b640 1 -- 172.21.15.98:0/1790461274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802419f670 con 0x7f8024101360 2024-09-19T07:32:17.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.754+0000 7f802906b640 1 --2- 172.21.15.98:0/1790461274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8024101360 0x7f802419abc0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8018009230 tx=0x7f8018004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:17.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.754+0000 7f8022ffd640 1 -- 172.21.15.98:0/1790461274 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801803f030 con 0x7f8024101360 2024-09-19T07:32:17.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.754+0000 7f8022ffd640 1 -- 172.21.15.98:0/1790461274 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8018003ad0 con 0x7f8024101360 2024-09-19T07:32:17.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.754+0000 7f802bad0640 1 -- 172.21.15.98:0/1790461274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802419f900 con 0x7f8024101360 2024-09-19T07:32:17.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.754+0000 7f8022ffd640 1 -- 172.21.15.98:0/1790461274 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8018035070 con 0x7f8024101360 2024-09-19T07:32:17.758 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.754+0000 7f802bad0640 1 -- 172.21.15.98:0/1790461274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80241a71f0 con 0x7f8024101360 2024-09-19T07:32:17.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.755+0000 7f802bad0640 1 -- 172.21.15.98:0/1790461274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8024100e20 con 0x7f8024101360 2024-09-19T07:32:17.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.756+0000 7f8022ffd640 1 -- 172.21.15.98:0/1790461274 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8018042030 con 0x7f8024101360 2024-09-19T07:32:17.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.757+0000 7f8022ffd640 1 --2- 172.21.15.98:0/1790461274 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f800c0a33c0 0x7f800c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:17.759 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.757+0000 7f802986c640 1 --2- 172.21.15.98:0/1790461274 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f800c0a33c0 0x7f800c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:17.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.757+0000 7f8022ffd640 1 -- 172.21.15.98:0/1790461274 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f80180f0790 con 0x7f8024101360 2024-09-19T07:32:17.760 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.757+0000 7f802986c640 1 --2- 172.21.15.98:0/1790461274 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f800c0a33c0 0x7f800c0a5880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f801c00a860 tx=0x7f801c005b60 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:17.761 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.760+0000 7f8022ffd640 1 -- 172.21.15.98:0/1790461274 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f80180bd0b0 con 0x7f8024101360 2024-09-19T07:32:17.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:17 smithi139 ceph-mon[35039]: pgmap v316: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:32:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:17 smithi139 ceph-mon[35039]: from='client.16671 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:32:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:17 smithi139 ceph-mon[35039]: from='client.16677 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:32:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:17 smithi139 ceph-mon[35039]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T07:32:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:17 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3410303870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:32:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:17 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2126052791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:32:17.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:17 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/767169777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:32:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:17 smithi162 ceph-mon[35726]: pgmap v316: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:32:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:17 smithi162 ceph-mon[35726]: from='client.16671 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:32:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:17 smithi162 ceph-mon[35726]: from='client.16677 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:32:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:17 smithi162 ceph-mon[35726]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T07:32:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:17 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3410303870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:32:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:17 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2126052791' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T07:32:17.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:17 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/767169777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T07:32:17.974 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.973+0000 7f802bad0640 1 -- 172.21.15.98:0/1790461274 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f80241a74b0 con 0x7f8024101360 2024-09-19T07:32:17.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.980+0000 7f8022ffd640 1 -- 172.21.15.98:0/1790461274 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+742865 (secure 0 0 0) 0x7f80180bc9b0 con 0x7f8024101360 2024-09-19T07:32:17.991 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:32:17.992 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:32:17.992 INFO:teuthology.orchestra.run.smithi098.stdout: "epoch": 25, 2024-09-19T07:32:17.992 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:17.992 INFO:teuthology.orchestra.run.smithi098.stdout: "active_gid": 15129, 2024-09-19T07:32:17.992 INFO:teuthology.orchestra.run.smithi098.stdout: "active_name": "x", 2024-09-19T07:32:17.992 INFO:teuthology.orchestra.run.smithi098.stdout: "active_addrs": { 2024-09-19T07:32:17.992 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-19T07:32:17.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:17.992 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-19T07:32:17.992 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.98:6800", 2024-09-19T07:32:17.992 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 39328331 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v1", 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.98:6801", 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 39328331 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: "active_addr": "172.21.15.98:6801/39328331", 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: "active_change": "2024-09-19T07:22:03.757640+0000", 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: "available": true, 2024-09-19T07:32:17.993 INFO:teuthology.orchestra.run.smithi098.stdout: "standbys": [ 2024-09-19T07:32:17.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:17.994 INFO:teuthology.orchestra.run.smithi098.stdout: "gid": 24709, 2024-09-19T07:32:17.994 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "z", 2024-09-19T07:32:17.994 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr_features": 4540701547738038271, 2024-09-19T07:32:17.994 INFO:teuthology.orchestra.run.smithi098.stdout: "available_modules": [ 2024-09-19T07:32:17.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:17.994 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "alerts", 2024-09-19T07:32:17.994 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:17.994 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:17.994 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:17.994 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:17.994 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:17.995 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:17.996 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:17.997 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:17.998 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:17.999 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:17.999 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:17.999 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:17.999 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:17.999 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:17.999 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:17.999 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:17.999 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:17.999 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:17.999 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.000 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_destination": { 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_destination", 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.001 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email address to send alerts to", 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_from_name": { 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_from_name", 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "Ceph", 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.002 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email From: name", 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_host": { 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_host", 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.003 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.004 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP server", 2024-09-19T07:32:18.004 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.004 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.004 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.004 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_password": { 2024-09-19T07:32:18.004 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_password", 2024-09-19T07:32:18.004 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.004 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.004 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.004 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.004 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Password to authenticate with", 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_port": { 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_port", 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "465", 2024-09-19T07:32:18.005 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP port", 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_sender": { 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_sender", 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.006 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP envelope sender", 2024-09-19T07:32:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_ssl": { 2024-09-19T07:32:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_ssl", 2024-09-19T07:32:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.007 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_user": { 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_user", 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.008 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "User to authenticate as", 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.009 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "balancer", 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "active": { 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "active", 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.010 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_time": { 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_time", 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0000", 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.011 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_weekday": { 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_weekday", 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-19T07:32:18.012 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_max_iterations": { 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_max_iterations", 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "25", 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-19T07:32:18.013 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "250", 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_metrics": { 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_metrics", 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T07:32:18.014 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_step": { 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_step", 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.015 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.5", 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0.001", 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "0.999", 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "aggressiveness of optimization", 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "end_time": { 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_time", 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.016 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2359", 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "end_weekday": { 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_weekday", 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.017 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.018 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.019 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.020 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.021 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.022 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.023 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "min_score": { 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_score", 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.024 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "upmap", 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "crush-compat", 2024-09-19T07:32:18.025 INFO:teuthology.orchestra.run.smithi098.stdout: "none", 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "read", 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap", 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap-read" 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Balancer mode", 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_ids": { 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_ids", 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.026 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:18.027 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_deviation": { 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_deviation", 2024-09-19T07:32:18.028 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_optimizations": { 2024-09-19T07:32:18.029 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_optimizations", 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm", 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_down_multiplier": { 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_down_multiplier", 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.031 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_refresh_rate": { 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_refresh_rate", 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "20", 2024-09-19T07:32:18.032 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_starting_port": { 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_starting_port", 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.033 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4721", 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_ptrace": { 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_ptrace", 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.034 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_interval": { 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_interval", 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.035 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_memory_target_ratio": { 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T07:32:18.036 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.7", 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm_log_destination": { 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm_log_destination", 2024-09-19T07:32:18.037 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "file", 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "file,syslog", 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "syslog" 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.038 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "cgroups_split": { 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cgroups_split", 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.039 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "config_checks_enabled": { 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_checks_enabled", 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.040 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "config_dashboard": { 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_dashboard", 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.041 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_alertmanager": { 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_alertmanager", 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-19T07:32:18.042 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_base": { 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_base", 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.043 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Container image name, without the tag", 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_elasticsearch": { 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_elasticsearch", 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.044 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "elasticsearch container image", 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_grafana": { 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_grafana", 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.045 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-19T07:32:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_haproxy": { 2024-09-19T07:32:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_haproxy", 2024-09-19T07:32:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.046 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "HAproxy container image", 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_agent": { 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_agent", 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.047 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger agent container image", 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_collector": { 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_collector", 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.048 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger collector container image", 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_query": { 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_query", 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.049 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger query container image", 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_keepalived": { 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_keepalived", 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.050 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Keepalived container image", 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_loki": { 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_loki", 2024-09-19T07:32:18.051 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T07:32:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Loki container image", 2024-09-19T07:32:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.052 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_node_exporter": { 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_node_exporter", 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.053 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_nvmeof": { 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_nvmeof", 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Nvme-of container image", 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.054 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_prometheus": { 2024-09-19T07:32:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_prometheus", 2024-09-19T07:32:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T07:32:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-19T07:32:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.055 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_promtail": { 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_promtail", 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Promtail container image", 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.056 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_samba": { 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_samba", 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Samba/SMB container image", 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.057 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_snmp_gateway": { 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_snmp_gateway", 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SNMP Gateway container image", 2024-09-19T07:32:18.058 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: "container_init": { 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_init", 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.059 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: "daemon_cache_timeout": { 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "daemon_cache_timeout", 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.060 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: "default_cephadm_command_timeout": { 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "900", 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.061 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: "default_registry": { 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_registry", 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io", 2024-09-19T07:32:18.062 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: "device_cache_timeout": { 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_cache_timeout", 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.063 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1800", 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache device inventory", 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: "device_enhanced_scan": { 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_enhanced_scan", 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.064 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: "facts_cache_timeout": { 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "facts_cache_timeout", 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.065 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache host facts data", 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "grafana_dashboards_path": { 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "grafana_dashboards_path", 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.066 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: "host_check_interval": { 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "host_check_interval", 2024-09-19T07:32:18.067 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to perform a host check", 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "hw_monitoring": { 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hw_monitoring", 2024-09-19T07:32:18.068 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: "inventory_list_all": { 2024-09-19T07:32:18.069 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "inventory_list_all", 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.070 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.071 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.072 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.072 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.072 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.072 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.072 INFO:teuthology.orchestra.run.smithi098.stdout: "log_refresh_metadata": { 2024-09-19T07:32:18.072 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_refresh_metadata", 2024-09-19T07:32:18.072 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.072 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.072 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.073 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.073 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.073 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.073 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.073 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T07:32:18.073 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.073 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.073 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.073 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.073 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.074 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.075 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.075 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.075 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.075 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.075 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.075 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.075 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.075 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.075 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.075 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.075 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.076 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.076 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.076 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.076 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.076 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.076 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.076 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.076 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.076 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.076 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.076 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T07:32:18.077 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T07:32:18.078 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.079 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.079 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.079 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "*", 2024-09-19T07:32:18.079 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.079 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.079 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.079 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T07:32:18.079 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.079 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.079 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.079 INFO:teuthology.orchestra.run.smithi098.stdout: "max_count_per_host": { 2024-09-19T07:32:18.080 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_count_per_host", 2024-09-19T07:32:18.080 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.080 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.080 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.080 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.080 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.080 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.080 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.080 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of daemons per service per host", 2024-09-19T07:32:18.080 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.080 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.081 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.081 INFO:teuthology.orchestra.run.smithi098.stdout: "max_osd_draining_count": { 2024-09-19T07:32:18.081 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_osd_draining_count", 2024-09-19T07:32:18.081 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.081 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.081 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.081 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.081 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.081 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.081 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.081 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T07:32:18.082 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.082 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.082 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.082 INFO:teuthology.orchestra.run.smithi098.stdout: "migration_current": { 2024-09-19T07:32:18.082 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "migration_current", 2024-09-19T07:32:18.082 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.082 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.082 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.082 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.082 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.082 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "internal - do not modify", 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "root", 2024-09-19T07:32:18.083 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.084 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.084 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.084 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm-package", 2024-09-19T07:32:18.084 INFO:teuthology.orchestra.run.smithi098.stdout: "root" 2024-09-19T07:32:18.084 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.084 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T07:32:18.084 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.084 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.084 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.084 INFO:teuthology.orchestra.run.smithi098.stdout: "oob_default_addr": { 2024-09-19T07:32:18.084 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "oob_default_addr", 2024-09-19T07:32:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "169.254.1.1", 2024-09-19T07:32:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T07:32:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "prometheus_alerts_path": { 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus_alerts_path", 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.087 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_insecure": { 2024-09-19T07:32:18.087 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_insecure", 2024-09-19T07:32:18.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.087 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.087 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.087 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.087 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.087 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.087 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T07:32:18.087 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_password": { 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_password", 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.088 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T07:32:18.089 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.089 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.089 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.089 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_url": { 2024-09-19T07:32:18.089 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_url", 2024-09-19T07:32:18.089 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.089 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.089 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.089 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.089 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_username": { 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_username", 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.090 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "secure_monitoring_stack": { 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secure_monitoring_stack", 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.091 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.092 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.092 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.092 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T07:32:18.092 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.092 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.092 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.092 INFO:teuthology.orchestra.run.smithi098.stdout: "service_discovery_port": { 2024-09-19T07:32:18.092 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "service_discovery_port", 2024-09-19T07:32:18.092 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.092 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8765", 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "cephadm service discovery port", 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_config_file": { 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_config_file", 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.093 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: "use_agent": { 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_agent", 2024-09-19T07:32:18.094 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: "use_repo_digest": { 2024-09-19T07:32:18.095 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_repo_digest", 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.096 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_failed_host_check": { 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_failed_host_check", 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_daemons": { 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_daemons", 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.098 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_hosts": { 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_hosts", 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.099 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.100 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.100 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.100 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.100 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crash", 2024-09-19T07:32:18.100 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.100 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.100 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.100 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.100 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.101 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.102 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.103 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.105 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.105 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.105 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.105 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.105 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.105 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.105 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.105 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.105 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.105 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.105 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.105 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "retain_interval": { 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retain_interval", 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "31536000", 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.106 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_recent_interval": { 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_recent_interval", 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1209600", 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T07:32:18.107 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dashboard", 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.108 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.109 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.109 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.109 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.109 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.109 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.109 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.109 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.109 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.109 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.109 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T07:32:18.109 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.110 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.111 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_ENABLED": { 2024-09-19T07:32:18.112 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T07:32:18.112 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.112 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.112 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.112 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.112 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.112 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.112 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.112 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.112 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.112 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.112 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.113 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.114 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.115 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.116 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.117 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.117 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.117 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T07:32:18.117 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T07:32:18.117 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.117 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.117 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.117 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.117 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.117 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.118 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.119 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.120 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.121 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.122 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.123 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-19T07:32:18.124 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.124 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.124 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.124 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.124 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.124 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.124 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.124 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T07:32:18.124 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T07:32:18.124 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.124 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_URL": { 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_URL", 2024-09-19T07:32:18.125 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.126 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.127 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.128 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.128 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.128 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.128 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.128 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.128 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.128 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.128 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.128 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.128 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T07:32:18.128 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T07:32:18.129 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.129 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.129 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.129 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.129 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.129 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.129 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.129 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.129 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.129 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.129 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.130 INFO:teuthology.orchestra.run.smithi098.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.132 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.133 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T07:32:18.133 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T07:32:18.133 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.133 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.133 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.133 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.133 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.133 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.133 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.133 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.133 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.134 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.134 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.134 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T07:32:18.134 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T07:32:18.134 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.134 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.134 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.134 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.134 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.134 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.134 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.135 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.136 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.136 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.136 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.136 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.136 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T07:32:18.136 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T07:32:18.136 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.136 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.136 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.136 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.136 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.137 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.138 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.139 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.140 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.140 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.140 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.140 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.140 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.140 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.140 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T07:32:18.140 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T07:32:18.140 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.140 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.140 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.141 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.141 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.141 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.141 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.141 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.141 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.141 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.141 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.141 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T07:32:18.141 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T07:32:18.141 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T07:32:18.142 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T07:32:18.143 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.144 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T07:32:18.145 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T07:32:18.145 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.145 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.145 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.145 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8", 2024-09-19T07:32:18.145 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.145 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.145 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.145 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.145 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.145 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.145 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "45", 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.146 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.147 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.148 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.148 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T07:32:18.148 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T07:32:18.148 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.148 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.148 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.148 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-19T07:32:18.148 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.148 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.148 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.148 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.149 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.150 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.151 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.152 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.153 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: "cross_origin_url": { 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cross_origin_url", 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.154 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: "crt_file": { 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crt_file", 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.155 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: "debug": { 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "debug", 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.156 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable/disable debug options", 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: "jwt_token_ttl": { 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "jwt_token_ttl", 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.157 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "28800", 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.158 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.159 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.160 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.160 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.160 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.160 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.160 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.160 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.160 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.160 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.160 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.160 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.160 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.160 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.161 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.162 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.163 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "motd": { 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "motd", 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "The message of the day", 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.165 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect_resolve_ip_addr": { 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.166 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-19T07:32:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-19T07:32:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-19T07:32:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.167 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-19T07:32:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-19T07:32:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8080", 2024-09-19T07:32:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.168 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.169 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl_server_port": { 2024-09-19T07:32:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl_server_port", 2024-09-19T07:32:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8443", 2024-09-19T07:32:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.170 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "redirect", 2024-09-19T07:32:18.171 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect" 2024-09-19T07:32:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.172 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-19T07:32:18.173 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-19T07:32:18.173 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.173 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.173 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.173 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-19T07:32:18.173 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-19T07:32:18.173 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-19T07:32:18.173 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.173 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "url_prefix": { 2024-09-19T07:32:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url_prefix", 2024-09-19T07:32:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.174 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "devicehealth", 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.175 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_monitoring": { 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_monitoring", 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "monitor device health metrics", 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.176 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.177 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.178 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.179 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.180 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.182 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "mark_out_threshold": { 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mark_out_threshold", 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.183 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2419200", 2024-09-19T07:32:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T07:32:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_name": { 2024-09-19T07:32:18.184 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_name", 2024-09-19T07:32:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "device_health_metrics", 2024-09-19T07:32:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T07:32:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "retention_period": { 2024-09-19T07:32:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retention_period", 2024-09-19T07:32:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15552000", 2024-09-19T07:32:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain device health metrics", 2024-09-19T07:32:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.186 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_frequency": { 2024-09-19T07:32:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_frequency", 2024-09-19T07:32:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-19T07:32:18.187 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T07:32:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "self_heal": { 2024-09-19T07:32:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "self_heal", 2024-09-19T07:32:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.188 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T07:32:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:18.189 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T07:32:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.190 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_threshold": { 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_threshold", 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7257600", 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.191 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "diskprediction_local", 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.192 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.193 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.194 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.195 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.196 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.197 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "predict_interval": { 2024-09-19T07:32:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predict_interval", 2024-09-19T07:32:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-19T07:32:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.198 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "predictor_model": { 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predictor_model", 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "prophetstor", 2024-09-19T07:32:18.199 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.200 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "influx", 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": false, 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "influxdb python module not found", 2024-09-19T07:32:18.201 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "batch_size": { 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "batch_size", 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5000", 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "database": { 2024-09-19T07:32:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "database", 2024-09-19T07:32:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "ceph", 2024-09-19T07:32:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T07:32:18.203 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": { 2024-09-19T07:32:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hostname", 2024-09-19T07:32:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.204 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server hostname", 2024-09-19T07:32:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:18.205 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "30", 2024-09-19T07:32:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "5", 2024-09-19T07:32:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T07:32:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.207 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.208 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.209 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.210 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.211 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "password": { 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "password", 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.212 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "password of InfluxDB server user", 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "port": { 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "port", 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.213 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8086", 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server port", 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-19T07:32:18.214 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "false", 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "threads": { 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threads", 2024-09-19T07:32:18.215 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "32", 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "username": { 2024-09-19T07:32:18.216 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "username", 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "username of InfluxDB server user", 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.217 INFO:teuthology.orchestra.run.smithi098.stdout: "verify_ssl": { 2024-09-19T07:32:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "verify_ssl", 2024-09-19T07:32:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "true", 2024-09-19T07:32:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:32:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.218 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "insights", 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.219 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.220 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.221 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.222 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.223 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.224 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "iostat", 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.225 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.226 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.227 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.228 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.229 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "k8sevents", 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_event_retention_days": { 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ceph_event_retention_days", 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7", 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.231 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T07:32:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "config_check_secs": { 2024-09-19T07:32:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_check_secs", 2024-09-19T07:32:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.232 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "10", 2024-09-19T07:32:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T07:32:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.233 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.234 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.235 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.236 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.237 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.238 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "localpool", 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "failure_domain": { 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "failure_domain", 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.239 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "host", 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "failure domain for any created local pool", 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.240 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.241 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.242 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.243 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.244 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.245 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "min_size": { 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_size", 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default min_size for any created local pool", 2024-09-19T07:32:18.246 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T07:32:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "num_rep": { 2024-09-19T07:32:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "num_rep", 2024-09-19T07:32:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3", 2024-09-19T07:32:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.247 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default replica count for any created local pool", 2024-09-19T07:32:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_num": { 2024-09-19T07:32:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_num", 2024-09-19T07:32:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.248 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "128", 2024-09-19T07:32:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T07:32:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: "prefix": { 2024-09-19T07:32:18.249 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prefix", 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name prefix for any created local pool", 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "subtree": { 2024-09-19T07:32:18.250 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "subtree", 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "rack", 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.251 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mds_autoscaler", 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.252 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.253 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.254 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.255 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.256 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.257 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirroring", 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.258 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.260 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.261 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.262 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "nfs", 2024-09-19T07:32:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.264 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.265 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.266 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.267 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.268 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.269 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: "fail_fs": { 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "fail_fs", 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.270 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.271 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.272 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.273 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.274 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.275 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator": { 2024-09-19T07:32:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-19T07:32:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm", 2024-09-19T07:32:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "rook", 2024-09-19T07:32:18.277 INFO:teuthology.orchestra.run.smithi098.stdout: "test_orchestrator" 2024-09-19T07:32:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Orchestrator backend", 2024-09-19T07:32:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_perf_query", 2024-09-19T07:32:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.278 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.279 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.280 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.281 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.283 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_support", 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.284 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.285 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.286 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.287 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.289 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_autoscaler", 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.290 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.291 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.292 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.293 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.296 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.297 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:18.298 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "threshold": { 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threshold", 2024-09-19T07:32:18.299 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-19T07:32:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1.0", 2024-09-19T07:32:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "scaling threshold", 2024-09-19T07:32:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T07:32:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.300 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "progress", 2024-09-19T07:32:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_pg_recovery_event": { 2024-09-19T07:32:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_pg_recovery_event", 2024-09-19T07:32:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.301 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.302 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.303 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.304 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.305 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.306 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.307 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: "max_completed_events": { 2024-09-19T07:32:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_completed_events", 2024-09-19T07:32:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "50", 2024-09-19T07:32:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "number of past completed events to remember", 2024-09-19T07:32:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long the module is going to sleep", 2024-09-19T07:32:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus", 2024-09-19T07:32:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: "cache": { 2024-09-19T07:32:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cache", 2024-09-19T07:32:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: "exclude_perf_counters": { 2024-09-19T07:32:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "exclude_perf_counters", 2024-09-19T07:32:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools": { 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools", 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T07:32:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T07:32:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "300", 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_interval": { 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_interval", 2024-09-19T07:32:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15.0", 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-19T07:32:18.322 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-19T07:32:18.323 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "9283", 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: "stale_cache_strategy": { 2024-09-19T07:32:18.324 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stale_cache_strategy", 2024-09-19T07:32:18.325 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.325 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.325 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.325 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "log", 2024-09-19T07:32:18.325 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.325 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.325 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.325 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.325 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.325 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.325 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "default", 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: "default", 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: "error" 2024-09-19T07:32:18.326 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-19T07:32:18.327 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-19T07:32:18.328 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.328 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.328 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.328 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.328 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.328 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.328 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.328 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_support", 2024-09-19T07:32:18.328 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.329 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.330 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.331 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.332 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.332 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.332 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.332 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.332 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.332 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.332 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.332 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.332 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.332 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.332 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.333 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_snap_create": { 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_snap_create", 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.334 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: "mirror_snapshot_schedule": { 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T07:32:18.335 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "trash_purge_schedule": { 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "trash_purge_schedule", 2024-09-19T07:32:18.336 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "restful", 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_auth": { 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_auth", 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.338 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.339 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.340 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.340 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.340 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.340 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.340 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.340 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.340 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.341 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.342 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.343 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.344 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.344 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.344 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.344 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.344 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.344 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.344 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.344 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.344 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.344 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.344 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.344 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.345 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.346 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.347 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rgw", 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.348 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.349 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.350 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.351 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.352 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.352 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.352 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.352 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.352 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.352 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.352 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.352 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.352 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.352 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.352 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.354 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.355 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rook", 2024-09-19T07:32:18.355 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.355 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.355 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.355 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.355 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.355 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.355 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.355 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.356 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.356 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.356 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.356 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.356 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.356 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.356 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.356 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.356 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.356 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.356 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.357 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.358 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.358 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.358 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.358 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.358 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.358 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.358 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.358 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.358 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.358 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.358 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.359 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.360 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "storage_class": { 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "storage_class", 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "local", 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.361 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "selftest", 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.362 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.363 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.363 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.363 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.363 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.363 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.363 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.363 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.363 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.363 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.363 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.363 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.363 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.364 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.364 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.364 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.364 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.364 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.364 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.364 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.364 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.364 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.364 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.364 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.365 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.366 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.367 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: "roption1": { 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption1", 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.368 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.369 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.369 INFO:teuthology.orchestra.run.smithi098.stdout: "roption2": { 2024-09-19T07:32:18.369 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption2", 2024-09-19T07:32:18.369 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.369 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.369 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.369 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "xyz", 2024-09-19T07:32:18.369 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.369 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.369 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.369 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.370 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.370 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.370 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.370 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption1": { 2024-09-19T07:32:18.370 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption1", 2024-09-19T07:32:18.370 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.370 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.370 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.370 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.370 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.370 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption2": { 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption2", 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.371 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.372 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.372 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.372 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.372 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.372 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.372 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.372 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption3": { 2024-09-19T07:32:18.372 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption3", 2024-09-19T07:32:18.372 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.372 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.372 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.373 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.373 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.373 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.373 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.373 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.373 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.373 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.373 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.373 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption4": { 2024-09-19T07:32:18.373 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption4", 2024-09-19T07:32:18.373 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption5": { 2024-09-19T07:32:18.374 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption5", 2024-09-19T07:32:18.375 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.375 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.375 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.375 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.375 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.375 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.375 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.375 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.375 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.375 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.375 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.376 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption6": { 2024-09-19T07:32:18.376 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption6", 2024-09-19T07:32:18.376 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.376 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.376 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.376 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.376 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.376 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.376 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.376 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.376 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.376 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption7": { 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption7", 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "42", 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.377 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.378 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.378 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.378 INFO:teuthology.orchestra.run.smithi098.stdout: "testkey": { 2024-09-19T07:32:18.378 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testkey", 2024-09-19T07:32:18.378 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.378 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.378 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.378 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.378 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.378 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.378 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.379 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.379 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.379 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.379 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.379 INFO:teuthology.orchestra.run.smithi098.stdout: "testlkey": { 2024-09-19T07:32:18.379 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testlkey", 2024-09-19T07:32:18.379 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.379 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.379 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.379 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.379 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: "testnewline": { 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testnewline", 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.380 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snap_schedule", 2024-09-19T07:32:18.381 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_m_granularity": { 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_m_granularity", 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.382 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: "dump_on_update": { 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dump_on_update", 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "dump database to debug log on update", 2024-09-19T07:32:18.383 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.384 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.385 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.386 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.387 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.388 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stats", 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.390 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.391 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.392 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.393 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.394 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "status", 2024-09-19T07:32:18.395 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.396 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.397 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.398 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.399 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.400 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.401 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.401 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.401 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.401 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.401 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.401 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.401 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.401 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telegraf", 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "address": { 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "address", 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.402 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15", 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.403 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.404 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.404 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.404 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.404 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.404 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.404 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.404 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.404 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.404 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.404 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.404 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.405 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.406 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.407 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.408 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.409 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.409 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.409 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.409 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.409 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.409 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.409 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.409 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.409 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.409 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.409 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.409 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telemetry", 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_basic": { 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_basic", 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.410 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_crash": { 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_crash", 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.411 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_device": { 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_device", 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.412 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.413 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.413 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T07:32:18.413 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.413 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.413 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.413 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_ident": { 2024-09-19T07:32:18.413 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_ident", 2024-09-19T07:32:18.413 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.413 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.413 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_perf": { 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_perf", 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.414 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.415 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.415 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.415 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.415 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.415 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T07:32:18.415 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.415 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.415 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.415 INFO:teuthology.orchestra.run.smithi098.stdout: "contact": { 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "contact", 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.416 INFO:teuthology.orchestra.run.smithi098.stdout: "description": { 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "description", 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.417 INFO:teuthology.orchestra.run.smithi098.stdout: "device_url": { 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_url", 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.418 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.419 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "24", 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "8", 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.420 INFO:teuthology.orchestra.run.smithi098.stdout: "last_opt_revision": { 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "last_opt_revision", 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1", 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard": { 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard", 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.422 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard_description": { 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard_description", 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.424 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.425 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.426 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.427 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.428 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: "organization": { 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "organization", 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.429 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: "proxy": { 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "proxy", 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.430 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: "url": { 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url", 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.431 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.432 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.432 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.432 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.432 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.432 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.432 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.432 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.432 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "test_orchestrator", 2024-09-19T07:32:18.432 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.433 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.433 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.433 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.433 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.433 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.433 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.433 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.433 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.433 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.433 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.433 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.433 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.434 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.435 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.436 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.436 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.436 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.436 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.436 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.436 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.436 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.436 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.436 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.436 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.436 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.436 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.437 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.438 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.438 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.438 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.438 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.438 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.438 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.438 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.438 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.438 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.439 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.440 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.440 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.440 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.440 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.440 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.440 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.440 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.440 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.440 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.440 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.440 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.442 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.443 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_clones": { 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_clones", 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.444 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4", 2024-09-19T07:32:18.445 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.445 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.445 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.445 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T07:32:18.445 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.445 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.445 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.445 INFO:teuthology.orchestra.run.smithi098.stdout: "periodic_async_work": { 2024-09-19T07:32:18.445 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "periodic_async_work", 2024-09-19T07:32:18.445 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.445 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Periodically check for async work", 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_delay": { 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_delay", 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.446 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_no_wait": { 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T07:32:18.447 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix", 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "discovery_interval": { 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "discovery_interval", 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "100", 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.449 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "identifier": { 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "identifier", 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.450 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.451 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.452 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.453 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.454 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.455 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.456 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_host": { 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_host", 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.457 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_port": { 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_port", 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10051", 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.458 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_sender": { 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_sender", 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.459 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.460 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.460 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.460 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.460 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.460 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.460 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.460 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.460 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.460 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-19T07:32:18.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.460 INFO:teuthology.orchestra.run.smithi098.stdout: "gid": 24746, 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "y", 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "mgr_features": 4540701547738038271, 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "available_modules": [ 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "alerts", 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:18.461 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.462 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.463 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.464 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.465 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.466 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.466 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.466 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.466 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.466 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.466 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.466 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.466 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.466 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.466 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_destination": { 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_destination", 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.467 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.468 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.468 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.468 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.468 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email address to send alerts to", 2024-09-19T07:32:18.468 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.468 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.468 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.468 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_from_name": { 2024-09-19T07:32:18.468 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_from_name", 2024-09-19T07:32:18.468 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "Ceph", 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email From: name", 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_host": { 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_host", 2024-09-19T07:32:18.469 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP server", 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_password": { 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_password", 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.470 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Password to authenticate with", 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_port": { 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_port", 2024-09-19T07:32:18.471 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "465", 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP port", 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_sender": { 2024-09-19T07:32:18.472 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_sender", 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP envelope sender", 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_ssl": { 2024-09-19T07:32:18.473 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_ssl", 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.474 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_user": { 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_user", 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "User to authenticate as", 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "balancer", 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: "active": { 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "active", 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.476 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.477 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.477 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T07:32:18.477 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.477 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.477 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.477 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_time": { 2024-09-19T07:32:18.477 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_time", 2024-09-19T07:32:18.477 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.477 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.477 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.478 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0000", 2024-09-19T07:32:18.478 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.478 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.478 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.478 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T07:32:18.478 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:32:18.478 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.478 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.478 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_weekday": { 2024-09-19T07:32:18.478 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_weekday", 2024-09-19T07:32:18.478 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.479 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.479 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.479 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.479 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-19T07:32:18.479 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-19T07:32:18.479 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.479 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T07:32:18.479 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:32:18.479 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.479 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.479 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_max_iterations": { 2024-09-19T07:32:18.480 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_max_iterations", 2024-09-19T07:32:18.480 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.480 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.480 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.480 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "25", 2024-09-19T07:32:18.480 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-19T07:32:18.480 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "250", 2024-09-19T07:32:18.480 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.480 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T07:32:18.480 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.480 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.480 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.481 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_metrics": { 2024-09-19T07:32:18.481 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_metrics", 2024-09-19T07:32:18.481 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.481 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.481 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.481 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T07:32:18.481 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.481 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.481 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.481 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_step": { 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_step", 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.5", 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0.001", 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "0.999", 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.482 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "aggressiveness of optimization", 2024-09-19T07:32:18.483 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T07:32:18.483 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.483 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.483 INFO:teuthology.orchestra.run.smithi098.stdout: "end_time": { 2024-09-19T07:32:18.483 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_time", 2024-09-19T07:32:18.483 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.483 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.483 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.483 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2359", 2024-09-19T07:32:18.483 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.483 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: "end_weekday": { 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_weekday", 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.484 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.485 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.486 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.487 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.488 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.489 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: "min_score": { 2024-09-19T07:32:18.490 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_score", 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.491 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-19T07:32:18.492 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-19T07:32:18.492 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.492 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.492 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.492 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "upmap", 2024-09-19T07:32:18.492 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.492 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.492 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.492 INFO:teuthology.orchestra.run.smithi098.stdout: "crush-compat", 2024-09-19T07:32:18.492 INFO:teuthology.orchestra.run.smithi098.stdout: "none", 2024-09-19T07:32:18.492 INFO:teuthology.orchestra.run.smithi098.stdout: "read", 2024-09-19T07:32:18.492 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap", 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap-read" 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Balancer mode", 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_ids": { 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_ids", 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.493 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.494 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.494 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.494 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T07:32:18.494 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.494 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.494 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.494 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:18.494 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:18.494 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.494 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.494 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_deviation": { 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_deviation", 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.495 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.496 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:18.496 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-19T07:32:18.496 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.496 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.496 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T07:32:18.496 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T07:32:18.496 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.496 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.496 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_optimizations": { 2024-09-19T07:32:18.496 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_optimizations", 2024-09-19T07:32:18.496 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.498 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm", 2024-09-19T07:32:18.498 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.498 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.498 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.498 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_down_multiplier": { 2024-09-19T07:32:18.498 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_down_multiplier", 2024-09-19T07:32:18.498 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.498 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.498 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_refresh_rate": { 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_refresh_rate", 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.500 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "20", 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_starting_port": { 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_starting_port", 2024-09-19T07:32:18.501 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4721", 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_ptrace": { 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_ptrace", 2024-09-19T07:32:18.502 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_interval": { 2024-09-19T07:32:18.503 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_interval", 2024-09-19T07:32:18.504 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.504 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.504 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.504 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.504 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.504 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.504 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.504 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T07:32:18.504 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.504 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.504 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_memory_target_ratio": { 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.7", 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.505 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm_log_destination": { 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm_log_destination", 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "file", 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "file,syslog", 2024-09-19T07:32:18.506 INFO:teuthology.orchestra.run.smithi098.stdout: "syslog" 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: "cgroups_split": { 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cgroups_split", 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.507 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "config_checks_enabled": { 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_checks_enabled", 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.508 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.509 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.509 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.509 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T07:32:18.509 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.509 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.509 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.509 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.509 INFO:teuthology.orchestra.run.smithi098.stdout: "config_dashboard": { 2024-09-19T07:32:18.509 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_dashboard", 2024-09-19T07:32:18.509 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.509 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.509 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.510 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.510 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.510 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.510 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.510 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T07:32:18.510 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.510 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.510 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.510 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.510 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_alertmanager": { 2024-09-19T07:32:18.510 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_alertmanager", 2024-09-19T07:32:18.511 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.511 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.511 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.511 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T07:32:18.511 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.511 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.511 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.511 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-19T07:32:18.511 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.511 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.511 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.511 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.512 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_base": { 2024-09-19T07:32:18.512 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_base", 2024-09-19T07:32:18.512 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.512 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.512 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.512 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T07:32:18.512 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.512 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.512 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.512 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Container image name, without the tag", 2024-09-19T07:32:18.512 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.512 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_elasticsearch": { 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_elasticsearch", 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "elasticsearch container image", 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.513 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_grafana": { 2024-09-19T07:32:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_grafana", 2024-09-19T07:32:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T07:32:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.514 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-19T07:32:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_haproxy": { 2024-09-19T07:32:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_haproxy", 2024-09-19T07:32:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.515 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T07:32:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "HAproxy container image", 2024-09-19T07:32:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_agent": { 2024-09-19T07:32:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_agent", 2024-09-19T07:32:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.516 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.517 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.517 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T07:32:18.517 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.517 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.517 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.517 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger agent container image", 2024-09-19T07:32:18.517 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.517 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.517 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.517 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.518 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_collector": { 2024-09-19T07:32:18.518 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_collector", 2024-09-19T07:32:18.518 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.518 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.518 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.518 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T07:32:18.518 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.518 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.518 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.518 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger collector container image", 2024-09-19T07:32:18.518 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_query": { 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_query", 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.519 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger query container image", 2024-09-19T07:32:18.520 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.520 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.520 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.520 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.520 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_keepalived": { 2024-09-19T07:32:18.520 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_keepalived", 2024-09-19T07:32:18.520 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.520 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.520 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.520 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T07:32:18.520 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.521 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.521 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.521 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Keepalived container image", 2024-09-19T07:32:18.521 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.521 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.521 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.521 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.521 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_loki": { 2024-09-19T07:32:18.521 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_loki", 2024-09-19T07:32:18.521 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.521 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.521 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Loki container image", 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_node_exporter": { 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_node_exporter", 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.522 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_nvmeof": { 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_nvmeof", 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.523 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Nvme-of container image", 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_prometheus": { 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_prometheus", 2024-09-19T07:32:18.524 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.525 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.525 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.525 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T07:32:18.525 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.525 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.525 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.525 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-19T07:32:18.525 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.525 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.525 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.525 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.525 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_promtail": { 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_promtail", 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Promtail container image", 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.526 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_samba": { 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_samba", 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Samba/SMB container image", 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.527 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.528 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_snmp_gateway": { 2024-09-19T07:32:18.528 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_snmp_gateway", 2024-09-19T07:32:18.528 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.528 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.528 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.528 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T07:32:18.528 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.528 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.528 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.528 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SNMP Gateway container image", 2024-09-19T07:32:18.528 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: "container_init": { 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_init", 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.529 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: "daemon_cache_timeout": { 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "daemon_cache_timeout", 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.530 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "default_cephadm_command_timeout": { 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "900", 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.531 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.532 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T07:32:18.532 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.532 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.532 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.532 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.532 INFO:teuthology.orchestra.run.smithi098.stdout: "default_registry": { 2024-09-19T07:32:18.532 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_registry", 2024-09-19T07:32:18.532 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.532 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.532 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.532 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io", 2024-09-19T07:32:18.532 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.533 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.533 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.533 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T07:32:18.533 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.533 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.533 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.533 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.533 INFO:teuthology.orchestra.run.smithi098.stdout: "device_cache_timeout": { 2024-09-19T07:32:18.533 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_cache_timeout", 2024-09-19T07:32:18.533 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.533 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.533 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1800", 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache device inventory", 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: "device_enhanced_scan": { 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_enhanced_scan", 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.534 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.535 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.535 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.535 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.535 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.535 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.535 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T07:32:18.535 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.535 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.535 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.535 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.535 INFO:teuthology.orchestra.run.smithi098.stdout: "facts_cache_timeout": { 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "facts_cache_timeout", 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache host facts data", 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.536 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "grafana_dashboards_path": { 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "grafana_dashboards_path", 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.537 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "host_check_interval": { 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "host_check_interval", 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to perform a host check", 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.538 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "hw_monitoring": { 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hw_monitoring", 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.539 INFO:teuthology.orchestra.run.smithi098.stdout: "inventory_list_all": { 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "inventory_list_all", 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.540 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.541 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: "log_refresh_metadata": { 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_refresh_metadata", 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.542 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.543 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.544 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.545 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.545 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.545 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.545 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.545 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.545 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.545 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.545 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.545 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.545 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.545 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.545 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.546 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.547 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.548 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "*", 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "max_count_per_host": { 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_count_per_host", 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.549 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of daemons per service per host", 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "max_osd_draining_count": { 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_osd_draining_count", 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.550 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.551 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.551 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.551 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.551 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T07:32:18.551 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.551 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.551 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.551 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.551 INFO:teuthology.orchestra.run.smithi098.stdout: "migration_current": { 2024-09-19T07:32:18.551 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "migration_current", 2024-09-19T07:32:18.551 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.551 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "internal - do not modify", 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-19T07:32:18.552 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "root", 2024-09-19T07:32:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm-package", 2024-09-19T07:32:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: "root" 2024-09-19T07:32:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T07:32:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.553 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "oob_default_addr": { 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "oob_default_addr", 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "169.254.1.1", 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.554 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.555 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.555 INFO:teuthology.orchestra.run.smithi098.stdout: "prometheus_alerts_path": { 2024-09-19T07:32:18.555 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus_alerts_path", 2024-09-19T07:32:18.555 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.555 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.555 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.555 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T07:32:18.555 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.555 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.555 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.555 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T07:32:18.555 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_insecure": { 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_insecure", 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.556 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_password": { 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_password", 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.557 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_url": { 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_url", 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.558 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_username": { 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_username", 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.559 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: "secure_monitoring_stack": { 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secure_monitoring_stack", 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.560 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.561 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.561 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.561 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T07:32:18.561 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.561 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.561 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.561 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.561 INFO:teuthology.orchestra.run.smithi098.stdout: "service_discovery_port": { 2024-09-19T07:32:18.561 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "service_discovery_port", 2024-09-19T07:32:18.561 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.561 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.561 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8765", 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "cephadm service discovery port", 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_config_file": { 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_config_file", 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.562 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: "use_agent": { 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_agent", 2024-09-19T07:32:18.563 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: "use_repo_digest": { 2024-09-19T07:32:18.564 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_repo_digest", 2024-09-19T07:32:18.565 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.565 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.565 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.565 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.565 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.565 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.565 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.565 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T07:32:18.565 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.565 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.565 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.565 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_failed_host_check": { 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_failed_host_check", 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.566 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_daemons": { 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_daemons", 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.567 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_hosts": { 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_hosts", 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.568 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crash", 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.569 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.570 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.570 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.570 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.570 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.570 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.570 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.570 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.570 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.570 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.570 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.570 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.572 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.573 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.574 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "retain_interval": { 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retain_interval", 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "31536000", 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.575 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_recent_interval": { 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_recent_interval", 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1209600", 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T07:32:18.576 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dashboard", 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T07:32:18.577 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T07:32:18.578 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T07:32:18.579 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.580 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_ENABLED": { 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.581 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.582 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.583 INFO:teuthology.orchestra.run.smithi098.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T07:32:18.583 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T07:32:18.583 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.583 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.583 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.583 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.583 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.583 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.583 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.583 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.583 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.583 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.584 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.585 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.586 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.587 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.588 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.589 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.589 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.589 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.589 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.589 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.589 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.589 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.589 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T07:32:18.589 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T07:32:18.589 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.589 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.589 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.590 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T07:32:18.591 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T07:32:18.592 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.593 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.594 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.595 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_URL": { 2024-09-19T07:32:18.595 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_URL", 2024-09-19T07:32:18.595 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.595 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.595 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.595 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.595 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.595 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.595 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.595 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.595 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.595 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.596 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.597 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.598 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.599 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.600 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.600 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.600 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.600 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.600 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.600 INFO:teuthology.orchestra.run.smithi098.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T07:32:18.600 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T07:32:18.600 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.600 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.600 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.600 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.600 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.601 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.602 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.603 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.604 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T07:32:18.605 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T07:32:18.606 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T07:32:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.608 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.609 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T07:32:18.609 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T07:32:18.609 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.609 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.609 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.609 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.609 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.609 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.609 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.609 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.609 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.610 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.611 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.612 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.613 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.614 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8", 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.615 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.616 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "45", 2024-09-19T07:32:18.616 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.616 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.616 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.616 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.616 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.616 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.616 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.616 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.616 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T07:32:18.616 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T07:32:18.616 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T07:32:18.617 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T07:32:18.618 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.618 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.618 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.618 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-19T07:32:18.618 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.618 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.618 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.618 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.618 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.618 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.618 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.618 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.619 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.620 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.621 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.622 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.622 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.622 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T07:32:18.622 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T07:32:18.622 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.622 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.622 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.622 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.622 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.622 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.622 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.623 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.624 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.624 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.624 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.624 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.624 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.624 INFO:teuthology.orchestra.run.smithi098.stdout: "cross_origin_url": { 2024-09-19T07:32:18.624 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cross_origin_url", 2024-09-19T07:32:18.624 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.624 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.624 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.624 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: "crt_file": { 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crt_file", 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.625 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.626 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.626 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.626 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.626 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.626 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.626 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.626 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.626 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.626 INFO:teuthology.orchestra.run.smithi098.stdout: "debug": { 2024-09-19T07:32:18.626 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "debug", 2024-09-19T07:32:18.626 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable/disable debug options", 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "jwt_token_ttl": { 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "jwt_token_ttl", 2024-09-19T07:32:18.627 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "28800", 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-19T07:32:18.628 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.629 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.630 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.631 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.632 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.633 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "motd": { 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "motd", 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "The message of the day", 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.635 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect_resolve_ip_addr": { 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.636 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.637 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8080", 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.638 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.639 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl_server_port": { 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl_server_port", 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8443", 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.640 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.641 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.641 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-19T07:32:18.641 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-19T07:32:18.641 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.641 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.641 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.641 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "redirect", 2024-09-19T07:32:18.641 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.641 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.641 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.641 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.642 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect" 2024-09-19T07:32:18.642 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.642 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.642 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.642 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.642 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.642 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-19T07:32:18.642 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-19T07:32:18.642 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.642 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.643 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.643 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-19T07:32:18.643 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-19T07:32:18.643 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-19T07:32:18.643 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.643 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.643 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.643 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.643 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.643 INFO:teuthology.orchestra.run.smithi098.stdout: "url_prefix": { 2024-09-19T07:32:18.643 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url_prefix", 2024-09-19T07:32:18.644 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.644 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.644 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.644 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.644 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.644 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.644 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.644 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.644 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.644 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.644 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "devicehealth", 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_monitoring": { 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_monitoring", 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.645 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.646 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.646 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.646 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.646 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.646 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "monitor device health metrics", 2024-09-19T07:32:18.646 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.646 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.646 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.646 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.646 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.646 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.647 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.647 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.647 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.647 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.647 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.647 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.647 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.647 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.647 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.647 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.647 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.647 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.648 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.648 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.648 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.648 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.648 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.648 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.648 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.648 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.648 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.648 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.648 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.649 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.649 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.649 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.649 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.649 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.649 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.649 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.649 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.649 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.649 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.649 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.650 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.651 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "mark_out_threshold": { 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mark_out_threshold", 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2419200", 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.652 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_name": { 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_name", 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "device_health_metrics", 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.653 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: "retention_period": { 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retention_period", 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15552000", 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain device health metrics", 2024-09-19T07:32:18.654 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_frequency": { 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_frequency", 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.655 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: "self_heal": { 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "self_heal", 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T07:32:18.656 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.657 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_threshold": { 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_threshold", 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7257600", 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.658 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T07:32:18.659 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.659 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.659 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.659 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.659 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "diskprediction_local", 2024-09-19T07:32:18.659 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.659 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.659 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.660 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.660 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.660 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.660 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.660 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.660 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.660 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.660 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.660 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.660 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.660 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.660 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.661 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.662 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.663 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.664 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "predict_interval": { 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predict_interval", 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.665 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "predictor_model": { 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predictor_model", 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "prophetstor", 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.666 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.667 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "influx", 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": false, 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "influxdb python module not found", 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: "batch_size": { 2024-09-19T07:32:18.668 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "batch_size", 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5000", 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.669 INFO:teuthology.orchestra.run.smithi098.stdout: "database": { 2024-09-19T07:32:18.670 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "database", 2024-09-19T07:32:18.670 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.670 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.670 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.670 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "ceph", 2024-09-19T07:32:18.670 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.670 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.670 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.670 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T07:32:18.670 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.670 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": { 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hostname", 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server hostname", 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.671 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.672 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.672 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:18.672 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:18.672 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.672 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.672 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.672 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "30", 2024-09-19T07:32:18.672 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "5", 2024-09-19T07:32:18.672 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.672 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.673 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.674 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.674 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.674 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.674 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.674 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.674 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.674 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.674 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.674 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.674 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.674 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.675 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.675 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.675 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.675 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.675 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.675 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.675 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.675 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.675 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.675 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.676 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.676 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.676 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.676 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.676 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.676 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.676 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.676 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.676 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.676 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.676 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.678 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.679 INFO:teuthology.orchestra.run.smithi098.stdout: "password": { 2024-09-19T07:32:18.679 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "password", 2024-09-19T07:32:18.679 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.679 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.679 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.679 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.679 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.679 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.679 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.679 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "password of InfluxDB server user", 2024-09-19T07:32:18.679 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "port": { 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "port", 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8086", 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server port", 2024-09-19T07:32:18.680 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.681 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.681 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.681 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-19T07:32:18.681 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-19T07:32:18.681 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.681 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.681 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.681 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "false", 2024-09-19T07:32:18.681 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.681 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.681 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: "threads": { 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threads", 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-19T07:32:18.682 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "32", 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "username": { 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "username", 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.683 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.684 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "username of InfluxDB server user", 2024-09-19T07:32:18.684 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.684 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.684 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.684 INFO:teuthology.orchestra.run.smithi098.stdout: "verify_ssl": { 2024-09-19T07:32:18.684 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "verify_ssl", 2024-09-19T07:32:18.684 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.684 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.684 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.684 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "true", 2024-09-19T07:32:18.684 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "insights", 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.685 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.686 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.687 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.688 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.689 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.690 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "iostat", 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.691 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.692 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.693 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.694 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.695 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "k8sevents", 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.696 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_event_retention_days": { 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ceph_event_retention_days", 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7", 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "config_check_secs": { 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_check_secs", 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "10", 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.699 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.700 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.701 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.702 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.703 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "localpool", 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "failure_domain": { 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "failure_domain", 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "host", 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.705 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "failure domain for any created local pool", 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.706 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.707 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.708 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.709 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.710 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "min_size": { 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_size", 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.711 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default min_size for any created local pool", 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "num_rep": { 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "num_rep", 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.712 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3", 2024-09-19T07:32:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default replica count for any created local pool", 2024-09-19T07:32:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_num": { 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_num", 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "128", 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "prefix": { 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prefix", 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name prefix for any created local pool", 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.715 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "subtree": { 2024-09-19T07:32:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "subtree", 2024-09-19T07:32:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "rack", 2024-09-19T07:32:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T07:32:18.716 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mds_autoscaler", 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.717 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.718 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.719 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.720 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.721 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirroring", 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.723 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.724 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.726 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.727 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.728 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "nfs", 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.729 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.730 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.731 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.732 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.733 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "fail_fs": { 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "fail_fs", 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.735 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.736 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.737 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.738 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.739 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.740 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator": { 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-19T07:32:18.741 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm", 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "rook", 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "test_orchestrator" 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Orchestrator backend", 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.742 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_perf_query", 2024-09-19T07:32:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.743 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.744 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.745 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.746 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.747 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.748 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_support", 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.749 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.750 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.751 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.752 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.753 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_autoscaler", 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.755 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.756 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.757 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.758 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.759 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.760 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "threshold": { 2024-09-19T07:32:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threshold", 2024-09-19T07:32:18.761 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1.0", 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "scaling threshold", 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "progress", 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_pg_recovery_event": { 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_pg_recovery_event", 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.763 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T07:32:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-19T07:32:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-19T07:32:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.764 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.765 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.766 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.767 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.768 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.769 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "max_completed_events": { 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_completed_events", 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.770 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "50", 2024-09-19T07:32:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "number of past completed events to remember", 2024-09-19T07:32:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long the module is going to sleep", 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.772 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus", 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "cache": { 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cache", 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.773 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "exclude_perf_counters": { 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "exclude_perf_counters", 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.774 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.775 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.776 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.777 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.778 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.779 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.780 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools": { 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools", 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.781 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "300", 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.782 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_interval": { 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_interval", 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15.0", 2024-09-19T07:32:18.783 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.784 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.785 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "9283", 2024-09-19T07:32:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T07:32:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "stale_cache_strategy": { 2024-09-19T07:32:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stale_cache_strategy", 2024-09-19T07:32:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.786 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "log", 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.787 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "default", 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "default", 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "error" 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.789 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_support", 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.790 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.791 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.792 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.793 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.794 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_snap_create": { 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_snap_create", 2024-09-19T07:32:18.795 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "mirror_snapshot_schedule": { 2024-09-19T07:32:18.796 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "trash_purge_schedule": { 2024-09-19T07:32:18.797 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "trash_purge_schedule", 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "restful", 2024-09-19T07:32:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_auth": { 2024-09-19T07:32:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_auth", 2024-09-19T07:32:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.799 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.800 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.801 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.802 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.803 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.804 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.805 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-19T07:32:18.806 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-19T07:32:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.807 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.808 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rgw", 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.809 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.810 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.811 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.812 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.813 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T07:32:18.814 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T07:32:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.815 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rook", 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.816 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.817 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.818 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.819 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.820 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.821 INFO:teuthology.orchestra.run.smithi098.stdout: "storage_class": { 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "storage_class", 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "local", 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "selftest", 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.823 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.824 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.825 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.826 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.827 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "roption1": { 2024-09-19T07:32:18.828 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption1", 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.829 INFO:teuthology.orchestra.run.smithi098.stdout: "roption2": { 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption2", 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "xyz", 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption1": { 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption1", 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption2": { 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption2", 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.832 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption3": { 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption3", 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.833 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption4": { 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption4", 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.834 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption5": { 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption5", 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.835 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption6": { 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption6", 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.836 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption7": { 2024-09-19T07:32:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption7", 2024-09-19T07:32:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-19T07:32:18.837 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "42", 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "testkey": { 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testkey", 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "testlkey": { 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testlkey", 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "testnewline": { 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testnewline", 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snap_schedule", 2024-09-19T07:32:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_m_granularity": { 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_m_granularity", 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "dump_on_update": { 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dump_on_update", 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "dump database to debug log on update", 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stats", 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "status", 2024-09-19T07:32:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telegraf", 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "address": { 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "address", 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T07:32:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15", 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telemetry", 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_basic": { 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_basic", 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_crash": { 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_crash", 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_device": { 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_device", 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_ident": { 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_ident", 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_perf": { 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_perf", 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T07:32:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "contact": { 2024-09-19T07:32:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "contact", 2024-09-19T07:32:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "description": { 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "description", 2024-09-19T07:32:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "device_url": { 2024-09-19T07:32:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_url", 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-19T07:32:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-19T07:32:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "24", 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "8", 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "last_opt_revision": { 2024-09-19T07:32:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "last_opt_revision", 2024-09-19T07:32:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1", 2024-09-19T07:32:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard": { 2024-09-19T07:32:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard", 2024-09-19T07:32:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard_description": { 2024-09-19T07:32:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard_description", 2024-09-19T07:32:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "organization": { 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "organization", 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "proxy": { 2024-09-19T07:32:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "proxy", 2024-09-19T07:32:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "url": { 2024-09-19T07:32:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url", 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "test_orchestrator", 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_clones": { 2024-09-19T07:32:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_clones", 2024-09-19T07:32:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4", 2024-09-19T07:32:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T07:32:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "periodic_async_work": { 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "periodic_async_work", 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Periodically check for async work", 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_delay": { 2024-09-19T07:32:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_delay", 2024-09-19T07:32:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_no_wait": { 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix", 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "discovery_interval": { 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "discovery_interval", 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "100", 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "identifier": { 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "identifier", 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_host": { 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_host", 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_port": { 2024-09-19T07:32:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_port", 2024-09-19T07:32:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10051", 2024-09-19T07:32:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_sender": { 2024-09-19T07:32:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_sender", 2024-09-19T07:32:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "modules": [ 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm", 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "dashboard", 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "iostat", 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "nfs", 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "restful", 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "snap_schedule" 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "available_modules": [ 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "alerts", 2024-09-19T07:32:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.931 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.931 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.931 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.931 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.931 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_destination": { 2024-09-19T07:32:18.931 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_destination", 2024-09-19T07:32:18.931 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.931 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.931 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.931 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.931 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email address to send alerts to", 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_from_name": { 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_from_name", 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.932 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "Ceph", 2024-09-19T07:32:18.933 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.933 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.933 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.933 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Email From: name", 2024-09-19T07:32:18.933 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.933 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.933 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.933 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_host": { 2024-09-19T07:32:18.933 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_host", 2024-09-19T07:32:18.933 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.933 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP server", 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_password": { 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_password", 2024-09-19T07:32:18.934 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Password to authenticate with", 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_port": { 2024-09-19T07:32:18.935 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_port", 2024-09-19T07:32:18.936 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.936 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.936 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.936 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "465", 2024-09-19T07:32:18.936 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.936 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.936 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.936 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP port", 2024-09-19T07:32:18.936 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.936 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.936 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.937 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_sender": { 2024-09-19T07:32:18.937 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_sender", 2024-09-19T07:32:18.937 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.937 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.937 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.937 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.937 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.937 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.937 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.937 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SMTP envelope sender", 2024-09-19T07:32:18.937 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.937 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.938 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.938 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_ssl": { 2024-09-19T07:32:18.938 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_ssl", 2024-09-19T07:32:18.938 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.938 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.938 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.938 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.938 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.938 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.938 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.938 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "smtp_user": { 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "smtp_user", 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.939 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "User to authenticate as", 2024-09-19T07:32:18.940 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.940 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.940 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.940 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.940 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.940 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "balancer", 2024-09-19T07:32:18.940 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.940 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.940 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.940 INFO:teuthology.orchestra.run.smithi098.stdout: "active": { 2024-09-19T07:32:18.941 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "active", 2024-09-19T07:32:18.941 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.941 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.941 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.941 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.941 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.941 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.941 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.941 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T07:32:18.941 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.941 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.941 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_time": { 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_time", 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0000", 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.942 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.943 INFO:teuthology.orchestra.run.smithi098.stdout: "begin_weekday": { 2024-09-19T07:32:18.943 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "begin_weekday", 2024-09-19T07:32:18.943 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.943 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.943 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.943 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.943 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-19T07:32:18.943 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-19T07:32:18.943 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.943 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T07:32:18.943 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:32:18.944 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.944 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.944 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_max_iterations": { 2024-09-19T07:32:18.944 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_max_iterations", 2024-09-19T07:32:18.944 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.944 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.944 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.944 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "25", 2024-09-19T07:32:18.944 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-19T07:32:18.944 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "250", 2024-09-19T07:32:18.944 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T07:32:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_metrics": { 2024-09-19T07:32:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_metrics", 2024-09-19T07:32:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T07:32:18.945 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T07:32:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T07:32:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: "crush_compat_step": { 2024-09-19T07:32:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crush_compat_step", 2024-09-19T07:32:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.946 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.5", 2024-09-19T07:32:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0.001", 2024-09-19T07:32:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "0.999", 2024-09-19T07:32:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "aggressiveness of optimization", 2024-09-19T07:32:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T07:32:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: "end_time": { 2024-09-19T07:32:18.947 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_time", 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2359", 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.948 INFO:teuthology.orchestra.run.smithi098.stdout: "end_weekday": { 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "end_weekday", 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "0", 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "6", 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.950 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:18.950 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:18.950 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.950 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.950 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.950 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.950 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.950 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.950 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.950 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.950 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.950 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.951 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.952 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.952 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.952 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.952 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.952 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.952 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.952 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.952 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.952 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.952 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:18.952 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:18.953 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.953 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.953 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.953 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:18.953 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.953 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.953 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.953 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:18.953 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:18.953 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:18.953 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:18.953 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:18.954 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:18.954 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.954 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.954 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.954 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.954 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.954 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:18.954 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:18.954 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.954 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.954 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: "min_score": { 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_score", 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.955 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.956 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.956 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:18.956 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.956 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.956 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.956 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T07:32:18.956 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.956 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.956 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.956 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-19T07:32:18.957 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-19T07:32:18.957 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.957 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.957 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.957 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "upmap", 2024-09-19T07:32:18.957 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.957 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.957 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.957 INFO:teuthology.orchestra.run.smithi098.stdout: "crush-compat", 2024-09-19T07:32:18.957 INFO:teuthology.orchestra.run.smithi098.stdout: "none", 2024-09-19T07:32:18.957 INFO:teuthology.orchestra.run.smithi098.stdout: "read", 2024-09-19T07:32:18.957 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap", 2024-09-19T07:32:18.958 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap-read" 2024-09-19T07:32:18.958 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.958 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Balancer mode", 2024-09-19T07:32:18.958 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.958 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.958 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.958 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_ids": { 2024-09-19T07:32:18.958 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_ids", 2024-09-19T07:32:18.958 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.958 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.958 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.959 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_deviation": { 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_deviation", 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.960 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "upmap_max_optimizations": { 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "upmap_max_optimizations", 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:18.961 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:18.962 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm", 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_down_multiplier": { 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_down_multiplier", 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T07:32:18.963 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_refresh_rate": { 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_refresh_rate", 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "20", 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.964 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T07:32:18.965 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.965 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.965 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.965 INFO:teuthology.orchestra.run.smithi098.stdout: "agent_starting_port": { 2024-09-19T07:32:18.965 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "agent_starting_port", 2024-09-19T07:32:18.965 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.965 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.965 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.965 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4721", 2024-09-19T07:32:18.965 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.965 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_ptrace": { 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_ptrace", 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.966 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_interval": { 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_interval", 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.967 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "autotune_memory_target_ratio": { 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.968 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0.7", 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm_log_destination": { 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cephadm_log_destination", 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.969 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: "file", 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: "file,syslog", 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: "syslog" 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.970 INFO:teuthology.orchestra.run.smithi098.stdout: "cgroups_split": { 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cgroups_split", 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.971 INFO:teuthology.orchestra.run.smithi098.stdout: "config_checks_enabled": { 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_checks_enabled", 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.972 INFO:teuthology.orchestra.run.smithi098.stdout: "config_dashboard": { 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_dashboard", 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.973 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_alertmanager": { 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_alertmanager", 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_base": { 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_base", 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Container image name, without the tag", 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.975 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.976 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_elasticsearch": { 2024-09-19T07:32:18.976 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_elasticsearch", 2024-09-19T07:32:18.976 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.976 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.976 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.976 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T07:32:18.976 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.976 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.976 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.976 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "elasticsearch container image", 2024-09-19T07:32:18.976 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_grafana": { 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_grafana", 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-19T07:32:18.977 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_haproxy": { 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_haproxy", 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "HAproxy container image", 2024-09-19T07:32:18.978 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_agent": { 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_agent", 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.979 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger agent container image", 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_collector": { 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_collector", 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.980 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger collector container image", 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_jaeger_query": { 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_jaeger_query", 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.981 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Jaeger query container image", 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_keepalived": { 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_keepalived", 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.982 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Keepalived container image", 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_loki": { 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_loki", 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.983 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Loki container image", 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_node_exporter": { 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_node_exporter", 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.984 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_nvmeof": { 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_nvmeof", 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.985 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Nvme-of container image", 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_prometheus": { 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_prometheus", 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.986 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Prometheus container image", 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_promtail": { 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_promtail", 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T07:32:18.987 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Promtail container image", 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_samba": { 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_samba", 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T07:32:18.988 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Samba/SMB container image", 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "container_image_snmp_gateway": { 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_image_snmp_gateway", 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T07:32:18.989 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "SNMP Gateway container image", 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "container_init": { 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "container_init", 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:18.990 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "daemon_cache_timeout": { 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "daemon_cache_timeout", 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.991 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.992 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.992 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.992 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T07:32:18.992 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.992 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.992 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.992 INFO:teuthology.orchestra.run.smithi098.stdout: "default_cephadm_command_timeout": { 2024-09-19T07:32:18.992 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T07:32:18.992 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:18.992 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.992 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "900", 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "default_registry": { 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "default_registry", 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.993 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "docker.io", 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: "device_cache_timeout": { 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_cache_timeout", 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.994 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1800", 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache device inventory", 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: "device_enhanced_scan": { 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_enhanced_scan", 2024-09-19T07:32:18.995 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "facts_cache_timeout": { 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "facts_cache_timeout", 2024-09-19T07:32:18.996 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "seconds to cache host facts data", 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "grafana_dashboards_path": { 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "grafana_dashboards_path", 2024-09-19T07:32:18.997 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:18.998 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.998 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.998 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T07:32:18.998 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.998 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.998 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.998 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T07:32:18.998 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.998 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.998 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:18.998 INFO:teuthology.orchestra.run.smithi098.stdout: "host_check_interval": { 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "host_check_interval", 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to perform a host check", 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:18.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "hw_monitoring": { 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hw_monitoring", 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "inventory_list_all": { 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "inventory_list_all", 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.002 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: "log_refresh_metadata": { 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_refresh_metadata", 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.003 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.004 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.005 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.006 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.007 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.008 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "*", 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T07:32:19.009 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "max_count_per_host": { 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_count_per_host", 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of daemons per service per host", 2024-09-19T07:32:19.010 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "max_osd_draining_count": { 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_osd_draining_count", 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.011 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "migration_current": { 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "migration_current", 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "internal - do not modify", 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.012 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "mode": { 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mode", 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "root", 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm-package", 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "root" 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.013 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "oob_default_addr": { 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "oob_default_addr", 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "169.254.1.1", 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.014 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "prometheus_alerts_path": { 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus_alerts_path", 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T07:32:19.015 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_insecure": { 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_insecure", 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.016 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_password": { 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_password", 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.017 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T07:32:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_url": { 2024-09-19T07:32:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_url", 2024-09-19T07:32:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.018 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: "registry_username": { 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "registry_username", 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.019 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: "secure_monitoring_stack": { 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secure_monitoring_stack", 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.020 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "service_discovery_port": { 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "service_discovery_port", 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.021 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8765", 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "cephadm service discovery port", 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: "ssh_config_file": { 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssh_config_file", 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.022 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: "use_agent": { 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_agent", 2024-09-19T07:32:19.023 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "use_repo_digest": { 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "use_repo_digest", 2024-09-19T07:32:19.024 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_failed_host_check": { 2024-09-19T07:32:19.025 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_failed_host_check", 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_daemons": { 2024-09-19T07:32:19.026 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_daemons", 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.027 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_on_stray_hosts": { 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_on_stray_hosts", 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.028 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crash", 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.029 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.031 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.031 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.031 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.031 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.031 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.031 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.031 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.031 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.031 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.031 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.031 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.031 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.032 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.032 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.032 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.032 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.032 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.032 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.032 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.032 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.032 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.032 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.032 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.033 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: "retain_interval": { 2024-09-19T07:32:19.034 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retain_interval", 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "31536000", 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_recent_interval": { 2024-09-19T07:32:19.036 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_recent_interval", 2024-09-19T07:32:19.036 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:19.036 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.036 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.036 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1209600", 2024-09-19T07:32:19.036 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.036 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.036 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.036 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T07:32:19.036 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.036 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.036 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.037 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.037 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.037 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dashboard", 2024-09-19T07:32:19.037 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.037 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.037 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.037 INFO:teuthology.orchestra.run.smithi098.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T07:32:19.037 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T07:32:19.037 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T07:32:19.038 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T07:32:19.039 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T07:32:19.040 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.040 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.040 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.040 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.040 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.040 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.040 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.040 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.040 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.040 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.040 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_ENABLED": { 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.041 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.042 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.043 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.044 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.045 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.045 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.045 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.045 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T07:32:19.045 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T07:32:19.045 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.045 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.045 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.045 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.045 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.045 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.046 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.047 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.048 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.049 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.050 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.051 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.052 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.053 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_URL": { 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_URL", 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.054 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.055 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.055 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.055 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.055 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.055 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.055 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T07:32:19.055 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T07:32:19.055 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.055 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.055 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.055 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.056 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.057 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.058 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.059 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.060 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.061 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.062 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.063 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.064 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.065 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.066 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.067 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.068 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.068 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.068 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.068 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.068 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.068 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.068 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.068 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.068 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T07:32:19.068 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.069 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.071 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T07:32:19.071 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T07:32:19.071 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.071 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.071 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.071 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T07:32:19.071 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.071 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.071 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.071 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.071 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.072 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8", 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.073 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.074 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.074 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.074 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.074 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.074 INFO:teuthology.orchestra.run.smithi098.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T07:32:19.074 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T07:32:19.074 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.074 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.074 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.074 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "45", 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.075 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.076 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.077 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "admin", 2024-09-19T07:32:19.077 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.077 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.077 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.077 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.077 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.077 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.077 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.077 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T07:32:19.077 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T07:32:19.077 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.078 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.078 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.078 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.078 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.078 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.078 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.078 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.078 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.078 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.078 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.078 INFO:teuthology.orchestra.run.smithi098.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T07:32:19.079 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T07:32:19.079 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.079 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.079 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.079 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.079 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.079 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.079 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.079 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.079 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.079 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.079 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.080 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T07:32:19.080 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T07:32:19.080 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.080 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.080 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.080 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:19.080 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.080 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.080 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.080 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.080 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.081 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.082 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "cross_origin_url": { 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cross_origin_url", 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.083 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.084 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.084 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.084 INFO:teuthology.orchestra.run.smithi098.stdout: "crt_file": { 2024-09-19T07:32:19.084 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "crt_file", 2024-09-19T07:32:19.084 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.084 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.084 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.084 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.084 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.084 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.084 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: "debug": { 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "debug", 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.085 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Enable/disable debug options", 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "jwt_token_ttl": { 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "jwt_token_ttl", 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "28800", 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.086 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.087 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.088 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.090 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.091 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.092 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "motd": { 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "motd", 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.093 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "The message of the day", 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect_resolve_ip_addr": { 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.094 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.095 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8080", 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.096 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.097 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl_server_port": { 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl_server_port", 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8443", 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.098 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.099 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.099 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.099 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.099 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.099 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.099 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-19T07:32:19.099 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-19T07:32:19.099 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.099 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.099 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.099 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "redirect", 2024-09-19T07:32:19.100 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.100 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.100 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.100 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.100 INFO:teuthology.orchestra.run.smithi098.stdout: "redirect" 2024-09-19T07:32:19.100 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.100 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.100 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.100 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.100 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.100 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.101 INFO:teuthology.orchestra.run.smithi098.stdout: "url_prefix": { 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url_prefix", 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.102 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "devicehealth", 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_monitoring": { 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_monitoring", 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.103 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "monitor device health metrics", 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.104 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.107 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.108 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: "mark_out_threshold": { 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mark_out_threshold", 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.109 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "2419200", 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: "pool_name": { 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pool_name", 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.110 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "device_health_metrics", 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "retention_period": { 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "retention_period", 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.111 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15552000", 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long to retain device health metrics", 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_frequency": { 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_frequency", 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.112 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "self_heal": { 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "self_heal", 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.113 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.114 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: "warn_threshold": { 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "warn_threshold", 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.115 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.116 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7257600", 2024-09-19T07:32:19.116 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.116 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.116 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.116 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T07:32:19.116 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.116 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.116 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.116 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.116 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "diskprediction_local", 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.117 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.118 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.119 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.120 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.121 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: "predict_interval": { 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predict_interval", 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.122 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "86400", 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: "predictor_model": { 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "predictor_model", 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.123 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "prophetstor", 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:19.124 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "600", 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "influx", 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": false, 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "influxdb python module not found", 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: "batch_size": { 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "batch_size", 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5000", 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.126 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: "database": { 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "database", 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "ceph", 2024-09-19T07:32:19.127 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: "hostname": { 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "hostname", 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.128 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server hostname", 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.129 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "30", 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "5", 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.130 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.131 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.132 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.133 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.134 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: "password": { 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "password", 2024-09-19T07:32:19.135 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "password of InfluxDB server user", 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "port": { 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "port", 2024-09-19T07:32:19.136 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.137 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.137 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.137 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "8086", 2024-09-19T07:32:19.137 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.137 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.137 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.137 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "InfluxDB server port", 2024-09-19T07:32:19.137 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.137 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.137 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.137 INFO:teuthology.orchestra.run.smithi098.stdout: "ssl": { 2024-09-19T07:32:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ssl", 2024-09-19T07:32:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "false", 2024-09-19T07:32:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:32:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.138 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: "threads": { 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threads", 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "32", 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.139 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.140 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.140 INFO:teuthology.orchestra.run.smithi098.stdout: "username": { 2024-09-19T07:32:19.140 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "username", 2024-09-19T07:32:19.140 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.140 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.140 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.140 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.140 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.140 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "username of InfluxDB server user", 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: "verify_ssl": { 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "verify_ssl", 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "true", 2024-09-19T07:32:19.141 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "insights", 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.142 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.143 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.143 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.143 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.143 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.143 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.143 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.143 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.143 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.143 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.143 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.143 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.143 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.144 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.145 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.146 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "iostat", 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.148 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.149 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.149 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.149 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.149 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.149 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.149 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.149 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.149 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.149 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.149 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.149 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.149 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.150 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.151 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.152 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.152 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.152 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.152 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.152 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.152 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.152 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.152 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.152 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.152 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.152 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.152 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.153 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "k8sevents", 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_event_retention_days": { 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "ceph_event_retention_days", 2024-09-19T07:32:19.154 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "7", 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: "config_check_secs": { 2024-09-19T07:32:19.155 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "config_check_secs", 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "10", 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.156 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.157 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.158 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.159 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.160 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "localpool", 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: "failure_domain": { 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "failure_domain", 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "host", 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.162 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "failure domain for any created local pool", 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.163 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.165 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.166 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.167 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "min_size": { 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "min_size", 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.168 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default min_size for any created local pool", 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "num_rep": { 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "num_rep", 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.169 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3", 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default replica count for any created local pool", 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_num": { 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_num", 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.170 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "128", 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "prefix": { 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prefix", 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.171 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "name prefix for any created local pool", 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "subtree": { 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "subtree", 2024-09-19T07:32:19.172 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "rack", 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mds_autoscaler", 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.174 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.177 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.178 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirroring", 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.180 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.181 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.182 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.183 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.184 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "nfs", 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.186 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.187 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.188 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.189 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.190 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.191 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "fail_fs": { 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "fail_fs", 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.192 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.193 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.194 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.195 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.196 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.197 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator": { 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "orchestrator", 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.198 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "cephadm", 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "rook", 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "test_orchestrator" 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Orchestrator backend", 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.199 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_perf_query", 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.200 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.201 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.202 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.203 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.204 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "osd_support", 2024-09-19T07:32:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.205 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.206 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.207 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.208 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.209 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.210 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.210 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.210 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.210 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.210 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.210 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.210 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.210 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.210 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.210 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.210 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "pg_autoscaler", 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.211 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.212 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.213 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.214 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.215 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.215 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.215 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.215 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.215 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.215 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.215 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.215 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.215 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.215 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.215 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.216 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.217 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: "threshold": { 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "threshold", 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "3.0", 2024-09-19T07:32:19.218 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1.0", 2024-09-19T07:32:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "scaling threshold", 2024-09-19T07:32:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T07:32:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "progress", 2024-09-19T07:32:19.219 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_pg_recovery_event": { 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_pg_recovery_event", 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T07:32:19.220 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.221 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.221 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.221 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-19T07:32:19.221 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-19T07:32:19.221 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.221 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.221 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.221 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.221 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.221 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.221 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.222 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.222 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.222 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.222 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.222 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.222 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.222 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.222 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.222 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.222 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.222 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.223 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.223 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.223 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.223 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.223 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.223 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.223 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.223 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.223 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.223 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.223 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.223 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.224 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.224 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.224 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.224 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.224 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.224 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.224 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.224 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.224 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.224 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.225 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.226 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.226 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.226 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.226 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.226 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.226 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.226 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.226 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.226 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.226 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.226 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.226 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.227 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.227 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.227 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.227 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.227 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.227 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.227 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.227 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.227 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.227 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.227 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: "max_completed_events": { 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_completed_events", 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "50", 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.228 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "number of past completed events to remember", 2024-09-19T07:32:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: "sleep_interval": { 2024-09-19T07:32:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "sleep_interval", 2024-09-19T07:32:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.229 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.230 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.230 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "how long the module is going to sleep", 2024-09-19T07:32:19.230 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.230 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.230 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.230 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.230 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "prometheus", 2024-09-19T07:32:19.230 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.231 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.231 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.231 INFO:teuthology.orchestra.run.smithi098.stdout: "cache": { 2024-09-19T07:32:19.231 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "cache", 2024-09-19T07:32:19.231 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.231 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.231 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.231 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.231 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.231 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.231 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.231 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.232 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.232 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.232 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.232 INFO:teuthology.orchestra.run.smithi098.stdout: "exclude_perf_counters": { 2024-09-19T07:32:19.232 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "exclude_perf_counters", 2024-09-19T07:32:19.232 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.232 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.232 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.232 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.232 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T07:32:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T07:32:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.233 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.234 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.235 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.235 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.235 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.235 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.235 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.235 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.235 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.235 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.235 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.235 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.235 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.236 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.237 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools": { 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools", 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.239 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "300", 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.240 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.241 INFO:teuthology.orchestra.run.smithi098.stdout: "scrape_interval": { 2024-09-19T07:32:19.241 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "scrape_interval", 2024-09-19T07:32:19.241 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:19.241 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.241 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.241 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15.0", 2024-09-19T07:32:19.241 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.241 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.241 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.241 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.241 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "::", 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T07:32:19.242 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.243 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.243 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.243 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-19T07:32:19.243 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-19T07:32:19.243 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.243 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.243 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.243 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "9283", 2024-09-19T07:32:19.243 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.243 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.243 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: "stale_cache_strategy": { 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stale_cache_strategy", 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "log", 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.244 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_behaviour": { 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_behaviour", 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "default", 2024-09-19T07:32:19.245 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: "default", 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: "error" 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: "standby_error_status_code": { 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "standby_error_status_code", 2024-09-19T07:32:19.246 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "500", 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "400", 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "599", 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.248 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_support", 2024-09-19T07:32:19.248 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.248 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.248 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.248 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.248 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.248 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.248 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.248 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.248 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.248 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.249 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.249 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.249 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.249 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.249 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.249 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.249 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.249 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.249 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.249 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.249 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.249 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.250 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.250 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.250 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.250 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.250 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.250 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.250 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.250 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.250 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.250 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.250 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.251 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.252 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.252 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.252 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.252 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.252 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.252 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.252 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.252 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.252 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.252 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.252 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_snap_create": { 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_snap_create", 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10", 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "mirror_snapshot_schedule": { 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.255 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "trash_purge_schedule": { 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "trash_purge_schedule", 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.256 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "restful", 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: "enable_auth": { 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enable_auth", 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.257 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "key_file": { 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "key_file", 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.258 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.260 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "server_addr": { 2024-09-19T07:32:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_addr", 2024-09-19T07:32:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "server_port": { 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "server_port", 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rgw", 2024-09-19T07:32:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T07:32:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "5", 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rook", 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "storage_class": { 2024-09-19T07:32:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "storage_class", 2024-09-19T07:32:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "local", 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "selftest", 2024-09-19T07:32:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "roption1": { 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption1", 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "roption2": { 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "roption2", 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "xyz", 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption1": { 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption1", 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption2": { 2024-09-19T07:32:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption2", 2024-09-19T07:32:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption3": { 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption3", 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "float", 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption4": { 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption4", 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption5": { 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption5", 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption6": { 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption6", 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "rwoption7": { 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rwoption7", 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "1", 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "42", 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "testkey": { 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testkey", 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "testlkey": { 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testlkey", 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "testnewline": { 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "testnewline", 2024-09-19T07:32:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snap_schedule", 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "allow_m_granularity": { 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "allow_m_granularity", 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "dump_on_update": { 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "dump_on_update", 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "dump database to debug log on update", 2024-09-19T07:32:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "stats", 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "status", 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telegraf", 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "address": { 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "address", 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T07:32:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "15", 2024-09-19T07:32:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "telemetry", 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_basic": { 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_basic", 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_crash": { 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_crash", 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_device": { 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_device", 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_ident": { 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_ident", 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "channel_perf": { 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "channel_perf", 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T07:32:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "contact": { 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "contact", 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "description": { 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "description", 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "device_url": { 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "device_url", 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "enabled": { 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "enabled", 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "24", 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "8", 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "last_opt_revision": { 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "last_opt_revision", 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "1", 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard": { 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard", 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "leaderboard_description": { 2024-09-19T07:32:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "leaderboard_description", 2024-09-19T07:32:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "organization": { 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "organization", 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "proxy": { 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "proxy", 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "url": { 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "url", 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "test_orchestrator", 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "max_concurrent_clones": { 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "max_concurrent_clones", 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "4", 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T07:32:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "periodic_async_work": { 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "periodic_async_work", 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Periodically check for async work", 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_delay": { 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_delay", 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "0", 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T07:32:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "snapshot_clone_no_wait": { 2024-09-19T07:32:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T07:32:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "True", 2024-09-19T07:32:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T07:32:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix", 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "can_run": true, 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "error_string": "", 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "module_options": { 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "discovery_interval": { 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "discovery_interval", 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "uint", 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "100", 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "identifier": { 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "identifier", 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.367 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "interval": { 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "interval", 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "secs", 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "60", 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.368 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "log_level": { 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_level", 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.369 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster": { 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster", 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.370 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_cluster_level": { 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_cluster_level", 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.371 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "info", 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [ 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "", 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "critical", 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "debug", 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "error", 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "info", 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "warning" 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.372 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "log_to_file": { 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "log_to_file", 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "bool", 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 1, 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "False", 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.373 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_host": { 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_host", 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "", 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_port": { 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_port", 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "int", 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "10051", 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "zabbix_sender": { 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "zabbix_sender", 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "str", 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "level": "advanced", 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "flags": 0, 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "min": "", 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "max": "", 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "enum_allowed": [], 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "desc": "", 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "long_desc": "", 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "tags": [], 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: "see_also": [] 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.376 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: "services": { 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: "dashboard": "https://172.21.15.98:8443/" 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: "always_on_modules": { 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: "octopus": [ 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-19T07:32:19.377 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "pacific": [ 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-19T07:32:19.378 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "quincy": [ 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "reef": [ 2024-09-19T07:32:19.379 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: "squid": [ 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: "balancer", 2024-09-19T07:32:19.380 INFO:teuthology.orchestra.run.smithi098.stdout: "crash", 2024-09-19T07:32:19.381 INFO:teuthology.orchestra.run.smithi098.stdout: "devicehealth", 2024-09-19T07:32:19.381 INFO:teuthology.orchestra.run.smithi098.stdout: "orchestrator", 2024-09-19T07:32:19.381 INFO:teuthology.orchestra.run.smithi098.stdout: "pg_autoscaler", 2024-09-19T07:32:19.381 INFO:teuthology.orchestra.run.smithi098.stdout: "progress", 2024-09-19T07:32:19.381 INFO:teuthology.orchestra.run.smithi098.stdout: "rbd_support", 2024-09-19T07:32:19.381 INFO:teuthology.orchestra.run.smithi098.stdout: "status", 2024-09-19T07:32:19.381 INFO:teuthology.orchestra.run.smithi098.stdout: "telemetry", 2024-09-19T07:32:19.381 INFO:teuthology.orchestra.run.smithi098.stdout: "volumes" 2024-09-19T07:32:19.381 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-19T07:32:19.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.381 INFO:teuthology.orchestra.run.smithi098.stdout: "last_failure_osd_epoch": 81, 2024-09-19T07:32:19.381 INFO:teuthology.orchestra.run.smithi098.stdout: "active_clients": [ 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "devicehealth", 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.98:0", 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 3087604401 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "libcephsqlite", 2024-09-19T07:32:19.382 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.98:0", 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 4069255913 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "rbd_support", 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-19T07:32:19.383 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.98:0", 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 501076737 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snap_schedule", 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.98:0", 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 256877316 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.384 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-19T07:32:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "snap_schedule", 2024-09-19T07:32:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-19T07:32:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-19T07:32:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.98:0", 2024-09-19T07:32:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 2945993514 2024-09-19T07:32:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-19T07:32:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:19.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.386 INFO:teuthology.orchestra.run.smithi098.stdout: "name": "volumes", 2024-09-19T07:32:19.386 INFO:teuthology.orchestra.run.smithi098.stdout: "addrvec": [ 2024-09-19T07:32:19.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-19T07:32:19.386 INFO:teuthology.orchestra.run.smithi098.stdout: "type": "v2", 2024-09-19T07:32:19.386 INFO:teuthology.orchestra.run.smithi098.stdout: "addr": "172.21.15.98:0", 2024-09-19T07:32:19.386 INFO:teuthology.orchestra.run.smithi098.stdout: "nonce": 2419937203 2024-09-19T07:32:19.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.386 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-19T07:32:19.386 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:19.386 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-19T07:32:19.386 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:32:19.388 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:18 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3060615618' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:32:19.388 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:18 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1790461274' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T07:32:19.388 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:18 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3060615618' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:32:19.388 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:18 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1790461274' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T07:32:19.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.986+0000 7f802bad0640 1 -- 172.21.15.98:0/1790461274 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f800c0a33c0 msgr2=0x7f800c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:19.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.986+0000 7f802bad0640 1 --2- 172.21.15.98:0/1790461274 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f800c0a33c0 0x7f800c0a5880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f801c00a860 tx=0x7f801c005b60 comp rx=0 tx=0).stop 2024-09-19T07:32:19.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.986+0000 7f802bad0640 1 -- 172.21.15.98:0/1790461274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8024101360 msgr2=0x7f802419abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:19.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.986+0000 7f802bad0640 1 --2- 172.21.15.98:0/1790461274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8024101360 0x7f802419abc0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8018009230 tx=0x7f8018004270 comp rx=0 tx=0).stop 2024-09-19T07:32:19.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.986+0000 7f802bad0640 1 -- 172.21.15.98:0/1790461274 shutdown_connections 2024-09-19T07:32:19.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.986+0000 7f802bad0640 1 --2- 172.21.15.98:0/1790461274 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f800c0a33c0 0x7f800c0a5880 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:19.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.986+0000 7f802bad0640 1 --2- 172.21.15.98:0/1790461274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80241069d0 0x7f802419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:19.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.986+0000 7f802bad0640 1 --2- 172.21.15.98:0/1790461274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8024101360 0x7f802419abc0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:19.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.986+0000 7f802bad0640 1 --2- 172.21.15.98:0/1790461274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80241009c0 0x7f802419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:19.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.986+0000 7f802bad0640 1 -- 172.21.15.98:0/1790461274 >> 172.21.15.98:0/1790461274 conn(0x7f80240fc6a0 msgr2=0x7f802406a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:19.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.986+0000 7f802bad0640 1 -- 172.21.15.98:0/1790461274 shutdown_connections 2024-09-19T07:32:19.389 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:17.986+0000 7f802bad0640 1 -- 172.21.15.98:0/1790461274 wait complete. 2024-09-19T07:32:19.448 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T07:32:19.448 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T07:32:19.449 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:18 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3060615618' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T07:32:19.449 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:18 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1790461274' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T07:32:19.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:19 smithi098 ceph-mon[30950]: pgmap v318: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:32:19.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:19 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:32:19.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:19 smithi139 ceph-mon[35039]: pgmap v318: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:32:19.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:19 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:32:19.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:19 smithi162 ceph-mon[35726]: pgmap v318: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T07:32:19.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:19 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:32:20.103 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:32:20.603 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:32:20.603 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:32:20.603 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 212, 2024-09-19T07:32:20.603 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 200, 2024-09-19T07:32:20.603 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1447888, 2024-09-19T07:32:20.603 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 121952, 2024-09-19T07:32:20.603 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 4, 2024-09-19T07:32:20.604 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 0, 2024-09-19T07:32:20.604 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.039378693, 2024-09-19T07:32:20.604 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.014433485, 2024-09-19T07:32:20.604 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.034649259, 2024-09-19T07:32:20.604 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:20.604 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:20.604 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 200, 2024-09-19T07:32:20.604 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.016019266, 2024-09-19T07:32:20.604 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000080096 2024-09-19T07:32:20.604 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:20.605 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:20.605 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:20.605 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:20.605 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:20.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:20.605 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 1447888, 2024-09-19T07:32:20.605 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 121952 2024-09-19T07:32:20.605 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:20.605 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:32:20.605 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 2, 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 152, 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 320, 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 184112, 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.012980185, 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.009086288, 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.001964034, 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 149, 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.007497857, 2024-09-19T07:32:20.606 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000050321 2024-09-19T07:32:20.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:20.607 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:20.607 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:20.607 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:20.607 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:20.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:20.607 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T07:32:20.607 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 184112 2024-09-19T07:32:20.607 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:20.607 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:32:20.608 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 0, 2024-09-19T07:32:20.608 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 2, 2024-09-19T07:32:20.608 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 0, 2024-09-19T07:32:20.608 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 0, 2024-09-19T07:32:20.608 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 2, 2024-09-19T07:32:20.608 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 1, 2024-09-19T07:32:20.608 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.000300123, 2024-09-19T07:32:20.608 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T07:32:20.608 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.000232757, 2024-09-19T07:32:20.609 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:20.609 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:20.609 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:20.609 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:20.609 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:20.609 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:20.609 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:20.609 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:20.609 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:20.609 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 0, 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:32:20.610 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-19T07:32:20.611 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:32:20.612 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-19T07:32:20.612 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:32:20.612 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:32:20.612 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:32:20.612 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:32:20.612 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:32:20.612 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:32:20.612 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:32:20.612 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-19T07:32:20.612 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:32:20.612 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:32:20.612 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 148977, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 30, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-19T07:32:20.613 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 0, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 0, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 928, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 2, 2024-09-19T07:32:20.614 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 210, 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 1415498, 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 210, 2024-09-19T07:32:20.615 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-19T07:32:20.616 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-19T07:32:20.616 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 210, 2024-09-19T07:32:20.616 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 1415498, 2024-09-19T07:32:20.616 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-19T07:32:20.616 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:20.616 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:20.616 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:20.616 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:20.616 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:20.616 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:32:21.374 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-19T07:32:21.374 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-19T07:32:21.374 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-19T07:32:21.374 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-19T07:32:21.374 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-19T07:32:21.374 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-19T07:32:21.374 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-19T07:32:21.374 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T07:32:21.374 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T07:32:21.665 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:32:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: pgmap v319: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T07:32:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:21.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-19T07:32:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: Unable to set osd_memory_target on smithi162 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-19T07:32:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.774 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:21 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: pgmap v319: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T07:32:21.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: Unable to set osd_memory_target on smithi162 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.817 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:21 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: pgmap v319: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi162 to 176.0M 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: Unable to set osd_memory_target on smithi162 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:21.883 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:21 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:22.184 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:32:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:32:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 213, 2024-09-19T07:32:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 203, 2024-09-19T07:32:22.184 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1446176, 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 124704, 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 4, 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 0, 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.039061912, 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.014832685, 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.034257359, 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 202, 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.011203172, 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000055461 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:22.185 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 1446176, 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 124704 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 6, 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 157, 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 3392, 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 185088, 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-09-19T07:32:22.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.014760016, 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.008998631, 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.003624866, 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 155, 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.013342103, 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000086078 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:22.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 185088 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 0, 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 2, 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 0, 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 0, 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 2, 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 1, 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.000323597, 2024-09-19T07:32:22.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.000248338, 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:32:22.189 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 0, 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:32:22.190 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:32:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:32:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:32:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:32:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:32:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:32:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-19T07:32:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:32:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-19T07:32:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:32:22.191 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:32:22.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:32:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:32:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 149017, 2024-09-19T07:32:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 31, 2024-09-19T07:32:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:32:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-19T07:32:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-19T07:32:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-19T07:32:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:32:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-19T07:32:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:32:22.193 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 0, 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 0, 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 928, 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 2, 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-19T07:32:22.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 215, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 1416148, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 215, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 215, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 1416148, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:22.195 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:22.196 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:22.196 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:32:22.932 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T07:32:22.932 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T07:32:22.932 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-19T07:32:22.932 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-19T07:32:22.932 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T07:32:22.932 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T07:32:22.932 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T07:32:22.932 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T07:32:22.933 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T07:32:22.949 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:22 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi139 to 176.0M 2024-09-19T07:32:22.949 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:22 smithi098 ceph-mon[30950]: Unable to set osd_memory_target on smithi139 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-19T07:32:22.949 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:22 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:22.949 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:22 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:22.949 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:22 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:22.949 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:22 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:22.950 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:22 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:22.950 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:22 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:22.950 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:22 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:32:22.950 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:22 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:32:22.950 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:22 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:23.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:22 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi139 to 176.0M 2024-09-19T07:32:23.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:22 smithi139 ceph-mon[35039]: Unable to set osd_memory_target on smithi139 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-19T07:32:23.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:22 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:23.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:22 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:23.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:22 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:23.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:22 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:23.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:22 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:23.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:22 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:23.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:22 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:32:23.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:22 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:32:23.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:22 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:23.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:22 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi139 to 176.0M 2024-09-19T07:32:23.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:22 smithi162 ceph-mon[35726]: Unable to set osd_memory_target on smithi139 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-19T07:32:23.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:22 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:23.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:22 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:23.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:22 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:22 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:22 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:22 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T07:32:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:22 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:32:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:22 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:32:23.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:22 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' 2024-09-19T07:32:23.178 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:32:23.679 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:32:23.679 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:32:23.679 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 209, 2024-09-19T07:32:23.679 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 199, 2024-09-19T07:32:23.680 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1445088, 2024-09-19T07:32:23.680 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 122144, 2024-09-19T07:32:23.680 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 4, 2024-09-19T07:32:23.680 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 0, 2024-09-19T07:32:23.680 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.036781667, 2024-09-19T07:32:23.680 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.013074697, 2024-09-19T07:32:23.680 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.034871272, 2024-09-19T07:32:23.680 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:23.680 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:23.680 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 198, 2024-09-19T07:32:23.680 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.009121420, 2024-09-19T07:32:23.680 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000046067 2024-09-19T07:32:23.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:23.681 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:23.681 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:23.681 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:23.681 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:23.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:23.681 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 1445088, 2024-09-19T07:32:23.681 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 122144 2024-09-19T07:32:23.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:23.682 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:32:23.682 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 6, 2024-09-19T07:32:23.682 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 154, 2024-09-19T07:32:23.682 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 3392, 2024-09-19T07:32:23.682 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 184560, 2024-09-19T07:32:23.682 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-09-19T07:32:23.682 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-19T07:32:23.682 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.015298367, 2024-09-19T07:32:23.682 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.008883420, 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.004418961, 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 152, 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.012754053, 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000083908 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-19T07:32:23.683 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 184560 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 0, 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 2, 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 0, 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 0, 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 2, 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 1, 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.000297323, 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.000233265, 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:23.684 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-19T07:32:23.685 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 0, 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:32:23.686 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:32:23.687 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 148994, 2024-09-19T07:32:23.688 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 31, 2024-09-19T07:32:23.689 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:32:23.689 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-19T07:32:23.689 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-19T07:32:23.689 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-19T07:32:23.689 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:32:23.689 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-19T07:32:23.689 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:32:23.689 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-19T07:32:23.689 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 0, 2024-09-19T07:32:23.689 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 0, 2024-09-19T07:32:23.689 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 928, 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 2, 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-19T07:32:23.690 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 211, 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 1415628, 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 211, 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 211, 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 1415628, 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:23.691 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:23.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:23.692 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:32:23.968 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:23 smithi139 ceph-mon[35039]: pgmap v320: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T07:32:23.968 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:23 smithi139 ceph-mon[35039]: Adjusting osd_memory_target on smithi098 to 176.0M 2024-09-19T07:32:23.968 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:23 smithi139 ceph-mon[35039]: Unable to set osd_memory_target on smithi098 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-19T07:32:23.996 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:23 smithi098 ceph-mon[30950]: pgmap v320: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T07:32:23.996 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:23 smithi098 ceph-mon[30950]: Adjusting osd_memory_target on smithi098 to 176.0M 2024-09-19T07:32:23.996 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:23 smithi098 ceph-mon[30950]: Unable to set osd_memory_target on smithi098 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-19T07:32:24.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:23 smithi162 ceph-mon[35726]: pgmap v320: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T07:32:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:23 smithi162 ceph-mon[35726]: Adjusting osd_memory_target on smithi098 to 176.0M 2024-09-19T07:32:24.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:23 smithi162 ceph-mon[35726]: Unable to set osd_memory_target on smithi098 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-19T07:32:24.393 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-19T07:32:24.393 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-19T07:32:24.393 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-19T07:32:24.393 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-19T07:32:24.394 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-19T07:32:24.394 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-19T07:32:24.394 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-19T07:32:24.394 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T07:32:24.394 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T07:32:24.679 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:32:25.186 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-19T07:32:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:32:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 0, 2024-09-19T07:32:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 2, 2024-09-19T07:32:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 0, 2024-09-19T07:32:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 0, 2024-09-19T07:32:25.186 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 4, 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 0, 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.001091232, 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.000217476, 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:25.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 2, 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 157, 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 320, 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 184992, 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.013555890, 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.009690619, 2024-09-19T07:32:25.188 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.001797769, 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 154, 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.007911029, 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000051370 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 184992 2024-09-19T07:32:25.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:32:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 218, 2024-09-19T07:32:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 206, 2024-09-19T07:32:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1449520, 2024-09-19T07:32:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 125792, 2024-09-19T07:32:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 2, 2024-09-19T07:32:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 1, 2024-09-19T07:32:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.039504969, 2024-09-19T07:32:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.014388869, 2024-09-19T07:32:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.037075795, 2024-09-19T07:32:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:25.190 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 206, 2024-09-19T07:32:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.015190563, 2024-09-19T07:32:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000073740 2024-09-19T07:32:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 1449520, 2024-09-19T07:32:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 125792 2024-09-19T07:32:25.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-19T07:32:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 0, 2024-09-19T07:32:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-19T07:32:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-19T07:32:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:32:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-19T07:32:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:32:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:32:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:32:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:32:25.192 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:32:25.193 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:32:25.194 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 149034, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 32, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 0, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 0, 2024-09-19T07:32:25.195 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 928, 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 2, 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-19T07:32:25.196 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 216, 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 1416278, 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 216, 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 216, 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 1416278, 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:25.197 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-19T07:32:25.198 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-19T07:32:26.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:25 smithi098 ceph-mon[30950]: pgmap v321: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T07:32:26.067 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T07:32:26.067 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T07:32:26.067 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-19T07:32:26.067 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-19T07:32:26.067 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T07:32:26.067 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T07:32:26.067 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T07:32:26.067 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T07:32:26.068 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T07:32:26.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:25 smithi139 ceph-mon[35039]: pgmap v321: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T07:32:26.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:25 smithi162 ceph-mon[35726]: pgmap v321: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-19T07:32:26.328 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:32:26.827 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-19T07:32:26.827 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:32:26.827 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 42751, 2024-09-19T07:32:26.828 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 58473, 2024-09-19T07:32:26.828 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 14872838, 2024-09-19T07:32:26.828 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 76757161, 2024-09-19T07:32:26.828 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 28, 2024-09-19T07:32:26.828 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 4, 2024-09-19T07:32:26.828 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 3.404416765, 2024-09-19T07:32:26.828 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 1.629079603, 2024-09-19T07:32:26.828 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 1.404491330, 2024-09-19T07:32:26.828 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.477146593, 2024-09-19T07:32:26.828 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:26.828 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 58476, 2024-09-19T07:32:26.828 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 8.813332479, 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000150717 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 68442, 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.011297286, 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000165 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 1893440, 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 226400 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 25278, 2024-09-19T07:32:26.829 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 25269, 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 10875813, 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 95655406, 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 98, 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 6, 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 1.789334629, 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.636041648, 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.354469346, 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.673203071, 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 25265, 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 19.839889626, 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000785271 2024-09-19T07:32:26.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 385, 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000060249, 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000156 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 100288, 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 473600 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 101678, 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 175667, 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 33526404, 2024-09-19T07:32:26.831 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 144844762, 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 23, 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 6, 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 6.028563621, 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 2.733914779, 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 5.589238948, 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.485643430, 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 175662, 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 16.264096925, 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000092587 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:26.832 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 223461, 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.035697220, 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000159 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 42496, 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 2336 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-19T07:32:26.833 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 18570, 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 40.465288931, 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.002179067 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 16710, 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 3.206558501, 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000191894 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:26.834 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 39518, 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 39340, 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 39340, 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 255.312396889, 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.006489893 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 178, 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 26, 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 1, 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 5561, 2024-09-19T07:32:26.835 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 14, 2024-09-19T07:32:26.836 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-09-19T07:32:26.836 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 27398, 2024-09-19T07:32:26.836 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 16995, 2024-09-19T07:32:26.836 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 9818, 2024-09-19T07:32:26.836 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 585, 2024-09-19T07:32:26.836 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 2839, 2024-09-19T07:32:26.836 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 2549, 2024-09-19T07:32:26.836 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 2, 2024-09-19T07:32:26.836 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 3, 2024-09-19T07:32:26.836 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 54, 2024-09-19T07:32:26.836 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 53653, 2024-09-19T07:32:26.836 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 50793, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 90, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 279, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 3, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 16, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 165, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 1867, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 117, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 1612, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 10211, 2024-09-19T07:32:26.837 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 2, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 4, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 234, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 6, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 10211, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 1231, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 5, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 1226, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 8980, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 273, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 16045, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 28600, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 197, 2024-09-19T07:32:26.838 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 29174, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 12620, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 270, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 18523 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 2808, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 446, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 301, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 423, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 6041, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 1623, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-09-19T07:32:26.839 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 12375, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 10734, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 71, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 11, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_path": 6, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_inode": 20926, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 5, 2024-09-19T07:32:26.840 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 168, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 14, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 63215, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 61827, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 61827, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 1388, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 6605, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 103, 2024-09-19T07:32:26.841 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 100, 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 100, 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 3, 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 1, 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 9, 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 163422523, 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 167422567, 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 0, 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 8932, 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 314.667939536, 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.035229281 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 0 2024-09-19T07:32:26.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 12556, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 25283, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 12727, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 1639, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 2079, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 440, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 27398, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 41135, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 13737, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 3, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 20360, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 20357, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 210740, 2024-09-19T07:32:26.843 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 231712 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 50812, 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 1988, 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 39518, 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 446, 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 4037, 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 11411, 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 34.487133247, 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.003022270 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.844 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 226, 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2.406722467, 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.010649214 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 175, 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 11.478179884, 2024-09-19T07:32:26.845 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.065589599 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 9968, 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 59.775164634, 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.005996705 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1, 2024-09-19T07:32:26.846 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000211126, 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000211126 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-09-19T07:32:26.847 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 10, 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.001468702, 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000146870 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1739, 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 31.464340795, 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.018093352 2024-09-19T07:32:26.848 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 398, 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 4.039684825, 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.010149961 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 10, 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.090516887, 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.009051688 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 48, 2024-09-19T07:32:26.849 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.053030630, 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001104804 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1693, 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 3.281065052, 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001938018 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 408, 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 18.728487727, 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.045903156 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.850 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-09-19T07:32:26.851 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.851 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.851 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.851 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-09-19T07:32:26.851 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.851 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.851 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.851 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.851 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-09-19T07:32:26.851 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1759, 2024-09-19T07:32:26.851 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 21.428139974, 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.012182001 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 4, 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.018270962, 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.004567740 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-09-19T07:32:26.852 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 205, 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 17.532870188, 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.085526196 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-09-19T07:32:26.853 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 8, 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.017875232, 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.002234404 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 411, 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 6.553049872, 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.015944160 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-09-19T07:32:26.854 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 10866, 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 43.956184685, 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.004045295 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-09-19T07:32:26.855 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 2, 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 6, 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 4, 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 2, 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 777, 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 388, 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 594, 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 1440, 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 1440, 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:32:26.856 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-09-19T07:32:26.857 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:32:26.858 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 13599195, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 15818, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 8384, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 184, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:32:26.859 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 53971506, 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 1490696, 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-09-19T07:32:26.860 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 52294, 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 202748678, 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 37, 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 52294, 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 52294, 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 3487.979394925, 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.066699418 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 52294, 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 93650 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 52294, 2024-09-19T07:32:26.861 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 10479, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 41815, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 3799, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 14942, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 236, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 9163, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 200, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 56, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 14, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 11459, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-09-19T07:32:26.862 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 10243, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 30310, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 230, 2024-09-19T07:32:26.863 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-09-19T07:32:26.864 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 89, 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 11, 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 12, 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 12, 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 11019, 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 54, 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 1925 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.865 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 1, 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 20053 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 14, 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 10, 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 10928, 2024-09-19T07:32:26.866 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 10734, 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 169703, 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 43933358, 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 169703, 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 169703, 2024-09-19T07:32:26.867 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 43933358, 2024-09-19T07:32:26.868 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:26.868 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.868 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.868 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.868 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:26.868 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.868 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 52294, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 204016096, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 52294, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 204016096, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 52294, 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 52294, 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 52294, 2024-09-19T07:32:26.870 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 52294, 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 10734, 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 1267838, 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:26.871 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 10734, 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 231, 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 1267838, 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x55c556d64960": { 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-19T07:32:26.872 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 63215, 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 163228263, 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 63215, 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 8932, 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 163228263, 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:26.873 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:26.874 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-19T07:32:27.645 INFO:tasks.check_counter:Daemon mds.b mds.exported=165 2024-09-19T07:32:27.646 INFO:tasks.check_counter:Daemon mds.b mds.imported=117 2024-09-19T07:32:27.646 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=2808 2024-09-19T07:32:27.646 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=446 2024-09-19T07:32:27.646 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T07:32:27.646 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-19T07:32:27.646 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-19T07:32:27.646 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T07:32:27.646 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T07:32:27.816 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:27 smithi139 ceph-mon[35039]: pgmap v322: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-19T07:32:27.904 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:32:28.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:27 smithi098 ceph-mon[30950]: pgmap v322: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-19T07:32:28.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:27 smithi162 ceph-mon[35726]: pgmap v322: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-19T07:32:28.537 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-19T07:32:28.537 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:32:28.537 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 1356, 2024-09-19T07:32:28.538 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 1331, 2024-09-19T07:32:28.538 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 52204632, 2024-09-19T07:32:28.538 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 481256, 2024-09-19T07:32:28.538 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 7, 2024-09-19T07:32:28.538 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 3, 2024-09-19T07:32:28.538 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.165272619, 2024-09-19T07:32:28.538 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.055237765, 2024-09-19T07:32:28.538 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.086660530, 2024-09-19T07:32:28.538 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.026899943, 2024-09-19T07:32:28.538 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:28.538 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1330, 2024-09-19T07:32:28.538 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.060892301, 2024-09-19T07:32:28.539 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000045783 2024-09-19T07:32:28.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.539 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:28.539 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.539 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.539 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.539 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 1527776, 2024-09-19T07:32:28.539 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 128272 2024-09-19T07:32:28.539 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.539 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 948, 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 1100, 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 71202627, 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 734534, 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 9, 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 7, 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.114259301, 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.025277443, 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.060109488, 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.022379071, 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1098, 2024-09-19T07:32:28.540 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.046424917, 2024-09-19T07:32:28.541 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000042281 2024-09-19T07:32:28.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.541 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:28.541 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.541 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.541 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.541 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-19T07:32:28.541 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 434912 2024-09-19T07:32:28.541 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.541 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:32:28.541 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 432, 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 434, 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 42051482, 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 137383, 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 6, 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 5, 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.060061106, 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.009304483, 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.034509416, 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.013027178, 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 432, 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.014312610, 2024-09-19T07:32:28.542 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000033131 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-09-19T07:32:28.543 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 4070, 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.375953126, 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000092371 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.544 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 0, 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 0, 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-09-19T07:32:28.545 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 0, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 0, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 38534, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 24618, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 13916, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 0, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 3366, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 0, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2024-09-19T07:32:28.546 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 2, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 0, 2024-09-19T07:32:28.547 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-09-19T07:32:28.548 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2024-09-19T07:32:28.548 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-09-19T07:32:28.548 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 4, 2024-09-19T07:32:28.548 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 234, 2024-09-19T07:32:28.548 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 6, 2024-09-19T07:32:28.548 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T07:32:28.548 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-09-19T07:32:28.548 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T07:32:28.548 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-09-19T07:32:28.548 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2024-09-19T07:32:28.548 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T07:32:28.548 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 0, 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 0, 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 0, 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 0, 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 0, 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 0 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.549 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 0, 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 0, 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 0, 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 0, 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 0, 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 0, 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 0, 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-09-19T07:32:28.550 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_path": 0, 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_inode": 0, 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 0, 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-09-19T07:32:28.551 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.552 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-09-19T07:32:28.552 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2024-09-19T07:32:28.552 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 0, 2024-09-19T07:32:28.552 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-09-19T07:32:28.552 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-09-19T07:32:28.552 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 63215, 2024-09-19T07:32:28.552 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-09-19T07:32:28.552 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-09-19T07:32:28.552 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 0, 2024-09-19T07:32:28.552 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-09-19T07:32:28.552 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-09-19T07:32:28.552 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 3, 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 25, 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 163422523, 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 167422567, 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 167422455, 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 63215 2024-09-19T07:32:28.553 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.554 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-09-19T07:32:28.554 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 12569, 2024-09-19T07:32:28.554 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 25064, 2024-09-19T07:32:28.554 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 12495, 2024-09-19T07:32:28.554 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 1632, 2024-09-19T07:32:28.554 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 1915, 2024-09-19T07:32:28.554 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 283, 2024-09-19T07:32:28.554 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 38534, 2024-09-19T07:32:28.554 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 40519, 2024-09-19T07:32:28.554 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 1985, 2024-09-19T07:32:28.554 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2024-09-19T07:32:28.554 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 0, 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 0, 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 137164, 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 215328 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 0, 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 0, 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 0, 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 0, 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 0, 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.556 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.557 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.557 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-09-19T07:32:28.557 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.557 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.557 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.557 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-09-19T07:32:28.557 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.557 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-09-19T07:32:28.558 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.560 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-09-19T07:32:28.560 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.560 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.560 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.560 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-09-19T07:32:28.560 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.561 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.561 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.561 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-09-19T07:32:28.561 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.561 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.561 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.561 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-09-19T07:32:28.561 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.561 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.561 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-09-19T07:32:28.562 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.563 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.564 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-09-19T07:32:28.564 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.564 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.564 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.564 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-09-19T07:32:28.564 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.564 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.564 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.564 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.564 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-09-19T07:32:28.564 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.565 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.566 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.567 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 2, 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 6, 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 4, 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 5, 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 0, 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 0, 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 6488, 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.568 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:32:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:32:28.570 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-09-19T07:32:28.571 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:32:28.571 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:32:28.571 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:32:28.571 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-09-19T07:32:28.571 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-09-19T07:32:28.571 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-09-19T07:32:28.571 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:32:28.571 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:32:28.571 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:32:28.571 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 785453, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 14836, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 8384, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 184, 2024-09-19T07:32:28.572 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:32:28.573 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:32:28.573 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-09-19T07:32:28.573 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-09-19T07:32:28.573 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 61060135, 2024-09-19T07:32:28.573 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 1450944, 2024-09-19T07:32:28.573 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-09-19T07:32:28.573 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-09-19T07:32:28.573 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-09-19T07:32:28.573 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-09-19T07:32:28.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.573 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-09-19T07:32:28.573 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 2484, 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 26, 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 4, 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 2484, 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2484, 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2.768942420, 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001114711 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-09-19T07:32:28.574 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2484, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2485 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 2484, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 2484, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 0, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 1540, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 0, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 941, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 0, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 0, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-09-19T07:32:28.575 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 0, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 2, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 0, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-09-19T07:32:28.576 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-09-19T07:32:28.577 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 89, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 11, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 11, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 11, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-09-19T07:32:28.578 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 0, 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 2, 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 0 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 0, 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.579 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 0, 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 0, 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 0, 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 2732, 2024-09-19T07:32:28.580 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 165197282, 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 2732, 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2732, 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 165197282, 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.581 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-09-19T07:32:28.582 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:28.582 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-19T07:32:28.582 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:28.582 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-19T07:32:28.582 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-19T07:32:28.582 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:28.582 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:28.582 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2484, 2024-09-19T07:32:28.582 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 163235925, 2024-09-19T07:32:28.582 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2484, 2024-09-19T07:32:28.582 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 163235925, 2024-09-19T07:32:28.582 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:28.583 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2484, 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 2484, 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2484, 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 2484, 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:28.584 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.585 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x560f20b02b40": { 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-09-19T07:32:28.586 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-09-19T07:32:28.587 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:28.587 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:28.587 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:28.587 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:28.587 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:28.587 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:28.587 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-19T07:32:29.328 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T07:32:29.328 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T07:32:29.328 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-19T07:32:29.328 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-19T07:32:29.328 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-09-19T07:32:29.329 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-19T07:32:29.329 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T07:32:29.329 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T07:32:29.329 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T07:32:29.574 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:32:30.018 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:29 smithi139 ceph-mon[35039]: pgmap v323: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T07:32:30.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:29 smithi098 ceph-mon[30950]: pgmap v323: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T07:32:30.028 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-19T07:32:30.028 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:32:30.028 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 45366, 2024-09-19T07:32:30.028 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 28991, 2024-09-19T07:32:30.028 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 20139220, 2024-09-19T07:32:30.028 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 25018337, 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 12, 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 6, 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 2.013210854, 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.889255312, 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 1.372792740, 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.082853097, 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 28989, 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.639681544, 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000022066 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:30.029 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 67735, 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.008618194, 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000127 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 976 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 9039, 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 15324, 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 4568807, 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 8847419, 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 18, 2024-09-19T07:32:30.030 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 5, 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.596116568, 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.263832919, 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.383023667, 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.019518802, 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 15324, 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.437384064, 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000028542 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 18361, 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.003408672, 2024-09-19T07:32:30.031 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000185 2024-09-19T07:32:30.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.032 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 1545504, 2024-09-19T07:32:30.032 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 188640 2024-09-19T07:32:30.032 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.032 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:32:30.032 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 5391, 2024-09-19T07:32:30.032 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 7318, 2024-09-19T07:32:30.032 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 1745710, 2024-09-19T07:32:30.032 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 7725795, 2024-09-19T07:32:30.032 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 15, 2024-09-19T07:32:30.032 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 6, 2024-09-19T07:32:30.032 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.351988075, 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.134797374, 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.192685621, 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.040669744, 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 7315, 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.233251377, 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000031886 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 9446, 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.001624419, 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000171 2024-09-19T07:32:30.033 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 1248, 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 436944 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 4505, 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 3.770541122, 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000836968 2024-09-19T07:32:30.034 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2755, 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.414205145, 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000150346 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 4320, 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 4174, 2024-09-19T07:32:30.035 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 4174, 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 42.356527488, 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.010147706 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 146, 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 5, 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 11, 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 3106, 2024-09-19T07:32:30.036 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 6, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 6, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 3094, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 3097, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 4398, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 12, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 11139, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 8020, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 135, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 1736, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 1, 2024-09-19T07:32:30.037 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 6, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 30, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 74, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 1008, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 117, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 1461, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 922, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 12, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 735, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 7383082, 2024-09-19T07:32:30.038 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 5, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 922, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 63, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 63, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 859, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 89, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 1917, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 3003, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 52, 2024-09-19T07:32:30.039 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 3250, 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 1109, 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 152, 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 3020 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 310, 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 4469, 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 2987, 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 3195, 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 706, 2024-09-19T07:32:30.040 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 206, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 1674, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 1461, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 27, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 7, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_path": 6, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_inode": 2734, 2024-09-19T07:32:30.041 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 75, 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 7580, 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 7580, 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-09-19T07:32:30.042 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 12, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 12, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 2, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 25803555, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 0, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1988, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 8.040778112, 2024-09-19T07:32:30.043 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.004044656 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 0 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 1433, 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 5035, 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 3602, 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 226, 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 2048, 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 1822, 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 3106, 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 8968, 2024-09-19T07:32:30.044 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 5862, 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 2717, 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 2717, 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 111072, 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 223520 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 7253, 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 1036, 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 4320, 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 157, 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 2467, 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-09-19T07:32:30.045 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 240, 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.451651831, 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001881882 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 32, 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.091744701, 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.002867021 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.046 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 58, 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.671420651, 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.011576218 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1302, 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2.407009704, 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001848701 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.048 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.049 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.049 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-09-19T07:32:30.049 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.049 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.049 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.050 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-09-19T07:32:30.050 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.050 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.050 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.050 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-09-19T07:32:30.050 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 108, 2024-09-19T07:32:30.050 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.151168128, 2024-09-19T07:32:30.050 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001399704 2024-09-19T07:32:30.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.050 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 87, 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.125604844, 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001443733 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 4, 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.002509985, 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000627496 2024-09-19T07:32:30.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 284, 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.240118484, 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000845487 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 155, 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 3.274473625, 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.021125636 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.052 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 234, 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2.389376875, 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.010211012 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.053 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 53, 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.077627727, 2024-09-19T07:32:30.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001464674 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.055 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 95, 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.158763726, 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.001671197 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.056 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1522, 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 32.315057207, 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.021231969 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.057 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 1, 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 3, 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 2, 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 1, 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 1514, 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 1514, 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 627, 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-09-19T07:32:30.058 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-09-19T07:32:30.059 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-09-19T07:32:30.060 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 2002262, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 1797, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:32:30.061 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 8384, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 184, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 6389129, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 305694, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-09-19T07:32:30.062 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 5059, 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 21960877, 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 33, 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 5059, 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 5059, 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 15.392680935, 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.003042633 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.063 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 5059, 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 5236 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 5059, 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 1084, 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 3975, 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 0, 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 10, 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 157, 2024-09-19T07:32:30.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 2145, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 102, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 17, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 1530, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 927, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 20, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-09-19T07:32:30.065 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 60, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-09-19T07:32:30.066 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 89, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 11, 2024-09-19T07:32:30.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 12, 2024-09-19T07:32:30.068 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 12, 2024-09-19T07:32:30.068 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-09-19T07:32:30.068 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-09-19T07:32:30.068 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 179, 2024-09-19T07:32:30.068 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 10, 2024-09-19T07:32:30.068 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 79 2024-09-19T07:32:30.068 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.068 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-09-19T07:32:30.068 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 1, 2024-09-19T07:32:30.068 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-09-19T07:32:30.068 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-09-19T07:32:30.068 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 2741 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 13, 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 10, 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 1530, 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 1461, 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.069 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:32:30.070 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:30.070 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-19T07:32:30.070 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:30.070 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 59792, 2024-09-19T07:32:30.070 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 21054776, 2024-09-19T07:32:30.070 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:30.070 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 59792, 2024-09-19T07:32:30.070 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-19T07:32:30.070 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-19T07:32:30.070 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 59792, 2024-09-19T07:32:30.070 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 21054776, 2024-09-19T07:32:30.070 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:30.071 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 5059, 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 22128454, 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 5059, 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 22128454, 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-09-19T07:32:30.072 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 5059, 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 5059, 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 5059, 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 5059, 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:30.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 1461, 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 167657, 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 1461, 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 157, 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 167657, 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:30.074 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x5563cc3c2960": { 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 7580, 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 21609251, 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 7580, 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-19T07:32:30.075 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-19T07:32:30.076 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 1988, 2024-09-19T07:32:30.076 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 21609251, 2024-09-19T07:32:30.076 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:30.076 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:30.076 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:30.076 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:30.076 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:30.076 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:30.076 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-19T07:32:30.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:29 smithi162 ceph-mon[35726]: pgmap v323: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T07:32:30.727 INFO:tasks.check_counter:Daemon mds.h mds.exported=74 2024-09-19T07:32:30.727 INFO:tasks.check_counter:Daemon mds.h mds.imported=117 2024-09-19T07:32:30.727 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=310 2024-09-19T07:32:30.727 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=4469 2024-09-19T07:32:30.727 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=5 2024-09-19T07:32:30.727 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-19T07:32:30.727 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T07:32:30.728 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T07:32:30.728 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T07:32:30.977 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T07:32:31.553 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-09-19T07:32:31.553 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:32:31.553 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 248, 2024-09-19T07:32:31.553 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 224, 2024-09-19T07:32:31.553 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 1529266, 2024-09-19T07:32:31.553 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 130356, 2024-09-19T07:32:31.553 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 5, 2024-09-19T07:32:31.553 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 1, 2024-09-19T07:32:31.554 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.042371548, 2024-09-19T07:32:31.554 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.014810042, 2024-09-19T07:32:31.554 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.041018012, 2024-09-19T07:32:31.554 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.000019838, 2024-09-19T07:32:31.554 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:31.554 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 223, 2024-09-19T07:32:31.554 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.013043911, 2024-09-19T07:32:31.554 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000058492 2024-09-19T07:32:31.554 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.554 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:31.554 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.555 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.555 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.555 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 1528432, 2024-09-19T07:32:31.555 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 130032 2024-09-19T07:32:31.555 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.555 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:32:31.555 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 665, 2024-09-19T07:32:31.555 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 822, 2024-09-19T07:32:31.555 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 2656802, 2024-09-19T07:32:31.556 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 647447, 2024-09-19T07:32:31.556 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 7, 2024-09-19T07:32:31.556 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 5, 2024-09-19T07:32:31.556 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.072141134, 2024-09-19T07:32:31.556 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.026799651, 2024-09-19T07:32:31.556 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.019482317, 2024-09-19T07:32:31.556 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.017872329, 2024-09-19T07:32:31.556 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:31.556 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 819, 2024-09-19T07:32:31.556 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.046645911, 2024-09-19T07:32:31.556 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000056954 2024-09-19T07:32:31.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.557 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:31.557 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.557 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.557 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.557 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T07:32:31.557 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 436608 2024-09-19T07:32:31.557 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.557 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:32:31.557 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 1509, 2024-09-19T07:32:31.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 1509, 2024-09-19T07:32:31.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 4637913, 2024-09-19T07:32:31.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 479096, 2024-09-19T07:32:31.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 5, 2024-09-19T07:32:31.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 4, 2024-09-19T07:32:31.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.157497038, 2024-09-19T07:32:31.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.053240199, 2024-09-19T07:32:31.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.041972498, 2024-09-19T07:32:31.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.048752578, 2024-09-19T07:32:31.558 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:31.558 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1508, 2024-09-19T07:32:31.559 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.067764884, 2024-09-19T07:32:31.559 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000044936 2024-09-19T07:32:31.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.559 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:31.559 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.559 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.559 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.559 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.559 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-19T07:32:31.559 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T07:32:31.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.560 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-09-19T07:32:31.560 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-09-19T07:32:31.560 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-09-19T07:32:31.560 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.560 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-09-19T07:32:31.560 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-19T07:32:31.560 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-19T07:32:31.560 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 3661, 2024-09-19T07:32:31.560 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.102685306, 2024-09-19T07:32:31.560 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000028048 2024-09-19T07:32:31.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:31.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.561 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-09-19T07:32:31.561 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-09-19T07:32:31.561 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-09-19T07:32:31.561 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.561 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.561 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.561 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:31.561 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.561 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-09-19T07:32:31.562 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 0, 2024-09-19T07:32:31.562 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 0, 2024-09-19T07:32:31.562 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-09-19T07:32:31.562 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.562 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.562 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.562 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.562 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-09-19T07:32:31.562 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 0, 2024-09-19T07:32:31.562 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2024-09-19T07:32:31.562 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-09-19T07:32:31.563 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 0, 2024-09-19T07:32:31.563 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2024-09-19T07:32:31.563 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-09-19T07:32:31.563 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 1192, 2024-09-19T07:32:31.563 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 0, 2024-09-19T07:32:31.563 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 1192, 2024-09-19T07:32:31.563 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 0, 2024-09-19T07:32:31.563 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 1191, 2024-09-19T07:32:31.563 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 0, 2024-09-19T07:32:31.563 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2024-09-19T07:32:31.563 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2024-09-19T07:32:31.564 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 1, 2024-09-19T07:32:31.564 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 0, 2024-09-19T07:32:31.564 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 0, 2024-09-19T07:32:31.564 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2024-09-19T07:32:31.564 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 0, 2024-09-19T07:32:31.564 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2024-09-19T07:32:31.564 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-09-19T07:32:31.564 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2024-09-19T07:32:31.564 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-09-19T07:32:31.564 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-09-19T07:32:31.564 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 0, 2024-09-19T07:32:31.565 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 0, 2024-09-19T07:32:31.565 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 0, 2024-09-19T07:32:31.565 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 0, 2024-09-19T07:32:31.565 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-09-19T07:32:31.565 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2024-09-19T07:32:31.565 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-09-19T07:32:31.565 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 0, 2024-09-19T07:32:31.565 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 0, 2024-09-19T07:32:31.565 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2024-09-19T07:32:31.565 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T07:32:31.565 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-09-19T07:32:31.566 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T07:32:31.566 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-09-19T07:32:31.566 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2024-09-19T07:32:31.566 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T07:32:31.566 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T07:32:31.566 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2024-09-19T07:32:31.566 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 0, 2024-09-19T07:32:31.566 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T07:32:31.566 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 0, 2024-09-19T07:32:31.566 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T07:32:31.566 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T07:32:31.566 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T07:32:31.567 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 0, 2024-09-19T07:32:31.567 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 0, 2024-09-19T07:32:31.567 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 0, 2024-09-19T07:32:31.567 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 0 2024-09-19T07:32:31.567 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.567 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-09-19T07:32:31.567 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 0, 2024-09-19T07:32:31.567 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 0, 2024-09-19T07:32:31.567 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 0, 2024-09-19T07:32:31.567 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 0, 2024-09-19T07:32:31.567 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 0, 2024-09-19T07:32:31.567 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2024-09-19T07:32:31.568 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-09-19T07:32:31.568 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-09-19T07:32:31.568 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 0, 2024-09-19T07:32:31.568 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 0, 2024-09-19T07:32:31.568 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-09-19T07:32:31.568 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-09-19T07:32:31.568 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-09-19T07:32:31.568 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-09-19T07:32:31.568 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-09-19T07:32:31.568 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-09-19T07:32:31.568 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-09-19T07:32:31.569 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_path": 0, 2024-09-19T07:32:31.569 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_inode": 0, 2024-09-19T07:32:31.569 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T07:32:31.569 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 0, 2024-09-19T07:32:31.569 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-09-19T07:32:31.569 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2024-09-19T07:32:31.569 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-09-19T07:32:31.569 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-09-19T07:32:31.569 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.569 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-09-19T07:32:31.569 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2024-09-19T07:32:31.569 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 0, 2024-09-19T07:32:31.570 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-09-19T07:32:31.570 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-09-19T07:32:31.570 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 2702, 2024-09-19T07:32:31.570 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-09-19T07:32:31.570 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-09-19T07:32:31.570 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 0, 2024-09-19T07:32:31.570 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-09-19T07:32:31.570 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-09-19T07:32:31.570 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 5, 2024-09-19T07:32:31.570 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 2, 2024-09-19T07:32:31.570 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-09-19T07:32:31.571 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-09-19T07:32:31.571 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2024-09-19T07:32:31.571 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 10875778, 2024-09-19T07:32:31.571 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 10873217, 2024-09-19T07:32:31.571 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-09-19T07:32:31.571 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.571 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.571 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.571 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 2702 2024-09-19T07:32:31.571 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.571 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-09-19T07:32:31.572 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 289, 2024-09-19T07:32:31.572 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 1553, 2024-09-19T07:32:31.572 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 1264, 2024-09-19T07:32:31.572 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 45, 2024-09-19T07:32:31.572 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 322, 2024-09-19T07:32:31.572 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 277, 2024-09-19T07:32:31.572 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 1192, 2024-09-19T07:32:31.572 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 2314, 2024-09-19T07:32:31.572 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 1122, 2024-09-19T07:32:31.572 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2024-09-19T07:32:31.572 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 0, 2024-09-19T07:32:31.573 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 0, 2024-09-19T07:32:31.573 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 54632, 2024-09-19T07:32:31.573 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 215328 2024-09-19T07:32:31.573 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.573 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-09-19T07:32:31.573 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 0, 2024-09-19T07:32:31.573 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 0, 2024-09-19T07:32:31.573 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 0, 2024-09-19T07:32:31.573 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 0, 2024-09-19T07:32:31.573 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 0, 2024-09-19T07:32:31.573 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-09-19T07:32:31.573 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.574 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.574 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.574 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-09-19T07:32:31.574 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.574 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.574 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.574 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.574 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-09-19T07:32:31.574 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.574 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.575 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.575 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-09-19T07:32:31.575 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.575 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.575 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.575 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.575 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-09-19T07:32:31.575 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.575 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.575 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.576 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-09-19T07:32:31.576 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.576 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.576 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.576 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-09-19T07:32:31.576 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.576 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.576 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.576 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.577 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-09-19T07:32:31.577 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.577 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.577 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.577 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-09-19T07:32:31.577 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.577 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.577 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.577 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.577 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-09-19T07:32:31.578 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.578 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.578 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.578 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-09-19T07:32:31.578 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.578 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.578 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.578 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.578 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-09-19T07:32:31.578 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.578 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.579 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.579 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-09-19T07:32:31.579 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.579 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.579 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.579 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.579 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-09-19T07:32:31.579 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.579 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.579 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.580 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-09-19T07:32:31.580 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.580 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.580 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.580 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-09-19T07:32:31.580 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.580 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.580 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.580 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.581 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-09-19T07:32:31.581 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.581 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.581 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.581 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-09-19T07:32:31.581 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.581 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.581 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.581 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.581 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-09-19T07:32:31.582 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.582 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.582 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.582 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-09-19T07:32:31.582 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.582 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.582 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.582 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.582 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-09-19T07:32:31.582 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.583 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.583 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.583 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-09-19T07:32:31.583 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.583 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.583 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.583 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.583 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-09-19T07:32:31.583 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.583 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.583 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.584 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-09-19T07:32:31.584 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.584 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.584 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.584 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-09-19T07:32:31.584 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.584 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.584 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.584 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.585 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-09-19T07:32:31.585 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.585 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.585 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.585 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-09-19T07:32:31.585 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.585 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.585 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.585 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.585 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-09-19T07:32:31.585 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.586 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.586 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.586 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-09-19T07:32:31.586 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.586 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.586 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.586 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.586 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-09-19T07:32:31.586 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-09-19T07:32:31.586 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-09-19T07:32:31.586 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.587 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.587 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.587 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:31.587 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.587 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-09-19T07:32:31.587 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 2, 2024-09-19T07:32:31.587 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 4, 2024-09-19T07:32:31.587 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 2, 2024-09-19T07:32:31.587 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 4, 2024-09-19T07:32:31.587 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-09-19T07:32:31.587 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 0, 2024-09-19T07:32:31.588 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 0, 2024-09-19T07:32:31.588 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 3061, 2024-09-19T07:32:31.588 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-09-19T07:32:31.588 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.588 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-09-19T07:32:31.588 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:32:31.588 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-09-19T07:32:31.588 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:32:31.588 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:32:31.588 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:32:31.588 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:32:31.588 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:32:31.589 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:32:31.589 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:32:31.589 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:32:31.589 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:32:31.589 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:32:31.589 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:32:31.589 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:32:31.589 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:32:31.589 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-09-19T07:32:31.589 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:32:31.589 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-09-19T07:32:31.589 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:32:31.590 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:32:31.590 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:32:31.590 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:32:31.590 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:32:31.590 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:32:31.590 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:32:31.590 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-09-19T07:32:31.590 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:32:31.590 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:32:31.590 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:32:31.590 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-09-19T07:32:31.590 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-09-19T07:32:31.591 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-09-19T07:32:31.591 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:32:31.592 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:32:31.592 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:32:31.592 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:32:31.592 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 210837, 2024-09-19T07:32:31.592 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 397, 2024-09-19T07:32:31.593 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:32:31.593 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2024-09-19T07:32:31.593 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-09-19T07:32:31.593 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-09-19T07:32:31.593 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:32:31.593 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-09-19T07:32:31.593 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:32:31.593 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-09-19T07:32:31.593 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 8384, 2024-09-19T07:32:31.593 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 184, 2024-09-19T07:32:31.593 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:32:31.593 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:32:31.594 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-09-19T07:32:31.594 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-09-19T07:32:31.594 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 1656844, 2024-09-19T07:32:31.594 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 46999, 2024-09-19T07:32:31.594 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-09-19T07:32:31.594 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-09-19T07:32:31.594 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-09-19T07:32:31.594 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-09-19T07:32:31.594 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.594 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-09-19T07:32:31.594 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-09-19T07:32:31.594 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-09-19T07:32:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 2169, 2024-09-19T07:32:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 21, 2024-09-19T07:32:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 3, 2024-09-19T07:32:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 2169, 2024-09-19T07:32:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-09-19T07:32:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2169, 2024-09-19T07:32:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.699964541, 2024-09-19T07:32:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000783754 2024-09-19T07:32:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-09-19T07:32:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-09-19T07:32:31.595 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2169, 2024-09-19T07:32:31.596 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2170 2024-09-19T07:32:31.596 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.596 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 2169, 2024-09-19T07:32:31.596 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 2169, 2024-09-19T07:32:31.596 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 0, 2024-09-19T07:32:31.596 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-09-19T07:32:31.596 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-09-19T07:32:31.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 1345, 2024-09-19T07:32:31.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 0, 2024-09-19T07:32:31.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 822, 2024-09-19T07:32:31.596 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 0, 2024-09-19T07:32:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 0, 2024-09-19T07:32:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-09-19T07:32:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-09-19T07:32:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-09-19T07:32:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2024-09-19T07:32:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 0, 2024-09-19T07:32:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-09-19T07:32:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-09-19T07:32:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-09-19T07:32:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 1, 2024-09-19T07:32:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 0, 2024-09-19T07:32:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-09-19T07:32:31.598 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-09-19T07:32:31.598 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-09-19T07:32:31.598 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-09-19T07:32:31.598 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-09-19T07:32:31.598 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-09-19T07:32:31.598 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T07:32:31.598 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-09-19T07:32:31.598 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-09-19T07:32:31.598 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-09-19T07:32:31.598 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-09-19T07:32:31.598 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-09-19T07:32:31.599 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-09-19T07:32:31.599 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-09-19T07:32:31.599 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-09-19T07:32:31.599 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-09-19T07:32:31.599 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-09-19T07:32:31.599 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-09-19T07:32:31.599 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-09-19T07:32:31.599 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-09-19T07:32:31.599 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-09-19T07:32:31.599 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-09-19T07:32:31.599 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-09-19T07:32:31.599 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-09-19T07:32:31.600 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-09-19T07:32:31.600 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-09-19T07:32:31.600 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 89, 2024-09-19T07:32:31.600 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-09-19T07:32:31.600 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 11, 2024-09-19T07:32:31.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 6, 2024-09-19T07:32:31.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 6, 2024-09-19T07:32:31.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-09-19T07:32:31.600 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-09-19T07:32:31.600 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 0, 2024-09-19T07:32:31.600 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 2, 2024-09-19T07:32:31.601 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 0 2024-09-19T07:32:31.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.601 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-09-19T07:32:31.601 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 0, 2024-09-19T07:32:31.601 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-09-19T07:32:31.601 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-09-19T07:32:31.601 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-09-19T07:32:31.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.601 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-09-19T07:32:31.601 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-09-19T07:32:31.601 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.601 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-09-19T07:32:31.602 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-09-19T07:32:31.602 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T07:32:31.602 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-09-19T07:32:31.602 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 0, 2024-09-19T07:32:31.602 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 0, 2024-09-19T07:32:31.602 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 0, 2024-09-19T07:32:31.602 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-09-19T07:32:31.602 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.602 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:32:31.602 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:31.602 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-19T07:32:31.602 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:31.603 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 2418, 2024-09-19T07:32:31.603 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 8590672, 2024-09-19T07:32:31.603 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:31.603 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 2418, 2024-09-19T07:32:31.603 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-19T07:32:31.603 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-19T07:32:31.603 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2418, 2024-09-19T07:32:31.603 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 8590672, 2024-09-19T07:32:31.603 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:31.603 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.603 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.603 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.604 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:31.604 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.604 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-09-19T07:32:31.604 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:31.604 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-09-19T07:32:31.604 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:31.604 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-19T07:32:31.604 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-19T07:32:31.604 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:31.604 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:31.605 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2169, 2024-09-19T07:32:31.605 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 6681479, 2024-09-19T07:32:31.605 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2169, 2024-09-19T07:32:31.605 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 6681479, 2024-09-19T07:32:31.605 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:31.605 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.605 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.605 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.605 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:31.605 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.605 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-09-19T07:32:31.606 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:31.606 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-09-19T07:32:31.606 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:31.606 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-19T07:32:31.606 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-19T07:32:31.606 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:31.606 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:31.606 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2169, 2024-09-19T07:32:31.606 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 2169, 2024-09-19T07:32:31.606 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2169, 2024-09-19T07:32:31.606 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 2169, 2024-09-19T07:32:31.606 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-09-19T07:32:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-19T07:32:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-19T07:32:31.607 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-19T07:32:31.608 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:31.608 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:31.608 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-19T07:32:31.608 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-19T07:32:31.608 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-09-19T07:32:31.608 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-09-19T07:32:31.608 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:31.608 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.608 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.608 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.608 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:31.608 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-09-19T07:32:31.609 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x56504f468b40": { 2024-09-19T07:32:31.609 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-09-19T07:32:31.609 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-09-19T07:32:31.609 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-09-19T07:32:31.609 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-09-19T07:32:31.609 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-09-19T07:32:31.609 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:31.609 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:31.609 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-09-19T07:32:31.609 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-09-19T07:32:31.609 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-09-19T07:32:31.609 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-09-19T07:32:31.610 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-09-19T07:32:31.610 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-09-19T07:32:31.610 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-09-19T07:32:31.610 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-09-19T07:32:31.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:31.610 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-09-19T07:32:31.610 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-09-19T07:32:32.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:31 smithi098 ceph-mon[30950]: pgmap v324: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T07:32:32.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:31 smithi139 ceph-mon[35039]: pgmap v324: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T07:32:32.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:31 smithi162 ceph-mon[35726]: pgmap v324: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T07:32:32.193 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-19T07:32:32.193 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-19T07:32:32.193 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-19T07:32:32.193 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-19T07:32:32.193 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-19T07:32:32.193 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-19T07:32:32.193 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T07:32:32.194 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T07:32:32.194 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T07:32:32.454 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:32:32.911 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T07:32:32.911 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:32:32.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 964, 2024-09-19T07:32:32.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 940, 2024-09-19T07:32:32.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1769600, 2024-09-19T07:32:32.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 356750, 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.132706718, 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.043520375, 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.062935176, 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.030118525, 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 939, 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.055904687, 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000059536 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:32.912 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 1527344, 2024-09-19T07:32:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 127472 2024-09-19T07:32:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:32:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 381, 2024-09-19T07:32:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 533, 2024-09-19T07:32:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 4290490, 2024-09-19T07:32:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 555840, 2024-09-19T07:32:32.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 7, 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 5, 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.046827070, 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.016640082, 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.013741046, 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.011558125, 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 531, 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.035082984, 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000066069 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.914 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 436528 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1104, 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1106, 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 17699000, 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 351079, 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-09-19T07:32:32.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.097037701, 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.031985171, 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.031797375, 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.025722552, 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1104, 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.048462748, 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000043897 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.916 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3714, 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.102795280, 2024-09-19T07:32:32.917 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000027677 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-09-19T07:32:32.918 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-19T07:32:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 4547, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 7, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 4540, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 4536, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 3, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 1, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-09-19T07:32:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 0, 2024-09-19T07:32:32.921 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 0, 2024-09-19T07:32:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-09-19T07:32:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T07:32:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-19T07:32:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T07:32:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-19T07:32:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-09-19T07:32:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T07:32:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T07:32:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-09-19T07:32:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-09-19T07:32:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T07:32:32.922 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-09-19T07:32:32.923 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-19T07:32:32.924 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-19T07:32:32.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 0, 2024-09-19T07:32:32.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 0, 2024-09-19T07:32:32.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T07:32:32.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-09-19T07:32:32.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-19T07:32:32.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-19T07:32:32.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-19T07:32:32.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-19T07:32:32.925 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.925 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-19T07:32:32.925 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-19T07:32:32.925 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 7580, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 12, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 2, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-19T07:32:32.926 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-19T07:32:32.927 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 25803555, 2024-09-19T07:32:32.927 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 25798112, 2024-09-19T07:32:32.927 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-19T07:32:32.927 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.927 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.927 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.927 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.927 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 7580 2024-09-19T07:32:32.927 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.927 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-19T07:32:32.927 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 1421, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 3605, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 2184, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 177, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 502, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 325, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 4547, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 5867, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 1320, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 63428, 2024-09-19T07:32:32.928 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 215328 2024-09-19T07:32:32.929 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.929 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-19T07:32:32.929 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-09-19T07:32:32.929 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-09-19T07:32:32.929 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-09-19T07:32:32.929 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-09-19T07:32:32.929 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-09-19T07:32:32.929 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-19T07:32:32.929 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.929 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.929 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.930 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-19T07:32:32.931 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.932 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.932 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.932 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.932 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-19T07:32:32.932 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.932 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.932 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.932 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.932 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-19T07:32:32.932 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.933 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.934 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-19T07:32:32.934 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.934 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.934 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.934 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.934 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-19T07:32:32.934 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.934 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.934 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.934 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.934 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-19T07:32:32.934 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.935 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-19T07:32:32.936 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.936 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.936 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.936 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.936 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-19T07:32:32.936 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.936 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.936 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.936 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.936 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-19T07:32:32.936 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.936 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.937 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.938 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.939 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.940 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 3, 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 2, 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 3, 2024-09-19T07:32:32.941 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 4232, 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:32:32.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:32:32.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:32:32.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:32:32.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:32:32.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:32:32.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:32:32.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:32:32.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:32:32.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-19T07:32:32.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:32:32.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-19T07:32:32.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:32:32.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-19T07:32:32.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 262144, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 1765, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:32:32.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 8384, 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 184, 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 7227994, 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 300798, 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-19T07:32:32.946 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 2200, 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 21, 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 3, 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 2200, 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2200, 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 1.767962245, 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000803619 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.947 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-19T07:32:32.948 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-19T07:32:32.948 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2200, 2024-09-19T07:32:32.948 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2201 2024-09-19T07:32:32.948 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.948 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 2200, 2024-09-19T07:32:32.948 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 2200, 2024-09-19T07:32:32.948 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-09-19T07:32:32.948 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-19T07:32:32.948 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-19T07:32:32.948 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 1349, 2024-09-19T07:32:32.948 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-09-19T07:32:32.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 849, 2024-09-19T07:32:32.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-09-19T07:32:32.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-09-19T07:32:32.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-19T07:32:32.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-19T07:32:32.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-09-19T07:32:32.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-19T07:32:32.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-09-19T07:32:32.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-19T07:32:32.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-19T07:32:32.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-19T07:32:32.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 1, 2024-09-19T07:32:32.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-09-19T07:32:32.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-19T07:32:32.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-19T07:32:32.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-19T07:32:32.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-19T07:32:32.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-19T07:32:32.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-19T07:32:32.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T07:32:32.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-19T07:32:32.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-19T07:32:32.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-19T07:32:32.951 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-19T07:32:32.952 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-19T07:32:32.952 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-19T07:32:32.952 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-19T07:32:32.952 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 89, 2024-09-19T07:32:32.952 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-19T07:32:32.952 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 11, 2024-09-19T07:32:32.952 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 6, 2024-09-19T07:32:32.952 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 6, 2024-09-19T07:32:32.952 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-19T07:32:32.952 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-19T07:32:32.952 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-09-19T07:32:32.953 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-09-19T07:32:32.953 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-09-19T07:32:32.953 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.953 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-19T07:32:32.953 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-09-19T07:32:32.953 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-19T07:32:32.953 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-19T07:32:32.953 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-19T07:32:32.953 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.953 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-19T07:32:32.953 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-09-19T07:32:32.953 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-19T07:32:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-19T07:32:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T07:32:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-19T07:32:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-09-19T07:32:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 0, 2024-09-19T07:32:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-09-19T07:32:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-19T07:32:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:32:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T07:32:32.954 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 2445, 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 23523559, 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 2445, 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2445, 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 23523559, 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.955 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2200, 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 21609256, 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2200, 2024-09-19T07:32:32.956 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 21609256, 2024-09-19T07:32:32.957 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T07:32:32.957 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.957 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.957 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.957 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:32.957 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.957 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-19T07:32:32.957 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T07:32:32.957 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-19T07:32:32.957 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T07:32:32.957 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2200, 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 2200, 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2200, 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 2200, 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:32.958 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.959 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55b6dca92b40": { 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-09-19T07:32:32.960 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-09-19T07:32:32.961 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T07:32:32.961 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:32.961 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:32.961 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:32.961 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:32.961 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:32.961 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T07:32:33.783 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-19T07:32:33.783 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-19T07:32:33.783 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-19T07:32:33.783 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-19T07:32:33.783 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-09-19T07:32:33.783 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-19T07:32:33.783 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T07:32:33.783 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T07:32:33.784 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T07:32:33.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:33 smithi162 ceph-mon[35726]: pgmap v325: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:32:34.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:33 smithi098 ceph-mon[30950]: pgmap v325: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:32:34.038 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:32:34.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:33 smithi139 ceph-mon[35039]: pgmap v325: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-09-19T07:32:34.522 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T07:32:34.522 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:32:34.522 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 0, 2024-09-19T07:32:34.522 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 2, 2024-09-19T07:32:34.522 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 0, 2024-09-19T07:32:34.523 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 0, 2024-09-19T07:32:34.523 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-19T07:32:34.523 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-09-19T07:32:34.523 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.001105010, 2024-09-19T07:32:34.523 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T07:32:34.523 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000233102, 2024-09-19T07:32:34.523 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:34.523 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:34.523 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:34.523 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:34.523 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:34.523 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:34.524 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:34.524 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:34.524 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:34.524 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:34.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:34.524 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:32:34.524 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:32:34.524 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:34.524 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:32:34.524 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 215, 2024-09-19T07:32:34.524 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 205, 2024-09-19T07:32:34.524 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1446720, 2024-09-19T07:32:34.525 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 125984, 2024-09-19T07:32:34.525 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-09-19T07:32:34.525 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-09-19T07:32:34.525 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.039687187, 2024-09-19T07:32:34.525 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.013961878, 2024-09-19T07:32:34.525 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.039782419, 2024-09-19T07:32:34.525 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:34.525 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:34.525 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 204, 2024-09-19T07:32:34.525 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.012928614, 2024-09-19T07:32:34.525 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000063375 2024-09-19T07:32:34.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 1446720, 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 125984 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 6, 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 158, 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 3392, 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 185264, 2024-09-19T07:32:34.526 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-09-19T07:32:34.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-09-19T07:32:34.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.013528946, 2024-09-19T07:32:34.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.007284131, 2024-09-19T07:32:34.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.004159112, 2024-09-19T07:32:34.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:34.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:34.527 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 156, 2024-09-19T07:32:34.527 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.016263024, 2024-09-19T07:32:34.527 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000104250 2024-09-19T07:32:34.527 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:34.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:34.527 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:34.528 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:34.528 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:34.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:34.528 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-19T07:32:34.528 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 185264 2024-09-19T07:32:34.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:34.528 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-19T07:32:34.528 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-09-19T07:32:34.528 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-19T07:32:34.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:34.528 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-19T07:32:34.528 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:32:34.529 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:32:34.530 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 148977, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 30, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-19T07:32:34.531 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:32:34.532 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-19T07:32:34.532 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:32:34.532 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-19T07:32:34.532 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-09-19T07:32:34.532 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-09-19T07:32:34.532 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:32:34.532 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:32:34.532 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-19T07:32:34.532 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-19T07:32:34.532 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 928, 2024-09-19T07:32:34.532 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-09-19T07:32:34.532 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 217, 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 1416408, 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 217, 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T07:32:34.533 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T07:32:34.534 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 217, 2024-09-19T07:32:34.534 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1416408, 2024-09-19T07:32:34.534 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T07:32:34.534 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:34.534 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:34.534 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:34.534 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:34.534 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:34.534 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T07:32:35.126 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-09-19T07:32:35.127 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-09-19T07:32:35.127 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.f 2024-09-19T07:32:35.127 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.f 2024-09-19T07:32:35.127 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-19T07:32:35.127 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-19T07:32:35.127 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-19T07:32:35.127 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T07:32:35.127 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T07:32:35.374 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:32:35.749 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:35 smithi162 ceph-mon[35726]: pgmap v326: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:32:35.910 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 38994, 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 20888, 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 19319243, 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 9483890, 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 13, 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 1.539919729, 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.592418808, 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 1.289659697, 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.025135029, 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 20889, 2024-09-19T07:32:35.911 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.369954281, 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000017710 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 57011, 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.008578859, 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000150 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 1541360, 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 257952 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 6542, 2024-09-19T07:32:35.912 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 4798, 2024-09-19T07:32:35.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 2833914, 2024-09-19T07:32:35.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 4347226, 2024-09-19T07:32:35.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 20, 2024-09-19T07:32:35.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 8, 2024-09-19T07:32:35.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.309628834, 2024-09-19T07:32:35.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.117376046, 2024-09-19T07:32:35.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.224565604, 2024-09-19T07:32:35.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.018291166, 2024-09-19T07:32:35.913 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:35.913 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4796, 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.112396146, 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000023435 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 9558, 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001533458, 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000160 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 9264, 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 130832 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 3769, 2024-09-19T07:32:35.914 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 6090, 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1339909, 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 3593110, 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 13, 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 7, 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.239995431, 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.102470490, 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.145239745, 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.013493688, 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 6086, 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.129887260, 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000021341 2024-09-19T07:32:35.915 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 7027, 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001441465, 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000205 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 316080 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.916 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-09-19T07:32:35.917 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T07:32:35.917 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T07:32:35.917 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1824, 2024-09-19T07:32:35.917 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.977183291, 2024-09-19T07:32:35.917 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000535736 2024-09-19T07:32:35.917 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:35.917 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.917 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-09-19T07:32:35.917 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-09-19T07:32:35.917 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-09-19T07:32:35.918 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1294, 2024-09-19T07:32:35.918 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.082209055, 2024-09-19T07:32:35.918 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000063530 2024-09-19T07:32:35.918 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:35.918 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.918 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-09-19T07:32:35.918 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 1620, 2024-09-19T07:32:35.918 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 1489, 2024-09-19T07:32:35.918 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-09-19T07:32:35.918 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1489, 2024-09-19T07:32:35.918 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2.865459077, 2024-09-19T07:32:35.918 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001924418 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 131, 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 11, 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 630, 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 7, 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 6, 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 617, 2024-09-19T07:32:35.919 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 620, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 4414, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 2, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 2, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 5, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 6888, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 4181, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 123, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 1812, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 1, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 16, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-09-19T07:32:35.920 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 58, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 847, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 63, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 649, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 465, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 3, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 735, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 7383082, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 5, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 465, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-09-19T07:32:35.921 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 26, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 26, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 439, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 40, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 821, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 983, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 6, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 1320, 2024-09-19T07:32:35.922 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 460, 2024-09-19T07:32:35.923 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 113, 2024-09-19T07:32:35.923 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 1200 2024-09-19T07:32:35.923 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.923 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-09-19T07:32:35.923 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 127, 2024-09-19T07:32:35.923 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 4919, 2024-09-19T07:32:35.923 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 3305, 2024-09-19T07:32:35.923 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 3375, 2024-09-19T07:32:35.923 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 255, 2024-09-19T07:32:35.923 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 49, 2024-09-19T07:32:35.923 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-09-19T07:32:35.923 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 631, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 585, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 6, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_path": 6, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_quiesce_inode": 1333, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T07:32:35.924 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 58, 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "evlrg": 0, 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 2702, 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 2702, 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-09-19T07:32:35.925 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 5, 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 5, 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "segmjr": 2, 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 10875778, 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 0, 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 723, 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2.539783290, 2024-09-19T07:32:35.926 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.003512839 2024-09-19T07:32:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 0 2024-09-19T07:32:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-09-19T07:32:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 310, 2024-09-19T07:32:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 3134, 2024-09-19T07:32:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 2824, 2024-09-19T07:32:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 99, 2024-09-19T07:32:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 2037, 2024-09-19T07:32:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 1938, 2024-09-19T07:32:35.927 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 630, 2024-09-19T07:32:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 5631, 2024-09-19T07:32:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 5001, 2024-09-19T07:32:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 2, 2024-09-19T07:32:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 1221, 2024-09-19T07:32:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 1219, 2024-09-19T07:32:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 86356, 2024-09-19T07:32:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 223520 2024-09-19T07:32:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-09-19T07:32:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 2895, 2024-09-19T07:32:35.928 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 563, 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 1620, 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 94, 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 1483, 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 42, 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.066594393, 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001585580 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 16, 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.017349438, 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001084339 2024-09-19T07:32:35.929 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 8, 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.146799912, 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.018349989 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 589, 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.204537589, 2024-09-19T07:32:35.930 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000347262 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1, 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000144896, 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000144896 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.931 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.932 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 6, 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.006815630, 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001135938 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 26, 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.025824493, 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000993249 2024-09-19T07:32:35.933 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2, 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001569691, 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000784845 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 99, 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.053439455, 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000539792 2024-09-19T07:32:35.934 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 27, 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.676268229, 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.025046971 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.935 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 53, 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.553864546, 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.010450274 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.936 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 7, 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.007891754, 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001127393 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-09-19T07:32:35.937 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.938 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.938 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.938 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.938 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-09-19T07:32:35.938 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.938 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.938 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 27, 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.115602523, 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.004281574 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-09-19T07:32:35.939 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 586, 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.988756528, 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001687297 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-09-19T07:32:35.940 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 2, 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 4, 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 2, 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 2, 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 597, 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 298, 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 588, 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-19T07:32:35.941 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:32:35.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:32:35.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:32:35.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:32:35.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:32:35.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:32:35.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:32:35.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:32:35.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:32:35.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:32:35.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:32:35.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:32:35.942 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:32:35.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-19T07:32:35.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:32:35.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-19T07:32:35.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:32:35.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:32:35.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:32:35.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:32:35.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:32:35.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:32:35.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:32:35.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-19T07:32:35.943 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 707079, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 492, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:32:35.944 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 8384, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 184, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-19T07:32:35.945 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 1410082, 2024-09-19T07:32:35.946 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 47743, 2024-09-19T07:32:35.946 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-19T07:32:35.946 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-19T07:32:35.946 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-19T07:32:35.946 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-19T07:32:35.946 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.946 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-09-19T07:32:35.946 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-09-19T07:32:35.946 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-09-19T07:32:35.946 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 2182, 2024-09-19T07:32:35.946 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 6848000, 2024-09-19T07:32:35.947 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 29, 2024-09-19T07:32:35.947 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 2182, 2024-09-19T07:32:35.947 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-09-19T07:32:35.947 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2182, 2024-09-19T07:32:35.947 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 5.524884165, 2024-09-19T07:32:35.947 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.002532027 2024-09-19T07:32:35.947 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.947 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-09-19T07:32:35.947 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-09-19T07:32:35.947 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2182, 2024-09-19T07:32:35.948 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2319 2024-09-19T07:32:35.948 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.948 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 2182, 2024-09-19T07:32:35.948 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 563, 2024-09-19T07:32:35.948 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 1619, 2024-09-19T07:32:35.948 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-09-19T07:32:35.948 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-09-19T07:32:35.948 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 0, 2024-09-19T07:32:35.948 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 10, 2024-09-19T07:32:35.948 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 98, 2024-09-19T07:32:35.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 821, 2024-09-19T07:32:35.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 75, 2024-09-19T07:32:35.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-09-19T07:32:35.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-09-19T07:32:35.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 5, 2024-09-19T07:32:35.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-09-19T07:32:35.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 602, 2024-09-19T07:32:35.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-09-19T07:32:35.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-09-19T07:32:35.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-09-19T07:32:35.949 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 465, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 20, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 6, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-09-19T07:32:35.950 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 89, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-09-19T07:32:35.951 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 11, 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 12, 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 12, 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 0, 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 160, 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 0, 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 57 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 1, 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-09-19T07:32:35.952 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 1339 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 12, 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 10, 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed_ops": 594, 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 585, 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:32:35.953 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 49301, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 19037374, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 49301, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 49301, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 19037374, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:35.954 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2182, 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 6915909, 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2182, 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 6915909, 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T07:32:35.955 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2182, 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 2182, 2024-09-19T07:32:35.956 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2182, 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 2182, 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 585, 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 67909, 2024-09-19T07:32:35.957 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 585, 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 98, 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 67909, 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x557ed4c14960": { 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-09-19T07:32:35.958 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T07:32:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 2702, 2024-09-19T07:32:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 6681474, 2024-09-19T07:32:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 2702, 2024-09-19T07:32:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T07:32:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T07:32:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 723, 2024-09-19T07:32:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 6681474, 2024-09-19T07:32:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T07:32:35.959 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:35.960 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:35.960 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T07:32:36.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:35 smithi098 ceph-mon[30950]: pgmap v326: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:32:36.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:35 smithi139 ceph-mon[35039]: pgmap v326: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:32:36.753 INFO:tasks.check_counter:Daemon mds.i mds.exported=58 2024-09-19T07:32:36.753 INFO:tasks.check_counter:Daemon mds.i mds.imported=63 2024-09-19T07:32:36.753 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=127 2024-09-19T07:32:36.753 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=4919 2024-09-19T07:32:36.753 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=5 2024-09-19T07:32:36.753 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-19T07:32:36.753 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T07:32:36.753 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T07:32:36.754 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T07:32:37.000 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T07:32:37.479 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-09-19T07:32:37.479 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T07:32:37.479 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 0, 2024-09-19T07:32:37.479 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 2, 2024-09-19T07:32:37.479 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 0, 2024-09-19T07:32:37.479 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 0, 2024-09-19T07:32:37.479 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.001021924, 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000189192, 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:37.480 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 219, 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 209, 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1447808, 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 128544, 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-09-19T07:32:37.481 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.042332780, 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.014465159, 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.040570034, 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 208, 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.012959124, 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000062303 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:37.482 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 1447808, 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 128544 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 6, 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 162, 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 3392, 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 185968, 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.012676934, 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.007502465, 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.003214592, 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T07:32:37.483 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 160, 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.015855626, 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000099097 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 185968 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:37.484 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T07:32:37.485 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T07:32:37.486 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T07:32:37.487 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 148967, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 29, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-09-19T07:32:37.488 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 928, 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-09-19T07:32:37.489 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 221, 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 1416928, 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 221, 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 221, 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1416928, 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-09-19T07:32:37.490 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:37.491 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-09-19T07:32:37.491 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-09-19T07:32:38.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:37 smithi098 ceph-mon[30950]: pgmap v327: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:32:38.040 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:37 smithi139 ceph-mon[35039]: pgmap v327: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:32:38.100 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:37 smithi162 ceph-mon[35726]: pgmap v327: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T07:32:38.127 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-19T07:32:38.127 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-19T07:32:38.127 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-19T07:32:38.127 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-19T07:32:38.127 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-19T07:32:38.127 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-19T07:32:38.128 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-19T07:32:38.128 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T07:32:38.139 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T07:32:38.140 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:32:38.140 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:32:38.162 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:32:38.162 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:32:38.221 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T07:32:38.514 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:32:39.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.973+0000 7fb2b760e640 1 -- 172.21.15.98:0/2860017682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2b0101de0 msgr2=0x7fb2b01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:39.010 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.973+0000 7fb2b760e640 1 --2- 172.21.15.98:0/2860017682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2b0101de0 0x7fb2b01021c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009900 tx=0x7fb2ac02a410 comp rx=0 tx=0).stop 2024-09-19T07:32:39.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.973+0000 7fb2b760e640 1 -- 172.21.15.98:0/2860017682 shutdown_connections 2024-09-19T07:32:39.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.973+0000 7fb2b760e640 1 --2- 172.21.15.98:0/2860017682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2b0106f10 0x7fb2b010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:39.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.973+0000 7fb2b760e640 1 --2- 172.21.15.98:0/2860017682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2b0102790 0x7fb2b01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:39.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.973+0000 7fb2b760e640 1 --2- 172.21.15.98:0/2860017682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2b0101de0 0x7fb2b01021c0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:39.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.973+0000 7fb2b760e640 1 -- 172.21.15.98:0/2860017682 >> 172.21.15.98:0/2860017682 conn(0x7fb2b00fd8c0 msgr2=0x7fb2b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:39.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.973+0000 7fb2b760e640 1 -- 172.21.15.98:0/2860017682 shutdown_connections 2024-09-19T07:32:39.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.973+0000 7fb2b760e640 1 -- 172.21.15.98:0/2860017682 wait complete. 2024-09-19T07:32:39.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.974+0000 7fb2b760e640 1 Processor -- start 2024-09-19T07:32:39.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.974+0000 7fb2b760e640 1 -- start start 2024-09-19T07:32:39.011 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.974+0000 7fb2b760e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2b0101de0 0x7fb2b0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.974+0000 7fb2b760e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2b0102790 0x7fb2b0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.974+0000 7fb2b760e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2b0106f10 0x7fb2b019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.974+0000 7fb2b760e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b0111f30 con 0x7fb2b0101de0 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.974+0000 7fb2b760e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b0111db0 con 0x7fb2b0102790 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.974+0000 7fb2b760e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b01120b0 con 0x7fb2b0106f10 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.974+0000 7fb2b53aa640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2b0101de0 0x7fb2b0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.974+0000 7fb2b53aa640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2b0101de0 0x7fb2b0198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35164/0 (socket says 172.21.15.98:35164) 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.974+0000 7fb2b53aa640 1 -- 172.21.15.98:0/3869475265 learned_addr learned my addr 172.21.15.98:0/3869475265 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.974+0000 7fb2b4ba9640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2b0102790 0x7fb2b0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.975+0000 7fb2b5bab640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2b0106f10 0x7fb2b019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.975+0000 7fb2b53aa640 1 -- 172.21.15.98:0/3869475265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2b0106f10 msgr2=0x7fb2b019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.975+0000 7fb2b53aa640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2b0106f10 0x7fb2b019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:39.012 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.975+0000 7fb2b53aa640 1 -- 172.21.15.98:0/3869475265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2b0102790 msgr2=0x7fb2b0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.975+0000 7fb2b53aa640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2b0102790 0x7fb2b0198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.975+0000 7fb2b53aa640 1 -- 172.21.15.98:0/3869475265 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b019d3f0 con 0x7fb2b0101de0 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.975+0000 7fb2b53aa640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2b0101de0 0x7fb2b0198440 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac006010 tx=0x7fb2ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.975+0000 7fb2a67fc640 1 -- 172.21.15.98:0/3869475265 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac03f030 con 0x7fb2b0101de0 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.975+0000 7fb2b760e640 1 -- 172.21.15.98:0/3869475265 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b019d680 con 0x7fb2b0101de0 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.975+0000 7fb2a67fc640 1 -- 172.21.15.98:0/3869475265 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2ac003ce0 con 0x7fb2b0101de0 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.975+0000 7fb2a67fc640 1 -- 172.21.15.98:0/3869475265 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac035070 con 0x7fb2b0101de0 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.975+0000 7fb2b760e640 1 -- 172.21.15.98:0/3869475265 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b01a4fc0 con 0x7fb2b0101de0 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.976+0000 7fb2b760e640 1 -- 172.21.15.98:0/3869475265 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b01021c0 con 0x7fb2b0101de0 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.977+0000 7fb2a67fc640 1 -- 172.21.15.98:0/3869475265 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb2ac042030 con 0x7fb2b0101de0 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.978+0000 7fb2a67fc640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb29c0a3430 0x7fb29c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.978+0000 7fb2b4ba9640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb29c0a3430 0x7fb29c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.978+0000 7fb2a67fc640 1 -- 172.21.15.98:0/3869475265 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7fb2ac0f0310 con 0x7fb2b0101de0 2024-09-19T07:32:39.013 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.978+0000 7fb2b4ba9640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb29c0a3430 0x7fb29c0a58f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00fdce0 tx=0x7fb2a000b410 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:39.014 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:38.982+0000 7fb2a67fc640 1 -- 172.21.15.98:0/3869475265 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb2ac0bcd50 con 0x7fb2b0101de0 2024-09-19T07:32:39.161 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.161+0000 7fb2b760e640 1 -- 172.21.15.98:0/3869475265 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb2b010a0f0 con 0x7fb2b0101de0 2024-09-19T07:32:39.162 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.161+0000 7fb2a67fc640 1 -- 172.21.15.98:0/3869475265 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v89) ==== 81+0+1000 (secure 0 0 0) 0x7fb2ac0bc650 con 0x7fb2b0101de0 2024-09-19T07:32:39.162 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/3732813400 2024-09-20T07:22:03.757428+0000 2024-09-19T07:32:39.162 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6801/2172632890 2024-09-20T07:22:03.757428+0000 2024-09-19T07:32:39.162 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/2271200719 2024-09-20T07:22:03.757428+0000 2024-09-19T07:32:39.162 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/617371908 2024-09-20T07:22:03.757428+0000 2024-09-19T07:32:39.162 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6801/2881913098 2024-09-20T07:13:13.007306+0000 2024-09-19T07:32:39.162 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/1600483360 2024-09-20T07:13:13.007306+0000 2024-09-19T07:32:39.162 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/68446464 2024-09-20T07:13:36.570145+0000 2024-09-19T07:32:39.162 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/813543838 2024-09-20T07:13:13.007306+0000 2024-09-19T07:32:39.163 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6800/2881913098 2024-09-20T07:13:13.007306+0000 2024-09-19T07:32:39.163 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6800/4041153215 2024-09-20T07:13:36.570145+0000 2024-09-19T07:32:39.163 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/1543222160 2024-09-20T07:22:03.757428+0000 2024-09-19T07:32:39.163 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/4070043354 2024-09-20T07:13:36.570145+0000 2024-09-19T07:32:39.163 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/2152340493 2024-09-20T07:13:13.007306+0000 2024-09-19T07:32:39.163 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6801/4041153215 2024-09-20T07:13:36.570145+0000 2024-09-19T07:32:39.163 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/1243774177 2024-09-20T07:13:36.570145+0000 2024-09-19T07:32:39.163 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:0/1123383068 2024-09-20T07:22:03.757428+0000 2024-09-19T07:32:39.163 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98:6800/2172632890 2024-09-20T07:22:03.757428+0000 2024-09-19T07:32:39.164 INFO:teuthology.orchestra.run.smithi098.stderr:listed 17 entries 2024-09-19T07:32:39.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.163+0000 7fb2b760e640 1 -- 172.21.15.98:0/3869475265 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb29c0a3430 msgr2=0x7fb29c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:39.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.163+0000 7fb2b760e640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb29c0a3430 0x7fb29c0a58f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00fdce0 tx=0x7fb2a000b410 comp rx=0 tx=0).stop 2024-09-19T07:32:39.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.163+0000 7fb2b760e640 1 -- 172.21.15.98:0/3869475265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2b0101de0 msgr2=0x7fb2b0198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:39.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.163+0000 7fb2b760e640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2b0101de0 0x7fb2b0198440 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac006010 tx=0x7fb2ac0042f0 comp rx=0 tx=0).stop 2024-09-19T07:32:39.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.163+0000 7fb2b760e640 1 -- 172.21.15.98:0/3869475265 shutdown_connections 2024-09-19T07:32:39.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.163+0000 7fb2b760e640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7fb29c0a3430 0x7fb29c0a58f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:39.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.163+0000 7fb2b760e640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2b0106f10 0x7fb2b019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:39.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.163+0000 7fb2b760e640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb2b0102790 0x7fb2b0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:39.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.163+0000 7fb2b760e640 1 --2- 172.21.15.98:0/3869475265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2b0101de0 0x7fb2b0198440 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:39.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.163+0000 7fb2b760e640 1 -- 172.21.15.98:0/3869475265 >> 172.21.15.98:0/3869475265 conn(0x7fb2b00fd8c0 msgr2=0x7fb2b00fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:39.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.164+0000 7fb2b760e640 1 -- 172.21.15.98:0/3869475265 shutdown_connections 2024-09-19T07:32:39.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:39.164+0000 7fb2b760e640 1 -- 172.21.15.98:0/3869475265 wait complete. 2024-09-19T07:32:39.853 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T07:32:39.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:32:39.853 DEBUG:teuthology.orchestra.run.smithi098:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T07:32:39.899 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi098.front.sepia.ceph.com 2024-09-19T07:32:39.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:32:39.899 DEBUG:teuthology.orchestra.run.smithi098:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T07:32:39.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:32:39.954 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-19T07:32:39.993 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T07:32:39.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:32:39.993 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T07:32:40.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:39 smithi098 ceph-mon[30950]: pgmap v328: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:32:40.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:39 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/3869475265' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:32:40.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:39 smithi139 ceph-mon[35039]: pgmap v328: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:32:40.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:39 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/3869475265' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:32:40.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:32:40.077 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-19T07:32:40.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:39 smithi162 ceph-mon[35726]: pgmap v328: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T07:32:40.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:39 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/3869475265' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:32:40.168 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T07:32:40.169 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-19T07:32:40.169 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:32:40.186 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=379 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/4c181851580132e40015b3d6a21c1e8e77df282f83a3d5eec9784f3b52f8f681/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4Y5GPJBT6ZDTEYPM7VGKXNIR2D:/var/lib/containers/storage/overlay/l/IUZWL4AQBHQOJ6O5GLKVUIS4PP,upperdir=/var/lib/containers/storage/overlay/4c181851580132e40015b3d6a21c1e8e77df282f83a3d5eec9784f3b52f8f681/diff,workdir=/var/lib/containers/storage/overlay/4c181851580132e40015b3d6a21c1e8e77df282f83a3d5eec9784f3b52f8f681/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/dad639239d2fd582d359ccf393a4421eb2e6dbc7ce42c6014f26d486785d5011/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4Y5GPJBT6ZDTEYPM7VGKXNIR2D:/var/lib/containers/storage/overlay/l/IUZWL4AQBHQOJ6O5GLKVUIS4PP,upperdir=/var/lib/containers/storage/overlay/dad639239d2fd582d359ccf393a4421eb2e6dbc7ce42c6014f26d486785d5011/diff,workdir=/var/lib/containers/storage/overlay/dad639239d2fd582d359ccf393a4421eb2e6dbc7ce42c6014f26d486785d5011/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/da492f04b3f89b7387709278332759227dfb2047176ba22f176af9bee6ee14f9/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4Y5GPJBT6ZDTEYPM7VGKXNIR2D:/var/lib/containers/storage/overlay/l/IUZWL4AQBHQOJ6O5GLKVUIS4PP,upperdir=/var/lib/containers/storage/overlay/da492f04b3f89b7387709278332759227dfb2047176ba22f176af9bee6ee14f9/diff,workdir=/var/lib/containers/storage/overlay/da492f04b3f89b7387709278332759227dfb2047176ba22f176af9bee6ee14f9/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/53e1a4f14297f1bb904584fac79b531644ac9a064ce78070612f3f44034d5005/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4Y5GPJBT6ZDTEYPM7VGKXNIR2D:/var/lib/containers/storage/overlay/l/IUZWL4AQBHQOJ6O5GLKVUIS4PP,upperdir=/var/lib/containers/storage/overlay/53e1a4f14297f1bb904584fac79b531644ac9a064ce78070612f3f44034d5005/diff,workdir=/var/lib/containers/storage/overlay/53e1a4f14297f1bb904584fac79b531644ac9a064ce78070612f3f44034d5005/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/6591c93edbb8486d53127cfb6d5aa0dda938b876dd9421a5bb96dfbc14914b87/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4Y5GPJBT6ZDTEYPM7VGKXNIR2D:/var/lib/containers/storage/overlay/l/IUZWL4AQBHQOJ6O5GLKVUIS4PP,upperdir=/var/lib/containers/storage/overlay/6591c93edbb8486d53127cfb6d5aa0dda938b876dd9421a5bb96dfbc14914b87/diff,workdir=/var/lib/containers/storage/overlay/6591c93edbb8486d53127cfb6d5aa0dda938b876dd9421a5bb96dfbc14914b87/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8449a4ba93c09e6e97cc0b686c05ccb4429f856f7b77e9c8c395d7bcd81279b2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/4Y5GPJBT6ZDTEYPM7VGKXNIR2D:/var/lib/containers/storage/overlay/l/IUZWL4AQBHQOJ6O5GLKVUIS4PP,upperdir=/var/lib/containers/storage/overlay/8449a4ba93c09e6e97cc0b686c05ccb4429f856f7b77e9c8c395d7bcd81279b2/diff,workdir=/var/lib/containers/storage/overlay/8449a4ba93c09e6e97cc0b686c05ccb4429f856f7b77e9c8c395d7bcd81279b2/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/fcde0040ca83b518ed40acc54dd3f6ea7d8a40fe6393e68787b9b087dadd3b66/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4Y5GPJBT6ZDTEYPM7VGKXNIR2D:/var/lib/containers/storage/overlay/l/IUZWL4AQBHQOJ6O5GLKVUIS4PP,upperdir=/var/lib/containers/storage/overlay/fcde0040ca83b518ed40acc54dd3f6ea7d8a40fe6393e68787b9b087dadd3b66/diff,workdir=/var/lib/containers/storage/overlay/fcde0040ca83b518ed40acc54dd3f6ea7d8a40fe6393e68787b9b087dadd3b66/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/68b5c7838064b5747cf003fd209d6e8264c0d4f53d5232861d378ff57d68a4d5/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4Y5GPJBT6ZDTEYPM7VGKXNIR2D:/var/lib/containers/storage/overlay/l/IUZWL4AQBHQOJ6O5GLKVUIS4PP,upperdir=/var/lib/containers/storage/overlay/68b5c7838064b5747cf003fd209d6e8264c0d4f53d5232861d378ff57d68a4d5/diff,workdir=/var/lib/containers/storage/overlay/68b5c7838064b5747cf003fd209d6e8264c0d4f53d5232861d378ff57d68a4d5/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8ae30f10247d294b5d0a7ceff1ee9dfe70649f9fc1a4f7eefa2c498c1c2541c2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4Y5GPJBT6ZDTEYPM7VGKXNIR2D:/var/lib/containers/storage/overlay/l/IUZWL4AQBHQOJ6O5GLKVUIS4PP,upperdir=/var/lib/containers/storage/overlay/8ae30f10247d294b5d0a7ceff1ee9dfe70649f9fc1a4f7eefa2c498c1c2541c2/diff,workdir=/var/lib/containers/storage/overlay/8ae30f10247d294b5d0a7ceff1ee9dfe70649f9fc1a4f7eefa2c498c1c2541c2/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/1b639eca92639162ba358f4dea79ed8f340cb73920b82d44aaaba5039526315d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/4Y5GPJBT6ZDTEYPM7VGKXNIR2D:/var/lib/containers/storage/overlay/l/IUZWL4AQBHQOJ6O5GLKVUIS4PP,upperdir=/var/lib/containers/storage/overlay/1b639eca92639162ba358f4dea79ed8f340cb73920b82d44aaaba5039526315d/diff,workdir=/var/lib/containers/storage/overlay/1b639eca92639162ba358f4dea79ed8f340cb73920b82d44aaaba5039526315d/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 2024-09-19T07:32:40.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:32:40.186 DEBUG:teuthology.orchestra.run.smithi098:> ip netns list 2024-09-19T07:32:40.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:32:40.242 DEBUG:teuthology.orchestra.run.smithi098:> sudo ip link delete ceph-brx 2024-09-19T07:32:40.309 INFO:teuthology.orchestra.run.smithi098.stderr:Cannot find device "ceph-brx" 2024-09-19T07:32:40.310 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:32:40.311 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T07:32:40.328 INFO:tasks.cephadm:Teardown begin 2024-09-19T07:32:40.328 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T07:32:40.328 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:32:40.597 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:32:41.153 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.150+0000 7f3c03261640 1 -- 172.21.15.98:0/1283544512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bfc106f20 msgr2=0x7f3bfc10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.150+0000 7f3c03261640 1 --2- 172.21.15.98:0/1283544512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bfc106f20 0x7f3bfc10eaa0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009ca0 tx=0x7f3bec02a8c0 comp rx=0 tx=0).stop 2024-09-19T07:32:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.150+0000 7f3c03261640 1 -- 172.21.15.98:0/1283544512 shutdown_connections 2024-09-19T07:32:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.150+0000 7f3c03261640 1 --2- 172.21.15.98:0/1283544512 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bfc106f20 0x7f3bfc10eaa0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.150+0000 7f3c03261640 1 --2- 172.21.15.98:0/1283544512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bfc1027a0 0x7f3bfc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.150+0000 7f3c03261640 1 --2- 172.21.15.98:0/1283544512 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bfc101df0 0x7f3bfc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.150+0000 7f3c03261640 1 -- 172.21.15.98:0/1283544512 >> 172.21.15.98:0/1283544512 conn(0x7f3bfc0fd8f0 msgr2=0x7f3bfc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.150+0000 7f3c03261640 1 -- 172.21.15.98:0/1283544512 shutdown_connections 2024-09-19T07:32:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.150+0000 7f3c03261640 1 -- 172.21.15.98:0/1283544512 wait complete. 2024-09-19T07:32:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.150+0000 7f3c03261640 1 Processor -- start 2024-09-19T07:32:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c03261640 1 -- start start 2024-09-19T07:32:41.154 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c03261640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bfc101df0 0x7f3bfc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:41.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c03261640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bfc1027a0 0x7f3bfc198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:41.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c03261640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bfc106f20 0x7f3bfc19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:41.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c03261640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc111f80 con 0x7f3bfc106f20 2024-09-19T07:32:41.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c03261640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc111e00 con 0x7f3bfc101df0 2024-09-19T07:32:41.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c03261640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc112100 con 0x7f3bfc1027a0 2024-09-19T07:32:41.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c017fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bfc106f20 0x7f3bfc19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:41.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c00ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bfc101df0 0x7f3bfc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:41.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c00ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bfc101df0 0x7f3bfc1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.98:40720/0 (socket says 172.21.15.98:40720) 2024-09-19T07:32:41.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c017fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bfc106f20 0x7f3bfc19cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:35170/0 (socket says 172.21.15.98:35170) 2024-09-19T07:32:41.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c00ffd640 1 -- 172.21.15.98:0/2067924078 learned_addr learned my addr 172.21.15.98:0/2067924078 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:41.155 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3bfbfff640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bfc1027a0 0x7f3bfc198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:41.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c017fe640 1 -- 172.21.15.98:0/2067924078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bfc1027a0 msgr2=0x7f3bfc198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:41.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c017fe640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bfc1027a0 0x7f3bfc198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:41.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c017fe640 1 -- 172.21.15.98:0/2067924078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bfc101df0 msgr2=0x7f3bfc1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:41.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c017fe640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bfc101df0 0x7f3bfc1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:41.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c017fe640 1 -- 172.21.15.98:0/2067924078 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bfc19d370 con 0x7f3bfc106f20 2024-09-19T07:32:41.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.151+0000 7f3c017fe640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bfc106f20 0x7f3bfc19cc90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3bec02ade0 tx=0x7f3bec0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:41.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.152+0000 7f3bf9ffb640 1 -- 172.21.15.98:0/2067924078 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec003c30 con 0x7f3bfc106f20 2024-09-19T07:32:41.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.152+0000 7f3bf9ffb640 1 -- 172.21.15.98:0/2067924078 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bec003dd0 con 0x7f3bfc106f20 2024-09-19T07:32:41.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.152+0000 7f3bf9ffb640 1 -- 172.21.15.98:0/2067924078 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec02fd20 con 0x7f3bfc106f20 2024-09-19T07:32:41.156 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.152+0000 7f3c03261640 1 -- 172.21.15.98:0/2067924078 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bfc19d600 con 0x7f3bfc106f20 2024-09-19T07:32:41.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.152+0000 7f3c03261640 1 -- 172.21.15.98:0/2067924078 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bfc1a4f40 con 0x7f3bfc106f20 2024-09-19T07:32:41.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.153+0000 7f3c03261640 1 -- 172.21.15.98:0/2067924078 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bfc1021d0 con 0x7f3bfc106f20 2024-09-19T07:32:41.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.154+0000 7f3bf9ffb640 1 -- 172.21.15.98:0/2067924078 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3bec004050 con 0x7f3bfc106f20 2024-09-19T07:32:41.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.154+0000 7f3bf9ffb640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3be80a33b0 0x7f3be80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:41.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.155+0000 7f3bf9ffb640 1 -- 172.21.15.98:0/2067924078 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f3bec0f0f90 con 0x7f3bfc106f20 2024-09-19T07:32:41.157 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.155+0000 7f3c00ffd640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3be80a33b0 0x7f3be80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:41.158 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.155+0000 7f3c00ffd640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3be80a33b0 0x7f3be80a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4005fd0 tx=0x7f3bf400b480 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:41.159 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.159+0000 7f3bf9ffb640 1 -- 172.21.15.98:0/2067924078 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3bec0bdab0 con 0x7f3bfc106f20 2024-09-19T07:32:41.358 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.358+0000 7f3c03261640 1 -- 172.21.15.98:0/2067924078 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3bfc10a160 con 0x7f3bfc106f20 2024-09-19T07:32:41.359 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.358+0000 7f3bf9ffb640 1 -- 172.21.15.98:0/2067924078 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11919 (secure 0 0 0) 0x7f3bec0bd3b0 con 0x7f3bfc106f20 2024-09-19T07:32:41.359 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:32:41.360 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":36,"btime":"2024-09-19T07:30:29:558606+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:30:29.514555+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":73,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":74,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:32:41.360 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 36 2024-09-19T07:32:41.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.361+0000 7f3c03261640 1 -- 172.21.15.98:0/2067924078 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3be80a33b0 msgr2=0x7f3be80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:41.361 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.361+0000 7f3c03261640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3be80a33b0 0x7f3be80a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4005fd0 tx=0x7f3bf400b480 comp rx=0 tx=0).stop 2024-09-19T07:32:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.361+0000 7f3c03261640 1 -- 172.21.15.98:0/2067924078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bfc106f20 msgr2=0x7f3bfc19cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.361+0000 7f3c03261640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bfc106f20 0x7f3bfc19cc90 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3bec02ade0 tx=0x7f3bec0319f0 comp rx=0 tx=0).stop 2024-09-19T07:32:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.361+0000 7f3c03261640 1 -- 172.21.15.98:0/2067924078 shutdown_connections 2024-09-19T07:32:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.361+0000 7f3c03261640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f3be80a33b0 0x7f3be80a5870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.361+0000 7f3c03261640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bfc106f20 0x7f3bfc19cc90 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.361+0000 7f3c03261640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bfc1027a0 0x7f3bfc198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.361+0000 7f3c03261640 1 --2- 172.21.15.98:0/2067924078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3bfc101df0 0x7f3bfc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.361+0000 7f3c03261640 1 -- 172.21.15.98:0/2067924078 >> 172.21.15.98:0/2067924078 conn(0x7f3bfc0fd8f0 msgr2=0x7f3bfc0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.361+0000 7f3c03261640 1 -- 172.21.15.98:0/2067924078 shutdown_connections 2024-09-19T07:32:41.362 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:41.361+0000 7f3c03261640 1 -- 172.21.15.98:0/2067924078 wait complete. 2024-09-19T07:32:41.985 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:41 smithi098 ceph-mon[30950]: pgmap v329: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:32:41.986 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:41 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2067924078' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:32:41.988 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:32:42.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:41 smithi139 ceph-mon[35039]: pgmap v329: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:32:42.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:41 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2067924078' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:32:42.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:41 smithi162 ceph-mon[35726]: pgmap v329: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T07:32:42.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:41 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2067924078' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:32:42.255 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:32:42.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.720+0000 7f42fa4af640 1 -- 172.21.15.98:0/2939145823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f410c1a0 msgr2=0x7f42f410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:42.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.720+0000 7f42fa4af640 1 --2- 172.21.15.98:0/2939145823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f410c1a0 0x7f42f410e610 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009ca0 tx=0x7f42ec02a950 comp rx=0 tx=0).stop 2024-09-19T07:32:42.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.720+0000 7f42fa4af640 1 -- 172.21.15.98:0/2939145823 shutdown_connections 2024-09-19T07:32:42.729 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.720+0000 7f42fa4af640 1 --2- 172.21.15.98:0/2939145823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f410c1a0 0x7f42f410e610 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.720+0000 7f42fa4af640 1 --2- 172.21.15.98:0/2939145823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42f41036e0 0x7f42f410bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.720+0000 7f42fa4af640 1 --2- 172.21.15.98:0/2939145823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42f4102dc0 0x7f42f41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.720+0000 7f42fa4af640 1 -- 172.21.15.98:0/2939145823 >> 172.21.15.98:0/2939145823 conn(0x7f42f40fc7a0 msgr2=0x7f42f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.720+0000 7f42fa4af640 1 -- 172.21.15.98:0/2939145823 shutdown_connections 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.720+0000 7f42fa4af640 1 -- 172.21.15.98:0/2939145823 wait complete. 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.721+0000 7f42fa4af640 1 Processor -- start 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.721+0000 7f42fa4af640 1 -- start start 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.721+0000 7f42fa4af640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42f4102dc0 0x7f42f41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.721+0000 7f42fa4af640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f41036e0 0x7f42f4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.721+0000 7f42fa4af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42f410c1a0 0x7f42f419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.721+0000 7f42fa4af640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42f4111f70 con 0x7f42f41036e0 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.721+0000 7f42fa4af640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f42f4111df0 con 0x7f42f4102dc0 2024-09-19T07:32:42.730 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.721+0000 7f42fa4af640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f42f41120f0 con 0x7f42f410c1a0 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f41036e0 0x7f42f4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f37fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f41036e0 0x7f42f4198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59850/0 (socket says 172.21.15.98:59850) 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f37fe640 1 -- 172.21.15.98:0/1023095463 learned_addr learned my addr 172.21.15.98:0/1023095463 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f3fff640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42f4102dc0 0x7f42f41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f8a4c640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42f410c1a0 0x7f42f419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f37fe640 1 -- 172.21.15.98:0/1023095463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42f410c1a0 msgr2=0x7f42f419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f37fe640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42f410c1a0 0x7f42f419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f37fe640 1 -- 172.21.15.98:0/1023095463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42f4102dc0 msgr2=0x7f42f41983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f37fe640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42f4102dc0 0x7f42f41983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f37fe640 1 -- 172.21.15.98:0/1023095463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f419d3a0 con 0x7f42f41036e0 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f37fe640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f41036e0 0x7f42f4198930 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f42e800e9f0 tx=0x7f42e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f17fa640 1 -- 172.21.15.98:0/1023095463 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e800cd80 con 0x7f42f41036e0 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42fa4af640 1 -- 172.21.15.98:0/1023095463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f419d690 con 0x7f42f41036e0 2024-09-19T07:32:42.731 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f17fa640 1 -- 172.21.15.98:0/1023095463 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42e8010910 con 0x7f42f41036e0 2024-09-19T07:32:42.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42f17fa640 1 -- 172.21.15.98:0/1023095463 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e80188f0 con 0x7f42f41036e0 2024-09-19T07:32:42.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.722+0000 7f42fa4af640 1 -- 172.21.15.98:0/1023095463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f41a4f70 con 0x7f42f41036e0 2024-09-19T07:32:42.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.723+0000 7f42fa4af640 1 -- 172.21.15.98:0/1023095463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f41031a0 con 0x7f42f41036e0 2024-09-19T07:32:42.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.725+0000 7f42f17fa640 1 -- 172.21.15.98:0/1023095463 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f42e8010ac0 con 0x7f42f41036e0 2024-09-19T07:32:42.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.725+0000 7f42f17fa640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42dc0a33b0 0x7f42dc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:42.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.726+0000 7f42f3fff640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42dc0a33b0 0x7f42dc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:42.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.726+0000 7f42f17fa640 1 -- 172.21.15.98:0/1023095463 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f42e80d05c0 con 0x7f42f41036e0 2024-09-19T07:32:42.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.726+0000 7f42f3fff640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42dc0a33b0 0x7f42dc0a5870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009bd0 tx=0x7f42e4005f90 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:42.732 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.729+0000 7f42f17fa640 1 -- 172.21.15.98:0/1023095463 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f42e809cee0 con 0x7f42f41036e0 2024-09-19T07:32:42.936 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.936+0000 7f42fa4af640 1 -- 172.21.15.98:0/1023095463 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42f41072a0 con 0x7f42f41036e0 2024-09-19T07:32:42.937 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.937+0000 7f42f17fa640 1 -- 172.21.15.98:0/1023095463 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11919 (secure 0 0 0) 0x7f42e809c7e0 con 0x7f42f41036e0 2024-09-19T07:32:42.937 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:32:42.938 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":36,"btime":"2024-09-19T07:30:29:558606+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/181693932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":181693932},{"type":"v1","addr":"172.21.15.98:6835","nonce":181693932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/2912813887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":2912813887},{"type":"v1","addr":"172.21.15.98:6837","nonce":2912813887}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2258357114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2258357114},{"type":"v1","addr":"172.21.15.98:6839","nonce":2258357114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6841/2652528346","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6840","nonce":2652528346},{"type":"v1","addr":"172.21.15.98:6841","nonce":2652528346}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/1643362672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1643362672},{"type":"v1","addr":"172.21.15.162:6833","nonce":1643362672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24421,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2650670127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2650670127},{"type":"v1","addr":"172.21.15.162:6835","nonce":2650670127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T07:20:20.077021+0000","modified":"2024-09-19T07:30:29.514555+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24479,"mds_1":24458,"mds_2":24442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/587476912","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":587476912},{"type":"v1","addr":"172.21.15.139:6833","nonce":587476912}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/2810820400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":2810820400},{"type":"v1","addr":"172.21.15.162:6837","nonce":2810820400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24437":{"gid":24437,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/4113105598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":4113105598},{"type":"v1","addr":"172.21.15.139:6835","nonce":4113105598}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":73,"addr":"172.21.15.162:6839/609705447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":609705447},{"type":"v1","addr":"172.21.15.162:6839","nonce":609705447}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":74,"addr":"172.21.15.139:6837/3386684827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":3386684827},{"type":"v1","addr":"172.21.15.139:6837","nonce":3386684827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.139:6839/2420704228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":2420704228},{"type":"v1","addr":"172.21.15.139:6839","nonce":2420704228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24479,"qdb_cluster":[24479,24458,24442]},"id":1}]} 2024-09-19T07:32:42.938 INFO:teuthology.orchestra.run.smithi098.stderr:dumped fsmap epoch 36 2024-09-19T07:32:42.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.939+0000 7f42fa4af640 1 -- 172.21.15.98:0/1023095463 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42dc0a33b0 msgr2=0x7f42dc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:42.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.939+0000 7f42fa4af640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42dc0a33b0 0x7f42dc0a5870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009bd0 tx=0x7f42e4005f90 comp rx=0 tx=0).stop 2024-09-19T07:32:42.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.939+0000 7f42fa4af640 1 -- 172.21.15.98:0/1023095463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f41036e0 msgr2=0x7f42f4198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:42.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.939+0000 7f42fa4af640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f41036e0 0x7f42f4198930 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f42e800e9f0 tx=0x7f42e800eeb0 comp rx=0 tx=0).stop 2024-09-19T07:32:42.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.939+0000 7f42fa4af640 1 -- 172.21.15.98:0/1023095463 shutdown_connections 2024-09-19T07:32:42.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.939+0000 7f42fa4af640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f42dc0a33b0 0x7f42dc0a5870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:42.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.939+0000 7f42fa4af640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42f410c1a0 0x7f42f419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:42.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.939+0000 7f42fa4af640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42f41036e0 0x7f42f4198930 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:42.940 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.939+0000 7f42fa4af640 1 --2- 172.21.15.98:0/1023095463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f42f4102dc0 0x7f42f41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:42.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.939+0000 7f42fa4af640 1 -- 172.21.15.98:0/1023095463 >> 172.21.15.98:0/1023095463 conn(0x7f42f40fc7a0 msgr2=0x7f42f40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:42.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.940+0000 7f42fa4af640 1 -- 172.21.15.98:0/1023095463 shutdown_connections 2024-09-19T07:32:42.941 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:42.940+0000 7f42fa4af640 1 -- 172.21.15.98:0/1023095463 wait complete. 2024-09-19T07:32:43.611 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T07:32:43.859 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:32:43.976 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:43 smithi098 ceph-mon[30950]: pgmap v330: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:32:43.977 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:43 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1023095463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:32:44.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:43 smithi139 ceph-mon[35039]: pgmap v330: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:32:44.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:43 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1023095463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:32:44.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:43 smithi162 ceph-mon[35726]: pgmap v330: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:32:44.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:43 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1023095463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:32:44.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.342+0000 7faac7499640 1 -- 172.21.15.98:0/2866119588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac0100a80 msgr2=0x7faac0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:44.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.342+0000 7faac7499640 1 --2- 172.21.15.98:0/2866119588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac0100a80 0x7faac0100ee0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7faab0009930 tx=0x7faab002a420 comp rx=0 tx=0).stop 2024-09-19T07:32:44.345 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.342+0000 7faac7499640 1 -- 172.21.15.98:0/2866119588 shutdown_connections 2024-09-19T07:32:44.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.342+0000 7faac7499640 1 --2- 172.21.15.98:0/2866119588 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac0101420 0x7faac010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:44.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.342+0000 7faac7499640 1 --2- 172.21.15.98:0/2866119588 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac0100a80 0x7faac0100ee0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:44.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.342+0000 7faac7499640 1 --2- 172.21.15.98:0/2866119588 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faac0106a80 0x7faac0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:44.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.342+0000 7faac7499640 1 -- 172.21.15.98:0/2866119588 >> 172.21.15.98:0/2866119588 conn(0x7faac00fc7a0 msgr2=0x7faac00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:44.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.342+0000 7faac7499640 1 -- 172.21.15.98:0/2866119588 shutdown_connections 2024-09-19T07:32:44.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.342+0000 7faac7499640 1 -- 172.21.15.98:0/2866119588 wait complete. 2024-09-19T07:32:44.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.342+0000 7faac7499640 1 Processor -- start 2024-09-19T07:32:44.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.342+0000 7faac7499640 1 -- start start 2024-09-19T07:32:44.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac7499640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faac0100a80 0x7faac0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:44.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac7499640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac0101420 0x7faac01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:44.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac7499640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac0106a80 0x7faac019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:44.346 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac7499640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faac0110e80 con 0x7faac0106a80 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac7499640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faac0110d00 con 0x7faac0101420 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac7499640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faac0111000 con 0x7faac0100a80 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac5a36640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac0106a80 0x7faac019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac5a36640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac0106a80 0x7faac019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59872/0 (socket says 172.21.15.98:59872) 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac5a36640 1 -- 172.21.15.98:0/491827968 learned_addr learned my addr 172.21.15.98:0/491827968 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac5235640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faac0100a80 0x7faac0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac4a34640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac0101420 0x7faac01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac5a36640 1 -- 172.21.15.98:0/491827968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faac0100a80 msgr2=0x7faac0198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac5a36640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faac0100a80 0x7faac0198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac5a36640 1 -- 172.21.15.98:0/491827968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac0101420 msgr2=0x7faac01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac5a36640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac0101420 0x7faac01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac5a36640 1 -- 172.21.15.98:0/491827968 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac019d420 con 0x7faac0106a80 2024-09-19T07:32:44.347 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac4a34640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac0101420 0x7faac01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:32:44.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac5a36640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac0106a80 0x7faac019cd40 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7faab8009fd0 tx=0x7faab800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:44.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faab67fc640 1 -- 172.21.15.98:0/491827968 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab8017070 con 0x7faac0106a80 2024-09-19T07:32:44.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faab67fc640 1 -- 172.21.15.98:0/491827968 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab8003e50 con 0x7faac0106a80 2024-09-19T07:32:44.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac7499640 1 -- 172.21.15.98:0/491827968 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac019d710 con 0x7faac0106a80 2024-09-19T07:32:44.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faab67fc640 1 -- 172.21.15.98:0/491827968 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab80106c0 con 0x7faac0106a80 2024-09-19T07:32:44.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.343+0000 7faac7499640 1 -- 172.21.15.98:0/491827968 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac01a4ff0 con 0x7faac0106a80 2024-09-19T07:32:44.348 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.344+0000 7faac7499640 1 -- 172.21.15.98:0/491827968 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac0100ee0 con 0x7faac0106a80 2024-09-19T07:32:44.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.346+0000 7faab67fc640 1 -- 172.21.15.98:0/491827968 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7faab8003970 con 0x7faac0106a80 2024-09-19T07:32:44.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.346+0000 7faab67fc640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faaac0a33b0 0x7faaac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:44.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.346+0000 7faac5235640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faaac0a33b0 0x7faaac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:44.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.346+0000 7faab67fc640 1 -- 172.21.15.98:0/491827968 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7faab80cfc50 con 0x7faac0106a80 2024-09-19T07:32:44.349 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.347+0000 7faac5235640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faaac0a33b0 0x7faaac0a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faabc005fd0 tx=0x7faabc00b510 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:44.351 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.350+0000 7faab67fc640 1 -- 172.21.15.98:0/491827968 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faab809c570 con 0x7faac0106a80 2024-09-19T07:32:44.519 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.518+0000 7faac7499640 1 -- 172.21.15.98:0/491827968 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faac0109a70 con 0x7faac0106a80 2024-09-19T07:32:44.520 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.520+0000 7faab67fc640 1 -- 172.21.15.98:0/491827968 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+23291 (secure 0 0 0) 0x7faab809be70 con 0x7faac0106a80 2024-09-19T07:32:44.521 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-19T07:32:44.521 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":89,"fsid":"73438718-7656-11ef-bceb-c7b262605968","created":"2024-09-19T07:12:50.967816+0000","modified":"2024-09-19T07:32:16.554373+0000","last_up_change":"2024-09-19T07:19:33.196630+0000","last_in_change":"2024-09-19T07:19:09.613759+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T07:15:50.874894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T07:20:16.391879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T07:20:18.243837+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":88,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"716d8456-e227-4bd3-a17d-40eddbb7ccac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6803","nonce":1895935015}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6805","nonce":1895935015}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6809","nonce":1895935015}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":1895935015},{"type":"v1","addr":"172.21.15.98:6807","nonce":1895935015}]},"public_addr":"172.21.15.98:6803/1895935015","cluster_addr":"172.21.15.98:6805/1895935015","heartbeat_back_addr":"172.21.15.98:6809/1895935015","heartbeat_front_addr":"172.21.15.98:6807/1895935015","state":["exists","up"]},{"osd":1,"uuid":"27725803-429d-4458-9881-4a4fdf82dc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6801","nonce":1737478302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6803","nonce":1737478302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6807","nonce":1737478302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":1737478302},{"type":"v1","addr":"172.21.15.139:6805","nonce":1737478302}]},"public_addr":"172.21.15.139:6801/1737478302","cluster_addr":"172.21.15.139:6803/1737478302","heartbeat_back_addr":"172.21.15.139:6807/1737478302","heartbeat_front_addr":"172.21.15.139:6805/1737478302","state":["exists","up"]},{"osd":2,"uuid":"40247362-cb89-41d9-9fab-b0dcb276bd71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6801","nonce":2473103399}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6803","nonce":2473103399}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6807","nonce":2473103399}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2473103399},{"type":"v1","addr":"172.21.15.162:6805","nonce":2473103399}]},"public_addr":"172.21.15.162:6801/2473103399","cluster_addr":"172.21.15.162:6803/2473103399","heartbeat_back_addr":"172.21.15.162:6807/2473103399","heartbeat_front_addr":"172.21.15.162:6805/2473103399","state":["exists","up"]},{"osd":3,"uuid":"4b314c43-b6f0-492c-bc66-10af912f4d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6811","nonce":970037395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6813","nonce":970037395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6817","nonce":970037395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":970037395},{"type":"v1","addr":"172.21.15.98:6815","nonce":970037395}]},"public_addr":"172.21.15.98:6811/970037395","cluster_addr":"172.21.15.98:6813/970037395","heartbeat_back_addr":"172.21.15.98:6817/970037395","heartbeat_front_addr":"172.21.15.98:6815/970037395","state":["exists","up"]},{"osd":4,"uuid":"62d22856-0d55-4a7c-90d2-ff68643ee0e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6809","nonce":4282134034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6811","nonce":4282134034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6815","nonce":4282134034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4282134034},{"type":"v1","addr":"172.21.15.139:6813","nonce":4282134034}]},"public_addr":"172.21.15.139:6809/4282134034","cluster_addr":"172.21.15.139:6811/4282134034","heartbeat_back_addr":"172.21.15.139:6815/4282134034","heartbeat_front_addr":"172.21.15.139:6813/4282134034","state":["exists","up"]},{"osd":5,"uuid":"bbd4560c-4744-4863-aae3-a2c51b7c5e20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6809","nonce":4205554028}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6811","nonce":4205554028}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6815","nonce":4205554028}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":4205554028},{"type":"v1","addr":"172.21.15.162:6813","nonce":4205554028}]},"public_addr":"172.21.15.162:6809/4205554028","cluster_addr":"172.21.15.162:6811/4205554028","heartbeat_back_addr":"172.21.15.162:6815/4205554028","heartbeat_front_addr":"172.21.15.162:6813/4205554028","state":["exists","up"]},{"osd":6,"uuid":"ccb29a18-5a73-4e5c-86fb-1596e5386ce8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6819","nonce":1426401351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6821","nonce":1426401351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6825","nonce":1426401351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":1426401351},{"type":"v1","addr":"172.21.15.98:6823","nonce":1426401351}]},"public_addr":"172.21.15.98:6819/1426401351","cluster_addr":"172.21.15.98:6821/1426401351","heartbeat_back_addr":"172.21.15.98:6825/1426401351","heartbeat_front_addr":"172.21.15.98:6823/1426401351","state":["exists","up"]},{"osd":7,"uuid":"532269e4-0c74-4b64-95c0-1e4ff49d817e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6817","nonce":1139952110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6819","nonce":1139952110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6823","nonce":1139952110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":1139952110},{"type":"v1","addr":"172.21.15.139:6821","nonce":1139952110}]},"public_addr":"172.21.15.139:6817/1139952110","cluster_addr":"172.21.15.139:6819/1139952110","heartbeat_back_addr":"172.21.15.139:6823/1139952110","heartbeat_front_addr":"172.21.15.139:6821/1139952110","state":["exists","up"]},{"osd":8,"uuid":"ca54d58c-9cc0-473c-88da-5e3b15c8cdca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6817","nonce":81102188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6819","nonce":81102188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6823","nonce":81102188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":81102188},{"type":"v1","addr":"172.21.15.162:6821","nonce":81102188}]},"public_addr":"172.21.15.162:6817/81102188","cluster_addr":"172.21.15.162:6819/81102188","heartbeat_back_addr":"172.21.15.162:6823/81102188","heartbeat_front_addr":"172.21.15.162:6821/81102188","state":["exists","up"]},{"osd":9,"uuid":"1b0ffa4c-e3f3-41bb-9f8e-78ef59a8a899","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6827","nonce":1615504006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6829","nonce":1615504006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6833","nonce":1615504006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":1615504006},{"type":"v1","addr":"172.21.15.98:6831","nonce":1615504006}]},"public_addr":"172.21.15.98:6827/1615504006","cluster_addr":"172.21.15.98:6829/1615504006","heartbeat_back_addr":"172.21.15.98:6833/1615504006","heartbeat_front_addr":"172.21.15.98:6831/1615504006","state":["exists","up"]},{"osd":10,"uuid":"5d940771-0407-4f30-95af-079e436759cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6825","nonce":2203263368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6827","nonce":2203263368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6831","nonce":2203263368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":2203263368},{"type":"v1","addr":"172.21.15.139:6829","nonce":2203263368}]},"public_addr":"172.21.15.139:6825/2203263368","cluster_addr":"172.21.15.139:6827/2203263368","heartbeat_back_addr":"172.21.15.139:6831/2203263368","heartbeat_front_addr":"172.21.15.139:6829/2203263368","state":["exists","up"]},{"osd":11,"uuid":"f91b69da-1ecf-46b5-a94d-401a7416be9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6825","nonce":3479073723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6827","nonce":3479073723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6831","nonce":3479073723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3479073723},{"type":"v1","addr":"172.21.15.162:6829","nonce":3479073723}]},"public_addr":"172.21.15.162:6825/3479073723","cluster_addr":"172.21.15.162:6827/3479073723","heartbeat_back_addr":"172.21.15.162:6831/3479073723","heartbeat_front_addr":"172.21.15.162:6829/3479073723","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:14:58.091577+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:23.636168+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:15:48.161722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:13.627842+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:16:38.539569+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:03.834853+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:27.139154+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:17:52.481927+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:17.500088+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:18:42.219648+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:06.677047+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T07:19:30.659260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.98:0/3732813400":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6801/2172632890":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/2271200719":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/617371908":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6801/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/1600483360":"2024-09-20T07:13:13.007306+0000","172.21.15.98:0/68446464":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/813543838":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/2881913098":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6800/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1543222160":"2024-09-20T07:22:03.757428+0000","172.21.15.98:0/4070043354":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/2152340493":"2024-09-20T07:13:13.007306+0000","172.21.15.98:6801/4041153215":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1243774177":"2024-09-20T07:13:36.570145+0000","172.21.15.98:0/1123383068":"2024-09-20T07:22:03.757428+0000","172.21.15.98:6800/2172632890":"2024-09-20T07:22:03.757428+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T07:32:44.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.522+0000 7faac7499640 1 -- 172.21.15.98:0/491827968 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faaac0a33b0 msgr2=0x7faaac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:44.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.522+0000 7faac7499640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faaac0a33b0 0x7faaac0a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faabc005fd0 tx=0x7faabc00b510 comp rx=0 tx=0).stop 2024-09-19T07:32:44.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.522+0000 7faac7499640 1 -- 172.21.15.98:0/491827968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac0106a80 msgr2=0x7faac019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:44.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.522+0000 7faac7499640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac0106a80 0x7faac019cd40 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7faab8009fd0 tx=0x7faab800b260 comp rx=0 tx=0).stop 2024-09-19T07:32:44.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.522+0000 7faac7499640 1 -- 172.21.15.98:0/491827968 shutdown_connections 2024-09-19T07:32:44.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.522+0000 7faac7499640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7faaac0a33b0 0x7faaac0a5870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:44.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.522+0000 7faac7499640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac0106a80 0x7faac019cd40 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:44.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.522+0000 7faac7499640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faac0101420 0x7faac01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:44.523 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.522+0000 7faac7499640 1 --2- 172.21.15.98:0/491827968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faac0100a80 0x7faac0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:44.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.522+0000 7faac7499640 1 -- 172.21.15.98:0/491827968 >> 172.21.15.98:0/491827968 conn(0x7faac00fc7a0 msgr2=0x7faac006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:44.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.522+0000 7faac7499640 1 -- 172.21.15.98:0/491827968 shutdown_connections 2024-09-19T07:32:44.524 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:44.522+0000 7faac7499640 1 -- 172.21.15.98:0/491827968 wait complete. 2024-09-19T07:32:44.773 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:44 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/491827968' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:32:45.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:44 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/491827968' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:32:45.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:44 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/491827968' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T07:32:45.273 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T07:32:45.520 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:32:45.921 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:45 smithi098 ceph-mon[30950]: pgmap v331: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:32:46.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.001+0000 7f2cdd053640 1 -- 172.21.15.98:0/255402778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cd8106a80 msgr2=0x7f2cd8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:46.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.001+0000 7f2cdd053640 1 --2- 172.21.15.98:0/255402778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cd8106a80 0x7f2cd8106e60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009930 tx=0x7f2cc802a420 comp rx=0 tx=0).stop 2024-09-19T07:32:46.029 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.001+0000 7f2cdd053640 1 -- 172.21.15.98:0/255402778 shutdown_connections 2024-09-19T07:32:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.001+0000 7f2cdd053640 1 --2- 172.21.15.98:0/255402778 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cd8101420 0x7f2cd810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.001+0000 7f2cdd053640 1 --2- 172.21.15.98:0/255402778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd8100a80 0x7f2cd8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.001+0000 7f2cdd053640 1 --2- 172.21.15.98:0/255402778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cd8106a80 0x7f2cd8106e60 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.001+0000 7f2cdd053640 1 -- 172.21.15.98:0/255402778 >> 172.21.15.98:0/255402778 conn(0x7f2cd80fc7a0 msgr2=0x7f2cd80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.001+0000 7f2cdd053640 1 -- 172.21.15.98:0/255402778 shutdown_connections 2024-09-19T07:32:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.001+0000 7f2cdd053640 1 -- 172.21.15.98:0/255402778 wait complete. 2024-09-19T07:32:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.002+0000 7f2cdd053640 1 Processor -- start 2024-09-19T07:32:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.002+0000 7f2cdd053640 1 -- start start 2024-09-19T07:32:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cdd053640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cd8100a80 0x7f2cd81974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cdd053640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cd8101420 0x7f2cd8197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cdd053640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd8106a80 0x7f2cd819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:46.030 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cdd053640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd8110f20 con 0x7f2cd8101420 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cdd053640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd8110da0 con 0x7f2cd8100a80 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cdd053640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd81110a0 con 0x7f2cd8106a80 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cd659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cd8101420 0x7f2cd8197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cd659c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cd8101420 0x7f2cd8197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59898/0 (socket says 172.21.15.98:59898) 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cd659c640 1 -- 172.21.15.98:0/1855751945 learned_addr learned my addr 172.21.15.98:0/1855751945 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cd6d9d640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cd8100a80 0x7f2cd81974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cd759e640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd8106a80 0x7f2cd819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cd659c640 1 -- 172.21.15.98:0/1855751945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd8106a80 msgr2=0x7f2cd819bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cd659c640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd8106a80 0x7f2cd819bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cd659c640 1 -- 172.21.15.98:0/1855751945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cd8100a80 msgr2=0x7f2cd81974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cd659c640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cd8100a80 0x7f2cd81974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cd659c640 1 -- 172.21.15.98:0/1855751945 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd819c490 con 0x7f2cd8101420 2024-09-19T07:32:46.031 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cd659c640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cd8101420 0x7f2cd8197a20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00b4a0 tx=0x7f2ccc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:46.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cbffff640 1 -- 172.21.15.98:0/1855751945 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc014070 con 0x7f2cd8101420 2024-09-19T07:32:46.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.003+0000 7f2cdd053640 1 -- 172.21.15.98:0/1855751945 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd819c780 con 0x7f2cd8101420 2024-09-19T07:32:46.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.004+0000 7f2cdd053640 1 -- 172.21.15.98:0/1855751945 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd81a4060 con 0x7f2cd8101420 2024-09-19T07:32:46.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.004+0000 7f2cbffff640 1 -- 172.21.15.98:0/1855751945 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ccc010af0 con 0x7f2cd8101420 2024-09-19T07:32:46.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.004+0000 7f2cbffff640 1 -- 172.21.15.98:0/1855751945 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc01e060 con 0x7f2cd8101420 2024-09-19T07:32:46.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.004+0000 7f2cdd053640 1 -- 172.21.15.98:0/1855751945 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc4005290 con 0x7f2cd8101420 2024-09-19T07:32:46.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.006+0000 7f2cbffff640 1 -- 172.21.15.98:0/1855751945 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2ccc017070 con 0x7f2cd8101420 2024-09-19T07:32:46.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.006+0000 7f2cbffff640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f2cc00a33b0 0x7f2cc00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:46.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.006+0000 7f2cd6d9d640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f2cc00a33b0 0x7f2cc00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:46.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.006+0000 7f2cbffff640 1 -- 172.21.15.98:0/1855751945 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8614+0+0 (secure 0 0 0) 0x7f2ccc0ceec0 con 0x7f2cd8101420 2024-09-19T07:32:46.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.007+0000 7f2cd6d9d640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f2cc00a33b0 0x7f2cc00a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009900 tx=0x7f2cc80058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:46.032 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.010+0000 7f2cbffff640 1 -- 172.21.15.98:0/1855751945 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2ccc09b950 con 0x7f2cd8101420 2024-09-19T07:32:46.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:45 smithi139 ceph-mon[35039]: pgmap v331: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:32:46.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:45 smithi162 ceph-mon[35726]: pgmap v331: 97 pgs: 97 active+clean; 61 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T07:32:46.214 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.213+0000 7f2cdd053640 1 -- 172.21.15.98:0/1855751945 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2cc4005850 con 0x7f2cd8101420 2024-09-19T07:32:46.218 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.218+0000 7f2cbffff640 1 -- 172.21.15.98:0/1855751945 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7f2ccc09b250 con 0x7f2cd8101420 2024-09-19T07:32:46.218 INFO:teuthology.orchestra.run.smithi098.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T07:32:46.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.220+0000 7f2cdd053640 1 -- 172.21.15.98:0/1855751945 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f2cc00a33b0 msgr2=0x7f2cc00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:46.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.220+0000 7f2cdd053640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f2cc00a33b0 0x7f2cc00a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8009900 tx=0x7f2cc80058d0 comp rx=0 tx=0).stop 2024-09-19T07:32:46.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.220+0000 7f2cdd053640 1 -- 172.21.15.98:0/1855751945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cd8101420 msgr2=0x7f2cd8197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:46.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.220+0000 7f2cdd053640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cd8101420 0x7f2cd8197a20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00b4a0 tx=0x7f2ccc00b960 comp rx=0 tx=0).stop 2024-09-19T07:32:46.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.220+0000 7f2cdd053640 1 -- 172.21.15.98:0/1855751945 shutdown_connections 2024-09-19T07:32:46.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.220+0000 7f2cdd053640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f2cc00a33b0 0x7f2cc00a5870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:46.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.220+0000 7f2cdd053640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cd8106a80 0x7f2cd819bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:46.221 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.221+0000 7f2cdd053640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2cd8101420 0x7f2cd8197a20 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:46.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.221+0000 7f2cdd053640 1 --2- 172.21.15.98:0/1855751945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2cd8100a80 0x7f2cd81974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:46.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.221+0000 7f2cdd053640 1 -- 172.21.15.98:0/1855751945 >> 172.21.15.98:0/1855751945 conn(0x7f2cd80fc7a0 msgr2=0x7f2cd80fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:46.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.221+0000 7f2cdd053640 1 -- 172.21.15.98:0/1855751945 shutdown_connections 2024-09-19T07:32:46.222 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:46.221+0000 7f2cdd053640 1 -- 172.21.15.98:0/1855751945 wait complete. 2024-09-19T07:32:46.523 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:46 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a[30946]: 2024-09-19T07:32:46.214+0000 7efcdd063640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T07:32:46.567 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b[65424]: ignoring --setuser ceph since I am not root 2024-09-19T07:32:46.567 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b[65424]: ignoring --setgroup ceph since I am not root 2024-09-19T07:32:46.567 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-mds[65428]: -- 172.21.15.139:0/94941598 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55feff043860 con 0x55feff021000 2024-09-19T07:32:46.567 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b[65424]: starting mds.b at 2024-09-19T07:32:46.567 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e[64822]: ignoring --setuser ceph since I am not root 2024-09-19T07:32:46.567 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e[64822]: ignoring --setgroup ceph since I am not root 2024-09-19T07:32:46.567 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-mds[64826]: -- 172.21.15.139:0/3336593628 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56171a079860 con 0x56171a057000 2024-09-19T07:32:46.568 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e[64822]: starting mds.e at 2024-09-19T07:32:46.568 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: ignoring --setuser ceph since I am not root 2024-09-19T07:32:46.568 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: ignoring --setgroup ceph since I am not root 2024-09-19T07:32:46.568 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-mds[65126]: -- 172.21.15.139:0/230504528 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564553bb3860 con 0x564553b90800 2024-09-19T07:32:46.568 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: starting mds.h at 2024-09-19T07:32:46.568 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-k[64513]: ignoring --setuser ceph since I am not root 2024-09-19T07:32:46.568 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-k[64513]: ignoring --setgroup ceph since I am not root 2024-09-19T07:32:46.568 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-mds[64517]: -- 172.21.15.139:0/1773842157 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5632517ff860 con 0x5632517dd000 2024-09-19T07:32:46.569 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-k[64513]: starting mds.k at 2024-09-19T07:32:46.632 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c[65781]: ignoring --setuser ceph since I am not root 2024-09-19T07:32:46.632 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c[65781]: ignoring --setgroup ceph since I am not root 2024-09-19T07:32:46.632 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-mds[65785]: -- 172.21.15.162:0/428487099 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560925969860 con 0x560925947400 2024-09-19T07:32:46.632 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c[65781]: starting mds.c at 2024-09-19T07:32:46.632 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c[65781]: 2024-09-19T07:32:46.265+0000 7f6320a46640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6836/0: (98) Address already in use 2024-09-19T07:32:46.632 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: ignoring --setuser ceph since I am not root 2024-09-19T07:32:46.632 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: ignoring --setgroup ceph since I am not root 2024-09-19T07:32:46.632 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-mds[66087]: -- 172.21.15.162:0/2293752580 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d9b557dc20 con 0x55d9b555b000 2024-09-19T07:32:46.632 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: starting mds.i at 2024-09-19T07:32:47.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:46 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1855751945' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T07:32:47.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:46 smithi098 ceph-mon[30950]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T07:32:47.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:46 smithi098 ceph-mon[30950]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T07:32:47.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:46 smithi098 ceph-mon[30950]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-09-19T07:32:47.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:46 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/1855751945' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T07:32:47.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:46 smithi098 ceph-mon[30950]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T07:32:47.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:46 smithi098 ceph-mon[30950]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T07:32:47.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1855751945' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T07:32:47.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-mon[35039]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T07:32:47.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-mon[35039]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T07:32:47.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-mon[35039]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-09-19T07:32:47.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/1855751945' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T07:32:47.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-mon[35039]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T07:32:47.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:46 smithi139 ceph-mon[35039]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T07:32:47.081 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T07:32:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1855751945' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T07:32:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-mon[35726]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T07:32:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-mon[35726]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T07:32:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-mon[35726]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-09-19T07:32:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/1855751945' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T07:32:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-mon[35726]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T07:32:47.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:46 smithi162 ceph-mon[35726]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T07:32:47.329 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:32:47.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 -- 172.21.15.98:0/1563888338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948102ef0 msgr2=0x7f094810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:47.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 --2- 172.21.15.98:0/1563888338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948102ef0 0x7f094810da40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f0940009ca0 tx=0x7f094002a950 comp rx=0 tx=0).stop 2024-09-19T07:32:47.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 -- 172.21.15.98:0/1563888338 shutdown_connections 2024-09-19T07:32:47.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 --2- 172.21.15.98:0/1563888338 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948102ef0 0x7f094810da40 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:47.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 --2- 172.21.15.98:0/1563888338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0948102570 0x7f09481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:47.914 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 --2- 172.21.15.98:0/1563888338 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0948100e20 0x7f0948101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 -- 172.21.15.98:0/1563888338 >> 172.21.15.98:0/1563888338 conn(0x7f09480fc7d0 msgr2=0x7f09480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 -- 172.21.15.98:0/1563888338 shutdown_connections 2024-09-19T07:32:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 -- 172.21.15.98:0/1563888338 wait complete. 2024-09-19T07:32:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 Processor -- start 2024-09-19T07:32:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 -- start start 2024-09-19T07:32:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0948100e20 0x7f09481974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0948102570 0x7f0948197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.863+0000 7f094e4c5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948102ef0 0x7f094819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f094e4c5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0948111020 con 0x7f0948102ef0 2024-09-19T07:32:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f094e4c5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0948110ea0 con 0x7f0948102570 2024-09-19T07:32:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f094e4c5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f09481111a0 con 0x7f0948100e20 2024-09-19T07:32:47.915 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f094ca62640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948102ef0 0x7f094819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f094ca62640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948102ef0 0x7f094819bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59922/0 (socket says 172.21.15.98:59922) 2024-09-19T07:32:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f094ca62640 1 -- 172.21.15.98:0/4199386686 learned_addr learned my addr 172.21.15.98:0/4199386686 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f0947fff640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0948100e20 0x7f09481974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f093ffff640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0948102570 0x7f0948197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f094ca62640 1 -- 172.21.15.98:0/4199386686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0948100e20 msgr2=0x7f09481974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f094ca62640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0948100e20 0x7f09481974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f094ca62640 1 -- 172.21.15.98:0/4199386686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0948102570 msgr2=0x7f0948197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f094ca62640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0948102570 0x7f0948197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f094ca62640 1 -- 172.21.15.98:0/4199386686 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094819c490 con 0x7f0948102ef0 2024-09-19T07:32:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f094ca62640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948102ef0 0x7f094819bdb0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0940006010 tx=0x7f094002f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:47.916 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f0945ffb640 1 -- 172.21.15.98:0/4199386686 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940034040 con 0x7f0948102ef0 2024-09-19T07:32:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f0945ffb640 1 -- 172.21.15.98:0/4199386686 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0940003e00 con 0x7f0948102ef0 2024-09-19T07:32:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.865+0000 7f094e4c5640 1 -- 172.21.15.98:0/4199386686 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094819c720 con 0x7f0948102ef0 2024-09-19T07:32:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.864+0000 7f0945ffb640 1 -- 172.21.15.98:0/4199386686 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094003a5c0 con 0x7f0948102ef0 2024-09-19T07:32:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.865+0000 7f094e4c5640 1 -- 172.21.15.98:0/4199386686 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0948069f70 con 0x7f0948102ef0 2024-09-19T07:32:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.865+0000 7f094e4c5640 1 -- 172.21.15.98:0/4199386686 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09481021b0 con 0x7f0948102ef0 2024-09-19T07:32:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.867+0000 7f0945ffb640 1 -- 172.21.15.98:0/4199386686 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0940037020 con 0x7f0948102ef0 2024-09-19T07:32:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.867+0000 7f0945ffb640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f09340a3430 0x7f09340a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.867+0000 7f0947fff640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f09340a3430 0x7f09340a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.868+0000 7f0945ffb640 1 -- 172.21.15.98:0/4199386686 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8828+0+0 (secure 0 0 0) 0x7f09400f2b70 con 0x7f0948102ef0 2024-09-19T07:32:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.868+0000 7f0947fff640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f09340a3430 0x7f09340a58f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0938009990 tx=0x7f0938009110 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:47.917 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:47.871+0000 7f0945ffb640 1 -- 172.21.15.98:0/4199386686 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0940040070 con 0x7f0948102ef0 2024-09-19T07:32:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: pgmap v332: 97 pgs: 97 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T07:32:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.162:6836/3678546720,v1:172.21.15.162:6838/3678546720] up:boot 2024-09-19T07:32:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.162:6837/4118520576,v1:172.21.15.162:6839/4118520576] up:boot 2024-09-19T07:32:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.139:6832/492095209,v1:172.21.15.139:6833/492095209] up:boot 2024-09-19T07:32:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.139:6834/636303165,v1:172.21.15.139:6836/636303165] up:boot 2024-09-19T07:32:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.139:6835/186941883,v1:172.21.15.139:6837/186941883] up:boot 2024-09-19T07:32:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: mds.? [v2:172.21.15.139:6838/2235255435,v1:172.21.15.139:6839/2235255435] up:boot 2024-09-19T07:32:48.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T07:32:48.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:32:48.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:32:48.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:32:48.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:32:48.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:32:48.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:47 smithi098 ceph-mon[30950]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:32:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: pgmap v332: 97 pgs: 97 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.162:6836/3678546720,v1:172.21.15.162:6838/3678546720] up:boot 2024-09-19T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.162:6837/4118520576,v1:172.21.15.162:6839/4118520576] up:boot 2024-09-19T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.139:6832/492095209,v1:172.21.15.139:6833/492095209] up:boot 2024-09-19T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.139:6834/636303165,v1:172.21.15.139:6836/636303165] up:boot 2024-09-19T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.139:6835/186941883,v1:172.21.15.139:6837/186941883] up:boot 2024-09-19T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: mds.? [v2:172.21.15.139:6838/2235255435,v1:172.21.15.139:6839/2235255435] up:boot 2024-09-19T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:32:48.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:32:48.068 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:47 smithi139 ceph-mon[35039]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:32:48.074 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.074+0000 7f094e4c5640 1 -- 172.21.15.98:0/4199386686 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f094806a9f0 con 0x7f0948102ef0 2024-09-19T07:32:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: pgmap v332: 97 pgs: 97 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T07:32:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.162:6836/3678546720,v1:172.21.15.162:6838/3678546720] up:boot 2024-09-19T07:32:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.162:6837/4118520576,v1:172.21.15.162:6839/4118520576] up:boot 2024-09-19T07:32:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.139:6832/492095209,v1:172.21.15.139:6833/492095209] up:boot 2024-09-19T07:32:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.139:6834/636303165,v1:172.21.15.139:6836/636303165] up:boot 2024-09-19T07:32:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.139:6835/186941883,v1:172.21.15.139:6837/186941883] up:boot 2024-09-19T07:32:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: mds.? [v2:172.21.15.139:6838/2235255435,v1:172.21.15.139:6839/2235255435] up:boot 2024-09-19T07:32:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T07:32:48.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T07:32:48.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T07:32:48.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T07:32:48.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T07:32:48.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T07:32:48.133 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:47 smithi162 ceph-mon[35726]: from='mgr.15129 172.21.15.98:0/1985746137' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T07:32:48.739 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.738+0000 7f0945ffb640 1 -- 172.21.15.98:0/4199386686 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7f09400bf420 con 0x7f0948102ef0 2024-09-19T07:32:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.741+0000 7f094e4c5640 1 -- 172.21.15.98:0/4199386686 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f09340a3430 msgr2=0x7f09340a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.741+0000 7f094e4c5640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f09340a3430 0x7f09340a58f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0938009990 tx=0x7f0938009110 comp rx=0 tx=0).stop 2024-09-19T07:32:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.741+0000 7f094e4c5640 1 -- 172.21.15.98:0/4199386686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948102ef0 msgr2=0x7f094819bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.741+0000 7f094e4c5640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948102ef0 0x7f094819bdb0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0940006010 tx=0x7f094002f6f0 comp rx=0 tx=0).stop 2024-09-19T07:32:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.741+0000 7f094e4c5640 1 -- 172.21.15.98:0/4199386686 shutdown_connections 2024-09-19T07:32:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.741+0000 7f094e4c5640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f09340a3430 0x7f09340a58f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.741+0000 7f094e4c5640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0948102ef0 0x7f094819bdb0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.741+0000 7f094e4c5640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0948102570 0x7f0948197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.741+0000 7f094e4c5640 1 --2- 172.21.15.98:0/4199386686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0948100e20 0x7f09481974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:48.742 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.741+0000 7f094e4c5640 1 -- 172.21.15.98:0/4199386686 >> 172.21.15.98:0/4199386686 conn(0x7f09480fc7d0 msgr2=0x7f09480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:48.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.741+0000 7f094e4c5640 1 -- 172.21.15.98:0/4199386686 shutdown_connections 2024-09-19T07:32:48.743 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:48.741+0000 7f094e4c5640 1 -- 172.21.15.98:0/4199386686 wait complete. 2024-09-19T07:32:49.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:48 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4199386686' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:32:49.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:48 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4199386686' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:32:49.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:48 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4199386686' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T07:32:49.381 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T07:32:49.636 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:32:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:49 smithi098 ceph-mon[30950]: pgmap v334: 97 pgs: 97 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T07:32:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:49 smithi098 ceph-mon[30950]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T07:32:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:49 smithi098 ceph-mon[30950]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T07:32:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:49 smithi098 ceph-mon[30950]: Cluster is now healthy 2024-09-19T07:32:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:49 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/4199386686' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:32:50.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:49 smithi098 ceph-mon[30950]: fsmap 12 up:standby 2024-09-19T07:32:50.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:49 smithi139 ceph-mon[35039]: pgmap v334: 97 pgs: 97 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T07:32:50.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:49 smithi139 ceph-mon[35039]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T07:32:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:49 smithi139 ceph-mon[35039]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T07:32:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:49 smithi139 ceph-mon[35039]: Cluster is now healthy 2024-09-19T07:32:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:49 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/4199386686' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:32:50.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:49 smithi139 ceph-mon[35039]: fsmap 12 up:standby 2024-09-19T07:32:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:49 smithi162 ceph-mon[35726]: pgmap v334: 97 pgs: 97 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-19T07:32:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:49 smithi162 ceph-mon[35726]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T07:32:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:49 smithi162 ceph-mon[35726]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T07:32:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:49 smithi162 ceph-mon[35726]: Cluster is now healthy 2024-09-19T07:32:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:49 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/4199386686' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T07:32:50.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:49 smithi162 ceph-mon[35726]: fsmap 12 up:standby 2024-09-19T07:32:50.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.158+0000 7f5a57c5d640 1 -- 172.21.15.98:0/921990076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a501027a0 msgr2=0x7f5a501067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:50.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.158+0000 7f5a57c5d640 1 --2- 172.21.15.98:0/921990076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a501027a0 0x7f5a501067f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009900 tx=0x7f5a4402a410 comp rx=0 tx=0).stop 2024-09-19T07:32:50.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.158+0000 7f5a57c5d640 1 -- 172.21.15.98:0/921990076 shutdown_connections 2024-09-19T07:32:50.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.158+0000 7f5a57c5d640 1 --2- 172.21.15.98:0/921990076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a50106f20 0x7f5a5010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:50.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.158+0000 7f5a57c5d640 1 --2- 172.21.15.98:0/921990076 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a501027a0 0x7f5a501067f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:50.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.158+0000 7f5a57c5d640 1 --2- 172.21.15.98:0/921990076 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a50101df0 0x7f5a501021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:50.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.158+0000 7f5a57c5d640 1 -- 172.21.15.98:0/921990076 >> 172.21.15.98:0/921990076 conn(0x7f5a500fd8b0 msgr2=0x7f5a500ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:50.164 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.158+0000 7f5a57c5d640 1 -- 172.21.15.98:0/921990076 shutdown_connections 2024-09-19T07:32:50.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.158+0000 7f5a57c5d640 1 -- 172.21.15.98:0/921990076 wait complete. 2024-09-19T07:32:50.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a57c5d640 1 Processor -- start 2024-09-19T07:32:50.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a57c5d640 1 -- start start 2024-09-19T07:32:50.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a57c5d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a50101df0 0x7f5a501985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:50.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a57c5d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a501027a0 0x7f5a50198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:50.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a57c5d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a50106f20 0x7f5a5019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:50.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a57c5d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5a50112040 con 0x7f5a501027a0 2024-09-19T07:32:50.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a57c5d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a50111ec0 con 0x7f5a50106f20 2024-09-19T07:32:50.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a57c5d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a501121c0 con 0x7f5a50101df0 2024-09-19T07:32:50.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a551f8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a501027a0 0x7f5a50198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:50.165 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a551f8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a501027a0 0x7f5a50198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59938/0 (socket says 172.21.15.98:59938) 2024-09-19T07:32:50.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a551f8640 1 -- 172.21.15.98:0/2972726330 learned_addr learned my addr 172.21.15.98:0/2972726330 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:50.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a551f8640 1 -- 172.21.15.98:0/2972726330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a50101df0 msgr2=0x7f5a501985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:50.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a561fa640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a50106f20 0x7f5a5019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:50.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a551f8640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a50101df0 0x7f5a501985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:50.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a551f8640 1 -- 172.21.15.98:0/2972726330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a50106f20 msgr2=0x7f5a5019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:50.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.159+0000 7f5a551f8640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a50106f20 0x7f5a5019ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:50.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.160+0000 7f5a551f8640 1 -- 172.21.15.98:0/2972726330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5019d550 con 0x7f5a501027a0 2024-09-19T07:32:50.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.160+0000 7f5a551f8640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a501027a0 0x7f5a50198ae0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5a44005ab0 tx=0x7f5a440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:50.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.160+0000 7f5a4effd640 1 -- 172.21.15.98:0/2972726330 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4403f030 con 0x7f5a501027a0 2024-09-19T07:32:50.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.160+0000 7f5a4effd640 1 -- 172.21.15.98:0/2972726330 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a44003ce0 con 0x7f5a501027a0 2024-09-19T07:32:50.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.160+0000 7f5a57c5d640 1 -- 172.21.15.98:0/2972726330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5019d7e0 con 0x7f5a501027a0 2024-09-19T07:32:50.166 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.160+0000 7f5a4effd640 1 -- 172.21.15.98:0/2972726330 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a44035070 con 0x7f5a501027a0 2024-09-19T07:32:50.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.160+0000 7f5a57c5d640 1 -- 172.21.15.98:0/2972726330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a501a5120 con 0x7f5a501027a0 2024-09-19T07:32:50.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.161+0000 7f5a57c5d640 1 -- 172.21.15.98:0/2972726330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a501032d0 con 0x7f5a501027a0 2024-09-19T07:32:50.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.162+0000 7f5a4effd640 1 -- 172.21.15.98:0/2972726330 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5a44042030 con 0x7f5a501027a0 2024-09-19T07:32:50.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.163+0000 7f5a4effd640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f5a380a33b0 0x7f5a380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:50.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.163+0000 7f5a559f9640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f5a380a33b0 0x7f5a380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:50.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.163+0000 7f5a4effd640 1 -- 172.21.15.98:0/2972726330 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8828+0+0 (secure 0 0 0) 0x7f5a440f0a70 con 0x7f5a501027a0 2024-09-19T07:32:50.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.163+0000 7f5a559f9640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f5a380a33b0 0x7f5a380a5870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000abb0 tx=0x7f5a40009250 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:50.167 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.166+0000 7f5a4effd640 1 -- 172.21.15.98:0/2972726330 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a440bd2c0 con 0x7f5a501027a0 2024-09-19T07:32:50.340 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.339+0000 7f5a57c5d640 1 -- 172.21.15.98:0/2972726330 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5a50102250 con 0x7f5a501027a0 2024-09-19T07:32:50.746 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.746+0000 7f5a4effd640 1 -- 172.21.15.98:0/2972726330 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) ==== 181+0+0 (secure 0 0 0) 0x7f5a50102250 con 0x7f5a501027a0 2024-09-19T07:32:50.746 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_metadata' removed 2024-09-19T07:32:50.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.749+0000 7f5a57c5d640 1 -- 172.21.15.98:0/2972726330 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f5a380a33b0 msgr2=0x7f5a380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:50.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.749+0000 7f5a57c5d640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f5a380a33b0 0x7f5a380a5870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000abb0 tx=0x7f5a40009250 comp rx=0 tx=0).stop 2024-09-19T07:32:50.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.749+0000 7f5a57c5d640 1 -- 172.21.15.98:0/2972726330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a501027a0 msgr2=0x7f5a50198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:50.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.749+0000 7f5a57c5d640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a501027a0 0x7f5a50198ae0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5a44005ab0 tx=0x7f5a440042f0 comp rx=0 tx=0).stop 2024-09-19T07:32:50.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.749+0000 7f5a57c5d640 1 -- 172.21.15.98:0/2972726330 shutdown_connections 2024-09-19T07:32:50.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.749+0000 7f5a57c5d640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f5a380a33b0 0x7f5a380a5870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:50.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.749+0000 7f5a57c5d640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a50106f20 0x7f5a5019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:50.750 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.749+0000 7f5a57c5d640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a501027a0 0x7f5a50198ae0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:50.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.749+0000 7f5a57c5d640 1 --2- 172.21.15.98:0/2972726330 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a50101df0 0x7f5a501985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:50.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.749+0000 7f5a57c5d640 1 -- 172.21.15.98:0/2972726330 >> 172.21.15.98:0/2972726330 conn(0x7f5a500fd8b0 msgr2=0x7f5a500febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:50.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.750+0000 7f5a57c5d640 1 -- 172.21.15.98:0/2972726330 shutdown_connections 2024-09-19T07:32:50.751 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:50.750+0000 7f5a57c5d640 1 -- 172.21.15.98:0/2972726330 wait complete. 2024-09-19T07:32:51.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:50 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2972726330' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:32:51.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:50 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2972726330' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:32:51.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:50 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2972726330' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:32:51.381 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 73438718-7656-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T07:32:51.633 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T07:32:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:51 smithi098 ceph-mon[30950]: pgmap v335: 97 pgs: 97 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 921 B/s wr, 5 op/s 2024-09-19T07:32:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:51 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2972726330' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:32:52.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:51 smithi098 ceph-mon[30950]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T07:32:52.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:51 smithi139 ceph-mon[35039]: pgmap v335: 97 pgs: 97 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 921 B/s wr, 5 op/s 2024-09-19T07:32:52.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:51 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2972726330' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:32:52.067 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:51 smithi139 ceph-mon[35039]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T07:32:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:51 smithi162 ceph-mon[35726]: pgmap v335: 97 pgs: 97 active+clean; 61 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 921 B/s wr, 5 op/s 2024-09-19T07:32:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:51 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2972726330' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:32:52.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:51 smithi162 ceph-mon[35726]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T07:32:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.172+0000 7f371a2b1640 1 -- 172.21.15.98:0/966986111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3714102570 msgr2=0x7f37141029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.172+0000 7f371a2b1640 1 --2- 172.21.15.98:0/966986111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3714102570 0x7f37141029b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009900 tx=0x7f36fc02a480 comp rx=0 tx=0).stop 2024-09-19T07:32:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.172+0000 7f371a2b1640 1 -- 172.21.15.98:0/966986111 shutdown_connections 2024-09-19T07:32:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.172+0000 7f371a2b1640 1 --2- 172.21.15.98:0/966986111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3714102ef0 0x7f371410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.172+0000 7f371a2b1640 1 --2- 172.21.15.98:0/966986111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3714102570 0x7f37141029b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.172+0000 7f371a2b1640 1 --2- 172.21.15.98:0/966986111 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3714100e20 0x7f3714101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:52.176 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.172+0000 7f371a2b1640 1 -- 172.21.15.98:0/966986111 >> 172.21.15.98:0/966986111 conn(0x7f37140fc7d0 msgr2=0x7f37140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.172+0000 7f371a2b1640 1 -- 172.21.15.98:0/966986111 shutdown_connections 2024-09-19T07:32:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.172+0000 7f371a2b1640 1 -- 172.21.15.98:0/966986111 wait complete. 2024-09-19T07:32:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f371a2b1640 1 Processor -- start 2024-09-19T07:32:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f371a2b1640 1 -- start start 2024-09-19T07:32:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f371a2b1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3714100e20 0x7f37140fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f371a2b1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3714102570 0x7f37140fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f371a2b1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3714102ef0 0x7f37140fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f371a2b1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3714110fa0 con 0x7f3714100e20 2024-09-19T07:32:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f371a2b1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3714110e20 con 0x7f3714102ef0 2024-09-19T07:32:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f371a2b1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3714111120 con 0x7f3714102570 2024-09-19T07:32:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f3713fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3714100e20 0x7f37140fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:52.177 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f3713fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3714100e20 0x7f37140fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:59956/0 (socket says 172.21.15.98:59956) 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f3713fff640 1 -- 172.21.15.98:0/2969205919 learned_addr learned my addr 172.21.15.98:0/2969205919 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f370bfff640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3714102570 0x7f37140fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f371884e640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3714102ef0 0x7f37140fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f3713fff640 1 -- 172.21.15.98:0/2969205919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3714102570 msgr2=0x7f37140fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f3713fff640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3714102570 0x7f37140fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f3713fff640 1 -- 172.21.15.98:0/2969205919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3714102ef0 msgr2=0x7f37140fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f3713fff640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3714102ef0 0x7f37140fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.173+0000 7f3713fff640 1 -- 172.21.15.98:0/2969205919 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37141a6a30 con 0x7f3714100e20 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.174+0000 7f371884e640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3714102ef0 0x7f37140fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.174+0000 7f3713fff640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3714100e20 0x7f37140fcc80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f370400b4a0 tx=0x7f370400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.174+0000 7f3711ffb640 1 -- 172.21.15.98:0/2969205919 <== mon.0 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3704014070 con 0x7f3714100e20 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.174+0000 7f3711ffb640 1 -- 172.21.15.98:0/2969205919 <== mon.0 v2:172.21.15.98:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3704010af0 con 0x7f3714100e20 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.174+0000 7f371a2b1640 1 -- 172.21.15.98:0/2969205919 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37141a6d20 con 0x7f3714100e20 2024-09-19T07:32:52.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.174+0000 7f3711ffb640 1 -- 172.21.15.98:0/2969205919 <== mon.0 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3704017d10 con 0x7f3714100e20 2024-09-19T07:32:52.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.174+0000 7f371a2b1640 1 -- 172.21.15.98:0/2969205919 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37141a7220 con 0x7f3714100e20 2024-09-19T07:32:52.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.175+0000 7f371a2b1640 1 -- 172.21.15.98:0/2969205919 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3714101200 con 0x7f3714100e20 2024-09-19T07:32:52.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.176+0000 7f3711ffb640 1 -- 172.21.15.98:0/2969205919 <== mon.0 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3704017070 con 0x7f3714100e20 2024-09-19T07:32:52.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.176+0000 7f3711ffb640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f37000a3430 0x7f37000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:32:52.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.177+0000 7f370bfff640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f37000a3430 0x7f37000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:32:52.179 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.177+0000 7f3711ffb640 1 -- 172.21.15.98:0/2969205919 <== mon.0 v2:172.21.15.98:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8274+0+0 (secure 0 0 0) 0x7f37040cef50 con 0x7f3714100e20 2024-09-19T07:32:52.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.177+0000 7f370bfff640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f37000a3430 0x7f37000a58f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009230 tx=0x7f36fc0058d0 comp rx=0 tx=0).ready entity=mgr.15129 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:32:52.180 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.180+0000 7f3711ffb640 1 -- 172.21.15.98:0/2969205919 <== mon.0 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f370409bb30 con 0x7f3714100e20 2024-09-19T07:32:52.352 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.351+0000 7f371a2b1640 1 -- 172.21.15.98:0/2969205919 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f37140fe1b0 con 0x7f3714100e20 2024-09-19T07:32:52.754 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.754+0000 7f3711ffb640 1 -- 172.21.15.98:0/2969205919 <== mon.0 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) ==== 169+0+0 (secure 0 0 0) 0x7f370409b430 con 0x7f3714100e20 2024-09-19T07:32:52.754 INFO:teuthology.orchestra.run.smithi098.stderr:pool 'cephfs_data' removed 2024-09-19T07:32:52.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.756+0000 7f371a2b1640 1 -- 172.21.15.98:0/2969205919 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f37000a3430 msgr2=0x7f37000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:52.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.756+0000 7f371a2b1640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f37000a3430 0x7f37000a58f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009230 tx=0x7f36fc0058d0 comp rx=0 tx=0).stop 2024-09-19T07:32:52.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.756+0000 7f371a2b1640 1 -- 172.21.15.98:0/2969205919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3714100e20 msgr2=0x7f37140fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:32:52.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.756+0000 7f371a2b1640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3714100e20 0x7f37140fcc80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f370400b4a0 tx=0x7f370400b960 comp rx=0 tx=0).stop 2024-09-19T07:32:52.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.756+0000 7f371a2b1640 1 -- 172.21.15.98:0/2969205919 shutdown_connections 2024-09-19T07:32:52.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.756+0000 7f371a2b1640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.98:6800/39328331,v1:172.21.15.98:6801/39328331] conn(0x7f37000a3430 0x7f37000a58f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:52.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.756+0000 7f371a2b1640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3714102ef0 0x7f37140fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:52.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.756+0000 7f371a2b1640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3714102570 0x7f37140fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:52.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.756+0000 7f371a2b1640 1 --2- 172.21.15.98:0/2969205919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3714100e20 0x7f37140fcc80 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:32:52.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.756+0000 7f371a2b1640 1 -- 172.21.15.98:0/2969205919 >> 172.21.15.98:0/2969205919 conn(0x7f37140fc7d0 msgr2=0x7f371406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:32:52.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.756+0000 7f371a2b1640 1 -- 172.21.15.98:0/2969205919 shutdown_connections 2024-09-19T07:32:52.757 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-19T07:32:52.756+0000 7f371a2b1640 1 -- 172.21.15.98:0/2969205919 wait complete. 2024-09-19T07:32:53.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:52 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2969205919' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:32:53.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:52 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2969205919' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:32:53.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:52 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2969205919' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T07:32:53.449 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:32:53.478 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:32:53.505 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:32:53.534 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T07:32:53.534 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:32:53.549 DEBUG:teuthology.orchestra.run.smithi139:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:32:53.565 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:32:53.589 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T07:32:53.590 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T07:32:53.590 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mon.a 2024-09-19T07:32:53.756 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:53 smithi098 systemd[1]: Stopping Ceph mon.a for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:32:53.881 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:53 smithi162 ceph-mon[35726]: pgmap v337: 65 pgs: 65 active+clean; 24 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:32:53.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:53 smithi162 ceph-mon[35726]: from='client.? 172.21.15.98:0/2969205919' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:32:53.882 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:53 smithi162 ceph-mon[35726]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T07:32:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:53 smithi098 ceph-mon[30950]: pgmap v337: 65 pgs: 65 active+clean; 24 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:32:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:53 smithi098 ceph-mon[30950]: from='client.? 172.21.15.98:0/2969205919' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:32:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:53 smithi098 ceph-mon[30950]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T07:32:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:53 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a[30946]: 2024-09-19T07:32:53.905+0000 7efce286e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:54.023 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:53 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a[30946]: 2024-09-19T07:32:53.905+0000 7efce286e640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T07:32:54.024 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:53 smithi098 podman[98477]: 2024-09-19 07:32:53.977589705 +0000 UTC m=+0.196367100 container died 11bd946099decb0e7943f1bc34b5e5d93af1ccc9076f894c16af9df50ccebbda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T07:32:54.033 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:53 smithi139 ceph-mon[35039]: pgmap v337: 65 pgs: 65 active+clean; 24 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T07:32:54.033 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:53 smithi139 ceph-mon[35039]: from='client.? 172.21.15.98:0/2969205919' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T07:32:54.034 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:53 smithi139 ceph-mon[35039]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T07:32:54.624 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:54 smithi098 podman[98477]: 2024-09-19 07:32:54.364513696 +0000 UTC m=+0.583291089 container cleanup 11bd946099decb0e7943f1bc34b5e5d93af1ccc9076f894c16af9df50ccebbda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T07:32:54.624 INFO:journalctl@ceph.mon.a.smithi098.stdout:Sep 19 07:32:54 smithi098 bash[98477]: ceph-73438718-7656-11ef-bceb-c7b262605968-mon-a 2024-09-19T07:32:54.783 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T07:32:54.827 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:54.827 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T07:32:54.827 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T07:32:54.827 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mon.b 2024-09-19T07:32:55.135 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:54 smithi139 systemd[1]: Stopping Ceph mon.b for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:32:55.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:55 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-b[35035]: 2024-09-19T07:32:55.134+0000 7f0bb9e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:55.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:55 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-b[35035]: 2024-09-19T07:32:55.134+0000 7f0bb9e00640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T07:32:55.567 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:55 smithi139 podman[70915]: 2024-09-19 07:32:55.318030367 +0000 UTC m=+0.296167268 container died a8c956391da0bf59958e245fd37c0301a03e4f3acfd5979fd5300f4125f80a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T07:32:56.002 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:55 smithi139 podman[70915]: 2024-09-19 07:32:55.710853775 +0000 UTC m=+0.688990675 container cleanup a8c956391da0bf59958e245fd37c0301a03e4f3acfd5979fd5300f4125f80a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T07:32:56.002 INFO:journalctl@ceph.mon.b.smithi139.stdout:Sep 19 07:32:55 smithi139 bash[70915]: ceph-73438718-7656-11ef-bceb-c7b262605968-mon-b 2024-09-19T07:32:56.153 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T07:32:56.201 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:56.201 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T07:32:56.201 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T07:32:56.201 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mon.c 2024-09-19T07:32:56.510 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:56 smithi162 systemd[1]: Stopping Ceph mon.c for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:32:56.853 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:56 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-c[35722]: 2024-09-19T07:32:56.510+0000 7f4b0c963640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:56.853 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:56 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mon-c[35722]: 2024-09-19T07:32:56.510+0000 7f4b0c963640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T07:32:56.853 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:56 smithi162 podman[71439]: 2024-09-19 07:32:56.551454654 +0000 UTC m=+0.151018343 container died 84c03fd703129bad6c867fd65e84839a3fa546335b0f1c1e0ce67f1586843984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T07:32:57.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:56 smithi162 podman[71439]: 2024-09-19 07:32:56.960841027 +0000 UTC m=+0.560404697 container cleanup 84c03fd703129bad6c867fd65e84839a3fa546335b0f1c1e0ce67f1586843984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T07:32:57.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Sep 19 07:32:56 smithi162 bash[71439]: ceph-73438718-7656-11ef-bceb-c7b262605968-mon-c 2024-09-19T07:32:57.314 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T07:32:57.355 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:57.355 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T07:32:57.356 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T07:32:57.356 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.x 2024-09-19T07:32:57.670 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:32:57 smithi098 systemd[1]: Stopping Ceph mgr.x for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:32:57.979 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:32:57 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x[31178]: 2024-09-19T07:32:57.669+0000 7fb00f183640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:32:57.979 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:32:57 smithi098 podman[98602]: 2024-09-19 07:32:57.700436066 +0000 UTC m=+0.149416476 container died 623c6bf1043fcd53c7e3b1032f28ae81a822443eddcee2e304cc6f6f283b271f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:32:58.273 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:32:58 smithi098 podman[98602]: 2024-09-19 07:32:58.086547245 +0000 UTC m=+0.535527663 container cleanup 623c6bf1043fcd53c7e3b1032f28ae81a822443eddcee2e304cc6f6f283b271f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T07:32:58.273 INFO:journalctl@ceph.mgr.x.smithi098.stdout:Sep 19 07:32:58 smithi098 bash[98602]: ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-x 2024-09-19T07:32:58.466 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T07:32:58.500 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:58.500 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T07:32:58.501 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T07:32:58.501 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.y 2024-09-19T07:32:58.816 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:32:58 smithi139 systemd[1]: Stopping Ceph mgr.y for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:32:59.129 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:32:58 smithi139 podman[71034]: 2024-09-19 07:32:58.861370087 +0000 UTC m=+0.161374910 container died 265e6fd6cc2fe028fb70cda1664b3e6e19e4a6242c2b6067edae2f79e48be2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:32:59.488 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:32:59 smithi139 podman[71034]: 2024-09-19 07:32:59.212820395 +0000 UTC m=+0.512825217 container cleanup 265e6fd6cc2fe028fb70cda1664b3e6e19e4a6242c2b6067edae2f79e48be2ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:32:59.489 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Sep 19 07:32:59 smithi139 bash[71034]: ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-y 2024-09-19T07:32:59.635 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T07:32:59.670 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:32:59.670 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T07:32:59.670 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T07:32:59.670 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.z 2024-09-19T07:33:00.021 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:32:59 smithi162 systemd[1]: Stopping Ceph mgr.z for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:33:00.291 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:33:00 smithi162 podman[71560]: 2024-09-19 07:33:00.021474451 +0000 UTC m=+0.154410747 container died ec452004dd306a1c2d8069f04b6a563f4e96ede1c1d0666916b3c506be22f3cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:33:00.633 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:33:00 smithi162 podman[71560]: 2024-09-19 07:33:00.381881666 +0000 UTC m=+0.514817961 container cleanup ec452004dd306a1c2d8069f04b6a563f4e96ede1c1d0666916b3c506be22f3cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:33:00.633 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Sep 19 07:33:00 smithi162 bash[71560]: ceph-73438718-7656-11ef-bceb-c7b262605968-mgr-z 2024-09-19T07:33:00.810 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T07:33:00.844 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:00.844 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T07:33:00.845 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T07:33:00.845 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@osd.0 2024-09-19T07:33:01.166 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:00 smithi098 systemd[1]: Stopping Ceph osd.0 for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:33:01.523 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0[44450]: 2024-09-19T07:33:01.165+0000 7fca1d56d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:01.523 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0[44450]: 2024-09-19T07:33:01.165+0000 7fca1d56d640 -1 osd.0 92 *** Got signal Terminated *** 2024-09-19T07:33:01.523 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0[44450]: 2024-09-19T07:33:01.165+0000 7fca1d56d640 -1 osd.0 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:33:07.023 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:06 smithi098 podman[98725]: 2024-09-19 07:33:06.710803802 +0000 UTC m=+5.677183857 container died f943037cb84fbfbb040b85e46a2bdf502d9b78988f1373d4bc4cfd33e3767dc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:33:07.359 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:07 smithi098 podman[98725]: 2024-09-19 07:33:07.133041179 +0000 UTC m=+6.099421224 container cleanup f943037cb84fbfbb040b85e46a2bdf502d9b78988f1373d4bc4cfd33e3767dc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T07:33:07.359 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:07 smithi098 bash[98725]: ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0 2024-09-19T07:33:07.773 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:07 smithi098 podman[98743]: 2024-09-19 07:33:07.359236596 +0000 UTC m=+0.650838910 container remove f943037cb84fbfbb040b85e46a2bdf502d9b78988f1373d4bc4cfd33e3767dc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T07:33:08.062 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:07 smithi098 podman[98833]: 2024-09-19 07:33:07.698266011 +0000 UTC m=+0.015784962 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:33:08.062 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:07 smithi098 podman[98833]: 2024-09-19 07:33:07.810169392 +0000 UTC m=+0.127688333 container create ee214e2b2cf7340b3b38ebf2006b64900e8973905e4e8b8ce8c53301f7e38241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:33:08.523 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:08 smithi098 podman[98833]: 2024-09-19 07:33:08.063066302 +0000 UTC m=+0.380585244 container init ee214e2b2cf7340b3b38ebf2006b64900e8973905e4e8b8ce8c53301f7e38241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T07:33:08.523 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:08 smithi098 podman[98833]: 2024-09-19 07:33:08.06627107 +0000 UTC m=+0.383790012 container start ee214e2b2cf7340b3b38ebf2006b64900e8973905e4e8b8ce8c53301f7e38241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T07:33:08.523 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:08 smithi098 podman[98833]: 2024-09-19 07:33:08.137891686 +0000 UTC m=+0.455410642 container attach ee214e2b2cf7340b3b38ebf2006b64900e8973905e4e8b8ce8c53301f7e38241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T07:33:08.523 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:08 smithi098 podman[98833]: 2024-09-19 07:33:08.254875018 +0000 UTC m=+0.572393967 container died ee214e2b2cf7340b3b38ebf2006b64900e8973905e4e8b8ce8c53301f7e38241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T07:33:08.874 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:08 smithi098 podman[98860]: 2024-09-19 07:33:08.849929604 +0000 UTC m=+0.588925288 container remove ee214e2b2cf7340b3b38ebf2006b64900e8973905e4e8b8ce8c53301f7e38241 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T07:33:08.875 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:08 smithi098 systemd[1]: ceph-73438718-7656-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-19T07:33:08.875 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:08 smithi098 systemd[1]: Stopped Ceph osd.0 for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:33:08.875 INFO:journalctl@ceph.osd.0.smithi098.stdout:Sep 19 07:33:08 smithi098 systemd[1]: ceph-73438718-7656-11ef-bceb-c7b262605968@osd.0.service: Consumed 43.573s CPU time. 2024-09-19T07:33:08.876 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T07:33:08.915 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:08.915 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T07:33:08.915 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T07:33:08.915 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@osd.1 2024-09-19T07:33:09.217 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:08 smithi139 systemd[1]: Stopping Ceph osd.1 for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:33:09.566 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:09 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1[39537]: 2024-09-19T07:33:09.216+0000 7f6e2afc1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:09.567 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:09 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1[39537]: 2024-09-19T07:33:09.216+0000 7f6e2afc1640 -1 osd.1 92 *** Got signal Terminated *** 2024-09-19T07:33:09.567 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:09 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1[39537]: 2024-09-19T07:33:09.216+0000 7f6e2afc1640 -1 osd.1 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:33:15.066 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:14 smithi139 podman[71157]: 2024-09-19 07:33:14.779775432 +0000 UTC m=+5.666593691 container died bf4ab46860b2233e68a67a5405b03ab47d37d1b3588361c94463f9f44249891a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T07:33:15.566 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:15 smithi139 podman[71157]: 2024-09-19 07:33:15.124312594 +0000 UTC m=+6.011130839 container cleanup bf4ab46860b2233e68a67a5405b03ab47d37d1b3588361c94463f9f44249891a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T07:33:15.566 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:15 smithi139 bash[71157]: ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1 2024-09-19T07:33:15.567 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:15 smithi139 podman[71173]: 2024-09-19 07:33:15.325438553 +0000 UTC m=+0.539077587 container remove bf4ab46860b2233e68a67a5405b03ab47d37d1b3588361c94463f9f44249891a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T07:33:15.995 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:15 smithi139 podman[71262]: 2024-09-19 07:33:15.642325742 +0000 UTC m=+0.016290834 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:33:15.995 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:15 smithi139 podman[71262]: 2024-09-19 07:33:15.7511759 +0000 UTC m=+0.125140985 container create 810b31a0548c46feae552d6ebd416b75e2f890e27db6216bf846becfe9a038a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:33:16.317 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:15 smithi139 podman[71262]: 2024-09-19 07:33:15.995415 +0000 UTC m=+0.369380090 container init 810b31a0548c46feae552d6ebd416b75e2f890e27db6216bf846becfe9a038a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T07:33:16.317 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:15 smithi139 podman[71262]: 2024-09-19 07:33:15.99925604 +0000 UTC m=+0.373221124 container start 810b31a0548c46feae552d6ebd416b75e2f890e27db6216bf846becfe9a038a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:33:16.317 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:16 smithi139 podman[71262]: 2024-09-19 07:33:16.078503563 +0000 UTC m=+0.452468657 container attach 810b31a0548c46feae552d6ebd416b75e2f890e27db6216bf846becfe9a038a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T07:33:16.317 INFO:journalctl@ceph.osd.1.smithi139.stdout:Sep 19 07:33:16 smithi139 podman[71262]: 2024-09-19 07:33:16.183266256 +0000 UTC m=+0.557231347 container died 810b31a0548c46feae552d6ebd416b75e2f890e27db6216bf846becfe9a038a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T07:33:16.771 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T07:33:16.809 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:16.810 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T07:33:16.810 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T07:33:16.810 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@osd.2 2024-09-19T07:33:17.126 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:16 smithi162 systemd[1]: Stopping Ceph osd.2 for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:33:17.381 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:17 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2[40721]: 2024-09-19T07:33:17.125+0000 7f687f06b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:17.382 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:17 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2[40721]: 2024-09-19T07:33:17.125+0000 7f687f06b640 -1 osd.2 92 *** Got signal Terminated *** 2024-09-19T07:33:17.382 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:17 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2[40721]: 2024-09-19T07:33:17.125+0000 7f687f06b640 -1 osd.2 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:33:22.785 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:22 smithi162 podman[71686]: 2024-09-19 07:33:22.470419782 +0000 UTC m=+5.463797562 container died ede76ae893891314022ed377ce0a735108387061aa0046845f91cbb8af68a683 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T07:33:23.051 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:22 smithi162 podman[71686]: 2024-09-19 07:33:22.867269155 +0000 UTC m=+5.860646935 container cleanup ede76ae893891314022ed377ce0a735108387061aa0046845f91cbb8af68a683 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T07:33:23.051 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:22 smithi162 bash[71686]: ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2 2024-09-19T07:33:23.369 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:23 smithi162 podman[71701]: 2024-09-19 07:33:23.051851466 +0000 UTC m=+0.575581406 container remove ede76ae893891314022ed377ce0a735108387061aa0046845f91cbb8af68a683 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T07:33:23.632 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:23 smithi162 podman[71790]: 2024-09-19 07:33:23.271910495 +0000 UTC m=+0.015858937 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:33:23.632 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:23 smithi162 podman[71790]: 2024-09-19 07:33:23.377729658 +0000 UTC m=+0.121678086 container create d169af5ef219adac9fbfbc06f0ee07b05a610880e768db36184ba63a0bb85aae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T07:33:23.632 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:23 smithi162 podman[71790]: 2024-09-19 07:33:23.596894945 +0000 UTC m=+0.340843384 container init d169af5ef219adac9fbfbc06f0ee07b05a610880e768db36184ba63a0bb85aae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T07:33:23.632 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:23 smithi162 podman[71790]: 2024-09-19 07:33:23.600174499 +0000 UTC m=+0.344122930 container start d169af5ef219adac9fbfbc06f0ee07b05a610880e768db36184ba63a0bb85aae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:33:24.017 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:23 smithi162 podman[71790]: 2024-09-19 07:33:23.688618902 +0000 UTC m=+0.432567342 container attach d169af5ef219adac9fbfbc06f0ee07b05a610880e768db36184ba63a0bb85aae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:33:24.017 INFO:journalctl@ceph.osd.2.smithi162.stdout:Sep 19 07:33:23 smithi162 podman[71790]: 2024-09-19 07:33:23.790519573 +0000 UTC m=+0.534468013 container died d169af5ef219adac9fbfbc06f0ee07b05a610880e768db36184ba63a0bb85aae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T07:33:24.326 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T07:33:24.365 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:24.366 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T07:33:24.366 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T07:33:24.366 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@osd.3 2024-09-19T07:33:24.686 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:24 smithi098 systemd[1]: Stopping Ceph osd.3 for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:33:25.023 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:24 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3[50933]: 2024-09-19T07:33:24.685+0000 7f8f5080d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:25.023 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:24 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3[50933]: 2024-09-19T07:33:24.685+0000 7f8f5080d640 -1 osd.3 92 *** Got signal Terminated *** 2024-09-19T07:33:25.023 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:24 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3[50933]: 2024-09-19T07:33:24.685+0000 7f8f5080d640 -1 osd.3 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:33:28.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:27 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:27.721+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:28.384 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:28 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:28.119+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:29.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:28 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:28.744+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:29.381 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:29 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:29.113+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:29.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:28 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:28.966+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:30.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:29 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:29.702+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:30.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:29 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:29.933+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:30.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:29 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:29.956+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:30.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:30 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:30.115+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:30.453 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:30 smithi098 podman[98939]: 2024-09-19 07:33:30.191927067 +0000 UTC m=+5.628783907 container died 84689524b4b45edd8ae33b1b19c04e5289e0b09ed7abae19803dd662af3a401f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T07:33:30.454 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:30 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:30.124+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:30.750 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:30 smithi098 podman[98939]: 2024-09-19 07:33:30.561229456 +0000 UTC m=+5.998086289 container cleanup 84689524b4b45edd8ae33b1b19c04e5289e0b09ed7abae19803dd662af3a401f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:33:30.750 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:30 smithi098 bash[98939]: ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3 2024-09-19T07:33:31.023 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:30 smithi098 podman[98968]: 2024-09-19 07:33:30.862674641 +0000 UTC m=+0.672677258 container remove 84689524b4b45edd8ae33b1b19c04e5289e0b09ed7abae19803dd662af3a401f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T07:33:31.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:30 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:30.749+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:31.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:30 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:30.917+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:31.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:30 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:30.949+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:31.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:31.069+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:31.388 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:31 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:31.136+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:31.388 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:31 smithi098 podman[99059]: 2024-09-19 07:33:31.128263157 +0000 UTC m=+0.015962045 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:33:31.389 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:31 smithi098 podman[99059]: 2024-09-19 07:33:31.247005912 +0000 UTC m=+0.134704784 container create 15d4a24799857dd42b90e7fb00fc168d261a06799754390aeff7ab241df38202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T07:33:31.701 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:31 smithi098 podman[99059]: 2024-09-19 07:33:31.508063713 +0000 UTC m=+0.395762603 container init 15d4a24799857dd42b90e7fb00fc168d261a06799754390aeff7ab241df38202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T07:33:31.701 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:31 smithi098 podman[99059]: 2024-09-19 07:33:31.5115085 +0000 UTC m=+0.399207372 container start 15d4a24799857dd42b90e7fb00fc168d261a06799754390aeff7ab241df38202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T07:33:31.701 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:31 smithi098 podman[99059]: 2024-09-19 07:33:31.591087017 +0000 UTC m=+0.478785926 container attach 15d4a24799857dd42b90e7fb00fc168d261a06799754390aeff7ab241df38202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:33:32.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:31 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:31.791+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:32.023 INFO:journalctl@ceph.osd.3.smithi098.stdout:Sep 19 07:33:31 smithi098 podman[99059]: 2024-09-19 07:33:31.701248651 +0000 UTC m=+0.588947524 container died 15d4a24799857dd42b90e7fb00fc168d261a06799754390aeff7ab241df38202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T07:33:32.294 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:32 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:32.185+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:32.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:31 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:31.903+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:32.320 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T07:33:32.361 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:32.361 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T07:33:32.362 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T07:33:32.362 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@osd.4 2024-09-19T07:33:32.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:31.957+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:32.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:32.034+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:32.650 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:32 smithi139 systemd[1]: Stopping Ceph osd.4 for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:33:32.952 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:32 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4[46210]: 2024-09-19T07:33:32.650+0000 7fabdafb0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:32.952 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:32 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4[46210]: 2024-09-19T07:33:32.650+0000 7fabdafb0640 -1 osd.4 92 *** Got signal Terminated *** 2024-09-19T07:33:32.953 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:32 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4[46210]: 2024-09-19T07:33:32.650+0000 7fabdafb0640 -1 osd.4 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:33:33.227 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:32 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:32.821+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:33.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:32 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:32.952+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:33.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:32.989+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:33.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:32.990+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:33.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:33 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:33.226+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:34.198 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:33 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:33.825+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:34.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:33 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:33.965+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:34.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:33 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:33.965+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:34.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:34 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:34.025+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:34.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:34 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:34.198+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:35.223 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:34 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:34.824+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:35.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:35 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:35.005+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:35.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:34 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:34.978+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:35.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:35 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:35.021+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:35.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:35 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:35.021+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.925279+0000 front 2024-09-19T07:33:08.925467+0000 (oldest deadline 2024-09-19T07:33:34.825466+0000) 2024-09-19T07:33:35.522 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:35.222+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:35.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:35 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:35.336+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:35.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:35 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:35.456+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:36.196 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:35.835+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:36.316 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:36 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:36.298+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:36.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:36 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:36.055+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:36.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:35 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:35.989+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:36.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:36 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:36.010+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:36.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:36 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:36.010+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.925279+0000 front 2024-09-19T07:33:08.925467+0000 (oldest deadline 2024-09-19T07:33:34.825466+0000) 2024-09-19T07:33:36.522 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:36 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:36.195+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:36.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:36 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:36.195+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:36.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:36 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:36.505+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:37.185 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:36 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:36.808+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:37.186 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:36 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:36.808+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:37.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:37.034+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:37.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:36 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:36.950+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:37.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:36 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:36.976+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:37.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:36 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:36.976+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.925279+0000 front 2024-09-19T07:33:08.925467+0000 (oldest deadline 2024-09-19T07:33:34.825466+0000) 2024-09-19T07:33:37.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:37.185+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:37.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:37.185+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:37.607 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:37.332+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:37.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:37 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:37.551+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:38.207 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:37.785+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:38.208 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:37.785+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:38.317 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:38 smithi139 podman[71381]: 2024-09-19 07:33:38.211980417 +0000 UTC m=+5.659244939 container died 5cf39cb1a4d3373a6caa65a4a4202ae2c4281da0f3488082d2cd24726ea3f0ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T07:33:38.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:37.997+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:38.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:37 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:37.997+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:38.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:37 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:37.970+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:38.383 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:37 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:37.975+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:38.383 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:37 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:37.975+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.925279+0000 front 2024-09-19T07:33:08.925467+0000 (oldest deadline 2024-09-19T07:33:34.825466+0000) 2024-09-19T07:33:38.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:38 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:38.207+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:38.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:38 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:38.207+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:38.734 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:38 smithi139 podman[71381]: 2024-09-19 07:33:38.52484838 +0000 UTC m=+5.972112888 container cleanup 5cf39cb1a4d3373a6caa65a4a4202ae2c4281da0f3488082d2cd24726ea3f0ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T07:33:38.734 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:38 smithi139 bash[71381]: ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4 2024-09-19T07:33:38.734 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:38 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:38.323+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:38.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:38 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:38.561+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:39.066 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:38 smithi139 podman[71396]: 2024-09-19 07:33:38.734189902 +0000 UTC m=+0.523150301 container remove 5cf39cb1a4d3373a6caa65a4a4202ae2c4281da0f3488082d2cd24726ea3f0ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T07:33:39.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:38 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:38.958+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:39.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:38 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:38.958+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:39.198 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:38 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:38.799+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:39.198 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:38 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:38.799+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:39.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:38 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:38.972+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:39.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:38 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:38.972+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.925279+0000 front 2024-09-19T07:33:08.925467+0000 (oldest deadline 2024-09-19T07:33:34.825466+0000) 2024-09-19T07:33:39.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:39 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:39.003+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:39.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:39 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:39.003+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:39.487 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:39 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:39.306+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:39.487 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:39 smithi139 podman[71484]: 2024-09-19 07:33:39.034560452 +0000 UTC m=+0.015899615 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:33:39.487 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:39 smithi139 podman[71484]: 2024-09-19 07:33:39.143458882 +0000 UTC m=+0.124798034 container create 079e3533418e6077d888194c834a06b46213245608805cf3df6b52de34f3bf6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T07:33:39.487 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:39 smithi139 podman[71484]: 2024-09-19 07:33:39.362658288 +0000 UTC m=+0.343997438 container init 079e3533418e6077d888194c834a06b46213245608805cf3df6b52de34f3bf6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T07:33:39.487 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:39 smithi139 podman[71484]: 2024-09-19 07:33:39.366079756 +0000 UTC m=+0.347418918 container start 079e3533418e6077d888194c834a06b46213245608805cf3df6b52de34f3bf6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T07:33:39.487 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:39 smithi139 podman[71484]: 2024-09-19 07:33:39.487336267 +0000 UTC m=+0.468675432 container attach 079e3533418e6077d888194c834a06b46213245608805cf3df6b52de34f3bf6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T07:33:39.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:39 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:39.197+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:39.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:39 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:39.197+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:39.816 INFO:journalctl@ceph.osd.4.smithi139.stdout:Sep 19 07:33:39 smithi139 podman[71484]: 2024-09-19 07:33:39.558394325 +0000 UTC m=+0.539733499 container died 079e3533418e6077d888194c834a06b46213245608805cf3df6b52de34f3bf6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T07:33:39.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:39 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:39.582+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:40.123 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:39 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:39.926+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:40.123 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:39 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:39.926+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:40.155 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T07:33:40.185 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:39 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:39.844+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:40.185 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:39 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:39.844+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:40.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:40.194 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T07:33:40.194 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T07:33:40.194 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@osd.5 2024-09-19T07:33:40.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:40 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:40.019+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:40.222 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:40 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:40.019+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.925279+0000 front 2024-09-19T07:33:08.925467+0000 (oldest deadline 2024-09-19T07:33:34.825466+0000) 2024-09-19T07:33:40.222 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:39 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:39.966+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:40.222 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:39 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:39.966+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:40.493 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:40 smithi162 systemd[1]: Stopping Ceph osd.5 for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:33:40.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:40 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:40.184+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:40.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:40 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:40.184+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:40.566 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:40 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:40.336+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:40.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:40 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:40.575+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:40.882 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:40 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:40.493+0000 7f1f55479640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:40.882 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:40 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:40.493+0000 7f1f55479640 -1 osd.5 92 *** Got signal Terminated *** 2024-09-19T07:33:40.882 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:40 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:40.493+0000 7f1f55479640 -1 osd.5 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:33:41.177 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:40 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:40.893+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:41.177 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:40 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:40.893+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:41.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:40 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:40.943+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:41.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:40 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:40.943+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:41.381 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:41 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:41.062+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:41.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:41 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:41.062+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.925279+0000 front 2024-09-19T07:33:08.925467+0000 (oldest deadline 2024-09-19T07:33:34.825466+0000) 2024-09-19T07:33:41.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:40 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:40.982+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:41.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:40 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:40.982+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:41.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:41 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:41.177+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:41.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:41 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:41.177+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:41.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:41 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:41.339+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:41.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:41 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:41.589+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:42.136 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:41 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:41.884+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:42.136 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:41 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:41.885+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:42.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:41 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:41.959+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:42.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:41 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:41.959+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:42.381 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:42 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:42.060+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:42.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:42 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:42.060+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.925279+0000 front 2024-09-19T07:33:08.925467+0000 (oldest deadline 2024-09-19T07:33:34.825466+0000) 2024-09-19T07:33:42.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:41 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:41.973+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:42.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:41 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:41.973+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:42.405 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:42 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:42.135+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:42.406 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:42 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:42.135+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:42.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:42 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:42.317+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:42.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:42 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:42.558+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:43.132 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:42 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:42.869+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:43.132 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:42 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:42.869+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:43.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:42 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:42.939+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:43.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:42 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:42.939+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:43.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:42 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:42.968+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:43.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:42 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:42.968+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:43.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:43 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:43.021+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:43.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:43 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:43.021+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.925279+0000 front 2024-09-19T07:33:08.925467+0000 (oldest deadline 2024-09-19T07:33:34.825466+0000) 2024-09-19T07:33:43.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:43 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:43.132+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:43.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:43 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:43.132+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:43.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:43 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:43.357+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:43.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:43 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:43.516+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:44.273 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:44 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:44.092+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:44.273 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:44 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:44.092+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:44.273 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:43 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:43.847+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:44.273 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:43 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:43.847+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:44.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:43 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:43.955+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:44.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:43 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:43.955+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:44.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:43 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:43.988+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:44.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:43 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:43.988+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:44.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:44.014+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:44.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:44.014+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.925279+0000 front 2024-09-19T07:33:08.925467+0000 (oldest deadline 2024-09-19T07:33:34.825466+0000) 2024-09-19T07:33:44.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:44.407+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:44.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:44.476+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:45.135 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:44 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:44.884+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:45.135 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:44 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:44.884+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:45.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:44.965+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:45.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:44 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:44.965+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:45.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:44.975+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:45.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:44.975+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:45.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:44 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:44.975+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:45.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:45 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:45.031+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.823995+0000 front 2024-09-19T07:33:03.824123+0000 (oldest deadline 2024-09-19T07:33:27.323910+0000) 2024-09-19T07:33:45.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:45 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:45.031+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.925279+0000 front 2024-09-19T07:33:08.925467+0000 (oldest deadline 2024-09-19T07:33:34.825466+0000) 2024-09-19T07:33:45.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:45 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5[47212]: 2024-09-19T07:33:45.031+0000 7f1f51a7e640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.926663+0000 front 2024-09-19T07:33:18.926514+0000 (oldest deadline 2024-09-19T07:33:44.826602+0000) 2024-09-19T07:33:45.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:45 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:45.135+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:45.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:45 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:45.135+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:45.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:45 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:45.382+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:45.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:45 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:45.382+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:45.841 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:45 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:45.472+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:45.842 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:45 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:45.472+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:46.104 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:45 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:45.837+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:46.104 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:45 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:45.837+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:46.127 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:45 smithi162 podman[71907]: 2024-09-19 07:33:45.842247488 +0000 UTC m=+5.447489711 container died 7b3571e70020788b02b7113bc38c4ad5d61d433278ad822d5236f6687f5ab39d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T07:33:46.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:46.023+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:46.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:46.023+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:46.127 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:46.023+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:46.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:45 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:45.926+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:46.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:45 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:45.926+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:46.381 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:46 smithi162 podman[71907]: 2024-09-19 07:33:46.225984078 +0000 UTC m=+5.831226300 container cleanup 7b3571e70020788b02b7113bc38c4ad5d61d433278ad822d5236f6687f5ab39d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:33:46.381 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:46 smithi162 bash[71907]: ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5 2024-09-19T07:33:46.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:46 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:46.104+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:46.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:46 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:46.104+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:46.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:46 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:46.104+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:46.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:46.346+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:46.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:46.346+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:46.835 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:46 smithi162 podman[71924]: 2024-09-19 07:33:46.490013024 +0000 UTC m=+0.650614233 container remove 7b3571e70020788b02b7113bc38c4ad5d61d433278ad822d5236f6687f5ab39d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T07:33:46.836 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:46.522+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:46.836 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:46 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:46.522+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:47.113 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:47 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:47.015+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:47.113 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:47 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:47.015+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:47.113 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:47 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:47.015+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:47.113 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:46 smithi162 podman[72011]: 2024-09-19 07:33:46.836283295 +0000 UTC m=+0.106666983 container create 8a3613b5a1ba603dfa86688f953dd6028c0fa9689bf208a12534fc002179525c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:33:47.113 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:46 smithi162 podman[72011]: 2024-09-19 07:33:46.745830126 +0000 UTC m=+0.016213826 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:33:47.113 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:47 smithi162 podman[72011]: 2024-09-19 07:33:47.046905541 +0000 UTC m=+0.317289240 container init 8a3613b5a1ba603dfa86688f953dd6028c0fa9689bf208a12534fc002179525c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T07:33:47.114 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:47 smithi162 podman[72011]: 2024-09-19 07:33:47.050207579 +0000 UTC m=+0.320591274 container start 8a3613b5a1ba603dfa86688f953dd6028c0fa9689bf208a12534fc002179525c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T07:33:47.114 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:47 smithi162 podman[72011]: 2024-09-19 07:33:47.113327874 +0000 UTC m=+0.383711577 container attach 8a3613b5a1ba603dfa86688f953dd6028c0fa9689bf208a12534fc002179525c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T07:33:47.154 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:46 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:46.804+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:47.154 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:46 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:46.804+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:47.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:46.897+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:47.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:46.897+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:47.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:46 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:46.897+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:47.382 INFO:journalctl@ceph.osd.5.smithi162.stdout:Sep 19 07:33:47 smithi162 podman[72011]: 2024-09-19 07:33:47.250162652 +0000 UTC m=+0.520546349 container died 8a3613b5a1ba603dfa86688f953dd6028c0fa9689bf208a12534fc002179525c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T07:33:47.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:47 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:47.154+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:47.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:47 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:47.154+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:47.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:47 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:47.154+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:47.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:47.345+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:47.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:47.345+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:47.849 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:47 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:47.532+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:47.850 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:47 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:47.532+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:47.869 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T07:33:47.950 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:47.951 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T07:33:47.951 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T07:33:47.951 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@osd.6 2024-09-19T07:33:48.131 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:48 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:48.041+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:48.132 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:48 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:48.041+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:48.132 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:48 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:48.041+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:48.198 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:47 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:47.815+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:48.199 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:47 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:47.815+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:48.199 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:47 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:47.815+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:16.446666+0000 front 2024-09-19T07:33:16.446652+0000 (oldest deadline 2024-09-19T07:33:47.046895+0000) 2024-09-19T07:33:48.199 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:48 smithi098 systemd[1]: Stopping Ceph osd.6 for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:33:48.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:47.909+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:48.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:47.909+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:48.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:47 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:47.909+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:48.523 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:48 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:48.264+0000 7f68d0270640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:48.523 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:48 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:48.264+0000 7f68d0270640 -1 osd.6 92 *** Got signal Terminated *** 2024-09-19T07:33:48.523 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:48 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:48.264+0000 7f68d0270640 -1 osd.6 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:33:48.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:48 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:48.198+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:48.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:48 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:48.198+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:48.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:48 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:48.198+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:48.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:48.348+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:48.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:48.348+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:48.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:48 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:48.574+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:48.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:48 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:48.574+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:49.157 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:48 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:48.774+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:49.158 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:48 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:48.774+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:49.158 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:48 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:48.774+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:16.446666+0000 front 2024-09-19T07:33:16.446652+0000 (oldest deadline 2024-09-19T07:33:47.046895+0000) 2024-09-19T07:33:49.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:48.877+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:49.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:48.877+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:49.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:48 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:48.877+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:49.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:49.027+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:49.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:49.027+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:49.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:49.027+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:49.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:49 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:49.157+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:49.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:49 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:49.157+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:49.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:49 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:49.157+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:49.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:49 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:49.361+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:49.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:49 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:49.361+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:49.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:49.547+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:49.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:49 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:49.547+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:50.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:49 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:49.770+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:50.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:49 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:49.770+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:50.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:49 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:49.770+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:16.446666+0000 front 2024-09-19T07:33:16.446652+0000 (oldest deadline 2024-09-19T07:33:47.046895+0000) 2024-09-19T07:33:50.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:49 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:49.885+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:50.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:49 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:49.885+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:50.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:49 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:49.885+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:50.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:50 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:50.052+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:50.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:50 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:50.052+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:50.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:50 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:50.052+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:50.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:50 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:50.142+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:50.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:50 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:50.142+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:50.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:50 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:50.142+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:50.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:50 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:50.377+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:50.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:50 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:50.377+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:50.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:50 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:50.534+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:50.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:50 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:50.534+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:50.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:50 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:50.534+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:33:51.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:50 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:50.766+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:51.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:50 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:50.766+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:51.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:50 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:50.766+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:16.446666+0000 front 2024-09-19T07:33:16.446652+0000 (oldest deadline 2024-09-19T07:33:47.046895+0000) 2024-09-19T07:33:51.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:50 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:50.900+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:51.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:50 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:50.900+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:51.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:50 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:50.900+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:51.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:51 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:51.084+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:51.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:51 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:51.084+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:51.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:51 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:51.084+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:51.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:51 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:51.084+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:33:51.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:51 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:51.118+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:51.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:51 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:51.118+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:51.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:51 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:51.118+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:51.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:51 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:51.118+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:33:51.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:51 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:51.336+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:51.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:51 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:51.336+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:51.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:51 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:51.529+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:51.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:51 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:51.529+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:51.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:51 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:51.529+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:33:52.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:51 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:51.760+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:52.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:51 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:51.760+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:52.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:51 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:51.760+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:16.446666+0000 front 2024-09-19T07:33:16.446652+0000 (oldest deadline 2024-09-19T07:33:47.046895+0000) 2024-09-19T07:33:52.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:51 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:51.760+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:27.047173+0000 front 2024-09-19T07:33:27.047245+0000 (oldest deadline 2024-09-19T07:33:51.747301+0000) 2024-09-19T07:33:52.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:51 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:51.883+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:52.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:51 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:51.883+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:52.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:51 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:51.883+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:52.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:52 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:52.101+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:52.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:52 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:52.101+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:52.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:52 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:52.101+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:52.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:52 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:52.101+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:33:52.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:52 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:52.100+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:52.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:52 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:52.100+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:52.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:52 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:52.100+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:52.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:52 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:52.100+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:33:52.661 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:52 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:52.541+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:52.661 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:52 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:52.541+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:52.661 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:52 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:52.541+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:33:52.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:52 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:52.334+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:52.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:52 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:52.334+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:52.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:52 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:52.334+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:29.429986+0000 front 2024-09-19T07:33:29.430073+0000 (oldest deadline 2024-09-19T07:33:52.329885+0000) 2024-09-19T07:33:53.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:52 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:52.727+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.942900+0000 front 2024-09-19T07:33:03.942876+0000 (oldest deadline 2024-09-19T07:33:27.442919+0000) 2024-09-19T07:33:53.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:52 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:52.727+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:13.745147+0000 front 2024-09-19T07:33:13.745269+0000 (oldest deadline 2024-09-19T07:33:36.446160+0000) 2024-09-19T07:33:53.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:52 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:52.727+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:16.446666+0000 front 2024-09-19T07:33:16.446652+0000 (oldest deadline 2024-09-19T07:33:47.046895+0000) 2024-09-19T07:33:53.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:52 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6[57416]: 2024-09-19T07:33:52.727+0000 7f68cc875640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:27.047173+0000 front 2024-09-19T07:33:27.047245+0000 (oldest deadline 2024-09-19T07:33:51.747301+0000) 2024-09-19T07:33:53.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:52 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:52.889+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:53.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:52 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:52.889+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:53.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:52 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:52.889+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:53.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:53 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:53.131+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:53.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:53 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:53.131+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:53.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:53 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:53.131+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:53.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:53 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:53.131+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:33:53.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:53 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:53.055+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:53.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:53 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:53.055+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:53.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:53 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:53.055+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:53.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:53 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:53.055+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:33:53.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:53 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:53.378+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:53.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:53 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:53.378+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:53.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:53 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:53.378+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:29.429986+0000 front 2024-09-19T07:33:29.430073+0000 (oldest deadline 2024-09-19T07:33:52.329885+0000) 2024-09-19T07:33:53.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:53 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:53.586+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:53.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:53 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:53.586+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:53.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:53 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:53.586+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:33:54.065 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:53 smithi098 podman[99162]: 2024-09-19 07:33:53.810005307 +0000 UTC m=+5.664128094 container died 25aa5cbbe0c752851dd08fdb9714a80d3b0be67304078cc3fc8ac9954d536864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T07:33:54.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:53 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:53.854+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:54.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:53 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:53.854+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:54.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:53 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:53.854+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:54.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:53 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:53.854+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:33:54.332 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:54 smithi098 podman[99162]: 2024-09-19 07:33:54.156062096 +0000 UTC m=+6.010184887 container cleanup 25aa5cbbe0c752851dd08fdb9714a80d3b0be67304078cc3fc8ac9954d536864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:33:54.332 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:54 smithi098 bash[99162]: ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6 2024-09-19T07:33:54.332 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:54 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:54.067+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:54.332 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:54 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:54.067+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:54.333 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:54 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:54.067+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:54.333 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:54 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:54.067+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:33:54.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:54 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:54.111+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:54.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:54 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:54.111+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:54.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:54 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:54.111+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:54.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:54 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:54.111+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:33:54.772 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:54 smithi098 podman[99177]: 2024-09-19 07:33:54.332424406 +0000 UTC m=+0.516785293 container remove 25aa5cbbe0c752851dd08fdb9714a80d3b0be67304078cc3fc8ac9954d536864 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T07:33:54.808 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:54 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:54.401+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:54.808 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:54 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:54.401+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:54.808 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:54 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:54.401+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:29.429986+0000 front 2024-09-19T07:33:29.430073+0000 (oldest deadline 2024-09-19T07:33:52.329885+0000) 2024-09-19T07:33:54.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:54 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:54.587+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:54.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:54 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:54.587+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:54.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:54 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:54.587+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:33:55.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:54 smithi098 podman[99264]: 2024-09-19 07:33:54.675183413 +0000 UTC m=+0.016122927 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:33:55.023 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:54 smithi098 podman[99264]: 2024-09-19 07:33:54.783748422 +0000 UTC m=+0.124687923 container create 0f34a60d488d1e1206fd3956e2aa092c10ee6c54ba71b3b7da2cc8193667dc70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T07:33:55.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:54 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:54.808+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:55.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:54 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:54.808+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:55.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:54 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:54.808+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:55.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:54 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:54.808+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:33:55.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:55 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:55.064+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:55.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:55 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:55.064+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:55.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:55 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:55.064+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:55.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:55 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:55.064+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:33:55.513 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:55 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:55.086+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:55.513 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:55 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:55.086+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:55.513 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:55 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:55.086+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:55.513 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:55 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:55.086+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:33:55.513 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:55 smithi098 podman[99264]: 2024-09-19 07:33:55.027434421 +0000 UTC m=+0.368373923 container init 0f34a60d488d1e1206fd3956e2aa092c10ee6c54ba71b3b7da2cc8193667dc70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T07:33:55.514 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:55 smithi098 podman[99264]: 2024-09-19 07:33:55.030642593 +0000 UTC m=+0.371582095 container start 0f34a60d488d1e1206fd3956e2aa092c10ee6c54ba71b3b7da2cc8193667dc70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T07:33:55.514 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:55 smithi098 podman[99264]: 2024-09-19 07:33:55.110746096 +0000 UTC m=+0.451685602 container attach 0f34a60d488d1e1206fd3956e2aa092c10ee6c54ba71b3b7da2cc8193667dc70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:33:55.514 INFO:journalctl@ceph.osd.6.smithi098.stdout:Sep 19 07:33:55 smithi098 podman[99264]: 2024-09-19 07:33:55.225753512 +0000 UTC m=+0.566693023 container died 0f34a60d488d1e1206fd3956e2aa092c10ee6c54ba71b3b7da2cc8193667dc70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T07:33:55.803 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:55 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:55.420+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:55.804 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:55 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:55.420+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:55.804 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:55 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:55.420+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:29.429986+0000 front 2024-09-19T07:33:29.430073+0000 (oldest deadline 2024-09-19T07:33:52.329885+0000) 2024-09-19T07:33:55.834 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T07:33:55.873 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:33:55.873 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T07:33:55.874 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T07:33:55.874 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@osd.7 2024-09-19T07:33:55.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:55 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:55.566+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:55.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:55 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:55.566+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:55.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:55 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:55.566+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:33:56.066 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:55 smithi139 systemd[1]: Stopping Ceph osd.7 for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:33:56.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:55 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:55.803+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:56.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:55 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:55.803+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:56.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:55 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:55.803+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:56.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:55 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:55.803+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:33:56.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:56 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:56.109+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:56.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:56 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:56.109+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:56.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:56 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:56.109+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:56.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:56 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:56.109+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:33:56.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:56 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:56.064+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:56.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:56 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:56.064+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:56.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:56 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:56.064+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:56.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:56 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:56.064+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:33:56.566 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:56 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:56.191+0000 7f71cab33640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:33:56.567 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:56 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:56.191+0000 7f71cab33640 -1 osd.7 92 *** Got signal Terminated *** 2024-09-19T07:33:56.567 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:56 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:56.191+0000 7f71cab33640 -1 osd.7 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:33:56.567 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:56 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:56.389+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:56.567 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:56 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:56.389+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:56.567 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:56 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:56.389+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:29.429986+0000 front 2024-09-19T07:33:29.430073+0000 (oldest deadline 2024-09-19T07:33:52.329885+0000) 2024-09-19T07:33:56.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:56 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:56.596+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:56.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:56 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:56.596+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:56.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:56 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:56.596+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:33:57.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:56 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:56.788+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:57.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:56 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:56.788+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:57.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:56 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:56.788+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:57.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:56 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:56.788+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:33:57.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:57 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:57.097+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:57.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:57 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:57.097+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:57.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:57 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:57.097+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:57.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:57 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:57.097+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:33:57.609 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:57 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:57.153+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:57.609 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:57 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:57.153+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:57.609 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:57 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:57.153+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:57.609 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:57 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:57.153+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:33:57.803 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:57 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:57.429+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:57.803 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:57 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:57.429+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:57.803 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:57 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:57.429+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:29.429986+0000 front 2024-09-19T07:33:29.430073+0000 (oldest deadline 2024-09-19T07:33:52.329885+0000) 2024-09-19T07:33:57.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:57 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:57.609+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:57.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:57 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:57.609+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:57.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:57 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:57.609+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:33:58.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:57 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:57.802+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:58.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:57 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:57.802+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:58.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:57 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:57.802+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:58.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:57 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:57.802+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:33:58.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:58.089+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:58.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:58.089+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:58.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:58.089+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:58.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:58 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:58.089+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:33:58.566 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:58 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:58.446+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:58.566 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:58 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:58.446+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:58.567 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:58 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:58.446+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:29.429986+0000 front 2024-09-19T07:33:29.430073+0000 (oldest deadline 2024-09-19T07:33:52.329885+0000) 2024-09-19T07:33:58.631 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:58 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:58.192+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:58.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:58 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:58.192+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:58.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:58 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:58.192+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:58.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:58 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:58.192+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:33:59.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:58 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:58.650+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:33:59.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:58 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:58.650+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:33:59.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:58 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:58.650+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:33:59.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:58 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:58.650+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.215497+0000 front 2024-09-19T07:33:36.215442+0000 (oldest deadline 2024-09-19T07:33:58.515331+0000) 2024-09-19T07:33:59.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:58 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:58.828+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:33:59.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:58 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:58.828+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:33:59.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:58 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:58.828+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:33:59.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:58 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:58.828+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:33:59.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:59.073+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:33:59.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:59.073+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:33:59.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:59.073+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:33:59.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:59.073+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:33:59.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:33:59 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:33:59.073+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:33:59.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:59.148+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:33:59.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:59.148+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:33:59.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:59.148+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:33:59.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:33:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:33:59.148+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:33:59.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:59.427+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:33:59.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:59.427+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:33:59.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:59.427+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:29.429986+0000 front 2024-09-19T07:33:29.430073+0000 (oldest deadline 2024-09-19T07:33:52.329885+0000) 2024-09-19T07:33:59.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:33:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:33:59.427+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:37.630956+0000 front 2024-09-19T07:33:37.630909+0000 (oldest deadline 2024-09-19T07:33:58.731142+0000) 2024-09-19T07:34:00.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:59.675+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:34:00.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:59.675+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:34:00.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:59.675+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:34:00.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:33:59 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:33:59.675+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.215497+0000 front 2024-09-19T07:33:36.215442+0000 (oldest deadline 2024-09-19T07:33:58.515331+0000) 2024-09-19T07:34:00.316 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:59.876+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:00.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:59.876+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:00.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:59.876+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:00.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:33:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:33:59.876+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:00.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:00.051+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:00.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:00.051+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:00.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:00.051+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:00.524 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:00.051+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:00.524 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:00 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:00.051+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:00.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:00 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:00.157+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:00.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:00 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:00.157+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:00.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:00 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:00.157+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:00.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:00 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:00.157+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:00.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:00 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:34:00.390+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:10.627563+0000 front 2024-09-19T07:33:10.627633+0000 (oldest deadline 2024-09-19T07:33:35.327696+0000) 2024-09-19T07:34:00.816 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:00 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:34:00.390+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:20.028763+0000 front 2024-09-19T07:33:20.028708+0000 (oldest deadline 2024-09-19T07:33:45.328854+0000) 2024-09-19T07:34:00.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:00 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:34:00.390+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:29.429986+0000 front 2024-09-19T07:33:29.430073+0000 (oldest deadline 2024-09-19T07:33:52.329885+0000) 2024-09-19T07:34:00.817 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:00 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7[53170]: 2024-09-19T07:34:00.390+0000 7f71c7138640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:37.630956+0000 front 2024-09-19T07:33:37.630909+0000 (oldest deadline 2024-09-19T07:33:58.731142+0000) 2024-09-19T07:34:01.131 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:00 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:00.641+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:34:01.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:00 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:00.641+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:34:01.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:00 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:00.641+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:34:01.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:00 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:00.641+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.215497+0000 front 2024-09-19T07:33:36.215442+0000 (oldest deadline 2024-09-19T07:33:58.515331+0000) 2024-09-19T07:34:01.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:00 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:00.886+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:01.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:00 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:00.886+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:01.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:00 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:00.886+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:01.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:00 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:00.886+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:01.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:01.092+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:01.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:01.092+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:01.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:01.092+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:01.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:01.092+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:01.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:01 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:01.092+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:01.607 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:01 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:01.196+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:01.607 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:01 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:01.196+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:01.607 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:01 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:01.196+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:01.607 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:01 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:01.196+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:01.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:01 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:01.605+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:34:01.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:01 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:01.605+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:34:01.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:01 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:01.605+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:34:01.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:01 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:01.605+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.215497+0000 front 2024-09-19T07:33:36.215442+0000 (oldest deadline 2024-09-19T07:33:58.515331+0000) 2024-09-19T07:34:02.059 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:01 smithi139 podman[71587]: 2024-09-19 07:34:01.76872466 +0000 UTC m=+5.701530328 container died 1376af22d6027d73ba2a69f4d7a7acc5bc7d32ddc213615303ecfae970c66a10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T07:34:02.059 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:01 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:01.922+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:02.060 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:01 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:01.922+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:02.060 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:01 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:01.922+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:02.060 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:01 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:01.922+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:02.060 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:01 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:01.922+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:02.316 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:02 smithi139 podman[71587]: 2024-09-19 07:34:02.183709633 +0000 UTC m=+6.116515300 container cleanup 1376af22d6027d73ba2a69f4d7a7acc5bc7d32ddc213615303ecfae970c66a10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T07:34:02.317 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:02 smithi139 bash[71587]: ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7 2024-09-19T07:34:02.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:02.065+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:02.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:02.065+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:02.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:02.065+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:02.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:02.065+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:02.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:02 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:02.065+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:02.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:02.238+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:02.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:02.238+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:02.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:02.238+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:02.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:02.238+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:02.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:02.238+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:02.796 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:02 smithi139 podman[71616]: 2024-09-19 07:34:02.359865842 +0000 UTC m=+0.593077829 container remove 1376af22d6027d73ba2a69f4d7a7acc5bc7d32ddc213615303ecfae970c66a10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:34:03.066 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:02 smithi139 podman[71705]: 2024-09-19 07:34:02.699644802 +0000 UTC m=+0.016015315 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:34:03.067 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:02 smithi139 podman[71705]: 2024-09-19 07:34:02.810580241 +0000 UTC m=+0.126950746 container create eed11a48cab5cdc45bb0b67659cfeb817d49e479f25570a78df5f77f66c203ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T07:34:03.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:02.874+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:03.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:02.874+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:03.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:02.874+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:03.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:02.874+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:03.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:02 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:02.874+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:03.131 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:02.635+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:34:03.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:02.635+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:34:03.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:02.635+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:34:03.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:02 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:02.635+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.215497+0000 front 2024-09-19T07:33:36.215442+0000 (oldest deadline 2024-09-19T07:33:58.515331+0000) 2024-09-19T07:34:03.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:03 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:03.035+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:03.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:03 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:03.035+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:03.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:03 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:03.035+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:03.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:03 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:03.035+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:03.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:03 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:03.035+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:03.567 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:03 smithi139 podman[71705]: 2024-09-19 07:34:03.071196736 +0000 UTC m=+0.387567247 container init eed11a48cab5cdc45bb0b67659cfeb817d49e479f25570a78df5f77f66c203ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T07:34:03.567 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:03 smithi139 podman[71705]: 2024-09-19 07:34:03.074805992 +0000 UTC m=+0.391176510 container start eed11a48cab5cdc45bb0b67659cfeb817d49e479f25570a78df5f77f66c203ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T07:34:03.567 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:03 smithi139 podman[71705]: 2024-09-19 07:34:03.146069263 +0000 UTC m=+0.462439772 container attach eed11a48cab5cdc45bb0b67659cfeb817d49e479f25570a78df5f77f66c203ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T07:34:03.567 INFO:journalctl@ceph.osd.7.smithi139.stdout:Sep 19 07:34:03 smithi139 podman[71705]: 2024-09-19 07:34:03.261387601 +0000 UTC m=+0.577758111 container died eed11a48cab5cdc45bb0b67659cfeb817d49e479f25570a78df5f77f66c203ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T07:34:03.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:03 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:03.194+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:03.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:03 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:03.194+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:03.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:03 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:03.194+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:03.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:03 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:03.194+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:03.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:03 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:03.194+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:03.891 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:03 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:03.828+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:03.891 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:03 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:03.828+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:03.891 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:03 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:03.828+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:03.891 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:03 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:03.828+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:03.891 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:03 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:03.828+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:03.916 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T07:34:03.958 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:34:03.958 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T07:34:03.958 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T07:34:03.958 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@osd.8 2024-09-19T07:34:03.985 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:03 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:03.643+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:34:03.985 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:03 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:03.643+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:34:03.985 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:03 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:03.643+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:34:03.985 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:03 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:03.643+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.215497+0000 front 2024-09-19T07:33:36.215442+0000 (oldest deadline 2024-09-19T07:33:58.515331+0000) 2024-09-19T07:34:04.268 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:04 smithi162 systemd[1]: Stopping Ceph osd.8 for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:34:04.268 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:04.169+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:04.268 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:04.169+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:04.268 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:04.169+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:04.268 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:04.169+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:04.268 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:04.169+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:04.525 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:04.059+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:04.525 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:04.059+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:04.525 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:04.059+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:04.526 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:04.059+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:04.526 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:04 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:04.059+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:04.631 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:04.266+0000 7fc4d83f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:34:04.631 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:04.266+0000 7fc4d83f7640 -1 osd.8 92 *** Got signal Terminated *** 2024-09-19T07:34:04.631 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:04.266+0000 7fc4d83f7640 -1 osd.8 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:34:05.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:04 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:04.793+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:05.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:04 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:04.793+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:05.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:04 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:04.793+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:05.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:04 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:04.793+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:05.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:04 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:04.793+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:05.131 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:04.665+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:34:05.131 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:04.665+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:34:05.131 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:04.665+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:34:05.132 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:04 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:04.665+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.215497+0000 front 2024-09-19T07:33:36.215442+0000 (oldest deadline 2024-09-19T07:33:58.515331+0000) 2024-09-19T07:34:05.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:05.080+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:05.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:05.080+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:05.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:05.080+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:05.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:05.080+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:05.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:05 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:05.080+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:05.625 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:05 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:05.176+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:05.625 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:05 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:05.176+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:05.625 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:05 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:05.176+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:05.625 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:05 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:05.176+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:05.625 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:05 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:05.176+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:05.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:05 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:05.623+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:34:05.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:05 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:05.623+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:34:05.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:05 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:05.623+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:34:05.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:05 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:05.623+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.215497+0000 front 2024-09-19T07:33:36.215442+0000 (oldest deadline 2024-09-19T07:33:58.515331+0000) 2024-09-19T07:34:06.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:05 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:05.747+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:06.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:05 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:05.747+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:06.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:05 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:05.747+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:06.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:05 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:05.747+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:06.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:05 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:05.747+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:06.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:06 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:06.086+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:06.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:06 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:06.086+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:06.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:06 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:06.086+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:06.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:06 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:06.086+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:06.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:06 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:06.086+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:06.611 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:06 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:06.201+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:06.611 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:06 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:06.201+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:06.612 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:06 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:06.201+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:06.612 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:06 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:06.201+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:06.612 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:06 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:06.201+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:06.881 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:06 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:06.611+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:34:06.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:06 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:06.611+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:34:06.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:06 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:06.611+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:34:06.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:06 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:06.611+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.215497+0000 front 2024-09-19T07:33:36.215442+0000 (oldest deadline 2024-09-19T07:33:58.515331+0000) 2024-09-19T07:34:07.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:06 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:06.782+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:07.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:06 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:06.782+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:07.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:06 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:06.782+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:07.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:06 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:06.782+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:07.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:06 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:06.782+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:07.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:07 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:07.051+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:07.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:07 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:07.051+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:07.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:07 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:07.051+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:07.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:07 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:07.051+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:07.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:07 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:07.051+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:07.569 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:07 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:07.157+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:07.569 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:07 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:07.157+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:07.569 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:07 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:07.157+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:07.569 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:07 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:07.157+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:07.569 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:07 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:07.157+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:07.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:07 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:07.568+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:34:07.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:07 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:07.568+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:34:07.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:07 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:07.568+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:34:07.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:07 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:07.568+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.215497+0000 front 2024-09-19T07:33:36.215442+0000 (oldest deadline 2024-09-19T07:33:58.515331+0000) 2024-09-19T07:34:08.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:07 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:07.780+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:08.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:07 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:07.780+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:08.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:07 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:07.780+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:08.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:07 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:07.780+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:08.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:07 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:07.780+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:08.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:08.072+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:08.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:08.072+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:08.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:08.072+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:08.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:08.072+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:08.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:08 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:08.072+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:08.589 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:08 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:08.195+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:08.589 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:08 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:08.195+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:08.589 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:08 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:08.195+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:08.589 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:08 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:08.195+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:08.590 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:08 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:08.195+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:08.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:08 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:08.589+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:11.612646+0000 front 2024-09-19T07:33:11.612437+0000 (oldest deadline 2024-09-19T07:33:35.112367+0000) 2024-09-19T07:34:08.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:08 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:08.589+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.013214+0000 front 2024-09-19T07:33:21.013327+0000 (oldest deadline 2024-09-19T07:33:44.513362+0000) 2024-09-19T07:34:08.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:08 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:08.589+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:24.513739+0000 front 2024-09-19T07:33:24.513831+0000 (oldest deadline 2024-09-19T07:33:50.413717+0000) 2024-09-19T07:34:08.882 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:08 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8[54063]: 2024-09-19T07:34:08.589+0000 7fc4d49fc640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.215497+0000 front 2024-09-19T07:33:36.215442+0000 (oldest deadline 2024-09-19T07:33:58.515331+0000) 2024-09-19T07:34:09.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:08 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:08.818+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:09.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:08 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:08.818+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:09.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:08 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:08.818+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:09.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:08 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:08.818+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:09.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:08 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:08.818+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:09.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:09 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:09.052+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:09.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:09 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:09.052+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:09.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:09 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:09.052+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:09.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:09 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:09.052+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:09.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:09 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:09.052+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:09.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:09 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:09.052+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:44.823767+0000 front 2024-09-19T07:33:44.823740+0000 (oldest deadline 2024-09-19T07:34:08.923563+0000) 2024-09-19T07:34:09.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:09 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:09.170+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:09.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:09 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:09.170+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:09.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:09 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:09.170+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:09.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:09 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:09.170+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:09.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:09 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:09.170+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:10.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:09 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:09.785+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:10.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:09 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:09.785+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:10.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:09 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:09.785+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:10.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:09 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:09.785+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:10.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:09 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:09.785+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:10.125 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:09 smithi162 podman[72125]: 2024-09-19 07:34:09.837300253 +0000 UTC m=+5.685048691 container died dd36bcbb50779fc15b739f74408ba3bb9ba96739e9a9bdd84b170e09b15435e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T07:34:10.125 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:10 smithi162 podman[72125]: 2024-09-19 07:34:10.125171456 +0000 UTC m=+5.972919896 container cleanup dd36bcbb50779fc15b739f74408ba3bb9ba96739e9a9bdd84b170e09b15435e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:34:10.382 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:10 smithi162 bash[72125]: ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8 2024-09-19T07:34:10.382 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:10 smithi162 podman[72141]: 2024-09-19 07:34:10.359901083 +0000 UTC m=+0.520804556 container remove dd36bcbb50779fc15b739f74408ba3bb9ba96739e9a9bdd84b170e09b15435e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:34:10.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:10 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:10.134+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:10.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:10 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:10.134+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:10.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:10 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:10.134+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:10.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:10 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:10.134+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:10.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:10 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:10.134+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:10.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:10 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:10.078+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:10.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:10 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:10.078+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:10.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:10 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:10.078+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:10.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:10 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:10.078+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:10.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:10 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:10.078+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:10.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:10 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:10.078+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:44.823767+0000 front 2024-09-19T07:33:44.823740+0000 (oldest deadline 2024-09-19T07:34:08.923563+0000) 2024-09-19T07:34:10.979 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:10 smithi162 podman[72227]: 2024-09-19 07:34:10.599290819 +0000 UTC m=+0.015852445 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:34:10.979 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:10 smithi162 podman[72227]: 2024-09-19 07:34:10.752253008 +0000 UTC m=+0.168814618 container create 67580f0584faff2ece920b2fe0109f90425a86faad1a9f36833cf665d0fc3486 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T07:34:11.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:10 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:10.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:11.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:10 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:10.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:11.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:10 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:10.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:11.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:10 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:10.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:11.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:10 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:10.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:11.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:10 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:10.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:11.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:11 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:11.172+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:11.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:11 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:11.172+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:11.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:11 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:11.172+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:11.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:11 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:11.172+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:11.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:11 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:11.172+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:11.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:11 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:11.172+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:11.383 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:10 smithi162 podman[72227]: 2024-09-19 07:34:10.979709947 +0000 UTC m=+0.396271559 container init 67580f0584faff2ece920b2fe0109f90425a86faad1a9f36833cf665d0fc3486 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T07:34:11.383 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:10 smithi162 podman[72227]: 2024-09-19 07:34:10.983061801 +0000 UTC m=+0.399623413 container start 67580f0584faff2ece920b2fe0109f90425a86faad1a9f36833cf665d0fc3486 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:34:11.383 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:11 smithi162 podman[72227]: 2024-09-19 07:34:11.071349332 +0000 UTC m=+0.487910945 container attach 67580f0584faff2ece920b2fe0109f90425a86faad1a9f36833cf665d0fc3486 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T07:34:11.383 INFO:journalctl@ceph.osd.8.smithi162.stdout:Sep 19 07:34:11 smithi162 podman[72227]: 2024-09-19 07:34:11.172837828 +0000 UTC m=+0.589399451 container died 67580f0584faff2ece920b2fe0109f90425a86faad1a9f36833cf665d0fc3486 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T07:34:11.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:11.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:11.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:11.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:11.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:11.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:11.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:11.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:11.524 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:11.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:11.524 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:11 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:11.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:44.823767+0000 front 2024-09-19T07:33:44.823740+0000 (oldest deadline 2024-09-19T07:34:08.923563+0000) 2024-09-19T07:34:11.760 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T07:34:11.839 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:34:11.839 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T07:34:11.840 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T07:34:11.840 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@osd.9 2024-09-19T07:34:12.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:11 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:11.773+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:12.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:11 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:11.773+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:12.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:11 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:11.773+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:12.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:11 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:11.773+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:12.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:11 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:11.773+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:12.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:11 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:11.773+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:12.125 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:11 smithi098 systemd[1]: Stopping Ceph osd.9 for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:34:12.125 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:12.099+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:12.125 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:12.099+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:12.125 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:12.099+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:12.125 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:12.099+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:12.125 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:12.099+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:12.126 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:12.099+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:44.823767+0000 front 2024-09-19T07:33:44.823740+0000 (oldest deadline 2024-09-19T07:34:08.923563+0000) 2024-09-19T07:34:12.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:12 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:12.125+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:12.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:12 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:12.125+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:12.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:12 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:12.125+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:12.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:12 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:12.125+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:12.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:12 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:12.125+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:12.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:12 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:12.125+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:12.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:12.124+0000 7febf37e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:34:12.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:12.124+0000 7febf37e0640 -1 osd.9 92 *** Got signal Terminated *** 2024-09-19T07:34:12.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:12 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:12.124+0000 7febf37e0640 -1 osd.9 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:34:13.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:12 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:12.791+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:13.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:12 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:12.791+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:13.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:12 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:12.791+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:13.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:12 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:12.791+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:13.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:12 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:12.791+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:13.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:12 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:12.791+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:13.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:13 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:13.079+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:13.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:13 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:13.079+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:13.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:13 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:13.079+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:13.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:13 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:13.079+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:13.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:13 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:13.079+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:13.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:13 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:13.079+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:13.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:13 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:13.077+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:13.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:13 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:13.077+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:13.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:13 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:13.077+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:13.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:13 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:13.077+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:13.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:13 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:13.077+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:13.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:13 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:13.077+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:44.823767+0000 front 2024-09-19T07:33:44.823740+0000 (oldest deadline 2024-09-19T07:34:08.923563+0000) 2024-09-19T07:34:14.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:13 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:13.757+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:14.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:13 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:13.757+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:14.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:13 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:13.757+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:14.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:13 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:13.757+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:14.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:13 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:13.757+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:14.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:13 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:13.757+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:14.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:14 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:14.041+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:14.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:14 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:14.041+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:14.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:14 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:14.041+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:14.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:14 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:14.041+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:14.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:14 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:14.041+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:14.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:14 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:14.041+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:14.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:14 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:14.077+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:14.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:14 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:14.077+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:14.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:14 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:14.077+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:14.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:14 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:14.077+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:14.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:14 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:14.077+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:14.524 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:14 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:14.077+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:44.823767+0000 front 2024-09-19T07:33:44.823740+0000 (oldest deadline 2024-09-19T07:34:08.923563+0000) 2024-09-19T07:34:15.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:14 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:14.752+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:15.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:14 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:14.752+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:15.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:14 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:14.752+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:15.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:14 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:14.752+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:15.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:14 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:14.752+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:15.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:14 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:14.752+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:15.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:14 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:14.752+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:52.287162+0000 front 2024-09-19T07:33:52.287118+0000 (oldest deadline 2024-09-19T07:34:14.587134+0000) 2024-09-19T07:34:15.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:15 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:15.062+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:15.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:15 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:15.062+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:15.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:15 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:15.062+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:15.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:15 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:15.062+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:15.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:15 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:15.062+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:15.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:15 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:15.062+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:15.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:15.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:15.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:15.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:15.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:15.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:15.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:15.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:15.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:15.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:15.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:15.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:44.823767+0000 front 2024-09-19T07:33:44.823740+0000 (oldest deadline 2024-09-19T07:34:08.923563+0000) 2024-09-19T07:34:15.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:15 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:15.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:48.924032+0000 front 2024-09-19T07:33:48.924052+0000 (oldest deadline 2024-09-19T07:34:14.224076+0000) 2024-09-19T07:34:16.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:15 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:15.719+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:16.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:15 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:15.719+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:16.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:15 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:15.719+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:16.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:15 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:15.719+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:16.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:15 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:15.719+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:16.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:15 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:15.719+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:16.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:15 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:15.719+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:52.287162+0000 front 2024-09-19T07:33:52.287118+0000 (oldest deadline 2024-09-19T07:34:14.587134+0000) 2024-09-19T07:34:16.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:16 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:16.039+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:16.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:16 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:16.039+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:16.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:16 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:16.039+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:16.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:16 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:16.039+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:16.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:16 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:16.039+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:16.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:16 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:16.039+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:16.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:16 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:16.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:16.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:16 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:16.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:16.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:16 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:16.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:16.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:16 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:16.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:16.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:16 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:16.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:16.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:16 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:16.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:44.823767+0000 front 2024-09-19T07:33:44.823740+0000 (oldest deadline 2024-09-19T07:34:08.923563+0000) 2024-09-19T07:34:16.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:16 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:16.121+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:48.924032+0000 front 2024-09-19T07:33:48.924052+0000 (oldest deadline 2024-09-19T07:34:14.224076+0000) 2024-09-19T07:34:17.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:16 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:16.698+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:17.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:16 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:16.698+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:17.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:16 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:16.698+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:17.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:16 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:16.698+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:17.068 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:16 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:16.698+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:17.068 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:16 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:16.698+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:17.068 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:16 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:16.698+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:52.287162+0000 front 2024-09-19T07:33:52.287118+0000 (oldest deadline 2024-09-19T07:34:14.587134+0000) 2024-09-19T07:34:17.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:17 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:17.060+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:17.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:17 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:17.060+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:17.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:17 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:17.060+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:17.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:17 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:17.060+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:17.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:17 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:17.060+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:17.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:17 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:17.060+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:17.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:17.091+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:04.118270+0000 front 2024-09-19T07:33:04.118210+0000 (oldest deadline 2024-09-19T07:33:29.417955+0000) 2024-09-19T07:34:17.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:17.091+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:09.418373+0000 front 2024-09-19T07:33:09.418463+0000 (oldest deadline 2024-09-19T07:33:35.318289+0000) 2024-09-19T07:34:17.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:17.091+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.119684+0000 front 2024-09-19T07:33:21.119514+0000 (oldest deadline 2024-09-19T07:33:45.719826+0000) 2024-09-19T07:34:17.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:17.091+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:26.220536+0000 front 2024-09-19T07:33:26.220600+0000 (oldest deadline 2024-09-19T07:33:50.320636+0000) 2024-09-19T07:34:17.523 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:17.091+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:35.522179+0000 front 2024-09-19T07:33:35.522255+0000 (oldest deadline 2024-09-19T07:33:59.021972+0000) 2024-09-19T07:34:17.524 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:17.091+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:44.823767+0000 front 2024-09-19T07:33:44.823740+0000 (oldest deadline 2024-09-19T07:34:08.923563+0000) 2024-09-19T07:34:17.524 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:17 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9[64415]: 2024-09-19T07:34:17.091+0000 7febefde5640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:48.924032+0000 front 2024-09-19T07:33:48.924052+0000 (oldest deadline 2024-09-19T07:34:14.224076+0000) 2024-09-19T07:34:17.834 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:17 smithi098 podman[99368]: 2024-09-19 07:34:17.548033223 +0000 UTC m=+5.516812623 container died 17397e5474c180971fcaba96fa61dc8845f9493762e3548b820e0e5e54da5906 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:34:18.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:17 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:17.654+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:18.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:17 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:17.654+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:18.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:17 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:17.654+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:18.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:17 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:17.654+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:18.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:17 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:17.654+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:18.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:17 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:17.654+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:18.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:17 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:17.654+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:52.287162+0000 front 2024-09-19T07:33:52.287118+0000 (oldest deadline 2024-09-19T07:34:14.587134+0000) 2024-09-19T07:34:18.175 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:17 smithi098 podman[99368]: 2024-09-19 07:34:17.925044438 +0000 UTC m=+5.893823825 container cleanup 17397e5474c180971fcaba96fa61dc8845f9493762e3548b820e0e5e54da5906 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-09-19T07:34:18.176 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:17 smithi098 bash[99368]: ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9 2024-09-19T07:34:18.381 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:18 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:18.069+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:18.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:18 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:18.069+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:18.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:18 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:18.069+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:18.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:18 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:18.069+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:18.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:18 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:18.069+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:18.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:18 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:18.069+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:18.483 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:18 smithi098 podman[99387]: 2024-09-19 07:34:18.176129595 +0000 UTC m=+0.624385502 container remove 17397e5474c180971fcaba96fa61dc8845f9493762e3548b820e0e5e54da5906 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:34:18.773 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:18 smithi098 podman[99472]: 2024-09-19 07:34:18.387077518 +0000 UTC m=+0.015933998 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:34:18.773 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:18 smithi098 podman[99472]: 2024-09-19 07:34:18.493718126 +0000 UTC m=+0.122574589 container create 32eaa4a28c856fe9a110311c2e3ad37db1f8679cbcd5c3bc7c1bf1098aa27717 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T07:34:18.773 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:18 smithi098 podman[99472]: 2024-09-19 07:34:18.704575289 +0000 UTC m=+0.333431753 container init 32eaa4a28c856fe9a110311c2e3ad37db1f8679cbcd5c3bc7c1bf1098aa27717 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:34:18.773 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:18 smithi098 podman[99472]: 2024-09-19 07:34:18.707786113 +0000 UTC m=+0.336642587 container start 32eaa4a28c856fe9a110311c2e3ad37db1f8679cbcd5c3bc7c1bf1098aa27717 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T07:34:19.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:18 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:18.701+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:19.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:18 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:18.701+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:19.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:18 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:18.701+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:19.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:18 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:18.701+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:19.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:18 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:18.701+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:19.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:18 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:18.701+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:19.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:18 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:18.701+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:52.287162+0000 front 2024-09-19T07:33:52.287118+0000 (oldest deadline 2024-09-19T07:34:14.587134+0000) 2024-09-19T07:34:19.183 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:18 smithi098 podman[99472]: 2024-09-19 07:34:18.787897306 +0000 UTC m=+0.416753773 container attach 32eaa4a28c856fe9a110311c2e3ad37db1f8679cbcd5c3bc7c1bf1098aa27717 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T07:34:19.183 INFO:journalctl@ceph.osd.9.smithi098.stdout:Sep 19 07:34:18 smithi098 podman[99472]: 2024-09-19 07:34:18.891226172 +0000 UTC m=+0.520082647 container died 32eaa4a28c856fe9a110311c2e3ad37db1f8679cbcd5c3bc7c1bf1098aa27717 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:34:19.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:19 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:19.050+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:19.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:19 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:19.050+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:19.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:19 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:19.050+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:19.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:19 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:19.050+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:19.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:19 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:19.050+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:19.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:19 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:19.050+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:19.496 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T07:34:19.537 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:34:19.537 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T07:34:19.537 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T07:34:19.538 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@osd.10 2024-09-19T07:34:19.817 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:19 smithi139 systemd[1]: Stopping Ceph osd.10 for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:34:19.817 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:19 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:19.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:19.817 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:19 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:19.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:19.817 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:19 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:19.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:19.817 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:19 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:19.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:19.817 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:19 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:19.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:19.817 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:19 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:19.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:19.817 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:19 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:19.750+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:52.287162+0000 front 2024-09-19T07:33:52.287118+0000 (oldest deadline 2024-09-19T07:34:14.587134+0000) 2024-09-19T07:34:20.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:19 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:19.859+0000 7f256ea7a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:34:20.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:19 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:19.859+0000 7f256ea7a640 -1 osd.10 92 *** Got signal Terminated *** 2024-09-19T07:34:20.317 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:19 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:19.859+0000 7f256ea7a640 -1 osd.10 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:34:20.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:20 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:20.100+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:20.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:20 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:20.100+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:20.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:20 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:20.100+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:20.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:20 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:20.100+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:20.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:20 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:20.100+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:20.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:20 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:20.100+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:21.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:20 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:20.782+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:21.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:20 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:20.782+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:21.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:20 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:20.782+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:21.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:20 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:20.782+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:21.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:20 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:20.782+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:21.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:20 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:20.782+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:21.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:20 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:20.782+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:52.287162+0000 front 2024-09-19T07:33:52.287118+0000 (oldest deadline 2024-09-19T07:34:14.587134+0000) 2024-09-19T07:34:21.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:21 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:21.113+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:21.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:21 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:21.113+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:21.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:21 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:21.113+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:21.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:21 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:21.113+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:21.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:21 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:21.113+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:21.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:21 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:21.113+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:22.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:21 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:21.807+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:22.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:21 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:21.807+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:22.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:21 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:21.807+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:22.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:21 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:21.807+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:22.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:21 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:21.807+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:22.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:21 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:21.807+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:22.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:21 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:21.807+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:52.287162+0000 front 2024-09-19T07:33:52.287118+0000 (oldest deadline 2024-09-19T07:34:14.587134+0000) 2024-09-19T07:34:22.283 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:22 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:22.067+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:22.283 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:22 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:22.067+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:22.283 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:22 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:22.067+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:22.283 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:22 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:22.067+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:22.283 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:22 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:22.067+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:22.283 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:22 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:22.067+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:23.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:22 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:22.771+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:23.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:22 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:22.771+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:23.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:22 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:22.771+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:23.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:22 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:22.771+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:23.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:22 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:22.771+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:23.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:22 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:22.771+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:23.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:22 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:22.771+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:52.287162+0000 front 2024-09-19T07:33:52.287118+0000 (oldest deadline 2024-09-19T07:34:14.587134+0000) 2024-09-19T07:34:23.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:23 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:23.097+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:23.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:23 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:23.097+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:23.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:23 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:23.097+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:23.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:23 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:23.097+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:23.383 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:23 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:23.097+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:23.383 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:23 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:23.097+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:24.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:23 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:23.813+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:24.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:23 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:23.813+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:24.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:23 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:23.813+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:24.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:23 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:23.813+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:24.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:23 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:23.813+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:24.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:23 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:23.813+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:24.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:23 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:23.813+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:52.287162+0000 front 2024-09-19T07:33:52.287118+0000 (oldest deadline 2024-09-19T07:34:14.587134+0000) 2024-09-19T07:34:24.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:24 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:24.093+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:24.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:24 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:24.093+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:24.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:24 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:24.093+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:24.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:24 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:24.093+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:24.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:24 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:24.093+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:24.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:24 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:24.093+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:24.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:24 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:24.093+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-19T07:33:56.103354+0000 front 2024-09-19T07:33:56.103259+0000 (oldest deadline 2024-09-19T07:34:23.103508+0000) 2024-09-19T07:34:25.261 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:24 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:24.834+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.880169+0000 front 2024-09-19T07:33:03.880187+0000 (oldest deadline 2024-09-19T07:33:29.180195+0000) 2024-09-19T07:34:25.261 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:24 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:24.834+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:12.081054+0000 front 2024-09-19T07:33:12.081032+0000 (oldest deadline 2024-09-19T07:33:37.881866+0000) 2024-09-19T07:34:25.262 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:24 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:24.834+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:21.982849+0000 front 2024-09-19T07:33:21.982930+0000 (oldest deadline 2024-09-19T07:33:46.682921+0000) 2024-09-19T07:34:25.262 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:24 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:24.834+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:28.984096+0000 front 2024-09-19T07:33:28.984040+0000 (oldest deadline 2024-09-19T07:33:53.083913+0000) 2024-09-19T07:34:25.262 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:24 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:24.834+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:34.784885+0000 front 2024-09-19T07:33:34.784864+0000 (oldest deadline 2024-09-19T07:34:01.785309+0000) 2024-09-19T07:34:25.262 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:24 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:24.835+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:45.286313+0000 front 2024-09-19T07:33:45.286369+0000 (oldest deadline 2024-09-19T07:34:09.986187+0000) 2024-09-19T07:34:25.262 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:24 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10[60218]: 2024-09-19T07:34:24.835+0000 7f256b07f640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.98:6822 osd.6 since back 2024-09-19T07:33:52.287162+0000 front 2024-09-19T07:33:52.287118+0000 (oldest deadline 2024-09-19T07:34:14.587134+0000) 2024-09-19T07:34:25.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:25 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:25.089+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:25.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:25 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:25.089+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:25.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:25 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:25.089+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:25.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:25 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:25.089+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:25.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:25 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:25.089+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:25.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:25 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:25.089+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:25.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:25 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:25.089+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-19T07:33:56.103354+0000 front 2024-09-19T07:33:56.103259+0000 (oldest deadline 2024-09-19T07:34:23.103508+0000) 2024-09-19T07:34:25.566 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:25 smithi139 podman[71808]: 2024-09-19 07:34:25.261810497 +0000 UTC m=+5.525536046 container died 7e8fccf43244cb297cf11b7a004f15ea0199a6b43406e2957ff8afe912b33142 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T07:34:26.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:25 smithi139 podman[71808]: 2024-09-19 07:34:25.583472281 +0000 UTC m=+5.847197827 container cleanup 7e8fccf43244cb297cf11b7a004f15ea0199a6b43406e2957ff8afe912b33142 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T07:34:26.066 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:25 smithi139 bash[71808]: ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10 2024-09-19T07:34:26.067 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:25 smithi139 podman[71826]: 2024-09-19 07:34:25.759583995 +0000 UTC m=+0.498511602 container remove 7e8fccf43244cb297cf11b7a004f15ea0199a6b43406e2957ff8afe912b33142 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T07:34:26.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:26 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:26.128+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:26.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:26 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:26.128+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:26.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:26 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:26.128+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:26.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:26 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:26.128+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:26.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:26 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:26.128+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:26.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:26 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:26.128+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:26.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:26 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:26.128+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-19T07:33:56.103354+0000 front 2024-09-19T07:33:56.103259+0000 (oldest deadline 2024-09-19T07:34:23.103508+0000) 2024-09-19T07:34:26.512 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:26 smithi139 podman[71913]: 2024-09-19 07:34:26.096616151 +0000 UTC m=+0.015983073 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:34:26.512 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:26 smithi139 podman[71913]: 2024-09-19 07:34:26.210213203 +0000 UTC m=+0.129580161 container create 63745ff2059e6cfd8ca298f0a38d2f2d38b6010b08d35916d166ae3f2cd800b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:34:26.512 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:26 smithi139 podman[71913]: 2024-09-19 07:34:26.43754865 +0000 UTC m=+0.356915566 container init 63745ff2059e6cfd8ca298f0a38d2f2d38b6010b08d35916d166ae3f2cd800b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:34:26.512 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:26 smithi139 podman[71913]: 2024-09-19 07:34:26.440894293 +0000 UTC m=+0.360261209 container start 63745ff2059e6cfd8ca298f0a38d2f2d38b6010b08d35916d166ae3f2cd800b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:34:26.512 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:26 smithi139 podman[71913]: 2024-09-19 07:34:26.512535309 +0000 UTC m=+0.431902234 container attach 63745ff2059e6cfd8ca298f0a38d2f2d38b6010b08d35916d166ae3f2cd800b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T07:34:26.816 INFO:journalctl@ceph.osd.10.smithi139.stdout:Sep 19 07:34:26 smithi139 podman[71913]: 2024-09-19 07:34:26.635086297 +0000 UTC m=+0.554453215 container died 63745ff2059e6cfd8ca298f0a38d2f2d38b6010b08d35916d166ae3f2cd800b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T07:34:27.242 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T07:34:27.279 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:34:27.280 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T07:34:27.280 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T07:34:27.280 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@osd.11 2024-09-19T07:34:27.593 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:27 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:27.144+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:27.593 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:27 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:27.144+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:27.593 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:27 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:27.144+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:27.593 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:27 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:27.144+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:27.593 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:27 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:27.144+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:27.594 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:27 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:27.144+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:27.594 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:27 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:27.144+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-19T07:33:56.103354+0000 front 2024-09-19T07:33:56.103259+0000 (oldest deadline 2024-09-19T07:34:23.103508+0000) 2024-09-19T07:34:27.594 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:27 smithi162 systemd[1]: Stopping Ceph osd.11 for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:34:27.594 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:27 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:27.592+0000 7f79089cc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:34:27.594 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:27 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:27.592+0000 7f79089cc640 -1 osd.11 92 *** Got signal Terminated *** 2024-09-19T07:34:27.594 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:27 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:27.592+0000 7f79089cc640 -1 osd.11 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:34:28.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:28 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:28.135+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:28.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:28 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:28.135+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:28.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:28 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:28.135+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:28.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:28 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:28.135+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:28.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:28 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:28.135+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:28.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:28 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:28.135+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:28.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:28 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:28.135+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-19T07:33:56.103354+0000 front 2024-09-19T07:33:56.103259+0000 (oldest deadline 2024-09-19T07:34:23.103508+0000) 2024-09-19T07:34:29.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:29 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:29.085+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:29.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:29 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:29.085+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:29.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:29 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:29.085+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:29.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:29 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:29.085+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:29.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:29 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:29.085+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:29.383 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:29 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:29.085+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:29.383 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:29 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:29.085+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-19T07:33:56.103354+0000 front 2024-09-19T07:33:56.103259+0000 (oldest deadline 2024-09-19T07:34:23.103508+0000) 2024-09-19T07:34:30.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:30 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:30.038+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:30.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:30 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:30.038+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:30.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:30 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:30.038+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:30.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:30 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:30.038+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:30.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:30 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:30.038+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:30.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:30 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:30.038+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:30.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:30 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:30.038+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-19T07:33:56.103354+0000 front 2024-09-19T07:33:56.103259+0000 (oldest deadline 2024-09-19T07:34:23.103508+0000) 2024-09-19T07:34:31.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:31.022+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:31.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:31.022+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:31.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:31.022+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:31.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:31.022+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:31.383 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:31.022+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:31.383 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:31.022+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:31.383 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:31 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:31.022+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-19T07:33:56.103354+0000 front 2024-09-19T07:33:56.103259+0000 (oldest deadline 2024-09-19T07:34:23.103508+0000) 2024-09-19T07:34:32.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:32.028+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6806 osd.0 since back 2024-09-19T07:33:03.297313+0000 front 2024-09-19T07:33:03.297367+0000 (oldest deadline 2024-09-19T07:33:28.597444+0000) 2024-09-19T07:34:32.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:32.028+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-09-19T07:33:08.598063+0000 front 2024-09-19T07:33:08.598100+0000 (oldest deadline 2024-09-19T07:33:38.598466+0000) 2024-09-19T07:34:32.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:32.028+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-09-19T07:33:18.598962+0000 front 2024-09-19T07:33:18.598813+0000 (oldest deadline 2024-09-19T07:33:44.498858+0000) 2024-09-19T07:34:32.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:32.028+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.98:6814 osd.3 since back 2024-09-19T07:33:25.599700+0000 front 2024-09-19T07:33:25.599809+0000 (oldest deadline 2024-09-19T07:33:50.899766+0000) 2024-09-19T07:34:32.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:32.028+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-09-19T07:33:36.800743+0000 front 2024-09-19T07:33:36.800780+0000 (oldest deadline 2024-09-19T07:34:01.500674+0000) 2024-09-19T07:34:32.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:32.028+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-09-19T07:33:41.501149+0000 front 2024-09-19T07:33:41.501070+0000 (oldest deadline 2024-09-19T07:34:10.301673+0000) 2024-09-19T07:34:32.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:32.028+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-09-19T07:33:56.103354+0000 front 2024-09-19T07:33:56.103259+0000 (oldest deadline 2024-09-19T07:34:23.103508+0000) 2024-09-19T07:34:32.382 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:32 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11[60660]: 2024-09-19T07:34:32.028+0000 7f7900fc9640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.162:6820 osd.8 since back 2024-09-19T07:34:07.804338+0000 front 2024-09-19T07:34:07.804372+0000 (oldest deadline 2024-09-19T07:34:31.904432+0000) 2024-09-19T07:34:33.359 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:33 smithi162 podman[72344]: 2024-09-19 07:34:33.077005756 +0000 UTC m=+5.588018208 container died 713fba42b4b16359661034f7e99105441c529bb3334a6ffb1c228e7585b746c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T07:34:33.631 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:33 smithi162 podman[72344]: 2024-09-19 07:34:33.483824768 +0000 UTC m=+5.994837219 container cleanup 713fba42b4b16359661034f7e99105441c529bb3334a6ffb1c228e7585b746c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:34:33.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:33 smithi162 bash[72344]: ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11 2024-09-19T07:34:34.035 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:33 smithi162 podman[72359]: 2024-09-19 07:34:33.718425717 +0000 UTC m=+0.639094187 container remove 713fba42b4b16359661034f7e99105441c529bb3334a6ffb1c228e7585b746c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T07:34:34.304 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:34 smithi162 podman[72450]: 2024-09-19 07:34:34.03579315 +0000 UTC m=+0.096781616 container create 0a3074e9d2cd18f161c1e465815d85b60f2601568dba42d17ea88531cd02118f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:34:34.304 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:34 smithi162 podman[72450]: 2024-09-19 07:34:33.954987303 +0000 UTC m=+0.015975773 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:34:34.304 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:34 smithi162 podman[72450]: 2024-09-19 07:34:34.229763079 +0000 UTC m=+0.290751546 container init 0a3074e9d2cd18f161c1e465815d85b60f2601568dba42d17ea88531cd02118f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T07:34:34.304 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:34 smithi162 podman[72450]: 2024-09-19 07:34:34.233182253 +0000 UTC m=+0.294170721 container start 0a3074e9d2cd18f161c1e465815d85b60f2601568dba42d17ea88531cd02118f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T07:34:34.305 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:34 smithi162 podman[72450]: 2024-09-19 07:34:34.304747465 +0000 UTC m=+0.365735943 container attach 0a3074e9d2cd18f161c1e465815d85b60f2601568dba42d17ea88531cd02118f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:34:34.632 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:34 smithi162 podman[72450]: 2024-09-19 07:34:34.420659919 +0000 UTC m=+0.481648387 container died 0a3074e9d2cd18f161c1e465815d85b60f2601568dba42d17ea88531cd02118f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T07:34:34.963 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T07:34:34.987 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:34 smithi162 podman[72474]: 2024-09-19 07:34:34.941386262 +0000 UTC m=+0.514918907 container remove 0a3074e9d2cd18f161c1e465815d85b60f2601568dba42d17ea88531cd02118f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T07:34:34.987 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:34 smithi162 systemd[1]: ceph-73438718-7656-11ef-bceb-c7b262605968@osd.11.service: Deactivated successfully. 2024-09-19T07:34:34.987 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:34 smithi162 systemd[1]: Stopped Ceph osd.11 for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:34:34.988 INFO:journalctl@ceph.osd.11.smithi162.stdout:Sep 19 07:34:34 smithi162 systemd[1]: ceph-73438718-7656-11ef-bceb-c7b262605968@osd.11.service: Consumed 38.257s CPU time. 2024-09-19T07:34:35.002 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:34:35.002 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T07:34:35.002 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T07:34:35.002 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mds.a 2024-09-19T07:34:35.339 INFO:journalctl@ceph.mds.a.smithi098.stdout:Sep 19 07:34:35 smithi098 systemd[1]: Stopping Ceph mds.a for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:34:35.773 INFO:journalctl@ceph.mds.a.smithi098.stdout:Sep 19 07:34:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-a[71343]: 2024-09-19T07:34:35.338+0000 7fe3ef859640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:34:35.773 INFO:journalctl@ceph.mds.a.smithi098.stdout:Sep 19 07:34:35 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-a[71343]: 2024-09-19T07:34:35.338+0000 7fe3ef859640 -1 mds.a *** got signal Terminated *** 2024-09-19T07:34:36.635 INFO:journalctl@ceph.mds.a.smithi098.stdout:Sep 19 07:34:36 smithi098 podman[99586]: 2024-09-19 07:34:36.372309283 +0000 UTC m=+1.170255397 container died 91c999fb46b483fba5ae7f59c98718b66ce5709e28a5e5ed2c6b8f0043a06858 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T07:34:36.635 INFO:journalctl@ceph.mds.a.smithi098.stdout:Sep 19 07:34:36 smithi098 podman[99586]: 2024-09-19 07:34:36.635414154 +0000 UTC m=+1.433360263 container cleanup 91c999fb46b483fba5ae7f59c98718b66ce5709e28a5e5ed2c6b8f0043a06858 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T07:34:36.911 INFO:journalctl@ceph.mds.a.smithi098.stdout:Sep 19 07:34:36 smithi098 bash[99586]: ceph-73438718-7656-11ef-bceb-c7b262605968-mds-a 2024-09-19T07:34:37.073 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T07:34:37.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:34:37.107 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T07:34:37.107 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T07:34:37.108 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mds.d 2024-09-19T07:34:37.423 INFO:journalctl@ceph.mds.d.smithi098.stdout:Sep 19 07:34:37 smithi098 systemd[1]: Stopping Ceph mds.d for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:34:37.773 INFO:journalctl@ceph.mds.d.smithi098.stdout:Sep 19 07:34:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-d[70157]: 2024-09-19T07:34:37.422+0000 7f27c1ef4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:34:37.773 INFO:journalctl@ceph.mds.d.smithi098.stdout:Sep 19 07:34:37 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-d[70157]: 2024-09-19T07:34:37.422+0000 7f27c1ef4640 -1 mds.d *** got signal Terminated *** 2024-09-19T07:34:41.723 INFO:journalctl@ceph.mds.d.smithi098.stdout:Sep 19 07:34:41 smithi098 podman[99707]: 2024-09-19 07:34:41.436199386 +0000 UTC m=+4.113051730 container died 2fe97c96888ab396ae4ecda1fa5c15e9f7a4e12e6d3237023cb603df35c630e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-09-19T07:34:42.023 INFO:journalctl@ceph.mds.d.smithi098.stdout:Sep 19 07:34:41 smithi098 podman[99707]: 2024-09-19 07:34:41.822488149 +0000 UTC m=+4.499340537 container cleanup 2fe97c96888ab396ae4ecda1fa5c15e9f7a4e12e6d3237023cb603df35c630e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:34:42.023 INFO:journalctl@ceph.mds.d.smithi098.stdout:Sep 19 07:34:41 smithi098 bash[99707]: ceph-73438718-7656-11ef-bceb-c7b262605968-mds-d 2024-09-19T07:34:42.207 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T07:34:42.240 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:34:42.240 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T07:34:42.240 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T07:34:42.240 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mds.g 2024-09-19T07:34:42.773 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:34:42 smithi098 systemd[1]: Stopping Ceph mds.g for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:34:42.773 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:34:42 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-g[70929]: 2024-09-19T07:34:42.534+0000 7fb6973d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:34:42.773 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:34:42 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-g[70929]: 2024-09-19T07:34:42.534+0000 7fb6973d0640 -1 mds.g *** got signal Terminated *** 2024-09-19T07:34:45.876 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:34:45 smithi098 podman[99828]: 2024-09-19 07:34:45.556288828 +0000 UTC m=+3.097558136 container died 64cfe78985fcc44be3660c047c31b8913911849d6fb5571eeb1ee72667b65f8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T07:34:45.940 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:34:45 smithi098 podman[99828]: 2024-09-19 07:34:45.876539163 +0000 UTC m=+3.417808463 container cleanup 64cfe78985fcc44be3660c047c31b8913911849d6fb5571eeb1ee72667b65f8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:34:46.265 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:34:45 smithi098 bash[99828]: ceph-73438718-7656-11ef-bceb-c7b262605968-mds-g 2024-09-19T07:34:46.265 INFO:journalctl@ceph.mds.g.smithi098.stdout:Sep 19 07:34:46 smithi098 podman[99839]: 2024-09-19 07:34:46.06116452 +0000 UTC m=+0.500720674 container remove 64cfe78985fcc44be3660c047c31b8913911849d6fb5571eeb1ee72667b65f8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T07:34:46.279 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T07:34:46.312 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:34:46.313 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T07:34:46.313 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T07:34:46.313 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mds.j 2024-09-19T07:34:46.622 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:34:46 smithi098 systemd[1]: Stopping Ceph mds.j for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:34:47.023 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:34:46 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-j[69740]: 2024-09-19T07:34:46.620+0000 7f0c8d670640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:34:47.023 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:34:46 smithi098 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-j[69740]: 2024-09-19T07:34:46.620+0000 7f0c8d670640 -1 mds.j *** got signal Terminated *** 2024-09-19T07:34:50.738 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:34:50 smithi098 podman[99948]: 2024-09-19 07:34:50.473533987 +0000 UTC m=+3.947814821 container died 1dbde68a8eb5a48e64d7d8fee2cd7903a232099edddd85688d2948236589227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-j, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T07:34:51.023 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:34:50 smithi098 podman[99948]: 2024-09-19 07:34:50.804996065 +0000 UTC m=+4.279276899 container cleanup 1dbde68a8eb5a48e64d7d8fee2cd7903a232099edddd85688d2948236589227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:34:51.023 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:34:50 smithi098 bash[99948]: ceph-73438718-7656-11ef-bceb-c7b262605968-mds-j 2024-09-19T07:34:51.023 INFO:journalctl@ceph.mds.j.smithi098.stdout:Sep 19 07:34:50 smithi098 podman[99960]: 2024-09-19 07:34:50.972689889 +0000 UTC m=+0.496717128 container remove 1dbde68a8eb5a48e64d7d8fee2cd7903a232099edddd85688d2948236589227b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-j, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:34:51.227 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T07:34:51.260 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:34:51.260 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T07:34:51.260 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T07:34:51.260 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mds.b 2024-09-19T07:34:51.549 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:34:51 smithi139 systemd[1]: Stopping Ceph mds.b for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:34:51.816 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:34:51 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b[65424]: 2024-09-19T07:34:51.548+0000 7f6ee89a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:34:51.816 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:34:51 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b[65424]: 2024-09-19T07:34:51.548+0000 7f6ee89a9640 -1 mds.b *** got signal Terminated *** 2024-09-19T07:34:54.566 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:34:54 smithi139 podman[72029]: 2024-09-19 07:34:54.29304964 +0000 UTC m=+2.837939156 container died dbcdc14ae0f97be6339644f83079e20f5b625570500cac84fee4fc2cf23017d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:34:54.866 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:34:54 smithi139 podman[72029]: 2024-09-19 07:34:54.614992833 +0000 UTC m=+3.159882349 container cleanup dbcdc14ae0f97be6339644f83079e20f5b625570500cac84fee4fc2cf23017d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T07:34:54.866 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:34:54 smithi139 bash[72029]: ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b 2024-09-19T07:34:55.095 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T07:34:55.117 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:34:54 smithi139 podman[72043]: 2024-09-19 07:34:54.866268255 +0000 UTC m=+0.571422091 container remove dbcdc14ae0f97be6339644f83079e20f5b625570500cac84fee4fc2cf23017d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T07:34:55.117 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:34:55 smithi139 systemd[1]: ceph-73438718-7656-11ef-bceb-c7b262605968@mds.b.service: Deactivated successfully. 2024-09-19T07:34:55.117 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:34:55 smithi139 systemd[1]: Stopped Ceph mds.b for 73438718-7656-11ef-bceb-c7b262605968. 2024-09-19T07:34:55.117 INFO:journalctl@ceph.mds.b.smithi139.stdout:Sep 19 07:34:55 smithi139 systemd[1]: ceph-73438718-7656-11ef-bceb-c7b262605968@mds.b.service: Consumed 2min 37.365s CPU time. 2024-09-19T07:34:55.130 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:34:55.131 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T07:34:55.131 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T07:34:55.131 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mds.e 2024-09-19T07:34:55.436 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:34:55 smithi139 systemd[1]: Stopping Ceph mds.e for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:34:55.816 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:34:55 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e[64822]: 2024-09-19T07:34:55.435+0000 7fab63a01640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:34:55.817 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:34:55 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e[64822]: 2024-09-19T07:34:55.435+0000 7fab63a01640 -1 mds.e *** got signal Terminated *** 2024-09-19T07:34:58.566 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:34:58 smithi139 podman[72151]: 2024-09-19 07:34:58.289493178 +0000 UTC m=+2.939546809 container died 415d2f182a9206fd9f006559d35f61da4ab29138be47b9aad0f8ee8adfd956df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T07:34:58.829 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:34:58 smithi139 podman[72151]: 2024-09-19 07:34:58.710548944 +0000 UTC m=+3.360602571 container cleanup 415d2f182a9206fd9f006559d35f61da4ab29138be47b9aad0f8ee8adfd956df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T07:34:58.829 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:34:58 smithi139 bash[72151]: ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e 2024-09-19T07:34:59.128 INFO:journalctl@ceph.mds.e.smithi139.stdout:Sep 19 07:34:58 smithi139 podman[72163]: 2024-09-19 07:34:58.895114345 +0000 UTC m=+0.604309593 container remove 415d2f182a9206fd9f006559d35f61da4ab29138be47b9aad0f8ee8adfd956df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-e, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:34:59.141 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T07:34:59.177 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:34:59.177 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T07:34:59.177 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T07:34:59.177 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mds.h 2024-09-19T07:34:59.523 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:34:59 smithi139 systemd[1]: Stopping Ceph mds.h for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:34:59.816 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:34:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:34:59.522+0000 7f20fa60d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:34:59.817 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:34:59 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h[65122]: 2024-09-19T07:34:59.522+0000 7f20fa60d640 -1 mds.h *** got signal Terminated *** 2024-09-19T07:35:02.566 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:35:02 smithi139 podman[72282]: 2024-09-19 07:35:02.297162148 +0000 UTC m=+2.900188884 container died d84c8446d0ef2a1c07ee38612f409518b0f1ffd576fe66bbfab29e29f2774876 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T07:35:02.964 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:35:02 smithi139 podman[72282]: 2024-09-19 07:35:02.680322396 +0000 UTC m=+3.283349135 container cleanup d84c8446d0ef2a1c07ee38612f409518b0f1ffd576fe66bbfab29e29f2774876 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T07:35:02.965 INFO:journalctl@ceph.mds.h.smithi139.stdout:Sep 19 07:35:02 smithi139 bash[72282]: ceph-73438718-7656-11ef-bceb-c7b262605968-mds-h 2024-09-19T07:35:03.114 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T07:35:03.148 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:35:03.148 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T07:35:03.149 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T07:35:03.149 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mds.k 2024-09-19T07:35:03.566 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:35:03 smithi139 systemd[1]: Stopping Ceph mds.k for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:35:03.567 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:35:03 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-k[64513]: 2024-09-19T07:35:03.466+0000 7f5097548640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:35:03.567 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:35:03 smithi139 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-k[64513]: 2024-09-19T07:35:03.466+0000 7f5097548640 -1 mds.k *** got signal Terminated *** 2024-09-19T07:35:06.566 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:35:06 smithi139 podman[72404]: 2024-09-19 07:35:06.294496535 +0000 UTC m=+2.929661985 container died 69de78d0610fcaefcd677bae0fc12835f093c12ccd97db18701c6dd73933d616 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T07:35:07.066 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:35:06 smithi139 podman[72404]: 2024-09-19 07:35:06.76715645 +0000 UTC m=+3.402321902 container cleanup 69de78d0610fcaefcd677bae0fc12835f093c12ccd97db18701c6dd73933d616 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T07:35:07.066 INFO:journalctl@ceph.mds.k.smithi139.stdout:Sep 19 07:35:06 smithi139 bash[72404]: ceph-73438718-7656-11ef-bceb-c7b262605968-mds-k 2024-09-19T07:35:07.240 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T07:35:07.272 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:35:07.273 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T07:35:07.273 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T07:35:07.273 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mds.c 2024-09-19T07:35:07.564 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:35:07 smithi162 systemd[1]: Stopping Ceph mds.c for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:35:07.827 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:35:07 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c[65781]: 2024-09-19T07:35:07.563+0000 7f631ea42640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:35:07.827 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:35:07 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c[65781]: 2024-09-19T07:35:07.563+0000 7f631ea42640 -1 mds.c *** got signal Terminated *** 2024-09-19T07:35:10.579 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:35:10 smithi162 podman[72555]: 2024-09-19 07:35:10.285216648 +0000 UTC m=+2.819247748 container died 0b8fea2a7a950c04f252ce609997f74a18b08e5d1da6d3358e2b4f683934c115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T07:35:10.579 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:35:10 smithi162 podman[72555]: 2024-09-19 07:35:10.579505935 +0000 UTC m=+3.113537027 container cleanup 0b8fea2a7a950c04f252ce609997f74a18b08e5d1da6d3358e2b4f683934c115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T07:35:10.881 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:35:10 smithi162 bash[72555]: ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c 2024-09-19T07:35:10.882 INFO:journalctl@ceph.mds.c.smithi162.stdout:Sep 19 07:35:10 smithi162 podman[72579]: 2024-09-19 07:35:10.747409415 +0000 UTC m=+0.460115638 container remove 0b8fea2a7a950c04f252ce609997f74a18b08e5d1da6d3358e2b4f683934c115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T07:35:11.001 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T07:35:11.038 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:35:11.039 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T07:35:11.039 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T07:35:11.039 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mds.f 2024-09-19T07:35:11.350 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:35:11 smithi162 systemd[1]: Stopping Ceph mds.f for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:35:11.631 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:35:11 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-f[65483]: 2024-09-19T07:35:11.350+0000 7effd6535640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:35:11.631 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:35:11 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-f[65483]: 2024-09-19T07:35:11.350+0000 7effd6535640 -1 mds.f *** got signal Terminated *** 2024-09-19T07:35:14.784 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:35:14 smithi162 podman[72688]: 2024-09-19 07:35:14.514564421 +0000 UTC m=+3.258536655 container died 86dc30f8492288d50cc4d74b0a92ae1ac6516e10b4715c078fe660c26743eeac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T07:35:15.125 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:35:14 smithi162 podman[72688]: 2024-09-19 07:35:14.899677044 +0000 UTC m=+3.643649275 container cleanup 86dc30f8492288d50cc4d74b0a92ae1ac6516e10b4715c078fe660c26743eeac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T07:35:15.125 INFO:journalctl@ceph.mds.f.smithi162.stdout:Sep 19 07:35:14 smithi162 bash[72688]: ceph-73438718-7656-11ef-bceb-c7b262605968-mds-f 2024-09-19T07:35:15.251 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T07:35:15.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:35:15.285 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T07:35:15.285 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T07:35:15.285 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mds.i 2024-09-19T07:35:15.381 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:35:15 smithi162 systemd[1]: Stopping Ceph mds.i for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:35:15.882 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:35:15 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:35:15.603+0000 7f2ff635d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:35:15.882 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:35:15 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i[66083]: 2024-09-19T07:35:15.603+0000 7f2ff635d640 -1 mds.i *** got signal Terminated *** 2024-09-19T07:35:18.631 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:35:18 smithi162 podman[72810]: 2024-09-19 07:35:18.279439199 +0000 UTC m=+2.780412253 container died 18c87e98b427d17e6a9f47a9684d20d4ba130e4edac9bb2f7bf00ed5c9c09680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T07:35:19.037 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:35:18 smithi162 podman[72810]: 2024-09-19 07:35:18.815536443 +0000 UTC m=+3.316509501 container cleanup 18c87e98b427d17e6a9f47a9684d20d4ba130e4edac9bb2f7bf00ed5c9c09680 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:35:19.037 INFO:journalctl@ceph.mds.i.smithi162.stdout:Sep 19 07:35:18 smithi162 bash[72810]: ceph-73438718-7656-11ef-bceb-c7b262605968-mds-i 2024-09-19T07:35:19.161 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T07:35:19.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:35:19.193 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T07:35:19.194 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T07:35:19.194 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-73438718-7656-11ef-bceb-c7b262605968@mds.l 2024-09-19T07:35:19.381 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:35:19 smithi162 systemd[1]: Stopping Ceph mds.l for 73438718-7656-11ef-bceb-c7b262605968... 2024-09-19T07:35:19.881 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:35:19 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-l[65184]: 2024-09-19T07:35:19.498+0000 7fe936c86640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:35:19.882 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:35:19 smithi162 ceph-73438718-7656-11ef-bceb-c7b262605968-mds-l[65184]: 2024-09-19T07:35:19.498+0000 7fe936c86640 -1 mds.l *** got signal Terminated *** 2024-09-19T07:35:21.215 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:35:20 smithi162 podman[72930]: 2024-09-19 07:35:20.942137166 +0000 UTC m=+1.524207460 container died 19646953c402c364623f4b64c6f64fb411ba3a55d190bec720cdb7087be73d0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T07:35:21.565 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:35:21 smithi162 podman[72930]: 2024-09-19 07:35:21.315076234 +0000 UTC m=+1.897146520 container cleanup 19646953c402c364623f4b64c6f64fb411ba3a55d190bec720cdb7087be73d0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-73438718-7656-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:35:21.566 INFO:journalctl@ceph.mds.l.smithi162.stdout:Sep 19 07:35:21 smithi162 bash[72930]: ceph-73438718-7656-11ef-bceb-c7b262605968-mds-l 2024-09-19T07:35:21.682 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-73438718-7656-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T07:35:21.714 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:35:21.714 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T07:35:21.714 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 73438718-7656-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:35:21.914 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:35:24.438 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 73438718-7656-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:35:24.641 INFO:teuthology.orchestra.run.smithi139.stdout:Deleting cluster with fsid: 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:35:27.058 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 73438718-7656-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:35:27.262 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:35:29.638 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:35:29.672 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:35:29.704 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:35:29.732 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T07:35:29.734 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784/remote/smithi098/crash 2024-09-19T07:35:29.735 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:35:29.764 INFO:teuthology.orchestra.run.smithi098.stderr:tar: /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:35:29.764 INFO:teuthology.orchestra.run.smithi098.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:35:29.766 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784/remote/smithi139/crash 2024-09-19T07:35:29.767 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:35:29.818 INFO:teuthology.orchestra.run.smithi139.stderr:tar: /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:35:29.818 INFO:teuthology.orchestra.run.smithi139.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:35:29.820 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784/remote/smithi162/crash 2024-09-19T07:35:29.821 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:35:29.858 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/73438718-7656-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:35:29.858 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:35:29.859 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T07:35:29.860 DEBUG:teuthology.orchestra.run.smithi098:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T07:35:29.902 INFO:teuthology.orchestra.run.smithi098.stdout:2024-09-19T07:24:44.012836+0000 mds.h (mds.1) 4 : cluster [WRN] Scrub error on inode 0x10000001e8c (/volumes/qa/sv_1/4730ffd1-fd85-4643-b1bb-bc536e5bfde4/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/stress/signals/sigismember_stress_1.c) see mds.h log and `damage ls` output for details 2024-09-19T07:35:29.903 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-19T07:35:29.903 INFO:tasks.cephadm:Compressing logs... 2024-09-19T07:35:29.903 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:35:29.946 DEBUG:teuthology.orchestra.run.smithi139:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:35:29.949 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:35:29.971 INFO:teuthology.orchestra.run.smithi098.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T07:35:29.971 INFO:teuthology.orchestra.run.smithi098.stderr:: No such file or directory 2024-09-19T07:35:29.971 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T07:35:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:35:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:35:29.972 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T07:35:29.973 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:35:29.974 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T07:35:29.974 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T07:35:29.974 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T07:35:29.974 INFO:teuthology.orchestra.run.smithi098.stderr: 84.6% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:35:29.976 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:35:29.976 INFO:teuthology.orchestra.run.smithi162.stderr:: No such file or directory 2024-09-19T07:35:29.976 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:35:29.976 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T07:35:29.976 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T07:35:29.976 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:35:29.976 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T07:35:29.977 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T07:35:29.977 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.11.log: 82.0%gzip -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.cephadm.log.gz -5 2024-09-19T07:35:29.977 INFO:teuthology.orchestra.run.smithi162.stderr: --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T07:35:29.977 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:35:29.977 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T07:35:29.978 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.5.log: /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.log: 90.5% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:35:29.981 INFO:teuthology.orchestra.run.smithi139.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T07:35:29.981 INFO:teuthology.orchestra.run.smithi139.stderr:: No such file or directory 2024-09-19T07:35:29.981 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T07:35:29.981 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose --/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T07:35:29.981 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:35:29.982 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T07:35:29.982 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T07:35:29.982 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.b.log: /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T07:35:29.982 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:35:29.982 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:35:29.983 INFO:teuthology.orchestra.run.smithi098.stderr: 94.6% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T07:35:29.983 INFO:teuthology.orchestra.run.smithi098.stderr: 94.6% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T07:35:29.983 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:35:29.983 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T07:35:29.983 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T07:35:29.983 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T07:35:29.984 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:35:29.985 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mgr.x.log: 89.6% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:35:29.985 INFO:teuthology.orchestra.run.smithi098.stderr: 94.6% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T07:35:29.986 INFO:teuthology.orchestra.run.smithi162.stderr: 89.7% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:35:29.986 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T07:35:29.986 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T07:35:29.987 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.8.log: 90.9% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:35:29.988 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.audit.log: 90.5% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:35:29.988 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T07:35:29.988 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.0% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:35:29.988 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:35:29.989 INFO:teuthology.orchestra.run.smithi098.stderr: 91.0% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:35:29.989 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T07:35:29.989 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:35:29.990 INFO:teuthology.orchestra.run.smithi162.stderr: 94.6% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T07:35:29.990 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T07:35:29.990 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T07:35:29.991 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T07:35:29.992 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mgr.y.log: 91.0% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:35:29.994 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T07:35:29.997 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.log: 89.7% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:35:29.997 INFO:teuthology.orchestra.run.smithi139.stderr: 91.8% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T07:35:29.997 INFO:teuthology.orchestra.run.smithi098.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:35:29.997 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T07:35:29.998 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.c.log: 91.9% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T07:35:29.999 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T07:35:30.004 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:35:30.007 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.f.log: 94.5% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T07:35:30.010 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:35:30.012 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:35:30.027 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:35:30.220 INFO:teuthology.orchestra.run.smithi098.stderr: 90.2% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T07:35:30.264 INFO:teuthology.orchestra.run.smithi162.stderr: 91.8% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T07:35:30.401 INFO:teuthology.orchestra.run.smithi139.stderr: 93.7% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T07:35:30.575 INFO:teuthology.orchestra.run.smithi139.stderr: 91.8% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T07:35:30.894 INFO:teuthology.orchestra.run.smithi162.stderr: 94.2% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T07:35:31.117 INFO:teuthology.orchestra.run.smithi098.stderr: 90.5% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T07:35:32.920 INFO:teuthology.orchestra.run.smithi098.stderr: 93.7% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T07:35:33.613 INFO:teuthology.orchestra.run.smithi162.stderr: 93.6% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T07:35:33.662 INFO:teuthology.orchestra.run.smithi162.stderr: 93.8% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T07:35:33.680 INFO:teuthology.orchestra.run.smithi162.stderr: 93.7% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T07:35:33.756 INFO:teuthology.orchestra.run.smithi098.stderr: 93.7% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T07:35:33.848 INFO:teuthology.orchestra.run.smithi098.stderr: 93.7% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T07:35:34.207 INFO:teuthology.orchestra.run.smithi098.stderr: 93.5% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T07:35:34.209 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-19T07:35:34.209 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m4.249s 2024-09-19T07:35:34.209 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m15.629s 2024-09-19T07:35:34.209 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m0.626s 2024-09-19T07:35:34.320 INFO:teuthology.orchestra.run.smithi139.stderr: 93.8% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T07:35:34.714 INFO:teuthology.orchestra.run.smithi162.stderr: 94.0% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T07:35:34.865 INFO:teuthology.orchestra.run.smithi139.stderr: 93.6% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T07:35:34.866 INFO:teuthology.orchestra.run.smithi139.stderr: 93.7% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T07:35:35.436 INFO:teuthology.orchestra.run.smithi139.stderr: 93.7% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T07:35:35.764 INFO:teuthology.orchestra.run.smithi139.stderr: 94.9% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T07:35:35.821 INFO:teuthology.orchestra.run.smithi162.stderr: 93.7% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T07:35:35.823 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-19T07:35:35.824 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m5.860s 2024-09-19T07:35:35.824 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m22.094s 2024-09-19T07:35:35.824 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m0.734s 2024-09-19T07:35:39.810 INFO:teuthology.orchestra.run.smithi139.stderr: 93.9% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T07:36:31.589 INFO:teuthology.orchestra.run.smithi139.stderr: 93.7% -- replaced with /var/log/ceph/73438718-7656-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T07:36:31.591 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-09-19T07:36:31.591 INFO:teuthology.orchestra.run.smithi139.stderr:real 1m1.627s 2024-09-19T07:36:31.591 INFO:teuthology.orchestra.run.smithi139.stderr:user 1m33.666s 2024-09-19T07:36:31.591 INFO:teuthology.orchestra.run.smithi139.stderr:sys 0m2.983s 2024-09-19T07:36:31.592 INFO:tasks.cephadm:Archiving logs... 2024-09-19T07:36:31.592 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784/remote/smithi098/log 2024-09-19T07:36:31.593 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:36:33.972 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784/remote/smithi139/log 2024-09-19T07:36:33.973 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:36:46.260 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784/remote/smithi162/log 2024-09-19T07:36:46.261 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:36:49.196 INFO:tasks.cephadm:Removing cluster... 2024-09-19T07:36:49.196 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 73438718-7656-11ef-bceb-c7b262605968 --force 2024-09-19T07:36:49.399 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:36:49.675 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 73438718-7656-11ef-bceb-c7b262605968 --force 2024-09-19T07:36:49.878 INFO:teuthology.orchestra.run.smithi139.stdout:Deleting cluster with fsid: 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:36:50.232 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 73438718-7656-11ef-bceb-c7b262605968 --force 2024-09-19T07:36:50.435 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: 73438718-7656-11ef-bceb-c7b262605968 2024-09-19T07:36:50.715 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T07:36:50.716 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:36:50.735 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:36:50.752 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:36:50.769 INFO:tasks.cephadm:Teardown complete 2024-09-19T07:36:50.769 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T07:36:50.781 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T07:36:50.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:36:50.784 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:36:50.794 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:36:50.909 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T07:36:50.921 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T07:36:50.921 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:36:50.924 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:36:50.927 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:36:50.938 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:36:50.939 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:36:50.941 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:36:50.943 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:36:50.944 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-09-19T07:36:50.944 INFO:teuthology.orchestra.run.smithi139.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +776us[ +815us] +/- 43ms 2024-09-19T07:36:50.944 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 34 -2382us[-2382us] +/- 82ms 2024-09-19T07:36:50.944 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 +678us[ +678us] +/- 67ms 2024-09-19T07:36:50.944 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:36:50.945 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:36:50.945 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-19T07:36:50.945 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 38 +766us[ +778us] +/- 43ms 2024-09-19T07:36:50.945 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 -2380us[-2380us] +/- 82ms 2024-09-19T07:36:50.945 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +688us[ +700us] +/- 67ms 2024-09-19T07:36:50.945 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:36:50.946 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:36:50.946 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-19T07:36:50.946 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 +806us[ +792us] +/- 43ms 2024-09-19T07:36:50.946 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 -2392us[-2406us] +/- 82ms 2024-09-19T07:36:50.946 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +669us[ +669us] +/- 68ms 2024-09-19T07:36:50.946 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:36:50.947 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T07:36:50.959 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T07:36:50.959 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T07:36:50.973 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:36:51.071 DEBUG:teuthology.orchestra.run.smithi139:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:36:51.138 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:36:51.206 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:36:51.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:36:51.237 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:36:51.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:36:51.266 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:36:51.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:36:51.294 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T07:36:51.305 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T07:36:51.316 INFO:teuthology.task.internal:Duration was 1842.328505 seconds 2024-09-19T07:36:51.316 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T07:36:51.327 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T07:36:51.328 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:36:51.330 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:36:51.332 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:36:51.369 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:36:51.369 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:36:51.373 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:36:51.857 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T07:36:51.857 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-19T07:36:51.857 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:36:51.881 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-09-19T07:36:51.881 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:36:51.919 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T07:36:51.919 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:36:51.946 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T07:36:51.946 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:36:51.949 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:36:51.962 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:36:52.013 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T07:36:52.014 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:36:52.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:36:52.028 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:36:52.845 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T07:36:52.857 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T07:36:52.857 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:36:52.882 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:36:52.908 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:36:52.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T07:36:52.950 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:36:52.953 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:36:52.956 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:36:52.976 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-19T07:36:52.978 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-09-19T07:36:53.004 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-19T07:36:53.021 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:36:53.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:36:53.046 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:36:53.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:36:53.061 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:36:53.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:36:53.078 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T07:36:53.091 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T07:36:53.093 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784/remote/smithi098 2024-09-19T07:36:53.093 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:36:53.149 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784/remote/smithi139 2024-09-19T07:36:53.149 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:36:53.194 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911784/remote/smithi162 2024-09-19T07:36:53.194 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:36:53.237 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T07:36:53.237 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:36:53.240 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:36:53.243 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:36:53.287 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T07:36:53.301 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T07:36:53.302 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T07:36:53.375 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T07:36:53.376 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:36:53.378 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:36:53.381 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:36:53.393 INFO:teuthology.orchestra.run.smithi098.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:36 /home/ubuntu/cephtest 2024-09-19T07:36:53.393 INFO:teuthology.orchestra.run.smithi139.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:36 /home/ubuntu/cephtest 2024-09-19T07:36:53.396 INFO:teuthology.orchestra.run.smithi162.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 07:36 /home/ubuntu/cephtest 2024-09-19T07:36:53.398 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T07:36:53.447 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T07:36:53.580 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsstress}} duration: 1842.3285052776337 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-19T07:36:53.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T07:36:53.663 INFO:teuthology.run:FAIL